Weather data processing system

Overview

The client’s internal development team spent four months on R&D to find an optimal solution for processing weather satellite data files using DEGRIB (General Regularly-distributed Information in Binary form) and GDAL (Geospatial Data Abstraction Library) tools. However, they were unsuccessful in using these tools to extract and process various types of complex weather components for displaying on maps. As a result, the client engaged Perituza to provide a solution for extracting and processing real-time weather data.

The Challenge

The client was unable to find local developers who specialized in Microsoft SQL spatial database and/or GIS (Geographical Information Systems) and remote sensing experts to find the optimal solution to extract and process binary datafiles.

Since Perituza’s development centers are outside of the US (Ireland, Sri Lanka, India), they had concerns about time zone conflicts, internal network access issues, and potential communication challenges.

Client Perspective

“Having worked with developers from Perituza for nearly two years on different software development projects, I definitely can give my endorsement for the quality of work and level of support that Perituza has provided throughout the duration of the projects. For our projects, Perituza has been a great source of expert knowledge and dedicated talent that has enabled us to develop highly specialized software products for our customers.”
Product Manager

The Solution: Assembling the right team

The client had initially hired a lead database developer from Perituza who had 12 years of experience in database and .NET technologies. He researched and developed a module to extract and populate SQL spatial database in three days. The client was impressed, and hired four additional resources for the project.

The team consisted of:

  • Lead database developer specializing in Microsoft SQL database and Integration Services***
  • GIS consultant with experience in Python and SQL spatial queries**
  • 1 full-time Data Warehouse specialist**
  • 2 full-time SQL developers with .NET C#*

*     Working out of Perituza’s development centres in India

**   Working out of Perituza’s development centres in Sri Lanka

*** Working out of Perituza’s development centres in Ireland


Technologies used:

MS SQL Server, SSIS, C#, Web API, Python, GDAL, DEGRIB

Project management and communication tools used:

Basecamp, Skype, Email


Perituza assigned one of their lead developers to design the database architecture and determine and document database development standards. Within one month, we added three new senior developers who specialized in database, integration services and API technologies and trained them for new tools used for data extraction and ingestion logics.


After six weeks, Perituza brought a consultant with 10+ years of GIS(Geographical Information Systems) experience to the project, who consulted with the technical team to extract and process various types of geodata.

How we addressed time-zone difference concerns

Perituza arranged an Ireland based developer to cover the full 9 AM to 5 PM CST work day, while Perituza’s Sri Lankan and Indian teams were available from 6 AM to 2 PM Central Standard Time Monday through Friday. Perituza’s team also covered additional hours on evenings and weekends as needed.

Offshore and in-house team engagement model

Perituza’s team participated in daily standup meetings with the client’s project manager and client’s in-house team, in addition to meetings with subject matter experts. The team used Email and Skype as primary communication tools.

How we addressed data security and confidentiality concerns

Perituza’s team members signed a strict NDA provided by the client. In order to satisfy network access concerns,we set up IT infrastructure in a way that Perituza’s team didn’t have to access the client’s internal network or systems. Developers worked outside the client’s firewall, and the client managed and controlled development servers in the cloud (including user access privileges).

The Result

Perituza developed a robust real-time data processing system, and the software is now used by their global customers every day.


Client Perspective

““Having worked with developers from Perituza for nearly two years on different software development projects, I definitely can give my endorsement for the quality of work and level of support that Perituza has provided throughout the duration of the projects. For our projects, Perituza has been a great source of expert knowledge and dedicated talent that has enabled us to develop highly specialized software products for our customers.”
Product Manager
  • Share:
Contact us todayto make your project successful