The Meteorological Services Department (MSD) in Zimbabwe is experiencing huge costs in transferring data of over Gigabytes from its different models of automatic weather stations into centralized database at Head Quarters (HQ) Belvedere in Harare. However, surveys indicate that emerging technologies of big data analytics such as Hadoop MapReduce can be extended into weather data management offering multiplicity of functions that includes: prediction, management of transmission of data and also managing the range of weather elements to monitor at anytime and anywhere. This study therefore sought to design and develop an experimental set-up to understand how Hadoop MapReduce can be used to manage data files from various weather stations simulated as Application Programming Interface (APIs). The developed system was conducted entirely in a cloud environment and the results suggest that Hadoop MapReduce function is an appropriate big data tool to manage weather data and offers better options especially for cash strapped organizations such as Meteorological Services Department (MSD). Adoption of MapReduce is economic and elastic to accord changing weather data management requirements. The research used a small dataset of 100 records which might offer comprehensive model for use for practical purposes. Further studies with more realistic huge datasets might be pertinent.
Read full abstract