ETL process for water resources and demographics data: an open source data processing tools and visualizations

Abstract

Open data portals have become increasingly popular in recent years as more and more governments, organizations, and businesses recognize the benefits of making data publicly available for researchers, analysts and decision-making platforms. Many governments have launched their portal at the national, regional, and local levels. In addition to traditional government datasets such as demographics, finance, and transportation, open data portals are increasingly providing access to a broader range of data types, including environmental data, health data, and social media data. Many open data portals are offering improved tools for data analysis and visualization, making it easier for users to extract insights from the data. Increased collaboration and engagement between government, businesses, and the public, with features such as forums and hackathons. The purpose of this research is to find a way to automate data collecting and visualization processes by using different open source technologies and promoting Open Data Portal by using environmental data, especially water resources and pollution data from the Agency for Strategic Planning and Reforms of the Republic of Kazakhstan, Bureau of National Statistics.