Big Data Analysis Framework for Water Quality Indicators with Assimilation of IoT and ML

Abstract

According to the United Nations, the Sustainable Development Goal ‘6’ seeks to ensure the availability and sustainable management of water for all. Digital technologies, such as big data, Internet of Things (IoT), and machine learning (ML) have a significant role and capability to meet the goal. Water quality analysis in any region is critical to identify and understand the standard of water quality and the quality of water is analyzed based on water quality parameters (WQP). Currently, water pollution and the scarcity of water are two major concerns in the region of Uttarakhand, and the analysis of water before it is supplied for human consumption has gained attention. In this study, a big data analytics framework is proposed to analyze the water quality parameters of 13 districts of Uttarakhand and find the correlation among the parameters with the assimilation of IoT and ML. During the analysis, statistical and fractal methods are implemented to understand the anomalies between the water quality parameters in 13 districts of Uttarakhand. The variation in WQP is analyzed using a random forest (RF) model, and the dataset is segmented location wise and the mean, mode, standard deviation, median, kurtosis, and skewness of time series datasets are examined. The mean of the parameters is adjusted with the coefficient of variation based on the standard values of each parameter. The turbidity in almost all the experimental sites has a normal distribution, with the lowest mean value (0.352 mg/L) and highest (11.9 mg/L) in the Pauri Garhwal and Almora districts, respectively. The pH of the water samples is observed to be in the standard range in all the experimental sites, with average and median values being nearly identical, at 7.189 and 7.20, respectively. However, the pH mode is 0.25. The Cl− concentration varies with mean values from the lowest (0.46 mg/L) to the highest (35.2 mg/L) over the experimental sites, i.e., the Bageshwar and Rudraprayag districts, respectively. Based on the analysis, it was concluded that the water samples were found to be safe to drink and in healthy condition in almost all the districts of the state Uttarakhand, except for the Haridwar district, where some increase in contaminants was observed.