Abstract

In environmental research, missing data are often a challenge for statistical modeling. This paper addressed some advanced techniques to deal with missing values in a data set measuring air quality using a multiple imputation (MI) approach. MCAR, MAR, and NMAR missing data techniques are applied to the data set. Five missing data levels are considered: 5%, 10%, 20%, 30%, and 40%. The imputation method used in this paper is an iterative imputation method, missForest, which is related to the random forest approach. Air quality data sets were gathered from five monitoring stations in Kuwait, aggregated to a daily basis. Logarithm transformation was carried out for all pollutant data, in order to normalize their distributions and to minimize skewness. We found high levels of missing values for (18.4%), (18.5%), (57.4%), (19.0%), and (18.2%) data. Climatological data (i.e., air temperature, relative humidity, wind direction, and wind speed) were used as control variables for better estimation. The results show that the MAR technique had the lowest RMSE and MAE. We conclude that MI using the missForest approach has a high level of accuracy in estimating missing values. MissForest had the lowest imputation error (RMSE and MAE) among the other imputation methods and, thus, can be considered to be appropriate for analyzing air quality data.

Highlights

  • Air quality monitoring is conducted with the aim of protecting public health

  • We estimate the values of all the missing values directly, by use of a random forest that is trained on the observed data set, where X is the matrix of the complete data

  • The power of MI lies in its multiple imputations being able to be performed for each variable in the data set

Read more

Summary

Introduction

Air quality monitoring is conducted with the aim of protecting public health. Numerous air contaminants have been found to have harmful effects on human health. A major challenge in air quality data management is determining how to deal with missing data values. Missing information in data sets occurs for multiple reasons, such as impaired equipment, insufficient sampling frequency, hardware problems, and human error [1]. Incomplete data sets affect the applicability of specific analyses, such as receptor modeling, which generally requires a complete data matrix [2]. The occurrence of missing data, no matter how infrequent, can bias findings on the relationships between air contaminants and health outcomes [3]. Incomplete data matrices may provide outcomes that vary significantly, compared to the results from complete data sets [4]

Objectives
Methods
Results
Discussion
Conclusion
Full Text
Paper version not known

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call