Evaluation of data preprocessing and feature selection process for prediction of hourly PM10 concentration using long short-term memory models

Abstract

Studies have confirmed that PM10, defined as respirable particles with diameters of 10 μm and smaller, has adverse effects on human health and the environment. Various estimation methods are employed to determine the PM10 concentration using historical data on controlling PM10 air pollution, early warning, and protecting public health and the environment. The present study analyses different Long Short-Term Memory (LSTM) models that can predict hourly PM10 concentration. In parallel, the study also investigates the effectiveness of the data preprocessing and feature selection (DPFS) process on the prediction accuracy of the LSTM models. For this purpose, three different LSTM models, namely Vanilla, Bi-Directional, and Stacked, were developed. Then, a comprehensive data preprocessing stage is used to eliminate missing and erroneous data and outliers from real-world raw data, and a feature selection process is applied to extract unnecessary features. The LSTM models consider three air quality parameters, including SO2, O3, and CO, and three meteorological factors, including relative humidity, wind direction, and wind speed. The prediction performances of the LSTM models are compared using the RMSE, MAE and R2 performance index according to whether DPFS is used in the models or not. As a result, when the DPFS process was applied, the proposed LSTM models achieved high prediction performance and can be used to predict hourly PM10 concentrations. Overall, the DPFS process significantly enhanced the developed LSTM models’ prediction performance. Furthermore, the proposed model might be a useful tool for city administrators to make decisions and improve air quality management efforts.