Development of a wide-range soft sensor for predicting wastewater BOD5 using an eXtreme gradient boosting (XGBoost) machine

Abstract

In wastewater monitoring, detecting extremely high pollutant concentrations is necessary to properly calibrate the treatment process. However, existing hardware sensors have a limited linear range which may fail to measure extremely high levels of pollutants; and likewise, the conventional “soft” model sensors are not suitable for the highly-skewed data distributions either. This study developed a new soft sensor by using eXtreme Gradient Boosting (XGBoost) machine learning to ‘measure’ the wastewater organics (in terms of 5-day biochemical oxygen demand (BOD5)). The soft sensor was tested on influent and effluent BOD5 of two different wastewater treatment plants to validate the results. The model results showed that XGBoost can detect these extreme values better than conventional soft sensors. This new soft sensor can function using a sparse input matrix via XGBoost's sparsity awareness algorithm - which can address the limitation of the conventional soft sensor with the fallibility of supporting hardware sensors even.