Improving soil moisture prediction with deep learning and machine learning models

Abstract

Reliable soil moisture (SM) data is critical for effective water resources management, yet its accurate measurement and prediction remain challenging. This study was conducted to develop a deep learning regression network for sub-hourly SM prediction and compare its performance with traditional machine learning models, including the eXtreme gradient boosting (XGB), light gradient-boosting machine (LGB), cat boosting (CB), random forest (RF), k-nearest neighbors (kNN), and long short-term memory (LSTM) models. Sub-hourly SM, electrical conductivity (EC), soil temperature (ST), and weather parameters were collected during research experiments conducted for two years (2020–2021 and 2021–2022) at the Tropical Research and Education Center (TREC), University of Florida. A network of SM sensors and a weather station were installed at the experimental site with 24 plots of green beans and sweet corn under full and three deficit irrigation treatments with four replications. Model performance metrics such as coefficient of determination (r2) and global performance indicator (GPI) were used to evaluate the performance of the models. Results showed that all MLs and DL models performed more than satisfactorily in simulating SM of green beans and sweet corn plots. The testing average r2 and GPI of MLs were 0.83 and 0.02 (green beans) and 0.85 and 0.02 (sweet corn). However, XGB and LGB models outperformed the remaining ML and DL models. The testing r2 and GPI of XGB were 0.86 and 0.014 for green beans, whereas 0.88 and 0.015 for sweet corn. The r2 and GPI values for the LGB were 0.85 and 0.014 for green beans, while 0.88 and 0.015 for sweet corn. Even though DL models took longer time and resources to be trained, the performance of this model was not as accurate as that of XGB and LGB models. However, the performance of DL was better than the LSTM model. The r2 and RMSE of LSTM were 0.68 and 0.02 for green beans and 0.75 and 0.02 for sweet corn. Whereas the r2 and RMSE of DL were 0.84 and 0.015 (green beans) and 0.85 and 0.02 (sweet corn). The ML and DL models performed better in simulating SM of sweet corn plots than green beans. Overall, these results confirmed that the MLs and DL models could be alternative tools for SM prediction for agricultural fields, including for irrigation scheduling and water resources management.