On-Site Soil Monitoring Using Photonics-Based Sensors and Historical Soil Spectral Libraries

Abstract

In-situ infrared soil spectroscopy is prone to the effects of ambient factors, such as moisture, shadows, or roughness, resulting in measurements of compromised quality, which is amplified when multiple sensors are used for data collection. Aiming to provide accurate estimations of common physicochemical soil properties, such as soil organic carbon (SOC), texture, pH, and calcium carbonates based on in-situ reflectance captured by a set of low-cost spectrometers operating at the shortwave infrared region, we developed an AI-based spectral transfer function that maps fields to laboratory spectra. Three test sites in Cyprus, Lithuania, and Greece were used to evaluate the proposed methodology, while the dataset was harmonized and augmented by GEO-Cradle regional soil spectral library (SSL). The developed dataset was used to calibrate and validate machine learning models, with the attained predictive performance shown to be promising for directly estimating soil properties in-situ, even with sensors with reduced spectral range. Aiming to set a baseline scenario, we completed the exact same modeling experiment under laboratory conditions and performed a one-to-one comparison between field and laboratory modelling accuracy metrics. SOC and pH presented an R2 of 0.43 and 0.32 when modeling the in-situ data compared to 0.63 and 0.41 of the laboratory case, respectively, while clay demonstrated the highest accuracy with an R2 value of 0.87 in-situ and 0.90 in the laboratory. Calcium carbonates were also attempted to be modeled at the studied spectral region, with the expected accuracy loss from the laboratory to the in-situ to be observable (R2 = 0.89 for the laboratory and 0.67 for the in-situ) but the reduced dataset variability combined with the calcium carbonate characteristics that are spectrally active in the region outside the spectral range of the used in-situ sensor, induced low RPIQ values (less than 0.50), signifying the importance of the suitable sensor selection.