Consumer-grade imaging system for NDVI measurement at plant scale by a farmer robot

Abstract

The Normalized Difference Vegetation Index (NDVI) is a valuable indicator of plant vigor that is frequently used in agronomic practices to make timely and targeted decisions with the aim of increasing the productivity of the system. NDVI measurements of large-scale fields are typically performed using remote sensing from satellite and aerial imaging devices. However, due to their low spatial and temporal resolution, these technologies may have limitations in precision viticulture. This paper investigates the potential of a proximal sensing system to characterize the vine foliage that makes use of data collected by a farmer robot equipped with an Intel RealSense D435 camera. The camera includes two infrared (IR) sensors in stereoscopic configuration and one RGB sensor, which provide, for each observation, both infrared and visible red channel information, thus making possible pixel-per-pixel NDVI calculation. Solutions to IR filtering and radiometric calibration issues are proposed that significantly improve measurement accuracy and reliability. Since the camera also provides stereo-based 3D scene reconstruction, depth information can be used to separate the plant canopy from the background before NDVI measurement. At the same time, range data can be employed to extract geometric properties of the crop, such as plant height and/or volume. The system is validated in the field in a commercial vineyard at different phenological stages, from the formation of the berries to leaf discoloration and fall. Experimental results show good agreement compared with ground truth provided by a GreenSeeker, with a mean absolute percentage error in the NDVI estimation of 4.6% and a R2 of 0.87 tested over the whole grapevine cycle. Therefore, the proposed sensing system could be a feasible solution to automated NDVI estimation at plant-scale.