Orchard classification based on super-pixels and deep learning with sparse optical images

Abstract

Reliable and accurate classification of orchards is important for the dynamic monitoring of large-scale orchards and food security evaluation. At present, the very similar spectral profiles of different fruit trees and the high susceptibility of optical data to interference by weather conditions limit the resolution of orchard classification. Synthetic Aperture Radar (SAR) imagery provides an advanced solution to this problem, with the advantages of being immune to weather conditions and advances in deep learning techniques. This paper presents an orchard classification model (STCM) with optical and SAR fusion, which integrates the advantages of the Simple Non-Iterative Clustering (SNIC) super-pixel algorithm with a deep learning algorithm based on a multi-headed attention mechanism, and it achieves the best classification accuracy of above 0.82 in comparison with existing deep learning models. Meanwhile, the model has exceptional classification accuracy and robustness in a study area with fragmented plots, many fruit tree species, and various distributions of optical images. In the absence of optical data, the classification accuracy of the STCM model using only SAR data is around 0.70, which makes the model have a promising potential application value. This study provides a technical solution for accurately obtaining different orchard categories in high-resolution remotely sensed orchard images. The study helps to improve the management and operation of orchards and provides a strong basis for decision-making in the fruit industry to enhance the sustainability of the global fruit industry.