A deep learning framework for crop mapping with reconstructed Sentinel-2 time series images

Abstract

Timely and accurate access to regional scale crop plant area and spatial distribution is essential for regional agricultural production and food security, especially in the context of global population growth and climate change. Deep learning has become prevalent in crop mapping under complex conditions due to its powerful feature extraction and nonlinear ability. This study proposes a time-series image classification framework using Attention-based Bidirectional Gated Recurrent Unit (A-BiGRU) to map rice, maize, and soybean in Fujin, China, from reconstructed Sentinel-2 time-series images. Firstly, the reconstructed Sentinel-2 time-series images with 10 spectral dimensions and 22 temporal dimensions were obtained by linear interpolation and Savitzky-Golay (SG) filter. Then, a neural network, the A-BiGRU was developed to identify different crops by taking advantage of their unique growth patterns. The attention mechanism enables temporal neural networks to focus on the critical growth periods of crops. Additionally, the structure of GRU is simpler than that of long short-term memory (LSTM) and simple recurrent neural network (SRNN), which reduces the number of parameters and alleviates overfitting. Compared to GRU, BiGRU can fully uses the time-series information of the entire crop growth cycle. To assess the effectiveness of the proposed method, we compared two deep learning methods (LSTM and SRNN) and three widely used non-deep learning classifiers (Spectral Angle Mapping (SAM), Support Vector Machine (SVM)) and eXtreme Gradient Boosting (XGBoost). The results demonstrate that A-BiGRU achieved the highest accuracy, with an overall accuracy of 0.9804, a macro F1 score of 0.9788 and a kappa score of 0.9714. We also selected four typical regions and compared the classification results with optical images, which showed that the proposed method has a good recognition effect. Therefore, the A-BiGRU method is capable of achieving high-precision crop mapping.