Assessing fusarium oxysporum disease severity in cotton using unmanned aerial system images and a hybrid domain adaptation deep learning time series model

Abstract

Currently, deep learning has achieved remarkable success in estimating plant disease from unmanned aerial system (UAS) images. However, two critical challenges remain unexplored: spatiotemporal variations in disease symptoms and the domain shift between source and target datasets. To overcome these challenges, this paper proposes an approach that incorporates temporal aspects of disease progression using time series analysis. Spatiotemporal information is integrated by combining convolutional neural networks and bidirectional long-short term memory (CNN-BiLSTM) to classify the disease into five severity levels. Various feature extraction methods, including both handcrafted and CNN-based feature extractors, are evaluated. Furthermore, to tackle the problem of domain shift, a feature-level domain adaptation method is proposed. This method aims to learn transferable feature representations that remain consistent despite variations between source and target datasets. This approach enhances the spatiotemporal transferability of the CNN-BiLSTM model, enabling the effective utilisation of historical datasets. The study demonstrates that the CNN-BiLSTM model outperforms traditional time-independent machine-learning methods that rely on handcrafted features. Specifically, the Resnet101-BiLSTM model achieves the highest overall classification accuracy of 89.7% among all tested models evaluated on a one-year dataset. Moreover, it shows superior generalisation with 72.7% accuracy for cross-spatiotemporal disease severity classification using domain adaptation, as demonstrated through two-year experiments. By reducing the domain shift of source and target datasets and harnessing time series high-resolution images obtained throughout the crop growing season, this hybrid approach has substantial potential to advance the assessment of crop disease severity in field conditions.