A fast and data-efficient deep learning framework for multi-class fruit blossom detection

Abstract

Automatic fruit blossom detection plays a crucial role in agricultural intelligence to predict fruit yield. Existing deep learning methods for vision-based fruit blossom detection oftentimes rely on large labeled samples and are tailor for a single category of fruit blossoms, limiting their flexibility and adaptability in real applications. In this paper, a fast and data-efficient framework is proposed to achieve multi-class fruit blossom detection using few labeled samples, which not only enhances the flexibility of model training by reducing the need for extensive samples but also extends the model’s applicability to a wider range of blossom categories. Specifically, the proposed framework incorporates the paradigm of few-shot object detection into a lightweight two-stage detector named CenterNet2. To improve the recall of blossom proposals, we introduce a location guidance module (LGM) to highlight foreground regions in query images that bear resemblance to the blossom reference provided by support images. Moreover, a contrastive learning scheme (CLS) is introduced to further distinguish fruit blossom categories with similar appearances, enhancing classification accuracy. Experimental results demonstrated that our framework achieved comparable performance to existing state-of-the-art models, with a mean average precision of 74.33% over 12 categories of fruit blossoms and a frame per second rate of 47. In summary, our proposed framework can reduce data dependency and enhance flexibility of existing deep learning detectors, making it a promising solution for automatic monitoring in real-world agricultural applications.