Pest Recognition Research Articles

Fine-grained recognition algorithm of crop pests based on cross-layer bilinear aggregation and multi-task learning

Fine-grained recognition of crop pests is a crucial concern in the field of agriculture, as the accuracy of recognition and generalization ability directly affect the yield and quality of crops. Aiming at the characteristics of crop pests with a wide variety of species, small inter-class and large intra-class differences in external morphology, as well as the problems of uneven sample distribution and noisy labels in fine-grained image datasets under complex environments, we propose a fine-grained recognition model of crop pests (MT-MACLBPHSNet) based on cross-layer bilinear aggregation and multi-task learning, which consists of three key modules: the backbone network module, the cross-layer bilinear aggregation module, and the multi-task learning module. A new union loss function is designed in the primary task of the multi-task learning module, which is used to alleviate the two problems existing in the model training fine-grained image datasets. The experimental results show that the model effectively balances the model complexity and recognition accuracy in a comparative analysis with several existing excellent network models on the IP102-CP13 dataset, with the recognition accuracy reaching 75.37%, which is 7.06% higher than the Baseline model, and the F1-score reaching 67.06%. Additionally, the generalization of the model is also verified on the IP102-VP16 dataset, and the model outperforms most of the models in terms of recognition accuracy and generalization ability, which can provide an effective reference for fine-grained recognition of crop pests.

An Improved Multi-Scale Feature Extraction Network for Rice Disease and Pest Recognition

In the process of rice production, rice pests are one of the main factors that cause rice yield reduction. To implement prevention and control measures, it is necessary to accurately identify the types of rice pests and diseases. However, the application of image recognition technologies focused on the agricultural field, especially in the field of rice disease and pest identification, is relatively limited. Existing research on rice diseases and pests has problems such as single data types, low data volume, and low recognition accuracy. Therefore, we constructed the rice pest and disease dataset (RPDD), which was expanded through data enhancement methods. Then, based on the ResNet structure and the convolutional attention mechanism module, we proposed a Lightweight Multi-scale Feature Extraction Network (LMN) to extract multi-scale features at a finer granularity. The proposed LMN model achieved an average classification accuracy of 95.38% and an F1-Score of 94.5% on the RPDD. The parameter size of the model is 1.4 M, and the FLOPs is 1.65 G. The results suggest that the LMN model performs rice disease and pest classification tasks more effectively than the baseline ResNet model by significantly reducing the model size and improving accuracy.

Method of intelligent agricultural pest image recognition based on machine vision algorithm

In recent years, people have paid increasing attention to smart agriculture. Its core technology is to combine information technology such as computer vision with agricultural production. In agricultural production, the occurrence of pests and diseases can seriously affect agricultural production. Therefore, in agricultural production, the diagnosis and identification of agricultural pests and diseases is the key to improve crop yield. Traditional machine vision methods often rely on feature extraction and classifier design, lack of strong learning and generalization ability, and can not effectively control crop diseases and pests in a timely manner. In order to solve this problem, this paper designs an agricultural pest recognition system based on machine vision algorithm of fuzzy recognition theory, and applies it to agricultural pest recognition. Compared with the traditional machine vision method, this method has obvious advantages, and can effectively improve the monitoring and early warning ability of crop diseases and pests. The experimental results show that the highest recognition rate of the machine vision optimization algorithm based on fuzzy recognition theory is 98.06%, and the lowest recognition error rate is 5.83%. It can be seen that the machine vision recognition algorithm based on fuzzy recognition theory has good recognition effect and can be used in agricultural pest recognition system to help farmers carry out agricultural production and reduce economic losses caused by diseases and pests.

Few-shot agricultural pest recognition based on multimodal masked autoencoder

Visual recognition methods based on deep convolutional neural networks have performed well in pest diagnosis and have gradually become a research hotspot. However, agricultural pest recognition faces challenges such as few-shot learning, category imbalance, similarity in appearance, and small pest targets. Existing deep learning-based pest recognition methods typically rely solely on unimodal image data, which results in a model whose recognition performance is heavily dependent on the size and quality of the annotated training dataset. However, the construction of large-scale, high-quality pest datasets requires significant economic and technical costs, limiting the practical generalization of existing methods for pest recognition. To address these challenges, this paper proposes a few-shot pest recognition model called MMAE (multimodal masked autoencoder). Firstly, the masked autoencoder of MMAE integrates self-supervised learning, which can be applied to few-shot datasets and improves recognition accuracy. Secondly, MMAE embeds textual modal information on top of image modal information, thus improving the performance of pest recognition by utilizing the correlation and complementarity between the two modalities. The experimental results show that MMAE is the most effective for pest identification compared with the existing excellent models, and the identification accuracy is as high as 98.12%, which is 1.61 percentage points higher than the current state-of-the-art MAE method. The work in this paper shows that the introduction of textual information can assist the visual coder in capturing agricultural pest characterization information at a higher level of granularity, providing a methodological reference for solving the problem of agricultural pest recognition under few-shot conditions.

TTPRNet: A Real-Time and Precise Tea Tree Pest Recognition Model in Complex Tea Garden Environments

The accurate identification of tea tree pests is crucial for tea production, as it directly impacts yield and quality. In natural tea garden environments, identifying pests is challenging due to their small size, similarity in color to tea trees, and complex backgrounds. To address this issue, we propose TTPRNet, a multi-scale recognition model designed for real tea garden environments. TTPRNet introduces the ConvNext architecture into the backbone network to enhance the global feature learning capabilities and reduce the parameters, and it incorporates the coordinate attention mechanism into the feature output layer to improve the representation ability for different scales. Additionally, GSConv is employed in the neck network to reduce redundant information and enhance the effectiveness of the attention modules. The NWD loss function is used to focus on the similarity between multi-scale pests, improving recognition accuracy. The results show that TTPRNet achieves a recall of 91% and a mAP of 92.8%, representing 7.1% and 4% improvements over the original model, respectively. TTPRNet outperforms existing object detection models in recall, mAP, and recognition speed, meeting real-time requirements. Furthermore, the model integrates a counting function, enabling precise tallying of pest numbers and types and thus offering practical solutions for accurate identification in complex field conditions.

An efficient zero-labeling segmentation approach for pest monitoring on smartphone-based images

Timely and precise farm inspection, which involves the identification and recognition of harmful insects and diseases, is crucial for safeguarding crop production. Traditional vision-based pest recognition methods typically require extensive annotated data for each pest species and a lengthy training process. This approach is time-consuming, labor-intensive, and prone to human error. Zero-shot learning offers a potential solution by enabling pest segmentation and control without requiring explicit training data. This study supports farmers in automatically identifying ten common pests and their precise locations in real-world outdoor environments. The zero-shot pest segmentation is based on a hybrid approach combining Explainable Contrastive Language-Image Pre-training (ECLIP) and Segment-Anything (SAM). Moreover, an optimized super-resolution model and various data augmentation methods are implemented to improve the quality of the dataset. Lastly, a mask post-processing step is applied to remove highly overlapping segmented masks and noise blobs caused by the complex background. The mean Intersection over Union (mIoU) of 66.5 % on the validation set demonstrates the potential of zero-shot methods for automated pest segmentation during farm inspections. This research lays the foundation for accurate pest monitoring systems capable of adapting to new pests, ultimately improving agricultural productivity.

SpemNet: A Cotton Disease and Pest Identification Method Based on Efficient Multi-Scale Attention and Stacking Patch Embedding.

We propose a cotton pest and disease recognition method, SpemNet, based on efficient multi-scale attention and stacking patch embedding. By introducing the SPE module and the EMA module, we successfully solve the problems of local feature learning difficulty and insufficient multi-scale feature integration in the traditional Vision Transformer model, which significantly improve the performance and efficiency of the model. In our experiments, we comprehensively validate the SpemNet model on the CottonInsect dataset, and the results show that SpemNet performs well in the cotton pest recognition task, with significant effectiveness and superiority. The SpemNet model excels in key metrics such as precision and F1 score, demonstrating significant potential and superiority in the cotton pest and disease recognition task. This study provides an efficient and reliable solution in the field of cotton pest and disease identification, which is of great theoretical and applied significance.

Residual swin transformer for classifying the types of cotton pests in complex background.

Cotton pests have a major impact on cotton quality and yield during cotton production and cultivation. With the rapid development of agricultural intelligence, the accurate classification of cotton pests is a key factor in realizing the precise application of medicines by utilize unmanned aerial vehicles (UAVs), large application devices and other equipment. In this study, a cotton insect pest classification model based on improved Swin Transformer is proposed. The model introduces the residual module, skip connection, into Swin Transformer to improve the problem that pest features are easily confused in complex backgrounds leading to poor classification accuracy, and to enhance the recognition of cotton pests. In this study, 2705 leaf images of cotton insect pests (including three insect pests, cotton aphids, cotton mirids and cotton leaf mites) were collected in the field, and after image preprocessing and data augmentation operations, model training was performed. The test results proved that the accuracy of the improved model compared to the original model increased from 94.6% to 97.4%, and the prediction time for a single image was 0.00434s. The improved Swin Transformer model was compared with seven kinds of classification models (VGG11, VGG11-bn, Resnet18, MobilenetV2, VIT, Swin Transformer small, and Swin Transformer base), and the model accuracy was increased respectively by 0.5%, 4.7%, 2.2%, 2.5%, 6.3%, 7.9%, 8.0%. Therefore, this study demonstrates that the improved Swin Transformer model significantly improves the accuracy and efficiency of cotton pest detection compared with other classification models, and can be deployed on edge devices such as utilize unmanned aerial vehicles (UAVs), thus providing an important technological support and theoretical basis for cotton pest control and precision drug application.

Overview of Pest Detection and Recognition Algorithms

Detecting and recognizing pests are paramount for ensuring the healthy growth of crops, maintaining ecological balance, and enhancing food production. With the advancement of artificial intelligence technologies, traditional pest detection and recognition algorithms based on manually selected pest features have gradually been substituted by deep learning-based algorithms. In this review paper, we first introduce the primary neural network architectures and evaluation metrics in the field of pest detection and pest recognition. Subsequently, we summarize widely used public datasets for pest detection and recognition. Following this, we present various pest detection and recognition algorithms proposed in recent years, providing detailed descriptions of each algorithm and their respective performance metrics. Finally, we outline the challenges that current deep learning-based pest detection and recognition algorithms encounter and propose future research directions for related algorithms.

Pest-ConFormer: A hybrid CNN-Transformer architecture for large-scale multi-class crop pest recognition

Crop pests are acknowledged as the major factors in reducing the yield and quality of agricultural production worldwide. It is an urgent necessity to recognize crop pests accurately to protect the crop in the early stage to reduce the loss for the agricultural economy. Due to the ecological characteristics of the crop pests and the complex background in fields, the crop pests show high inter-class similarity and significant intra-class variation in external morphology appearance, which makes current recognition methods suffer from low classification accuracy and poor generalization ability in complex natural environment recognition tasks. To tackle this problem, a hybrid convolutional neural network and transformer-based model, namely Pest-ConFormer, featured with multi-scale weakly supervised feature selection mechanisms is proposed, which has shown excellent multi-scale discriminative feature extraction in fine-grained visual classification (FGVC) tasks. This method employs a hybrid convolution-transformer encoder architecture pre-training in a self-supervised masked autoencoder manner as a backbone to learn pests’ highly discriminative features across various scales. Next, a dual-path feature aggregation structure with a top-down FPN-like feature pathway and a bottom-up PANet-like feature pathway based on attention mechanisms is designed to learn high-level global context information and low-level local detailed feature representation. Thirdly, a fine-grained classification module using weakly supervised learning is introduced to select the discriminative feature points in different pyramidal levels. Then, these feature points are fed into a graph convolutional network to accomplish classification. Several experiments are conducted on the large-scale multi-class IP102 benchmark dataset, and the proposed method achieves an accuracy of 77.81 % regarding crop pest recognition. The experimental results indicate that our approach outperforms other state-of-the-art methods by nearly 2 percent points, demonstrating that the proposed hybrid architecture with dual-path feature aggregation and fine-grained classification modules can be more effective in the crop pest recognition field than CNN-based methods and can be deployed in the practical natural environment. The source code will be available at https://github.com/mwfang/pestconformer.

Cascaded Aggregation Convolution Network for Salient Grain Pests Detection.

Pest infestation poses significant threats to grain storage due to pests' behaviors of feeding, respiration, excretion, and reproduction. Efficient pest detection and control are essential to mitigate these risks. However, accurate detection of small grain pests remains challenging due to their small size, high variability, low contrast, and cluttered background. Salient pest detection focuses on the visual features that stand out, improving the accuracy of pest identification in complex environments. Drawing inspiration from the rapid pest recognition abilities of humans and birds, we propose a novel Cascaded Aggregation Convolution Network (CACNet) for pest detection and control in stored grain. Our approach aims to improve detection accuracy by employing a reverse cascade feature aggregation network that imitates the visual attention mechanism in humans when observing and focusing on objects of interest. The CACNet uses VGG16 as the backbone network and incorporates two key operations, namely feature enhancement and feature aggregation. These operations merge the high-level semantic information and low-level positional information of salient objects, enabling accurate segmentation of small-scale grain pests. We have curated the GrainPest dataset, comprising 500 images showcasing zero to five or more pests in grains. Leveraging this dataset and the MSRA-B dataset, we validated our method's efficacy, achieving a structure S-measure of 91.9%, and 90.9%, and a weighted F-measure of 76.4%, and 91.0%, respectively. Our approach significantly surpasses the traditional saliency detection methods and other state-of-the-art salient object detection models based on deep learning. This technology shows great potential for pest detection and assessing the severity of pest infestation based on pest density in grain storage facilities. It also holds promise for the prevention and control of pests in agriculture and forestry.

Causality-inspired crop pest recognition based on Decoupled Feature Learning.

Ensuring the efficient recognition and management of crop pests is crucial for maintaining the balance in global agricultural ecosystems and ecological harmony. Deep learning-based methods have shown promise in crop pest recognition. However, prevailing methods often fail to address a critical issue: biased pest training dataset distribution stemming from the tendency to collect images primarily in certain environmental contexts, such as paddy fields. This oversight hampers recognition accuracy when encountering pest images dissimilar to training samples, highlighting the need for a novel approach to overcome this limitation. We introduce the Decoupled Feature Learning (DFL) framework, leveraging causal inference techniques to handle training dataset bias. DFL manipulates the training data based on classification confidence to construct different training domains and employs center triplet loss for learning class-core features. The proposed DFL framework significantly boosts existing baseline models, attaining unprecedented recognition accuracies of 95.33%, 92.59%, and 74.86% on the Li, DFSPD, and IP102 datasets, respectively. Extensive testing on three pest datasets using standard baseline models demonstrates the superiority of DFL in pest recognition. The visualization results show that DFL encourages the baseline models to capture the class-core features. The proposed DFL marks a pivotal step in mitigating the issue of data distribution bias, enhancing the reliability of deep learning in agriculture. © 2024 Society of Chemical Industry.

Deep migration learning-based recognition of diseases and insect pests in Yunnan tea under complex environments

BackgroundThe occurrence, development, and outbreak of tea diseases and pests pose a significant challenge to the quality and yield of tea, necessitating prompt identification and control measures. Given the vast array of tea diseases and pests, coupled with the intricacies of the tea planting environment, accurate and rapid diagnosis remains elusive. In addressing this issue, the present study investigates the utilization of transfer learning convolution neural networks for the identification of tea diseases and pests. Our objective is to facilitate the accurate and expeditious detection of diseases and pests affecting the Yunnan Big leaf kind of tea within its complex ecological niche.ResultsInitially, we gathered 1878 image data encompassing 10 prevalent types of tea diseases and pests from complex environments within tea plantations, compiling a comprehensive dataset. Additionally, we employed data augmentation techniques to enrich the sample diversity. Leveraging the ImageNet pre-trained model, we conducted a comprehensive evaluation and identified the Xception architecture as the most effective model. Notably, the integration of an attention mechanism within the Xeption model did not yield improvements in recognition performance. Subsequently, through transfer learning and the freezing core strategy, we achieved a test accuracy rate of 98.58% and a verification accuracy rate of 98.2310%.ConclusionsThese outcomes signify a significant stride towards accurate and timely detection, holding promise for enhancing the sustainability and productivity of Yunnan tea. Our findings provide a theoretical foundation and technical guidance for the development of online detection technologies for tea diseases and pests in Yunnan.

Use of Computer Vision Techniques for Recognition of Diseases and Pests in Tomato Plants

Use of Computer Vision Techniques for Recognition of Diseases and Pests in Tomato Plants

Enhanced Pest Recognition Using Multi-Task Deep Learning with the Discriminative Attention Multi-Network

Accurate recognition of agricultural pests is crucial for effective pest management and reducing pesticide usage. In recent research, deep learning models based on residual networks have achieved outstanding performance in pest recognition. However, challenges arise from complex backgrounds and appearance changes throughout the pests’ life stages. To address these issues, we develop a multi-task learning framework utilizing the discriminative attention multi-network (DAM-Net) for the main task of recognizing intricate fine-grained features. Additionally, our framework employs the residual network-50 (ResNet-50) for the subsidiary task that enriches texture details and global contextual information. This approach enhances the main task with comprehensive features, improving robustness and precision in diverse agricultural scenarios. An adaptive weighted loss mechanism dynamically adjusts task loss weights, further boosting overall accuracy. Our framework achieves accuracies of 99.7% on the D0 dataset and 74.1% on the IP102 dataset, demonstrating its efficacy in training high-performance pest-recognition models.

Farmland pest recognition based on Cascade RCNN Combined with Swin-Transformer

Farmland pest recognition based on Cascade RCNN Combined with Swin-Transformer

AM-MSFF: A Pest Recognition Network Based on Attention Mechanism and Multi-Scale Feature Fusion.

Traditional methods for pest recognition have certain limitations in addressing the challenges posed by diverse pest species, varying sizes, diverse morphologies, and complex field backgrounds, resulting in a lower recognition accuracy. To overcome these limitations, this paper proposes a novel pest recognition method based on attention mechanism and multi-scale feature fusion (AM-MSFF). By combining the advantages of attention mechanism and multi-scale feature fusion, this method significantly improves the accuracy of pest recognition. Firstly, we introduce the relation-aware global attention (RGA) module to adaptively adjust the feature weights of each position, thereby focusing more on the regions relevant to pests and reducing the background interference. Then, we propose the multi-scale feature fusion (MSFF) module to fuse feature maps from different scales, which better captures the subtle differences and the overall shape features in pest images. Moreover, we introduce generalized-mean pooling (GeMP) to more accurately extract feature information from pest images and better distinguish different pest categories. In terms of the loss function, this study proposes an improved focal loss (FL), known as balanced focal loss (BFL), as a replacement for cross-entropy loss. This improvement aims to address the common issue of class imbalance in pest datasets, thereby enhancing the recognition accuracy of pest identification models. To evaluate the performance of the AM-MSFF model, we conduct experiments on two publicly available pest datasets (IP102 and D0). Extensive experiments demonstrate that our proposed AM-MSFF outperforms most state-of-the-art methods. On the IP102 dataset, the accuracy reaches 72.64%, while on the D0 dataset, it reaches 99.05%.

Research on agricultural environmental monitoring Internet of Things based on edge computing and deep learning

Abstract With the continuous advancement of agricultural Internet of Things (IoT) technologies, real-time monitoring of agricultural environments has become increasingly significant. This monitoring provides valuable information on pest and disease occurrences and corresponding ecological conditions. However, as the agricultural environments have extensive coverage, the number of monitoring IoT devices and the volume of information will rapidly increase. This leads to a surge in network traffic and computing demands. To address this issue, this article proposes an agricultural environmental monitoring IoT system that utilizes edge computing and deep learning technologies. It combines the Long-Range Wide Area Network (LoRaWAN) for long-range transmission with pest recognition and counting modules. By offloading workloads traditionally processed in the cloud to edge nodes, the proposed system effectively reduces transmission and cloud computing pressures for the agricultural monitoring IoT. Simulation experiments demonstrate stable LoRaWAN protocol-based data transmission at the edge, with an overall packet loss rate of less than 5%, meeting the transmission quality requirements. Moreover, this article investigates a pest recognition and counting method based on deep learning technology. Pest images, captured by monitoring nodes, are recognized and counted online using the TensorFlow framework. Experimental results indicate an accuracy of 89% in pest recognition. By digitally transmitting pest image recognition results to the cloud, the proposed system significantly alleviates transmission and cloud computing pressures for the monitoring IoT.

EResNet-SVM: an overfitting-relieved deep learning model for recognition of plant diseases and pests.

The accurate recognition and early warning for plant diseases and pests are a prerequisite of intelligent prevention and control for plant diseases and pests. As a result of the phenotype similarity of the hazarded plant after plant diseases and pests occur, as well as the interference of the external environment, traditional deep learning models often face the overfitting problem in phenotype recognition of plant diseases and pests, which leads to not only the slow convergence speed of the network, but also low recognition accuracy. Motivated by the above problems, the present study proposes a deep learning model EResNet-support vector machine (SVM) to alleviate the overfitting for the recognition and classification of plant diseases and pests. First, the feature extraction capability of the model is improved by increasing feature extraction layers in the convolutional neural network. Second, the order-reduced modules are embedded and a sparsely activated function is introduced to reduce model complexity and alleviate overfitting. Finally, a classifier fused by SVM and fully connected layers are introduced to transforms the original non-linear classification problem into a linear classification problem in high-dimensional space to further alleviate the overfitting and improve the recognition accuracy of plant diseases and pests. The ablation experiments further demonstrate that the fused structure can effectively alleviate the overfitting and improve the recognition accuracy. The experimental recognition results for typical plant diseases and pests show that the proposed EResNet-SVM model has 99.30% test accuracy for eight conditions (seven plant diseases and one normal), which is 5.90% higher than the original ResNet18. Compared with the classic AlexNet, GoogLeNet, Xception, SqueezeNet and DenseNet201 models, the accuracy of the EResNet-SVM model has improved by 5.10%, 7%, 8.10%, 6.20% and 1.90%, respectively. The testing accuracy of the EResNet-SVM model for 6 insect pests is 100%, which is 3.90% higher than that of the original ResNet18 model. This research provides not only useful references for alleviating the overfitting problem in deep learning, but also a theoretical and technical support for the intelligent detection and control of plant diseases and pests. © 2024 Society of Chemical Industry.

Ethno-knowledge of family farmers associated with the control of Plutella xylostella L. 1758 (Lepidoptera: Plutellidae) in kale production

The species Brassica oleracea L. covers the varieties of kale, broccoli, and cabbage, being these crops mainly commercially exploited and cultivated by family farming in Brazil. Over the years, farmers adapt and better understand the problems related to pests and their life cycles, they gain knowledge from their daily work, which becomes important in the decision-making process regarding crops. Plutella xylostella L. is the main pest that attacks crucifers; when poorly controlled, it can compromise the entire production. The objective of this work was to evaluate the ethno-knowledge associated with the control of P. xylostella among family farmers who grow kale. 42 producers were selected by the snowball sampling technique, in the municipalities of Lucas do Rio Verde, Sorriso, and Sinop, Brazil, who answered a semi-structured questionnaire about their social profile, production and ethno-knowledge associated with the control of P. xylostella. It was found that there are several difficulties concerning the production of kale and pest recognition, the production techniques used, and access to information; in many of these factors, technical assistance has contributed to minimizing them through the dissemination of modern and effective techniques. Thus, knowing the role of ethno-knowledge of cabbage producers can contribute to the correct identification of damages in the crop and the pests that causes them, and can prevent the improper use of pesticides by farmers, leading to an efficient control. Furthermore, it can contribute to the valorization of dialogue, the exchange of knowledge and the resolution of problems.