Detecting volunteer cotton plants in a corn field with deep learning on UAV remote-sensing imagery

Abstract

Volunteer cotton (VC) plants growing in the fields of inter-seasonal and rotated crops, like corn, can serve as hosts to boll weevil pests once they reach pin-head square stage (5–6 leaf stage). The VC plants therefore need to be detected, located, and destroyed or sprayed. In this paper, we present a study on using deep learning (DL) to detect VC plants in a corn field using RGB images collected with an unmanned aerial vehicle (UAV). The objectives were (i) to determine whether the YOLOv3 DL algorithm could be used for VC detection in a corn field based on UAV-derived RGB images, and (ii) to investigate the behavior of YOLOv3 on images at three different pixel scales (320 × 320, S1; 416 × 416, S2; and 512 × 512, S3). The metrics used to evaluate the results were average precision (AP), mean average precision (mAP) and F1-score at 95 % confidence level. It was found that YOLOv3 was able to detect VC plants in corn field at an average detection accuracy of more than 80 %, F1-score of 78.5 % and mAP of 80.38 %. With respect to images size, no significant differences existed for mAP among the three scales, but a significant difference was found for AP between S1 and S3 (p = 0.04) and between S2 and S3 (p = 0.02). A significant difference was also found for F1-score between S2 and S3 (p = 0.02). The overall goal of this study was to minimize boll weevil pest infestation by maximizing the true positive detection of VC plants in a corn field which is represented by the mAP values. The lack of significant differences of these at all three scales indicated that the trained YOLOv3 model can be used for VC detection irrespective of the three input image sizes. The capability of YOLOv3 to detect VC plants demonstrates the potential of DL algorithms for real-time detection and mitigation using computer vision and a spot-spray capable UAV.