AgroCounters—A repository for counting objects in images in the agricultural domain by using deep-learning algorithms: Framework and evaluation

Abstract

AgroCounters is an open-source repository for counting objects in images in the agricultural domain by utilizing deep-learning algorithms. In this paper, we present the framework of AgroCounters, which integrates state-of-the-art deep learning models, including regression-based counting, detection-based counting, and density-estimation-based counting, to accurately count various agricultural objects, such as fruits, vegetables, and livestock, in single images. The framework utilizes transfer learning techniques to optimize model performance on the limited labeled data available in the agricultural domain. We provide an open-source implementation of AgroCounters, which includes a multitude of algorithms for counting applications and a toolbox that includes metrics, training data tools, visualizations, and a simple installation guide for several open-source implementations of counting methods. We evaluated the performance of AgroCounters on multiple agricultural datasets acquired from RGB sensors, including plant leaves, melons, wheat grains, cherry tomatoes, grapes, apple flowers, bananas (fruit and leaves), pears, and chickens. We compared the results of the various implemented methods over these datasets and showcased the most suitable solution for each. YOLOv5, the most recent of the compared object detectors, provided the best results on all the examined datasets, and there was no clear ’winner’ between Faster-RCNN and RetinaNet. Based on the analyzed datasets, when higher accuracy is required, the direct regression network (DRN) should be used; for small datasets, multiple scale regression (MSR) gives superior results. Based on the developments, we proposed guidelines for developing deep-learning-based counting solutions for agricultural applications, focusing on solutions and best practices for the agricultural domain. Overall, AgroCounters presents a promising solution for automated counting in the agricultural domain, offering significant potential for reducing manual labor, improving crop management, and increasing productivity.