Promotion of Color Sorting in Industrial Systems Using a Deep Learning Algorithm

Abstract

Color sorting is a technological operation performed with the aim of classifying compliant and noncompliant agricultural products in large-capacity industrial systems for agricultural product processing. This paper investigates the application of the YOLOv3 algorithm on raspberry images as a method developed for the detection, localization, and classification of objects based on convolutional neural networks (CNNs). To our knowledge, this is the first time a YOLO algorithm or CNN has been used with original images from the color sorter to focus on agricultural products. Results of the F1 measure were in the 92–97% range. Images in full resolution, 1024 × 1024, produced an average detection time of 0.37 s. The impact of the hyperparameters that define the YOLOv3 model as well as the impact of the application of the chosen augmentative methods on the model are evaluated. The successful classification of stalks, which is particularly challenging due to their shape, small dimensions, and variations, was achieved. The presented model demonstrates the ability to classify noncompliant products into four classes, some of which are appropriate for reprocessing. The software, including a graphic interface that enables the real-time testing of machine learning algorithm, is developed and presented.