Performance Evaluation of Deep Learning based Mandarin Fruit Sorting System with Industrial Camera

Abstract

Manual inspection of fruit surface defects is time consuming, involves labour cost, prone to human error and possess inconsistent classification standards in fruit sorting application. To solve this issue, an automatic fruit sorting algorithm using deep learning technique was proposed to identify surface defects namely splitting, pitting, and stem-end rot found in mandarin fruits. The fruit sorting algorithm consists of K-Medoids segmentation and Convolutional Neural Network (CNN) classification model. The grayscale images of mandarin fruit surface were captured from an image acquisition system built with Near Infrared (NIR) camera. A preprocessing median filter was applied to remove random noise. After preprocessing, segmentation was carried out using K-Medoids clustering to crop the fruit surface image from the background region. Different CNN models namely VGG-16, InceptionV3 and MobileNet were trained and tested with and without transfer learning approach using the cropped image dataset. After training, the cropped fruit surface image was given to CNN model for defect classification. The classification results of the above models improved significantly after implementing transfer learning method. The VGG-16 model achieved a maximum overall classification accuracy of 90% without transfer learning and 99.53% with transfer learning approach when compared with the InceptionV3 and MobileNet. Overall accuracy of MobileNet improved from 57% to 98% after transfer learning and also it takes minimum time for inference. Considering both the overall accuracy and inference time parameters with the transfer learning approach, the MobileNet is found to be the best model for mandarin fruit sorting application.