Unharvested palm fruit bunch (PFB) ripeness detection is crucial for efficient palm oil production as labor costs rise and worker shortages grow. Challenges remain under varying illumination, affecting detection performance. Although the deep learning-based color constancy model shows promise, the limitation lies in the lack of data. This paper addresses these issues by proposing a hybrid color correction method that combines the learning-based and the physical-based color constancy technique, then trains with YOLOv8 to enhance unharvested PFB detection performance. Specifically, the captured images and their corresponding simultaneous spectra are used to generate the ground truth images, then map the images to other ambient spectra to train the color constancy model, and finally, train the YOLOv8 with the corrected images for ripeness detection. Results demonstrate a 1.5% improvement in the mean Average Precision (mAP) @0.5 of YOLOv8, increasing from 88.2% to 89.7% after applying the proposed hybrid color correction method. For each ripeness category, the mAP@0.5 for unripe and ripe bunches increased by 1.7% and 1.8%, respectively. Underripe bunches exhibit the most increment in mAP of 2.1%, while the overripe bunch gives the least increase of 0.4%. The qualitative results show that the model has enhanced the ability to distinguish subtle differences in PFB ripeness. Consequently, it advances the effectiveness and reliability of PFB ripeness detection in practical palm oil production scenarios, especially for unripe to ripe bunches wherein color gives the most information. This research demonstrates potential in object detection tasks that incorporate illumination-based color correction methods.
Read full abstract