Extracting the symmetry axes of partially occluded single apples in natural scene using convex hull theory and shape context algorithm

Abstract

Accurate identification of apples partially occluded by branches and leaves is an urgent and key issue for a picking robot. The objective of this study was to detect the symmetry axes of partially occluded single apples accurately using the convex hull theory and Shape Context algorithm. Firstly, apple regions were obtained by using K-means clustering algorithm. Secondly, image pre-processing steps such as image binarization, hole filling, area opening and edge detection were applied. Thirdly, false contours were removed based on the convex hull theory to enhance the accuracy and stability of this method. Finally, the point matching relationship of each two contours and the two best symmetrical contours were found by using the Shape Context algorithm and Hungarian algorithm. Then the symmetry axes of apples were extracted using the matching point pairs. Least squares ellipses fitting algorithm and moment of inertia algorithm were used to compare with the presented algorithm. The angle difference between extracted symmetry axis and ideal symmetry axis for every method was computed, and the execution time of program as well. Ninety partially occluded single apple images were tested. The experimental results showed that the average angle error of the Shape Context algorithm were 7.72°, 37.5 % of the ellipses fitting algorithm and 31.3 % of the inertia moment algorithm. And its average execution time is 1.86 s, 103 % of the ellipses fitting algorithm and 106 % of the inertia moment algorithm. In conclusion, it was feasible to use the proposed method to extract the symmetry axes of partially occluded apples.