Composite descriptor based on contour and appearance for plant species identification

Abstract

In this paper, we propose an effective composite descriptor combining contour and appearance features for plant species identification. The composite descriptor uses two different fusion schemes: the first is a method based on the fusion of low-level local contour and appearance features; that is, we use local triangle features and local speeded-up robust features (SURF) to describe leaf images, respectively. Then, we utilize the Hausdorff distance to measure the leaf discrepancy to complete the plant identification task. The second is a method of global feature fusion based on high-level shape and appearance features. Specifically, the Fisher vector encodes the local triangle, and SURF features into high-level shape and appearance features. Then, the Euclidean distance is used to compute the dissimilarity of leaves to realize plant leaf recognition. The composite descriptor based on these two fusion schemes can well describe the characteristics of leaf images and improve the ability to identify plant leaves. This composite descriptor is extensively tested on several standard plant databases, including simple, compound, and natural scene plant leaf datasets. Experimental results demonstrate that the composite descriptor achieves high recognition accuracy, outperforming existing state-of-the-art benchmarks. In addition, we further applied our method directly to shape recognition and achieved good recognition results, demonstrating the wide range of applications of our method.