Facial expression recognition based on multi-scale vector triangle

Abstract

Image description is not sufficient in traditional facial expression recognition (FER) methods, therefore this paper proposes a FER method based on multi-scale vector triangle. It combines vector triangle pattern with image pyramid to extract facial expression features. Firstly, construct a facial image pyramid to produce images in different scales. Secondly, divide each image into blocks, and extract vector triangle features of each sub-image. Then, use histogram to statistical characteristics, and calculate Euclidean distance between the histograms. Finally, fusion weighted eigenvalues and come to the recognition results. Multi-scale vector triangle pattern can not only avoid the loss of information in image asymmetric regions, but also reflect image features in different scales. It can describe images more adequately. In order to verify the effectiveness of the algorithm, this paper uses the Japanese Female Facial Expression (JAFFE) database to do the experiments and compare the results with Complete Local Binary Patterns (CLBP), Gabor wavelet, Active Appearance Models (AAM) and so on. Experimental results indicate that this method has higher recognition rate and better real-time effect.