Discriminative analysis of lip features for emotion recognition

Abstract

There exist several emotion recognition techniques that use lip information in combination with other facial features. An attempt has been made in the presented work towards emotion recognition based only on lip features. Lip information is represented by extracting lip texture features and lip geometric features. Lip texture features are extracted using discrete cosine transformation while lip geometric features are extracted by modelling the lip shape using the localised active contour model. The extracted features are applied to support vector machine for emotion recognition. The proposed approach is evaluated on extended Cohn-Kanade and JAFFE database. It is evident from the experimental results that lip geometric features result in 85.76% recognition accuracy which is higher than the recognition accuracy using lip texture features 84.47%. In addition, combination of lip texture and geometric features results in 87.70% recognition accuracy, which is comparable to the state-of-the-art approaches.