Multiple strategies to enhance automatic 3D facial expression recognition

Abstract

The research on 3D facial expression recognition has attracted numbers of interests due to its superiority to 2D data and it has been greatly promoted in recent years. However, its performance needs to be further improved and its data structure needs to be further analyzed to keep its automation well as the mesh structure of 3D face models cannot be applied directly to algebraic operations. This paper addresses these problems with multiple strategies, so that 3D facial expression recognition can be automatically implemented and its performance is subsequently enhanced. Firstly, an image-like-structure is proposed to represent the 3D face models, so that algebraic operations can be directly applied to analyze 3D data. Based on this image-like-structure, the strategies of irregular division schemes and the entropy weighted blocks are employed to improve the recognition accuracy. The former aims to keep the integrity of local structure; the latter is employed to emphasize the contribution of different facial regions. Both of them can be separately or jointly, utilized to facial feature descriptors. With the remarkable experimental results based on LBP and LTP, we can conclude that these strategies are available to promote the performance of automatic 3D facial expression recognition, which draws a promising direction for automatic 3D facial expression recognition.