Interest emotion recognition approach using self-organising map and motion estimation

Abstract

Recognising human facial emotions by computer is an interesting problem. Although several approaches have been proposed the recognition rate, amount of used resources and calculation time remain factors for improvement. Our work presents a new approach for recognising basic emotions (joy, sadness, anger, disgust, surprise and fear) in image sequences. We introduced interest emotion and created its corresponding action units (AUs) based on psychological foundations. Our approach is mainly characterised by minimising used data and consequently optimising the computing time and improving the recognition rate. The proposed approach was divided into three steps: face detection using the Viola and Jones method, the extraction of facial features: here we exploited the facial action coding system, which is based on AUs. To detect AUs, we extracted face strategic points using an active appearance model and a block-matching approach. At the last, we classified the results by using the Kohonen self-organising map (SOM).