Fuzzy Histogram of Optical Flow Orientations for Micro-Expression Recognition

Abstract

In high-stake situations, the micro-expressions reveal the hidden emotions of a person and it has potential applications in many areas. The recognition of such short-lived subtle expressions is a challenging task. The literature proposes several spatio-temporal features to encode the subtle changes on the face during a micro-expression. The spatial changes are almost indistinguishable as the facial appearance does not change appreciably. However, these changes possess a temporal pattern. This paper explores the temporal features associated with facial micro-movements and proposes fuzzy histogram of optical flow orientation (FHOFO) features for recognition of micro-expressions. The FHOFO constructs suitable angular histograms from optical flow vector orientations using histogram fuzzification to encode the temporal pattern for classifying the micro-expressions. We have also discussed the effect of inclusion and exclusion of the motion magnitudes during FHOFO feature extraction. It has been demonstrated by repeated experiments on the publicly available databases, that the performance of FHOFO is consistent and close or at times even better than the state-of-art techniques.