Multi-pose Facial Expression Recognition Research Articles

Multi pose facial expression recognition based on convolutional neural network

Multi pose facial expression recognition based on convolutional neural network

Multi pose facial expression recognition based on convolutional neural network

Multi pose facial expression recognition based on convolutional neural network

Multi-Pose Facial Expression Recognition Using Hybrid Deep Learning Model with Improved Variant of Gravitational Search Algorithm

The recognition of human facial expressions with the variation of poses is one of the challenging tasks in real-time applications such as human physiological interaction detection, intention analysis, marketing interest evaluation, mental disease diagnosis, etc. This research work addresses the problem of expression recognition from different facial poses at the yaw angle. The major contribution of the paper is the proposal of an autonomous pose variant facial expression recognition framework using the amalgamation of a hybrid deep learning model with an improved quantum inspired gravitational search algorithm. The hybrid deep learning model is the integration of the convolutional neural network and recurrent neural network. The applicability of the hybrid deep learning model can be considered as significant if the feature set is efficiently optimized to have the discriminative features respective to each expression class. Here, the Improved Quantum Inspired Gravitational Search Algorithm (IQI-GSA) is utilized for the selection and optimization of features. The IQI-GSA method is significant for optimizing the features compared to quantum-behaved binary gravitation search algorithm for handing the local optima and stochastic characteristics. Comparing with state-of-art techniques, the proposed framework exhibits the outperformed recognition rate for experimentation on Karolinska Directed Emotional Faces (KDEF) and Japanese Female Facial Expression (JAFFE) datasets.

Identity preserving multi-pose facial expression recognition using fine tuned VGG on the latent space vector of generative adversarial network.

Facial expression is the crucial component for human beings to express their mental state and it has become one of the prominent areas of research in computer vision. However, the task becomes challenging when the given facial image is non-frontal. The influence of poses on facial images is alleviated using an encoder of a generative adversarial network capable of learning pose invariant representations. State-of-art results for image generation are achieved using styleGAN architecture. An efficient model is proposed to embed the given image into the latent vector space of styleGAN. The encoder extracts high-level features of the facial image and encodes them into the latent space. Rigorous analysis of semantics hidden in the latent space of styleGAN is performed. Based on the analysis, the facial image is synthesized, and facial expressions are recognized using an expression recognition neural network. The original image is recovered from the features encoded in the latent space. Semantic editing operations like face rotation, style transfer, face aging, image morphing and expression transfer can be performed on the image obtained from the image generated using the features encoded latent space of styleGAN. L2 feature-wise loss is applied to warrant the quality of the rebuilt image. The facial image is then fed into the attribute classifier to extract high-level features, and the features are concatenated to perform facial expression classification. Evaluations are performed on the generated results to demonstrate that state-of-art results are achieved using the proposed method.

Multi-pose facial expression recognition using appearance-based facial features

The problem of automatic facial expression recognition is both interesting and challenging with a strong impact on many application areas such as animation and human-computer interaction. The field has shown tremendous growth over the past years with its benchmarking efforts and progress. In this paper, an automated system to recognise facial expressions using the deep convolutional neural network is presented. The proposed system has used the appearance based features to recognise the facial expressions from imagery data with pose variations. The appearance based features are extracted by implementing an integrated approach of Gabor filter with local binary pattern method and the selection process of extracted features is executed using the concept of principal component analysis (PCA). The proposed system performance is accessed using the evaluation metrics of precision, recall, f-measure, and recognition rate for the frontal and half side pose images of the JAFFE and KDEF datasets.

Multi-pose facial expression recognition using appearance-based facial features

The problem of automatic facial expression recognition is both interesting and challenging with a strong impact on many application areas such as animation and human-computer interaction. The field has shown tremendous growth over the past years with its benchmarking efforts and progress. In this paper, an automated system to recognise facial expressions using the deep convolutional neural network is presented. The proposed system has used the appearance based features to recognise the facial expressions from imagery data with pose variations. The appearance based features are extracted by implementing an integrated approach of Gabor filter with local binary pattern method and the selection process of extracted features is executed using the concept of principal component analysis (PCA). The proposed system performance is accessed using the evaluation metrics of precision, recall, f-measure, and recognition rate for the frontal and half side pose images of the JAFFE and KDEF datasets.

Multi-pose facial expression recognition using rectangular HOG feature extractor and label-consistent KSVD classifier

In this paper, a new approach to the classification of facial expressions from multiple pose images is proposed. In this approach, a rectangular histogram of oriented gradient (R-HOG) algorithm is first designed to extract features of face images. The parameters of the R-HOG algorithm, which is a modification of the original HOG algorithm include cell shape, cell size, block size, and the number of orientation bins. The R-HOG is capable of capturing more discriminative texture features of different facial expressions. In addition, a supervised dictionary learning classifier, the label-consistent K-SVD (LC-KSVD) algorithm, is adopted to recognise the facial expression of the subject. To investigate its effectiveness, the proposed technique was applied to classify emotional states of the face images in the two public available facial expression datasets: KDFE and RafD. The experiment study showed that the new method outperformed in many aspects those methods reported in the literature tested with the same datasets. First, the new method handles pose variations better. Second, it is more robust in cases where the size of a training dataset is small. Finally, it's accuracy performance is more consistent measured by standard deviations.

Multi-pose facial expression recognition using rectangular HOG feature extractor and label-consistent KSVD classifier

Multi-pose facial expression recognition using rectangular HOG feature extractor and label-consistent KSVD classifier

Multi-Pose Facial Expression Recognition Based on Generative Adversarial Network

The recognition of human emotions from facial expression images is one of the most important topics in the machine vision and image processing fields. However, recognition becomes difficult when dealing with non-frontal faces. To alleviate the influence of poses, we propose an encoder-decoder generative adversarial network that can learn pose-invariant and expression-discriminative representations. Specifically, we assume that a facial image can be divided into an expressive component, an identity component, a head pose component and a remaining component. The encoder encodes each component into a feature representation space and the decoder recovers the original image from these encoded features. A classification loss on the components and an l 1 pixel-wise loss are applied to guarantee the rebuilt image quality and produce more constrained visual representations. Quantitative and qualitative evaluations on two multi-pose datasets demonstrate that the proposed algorithm performs favorably compared to state-of-the-art methods.

Cascaded Multi-level Transformed Dirichlet Process for Multi-pose Facial Expression Recognition

Cascaded Multi-level Transformed Dirichlet Process for Multi-pose Facial Expression Recognition