Facial Components Research Articles

Deep neural networks-based classification optimization by reducing the feature dimensionality with the variants of gravitational search algorithm

The optimization of the problems significantly improves the solution of the complex problems. The reduction in the feature dimensionality is enormously salient to reduce the redundant features and improve the system accuracy. In this paper, an amalgamation of different concepts is proposed to optimize the features and improve the system classification. The experiment is performed on the facial expression detection application by proposing the amalgamation of deep neural network models with the variants of the gravitational search algorithm. Facial expressions are the movement of the facial components such as lips, nose, eyes that are considered as the features to classify human emotions into different classes. The initial feature extraction is performed with the local binary pattern. The extracted feature set is optimized with the variants of gravitational search algorithm (GSA) as standard gravitational search algorithm (SGSA), binary gravitational search algorithm (BGSA) and fast discrete gravitational search algorithm (FDGSA). The deep neural network models of deep convolutional neural network (DCNN) and extended deep convolutional neural network (EDCNN) are employed for the classification of emotions from imagery datasets of JAFFE and KDEF. The fixed pose images of both the datasets are acquired and comparison based on average recognition accuracy is performed. The comparative analysis of the mentioned techniques and state-of-the-art techniques illustrates the superior recognition accuracy of the FDGSA with the EDCNN technique.

End-to-End Detection-Segmentation System for Face Labeling

In this paper, we propose an end-to-end detection-segmentation system to implement detailed face labeling. Fully convolutional networks (FCN) has become the mainstream algorithm in the field of semantic segmentation due to the state-of-the-art performance. However, a general FCN usually produces smooth and homogeneous results. Moreover, when semantic category is extremely unbalanced in samples such as face labeling problem, features for some categories cannot be well explored by FCN. To alleviate these problems, a face image is firstly encoded to multi-level feature maps by a pyramid FCN, then features of different facial components are extracted separately according to the bounding box provided by a one-stage detection head. Three class-specific sub-networks are employed to process the extracted features to obtain the respective segmentation results. The skin-hair region can be decoded directly from the back end of the pyramid FCN. Finally, the overall segmentation result is obtained by combining different branches. Moreover, the proposed method trained on a single-face labeled dataset, can be directly used to implement detailed multi-face labeling tasks without any network modification and additional module or data. The overall structure can be trained in an end-to-end manner while maintaining a small network size (12 MB). Experiments show that the proposed method can generate more accurate (single or multi) face labeling results comparing with previous works and gets the state-of-the-art results in HELEN face dataset.

One-shot Face Reenactment Using Appearance Adaptive Normalization

The paper proposes a novel generative adversarial network for one-shot face reenactment, which can animate a single face image to a different pose-and-expression (provided by a driving image) while keeping its original appearance. The core of our network is a novel mechanism called appearance adaptive normalization, which can effectively integrate the appearance information from the input image into our face generator by modulating the feature maps of the generator using the learned adaptive parameters. Furthermore, we specially design a local net to reenact the local facial components (i.e., eyes, nose and mouth) first, which is a much easier task for the network to learn and can in turn provide explicit anchors to guide our face generator to learn the global appearance and pose-and-expression. Extensive quantitative and qualitative experiments demonstrate the significant efficacy of our model compared with prior one-shot methods.

RoI Tanh-polar transformer network for face parsing in the wild

Face parsing aims to predict pixel-wise labels for facial components of a target face in an image. Existing approaches usually crop the target face from the input image with respect to a bounding box calculated during pre-processing, and thus can only parse inner facial Regions of Interest (RoIs). Peripheral regions like hair are ignored and nearby faces that are partially included in the bounding box can cause distractions. Moreover, these methods are only trained and evaluated on near-frontal portrait images and thus their performance for in-the-wild cases has been unexplored. To address these issues, this paper makes three contributions. First, we introduce iBugMask dataset for face parsing in the wild, which consists of 21,866 training images and 1000 testing images. The training images are obtained by augmenting an existing dataset with large face poses. The testing images are manually annotated with 11 facial regions and there are large variations in sizes, poses, expressions and background. Second, we propose RoI Tanh-polar transform that warps the whole image to a Tanh-polar representation with a fixed ratio between the face area and the context, guided by the target bounding box. The new representation contains all information in the original image, and allows for rotation equivariance in the convolutional neural networks (CNNs). Third, we propose a hybrid residual representation learning block, coined HybridBlock, that contains convolutional layers in both the Tanh-polar space and the Tanh-Cartesian space, allowing for receptive fields of different shapes in CNNs. Through extensive experiments, we show that the proposed method improves the state-of-the-art for face parsing in the wild and does not require facial landmarks for alignment.

Emotion recognition model based on facial expressions

Face mining is characterized as the revelation of picture designs in a given congregation of pictures. It is an exertion that generally attracts upon information PC (Personal Computer) vision, picture handling, information mining, AI (Artificial Intelligence), database, and human-made reasoning. Facial acknowledgement breaks down and contemplates the examples from the images of the facial. Facial component extraction is a programmed acknowledgment of human faces by recognizing its highlights, for example, eyebrows, eyes, and lips. In this paper, we are assessing the execution of PCA (Priniciple Component Analysis), GMM (Gaussian Mixture Models), GLCM (Gray Level Co-Occurrence Matrix), and SVM (Support Vector Machines) to perceive seven distinctive outward appearances of two people, for example, angry, sad, happy, disgust, neutral, fear, and surprise in database. Our point is to talk about the best systems that work best for facial acknowledgement. The present investigation demonstrates the plausibility of outward appearance acknowledgement for viable applications like surveillance and human PC communication.

Influence of facial components in classIII malocclusion esthetic perception of orthodontists, patients, and laypersons.

The aim of the present study was to investigate the influence of different facial components (face length, lip volume, nose size, and cheekbone contour) on the perception of facial attractiveness of patients with Angle classIII malocclusion in different categories of responders (orthodontists, laypersons, patients) with two-dimensional (2D) and three-dimensional (3D) simulations. An ideal standard 3D face was manipulated to create aclassIII facial malocclusion. Four facial components were modified (face length, lip volume, nose size and cheekbone contour) and the resulting simulations were used to obtain 2D figures and 3D videos, which were evaluated in asurvey by orthodontists, patients, and laypersons. No significant differences were detected between the 2D figures and 3D video simulations. Good correspondence was shown between the three categories of responders for the most and the least attractive faces. Smaller lips and bigger nose, regardless to the vertical dimension (short or long face), were found to be the least attractive features with agreement of all respondents. Regarding classIII facial attractiveness perception, the sum of all facial features and not the alteration of asingle component alone seems to play akey role in the perception of facial attractiveness. The 2D or 3D perspective did not play asignificant role in perception and the analyzed categories of responders did not show significant differences when perceiving facial attractiveness of the utilized simulations.

Correlation between the attractiveness of the facial components and the smiling face in males and females

Objectives: Esthetics is the main reason for seeking orthodontic treatment, demonstrating the importance of smile attractiveness in human relations. Therefore, this study aimed to quantify the influence of the smile and other facial components on overall facial attractiveness. Methods: Eight laypersons evaluated the attractiveness of 60 adults (30 men, 30 women) before orthodontic treatment using a visual analog scale. Pearson and stepwise correlations were carried out between the smiling face’s attractiveness and the attractiveness of the facial components: upper two-thirds, lower third, and smile. Results: For the entire sample, strong to moderate correlations were found between facial attractiveness and the smile (r = 0.71), the lower third (r = 0.70), and the upper two-thirds of the face (r = 0.42). When divided by gender, the facial parts’ correlation values were moderate and similar among each other in men, while in women, the face showed strong correlations with the smile (r = 0.83) and the attractiveness of the face’s lower third (r = 0.75). Conclusions: In general, correlations were found between the attractiveness of the smiling face and the components. In males, the lower third of the face accounted for 66% of the variation in facial attractiveness. In females, 83% of the variance in facial attractiveness could be ascribed to smile, with the value increasing only to 86% when the upper two-thirds were added.

Enhanced Facial Emotion Recognition by Optimal Descriptor Selection with Neural Network

Facial Emotion Recognition (FER) is the approach of detecting emotions of humans from facial expressions. Emotions are detected automatically by the human brain and hence, many computer aided techniques are implemented for recognizing emotions. Recognition of natural emotions is an exciting area with a broad range of real time applications like automated tutoring models, smart environments computer–human interaction, driver warning systems, and video and image retrieval. The major goal of this paper is to implement an intelligent model for FER. The proposed model involves few steps: (a) Face extraction (b) Image filtering, (c) Extraction of facial components, (d) Descriptor selection, and (d) Classification. Initially, the face is extracted from the input image by the Viola–Jones method, which is generally employed for the detection of object. Further, the noise of the image is filtered by the Gabor Filtering. Further, the facial components are extracted as features via the Affine-Scale-Invariant Feature Transform (ASIFT), which is the modified version of SIFT method. Since the length of the descriptors generated from ASIFT is high; the number of descriptors is reduced by the optimal descriptor selection approach with the aid of hybrid meta-heuristic algorithm termed as MV-WOA. The extracted descriptors are subjected to Neural Network (NN). As a modification to the existing machine learning algorithms, the number of hidden neurons in the NN is optimized by the proposed WOA+MVO algorithm. By conducting experiments, the results demonstrate that the developed system can perform better the recent traditional approaches for emotion recognition for classifying seven emotions like normal, smile, sad, surprise, anger, fear, and disgust.

DCLNet: Dual Closed-loop Networks for face super-resolution

Recently, deep-learning based face super-resolution methods have succeeded in hallucinating high-resolution face images from low-resolution inputs. However, since the given face images have tiny resolution and arbitrary characteristics which need to be reconstructed at high magnification factors, existing methods still suffer from large space of possible mapping functions, resulting in the limited performance in producing sharp textures. In this paper, we propose a novel CNN-based Dual Closed-loop Network (DCLNet) to minimize the possible mapping space. To that end, we design two dual learning networks to form the dual closed-loop structure with a primary face super-resolution network, which can provide the primary branch with additional prior constraint to guide the essential facial features restoring. Our work represents the first attempt to introduce multiple dual learning networks into face super-resolution model to constrain the possible mapping space. In addition, a progressive facial prior estimation framework and a new prior-guided feature enhancement module are presented to integrate the facial prior knowledge and guide the face image super-resolution. By generating multiple facial components maps for the activation of essential facial parts, our enhancement module can address the difficulty in learning and integrating strong priors into a face super-resolution model. In this way, the collaboration between the face super-resolution and alignment processes can be enhanced with effect. Extensive experiments are implemented on CelebA and Helen dataset, showing that our proposed method can provide state-of-the-art or even better performance in both quantitative and qualitative measurements.

Edge and identity preserving network for face super-resolution

Face super-resolution (SR) has become an indispensable function in security solutions such as video surveillance and identification system, but the distortion in facial components is a great challenge in it. Most state-of-the-art methods have utilized facial priors with deep neural networks. These methods require extra labels, longer training time, and larger computation memory. In this paper, we propose a novel Edge and Identity Preserving Network for Face SR Network, named as EIPNet, to minimize the distortion by utilizing a lightweight edge block and identity information. We present an edge block to extract perceptual edge information, and concatenate it to the original feature maps in multiple scales. This structure progressively provides edge information in reconstruction to aggregate local and global structural information. Moreover, we define an identity loss function to preserve identification of SR images. The identity loss function compares feature distributions between SR images and their ground truth to recover identities in SR images. In addition, we provide a luminance-chrominance error (LCE) to separately infer brightness and color information in SR images. The LCE method not only reduces the dependency of color information by dividing brightness and color components but also enables our network to reflect differences between SR images and their ground truth in two color spaces of RGB and YUV. The proposed method facilitates the proposed SR network to elaborately restore facial components and generate high quality 8× scaled SR images with a lightweight network structure. Furthermore, our network is able to reconstruct an 128×128 SR image with 215 fps on a GTX 1080Ti GPU. Extensive experiments demonstrate that our network qualitatively and quantitatively outperforms state-of-the-art methods on two challenging datasets: CelebA and VGGFace2.

Facial identification of twins based on fusion score method

Face recognition system contains lots of challenges due to various environmental factors, background variations, poor quality of camera, different illumination and others. Since twins are involved with criminal activities, twin identification becomes an essential task. The proposed system is focused on identifying the identical twins for the still images. The fusion based approach has been implemented in the proposed system. It combines the features extracted by using Principal Component Analysis (PCA), Histogram Oriented of Gradients (HOG), Local Binary Pattern (LBP), Gabor and distance between the facial components. Three types of fusion such as Decision Level Fusion, Feature Level Fusion and Score Level Fusion are used in the proposed approach. Based on these fusion generated scores, the twin has been identified. In the proposed system, Particle Swarm Optimization is used for the best feature selection and SVM classifier is used for training and testing the image. The proposed system provides better results when compared with the other twin detection techniques.

The Deficit of Multimodal Perception of Congruent and Non-Congruent Fearful Expressions in Patients with Schizophrenia: The ERP Study.

Emotional dysfunction, including flat affect and emotional perception deficits, is a specific symptom of schizophrenia disorder. We used a modified multimodal odd-ball paradigm with fearful facial expressions accompanied by congruent and non-congruent emotional vocalizations (sounds of women screaming and laughing) to investigate the impairment of emotional perception and reactions to other people’s emotions in schizophrenia. We compared subjective ratings of emotional state and event-related potentials (EPPs) in response to congruent and non-congruent stimuli in patients with schizophrenia and healthy controls. The results showed the altered multimodal perception of fearful stimuli in patients with schizophrenia. The amplitude of N50 was significantly higher for non-congruent stimuli than congruent ones in the control group and did not differ in patients. The P100 and N200 amplitudes were higher in response to non-congruent stimuli in patients than in controls, implying impaired sensory gating in schizophrenia. The observed decrease of P3a and P3b amplitudes in patients could be associated with less attention, less emotional arousal, or incorrect interpretation of emotional valence, as patients differed from healthy controls in the emotion scores of non-congruent stimuli. The difficulties in identifying the incoherence of facial and audial components of emotional expression could be significant in understanding the psychopathology of schizophrenia.

Deep convolutional neural network based facial expression identification using face-parsing method

Face parsing methodology may be a one amongst the advancements in pc vision that analyses the surface synthesis of the external body part, to amass bits of information on options needs correct pixel segmentation of various components of face like (mouth, nose, eyes etc.). Same means the analysis on feeling recognition plays a eventful role in communication and interactions of humanity and additionally relevant to psychological activities. Considering the disadvantage that totally different completely different components of face contain different quantity of knowledge for face expression and also the weighted perform are not an equivalent for various faces. In keeping with analysis, the image classification task ordinarily drives North American country to the notable Convolutional Neural Network (CNN) during which we tend to ar victimization VGG19 model. beyond exploring around however CNN, sometimes performs for greyscale photos, we tend to selected to start from 3 consecutive convolutional layers followed by a most pooling layer, basic exploit work for convolutional layer and “relu” is used, even as an analogous artefact pattern. The highlights to be known victimization the convolutional layer distended to 128 layers from thirty-two, it is suggestable that multi-layered structure (with increasing layers) that performs and results the most effective outcomes for the DNN model. At last, the CNN layer is 1st smoothened and afterwards expertise 2 many dense layers to reach the yield layer during which SoftMax activation perform is used for multiclass classification. We tend to victimization Cohn-Kanadre face expression dataset of seven expressions like contempt, anger, disgust, happiness, fear, disappointment and surprise.

AGRNet: Adaptive Graph Representation Learning and Reasoning for Face Parsing.

Face parsing infers a pixel-wise label to each facial component, which has drawn much attention recently. Previous methods have shown their success in face parsing, which however overlook the correlation among facial components. As a matter of fact, the component-wise relationship is a critical clue in discriminating ambiguous pixels in facial area. To address this issue, we propose adaptive graph representation learning and reasoning over facial components, aiming to learn representative vertices that describe each component, exploit the component-wise relationship and thereby produce accurate parsing results against ambiguity. In particular, we devise an adaptive and differentiable graph abstraction method to represent the components on a graph via pixel-to-vertex projection under the initial condition of a predicted parsing map, where pixel features within a certain facial region are aggregated onto a vertex. Further, we explicitly incorporate the image edge as a prior in the model, which helps to discriminate edge and non-edge pixels during the projection, thus leading to refined parsing results along the edges. Then, our model learns and reasons over the relations among components by propagating information across vertices on the graph. Finally, the refined vertex features are projected back to pixel grids for the prediction of the final parsing map. To train our model, we propose a discriminative loss to penalize small distances between vertices in the feature space, which leads to distinct vertices with strong semantics. Experimental results show the superior performance of the proposed model on multiple face parsing datasets, along with the validation on the human parsing task to demonstrate the generalizability of our model.

Face Hallucination With Finishing Touches.

Obtaining a high-quality frontal face image from a low-resolution (LR) non-frontal face image is primarily important for many facial analysis applications. However, mainstreams either focus on super-resolving near-frontal LR faces or frontalizing non-frontal high-resolution (HR) faces. It is desirable to perform both tasks seamlessly for daily-life unconstrained face images. In this paper, we present a novel Vivid Face Hallucination Generative Adversarial Network (VividGAN) for simultaneously super-resolving and frontalizing tiny non-frontal face images. VividGAN consists of coarse-level and fine-level Face Hallucination Networks (FHnet) and two discriminators, i.e., Coarse-D and Fine-D. The coarse-level FHnet generates a frontal coarse HR face and then the fine-level FHnet makes use of the facial component appearance prior, i.e., fine-grained facial components, to attain a frontal HR face image with authentic details. In the fine-level FHnet, we also design a facial component-aware module that adopts the facial geometry guidance as clues to accurately align and merge the frontal coarse HR face and prior information. Meanwhile, two-level discriminators are designed to capture both the global outline of a face image as well as detailed facial characteristics. The Coarse-D enforces the coarsely hallucinated faces to be upright and complete while the Fine-D focuses on the fine hallucinated ones for sharper details. Extensive experiments demonstrate that our VividGAN achieves photo-realistic frontal HR faces, reaching superior performance in downstream tasks, i.e., face recognition and expression classification, compared with other state-of-the-art methods.

Gender Recognition Using Global Feature and Selected Local Feature from Bag of Facial Component

Gender Recognition Using Global Feature and Selected Local Feature from Bag of Facial Component

Development of a Privacy-Preserving UAV System With Deep Learning-Based Face Anonymization

The robot market has been growing significantly and is expected to become 1.5 times larger in 2024 than what it was in 2019. Robots have attracted attention of security companies thanks to their mobility. These days, for security robots, unmanned aerial vehicles (UAVs) have quickly emerged by highlighting their advantage: they can even go to any hazardous place that humans cannot access. For UAVs, Drone has been a representative model and has several merits to consist of various sensors such as high-resolution cameras. Therefore, Drone is the most suitable as a mobile surveillance robot. These attractive advantages such as high-resolution cameras and mobility can be a double-edged sword, i.e., privacy infringement. Surveillance drones take videos with high-resolution to fulfill their role, however, those contain a lot of privacy sensitive information. The indiscriminate shooting is a critical issue for those who are very reluctant to be exposed. To tackle the privacy infringement, this work proposes face-anonymizing drone patrol system. In this system, one person's face in a video is transformed into a different face with facial components maintained. To construct our privacy-preserving system, we have adopted the latest generative adversarial networks frameworks and have some modifications on losses of those frameworks. Our face-anonymzing approach is evaluated with various public face-image and video dataset. Moreover, our system is evaluated with a customized drone consisting of a high-resolution camera, a companion computer, and a drone control computer. Finally, we confirm that our system can protect privacy sensitive information with our face-anonymzing algorithm while preserving the performance of robot perception, i.e., simultaneous localization and mapping.

A Novel Approach on Motion Estimation for Micro-Expression Recognition Using Phase Only Correlation with All Block Search (POC-ABS)

Micro-expression is an expression when a person tries to held or hidden, but the leak of this emotion still occurs in one or two areas of the face or maybe a short expression that across in the whole-face. Not more than 500ms, micro-expressions can be difficult to recognize and detect where the leakage area is located. This study presents a new method to recognize and detect the subtle motion on the facial components area using Phase Only Correlation algorithm with All Block Search (POC-ABS) to estimate the motion of all block areas. This block matching method is proposed by comparing each block in the two frames to determine whether there is movement or not. If the two blocks are identical, then the motion vector value is not displayed, whereas if the blocks are non-identical, the motion vector value of the POC is displayed. The motion vector, which is as a motion feature, estimates whether or not there are movements in the same block. In order to further confirm the reliability of the proposed method, two different classifiers were used for the micro-expression recognition of the CASME II dataset. The highest performance results are for SVM at 94.3 percent and for KNN at 95.6 percent. Finally, this algorithm detects leaks of motion based on the ratio of the motion vectors. The left and right eyebrows are dominant when expressing disgust, sadness, and surprise. Meanwhile, the movements of the right eye and left eye were the most dominant when the happiness expression.

The use of virtual reality in reducing anxiety during cast removal: a randomized controlled trial.

PurposeWhile virtual reality (VR) has been shown to be an effective distractor in children across a range of procedures, no studies have looked at its use within paediatric orthopaedics. The purpose of this study was to look at the use of VR in reducing anxiety levels in children during cast removal. In addition, the study aimed to find ways to enhance the efficiency of future VR trials in paediatrics.MethodsA non-blinded randomized control trial took place in children aged four to 18 years. Intraprocedural anxiety was measured using the Children’s Emotional Manifestation Scale (CEMS), while pre- and post-procedural anxiety was measured using the Short State Anxiety Inventory Scale. Additional data was collected on trait anxiety, nausea levels, desire for future VR use and areas of improvement for future VR studies.ResultsA total of 90 subjects were included in the study (control n = 45, intervention n = 45) with a mean age of 10.25 years (sd 3.35). Post-procedural anxiety and intraprocedural anxiety were 18% (p = 0.03) and 24% (p = 0.01) lower in the VR group, respectively, with the CEMS facial component showing a 31% (p < 0.001) reduction in the VR group. In all, 99% (n = 89) of subjects experienced no nausea, with one patient experiencing mild nausea that may have been present prior to VR use. Finally, 90% (n = 81) of subjects said they would like to use VR again, 1% (n = 1) said ‘no’ and 9% (n = 8) said ‘maybe’.ConclusionVR appears to be an effective distraction technique in reducing anxiety levels in children during cast removal.

Dynamic facial asset and rig generation from a single scan

The creation of high-fidelity computer-generated (CG) characters for films and games is tied with intensive manual labor, which involves the creation of comprehensive facial assets that are often captured using complex hardware. To simplify and accelerate this digitization process, we propose a framework for the automatic generation of high-quality dynamic facial models, including rigs which can be readily deployed for artists to polish. Our framework takes a single scan as input to generate a set of personalized blendshapes, dynamic textures, as well as secondary facial components ( e.g. , teeth and eyeballs). Based on a facial database with over 4, 000 scans with pore-level details, varying expressions and identities, we adopt a self-supervised neural network to learn personalized blendshapes from a set of template expressions. We also model the joint distribution between identities and expressions, enabling the inference of a full set of personalized blendshapes with dynamic appearances from a single neutral input scan. Our generated personalized face rig assets are seamlessly compatible with professional production pipelines for facial animation and rendering. We demonstrate a highly robust and effective framework on a wide range of subjects, and showcase high-fidelity facial animations with automatically generated personalized dynamic textures.