Features Of Face Images Research Articles

Hybrid Facial Expression Recognition (FER2013) Model for Real-Time Emotion Classification and Prediction

Facial expression recognition is a vital research topic in most fields ranging from artificial intelligence and gaming to human–computer interaction (HCI) and psychology. This paper proposes a hybrid model for facial expression recognition, which comprises a deep convolutional neural network (DCNN) and a Haar Cascade deep learning architecture. The objective is to classify real-time and digital facial images into one of the seven facial emotion categories considered. The DCNN employed in this research has more convolutional layers, ReLU activation functions, and multiple kernels to enhance filtering depth and facial feature extraction. In addition, a Haar Cascade model was also mutually used to detect facial features in real-time images and video frames. Grayscale images from the Kaggle repository (FER-2013) and then exploited graphics processing unit (GPU) computation to expedite the training and validation process. Pre-processing and data augmentation techniques are applied to improve training efficiency and classification performance. The experimental results show a significantly improved classification performance compared to state-of-the-art (SoTA) experiments and research. Also, compared to other conventional models, this paper validates that the proposed architecture is superior in classification performance with an improvement of up to 6%, totaling up to 70% accuracy, and with less execution time of 2,098.8 s.

Hybrid facial expression recognition (FER2013) modelfor real-time emotion classification and prediction

Facial expression recognition is a vital research topic in most fields ranging from artificial intelligence and gamingto human-computer interaction (HCI) and psychology. This paper proposes a hybrid model for facial expressionrecognition, which comprises a deep convolutional neural network (DCNN) and a Haar Cascade deep learningarchitecture. The objective is to classify real-time and digital facial images into one of the seven facial emotioncategories considered. The DCNN employed in this research has more convolutional layers, ReLU activationfunctions, and multiple kernels to enhance filtering depth and facial feature extraction. In addition, a HaarCascade model was also mutually used to detect facial features in real-time images and video frames. Grayscaleimages from the Kaggle repository (FER2013) and then exploited graphics processing unit (GPU) computation toexpedite the training and validation process. Pre-processing and data augmentation techniques are applied toimprove training efficiency and classification performance. The experimental results show a significantly improvedclassification performance compared to state-of-the-art (SoTA) experiments and research. Also, compared to otherconventional models, this paper validates that the proposed architecture is superior in classification performancewith an improvement of up to 6%, totaling up to 70% accuracy, and with less execution time of 2,098.8 s

A Novel Infrared and Visible Image Fusion Approach Based on Adversarial Neural Network.

The presence of fake pictures affects the reliability of visible face images under specific circumstances. This paper presents a novel adversarial neural network designed named as the FTSGAN for infrared and visible image fusion and we utilize FTSGAN model to fuse the face image features of infrared and visible image to improve the effect of face recognition. In FTSGAN model design, the Frobenius norm (F), total variation norm (TV), and structural similarity index measure (SSIM) are employed. The F and TV are used to limit the gray level and the gradient of the image, while the SSIM is used to limit the image structure. The FTSGAN fuses infrared and visible face images that contains bio-information for heterogeneous face recognition tasks. Experiments based on the FTSGAN using hundreds of face images demonstrate its excellent performance. The principal component analysis (PCA) and linear discrimination analysis (LDA) are involved in face recognition. The face recognition performance after fusion improved by 1.9% compared to that before fusion, and the final face recognition rate was 94.4%. This proposed method has better quality, faster rate, and is more robust than the methods that only use visible images for face recognition.

A Three-Dimensional Anisotropic Diffusion Equation-Based Video Recognition Model for Classroom Concentration Evaluation in English Language Teaching

In this paper, a three-dimensional anisotropic diffusion equation is used to conduct an in-depth study and analysis of students’ concentration in video recognition in English teaching classrooms. A multifeature fusion face live detection method based on diffusion model extracts Diffusion Kernel (DK) features and depth features from diffusion-processed face images, respectively. DK features provide a nonlinear description of the correlation between successive face images and express face image sequences in the temporal dimension; depth features are extracted by a pretrained depth neural network model that can express the complex nonlinear mapping relationships of images and reflect the more abstract implicit information inside face images. To improve the effectiveness of the face image features, the extracted DK features and depth features are fused using a multicore learning method to obtain the best combination and the corresponding weights. The two features complement each other, and the fused features are more discriminative, which provides a strong basis for the live determination of face images. Experiments show that the method has excellent performance and can effectively discriminate the live nature of faces in images and resist forged face attacks. Based on the above face detection and expression recognition algorithms, the classroom concentration analysis system based on expression recognition is designed to achieve real-time acquisition and processing of classroom images, complete student classroom attendance records using face detection and face recognition methods, and analyze students’ concentration from the face integrity and facial expression of students facing the blackboard by combining face detection and expression recognition to visualize and display students’ classroom data for teachers, students, and parents with more data support and help.

Weighted ensemble with angular feature learning for facial expression recognition

Ensemble learning using a set of deep convolutional neural networks (DCNNs) as weak classifiers has become a powerful tool for face expression. Nevertheless, training a DCNNS-based ensemble is not only time consuming but also gives rise to high redundancy due to the nature of DCNNs. In this paper, a novel DCNNs-based ensemble method, named weighted ensemble with angular feature learning (WDEA), is proposed to improve the computational efficiency and diversity of the ensemble. Specifically, the proposed ensemble consists of four parts including input layer, trunk layers, diversity layers and loss fusion. Among them, the trunk layers which are used to extract the local features of face images are shared by diversity layers such that the lower-level redundancy can be largely reduced. The independent branches enable the diversity of the ensemble. Rather than the traditional softmax loss, the angular softmax loss is employed to extract more discriminant deep feature representation. Moreover, a novel weighting technique is proposed to enhance the diversity of the ensemble. Extensive experiments were performed on CK+ and AffectNet. Experimental results demonstrate that the proposed WDEA outperforms existing ensemble learning methods on the recogntion rate and computational efficiency.

A Face Recognition Algorithm Based on Intermediate Layers Connected by the CNN

Face recognition is difficult due to the higher dimension of face image features and fewer training samples. Firstly, in order to improve the performance of feature extraction, we inventively construct a double hierarchical network structure convolution neural network (CNN) model. The front-end network adopts a relatively simple network model to achieve rough feature extraction from input images and obtain multiple suspect face candidate windows. The back-end network uses a relatively complex network model to filter the best detection window and return the face size and position by nonmaximum suppression. Then, in order to fully extract the face features in the optimal window, a face recognition algorithm based on intermediate layers connected by the deep CNN is proposed in this paper. Based on AlexNet, the front, intermediate and end convolution layers are combined by deep connection. Then, the feature vector describing the face image is obtained by the operation of the pooling layer and the full connection layer. Finally, the auxiliary classifier training method is used to train the model to ensure the effectiveness of the features of the intermediate layer. Experimental results based on open face database show that the recognition accuracy of the proposed algorithm is higher than that of other face recognition algorithms compared in this paper.

Gabor Log-Euclidean Gaussian and its fusion with deep network based on self-attention for face recognition

In this work, we proposed a face feature extraction method by Learning Gabor Log-Euclidean Gaussian with Whitening Principal Component Analysis (called LGLG-WPCA). The proposed method extracts raw features from the multivariate Gaussian in the transform domain of Gabor wavelet and uses WPCA to get robust features. Because the space of Gaussian is a Riemannian manifold, it is difficult to incorporate the learning mechanism into the model. To address this issue, Log-Euclidean approach is used to embed the multivariate Gaussian into the linear space, and then use WPCA to learn discriminative face features. LGLG-WPCA is good at extracting the detail features of face image. Furthermore, another outstanding advantage of LGLG is that its features can be effectively integrated with the high-level features of deep learning network for face recognition in more complex environments. We presented the feature fusing approaches for face recognition based on Self-attention Network (SAN) and achieved obvious performance improvement to the-state-of-the-art deep networks including SENet and FaceNet. Experiments show the proposed method is robust under adverse conditions such as varying poses, skin aging and uneven illumination, and it is suitable for face image under small-scale datasets in complex environments, such as network-based or video-based person searching or tracking.

Optical search and visual expertise

The eye movement parameters during a visual search for informative features in face images by a person and the identification of changes in these parameters depending on the expertise of this person were experimentally investigated to discover the effect of expertise in visual search required for the development of automated programs for the optical search for a target. The enhancement in the recognition of blurred images at the periphery of the visual field during the learning process is demonstrated for the first time. This process is the reason for the minimization of eye movement and, consequently, the time required for target search occurring with the accumulation of professional experience.

System for Fusion of Face and Speech Modalities Using DTCWT+QFT and MFCC+RASTA Techniques

Objectives: The main objective is to propose a multimodal biometric system by forming a fusion of Face and Speech modalities using DTCWT+QFT techniques for face and MFCC+RASTA Techniques for Speech recognitions. The experimental results are compared with existing works and analysed the performance with counterparts. Methods: The proposed model, make use of DTCWT and QFT techniques to extract the features of face images and perform fusion of both. The MFCC and RASTA techniques are implemented to extract features of speech data and then fusion is applied. Various databases discussed and utilized for both face and speech recognition system proposed. Findings: The results of experimentation are compared with existing systems and analysis proved than the proposed system is placed in better position. The fusion of DTCWT and QFT techniques for face recognition system is implemented and the results using performance parameters such as False Acceptation Ratio (FAR), False Rejection Ratio (FRR), Total Success Rate (TSR), Partial Error Rate (PER), Equal Error Rate (EER) are tabulated for six different types of face data sets. The average performance of the results is compared with four existing fusion techniques and showed that the proposed system performs better. The fusion of MFCC and RASTA techniques for speech recognition system is implemented and the performance is measured by calculating accuracy, precision, recall and F1-score. These results are compared with five different schemes and proved that proposed system of fusion of face and speech traits works better for human recognitions. Novelty: Fusion of two algorithms for face recognition is implemented and the results analysed. Then the fusion of two algorithms for speech recognition is implemented and the results are analysed. The novel approach is presented to combine both face and speech recognition system in to single system to improve the security using multimodal biometrics. Keywords: DTCWT; QFT; RASTA; MFCC; Feature Extraction; Fusion

Remote Blood Pressure Sensing Using Near-Infrared Wideband LEDs

Long-term and continuous blood pressure monitoring in daily life is important, especially for early detection and prevention of hypertension. The near-infrared (NIR) spectral region, which belongs to the middle of the visible and infrared bands, is the wavelength band with high biological permeability and called as a “living-body window”. Our research group developed an NIR wideband LED with a wide emission band in the NIR spectral region and applied the NIR wideband LED in remote blood pressure estimation. The accuracy of remote blood pressure estimation can be improved by using the spatial features of facial images, including multi-wavelength information. In this study, we describe the estimation of remote blood pressure using NIR wideband LEDs. Features in the nasal and lip regions, which contributed to estimating blood pressure, were analyzed using facial NIR images. Furthermore, the root mean square error between the measured and estimated MBP was around 4 mmHg using the NIR wideband LEDs in two of three subjects.

Research on Facial Expression Recognition Based on Improved Deep Residual Network Model

Facial expressions are the main external manifestations of human emotions. Facial expression recognition technology can be used in medical, investigation, education and other application scenarios. Aiming at the disadvantages of slow convergence speed and low recognition accuracy of traditional neural networks, in order to optimize the network more efficiently and improve the recognition rate of facial expressions, a facial expression recognition method based on improved convolutional neural networks is proposed.First, the deep residual network ResNet18 is improved, and then the improved ResNet18 network is used to extract global expression features of face images, and then the self-attention weighting module is introduced to calculate the expression features of each face image and output one The corresponding weights are used to weight the loss function. Finally, the two public expression data sets of CK+ and RAF-DB are used to experimentally verify the method in the article. The accuracy of facial expression recognition reaches 98.89% and respectively. 87.13%, compared with the original deep residual network ResNet18 model and other types of network models, the facial expression recognition rate has been significantly improved, which proves that this method can effectively improve the accuracy of facial expression recognition and has certain application value.

Security Analysis of Intelligent System Based on Edge Computing

At present, artificial intelligence technology is widely used in society, and various intelligent systems emerge as the times require. Due to the uniqueness of biometrics, most intelligent systems use biometric-based recognition technology, among which face recognition is the most widely used. To improve the security of intelligent system, this paper proposes a face authentication system based on edge computing and innovatively extracts the features of face image by convolution neural network, verifies the face by cosine similarity, and introduces a user privacy protection scheme based on secure nearest neighbor algorithm and secret sharing homomorphism technology. The results show that when the threshold is 0.51, the correct rate of face verification reaches 92.46%, which is far higher than the recognition strength of human eyes. In face recognition time consumption and recognition accuracy, the encryption scheme is basically consistent with the recognition time consumption in plaintext state. It can be seen that the security of the intelligent system with this scheme can be significantly improved. This research provides a certain reference value for the research on the ways to improve the security of intelligent system.

A New Face Image Recognition Algorithm Based on Cerebellum-Basal Ganglia Mechanism.

Face recognition is one of the popular areas of research in the field of computer vision. It is mainly used for identification and security system. One of the major challenges in face recognition is identification under numerous illumination environments by changing the direction of light or modifying the lighting magnitude. Exacting illumination invariant features is an effective approach to solve this problem. Conventional face recognition algorithms based on nonsubsampled contourlet transform (NSCT) and bionic mode are not capable enough to recognize the similar faces with great accuracy. Hence, in this paper, an attempt is made to propose an enhanced cerebellum-basal ganglia mechanism (CBGM) for face recognition. The integral projection and geometric feature assortment method are used to acquire the facial image features. The cognition model is deployed which is based on the cerebellum-basal ganglia mechanism and is applied for extraction of features from the face image to achieve greater accuracy for recognition of face images. The experimental results reveal that the enhanced CBGM algorithm can effectively recognize face images with greater accuracy. The recognition rate of 100 AR face images has been found to be 96.9%. The high recognition accuracy rate has been achieved by the proposed CBGM technique.

Transferable face image privacy protection based on federated learning and ensemble models

Face image features represent significant user privacy concerns. Face images cannot be privately transferred under existing privacy protection methods, and data across various social networks are unevenly distributed. This paper proposes a method for face image privacy protection based on federated learning and ensemble models. A federated learning model based on distributed data sets was established by means of federated learning. On the client side, a local facial recognition model was obtained by local face data training and used as the input of PcadvGAN to train PcadvGAN for several rounds. On the server side, a parameter aggregator based on a differential evolutionary algorithm was established as the discriminator of PcadvGAN server, and a client facial recognition model was ensembled simultaneously. The discriminator of the PcadvGAN server experienced mutation, crossover, and interaction with the ensemble model to reveal the optimal global weight of the PcadvGAN model. Finally, the global optimal aggregation parameter matrix of PcadvGAN was obtained by calculation. The server and the client shared the global optimal aggregation parameter matrix, enabling each client to generate private face images with high transferability and practicality. Targeted attack and non-targeted attack experiments demonstrated that the proposed method can generate high-quality, transferable, robust, private face images with only minor perturbations more effectively than other existing methods.

Dual Face Alignment Learning Network for NIR-VIS Face Recognition

As the most important topic in Heterogeneous Face Recognition (HFR), Near-InfraRed and VISual (NIR-VIS) face recognition has attracted increasing research attentions owing to its potential application in the field of criminal detective cases and multimedia information retrieval. However, due to its dramatic intra-class variations, including modality, pose, occlusion, blurry, lighting, distance, expression, etc, it is very challenging to retain inherent identity information. To address the above issue, we propose a novel Dual Face Alignment Learning (DFAL) algorithm to explore the potential domain-invariant neutral face representations of the cross-modal images. Our model contains three effective components including Feature-level Face Alignment (FFA), Image-level Face Alignment (IFA) and Cross-domain compact Representation (CdR). Firstly, Teacher-Encoder CNNs (TeEn-CNNs) and Student-Encoder CNNs (StEn-CNNs) are designed to encode features for VIS neutral face images and non-neutral face images, and the FFA is introduced to learn neutral face representations by performing feature-level alignment between non-neutral face and VIS neutral face. Secondly, Student-Decoder CNNs (StDe-CNNs) is developed to decode features to restore face images, and the IFA is designed to reconstruct neutral face image by imposing image-level alignment. Notably, the FFA acts as the primary target to learn VIS neutral face representations for cross-view data, while the IFA plays a role in the icing on the cake, i.e., further disentangling domain and residual information through the synthesis process. Finally, the CdR dispels modality features and distills identity features by mining inter-class information, inter-domain information and inter-semantic relationship. The joint scheme enables the elimination of intra-class variations and the purification of identity information. We carry out comprehensive experiments to illustrate the effectiveness of the DFAL approach on three challenging NIR-VIS databases.

Classification of Body Mass Index Based Facial Images using Empirical Mode Decomposition

Human faces contain rich information. Recent studies found that facial features have relation with human weight or body mass index (BMI). Decoding “facial information” from the face in predicting the BMI could be linked to the various health marker. This paper proposed the classification of body mass index (BMI) based on appearance based features of facial images using empirical mode decomposition (EMD) as feature extraction technique. The facial images that describe the body mass index was extracted using EMD to obtain a set of significant features. In this framework, the facial image was decomposed using EMD to produce a small set of intrinsic mode functions (IMF) via sifting process. The IMF features which exhibit the unique pattern were used to classify the BMI. The obtained features were then fed into machine learning classifier such as k-nearest neighbour and support vector machines (SVM) to classify the three BMI classes namely normal, overweight and obese. The obtained results show that the IMF2 feature using SVM classifier achieved recognition rate of 99.12% which show promising result.

An automated integrated speech and face imageanalysis system for the identification of human emotions

ObjectiveHuman interactions are related to speech and facial characteristics. It was suggested that speech signals and/or images of facial expressions may reveal human emotions and that both interact for the verification of a person's identity. The present study proposes and evaluates an automated integrated speech signal and facial image analysis system for the identification of seven different human emotions (Normal (N), Happy (H), Sad (S), Disgust (D), Fear (F), Anger (A), and Surprise (Su)). MethodsSpeech recordings and face images from 7,441 subjects aged 20≤age≤74 were collected, normalized and filtered. From all the above recordings 55 speech signal features and 61 different image face texture features were extracted. Statistical and model multi-classification analysis were performed to select the features able to statistically significantly distinguish between the seven aforementioned human emotions (N, H, S, D, F, A and Su). The selected features alone or a combination of these features along with age and gender of the sample investigated were used to build two learning-based classifiers; and the classifiers’ accuracy was computed. ResultsFor each of the above mentioned human emotions, statistical significantly different speech and face image features were identified that may be used to distinguish between the aforementioned groups (N vs H, N vs S, N vs D, N vs F, N vs A, N vs Su). Using solely the statistically significant speech and image features identified, an overall percentage of correct classification (%CC) score of 93% was achieved. ConclusionsA significant number of speech and face image features have been derived from continuous speech and face images. Features were identified that were able to identify between seven different emotional human states. This study poses the basis for the development of an integrated system for the identification of emotional states from automatic analysis of free speech and image face analysis. Future work will investigate the development and integration of the proposed method into a mobile device.

Fuzzy Weighted Entropy Attention Deep Learning Method for Expression Recognition

Deep learning network has been widely used in facial expression recognition. However, due to the complexity and variability of expression images and the influence of various factors such as illumination and individual differences, the recognition effect of existing methods needs to be improved. In order to improve the expressive ability of deep learning network, an attention mechanism based on fuzzy weighted entropy is introduced into deep learning network and applied to multi-channel facial expression recognition. Firstly, the convolutional neural network model is constructed to extract the convolutional layer multi-channel features of facial image. Then, the fuzzy weighted entropy of different channel features is calculated as the attention weight. Finally, the attention weight and multi-channel features were fused to extract the high-dimensional features of the facial expression image and sent to the full connection layer to complete the facial expression classification. Experiments in CK+ and JAFFE databases show that the average recognition rates of this method obtained 94.86% and 96.88%. It is better than the mainstream methods in recent years.

Face Image Feature Extraction based on Deep Learning Algorithm

In recent years, due to the rapid development of computer technology, artificial intelligence technology in the computer field has begun to integrate into people’s life, and facial recognition, as a unique biometric recognition method, is the core of artificial intelligence technology. Based on this, this paper discusses the local feature extraction and global feature extraction based on the deep learning algorithm, and proposes a training classification method based on the deep learning model combined with local pattern and GLQP representation feature extraction algorithm. In this paper, the local quantization method is used to input the data set preprocessed by the filter into the network. The depth of CNN network is selected as 4 layers, and the network is trained to produce high-resolution features. Experiments show that the accuracy of the trained deep network model is 92.2% in the test set. Therefore, compared with the traditional methods, deep learning has the advantages of powerful visualization and automatic face feature extraction, overcomes the shortcomings of deep learning model in the process of shallow feature learning, and shows higher recognition efficiency and generalization.

Face recognition framework based on effective computing and adversarial neural network and its implementation in machine vision for social robots

In recent years, with the continuous breakthrough of computer vision technology, the accuracy of object detection and target recognition has been improved by leaps and bounds. Face recognition is one of the important research directions in the field of computer vision, which is widely used in mobile payment, safe city, criminal investigation and other fields. Traditional face recognition methods need to extract face image features manually. The extracted features are greatly affected by subjective factors, and time-consuming and laborious. Deep learning is the most important technology in the field of computer vision at present. Compared with traditional face recognition methods, it can extract more essential features of face image without manual participation. In this paper, we build a face recognition system based on neural computing model and the principle of neural network. The experimental results show that the proposed method has high detection rate and short processing time.