Performance Of Face Recognition System Research Articles

The Effects of AI-Driven Face Restoration on Forensic Face Recognition

In biometric recognition, face recognition is a mature and widely used technique that provides a fast, accurate, and reliable method for human identification. This paper aims to study the effects of face image restoration for forensic face recognition and then further analyzes the advantages and limitations of the four state-of-the-art face image restoration methods in the field of face recognition for forensic human image identification. In total, 100 face image materials from an open-source face image dataset are used for experiments. The Gaussian blur processing is applied to simulate the effect of blurred face images in actual cases of forensic human image identification. Four state-of-the-art AI-driven face restoration methods are used to restore the blurred face images. We use three mainstream face recognition systems to evaluate the recognition performance changes of the blurred face images and the restored face images. We find that although face image restoration can effectively remove facial noise and blurring effects, the restored images do not significantly improve the recognition performance of the face recognition systems. Face image restoration may change the original features in face images and introduce new made-up image features, thereby affecting the accuracy of face recognition. In current conditions, the improvement in face image restoration on the recognition performance of face recognition systems is limited, but it still has a positive role in the application of forensic human image identification.

MASKED AND UNMASKED FACE RECOGNITION ON UNCONSTRAINED FACIAL IMAGES USING HAND-CRAFTED METHODS

In this study, the face recognition task is applied on masked and unmasked faces using hand-crafted methods. Due to COVID-19 and masks, facial identification from unconstrained images became a hot topic. To avoid COVID-19, most people use masks outside. In many cases, typical facial recognition technology is useless. The majority of contemporary advanced face recognition methods are based on deep learning, which primarily relies on a huge number of training examples, however, masked face recognition may be investigated using hand-crafted approaches at a lower computing cost than using deep learning systems. A low-cost system is intended to be constructed for recognizing masked faces and compares its performance to that of face recognition systems that do not use masks. The proposed method fuses hand-crafted methods using feature-level fusion strategy. This study compares the performance of masked and unmasked face recognition systems. The experiments are undertaken on two publicly accessible datasets for masked face recognition: Masked Labeled Faces in the Wild (MLFW) and Cross-Age Labeled Faces in the Wild (CALFW). The best accuracy is achieved as 94.8% on MLFW dataset. The rest of the results on different train and test sets from CALFW and MLFW datasets are encouraging compared to the state-of-the-art models.

Comparative study on the performance of face recognition algorithms

Facial and object recognition are more and more applied in our life. Therefore, this field has become important to both academicians and practitioners. Face recognition systems are complex systems using features of the face to recognize. Current face recognition systems may be used to increase work efficiency in various methods, including smart homes, online banking, traffic, sports, robots, and others. With various applications like this, the number of facial recognition methods has been increasing in recent years. However, the performance of face recognition systems can be significantly affected by various factors such as lighting conditions, and different types of masks (sunglasses, scarves, hats, etc.). In this paper, a detailed comparison between face recognition techniques is exposed by listing the structure of each model, the advantages and disadvantages as well as performing experiments to demonstrate the robustness, accuracy, and complexity of each algorithm. To be detailed, let’s give a performance comparison of three methods for measuring the efficacy of face recognition systems including a support vector machine (SVM), a visual geometry group with 16 layers (VGG-16), and a residual network with 50 layers (ResNet-50) in real-life settings. The efficiency of algorithms is evaluated in various environments such as normal light indoors, backlit indoors, low light indoors, natural light outdoors, and backlit outdoors. In addition, this paper also evaluates faces with hats and glasses to examine the accuracy of the methods. The experimental results indicate that the ResNet-50 has the highest accuracy to identify faces. The time to recognize is ranging from 1.1s to 1.2s in the normal environment

Improving Accuracy of Face Recognition in the Era of Mask-Wearing: An Evaluation of a Pareto-Optimized FaceNet Model with Data Preprocessing Techniques

The paper presents an evaluation of a Pareto-optimized FaceNet model with data preprocessing techniques to improve the accuracy of face recognition in the era of mask-wearing. The COVID-19 pandemic has led to an increase in mask-wearing, which poses a challenge for face recognition systems. The proposed model uses Pareto optimization to balance accuracy and computation time, and data preprocessing techniques to address the issue of masked faces. The evaluation results demonstrate that the model achieves high accuracy on both masked and unmasked faces, outperforming existing models in the literature. The findings of this study have implications for improving the performance of face recognition systems in real-world scenarios where mask-wearing is prevalent. The results of this study show that the Pareto optimization allowed improving the overall accuracy over the 94% achieved by the original FaceNet variant, which also performed similarly to the ArcFace model during testing. Furthermore, a Pareto-optimized model no longer has a limitation of the model size and is much smaller and more efficient version than the original FaceNet and derivatives, helping to reduce its inference time and making it more practical for use in real-life applications.

Face presentation attack detection performances of facial regions with multi-block LBP features.

Biometric recognition systems are frequently used in daily life although they are vulnerable to attacks. Today, especially the increasing use of face authentication systems has made these systems the target of face presentation attacks (FPA). This has increased the need for sensitive systems detecting the FPAs. Recently surgical masks, frequently used due to the pandemic, directly affect the performance of face recognition systems. Researchers design face recognition systems only from the eye region. This motivated us to evaluate the FPA detection performance of the eye region. Based on this, in cases where the whole face is not visible, the FPA detection performance of other parts of the face has also been examined. Therefore, in this study, FPA detection performances of facial regions of wide face, cropped face, eyes, nose, and mouth was investigated. For this purpose, the facial regions were determined and normalized, and texture features were extracted using powerful texture descriptor local binary patterns (LBP) due to its easy computability and low processing complexity. Multi-block LBP features are used to obtain more detailed texture information. Generally uniform LBP patterns are used for feature extraction in the literature. In this study, the FPA detection performances of both uniform LBP patterns and all LBP patterns were investigated. The size of feature vector is reduced by principal component analysis, and real/fake classification is performed with support vector machines. Experimental results on NUAA, CASIA, REPLAY-ATTACK and OULU-NPU datasets show that the use of all patterns increased the performance of FPA detection.

A Hybrid Method of Enhancing Accuracy of Facial Recognition System Using Gabor Filter and Stacked Sparse Autoencoders Deep Neural Network

Face recognition has grown in popularity due to the ease with which most recognition systems can find and recognize human faces in images and videos. However, the accuracy of the face recognition system is critical in ascertaining the success of a person’s identification. A lack of sufficiently large training datasets is one of the significant challenges that limit the accuracy of face recognition systems. Meanwhile, machine learning (ML) algorithms, particularly those used for image-based face recognition, require large training data samples to achieve a high degree of face recognition accuracy. Based on the above challenge, this research proposes a method for improving face recognition precision and accuracy by employing a hybrid approach of the Gabor filter and a stacked sparse autoencoders (SSAE) deep neural network. The face image datasets from Olivetti Research Laboratory (OLR) and the Extended Yale-B databases were used to evaluate the proposed hybrid model’s performance. All face image datasets used in our experiments are grayscale image type with a resolution of 92 × 112 for the OLR database and a resolution 192 × 168 for the Extended Yale-B database. Our experimental results showed that the proposed method improved face recognition accuracy by approximately 100% for the two databases used at a significantly reduced feature extraction time compared to the current state-of-art face recognition methods for all test cases. The SSAE approach can explore large and complex datasets with minimal computation time. In addition, the algorithm minimizes the false acceptance rate and improves recognition accuracy. This implies that the proposed method is promising and has the potential to enhance the performance of face recognition systems.

Face Image Quality Assessment: A Literature Survey

The performance of face analysis and recognition systems depends on the quality of the acquired face data, which is influenced by numerous factors. Automatically assessing the quality of face data in terms of biometric utility can thus be useful to detect low-quality data and make decisions accordingly. This survey provides an overview of the face image quality assessment literature, which predominantly focuses on visible wavelength face image input. A trend towards deep learning-based methods is observed, including notable conceptual differences among the recent approaches, such as the integration of quality assessment into face recognition models. Besides image selection, face image quality assessment can also be used in a variety of other application scenarios, which are discussed herein. Open issues and challenges are pointed out, i.a., highlighting the importance of comparability for algorithm evaluations and the challenge for future work to create deep learning approaches that are interpretable in addition to providing accurate utility predictions.

An effective face recognition method using guided image filter and convolutional neural network

<p>In the area of computer vision, face recognition is a challenging task because of the pose, facial expression, and illumination variations. The performance of face recognition systems reduces in an unconstrained environment. In this work, a new face recognition approach is proposed using a guided image filter, and a convolutional neural network (CNN). The guided image filter is a smoothing operator and performs well near the edges. Initially, the ViolaJones algorithm is used to detect the face region and then smoothened by a guided image filter. Later the proposed CNN is used to extract the features and recognize the faces. The experiments were performed on face databases like ORL, JAFFE, and YALE and attained a recognition rate of 98.33%, 99.53%, and 98.65% respectively. The experimental results show that the suggested face recognition method attains good results than some of the state-of-the-art techniques.</p>

Impact of facial tattoos and paintings on face recognition systems

In the past years, face recognition technologies have shown impressive recognition performance, mainly due to recent developments in deep convolutional neural networks. Notwithstanding those improvements, several challenges which affect the performance of face recognition systems remain. In this work, we investigate the impact that facial tattoos and paintings have on current face recognition systems. To this end, we first collected an appropriate database containing image-pairs of individuals with and without facial tattoos or paintings. The assembled database was used to evaluate how facial tattoos and paintings affect the detection, quality estimation, as well as the feature extraction and comparison modules of a face recognition system. The impact on these modules was evaluated using state-of-the-art open-source and commercial systems. The obtained results show that facial tattoos and paintings affect all the tested modules, especially for images where a large area of the face is covered with tattoos or paintings. Our work is an initial case-study and indicates a need to design algorithms which are robust to the visual changes caused by facial tattoos and paintings.

Cross-resolution face identification using deep-convolutional neural network

Low resolution (LR) and very low resolution (VLR) face images captured by surveillance cameras make automatic face recognition (AFR) a challenging task. The performance of an automatic face recognition system (AFRS) degrades when these types of face images are compared with high resolution (HR) gallery images. This paper has presented a face identification system called Cross-Resolution Face Identification System, to address this issue. It makes use of the Deep Convolutional Neural Network (DCNN) having different pooling operations to extract resolution robust features from high resolution, low resolution and very low resolution face images. The proposed system is evaluated on four face databases, namely, the ORL, the extended Yale face B, the LFW, and the Georgia Tech under three cross resolution environmental conditions based on resolution of probe images (i.e., high resolution to high resolution, low resolution to high resolution, and very low resolution to high resolution).The experimental outcomes exhibit the effectiveness of the proposed face identification system.

Image processing effects on the deep face recognition system.

Face recognition technology has become an important quantitative examination method in the field of forensic identification of human images. However, face image quality affects the recognition performance of face recognition systems. Existing research on the effects of face image denoising and enhancement methods on the face recognition performance are typically based on facial images with manually synthesized noises rather than the noises under natural environmental corruption, and their studied face recognition techniques are limited on the traditional face recognition algorithms rather than state-of-the-art convolutional neural network based face recognition methods. In this work, face image materials from 33 real cases in forensic identification of human images were collected for quantitative analysis of the effects of face image denoising and enhancement methods on the deep face recognition performance of the MXNet system architecture based face recognition system. The results show that face image quality has a significant effect on the recognition performance of the face recognition system, and the image processing techniques can enhance the quality of face images, and then improve the recognition precision of the face recognition system. In addition, the effects of the Gaussian filtering are better than the self-snake model based image enhancement method, which indicates that the image denoising methods are more suitable for performance improvement of the deep face recognition system rather than the image enhancement techniques under the application of the practical cases.

Cross‐ethnicity face anti‐spoofing recognition challenge: A review

Face anti-spoofing is critical to prevent face recognition systems from a security breach. The biometrics community has %possessed achieved impressive progress recently due the excellent performance of deep neural networks and the availability of large datasets. Although ethnic bias has been verified to severely affect the performance of face recognition systems, it still remains an open research problem in face anti-spoofing. Recently, a multi-ethnic face anti-spoofing dataset, CASIA-SURF CeFA, has been released with the goal of measuring the ethnic bias. It is the largest up to date cross-ethnicity face anti-spoofing dataset covering $3$ ethnicities, $3$ modalities, $1,607$ subjects, 2D plus 3D attack types, and the first dataset including explicit ethnic labels among the recently released datasets for face anti-spoofing. We organized the Chalearn Face Anti-spoofing Attack Detection Challenge which consists of single-modal (e.g., RGB) and multi-modal (e.g., RGB, Depth, Infrared (IR)) tracks around this novel resource to boost research aiming to alleviate the ethnic bias. Both tracks have attracted $340$ teams in the development stage, and finally 11 and 8 teams have submitted their codes in the single-modal and multi-modal face anti-spoofing recognition challenges, respectively. All the results were verified and re-ran by the organizing team, and the results were used for the final ranking. This paper presents an overview of the challenge, including its design, evaluation protocol and a summary of results. We analyze the top ranked solutions and draw conclusions derived from the competition. In addition we outline future work directions.

Patch-based pose invariant features for single sample face recognition

Pose variation is considered as one of the major challenges that degrade the performance of face recognition systems. Existing techniques address this problem from different attitudes. However, these methods may be inefficient or impractical in the case of single sample face recognition. This article presents an automatic patch-based pose invariant feature extraction method that can handle pose variations for the aforementioned case. The proposed method extracts Gabor and histograms of oriented gradients features from landmark-based patches. The features are then concatenated, dimensionally reduced using principal component analysis, fused using canonical correlation analysis, and normalized using min-max normalization. Experimental results carried out on the FERET database have shown the outstanding performance of the proposed method compared to that of the state-of-the-art approaches. The proposed approach achieved $$100\%$$ and $$96\%$$ and $$94.5\%$$ recognition rates for moderate and wide pose variations, respectively.

Cross-resolution face recognition adversarial attacks

• The performance of face recognition systems degrades in cross-resolution scenarios. • Deep models can be jeopardized by adversarial attacks based on different norms. • The success rate of the attacks is higher, on average, at low input resolutions. • Deep representations attacks represent a severe menace to face recognition systems. • Cross-resolution training can improve the robustness of deep models. Face Recognition is among the best examples of computer vision problems where the supremacy of deep learning techniques compared to standard ones is undeniable. Unfortunately, it has been shown that they are vulnerable to adversarial examples - input images to which a human imperceptible perturbation is added to lead a learning model to output a wrong prediction. Moreover, in applications such as biometric systems and forensics, cross-resolution scenarios are easily met with a non-negligible impact on the recognition performance and adversary’s success. Despite the existence of such vulnerabilities set a harsh limit to the spread of deep learning-based face recognition systems to real-world applications, a comprehensive analysis of their behavior when threatened in a cross-resolution setting is missing in the literature. In this context, we posit our study, where we harness several of the strongest adversarial attacks against deep learning-based face recognition systems considering the cross-resolution domain. To craft adversarial instances, we exploit attacks based on three different metrics, i.e., L 1 , L 2 , and L ∞ , and we study the resilience of the models across resolutions. We then evaluate the performance of the systems against the face identification protocol, open- and close-set. In our study, we find that the deep representation attacks represents a much dangerous menace to a face recognition system than the ones based on the classification output independently from the used metric. Furthermore, we notice that the input image’s resolution has a non-negligible impact on an adversary’s success in deceiving a learning model. Finally, by comparing the performance of the threatened networks under analysis, we show how they can benefit from a cross-resolution training approach in terms of resilience to adversarial attacks.

Normalization of Facial Pose and Expression to Increase the Accuracy of Face Recognition System

Normalization of face poses and expressions is one of the critical steps to restore the raw appearance of faces in uncontrolled conditions (in the wild) and help improving the performance of face recognition systems. Researchers in the field of computer vision has for a long time trying to find methods to normalize of poses and expressions to gain accuracy improvement for the face recognition process. The process of normalization is related to the face alignment stage, which aims to find face landmarks (point markers of facial features). From this face landmarks, the poses and facial expressions that are different from canonical face obtained for later transformation. This paper discusses the method of normalizing poses and facial expressions that have been proposed by researchers from geometrical-based transformation to the current state of the art, which is a deep learning-based system.

Constrained [formula omitted]-optimal sparse representation technique for face recognition

The performance of face recognition (FR) system essentially depends on the availability of training data. With limited training data available, it creates a major challenge in real world applications. This motivates researchers to investigate for such technique which generates optimum results using limited training samples or even single sample per person (SSPP). In this paper, a novel FR method is developed as Constrained L1-Optimal Sparse Representation Technique (L1-CSRT) for SSPP. An optimal sparse representation technique is formulated using the constrained Cuckoo search algorithm (CSA) for estimation of λ coefficients. Further, a novel fitness function is developed based on the L1-norm for better classification accuracy yielding better FR. The motivation behind the optimization of λ coefficients using CSA is to increase the sparsity by a better exploration of search space. The efficiency and accuracy of proposed L1-CSRT is shown based on the extensive simulations carried out on standard databases. The experimental results are compared with existing methods in terms of mean classification error. The performance of L1-CSRT is analysed with an improvement of 2--6% in terms of classification accuracy.

Webcam Based Computerized Attendance System using Face Recognition Algorithms

An automated executive participation process, which relies on face recognition and identification measurements, identifies the understudy as it joins the classes and marks the participation by marking it Particular on going circumstances are considered for evaluating the performance of various face recognition systems. This paper provides other than the methods to be used to deal with hazards such as caricature. At the moment, which stands out from traditional engagement, this programs spares time and also Monitor the students

Automatic Student Attendance System using Face Recognition

The most common difficulty that every teacher faces in class room is to take the attendance of the students one by one in each and every class. For the time being many automated systems has been proposed for taking student attendance. In this paper, I introduced an automated student attendance system based on the use of unique techniques for face detection and recognition. This system automatically detects the student when he or she enters the classroom and recognizes that specific student and marks the student's attendance. This method also focuses on the specific features of different attributes such as the face, eye and nose of humans. In order to evaluate the performance of different face recognition system, different real-time situations are considered. This paper also suggests the technique for handling the technique such as spoofing and avoiding student proxy. This system helps track students compared to traditional or current systems and thereby saves time.

An Improved Artificial Neural Network Design for Face Recognition utilizing Harmony Search Algorithm

Face recognition has become an interesting field for researchers where it is used in many applications. One of the most common methods of soft computing is named the artificial neural network (ANN) has been suggested to achieve the face recognition process. Nonetheless, the performance of ANN depends on the number of neurons in the hidden layers and the value of the learning rate. These variables are usually defined based on the trial and error method which is time-consuming. Furthermore, in many cases, it is very difficult to find the optimum value for these variables. Hence, to improve the performance of the ANN for the face recognition process, the optimization algorithm is needed to get promising outcomes. Therefore, this paper introduces an improved ANN design for face recognition using a meta-heuristic optimization algorithm. The ANN represents a distributed processing system consists of neurons which are simply connected elements. One of the most popular techniques for pattern recognition called back propagation algorithm (BP) is used to train the ANN (BP-ANN) to achieve the face recognition process. To enhance the face recognition system performance, the ANN has been hybridized with the well-known meta-heuristic optimization algorithm namely harmony search algorithm (HSA). The HSA based on the principle work of musicians to find the best harmonies. This technique is Implemented based on the results of the fitness function evaluation. In this research, the mean squared error (MSE) has been used as a fitness function. The HSA optimizes the ANN such that the face recognition system provides the lowest MSE and thus enhances the performance of the face recognition system. The accuracy of the optimum hybrid system (HSA-ANN) is investigated using the MATLAB environment conducted for 10 persons. The results revealed that the proposed system (HSA-ANN) achieved lower MSE compare with the ANN. Furthermore, the HSA-ANN gives a better face recognition rate than traditional ANN.

Automatic pose normalization for open-set single-sample face recognition in video surveillance

Face images acquired by video surveillance cameras usually involve large pose variations which significantly degrade the performance of face recognition systems. Existing techniques address the pose variation problem by normalizing the arbitrary poses to the desired pose prior to recognition. However, these methods may require 2D or 3D model fitting and manual facial landmarks annotation. In this work, we present an automatic pose normalization technique that is free from model fitting and manual intervention. Our method utilizes an automatic facial landmark detection algorithm and thin-plate splines warping method to normalize pose-varied face images to a canonical frontal pose. Detecting facial landmarks automatically in face images provides 2D surface points that are used by thin-plate splines warping to geometrically transform face images to the desired pose. Experimental results carried out on the FERET database have shown that the proposed method achieved a comparable or higher performance compared to the state-of-the-art pose normalization approaches under constrained conditions. Moreover, extended experiments on the ChokePoint database have shown that our method substantially improved the performance of our open-set single-sample face recognition approach in the surveillance environment.