Face Image Datasets Research Articles

FaceFinder: A Machine Learning Tool for Identification of Facial Images from Heterogenous Datasets

PurposeTo develop an algorithm to automate the organization of large photo databases using the Haar cascade algorithm for face and eye detection using machine learning tools in Python. DesignRetrospective study for the purposes of clinical tool development. MethodsWe developed an algorithm, termed FaceFinder, to identify front facing images in a large dataset of facial, orthodontal and miscellaneous images. FaceFinder works by detecting the presence of faces and at least two eyes using the Haar cascade. Execution time was recorded using different-sized datasets. A total of 895 images were analyzed by FaceFinder using various thresholds for face and eye detection. Precision, recall, specificity, accuracy, and F1 score were computed by comparison to ground truth labels of the images as determined by a human grader. ResultsUsing medium thresholds for face and eye detection, FaceFinder reached recall, accuracy, and F1 score of 89.3%, 91.6%, and 92.9%, respectively with an execution time per image was 0.91 seconds. Using the highest threshold for face and eye detection, FaceFinder achieved precision and specificity values of 98.3% and 99.2% respectively. ConclusionsFaceFinder is capable of sorting through a heterogenous dataset of photos of patients with craniofacial disease and identifying high-quality front-facing facial images. This capability allows for automated sorting of large databases that can facilitate and expedite data preparation for further downstream analyses involving artificial intelligence and facial landmarking.

Quantitative analysis of facial shape in children to support respirator design

The COVID-19 pandemic demonstrated the need for respiratory protection against airborne pathogens. Respirator options for children are limited, and existing designs do not consider differences in facial shape or size. We created a dataset of children's facial images from three cohorts, then used geometric morphometric analyses of dense and sparse facial landmark representations to quantify age, sex and ancestry-related variation in shape. We found facial shape and size in children vary significantly with age from ages 2 to 18, particularly in dimensions relevant to respirator design. Sex differences are small throughout most of the age range of our sample. Ancestry is associated with significant facial shape variation in dimensions that may affect respirator fit. We offer guidance on how to our results can be used for the appropriate design of devices such as respirators for pediatric populations. We also highlight the need to consider ancestry-related variation in facial morphology to promote equitable, inclusive products.

Introducing a novel dataset for facial emotion recognition and demonstrating significant enhancements in deep learning performance through pre-processing techniques

Facial expression recognition (FER) plays a pivotal role in various applications, ranging from human-computer interaction to psychoanalysis. To improve the accuracy of facial emotion recognition (FER) models, this study focuses on enhancing and augmenting FER datasets. It comprehensively analyzes the Facial Emotion Recognition dataset (FER13) to identify defects and correct misclassifications. The FER13 dataset represents a crucial resource for researchers developing Deep Learning (DL) models aimed at recognizing emotions based on facial features. Subsequently, this article develops a new facial dataset by expanding upon the original FER13 dataset. Similar to the FER + dataset, the expanded dataset incorporates a wider range of emotions while maintaining data accuracy. To further improve the dataset, it will be integrated with the extended Cohn-Kanade (CK+) dataset.This paper investigates the application of modern DL models to enhance emotion recognition in human faces. By training a new dataset, the study demonstrates significant performance gains compared with its counterparts. Furthermore, the article examines recent advances in FER technology and identifies critical requirements for DL models to overcome the inherent challenges of this task effectively. The study explores several DL architectures for emotion recognition in facial image datasets, with a particular focus on convolutional neural networks (CNNs). Our findings indicate that complex architecture, such as EfficientNetB7, outperforms other DL architectures, achieving a test accuracy of 78.9 %. Notably, the model surpassed the EfficientNet-XGBoost model, especially when used with the new dataset. Our approach leverages EfficientNetB7 as a backbone to build a model capable of efficiently recognizing emotions from facial images. Our proposed model, EfficientNetB7-CNN, achieved a peak accuracy of 81 % on the test set despite facing challenges such as GPU memory limitations. This demonstrates the model's robustness in handling complex facial expressions. Furthermore, to enhance feature extraction and attention mechanisms, we propose a new hybrid model, CBAM-4CNN, which integrates the convolutional block attention module (CBAM) with a custom 4-layer CNN architecture. The results showed that the CBAM-4CNN model outperformed existing models, achieving higher accuracy, precision, and recall metrics across multiple emotion classes. The results highlight the critical role of comprehensive and diverse data in enhancing model performance for facial emotion recognition.

Deep convolutional neural networks for age and gender estimation using an imbalanced dataset of human face images

Deep convolutional neural networks for age and gender estimation using an imbalanced dataset of human face images

Utility-based performance evaluation of biometric sample quality measures

The quality score of a biometric sample is intended to predict the sample’s degree of utility for biometric recognition. Different authors proposed different definitions for utility. A harmonized definition of utility would be useful to facilitate the comparison of biometric sample quality assessment algorithms. In this article, we compare different definitions of utility and apply them to both face image and fingerprint image data sets containing multiple samples per biometric instance and covering a wide range of potential quality issues. The results differ only slightly. We show that discarding samples with low utility scores results in rapidly declining false non-match rates. The obtained utility scores can be used as target labels for training biometric sample quality assessment algorithms and as baseline when summarizing utility-prediction performance in a single plot or even in a single figure of merit.

Masked contrastive graph representation learning for age estimation

Age estimation of face images is a crucial task with various practical applications in areas such as video surveillance and Internet access control. While deep learning-based age estimation methods like Convolutional Neural Networks (CNN), Multilayer Perceptrons (MLP), and Transformers have shown remarkable performance, they have limitations when modeling complex or irregular objects, and often contain redundant information. Although existing graph neural networks (GNNs) can alleviate this issue, they only considers the structural information of the image and ignores the semantic features, thus the feature representation capability of graph nodes is limited. To address these issues, this paper proposes a novel Masked Contrastive Graph Representation Learning (MCGRL) method for accurate age estimation of face images. Our approach leverages CNN to extract semantic features of the image, which are then partitioned into patches that serve as nodes in the graph. We use a masked graph convolutional network (GCN) to derive image-based node representations that capture rich structural information. Finally, we incorporate multiple losses to explore the complementary relationship between structural information and semantic features, which improves the feature representation capability of GCN. Experimental results on real-world face image datasets demonstrate the superiority of our proposed method over other state-of-the-art age estimation approaches. Our code is available at https://github.com/yuntaoshou/MCGRL

Face image de-identification based on feature embedding

A large number of images are available on the Internet with the growth of social networking services, and many of them are face photos or contain faces. It is necessary to protect the privacy of face images to prevent their malicious use by face image de-identification techniques that make face recognition difficult, which prevent the collection of specific face images using face recognition. In this paper, we propose a face image de-identification method that generates a de-identified image from an input face image by embedding facial features extracted from that of another person into the input face image. We develop the novel framework for embedding facial features into a face image and loss functions based on images and features to de-identify a face image preserving its appearance. Through a set of experiments using public face image datasets, we demonstrate that the proposed method exhibits higher de-identification performance against unknown face recognition models than conventional methods while preserving the appearance of the input face images.

Building Face Ageing Model Using Face Synthesis

Advancements in face synthesis technology have enabled innovative methods for modeling facial aging. This research paper focuses primarily on creating a robust face aging model using deep learning and Generative Adversarial Networks (GANs), trained on a diverse dataset of facial images. The proposed approach captures both global features and local textures to produce realistic age-progressed images while preserving the subject's identity. This paper also examines face synthesis techniques, with specific emphasis for the various practical usage of GANs. The key objective of our project is to upgrade both the discriminator and the generator parts of GANs to generate more realistic, age- progressed face images. We evaluated the model using quantitative metrics and qualitative assessments, demonstrating its effectiveness. Additionally, we address ethical considerations, proposing guidelines for responsible use. Our study offers a novel framework with significant applications in security, forensics, and entertainment, and suggests future research directions to improve accuracy and ethical standards.

Face Omron Ring: Proactive defense against face forgery with identity awareness

In the era of Artificial Intelligence Generated Content (AIGC), face forgery models pose significant security threats. These models have caused widespread negative impacts through the creation of forged products targeting public figures, national leaders, and other Persons-of-interest (POI). To address this, we propose the Face Omron Ring (FOR) to proactively protect the POI from face forgery. Specifically, by introducing FOR into a target face forgery model, the model will proactively refuse to forge any face image of protected identities without compromising the forgery capability for unprotected ones. We conduct extensive experiments on 4 face forgery models, StarGAN, AGGAN, AttGAN, and HiSD on the widely used large-scale face image datasets CelebA, CelebA-HQ, and PubFig83. Our results demonstrate that the proposed method can effectively protect 5000 different identities with a 100% protection success rate, for each of which only about 100 face images are needed. Our method also shows great robustness against multiple image processing attacks, such as JPEG, cropping, noise addition, and blurring. Compared to existing proactive defense methods, our method offers identity-centric protection for any image of the protected identity without requiring any special preprocessing, resulting in improved scalability and security. We hope that this work can provide a solution for responsible AIGC companies in regulating the use of face forgery models.

Deep Learning and Face Recognition: Face Recognition Approach Based on the DS-CDCN Algorithm

To enhance the performance and reliability of the face recognition algorithm that is based on deep learning technology, this study utilizes a density-based noise-applied spatial clustering algorithm to cluster a large-scale face image dataset, resulting in a self-constructed dataset. A deep separable center differential convolutional network algorithm is utilized for face recognition. The impact of convolutional parameters on the algorithm’s performance is verified through experiments with ablated convolutional parameters. The study found that the density-based noise-applied spatial clustering algorithm resulted in time savings of 43.66% and 51.22% compared to the K-means clustering algorithm and the hierarchical clustering algorithm, respectively, when analyzing 8000 images. Additionally, the depth-separable center difference convolutional network algorithm had a lower average classification error rate compared to the other two algorithms, with reductions of 2.49% and 17.01%, respectively. The depth-separable center difference convolutional network technique is an advanced method for identifying the faces of people of different races, according to the experimental investigation. It can provide efficient and accurate services for the face recognition needs of various races.

Micronutrient Deficiency Using Image Processing and Neural Network

Abstract: Vitamin and micronutrient deficiencies are a significant global health concern, leading to various adverse health consequences. Early detection and intervention are essential in addressing these issues. The project introduces an intelligent system that utilizes advanced deep learning techniques to identify and differentiate vitamin deficiencies in human tissue through image analysis. The approach involves an initial step of image clustering to separate and isolate problem areas from the input images. The goal is to evaluate the productivity ofimage segmentation methods, extract relevant characteristics, and compare classification results with other methods. To accomplish the objectives, a diverse dataset of facial images is gathered and preprocessed, focusing on individuals both with and without visible signs of vitamin deficiencies Following this, a CNN algorithm, inspired by models like Alex Net, is created and trained using the pre-processed dataset. The CNN isused to identify and classify features based on different types of vitamin deficiencies, enabling an automated andaccurate assessment based on facial images

Currency Classification Using Deep Learning

Among the uses of machine learning is the recognition of facial expressions. Based on the features that are derived from an image, it assigns a facial expression to one of the classes of facial expressions. Convolutional Neural Network (CNN) is a classification technique that may also be used to identify patterns in an image. We used the CNN approach to identify facial expressions in our proposed study. To increase the precision of facial emotion recognition, the wavelet transform is used after CNN processing. Seven distinct facial expressions are included in the facial expression image dataset that was obtained from Kaggle. The findings of the face expression recognition experiment utilizing CNN and wavelet transform show that the accuracy is improved, and the output is audible. Index Terms: Facial and Convolutional Neural Nets

Forward Head Posture Classification Using Deep Learning Models on Facial Recognition Data

Forward Head Posture (FHP) refers to a condition where the head protrudes forward, significantly contributing to neck pain and being associated with decreased productivity and psychological distress. This study investigates the nuanced classification of FHP and proposes a universally applicable methodology for its identification and analysis using deep learning. Leveraging the Korean Facial Image (K-FACE) dataset, rigorous image preprocessing with the Yolo-v8 model was conducted to facilitate accurate measurement of the CranioVertebral Angle (CVA) from various perspectives. The study meticulously evaluated the classification effectiveness of three advanced deep learning models: EfficientNet-B7, NFNet-F7, and ResNet-152. Among these, EfficientNet-B7 demonstrated superior performance with an accuracy of 0.69 and a recall score of 0.69 compared to other models. Additionally, comparisons based on camera angles within the EfficientNet-B7 model highlighted its excellence, particularly at the ±75° angle. The importance of image regions in EfficientNet-B7 was confirmed through Grad-CAM analysis, emphasizing the critical role of the neck region in accurately classifying FHP images. This comprehensive performance comparison and the proposed detailed classification methodology underscore the potential for generalization in FHP classification. Furthermore, by leveraging a unique dataset and employing state-of-the-art classification techniques, this research offers a novel perspective on the discourse surrounding FHP. Future research could integrate expanded facial image datasets and apply transfer learning techniques to further enhance the precision of FHP classification, thereby improving diagnostic accuracy and offering targeted interventions for individuals experiencing neck pain associated with FHP.

Generating bimodal privacy-preserving data for face recognition

The performance of state-of-the-art face recognition systems depends crucially on the availability of large-scale training datasets. However, increasing privacy concerns nowadays accompany the collection and distribution of biometric data, which has already resulted in the retraction of valuable face recognition datasets. The use of synthetic data represents a potential solution, however, the generation of privacy-preserving facial images useful for training recognition models is still an open problem. Generative methods also remain bound to the visible spectrum, despite the benefits that multispectral data can provide. To address these issues, we present a novel identity-conditioned generative framework capable of producing large-scale recognition datasets of visible and near-infrared privacy-preserving face images. The framework relies on a novel identity-conditioned dual-branch style-based generative adversarial network to enable the synthesis of aligned high-quality samples of identities determined by features of a pretrained recognition model. In addition, the framework incorporates a novel filter to prevent samples of privacy-breaching identities from reaching the generated datasets and improve both identity separability and intra-identity diversity. Extensive experiments on six publicly available datasets reveal that our framework achieves competitive synthesis capabilities while preserving the privacy of real-world subjects. The synthesized datasets also facilitate training more powerful recognition models than datasets generated by competing methods or even small-scale real-world datasets. Employing both visible and near-infrared data for training also results in higher recognition accuracy on real-world visible spectrum benchmarks. Therefore, training with multispectral data could potentially improve existing recognition systems that utilize only the visible spectrum, without the need for additional sensors.

The Effects of AI-Driven Face Restoration on Forensic Face Recognition

In biometric recognition, face recognition is a mature and widely used technique that provides a fast, accurate, and reliable method for human identification. This paper aims to study the effects of face image restoration for forensic face recognition and then further analyzes the advantages and limitations of the four state-of-the-art face image restoration methods in the field of face recognition for forensic human image identification. In total, 100 face image materials from an open-source face image dataset are used for experiments. The Gaussian blur processing is applied to simulate the effect of blurred face images in actual cases of forensic human image identification. Four state-of-the-art AI-driven face restoration methods are used to restore the blurred face images. We use three mainstream face recognition systems to evaluate the recognition performance changes of the blurred face images and the restored face images. We find that although face image restoration can effectively remove facial noise and blurring effects, the restored images do not significantly improve the recognition performance of the face recognition systems. Face image restoration may change the original features in face images and introduce new made-up image features, thereby affecting the accuracy of face recognition. In current conditions, the improvement in face image restoration on the recognition performance of face recognition systems is limited, but it still has a positive role in the application of forensic human image identification.

Generative adversarial networks for anonymous acneic face dataset generation.

It is well known that the performance of any classification model is effective if the dataset used for the training process and the test process satisfy some specific requirements. In other words, the more the dataset size is large, balanced, and representative, the more one can trust the proposed model's effectiveness and, consequently, the obtained results. Unfortunately, large-size anonymous datasets are generally not publicly available in biomedical applications, especially those dealing with pathological human face images. This concern makes using deep-learning-based approaches challenging to deploy and difficult to reproduce or verify some published results. In this paper, we propose an efficient method to generate a realistic anonymous synthetic dataset of human faces, focusing on attributes related to acne disorders at three distinct levels of severity (Mild, Moderate, and Severe). Notably, our approach initiates from a small dataset of facial acne images, leveraging generative techniques to augment and diversify the dataset, ensuring comprehensive coverage of acne severity levels while maintaining anonymity and realism in the synthetic data. Therefore, a specific hierarchy StyleGAN-based algorithm trained at distinct levels is considered. Moreover, the utilization of generative adversarial networks for augmentation offers a means to circumvent potential privacy or legal concerns associated with acquiring medical datasets. This is attributed to the synthetic nature of the generated data, where no actual subjects are present, thereby ensuring compliance with privacy regulations and legal considerations. To evaluate the performance of the proposed scheme, we consider a CNN-based classification system, trained using the generated synthetic acneic face images and tested using authentic face images. Consequently, we show that an accuracy of 97.6% is achieved using InceptionResNetv2. As a result, this work allows the scientific community to employ the generated synthetic dataset for any data processing application without restrictions on legal or ethical concerns. Moreover, this approach can also be extended to other applications requiring the generation of synthetic medical images.

Enhancing Foundation Shade Suggestions through Skin Tone Identification

As we concentrate on addressing the challenges in responsible beauty product recommendation, particularly when it involves comparing the product’s color with a person’s skin tone, similar as for foundation and robe p conditions. The features uprooted using the prints from illuminated terrain can be largely deceiving or indeed be inharmonious to be compared with the product attributes. Hence bad illumination condition can oppressively degrade quality of the recommendation. We introduce a machine learning frame for illumination assessment which classifies images into having moreover good or bad illumination condition. We also make an automatic stoner guidance tool which informs a stoner holding their camera if their illumination condition is good or bad. This way, the stoner is handed with rapid-fire feedback and can interactively control how the print is taken for their recommendation. Only a many studies are devoted to this problem, substantially due to the lack of dataset that's large, labeled, and different both in terms of skin tones and light patterns. Lack of similar dataset leads to neglecting skin tone diversity. Thus, we begin by constructing a different synthetic dataset that simulates colorful skin tones and light patterns in addition to a being facial image dataset. Next, we train a Convolutional Neural Network (CNN) for illumination assessment that outperforms the being results using the synthetic dataset. Eventually, we dissect how the work improves the shade recommendation for colorful foundation products

Masked facial recognition using ensemble convolutional neural network and grey-level co-occurrence matrix

The COVID-19 pandemic proved how face masks became necessary to stop the spread of infection. Due to this, effective identification of people wearing face mask became challenging. Masked facial recognition has significantly increased in accuracy because of developments in convolutional neural networks (CNNs). Small size of the dataset of masked facial images has been a problem in earlier research. As would be expected, this results in poorer accuracy when the model tries to identify faces. In this study, a novel model is proposed with textural feature extraction using grey-level co-occurrence matrix (GLCM) and an ensemble of two pre-trained CNNs DenseNet-121 and VGG-16. Using the minimum redundancy and maximum relevance, the model has improved accuracy by choosing the most important features of the image. The model was trained using in-house dataset that included 38,290 photos of 2,500 people with approximately equal distribution of properly masked, partially masked, and unmasked images. In this, we evaluated the performance of the model on different classifiers multi-class logistic regression (LR) and support vector machine (SVM) with one-vs-rest (OvR) classification and artificial neural network (ANN) and applied a soft voting scheme. The model achieved the highest accuracy of 98.56% at a learning rate of 0.001 on the ANN classifier.

Text-Guided Synthesis of Masked Face Images

The COVID-19 pandemic has made us all understand that wearing a face mask protects us from the spread of respiratory viruses. The face authentication systems, which are trained on the basis of facial key points such as the eyes, nose, and mouth, found it difficult to identify the person when the majority of the face is covered by the face mask. Removing the mask for authentication will cause the infection to spread. The possible solutions are: (a) to train the face recognition systems to identify the person with the upper face features (b) Reconstruct the complete face of the person with a generative model. (c) train the model with a dataset of the masked faces of the people. In this paper, we explore the scope of generative models for image synthesis. We used stable diffusion to generate masked face images of popular celebrities on various text prompts. A realistic dataset of 15K masked face images of 100 celebrities is generated and is called the Realistic Synthetic Masked Face Dataset (RSMFD). The model and the generated dataset will be made public so that researchers can augment the dataset. According to our knowledge, this is the largest masked face recognition dataset with realistic images. The generated images were tested on popular deep face recognition models and achieved significant results. The dataset is also trained and tested on some of the famous image classification models, and the results are competitive. The dataset is available on this link:- https://drive.google.com/drive/folders/1yetcgUOL1TOP4rod1geGsOkIrIJHtcEw?usp=sharing

Innovative Strategies for Early Autism Diagnosis: Active Learning and Domain Adaptation Optimization.

The early diagnosis of autism spectrum disorder (ASD) encounters challenges stemming from domain variations in facial image datasets. This study investigates the potential of active learning, particularly uncertainty-based sampling, for domain adaptation in early ASD diagnosis. Our focus is on improving model performance across diverse data sources. Utilizing the Kaggle ASD and YTUIA datasets, we meticulously analyze domain variations and assess transfer learning and active learning methodologies. Two state-of-the-art convolutional neural networks, Xception and ResNet50V2, pretrained on distinct datasets, demonstrate noteworthy accuracies of 95% on Kaggle ASD and 96% on YTUIA, respectively. However, combining datasets results in a modest decline in average accuracy, underscoring the necessity for effective domain adaptation techniques. We employ uncertainty-based active learning to address this, which significantly mitigates the accuracy drop. Xception and ResNet50V2 achieve 80% and 79% accuracy when pretrained on Kaggle ASD and applying active learning on YTUIA, respectively. Our findings highlight the efficacy of uncertainty-based active learning for domain adaptation, showcasing its potential to enhance accuracy and reduce annotation needs in early ASD diagnosis. This study contributes to the growing body of literature on ASD diagnosis methodologies. Future research should delve deeper into refining active learning strategies, ultimately paving the way for more robust and efficient ASD detection tools across diverse datasets.