Face Detection Performance Research Articles

Dense pedestrian face detection in complex environments

To address the problem of dense crowd face detection in complex environments, this paper proposes a face detection model named Deep and Compact Face Detection (DCFD), which adopts an improved lightweight EfficientNetV2 network to replace the backbone network of RetinaFace. A large kernel attention mechanism is introduced to address the face detection task more accurately. The backbone network, an improved efficient channel attention (ECA) mechanism, is added to further improve the algorithm performance. The feature fusion module is an improved neural architecture search feature pyramid network (NAS-FPN) that significantly improves the face detection accuracy in different scenes. To balance the training process of positive and negative samples, we use the focus loss function to replace the traditional cross-entropy loss function. In different environments, the DCFD algorithm has shown efficient face detection performance. This algorithm provides not only a feasible and effective solution for solving the problem of face detection in dense groups but also an important basis for improving the accuracy of face detection models in practical applications.

Attention Retinex Network(A4R-Net) for face detection under low-light environment

The degradation of recognition rates in low-light environments is a critical issue in terms of security when using object and face recognition technologies in various locations. Existing low-light enhancement models have shown limitations in terms of computational cost and performance. However, this paper overcomes these limitations. The experimental results demonstrate that our model achieves the same performance as existing models with 13 times lower computational cost and a face detection performance of 82.2%.The structure of this paper is as follows: Introduction, which provides the background and explains the limitations of existing models. Proposed Method, which details the structure and working principles of A4R-Net. Experimental Results, which present the evaluation of low-light enhancement performance and the comparison of face detection using YOLOv4 [1]. Conclusion, which discusses the contributions of this research and future research directions.The source code and dataset is https://github.com/Obiru2698/obiru2698.github.io/

Face detection method based on improved YOLO-v4 network and attention mechanism

Abstract Due to insufficient information and feature extraction in existing face-detection methods, as well as limited computing power, designing high-precision and efficient face-detection algorithms is an open challenge. Based on this, we propose an improved face detection algorithm. First, through 1 × 1’s common convolution block (CBL) expands the channel for feature extraction, introduces a depthwise separable residual network into the YOLO-v4 network to further reduce the amount of model computation, and uses CBL to reduce the dimension, so as to improve the efficiency of the subsequent network. Second, the improved attention mechanism is used to splice the high-level features, and the high-level features and the shallow features are fused to obtain the feature vectors containing more information, so as to improve the richness and representativeness of the feature vectors. Finally, the experimental results show that compared with other comparative methods, our method achieves the best results on public face datasets, and our performance in personal face detection is significantly better than other methods.

Face Detection Performance Using CNNs and Bug Bonuty Program (BBP)

Face Detection Performance Using CNNs and Bug Bonuty Program (BBP)

Pattern Recognition in Embedded Systems for Event Occurrences

Abstract: PR (pattern recognition) typically includes interaction with humans and other complicated processes in the real world, embedded systems are ideal candidates. A typical PR application often considered the more perceptual branch of AI, responds to external events that the system detects through physical sensors or input devices by activating actuators or displaying relevant information. To explore the embedded recognition system and apply the deep learning algorithm to face detection, the deep learning-based Convolutional Neural Network (CNN)suggests two deep face detection methods. These are presented to use the deep learning algorithm.This was done to make it possible for us to use the deep learning algorithm for face detection. Because of this, to analyze the built-in face recognition system and applied the deep learning algorithm to the process of identifying faces. In addition, to do both things simultaneously. OMTCNN's training accuracy is 85.14%, higher than the unimproved algorithm. Accuracy of the recognition and calculation acceleration modules boosts embedded system face detection and identification performance. Embedded deep learning recognition is helpful.

Survey on Utilizing Deep Learning Algorithms to Improve Face Detection in Videos with Challenging Conditions

Face detection in videos is a fundamental task with significant practical applications in various domains, including security, surveillance, and human-computer interaction. However, it becomes increasingly challenging when dealing with videos that contain various adverse conditions, such as low lighting, occlusions, pose variations, and scale changes. Traditional face detection methods often struggle to provide accurate and reliable results under these challenging conditions. This research explores the application of deep learning algorithms to enhance the performance of face detection in videos under challenging conditions. To validate the effectivenessof our approach, we conduct extensive experiments on benchmark datasets with various challenging conditions. The experimental results demonstrate that our proposed method outperforms state-of-the-art techniques in terms of accuracy, robustness, and computational efficiency. Additionally, we provide an in-depth analysis of the model’s performance under different challenging scenarios, highlighting its ability to handle occlusions, pose variations, and low- resolution frames effectively. Keywords: Face Detection , Deep Learning , Video Analysis, Challenging Conditions , Low lighting , Occlusion .

Computationally intelligent real-time security surveillance system in the education sector using deep learning.

Real-time security surveillance and identity matching using face detection and recognition are central research areas within computer vision. The classical facial detection techniques include Haar-like, MTCNN, AdaBoost, and others. These techniques employ template matching and geometric facial features for detecting faces, striving for a balance between detection time and accuracy. To address this issue, the current research presents an enhanced FaceNet network. The RetinaFace is employed to perform expeditious face detection and alignment. Subsequently, FaceNet, with an improved loss function is used to achieve face verification and recognition with high accuracy. The presented work involves a comparative evaluation of the proposed network framework against both traditional and deep learning techniques in terms of face detection and recognition performance. The experimental findings demonstrate that an enhanced FaceNet can successfully meet the real-time facial recognition requirements, and the accuracy of face recognition is 99.86% which fulfills the actual requirement. Consequently, the proposed solution holds significant potential for applications in face detection and recognition within the education sector for real-time security surveillance.

Face detection based on a human attention guided multi-scale model

Multiscale models are among the cutting-edge technologies used for face detection and recognition. An example is Deformable part-based models (DPMs), which encode a face as a multiplicity of local areas (parts) at different resolution scales and their hierarchical and spatial relationship. Although these models have proven successful and incredibly efficient in practical applications, the mutual position and spatial resolution of the parts involved are arbitrarily defined by a human specialist and the final choice of the optimal scales and parts is based on heuristics. This work seeks to understand whether a multi-scale model can take inspiration from human fixations to select specific areas and spatial scales. In more detail, it shows that a multi-scale pyramid representation can be adopted to extract interesting points, and that human attention can be used to select the points at the scales that lead to the best face detection performance. Human fixations can therefore provide a valid methodological basis on which to build a multiscale model, by selecting the spatial scales and areas of interest that are most relevant to humans.

A Rotation-Invariance Face Detector Based on RetinaNet

The use of deep convolutional neural networks has greatly improved the performance of general face detection. For detecting rotated faces, the mainstream approach is to use multi-stage detectors to gradually adjust the rotated face to a vertical orientation for detection, which increases the complexity of training as multiple networks are involved. In this study, we propose a new method for rotation-invariant face detection, which abandons the previously used cascaded architecture with multiple stages and instead uses a single-stage detector to achieve end-to-end detection of face classification, face box regression, and facial landmark regression. Extensive experiments on FDDB in multiple orientations have shown the effectiveness of our method. The results demonstrate that our method achieves good detection performance and the detection accuracy of our method even exceeds that of other rotated face detectors on the front-facing FDDB dataset.

Sheep Face Detection Based on an Improved RetinaFace Algorithm.

The accurate breeding of individual sheep has shown outstanding effectiveness in food quality tracing, prevention of fake insurance claims, etc., for which sheep identification is the key to guaranteeing its high performance. As a promising solution, sheep identification based on sheep face detection has shown potential effectiveness in recent studies. Unfortunately, the performance of sheep face detection has still been a challenge due to diverse background illumination, sheep face angles and scales, etc. In this paper, an effective and lightweight sheep face detection method based on an improved RetinaFace algorithm is proposed. In order to achieve an accurate and real-time detection of sheep faces on actual sheep farms, the original RetinaFace algorithm is improved in two main aspects. Firstly, to accelerate the speed of multi-scale sheep face feature extraction, an improved MobileNetV3-large with a switchable atrous convolution is optimally used as the backbone network of the proposed algorithm. Secondly, the channel and spatial attention modules are added into the original detector module to highlight important facial features of the sheep. This helps obtain more discriminative sheep face features to mitigate against the challenges of diverse face angles and scale in sheep. The experimental results on our collected real-world scenarios have shown that the proposed method outperforms others with an F1score of 95.25%, an average precision of 96.00%, a model size of 13.20 M, an average processing time of 26.83 ms, and a parameter of 3.20 M.

The future of video-based face detection: Conventional methods VS. deep learning

Recently, the problem of intelligent video analysis in the field of computer vision is receiving considerable attention worldwide. Several studies have proposed some classic methods to implement video-based face detection and face recognition. However, it has confirmed that the performance of video analysis can still improve in order to make it applicable to more scenarios. This article discusses using conventional methods and deep learning to achieve face detection. Two main issues need to be solved to accurately observe the performance of face detection, method selection, and model construction. AdaBoost and multi-task convolutional neural network (MTCNN) are selected to conduct the experiment. The results indicate that it is possible to combine these two methods to realize video-based face detection with higher performance.

Local Corner and Motion Key Point Trajectory Extraction for Facial Forgery Identification

At present, the development of deep forgery technology has brought new challenges to media content forensics, and the use of deep forgery identification methods to identify forged audio and video has become a significant focus of research and difficulty. Deep forgery technology and forensic technology play a mutual game and promote each other’s development. This paper proposes a spatiotemporal local feature abstraction (STLFA) framework for facial forgery identification to solve the media industry challenges of deep forgery technology. To adequately utilize local facial features, we combine facial key points, key point movement, and facial corner points to detect forgery content. This paper establishes a spatiotemporal relation, which realizes face forgery detection by identifying abnormalities of facial keypoints and corner points for interframe judgments. Meanwhile, we utilize RNNs to predict the sequences from facial key point movement abnormalities and corner points for interframe. Experimental results show that our method achieves better performance than some existing methods and good anticompression forgery face detection performance on FF++.

HeadPose-Softmax: Head pose adaptive curriculum learning loss for deep face recognition

Face recognition has been one of the most popular applications in the field of target detection. Currently, frontal faces can be easily detected, but multi-view face detection remains a difficult task because of various factors such as illumination, various poses, occlusions, and facial expressions. Margin-based loss functions are used to increase the feature margins between different classes, thus enhancing the discriminability of face recognition models, but the performance in face detection in complex scenes (e.g., high pitch angle face detection in surveillance environments) can be significantly degraded. Recently, the idea of a mining-based strategy to emphasize hard samples has been used to achieve good results in multi-view face detection. However, most of the existing methods do not explicitly emphasize samples based on their importance, resulting in the underutilization of hard samples. In this paper, we propose a curriculum learning loss function (HeadPose-Softmax) to classify the difficulty of a sample based on its facial pose, and embed the concept of curriculum learning into the loss function to implement a novel training strategy for deep face recognition. The loss function explicitly emphasizes the importance of the samples according to the different difficulty of each sample, which allows the model to make fuller use of hard samples, focus on learning pose invariant features, and improve the accuracy of the model in multi-view face detection tasks. Specifically, our HeadPose-Softmax dynamically adjusts the relative importance of the hard samples according to the pose angle of the face in the hard samples during the training phase. At each stage, different samples are assigned different importance according to their corresponding difficulty. Extensive experimental results under popular benchmarks show that our HeadPose-Softmax can enhance the accuracy of the model in multi-view face detection and outperform the state-of-the-art competitors.

A Survey and Test of the Face Detection Model Based on Yolov5

Major surveys and papers illustrate how deep learning model performance in face detection and output many excellent tools and model to solve the problem. It boosts many people trying to use them on specific issues; they need to train the model and get the hyperparameters. However, many people are not familiar with the structure of the model, and there are plenty of parameters that make experiments more complicated; the report tries to collect and conclude some methods of experiments. This report provides a survey of the recent research in deep-learning-based face detection and the corresponding form of design of the investigation. At first, this work will do a literature review about the deep learning model, separated into three kinds (CNN R-CNN SSD). They all symbolize their series and illustrate why the work recommends the Yolo series as a pipeline. Then, the work tries the most straightforward method, OVAT, which analyzes the results, then has a discussion, and tries to give an idea for future work.

EEFDet: an efficient and effective face detector for lightweight, fast, and accurate face detection

In practical applications, it is urgent to develop lightweight, fast, and accurate face detectors. Although the performance of face detection has made tremendous progress with the rapid development of deep learning, they still struggle to meet the requirements of both efficiency and effectiveness. This is because current face detectors either use large networks or cumbersome processes oriented for accuracy but leading to heavy model complexity and slow inference speed or use various simple designs oriented for efficiency but greatly sacrificing accuracy or not actually efficient. In this paper, we conduct an in-depth study of the network structure and anchor setting and present an efficient and effective face detector named EEFDet, which can detect faces with lightweight model, fast inference speed, and excellent accuracy. First, a lightweight, fast, and robust network (LFRNet) is constructed by carefully designing the backbone network, detection neck, and detection head of the network. LFRNet not only has small model complexity and low latency but also possesses robust feature extraction ability. Then, a sparse anchor strategy is proposed by rationally setting anchors associated with the detection head to avoid using too many redundant anchors and get the most effective anchors. This strategy enables the detector to process multiple anchor-related parts at a fast speed while still guaranteeing detection accuracy. Extensive experiments and detailed ablation analysis are conducted on several widely used face detection benchmarks based on multiple metrics and different platforms. The results show that our EEFDet is lightweight (1.195 M parameters and 0.719 G FLOPs), fast (38.780 ms on GPU and 141.787 ms on CPU), and accurate [90.8%/89.6% (easy), 88.1%/87.2% (medium), 77.9%/77.4% (hard) APs on Val/Test set of WIDER FACE, 96.3% discrete score and 79.7% continuous score on face detection data set and benchmark (FDDB), 97.7% AP on PASCAL FACE, and 98.2% AP on annotated face in-the-wild (AFW)], achieving an optimal trade-off between efficiency and effectiveness compared to state-of-the-art face detectors.

Fun Selfie Filters in Face Recognition: Impact Assessment and Removal

This work investigates the impact of fun selfie filters, which are frequently used to modify selfies, on face recognition systems. Based on a qualitative assessment and classification of freely available mobile applications, ten relevant fun selfie filters are selected to create a database. To this end, the selected filters are automatically applied to face images of public face image databases. Different state-of-the-art methods are used to evaluate the influence of fun selfie filters on the performance of face detection using dlib, RetinaFace, and a COTS method, sample quality estimated by FaceQNet and MagFace, and recognition accuracy employing ArcFace and a COTS algorithm. The obtained results indicate that selfie filters negatively affect face recognition modules, especially if fun selfie filters cover a large region of the face, where the mouth, nose, and eyes are covered. To mitigate such unwanted effects, a GAN-based selfie filter removal algorithm is proposed which consists of a segmentation module, a perceptual network, and a generation module. In a cross-database experiment the application of the presented selfie filter removal technique has shown to significantly improve the biometric performance of the underlying face recognition systems.

Deep Learning Based Face Mask Detection in Religious Mass Gathering During COVID-19 Pandemic

Notwithstanding the religious intention of billions of devotees, the religious mass gathering increased major public health concerns since it likely became a huge super spreading event for the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). Most attendees ignored preventive measures, namely maintaining physical distance, practising hand hygiene, and wearing facemasks. Wearing a face mask in public areas protects people from spreading COVID-19. Artificial intelligence (AI) based on deep learning (DL) and machine learning (ML) could assist in fighting covid-19 in several ways. This study introduces a new deep learning-based Face Mask Detection in Religious Mass Gathering (DLFMD-RMG) technique during the COVID-19 pandemic. The DLFMD-RMG technique focuses mainly on detecting face masks in a religious mass gathering. To accomplish this, the presented DLFMD-RMG technique undergoes two pre-processing levels: Bilateral Filtering (BF) and Contrast Enhancement. For face detection, the DLFMD-RMG technique uses YOLOv5 with a ResNet-50 detector. In addition, the face detection performance can be improved by the seeker optimization algorithm (SOA) for tuning the hyperparameter of the ResNet-50 module, showing the novelty of the work. At last, the faces with and without masks are classified using the Fuzzy Neural Network (FNN) model. The stimulation study of the DLFMD-RMG algorithm is examined on a benchmark dataset. The results highlighted the remarkable performance of the DLFMD-RMG model algorithm in other recent approaches.

Inverted Non-Maximum Suppression for More Accurate and Neater Face Detection

CNN-based face detection methods have achieved significant progress in recent years. In addition to the strong representation ability of CNN, post-processing methods are also very important for the performance of face detection. In general, the face detection method predicts several candidate bounding- boxes for one face. NMS is used to filter out inaccurate candidate boxes to get the most accurate box. The principle of NMS is to select the box with a higher score as the basic box and then delete the box which has a large overlapping area with the basic box but has a lower score. However, the current NMS method and its improved versions do not perform well when face image quality is poor or faces are in a cluster. In these situations, even after NMS filtering, there is often a face corresponding to multiple predicted boxes. To reduce this kind of negative result, in this paper, we propose a new NMS method that operates in the reverse order of other NMS methods. Our method performs well on low-quality and tiny face samples. Experiments demonstrate that our method is effective as a post-processor for different face detection methods. The source code has been released on https://github.com/.

Unsupervised Face Detection in the Dark.

Low-light face detection is challenging but critical for real-world applications, such as nighttime autonomous driving and city surveillance. Current face detection models rely on extensive annotations and lack generality and flexibility. In this paper, we explore how to learn face detectors without low-light annotations. Fully exploiting existing normal light data, we propose adapting face detectors from normal light to low light. This task is difficult because the gap between brightness and darkness is too large and complicated at the object level and pixel level. Accordingly, the performance of current low-light enhancement or adaptation methods is unsatisfactory. To solve this problem, we propose a joint High-Low Adaptation (HLA) framework. We design bidirectional low-level adaptation and multitask high-level adaptation. For low-level, we enhance the dark images and degrade the normal-light images, making both domains move toward each other. For high-level, we combine context-based and contrastive learning to comprehensively close the features on different domains. Experiments show that our HLA-Face v2 model obtains superior low-light face detection performance even without the use of low-light annotations. Moreover, our adaptation scheme can be extended to a wide range of applications, such as improving supervised learning and generic object detection. Project publicly available at: https://daooshee.github.io/HLA-Face-v2-Website/.

Low-Light Image and Video Enhancement Using Deep Learning: A Survey.

Low-light image enhancement (LLIE) aims at improving the perception or interpretability of an image captured in an environment with poor illumination. Recent advances in this area are dominated by deep learning-based solutions, where many learning strategies, network structures, loss functions, training data, etc. have been employed. In this paper, we provide a comprehensive survey to cover various aspects ranging from algorithm taxonomy to unsolved open issues. To examine the generalization of existing methods, we propose a low-light image and video dataset, in which the images and videos are taken by different mobile phones' cameras under diverse illumination conditions. Besides, for the first time, we provide a unified online platform that covers many popular LLIE methods, of which the results can be produced through a user-friendly web interface. In addition to qualitative and quantitative evaluation of existing methods on publicly available and our proposed datasets, we also validate their performance in face detection in the dark. This survey together with the proposed dataset and online platform could serve as a reference source for future study and promote the development of this research field. The proposed platform and dataset as well as the collected methods, datasets, and evaluation metrics are publicly available and will be regularly updated. Project page: https://www.mmlab-ntu.com/project/lliv_survey/index.html.