Masked Face Detection Using Artificial Intelligent Techniques

Abstract

AbstractNowadays, wearing a face mask is a vital routine in life, but threats are increasing in public due to the advantage of wearing face masks. Existing works do not perfectly detect the human face and also not possible to apply for different faces detection. To overwhelm this issue, in this paper we proposed real-time face mask detection. The proposed work consists of six steps: video acquisition and keyframes selection, data augmentation, facial parts segmentation, pixel-based feature extraction, Bag of Visual Words (BoVW) generation, and face mask detection. In the first step, a set of keyframes are selected using the histogram of gradient (HoG) algorithm. Secondly, data augmentation is involved with three steps as color normalization, illumination correction (parameterized CLAHE), and pose normalization (Angular Affine Transformation). In the third step, facial parts are segmented using the clustering approach i.e., Expectation Maximization with Gaussian Mixture Model (EM-GMM), in which facial regions are segmented into Eyes, Nose, Mouth, Chin, and Forehead. Then, CapsNet based Feature Extraction is performed using CapsNet approach, which performance is higher and lightweight model than the Yolo Tiny V2 and Yolo Tiny V3, and extracted features are constructed into Codebook by Hassanat Similarity with K-Nearest neighbor (H-M with KNN) algorithm. For mask detection, L2 distance function is used. Experiments conducted using Python IDLE 3.8 for the proposed model and also previous works as GMM with Deep learning (GMM + DL), Convolutional Neural Network (CNN) with VGGF, Yolo Tiny V2, and Yolo Tiny V3 in terms of various performance metrics.KeywordsCOVID-19 pandemicFace mask detectionCapsNetSurveillance videoKNNAnd ArcFace