SINGLE-SHOT FACE DETECTION AND RECOGNITION BASED ON CNN

Abstract

The paper proposes an architecture and training method of a deep convolutional neural network for simultaneous face detection and recognition. The implemented approach combines the ideas of SSD (Single Shot Detector) and Faster R-CNN (Region proposal Convolutional Neural Networks) algorithms. Face detection is performed similarly to single-stage detection algorithms, and then a biometric template is built by employing RoI (Region of Interest) pooling layers and using the separate branch of the neural network. Training process includes three stages: pretraining of thebasic CNN for face recognition on face images, fine-tuning by using RoI pooling on in painted face images, adding SSD layers and fine-tuning on face detection. Wherein, at the latter stage, training is performed by using shared layers technology for two databases simultaneously. The main feature of the algorithm is high processing speed, which does not depend on the number of faces in the input image. For example, in case of using ResNet-34 as the core architecture for the algorithm, the required time for detecting faces and building biometric templates on an image with 100 faces is less than 13 ms. For training purposes we use CASIA-WebFace for face recognition task and Wider Face for face detection task. Testing is performed on FDDB (Face Detection Dataset and Benchmark), since this database is closer to practical applications than Wider. As long as the main practical task the developed method is intended for is face reidentification, we use Fei Face DataBase for face recognition quality testing. We obtain TPR (True Positive Rate) = 0.928@1000 on FDDB Face DataBase and FAR (Face Acceptance Rate) = 0.03309@FRR (Face Rejection Rate) = 10–4. Therefore, the proposed algorithm allows solving face detection and reidentification tasks in real time with any number of faces on an input image.