Pose‐invariant face recognition based on matching the occlusion free regions aligned by 3D generic model

Abstract

Face recognition systems perform accurately in a controlled environment, but an unconstrained environment dramatically degrades their performance. In this study, a novel pose‐invariant face recognition system is proposed based on the occlusion free regions. This method utilises a gallery set of frontal face images and can handle large pose variations. For a 2D probe face image with an arbitrary pose, the head pose is first obtained using a robust head pose estimation method. Then, this 2D face image is normalised by a novel 3D modelling method from a single input image. In consequence, pose invariant face recognition is converted to a frontal face recognition problem. The 3D structure is reconstructed using a new method based on the estimated head pose and only one facial feature point, which is significantly reduced in comparison with the number of landmarks used in previous methods. According to the estimated poses, occlusion free regions are extracted from normalised images as feature extraction. Finally, face matching and recognition is performed using these regions from normalised test images and the corresponding regions of gallery images. Experimental results on FERET and CAS‐PEAL‐R1 databases demonstrate that the proposed method outperforms other methods, and it is robust and efficient.