Model-based varying pose face detection and facial feature registration in colour images

Abstract

This paper presents a hybrid method for varying pose face detection and facial feature registration from colour images. At the first stage, we use a skin-colour Gaussian model to identify possible varying pose face regions. At the second stage, we compare each face candidates with a varying pose face model using a combined feature-texture similarity measure (FTSM). False detections from the first stage are eliminated by setting an appropriate FTSM threshold. Also, one can register the facial features (eyes, nose and mouth) by aligning a prototype face with the unknown pose faces. Experimental results show that the proposed method can achieve reliable face detection and feature registration under various conditions, including different poses, face appearances, and lighting conditions.