Automatic detection of facial feature points in image sequences

Abstract

Detection and location of the face as well as extraction of facial features from images is an important stage for numerous facial image interpretation tasks. Detection of facial feature points, such as corners of eyes, lip corners, nostrils from the images are crucial. In this paper a method for autormatic facial feature point detection in image sequences, is introduced. The method uses image normalization, and thresholding techniques to detect 14 facial feature points. Algorithm proposed by Wolf Kienzle is used for face recognition. The detected face region is then divided into 5 relevant regions of interest, each of which is examined separately, further to detect the location of the facial feature points. In each region image is normalized with respect to brightness. Suitable threshold is set for each region, using which image is converted into binary image. Then in each region extreme ends of binary image will locate the facial feature points. In the eye region horizontal and vertical histograms are analyzed to detect eyeballs. This method when tested on Cohn-Kanade database results in recognition rate of 86%. Moreover, when tested on Informatics and Mathematical Modeling (IMM) face database which consists of tilted faces around y axis, we achieved average recognition rate of 83%.