Shape contexts and Gabor features for face description and authentication

Abstract

In this paper, we use a robust shape matching algorithm for establishing correspondences between points from face images, and Gabor vectors (jets) for feature computation. After extracting characteristic lines from faces, which is accomplished by using the ridges and valleys operator, shape is sampled through a set of points, where jets are calculated. So, each face is depicted by /spl Rfr//sup 2/ points, and their respective jets. Once two sets of points from face images have been extracted, the shape matching algorithm is used to solve the correspondence problem. A measure between the set of matched points gives an idea of the similarity of the faces. Also, comparison between shape-matched jets is possible, given that they are supposed to be located over the same face parts, leading to a system that is able to take shape and texture into account for face authentication.