Gender discriminating models from facial surface normals

Abstract

In this paper, we show how to use facial shape information to construct discriminating models for gender classification. We represent facial shapes using 2.5D fields of facial surface normals, and investigate three different methods to improve the gender discriminating capacity of the model constructed using the standard eigenspace method. The three methods are novel variants of principal geodesic analysis (PGA) namely (a) weighted PGA, (b) supervised weighted PGA, and (c) supervised PGA. Our starting point is to define a weight map over the facial surface that indicates the importance of different locations in discriminating gender. We show how to compute the relevant weights and how to incorporate the weights into the 2.5D model construction. We evaluate the performance of the alternative methods using facial surface normals extracted from 3D range images or recovered from brightness images. Experimental results demonstrate the effectiveness of our methods. Moreover, the classification accuracy, which is as high as 97%, demonstrates the effectiveness of using facial shape information for gender classification. ► We propose three strategies to incorporate gender weights into feature extraction. ► The proposed methods improve the discriminating capacity of leading eigen-features. ► The supervised weighted PGA method significantly outperforms the other two. ► The supervised weighted PGA method competes with the state-of-the-art methods.