Bidirectional feature selection with global and local structure preservation for small size samples

Abstract

Collecting samples is a challenging task for face recognition, especially for some real-world applications such as law enhancement and ID card identification, where there is usually single sample per person (SSPS) used to train a face recognition system. To extract discriminative features from the small size samples, in this paper we propose virtual samples via bidirectional feature selection with global and local structure preservation (VS-BFS-GL) to augment the number of training samples. In VS-BFS-GL, bidirectional feature selection is developed, which introduces L2,1 norm to explore the face variations from both horizontal and vertical directions. Further, to include more variations in the virtual images, the global structure information and sample-specified local structure information of the SSPP training set are considered. By integrating bidirectional feature selection, global and local structure, the limited training samples are fully utilized and more knowledge are mined. To further improve the effectiveness of VS-BFS-GL, an auxiliary database containing different face variations can be used to explore the local structure information. We extensively evaluated the proposed approach on AR and FERET database. The promising recognition results demonstrate that VS-BFS-GL is robust to expression, pose and partial occlusion variations in the faces.