Combining pixel selection with covariance similarity approach in hyperspectral face recognition based on convolution neural network

Abstract

A Hyperspectral camera provides discriminating features for capturing human faces that cannot be obtained by any other imaging technique. Nevertheless, it has new issues comprising curse of dimensionality, physical parameter retrieval, fast computing and inter band misalignment. As a result of, the literature of Hyperspectral Face Recognition is more scanty and confined to improvised dimensionality reduction and minimization of wide-ranging bands, and thus the objective can be obtained by the use of the Convolution Neural Network (ConvNet). Since ConvNet is of great attention in recent times, it can offer outstanding performance in face recognition systems, where the quantity of training data is amply large. We propose a Hyperspectral Face Recognition system using Firefly algorithm for band fusion and the Convolution Neural Network for classification. In addition to this, the present work is extended 11 exiting face recognition methods to perform Hyperspectral Face Recognition task. Thus the work has been framed as Hyperspectral Face Recognition problem to an image-set classification problem and assessment of the performance has been done on six state-of-the-art image-set problem techniques, and similarly it was examined on five state-of-the-art RGB and gray scale face recognition system, subsequently applied improved Firefly band selection algorithm on Hyperspectral Images to get appropriate band. Assessment with the eleven extended and five existing HSI Face Recognition system on two benchmark datasets (CMU-HSFD & UWA-HSFD) demonstrates that the proposed system overtakes all by a noteworthy margin. Lastly, we execute the band selection demonstration to get the novelty for most informative bands in Visible Near Infrared (VNIR).