Hyperspectral-cube-based mobile face recognition: A comprehensive review

Abstract

With the hyperspectral sensor technology evolving and becoming more cost-effective, hyperspectral imaging offers new opportunities for robust face recognition. Hyperspectral face cubes contain much more spectral information than face images from common RGB color cameras. Hyperspectral face recognition is robust to the impacts, such as illumination, pose, occlusion, and spoofing, which can heavily avoid the limitations of the visible-image-based face recognition.In this paper, we summarize the spectrum properties of hyperspectral face cubes and survey the hyperspectral face recognition methods in the literature. We categorize them into major groups for better understanding. We overview the existing hyperspectral face datasets, and establish our own dataset. We also discuss efficient neural networks used for mobile face recognition and conduct experiments on mobile hyperspectral face recognition. Results show that under harsh conditions like large illumination changing and pose variation, hyperspectral-cube-based methods have higher recognition accuracy than visible-image-based methods. Finally, we deliver insightful discussions and prospects for future works on mobile hyperspectral face recognition.