Deep representations for cross‐spectral ocular biometrics

Abstract

One of the major challenges in ocular biometrics is the cross-spectral scenario, i.e. how to match images acquired in different wavelengths. This study designs and extensively evaluates cross-spectral ocular verification methods using well known deep learning representations based on the iris and periocular regions. Using as inputs, the bounding boxes of non-normalised iris–periocular regions, the authors fine-tune convolutional neural network models, originally trained for face recognition. On the basis of the experiments carried out in two publicly available cross-spectral ocular databases, they report results for intra-spectral and cross-spectral scenarios, with the best performance being observed when fusing ResNet-50 deep representations from both the periocular and iris regions. When compared to the state of the art, they observed that the proposed solution consistently reduces the equal error rate values by 90%/93%/96% and 61%/77%/83% on the cross-spectral scenario and in the PolyU bi-spectral and cross-eye–cross-spectral datasets. Finally, they evaluate the effect that the ‘deepness’ factor of feature representations has in recognition effectiveness, and based on a subjective analysis of the most problematic pairwise comparisons – they point out further directions for this field of research.