A Hybrid Approach for Multimodal Biometric Recognition based on Feature Level Fusion in Reproducing Kernel Hilbert Space

Abstract

The feature vectors contain richer information than the scores, decisions and even raw data, thereby making feature-level fusion more effective than other levels. In the proposed method, kernel is used for fusion in feature space. First, the face features are extracted using kernel-based methods, the features of both right and left irises are extracted using Hough Transform and Daugman algorithm methods, and the features of both thumb prints are extracted using the Gabor filter bank. Second, after normalization operations, we use kernel methods to map the feature vectors to a reproducing kernel Hilbert space(RKHS) where non-linear relations are shown as linear for the purpose of compatibility of feature spaces. Then, dimensionality reduction algorithms are used to the fusion of the feature vectors extracted from fingerprints, irises and the face. since the proposed system uses face, both right and left irises and right and left thumbprints, it is hybrid multi-biometric system. Our results show that the hybrid multimodal template, while being secure against spoof attacks and making the system robust, can use the dimensionality of only 15 features to increase the accuracy of a hybrid multimodal biometric system to 100%, which shows a significant improvement compared with uni-biometric and other multimodal systems.