NLNet: A narrow-channel lightweight network for finger multimodal recognition

Abstract

Multimodal biometric recognition has attracted more and more attention in recent years because of its security and accuracy. Compared with the single use of fingerprint or finger vein feature recognition, the multi-modal feature recognition method based on fingerprint and finger vein significantly improves the recognition performance. However, most of the multi-modal feature recognition networks have the disadvantages of large number of parameters and high training cost. In this paper, a narrow-channel lightweight network NLNet for fingerprint and finger vein recognition is proposed. The network adopts asymmetric narrow channel structure for lightweight design, and combines shallow network to improve the discriminating nature of the extracted features, which significantly reduces the model parameters and computation. In addition, a lightweight feature extraction module for building feature extraction branches is designed for NLNet. This module takes dimensional transformation feature extraction as the backbone, and the joint extension module and attention mechanism obtain low-redundancy multi-scale feature information. In terms of feature fusion, a feature fusion method based on PatchPooling is proposed. This method combines the characteristics of modal images, and uses Spatial dimension local mapping to increase the utilization rate of low-dimensional features, which effectively improves the richness of classified features. In this paper, experiments were carried out on the SDUMLA-HMT, NUPT-FPV, FVCHKP and HDPR-310 multimodal finger datasets, and the recognition accuracy was high as 97.72 %, 99.10 %, 99.67 % and 99.74 %, respectively. In addition, the effectiveness of the model is verified by comparing with other advanced methods.