Noise robust multimodal biometric person authentication system using face, speech and signature features

Abstract

In this work, we present a multimodal biometric system using face, speech and signature features which is robust to noise. Face Recognition is done using subspace, Principal Component Analysis (PCA) and Linear Discriminant Analysis (LDA) techniques. Speaker Recognition system is built using Mel Frequency Cepstral Coefficients (MFCC) for feature extraction and Vector Quantization (VQ) for pattern matching. An Off-line Signature Recognition system is built using Vertical and Horizontal Projection Profiles (VPP, HPP) and Discrete Cosine Transform (DCT) for feature extraction. A multimodal biometric database with face, speech and signature biometric features has been collected for 30 users. A multimodal biometric system is built using score level fusion. Sum rule was used for the fusion of the biometric scores. Experimental results show the efficacy of the multimodal biometric system when the biometric data is affected by noise.