Score bi-Gaussian equalisation for multimodal person verification

Abstract

Multimodal biometric fusion at score level can be performed by means of combinatory or classificatory techniques. In the first case, it is straightforward that the normalisation of the scores is a very important issue for the success of the fusion process. In the classificatory approach as, for instance, in support vector machine (SVM)-based systems, only simple normalisation methods are usually applied. In this work, histogram equalisation of biometric score distribution is successfully applied in a multimodal person verification system composed by prosodic, speech spectrum and face information. Furthermore, a new bi-Gaussian equalisation (BGEQ) is introduced, which takes into account the separate statistics of the genuine and impostor scores by using as a reference a sum of two Gaussian functions, whose standard deviations model the overlap between the genuine and impostor lobes of the original distributions. Multimodal verification experiments are shown, where prosodic and speech spectrum scores are provided by speech experts using the Switchboard-I database, and face scores are obtained by a face recognition expert using XM2VTS database. BGEQ in combination with an SVM fusion system with a polynomial kernel has obtained the best results and has outperformed in more than a 21.29% the results obtained by min–max normalisation.