Robust Session Variability Compensation for SVM Speaker Verification

Abstract

This paper presents an enhanced nuisance attribute projection (NAP) method to improve the performance of speaker verification systems in mismatched train and test conditions. Unlike the conventional NAP training method that does not take any scheme to discriminate the source of nuisance, the proposed method quantitatively estimates the source of nuisance based on the statistics of given background speakers' eigenvalues. The estimated values are used for defining a discriminative weight for each of background speakers and selectively including the statistics of between-class scatter or of within-class scatter from them. Through the scheme, we intend to design a more robust projection matrix which involves less speaker-dependent or speaker-intrinsic variability while including more latent nuisance factors beyond the common within-class scatter of backgrounds. Experimental results on the recent NIST SRE evaluations demonstrate that the proposed algorithms produce consistent improvement over the previous NAP approaches.