A Novel Criterion for Classifiers Combination in Multistream Speech Recognition

Abstract

In this paper, we propose a novel information theoretic criterion for optimizing the linear combination of classifiers in multi stream automatic speech recognition. We discuss an objective function that achieves a tradeoff between the minimization of a bound on the Bayes probability of error and the minimization of the divergence between the individual classifier outputs and their combination. The method is compared with the conventional inverse entropy and minimum entropy combinations on both small and large vocabulary automatic speech recognition tasks. Results reveal that it outperforms other linear combination rules. Furthermore, we discuss the advantages of the proposed approach and the extension to other (nonlinear) combination rules.