Selection of the best population: an information theoretic approach

Abstract

This paper is devoted to the statistical problem of ranking and selection populations by using the subset selection formulation. The interest is focused (i) on the selection of the best population among k independent populations and (ii) on the selection of the best population, which is closest to an additional standard or control population. With respect to the first problem the populations are ranked in terms of entropies of their distributions and the population whose distribution has maximum entropy is selected. For the second problem the populations are ranked in terms of divergences between their distributions and the distribution of the standard or control population and the population with the minimum divergence is selected. In each case the populations are assumed to have general parametric densities satisfying the classical regularity conditions of asymptotic statistic. Large sample properties of the estimators of entropies and divergences of the populations will be studied and used in order to determine the probabilities of correct selection of the proposed asymptotic selection rules. Illustrative examples, including a numerical example using real medical data appeared in the literature, will be given for multivariate homoscedastic normal populations and populations described by the regular exponential family of distributions.