Maximum likelihood parameter and rank estimation in reduced-rank multivariate linear regressions

Abstract

This paper considers the problem of maximum likelihood (ML) estimation for reduced-rank linear regression equations with noise of arbitrary covariance. The rank-reduced matrix of regression coefficients is parameterized as the product of two full-rank factor matrices. This parameterization is essentially constraint free, but it is not unique, which renders the associated ML estimation problem rather nonstandard. Nevertheless, the problem turns out to be tractable, and the following results are obtained. An explicit expression is derived for the ML estimate of the regression matrix in terms of the data covariances and their eigenelements. Furthermore, a detailed analysis of the statistical properties of the ML parameter estimate is performed. Additionally, a generalized likelihood ratio test (GLRT) is proposed for estimating the rank of the regression matrix. The paper also presents the results of some simulation exercises, which lend empirical support to the theoretical findings.