Derived PDF of maximum likelihood signal estimator which employs an estimated noise covariance

Abstract

A probability density function (PDF) for the maximum likelihood (ML) signal vector estimator is derived when the estimator relies on a noise sample covariance matrix (SCM) for evaluation. By using a complex Wishart probabilistic model for the distribution of the SCM, it is shown that the PDF of the adaptive ML (AML) signal estimator (alias the SCM based minimum variance distortionless response (MVDR) beamformer output and, more generally, the SCM based linearly constrained minimum variance (LCMV) beamformer output) is, in general, the confluent hypergeometric function of a complex matrix argument known as Kummer's function. The AML signal estimator remains unbiased but only asymptotically efficient; moreover, the AML signal estimator converges in distribution to the ML signal estimator (known noise covariance). When the sample size of the estimated noise covariance matrix is fixed, it is demonstrated that there exists a dynamic tradeoff between signal-to-noise ratio (SNR) and noise adaptivity as the dimensionality of the array data (number of adaptive degrees of freedom) is varied, suggesting the existence of an optimal array data dimension that will yield the best performance.