Canonical coordinates are the right coordinate system for transform coding of noisy sources

Abstract

Historically, transform coding of noisy sources has been performed by first estimating the message and then quantizing this estimate. We show that it is also optimum to first transform the noisy observations into canonical coordinates, quantize, apply a Wiener filter in this coordinate system, and then transform the result back to the original coordinates. Canonical coordinates are uncorrelated, and quantizing and Wiener filtering are applied to each component independently. Optimality of this approach can be proved assuming additive white quantization noise. Half canonical coordinates minimize the mean-squared error by minimizing the trace of the error covariance matrix and full canonical coordinates maximize information rate by minimizing the determinant of the error covariance matrix.