On Finite Block-Length Quantization Distortion

Abstract

We investigate the upper and lower bounds on the quantization distortions for independent and identically distributed continuous sources in the finite block-length regime. We derive a lower bound on the quantization distortion, as well as an upper bound on the quantization distortion based on random quantization codebooks. Moreover, we apply the obtained bounds to the continuous Gaussian source. For the Gaussian source, we propose a computationally tractable method to numerically compute the upper and lower bounds, for both bounded and unbounded quantization codebooks. Numerical results show that the gap between the upper and lower bounds is small for the block length of several hundreds, and the upper and lower bounds are tighter than those proposed in the existing works.