Sensitivity Analysis for RVQ-Based Tomlinson–Harashima Precoded MIMO Systems

Abstract

Tomlinson-Harashima precoded (THP) multiple-input-multiple-output (MIMO) systems are developed to cancel the intersymbol interference (ISI) at the transmitter. However, the THP at least requires perfect channel direction information (CDI) to completely mitigate the interference at the transmitter, which is not practical in the real world. The limited feedback systems are then practically developed to convey the quantized CDI to the transmitter. Using the quantized CDI to conduct the THP, an unavoidable interference degrades the performance at the receiver. In this paper, we investigate the performance degradation resulted from the random vector quantization (RVQ), which is a kind of CDI-based limited feedback mechanism. Here, we measure the performance degradation as the excess mean-squared error (EMSE). Since the formulation of the EMSE is a complicated function of the quantization error, we proposed using the second-order Taylor expansion to derive an analytical result. Simulation results have also verified our proposed analysis, showing that the derived analysis can match the actual EMSE.