Non‐linear transceiver design for multiple‐input–multiple‐output interference channel with statistical channel state information error

Abstract

This study focuses on robust Tomlinson–Harashima precoding transceiver design for multi-cell multiple-input–multiple-output interference channel with statistical channel state information error. The objective is formulated to minimise the maximum per-user mean square error (MSE) with per-transmitter power constraint. Since the problem is not jointly convex, an approximated method is proposed. The authors optimise the receiver matrix to be minimum MSE form as well as derive the optimisation problems of transmitter matrix and feedback matrix to be second-order cone programming, respectively. By use of the results, the three matrices are updated iteratively. The convergence of the proposed method is also proved. Simulation results show that the proposed scheme outperforms the robust linear transceiver in both MSE and bit error ratio.