Autoencoder‐based deep learning for massive multiple‐input multiple‐output uplink under high‐power amplifier non‐linearities

Abstract

In this paper, the authors study the compensation of high-power amplifier (HPA) non-linear distortion in the multi-user (MU) massive multiple-input multiple-output (MIMO) systems and focus on uplink transmission, where the base station (BS) uses a large antenna array. First, the authors present a non-linear distortion iterative cancellation (NDIC) algorithm-based MMSE and approximate message passing (AMP) at the receiver level, in order to estimate and mitigate jointly a non-linear distortion and the channel noise. Second, the authors propose a novel distortion cancellation technique based on deep learning. At this level, the authors first introduce a multilayer neural network, trained in the Levenberg–Marquardt algorithm by eliminating HPA non-linearities on the ‘Pre distortion’ transmitter and ‘Post distortion’ receiver side. Next, the authors developed a novel end-to-end (E2E) learning approach for the joint transmitter and non-coherent receiver in the Rayleigh fading channel. The basic idea lies in the use of deep neural networks (DNNs), auto encoder (AE) for unknown channels, where DNNs are applied to perform several functions and modules existing in the transmission chain. The simulation results demonstrate the strong potential of the proposed approach E2E in terms of improving the link quality and symbol error rate (SER) compared to other compensation techniques presented in this work.