Joint Transceiver Design With Antenna Selection for Large-Scale MU-MIMO mmWave Systems

Abstract

This paper considers the uplink of large-scale multiple-user multiple-input multiple-output millimeter wave systems, where several mobile stations (MSs) communicate with a single base station (BS) equipped with a large-scale antenna array, for application to fifth generation wireless networks. Within this context, the use of hybrid transceivers along with antenna selection can significantly reduce the implementation cost and energy consumption of analog phase shifters and low-noise amplifiers. We aim to jointly design the MS beamforming vectors, the hybrid receiving matrices (baseband and analog), and the antenna selection matrix at the BS in order to maximize the achievable system sum-rate under a set of constraints. The corresponding optimization problem is nonconvex and difficult to solve, mainly due to the receive antenna selection and constant modulus constraints on the analog receiving matrix. By exploiting the special structure of the problem and linear relaxation, we first convert this problem into three subproblems, which are solved via an alternating optimization method. The latter iteratively updates the antenna selection matrix, the transmit beamforming vectors, and the hybrid receiving matrices by sequentially addressing each subproblem while keeping the other variables fixed. Specifically, the antenna selection matrix is optimized via the concave–convex procedure; the weighted mean-square error minimization approach is used to find the solution for the transmit beamformer; and the hybrid receiver is obtained via manifold optimization. The convergence of the proposed algorithm is analyzed and its effectiveness is verified by simulation.