Deep Reinforcement Learning for Resource Allocation in Multi-Band and Hybrid OMA-NOMA Wireless Networks

Abstract

Exploiting the advantages of both non-orthogonal multiple access technique and millimeter-wave communications requires joint efficient resource allocation techniques toward satisfying the stringent requirements of future mobile communication systems. This paper focuses on a multi-band (i.e., millimeter-wave band and sub-6 GHz band) wireless network where both orthogonal and non-orthogonal multiple access techniques coexist. A joint optimization of user association, transmit power allocation, sub-channel assignment, and multiple access technique selection is investigated to maximize the down-link sum-rate under a minimum rate requirement per user and power constraints. The problem is formulated as a non-convex mixed-integer optimization problem; then, it is proved to be <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\mathcal {NP}$ </tex-math></inline-formula> -hard. First, simple greedy and meta-heuristic solutions are proposed. Then, since model-based approaches have generally a high computational complexity, model-free centralized and distributed approaches based on deep reinforcement learning technique are proposed. The latter are based on multiple parallel deep neural networks to generate resource allocation solutions. The proposed approaches are evaluated and compared. Simulation results corroborate the high performance offered by the proposed solutions for stationary and mobile users. They also highlight the benefits of employing hybrid orthogonal and non-orthogonal multiple access scheme in multi-band systems in terms of down-link sum-rate and user fairness.