Distributed user-to-multiple access points association through deep learning for beyond 5G

Abstract

Future wireless networks will be facing unprecedented difficulties arising from mobile traffic growth, network densification, as well as diversification of applications and services. Indeed, future user devices are expected to integrate diverse radio interfaces such as 5G, WBAN or IoT, enabling each user to be served a wide range of applications at any time. This poses significant challenges in terms of wireless resource sharing and interference management, as more and more stringent Quality of Service (QoS) constraints should be jointly satisfied in dense interfering environments. Furthermore, future networks are expected to be highly autonomous and decentralized. To meet these challenges, this work proposes distributed user-to-multiple Access Points (AP) association methods, where the objective is to maximize the long-term sum-rate subject to application QoS constraints, as well as to AP load constraints. Our distributed methods enable each user to leverage their Deep Reinforcement Learning (DRL) capabilities, in particular Deep Q-Learning (DQL), to self-optimize their APs’ selection solely based on their local network state knowledge, so as to best satisfy their diverse requirements. Numerical results show that, compared to baseline schemes, the proposed methods enable global throughput enhancements while reducing user QoS outage probabilities, even in large and dense networks.