UAV-Net+: Effective and Energy-Efficient UAV Network Deployment for Extending Cell Tower Coverage With Dynamic Demands

Abstract

Nowadays, mobile data traffic is growing explosively, but in many realistic scenarios, users still often encounter insufficient or unstable network bandwidth. A promising solution is provided by unmanned aerial vehicle mounted base stations (UAV-BSs) to serve regions with bandwidth shortfall. It is significant to investigate how to deploy UAVs effectively and efficiently for maximizing the sum throughput and service time of a set of mobile clients scattered in a large environment. A basic idea is to use RF ray tracing simulations as a hint to narrow down the search space of UAVs for conducting actual measurements. Furthermore, we formulate two key sub-problems, <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">chunk selection</i> , which selects an optimal subset of chunks in the region as the search space of UAVs, and <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">chunk search</i> , which plans the paths of UAVs to cover all selected chunks for conducting measurements, provide network services and charge timely under energy constraints to maximize the total service time. As they are both proved to be NP-hard, a 3D convolutional deep reinforcement learning (DRL) based chunk selection algorithm and an energy-aware DRL-based chunk search algorithm are proposed to solve them efficiently. A prototype system, <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">UAV-Net+</i> , is implemented to evaluate the feasibility by conducting measurements by an UAV mounted WiFi AP communicating with several clients scattered in a campus, reporting an obvious throughput gain with a small measurement overhead and time consumption. Extensive simulations demonstrate the effectiveness of <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">3D convolutional DRL-based chunk selection algorithm</i> and <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">energy-aware DRL-based chunk search algorithm</i> . It is able to achieve 95.35% effective throughput of the skyline algorithm, <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Oracle</i> , with only 0.7% time cost. It is more beneficial for providing long-time network service and balancing the workload among UAVs.