Collaborative Multiagent Reinforcement Learning Aided Resource Allocation for UAV Anti-Jamming Communication

Abstract

In this article, we investigate the anti-jamming problem with joint channel and power allocation for unmanned aerial vehicle (UAV) networks. In particular, we focus on avoiding both mutual interference among UAVs and external malicious jamming to maximize the system Quality of Experience (QoE) relevant to the power consumption. To simultaneously capture the competition and coordination among UAVs, we first model the problem as a local interaction Markov game and then prove it as an exact potential game with at least one Nash equilibrium. Next, we propose a collaborative multiagent layered Q learning (MALQL)-based anti-jamming communication algorithm to reduce the high dimensionality of the action space and analyze the asymptotic convergence of the proposed algorithm. Simulation results show the effectiveness of the proposed algorithm, which outperforms the traditional multiagent <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$Q$ </tex-math></inline-formula> learning algorithm when suffering from different jamming strategies.