A collaborative optimization strategy for computing offloading and resource allocation based on multi-agent deep reinforcement learning

Abstract

With the emergence of mobile edge computing (MEC), the edge cloud with certain computing power is deployed closer to the mobile device, which can well solve the computing and delay requirements of the mobile device. In 5G ultra-dense heterogeneous networks, where the macro base station (MBS) and multiple dense small base stations (SBS) are deployed in the region, the offloading decision faces multiple choices. In order to solve the problem of computing offloading and resource allocation in 5G ultra-dense heterogeneous networks, we propose a collaborative optimization strategy based on multi-agent deep reinforcement learning (MADRL). At each time, the mobile device only needs to make the optimal offloading decision according to its own historical offloading decision, the allocated bandwidth and computing resources at the past time, as well as the service response delay and energy consumption at the past time, without knowing other user information and dynamic network environment information. Simulation results show that the proposed collaborative optimization strategy is better than the other three baseline schemes in terms of service response delay and energy consumption performance.