Deep Reinforcement Learning-Based Service-Oriented Resource Allocation in Smart Grids

Abstract

Resource allocation has a direct and profound impact on the performance of resource-limited smart grids with diversified services that need to be timely processed. In this paper, we investigate a joint communication, computing, and caching resource allocation problem with distinct delay requirement of services in smart grids. This paper aims to optimize the long-term system utility based on reward and loss function. Considering the unknown dynamic environment as well as the huge state and action space in smart grids, a deep reinforcement learning algorithm based on the polling method is exploited to learn the policy by interacting with the environment. Specifically, the edge nodes (ENs) act as agents to enable the services to schedule resources appropriately. Then, the agents that are allocated based on the service requirements are queried according to the polling mechanism and the well-designed reward function is utilized to update the strategy. Extensive simulation results show that the proposed algorithm outperforms three known baseline schemes in terms of network performance with decision results. Besides, in the face of a large number of services in the smart grids, the proposed system still surpasses that of existing several baseline schemes, especially in the improvement of cache hit rate and the decrease of computing delay.