Collaborative Data Scheduling for Vehicular Edge Computing via Deep Reinforcement Learning

Abstract

With the development of autonomous driving, the surging demand for data communications as well as computation offloading from connected and automated vehicles can be expected in the foreseeable future. With the limited capacity of both communication and computing, how to efficiently schedule the usage of resources in the network toward best utilization represents a fundamental research issue. In this article, we address the issue by jointly considering the communication and computation resources for data scheduling. Specifically, we investigate on the vehicular edge computing (VEC) in which edge computing-enabled roadside unit (RSU) is deployed along the road to provide data bandwidth and computation offloading to vehicles. In addition, vehicles can collaborate among each other with data relays and collaborative computing via vehicle-to-vehicle (V2V) communications. A unified framework with communication, computation, caching, and collaborative computing is then formulated, and a collaborative data scheduling scheme to minimize the system-wide data processing cost with ensured delay constraints of applications is developed. To derive the optimal strategy for data scheduling, we further model the data scheduling as a deep reinforcement learning problem which is solved by an enhanced deep $Q$ -network (DQN) algorithm with a separate target $Q$ -network. Using extensive simulations, we validate the effectiveness of the proposal.