Reinforcement Learning Policy for Adaptive Edge Caching in Heterogeneous Vehicular Network

Abstract

The flourishing vehicular applications require vehicles to download huge amount of Internet data, which consumes significant backhaul bandwidth and considerable time for data content delivery. Caching the popular data at network edge station can alleviate the congestion at backhaul network and reduce the data delivery delay. In this paper, we propose a dynamic edge caching policy for Heterogeneous Vehicular Network via Reinforcement Learning on adaptive traffic intensity and hot content popularity. We aim to enhance the download rate of vehicles adapting to dynamic vehicle velocity and hot file pool by caching the popular content on heterogeneous network edge stations. The proposed policy makes use of real time information and jointly considers download rate for each file and utility for edge stations to improve overall download performance. Simulation results show that our proposed policy can achieve better download rate than random and fixed caching policies.