Abstract
Ubiquitous Internet of Things (IoT) devices have fueled plenty of innovations in the emerging network paradigms. Among them, IoT edge caching has emerged as a promising technique to cope with the explosive growth in network data traffic, with Quality of Service (QoS) improved and energy saved. However, the intrinsic storage limitations of the edge servers poses a critical challenge for the IoT edge caching system. Enabling edge servers to cooperate with each other can provide a potential perspective to improve the edge storage utilization widely discussed. Nevertheless, it also incurs an additional communication overhead, eventually making the caching system more complex. As a result, how to perform an efficient cooperative caching becomes a critical issue. Thus, in this paper, we propose a deep reinforcement learning-based cooperative edge caching approach, which allows the distributed edge servers to learn to cooperate with each other. Specifically, edge servers determine their cache actions based on the local caching state. After that, the centralized remote server evaluates these actions and feeds back the evaluation results to edge servers for subsequent caching actions optimization. We show that, by designing an appropriate reward function, our approach promotes cooperation between edge servers as well as improving the system hit rate. On this basis, we consider a practical and reasonable scenario with inconsistent data item size and propose a novel multi-agent actor-critic caching algorithm. Extensive simulation results demonstrate the performance improvement using our proposed solution over three other caching algorithms.
Highlights
Fueled by the ubiquity of the Internet of Things (IoT) devices, IoT data has been growing exponentially
We investigate the cooperative caching mechanism in the IoT edge caching scenario, where IoT applications send the request to its assigned edge servers and the edge servers perform cooperatively to satisfy the request
We propose a deep reinforcement learning-based cooperative edge caching approach by combining the characteristics of the deep reinforcement learning approach and the IoT edge caching system
Summary
Fueled by the ubiquity of the Internet of Things (IoT) devices, IoT data has been growing exponentially. Researchers have noted that, it is challenging for the current network paradigm to accommodate these data especially in terms of storage and transmission. This mainly results from the fundamental design of the Internet [3], [4]. IoT applications can retrieve these data without going through the backhaul link, resulting in a significant reduction in data transmission [6] It saves the energy consumption of edge servers by reducing the non-essential utilization of backhaul connections [7], and further decreases the energy cost of IoT devices by minimizing the time to obtain IoT data [8]
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have