A delayed eviction caching replacement strategy with unified standard for edge servers

Abstract

The current explosion of user traffic compels Internet service providers to cache contents at edge servers, so as to reduce the response time of user requests. To deal with such vast amounts of content in edge servers with limited storage, an efficient caching replacement strategy is necessary, consisting of admission and eviction processes. Facing such a large number of user requests and limited storage of edge servers, traditional caching replacement strategies have encountered two major problems. Firstly, they conduct eviction process immediately after cache miss, which ignores the fetching time, during which there may still be multiple access requests to the evicted contents. Secondly, most existing solutions treat admission process and eviction process separately, with different standards, some contents might be fetched and evicted back and forth, seriously affecting user experience. To solve these two problems and improve caching performance, we design two caching modules, Delayed-Eviction and Unified-Standard, and integrate them together into Adele framework. By conducting extensive simulations using real traces, we demonstrate that Adele can improve the hit rate by 31% compared with the state-of-the-art solutions.