A novel memory management technique for cloud client devices

Abstract

Cloud computing systems consist of cloud client devices, which support various cloud computing services. As memory bottleneck degrades the performance of computing systems including cloud client devices, increasing the hit rates of last level caches (LLC) can improve the performance of cloud computing systems. To enhance the hit rates of LLC, we propose a new spatial locality aware prefetch technique. The proposed prefetch technique can fetch the data from main memory prior to actual requests to reduce the long latency to the main memory. To support the proposed technique, we introduce a new structure, LLC buffer which contains several memory blocks nearby the previously referenced memory block. In case that the LLC capacity is not enough, the proposed spatial locality-aware prefetch technique can improve the performance of cloud client devices significantly, especially for executing high spatial locality applications. Simulation results show that the proposed technique decreases LLC miss rates by up to 70.26 %, leading to performance improvement by up to 39.12 %.