To meet the performance demands of chip multi-processors, chip designers have increased the capacity and hierarchy of cache memories. Accordingly, a shared lower-level cache reduces conflict misses by adopting a multi-way set-associative structure with high associativity. This structure allows fast access because it allows access to all the ways in the cache set in parallel. However, it consumes a large amount of dynamic energy. Therefore, various schemes have been proposed to increase the cache memory energy efficiency. These schemes use way prediction or partial comparison to reduce unnecessary way accesses. This paper proposes a way prediction algorithm suitable to a shared second-level cache with high associativity. This algorithm is based on the real-time way access dominance detection (WADD). Through this detection, the proposed algorithm can determine the number and location of way candidates suitable for each partial access pattern among the fragmented access patterns due to the first-level cache replacement policy and intermingled accesses by multiple cores. Through this process, the proposed algorithm can implement efficient way prediction. Simulation results show that the WADD exhibits the highest energy efficiency among the comparison group, thus reducing the energy-delay product by 13.5% compared with the conventional cache without way prediction. This result is achieved by reducing the way prediction penalty through fast detection and high prediction accuracy.
Read full abstract