Improving Fairness for SSD Devices through DRAM Over-Provisioning Cache Management

Abstract

Modern NVMe SSDs have been widely deployed in multi-tenant cloud computing environments or multi-programming systems. When multiple applications concurrently access one SSD hardware, unfairness within the shared SSD will slow down the application significantly and lead to a violation of service level objectives. However, traditional data cache management within SSDs mainly focuses on improving cache hit ratio, which causes data cache contention and sacrifices fairness among multiple applications. In this paper, we propose a DRAM-based Over-Provisioning (OP) cache management mechanism, named Justitia, to reduce data cache contention and improve fairness for modern SSDs. Justitia consists of two stages including <i>Static-OP</i> stage and <i>Dynamic-OP</i> stage. Through the novel OP mechanism in the two stages, Justitia reduces the max slowdown by <inline-formula><tex-math notation="LaTeX">$4.5\times$</tex-math></inline-formula> on average. At the same time, Justitia increases fairness by <inline-formula><tex-math notation="LaTeX">$20.6\times$</tex-math></inline-formula> and buffer hit ratio by <inline-formula><tex-math notation="LaTeX">$19.6\%$</tex-math></inline-formula> averagely, compared with the traditional shared mechanism.