K2vTune: A workload-aware configuration tuning for RocksDB

Abstract

The explosive growth in data has triggered the emergence of NoSQL databases, which can be used to efficiently deal with unstructured and semi-structured data. RocksDB is a widely used persistent key–value store developed by Facebook to support high-throughput storage environments. It provides flexible configuration knobs that can be tuned to optimize performance. However, optimizing the RocksDB performance for specific workloads is challenging because the knobs have complicated inner relationships and different impacts according to workload type. In addition, RocksDB performance is measured using multiple metrics, such as latency and space amplification, which should be simultaneously considered. To address these issues, we designed a workload-aware configuration tuning framework called K2vTune, which can recognize the configuration knobs of RocksDB according to the workload type and effectively consider multiple performance metrics using our knob2vec method. The knob2vec method learns feature vectors for knobs that can capture both the latent relationships between knobs and workload-specific features to develop an attention neural network for accurate configuration-based performance prediction. K2vTune converts multiple metrics into a single problem and optimizes the problem using a genetic algorithm. We evaluated the proposed method using six different RocksDB workloads and confirmed that K2vTune achieved significant tuning performance improvement compared to baselines, showing 8.83% improvements over the state-of-the-art baseline.