RDMA-Enabled Concurrency Control Protocols for Transactions in the Cloud Era

Abstract

Online transaction processing (OLTP) is widely used on modern cloud infrastructures to complete important businesses such as payments and stock exchanges. Remote Direct Memory Access (RDMA) is a technology that enables ultra-low inter-server memory access latency - which is critical for implementing high-performance concurrency control protocols in distributed OLTP. In this article, we develop RCC, the first unified and comprehensive RDMA-enabled distributed transaction processing framework containing six serializable concurrency control protocols—not only the classical protocols <inline-formula><tex-math notation="LaTeX">${{\sf NOWAIT}}$</tex-math></inline-formula> , <inline-formula><tex-math notation="LaTeX">${{\sf WAITDIE}}$</tex-math></inline-formula> , <inline-formula><tex-math notation="LaTeX">${{\sf OCC}}$</tex-math></inline-formula> , but also more advanced <inline-formula><tex-math notation="LaTeX">${{\sf MVCC}}$</tex-math></inline-formula> , <inline-formula><tex-math notation="LaTeX">${{\sf SUNDIAL}}$</tex-math></inline-formula> , and <inline-formula><tex-math notation="LaTeX">${{\sf CALVIN}}$</tex-math></inline-formula> — the deterministic protocol. Our goal is to unbiasedly compare protocols on OLTP workloads in a common execution environment with the concurrency control protocol being the only changeable component. From RCC, we obtained new insights on building RDMA-based protocols. We analyzed stage-wise latency breakdown to develop more efficient hybrid implementations. Moreover, RCC can enumerate all stage-wise hybrid designs under a given workload characteristic. Our results show that throughput-wise hybrid designs are better than RPC or one-sided counterparts by 32.2% and up to 67%; three hybrid designs are better than their pure counterparts by up to 17.8%. RCC can provide performance insights and be used as the common open-sourced infrastructure for fast prototyping new implementations.