Cloud Storage Service Architecture Providing the Eventually Consistent Totally Ordered Commit History of Distributed Key-Value Stores for Data Consistency Verification

Beom-Heyn Kim,Young Yoon

doi:10.3390/electronics10212702

Abstract

Cloud storage services are one of the most popular cloud computing service types these days. Various cloud storage services such as Amazon S3, DropBox, Google Drive, and Microsoft OneDrive currently support billions of users. Nevertheless, data consistency of the underlying distributed key-value store of cloud storage services remains a serious concern, making potential customers of cloud services hesitate to migrate their data to the cloud. Researchers have explored how to allow clients to verify the behavior of untrusted cloud storage services with respect to consistency models. However, previous proposals are limited because they rely on a strongly consistent history server to provide a totally ordered history for clients. This work presents Relief, a novel cloud storage service exposing an eventually consistent totally ordered commit history of the underlying distributed key-value store to enable client-side data consistency verification for various consistency models. By empirically evaluating our system, we demonstrate that Relief is an efficient solution to overcome the limitation of previous approaches.

Highlights

IntroductionVarious cloud storage services (CSS) include Amazon S3, DropBox, Google Drive, Microsoft OneDrive, and Amazon DynamoDB
The performance of Relief was measured on our lab facility consisting of three physical machines connected over 1Gbps Ethernet
Using versions distributed key-value stores (DKVS) internally employ to determine the actual commit order of operations, eventually consistent totally ordered history can be provided for clients to perform consistency verification

Summary

Introduction

Various CSSs include Amazon S3, DropBox, Google Drive, Microsoft OneDrive, and Amazon DynamoDB. The recent survey projects the cloud storage service market to grow from 50.1 billion US Dollars in 2020 to 137.3 billion US Dollars by 2025, at a compound annual growth rate of 22.3% [1]. Because cloud storage services distribute and replicate data at a global scale, users with internet access can work on the same dataset to collaborate with others anywhere and anytime. Users do not need to worry about complications involved in managing physical storage servers since the cloud service provider’s responsibility is to ensure that the underlying infrastructure works as expected to serve their customers faithfully. We explain why it is vital to do consistency verification for consistency models of CSSs. we summarize the advance made in the field of consistency verification. We discuss distributed events and the methods to track causality and figure out their order

Methods

Results

Discussion

Conclusion