Overview of Data Deduplication Technology in a Cloud Storage Environment

Abstract

Data deduplication technology involves improving the data storage efficiency while storing and managing large amounts of data. Data deduplication reduces storage requirements by determining whether replicated data is being added to the storage, and thereby omitting the data upload if the same data already exists. Data deduplication requires data confidentiality and integrity when being applied in a cloud storage environment, and therefore various security measures such as encryption are needed. However, common encryption technologies generally cannot be applied simultaneously with data deduplication owing to the inherent inability to transform the source data. Various studies have been conducted for addressing the said issues. This paper discusses the basic environment of data deduplication technology. It also analyzes and compares multiple proposed techniques for addressing security threats.