Deduplication of files in cloud storage based on differential bloom filter

Abstract

With the prevalence of cloud storage, more and more users store their files in cloud storage. There are a large number of duplicate files in the cloud storage, which makes file deduplication important for saving the storage space. After analyzing the features of cloud files, this paper proposes a new file deduplication method based on differential bloom filter. Besides utilizing application aw are chunking method and index based on the file similarity theory, differential bloom filter is designed to accelerate the speed of lookups and to reduce the total computational costs. The experiments demonstrate that the proposed method has good overa11 performance and achieves excellent balance among the computational time, the memory consumption, and the deduplication efficiency.