Enabling Secure and Space-Efficient Metadata Management in Encrypted Deduplication

Abstract

Encrypted deduplication combines encryption and deduplication in a seamless way to provide confidentiality guarantees for the physical data in deduplicated storage, yet it incurs substantial metadata storage overhead due to the additional storage of keys. We present a new encrypted deduplication storage system called <inline-formula><tex-math notation="LaTeX">${\sf Metadedup}$</tex-math></inline-formula> , which suppresses metadata storage by also applying deduplication to metadata. Its idea builds on indirection, which adds another level of metadata chunks that record metadata information. We find that metadata chunks are highly redundant in real-world workloads and hence can be effectively deduplicated. We further extend <inline-formula><tex-math notation="LaTeX">${\sf Metadedup}$</tex-math></inline-formula> to incorporate multiple servers via a distributed key management approach, so as to provide both fault-tolerant storage and security guarantees. We extensively evaluate <inline-formula><tex-math notation="LaTeX">${\sf Metadedup}$</tex-math></inline-formula> from performance and storage efficiency perspectives. We show that <inline-formula><tex-math notation="LaTeX">${\sf Metadedup}$</tex-math></inline-formula> achieves high throughput in writing and restoring files, and saves the metadata storage by up to 93.94 percent for real-world backup workloads.