An Efficient Storage Architecture Based on Blockchain and Distributed Database for Public Security Big Data

Abstract

For the massive multi-source and heterogeneous public security big data, a distributed, secure and large-scale storage platform is urgently needed. As one of the most popular distributed ledger technologies, blockchain satisfies the needs of distribution and security, but there are still deficiencies in the storage of massive data. This paper provides an in-depth analysis of the advantages and disadvantages of blockchain and distributed databases in various aspects, and combines the characteristics of distributed databases to improve the performance of blockchain in terms of storage and query. HBase is proposed to extend the data storage layer of Hyperledger Fabric. The hash of the bulk data is first calculated and the complete data is stored into HBase by calling chaincode to store only the hash onto the chain. A hash-based rowkey construction has also been designed in an attempt to improve the efficiency of reading data in the blockchain. Finally, this architecture is applied to realize the storage of massive public security big data and the results demonstrate an ideal case of a 6% increase in throughput, 5% reduction in block size, and 13% reduction in transaction latency.KeywordsBlockchainDistributed databaseFabricHBasePerformance optimization