The Key as Dictionary Compression Method of Inverted Index Table under the Hbase Database

Abstract

Starting with Hbase's own characteristics, this paper designs an inverted index table which includes key word, document ID and position list, and the table can saves a lot of storage space. After then, on the basis of the table, the paper provides key as dictionary compression with high compression ratio and high decompression rate for the data block. At last, this paper tests the effectiveness of the compression method by comparing it with Lzo and Gzip which supported by Hbase.