Improvement of data compression technology for power dispatching based on run length encoding

Abstract

Abstract Data compression is of great significance to the storage of power dispatch data. The compressed data not only saves a lot of space, but also improves the speed of data retrieval. Therefore, this paper proposes an improved algorithm based on run length encoding to compress power dispatch data. In the case of high data similarity, run length coding and dictionary coding have good compression effects, so this article classifies power dispatch data, and uses an improved run length coding algorithm to compress data with high similarity. For similarity Low data is compressed using the Lz4 algorithm that comes with HBase, and a Base-128 Varints encoding the number of occurrences of elements in the run-length encoding is proposed to further improve the compression rate of similar data. This improved algorithm is proven in experiments In some scenarios, the compression rate is indeed improved.