Big data storage optimization and parallel processing technology for power equipment surveillance under cloud platform

Abstract

This paper describes how to strengthen the management capacity of power equipment surveillance system for big data. Here is the ODPS list storage for partial discharge data of transformer proposed against the limitation of self-built Hadoop storage system. According to analysis of results, it is co nfirmed that this method can make a lot of storage space available and improve system performance. In relation to Hadoop distributed file system, HBase, ODPS, it has been proven to be highly reliable.