Storage and Processing System of Meter Data Based on Hadoop

Abstract

The traditional meter data storage and processing system generally uses the expensive large server and relational database to ensure the normal operation of the system. When dealing with a large amount of meter data, this kind of system is difficult to expand, data processing is not in time and the efficiency of data retrieval is low, which led to the fault response cycle is prolonged, even cause a fatal impact on the enterprise. This thesis designed and implemented a storage and processing system for electric meter data based on Hadoop Technology which can realize the distributed storage and processing of the electric meter data. After analyzed the result of System benchmark I/O test, and compared data storage and processing capabilities with the traditional solution, it is proved that the new system has the advantages of efficient storage and processing under the condition of mass data, and is suitable for storage of mass meter data. The new system can significantly improve the efficiency and accuracy of data analysis, reduce labor management costs, has extensive practical value for improving the efficiency and the competitive power of the electric meter.