Big data processing and analysis platform for condition monitoring of electric power system

Abstract

This paper presents a preliminary study of developing a novel platform for big data management, processing and analysis of modern power systems. The framework comprises a big data acquisition subsystem, a big data analysis subsystem, a decision-making assistance subsystem and an information integration subsystem. For the big data management system, a novel structure is designed according to three different data resources, including database, data files and data stream. Further, powerful open-source computation algorithms and self-developed novel intelligent methods are integrated in the big data analysis system. To be specific, our early work on statistical processing monitoring (Principal Component Analysis (PCA)), advanced modelling methods (Fast Recursive Algorithm (FRA)) and newly developed optimization method (Teaching-Learning Based Optimization (TLBO)) are integrated into a self-developed analysis module. Thus, with the novel big data acquisition structure and data processing engine, the proposed platform can provide a powerful tool for big data analytic based Smart Grid monitoring.