A deep clustering framework for load pattern segmentation

Abstract

In recent years, the widespread use of smart meters in power networks has generated a wealth of data from electricity customers. However, much of this real-world smart meter dataset lacks labeled data, posing a significant challenge that can be addressed by clustering. Traditional clustering methods often struggle in high-dimensional spaces, leading to less accurate results and increased computational demands. In response to these challenges, this research introduces a framework that utilizes a deep-learning-based clustering approach to address the issue of accurate customer clustering based on usage patterns in unlabeled data. Using an autoencoder, our approach integrates dimensionality reduction and clustering into an end-to-end unsupervised learning framework. Our algorithm significantly improves load profiling by tackling challenges related to nonlinear decision boundaries at the autoencoder bottleneck. Unlike traditional approaches, we propose separating the optimization of reconstruction and cluster loss, bridging the gap between clustering quality and reconstruction efficiency. We rigorously analyze the performance of our approach by comparing classical and state-of-the-art algorithms using two real-world smart meter data. We provide a comprehensive comparative analysis of our method against five common dimension reduction techniques used in high-dimensional clustering. The experimental analysis concludes that the proposed algorithm significantly enhances load profiling more than others, as confirmed through detailed load curve analysis and clustering validity indexes. This comprehensive assessment highlights the effectiveness and versatility of our proposed methodology when compared to others. Moreover, this research advances load profiling in smart grid analytics, providing practical insights for utilities and stakeholders looking to optimize power network operations.