Deep Learning Based Densely Connected Network for Load Forecasting

Abstract

Load forecasting is of crucial importance for operations of electric power systems. In recent years, deep learning based methods are emerging for load forecasting because their strong nonlinear approximation capabilities can provide more forecasting precision than conventional statistical methods. However, they usually suffer from some problems, e.g., the gradient vanishment and over-fitting. In order to address these problems, an unshared convolution based deep learning model with densely connected network is proposed. In this model, the backbone is the unshared convolutional neural network and a densely connected structure is adopted, which could alleviate the gradient vanishment. What is more, we use a regularization method named clipped <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$L_2$</tex-math></inline-formula> -norm to overcome over-fitting, and design a trend decomposition strategy to address the possible distribution differences between the training and validation data. Finally, we conduct five case studies to verify the outperformance of our proposed deep learning model for deterministic and interval load forecasting. Two high-voltage and an medium-voltage real load datasets from Australia, Germany and America are used for model training and validation, respectively. Results show that the proposed model can achieve higher load forecasting accuracy, compared with other existing methods including the popular conventional methods such as naive forecast and generalized additive model, and deep learning methods, e.g., long short-term memory network, convolutional neural network, fully connected network, etc.