A Control Strategy Based on Deep Reinforcement Learning Under the Combined Wind-Solar Storage System

Abstract

In a deregulated environment, the renewable energy producers will face the challenge of how to increase their revenues under uncertainties of power generation and time-varying electricity price. In traditional power network scheduling, prediction and optimization are two independent processes, which easily leads to information loss and modeling error. To deal with the uncertainty and realize an end-to-end controller, this article proposes an energy storage system control model (ESSCM) in the scene of the combined wind-solar storage system. The proposed ESSCM using deep reinforcement learning (DRL) algorithm is trained by interacting with the massive environment of a power grid without requiring the assumption on the uncertainties. It learns from scratch to realize the coordination operation of with wind power and photovoltaic power in a combined system, further maximize the benefits of the combined system in the electricity market. One state-of-the-art DRL algorithm, namely double deep Q-network, is used to formulate the proposed ESSCM. Numerical results illustrate that the proposed approach can effectively accommodate the uncertainty and bring high revenues to the combined system.