Intra‐day Dynamic Optimal Dispatch for Power System Based on Deep Q‐Learning

Abstract

AbstractSource‐load stochasticity affects the safety, stability and economical operation of power grid, and makes it difficult to design optimal dispatch. Currently, due to the low accuracy of day‐ahead forecast for wind power and load, dynamic optimal dispatch based on ultra‐short‐term wind power prediction is an effective way to reduce the power deviation in power system and to relieve the operating pressure on automatic generation control (AGC) unit. In this paper, by comprehensively considering the source‐load stochasticity, the dispatch properties of unit, and the constraints of AGC regulating range, we establish a dynamic optimal dispatch model to minimize the running cost of the underlying power system, including the coal consumption cost of thermal unit, and the output adjustment cost of both the dispatchable unit and the AGC unit. Since each dynamic dispatch order has an impact, direct or indirect, on the subsequent system operation, we formulate the dynamic optimal dispatch problem as a Markov decision process (MDP) problem. In this framework, a deep Q‐learning method is provided to optimize the dispatch strategy. Finally, the feasibility and the effectiveness of the proposed method is validated by means of numerical experiments on IEEE 30‐node system. © 2021 Institute of Electrical Engineers of Japan. Published by Wiley Periodicals LLC.