Artificial emotional reinforcement learning for automatic generation control of large‐scale interconnected power grids

Abstract

This study proposes an artificial emotional reinforcement learning (ERL) controller for automatic generation control (AGC) of large-scale interconnected power grids. In the scheme of ERL, the agent consists of two parts, a mechanical logical part and a humanistic emotional part, which essentially develop the control strategies of the agent. These two parts in proposed controller are introduced by reinforcement learning (RL) and artificial emotion (AE), respectively. The ERL controller can generate different control strategies depending on the operating scenarios, by highly integrating AE functions, which are quadratic function, exponential function, and linear function, respectively, with the elements of RL, such as action, learning rate, and reward function. The effectiveness of ERL controller with nine control strategies has been demonstrated considering AGC on a two-area load frequency control power system and China Southern Power Grid (CSG) power system. Results of simulation show the superior performance of ERL over that of proportional-integral control and four RL techniques.