Adaptive optimal secure wind power generation control for variable speed wind turbine systems via reinforcement learning

Abstract

As the utilization of wind energy continues to grow, it is crucial to prioritize the identification of vulnerabilities, raise awareness, and develop strategies for cybersecurity defense. False data injection (FDI) attacks, if targeted at the communication between the rotor speed sensor and the wind turbine (WT) controller, can potentially disrupt the normal operation of the system. These attacks have the capability to overload the drive-train and significantly reduce the power generation efficiency of the wind turbine. So, this note presents an adaptive optimal secure control strategy entailing reinforcement learning (RL) neural network (NN) using the filter error to compensate the detrimental effects of FDI attack as well as actuator fault for WT systems. The Hamilton–Jacobi–Bellman (HJB) equation is constructed and solved to obtain the optimal control policy. Since the HJB is inextricably intertwined with intrinsic nonlinearity and complexity, solving this equation is quiet challenging. To tackle this issue and also approximate the solution of the HJB, an actor–critic-based reinforcement learning (RL) strategy is used, in which actor and critic NNs are applied to execute control action and assess control performance, respectively. To detect FDI attack, an anomaly detection is developed using a nonlinear observer/estimator. Stability analysis is performed using Lyapunov theory which guarantees semi-global uniformly ultimately bounded (SGUUB) of the error signal. Finally, simulation results verify the effectiveness of the proposed control approach.