Vulnerability Assessment of Deep Reinforcement Learning Models for Power System Topology Optimization

Abstract

This paper studies the vulnerability of deep reinforcement learning (DRL) models for power systems topology optimization under data perturbations and cyber-attack. DRL has recently solved many complex power system optimization problems. However, it has been practically proven that small perturbations of input data can lead to drastically different control decisions and induce danger. To evaluate and mitigate the security risks of DRL models in power systems, we propose a vulnerability assessment method for such DRL models under noisy data and cyber-attack. In specific, we assess the vulnerability of a DRL model in a way that perturbations are constructed to minimize the model’s performance. Besides, several vulnerability indices are proposed to identify the characteristics of perturbations that may cause malfunction of DRL. Simulations on the 14-bus system and the IEEE 118-bus system for topology optimization are carried out to validate the effectiveness of the proposed vulnerability assessment method. The results show that the performance of DRL models for power systems can be significantly degraded under cyber-attack and data perturbations, especially when a proposed vulnerability index has abnormal values.