Twin Delayed Deep Deterministic Policy Gradient (TD3) Based Virtual Inertia Control for Inverter-Interfacing DGs in Microgrids

Abstract

Environmental and energy security concerns lead to the continuous displacement of traditional fossil fuel-based power generation to power electronics interfaced distributed generations (DGs). Increasing penetration of renewable energy sources and the substitution of synchronous generators with power electronic converters have resulted in reduced power system inertia and damping. This causes large frequency deviations and a higher rate of change of frequency. The fast and flexible nature of the energy storage system with a designed controller can achieve frequency stability in low inertia microgrids (MGs). The conventional proportional-integral-based virtual inertia controller is unable to eliminate frequency instability in low inertia MG. To enhance frequency stability, this article proposes a virtual inertia emulation strategy using a twin delayed deep deterministic policy gradient (TD3) algorithm for fast frequency regulation of MGs with inverter-based DGs. A comparative analysis of the TD3 scheme and the conventional method is made. The results show that the TD3-based virtual inertia control provides better tracking with a 56.6% reduction in frequency deviation and faster transient recovery than the conventional virtual inertia control against a broad range of operational scenarios. Performance metrics and simulation results are shown to demonstrate the feasibility of the proposed control scheme.