Effective incentive based demand response with voltage support capability via reinforcement learning based multi-agent framework

Abstract

With the ongoing advancements in power grids, it is crucial to maintain a balance between energy generation and usage to ensure the stability of power systems. Any disparity between the supply and demand of energy can lead to increased expenses for utility companies and consumers, which might potentially result in a widespread failure of the grid. To tackle this problem, this study offers the implementation of the Voltage Capability Incentive-Based Demand Response (VC-IBDR) system, which utilizes a multi-agent framework. The main goal is to reduce power usage by providing financial incentives, while also ensuring that voltage standards are satisfied at each node. In this method, the aggregator agent coordinates demand response operations by interacting with household agents that are equipped with home energy management systems. Every household utilizes a disjunctively constrained knapsack problem optimization method to effectively organize the consumption of home appliances, considering customer preferences and dissatisfaction. During demand response events, the aggregator agent works together with household agents to optimize appliance schedules, ensuring that voltage levels at each node remain within acceptable levels. The simulation is performed to assess the efficacy of VC-IBDR on a feeder that provides service to 25 residential households. The findings indicate substantial decreases in power usage, with an average decline in demand of 4.20% at the feeder level and a 10.41% decrease in peak power consumption throughout the day. Furthermore, the voltage values at each node stay consistently steady within the range of 0.96 to 1.0 per unit throughout the day.