Abstract
Local energy markets are emerging as a tool for coordinating generation, storage, and consumption of energy from distributed resources. In combination with automation, they promise to provide an effective energy management framework that is fair and brings system-level savings. The cooperative–competitive nature of energy markets calls for multi-agent based automation with learning energy trading agents. However, depending on the dynamics of the agent–environment interaction, this approach may yield unintended behavior of market participants. Thus, the design of market mechanisms suitable for reinforcement learning agents must take into account this interplay. This article introduces autonomous local energy exchange (ALEX) as an experimental framework that combines multi-agent learning and double auction mechanism. Participants determine their internal price signals and make energy management decisions through market interactions, rather than relying on predetermined external price signals. The main contribution of this article is examination of compatibility between specific market elements and independent learning agents. Effects of different market properties are evaluated through simulation experiments, and the results are used for determine a suitable market design. The results show that market truthfulness maintains demand-response functionality, while weak budget balancing provides a strong reinforcement signal for the learning agents. The resulting agent behavior is compared with two baselines: net billing and time-of-use rates. The ALEX-based pricing is more responsive to fluctuations in the community net load compared to the time-of-use. The more accurate accounting of renewable energy usage reduced bills by a median 38.8% compared to net billing, confirming the ability to better facilitate demand response.
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.