Abstract
The increased penetration of renewable energies and the need to decarbonise the grid come with a lot of challenges. Microgrids, power grids that can operate independently from the main system, are seen as a promising solution. They range from a small building to a neighbourhood or a village. As they co-locate generation, storage and consumption, microgrids are often built with renewable energies. At the same time, because they can be disconnected from the main grid, they can be more resilient and less dependent on central generation. Due to their diversity and distributed nature, advanced metering and control will be necessary to maximise their potential. This paper presents a reinforcement learning algorithm to tackle the energy management of an off-grid microgrid, represented as a Markov Decision Process. The main objective function of the proposed algorithm is to minimise the global operating cost. By nature, rare events occur in physical systems. One of the main contribution of this paper is to demonstrate how to train agents in the presence of rare events. Merging the combined experience replay method with novel methods called ‘Memory Counter’ unstucks the agent during its learning phase. Compared to baselines, an extended version of double deep Q-network with a priority list of actions into the decision making strategy process lowers significantly the operating cost. Experiments are conducted using 2 years of real-world data from Ecole Polytechnique in France.
Highlights
One of the main challenges of the twenty‐first century is to reduce greenhouse gases emissions to comply with the 2015 Paris Agreement [1]
We have noticed that rare events create problems during the learning phase of an agent
We have proposed a novel approach by merging an existing method called combined experience replay technique (CER) and a new method called memory counter (MemC)
Summary
One of the main challenges of the twenty‐first century is to reduce greenhouse gases emissions to comply with the 2015 Paris Agreement [1]. To tackle this challenge, there has been a global increase in investments for renewable energy projects [2] and for distributed energy resources (DER), as demonstrated in Referenes [3,4]. The principal definitions and foundations of a microgrid have been developed and explained in References [5,6,7]. Developing renewable energy sources (RES) capacity will impact electricity markets with non‐dispatchable resources. In Reference [8], the author
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.