Reservoirs Optimal Operation Based on Reinforcement Learning

Abstract

Reinforcement learning has been widely used to solve the problem of optimal operation of a single reservoir. However, the research on the combination of reinforcement learning and optimal operation of reservoir groups is still blank. The complexity of reservoir groups brings difficulties to the application of reinforcement learning. In order to solve the complex problem of optimal operation of the reservoir group, Q-learning combined with the penalty method is used to generate the optimal operation scheme of the reservoir group by exploring the optimization Q value of the operation sequence. The experimental results show that this method can achieve the optimal solution in theory. Furthermore, Q-learning combined with a feasible direction method is used to establish time feasible state table and state-feasible action hash table according to the constraints of the discrete four-reservoirs problem, so that the Q-learning algorithm can shorten the optimization time and obtain the optimal solution.