Abstract
In this paper, the authors are concerned with Pump Scheduling Optimization in Water Distribution Networks, targeted on the minimization of the energy costs subject to operational constraints, such as satisfying demand, keeping pressures within certain bounds to reduce leakage and the risk of pipe burst, and keeping reservoir levels within bounds to avoid overflow. Urban water networks are generating huge amounts of data from flow/pressure sensors and smart metering of household consumption. Traditional optimization strategies fail to capture the value hidden in real time data assets. In this paper the authors are proposing a sequential optimization method based on Approximate Dynamic Programming in order to find a control policy defined as a mapping from states of the system to actions, i.e. pump settings. Q-Learning, one of the Approximate Dynamic Programming algorithms, well known in the Reinforcement Learning community, is used. The key difference is that usual Mathematical Programming approaches, including stochastic optimization, requires knowing the water demand in advance or, at least, to have a reliable and accurate forecasting. On the contrary, Approximate Dynamic Programming provides a policy, that is a strategy to decide how to act time step to time step according to the observation of the physical system. Results on the Anytown benchmark network proved that the optimization policy/strategy identified through Approximate Dynamic Programming is robust with respect to modifications of the water demand and, therefore, able to deal with real time data without any distributional assumption.
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.