Finite state estimation and control of a multi-input CSTR benchmark

Abstract

The problem of curse-of-dimensionality in finite state and action Markov decision processes is considered using iterative clustering of closed-loop data and repeated discretization of the state space process model. The performance of the control design approach is demonstrated using a multi-input van der Vusse continuous stirred tank reactor control benchmark. It is demonstrated that the finite state description provides a simple implementation of Bayesian state estimation using cell filters, and dynamic programming gives means to conduct optimization of closed-loop performance of a nonlinear stochastic multidimensional chemical plant.