Stochastic optimal control of partially observable nonlinear quasi-integrable Hamiltonian systems

Abstract

The stochastic optimal control of partially observable nonlinear quasi-integrable Hamiltonian systems is investigated. First, the stochastic optimal control problem of a partially observable nonlinear quasi-integrable Hamiltonian system is converted into that of a completely observable linear system based on a theorem due to Charalambous and Elliot. Then, the converted stochastic optimal control problem is solved by applying the stochastic averaging method and the stochastic dynamical programming principle. The response of the controlled quasi Hamiltonian system is predicted by solving the averaged Fokker-Planck-Kolmogorov equation and the Riccati equation for the estimated error of system states. As an example to illustrate the procedure and effectiveness of the proposed method, the stochastic optimal control problem of a partially observable two-degree-of-freedom quasi-integrable Hamiltonian system is worked out in detail.