Abstract

Based on discrete martingale theory, the LaSalle-type theorem for general discrete-time stochastic systems is obtained and the almost sure stability is in turn discussed. As applications, infinite horizon nonlinear optimal regulator is investigated, and a dynamical programming equation called the Hamilton-Jacobi-Bellman equation is also derived for discrete-time nonlinear stochastic optimal control.

Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call