Abstract
A formal dynamic programming argument relates the “value function of a stochastic optimal control problem” with the solution of a nonlinear parabolic partial differential equation. In cases in which the partial differential equation is degenerate, it may not have a classical solution but may have a weak solution in the sense of the theory of Schwartz distributions. It has been an open question as to whether a weak solution of the partial differential equation does equal the value function of the stochastic optimal control problem.This paper shows that, roughly, whenever an associated uncontrolled system has an appropriately behaved density function, the equality holds. It is also shown that an optimal control law may be determined by minimizing a Hamiltonian formed in terms of the partial derivatives of the weak solution of the partial differential equation.
Published Version
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.