Abstract

The cost cumulant statistical control method optimizes the system performance by shaping the probability density function of the random cost function. For a stochastic system, a typical optimal control method minimizes the mean (first cumulant) of the cost function. However, there are other statistical properties of the cost function such as variance (second cumulant), skewness (third cumulant) and kurtosis (fourth cumulant), which affect system performance. In this technical note, we extend the theory of traditional stochastic control by deriving the Hamilton-Jacobi-Bellman (HJB) equation as the necessary conditions for optimality. Furthermore, we derived the verification theorem, which is the sufficient condition, for higher order statistical control, and construct the optimal controller. In addition, we utilize neural networks to numerically solve HJB partial differential equations. Finally, we provide simulation results for an oscillator system to demonstrate our method.

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.