Adaptive Optimized Backstepping Control-Based RL Algorithm for Stochastic Nonlinear Systems With State Constraints and Its Application

Abstract

This article investigates the adaptive neural-network (NN) tracking optimal control problem for stochastic nonlinear systems, which contain state constraints and uncertain dynamics. First, to avoid the violation of state constraints in achieving optimal control, the novel barrier optimal performance index functions for subsystems are developed. Second, under the framework of the identifier-actor-critic, the virtual and actual optimal controllers are presented based on the backstepping technique, in which the unknown nonlinear dynamics are learned by the NN approximators. Moreover, the quartic barrier Lyapunov functions are constructed instead of square ones to cope with the Hessian term to ensure the stability of the systems with stochastic disturbance. The proposed optimal control strategy can guarantee the boundedness of closed-loop signals, and the output can follow the given reference signal. Meanwhile, the system states are restricted within some preselected compact sets all the while. Finally, both numerical and practical systems are carried out to further illustrate the validity of the proposed optimal control approach.