Abstract

In this paper, a reinforcement Q-learning fuzzy optimal tracking control method is investigated for nonlinear underactuated unmanned surface vehicles (USVs) with external disturbances. Firstly, the motion dynamics of USVs are described by the Takagi–Sugeno (T–S) fuzzy discrete-time systems. Secondly, by applying parallel distributed compensation (PDC) method and constructing cost function, the existence condition of optimal solutions is derived and reduced to the algebraic Riccati equations (AREs). To solve the solutions of the GAREs, a Q-learning value iteration (VI) algorithm is further developed, which can be implemented by eliminating the demand of initial allowable control policy and system information. The developed strategy has the advantage that the optimal control policy can ensure the USV to be stable and the desired reference signal can also be well tracked by the USV output. Finally, the proposed fuzzy optimal control algorithm is applied to control the USV, the simulation results verify the feasibility of the proposed optimal control algorithm.

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.