In this paper, a fuzzy reinforcement learning (RL)-based tracking control algorithm is first proposed for partially unknown systems with actuator faults. Based on Takagi–Sugeno fuzzy model, a novel fuzzy-augmented tracking dynamic is developed and the overall fuzzy control policy with corresponding performance index is designed, where four kinds of actuator faults, including actuator loss of effectiveness and bias fault, are considered. Combining the RL technique and fuzzy-augmented model, the new fuzzy integral RL-based fault-tolerant control algorithm is designed, and it runs in real time for the system with actuator faults. The dynamic matrices can be partially unknown and the online algorithm requires less information transmissions or computational load along with the learning process. Under the overall fuzzy fault-tolerant policy, the tracking objective is achieved and the stability is proven by Lyapunov theory. Finally, the applications in the single-link robot arm system and the complex pitch-rate control problem of F-16 fighter aircraft demonstrate the effectiveness of the proposed method.
Read full abstract