The unknown disturbances and the changing uncertainties bring difficulties for designing a stable attitude controller for UAV. In this paper, a novel adaptive fault-tolerant attitude control approach is designed based on the long short-term memory (LSTM) network for the fixed-wing UAV subject to the high dynamic disturbances and actuator faults. Firstly, the high dynamic disturbances can be compensated by the adaptive laws. Meanwhile, the actuator faults can be handled by the proposed adaptive fault-tolerant control (AFTC) scheme. Moreover, the LSTM network is introduced to approximate the unknown and time-accumulating nonlinearities. With the introduction of the one-to-one nonlinear mapping (NM), the output constraints in the control system can be guaranteed. Additionally, it can be demonstrated that the boundness of all the signals can be assured. At last, numerical simulation results are provided to illustrate the effectiveness of the proposed method.