The application of quadrotors has been expanded into aggressive tasks such as military confrontation and aerobatics shows, making it crucial to enhance flight maneuverability to adapt to rapid and large-scale command changes. Unlike hovering or low-speed modes, aggressive flight exacerbates quadrotor model uncertainty, making it challenging for controllers to balance response speed and robustness. This paper proposes an INDI control method that integrates a high-fidelity thrust model unit to address this practical need. First, based on the pole distribution theory and the application of INDI on quadrotors, it is concluded that the dynamic response of quadrotor flight is impacted by the accuracy of the thrust model. Second, consider the airflow velocity and angles, the high-fidelity modeling approach, and the aerodynamic forces and torque expression validated through wind tunnel experiments are provided. Then the flight controller for the quadrotor is designed with the established high-fidelity thrust unit model. Finally, aggressive trajectory-tracking flight tests are set to evaluate the improvement of our work. The results demonstrate that our proposed method indeed enhances the response speed and tracking accuracy, as well as the flight stability of the quadrotor.