Augmented reality for training formation flights: An analysis of human factors

Abstract

Pilot training has been, for decades, aided by flight simulators with different characteristics and degrees of fidelity. However, many studies indicate that, despite the recognized contribution of simulator training, actual flying practice is still necessary, depending on the trained task. This work introduces the proposal of using augmented reality for in-flight training, where elements in the environment outside the aircraft are displayed through an augmented reality headset to create a simulation scenario. The training of basic formation flight is used as an example, as it requires flying with at least two aircraft, resulting in high operational costs and risk of collision between aircraft. In this case, the augmented reality system replaces the real leader aircraft with a projection. In order to evaluate the Technology Readiness Level (TRL) of this proposal, this work presents a prototype of an augmented reality system integrated into a flight simulator to conduct an evaluation campaign. We investigate how the introduction of the augmented reality system impacts on human factors, such as stress and workload, as well as performance. Although the results obtained in a simulated environment are not equivalent to those from an in-flight campaign, the experimental campaign performed in the flight simulator provides a way of evaluating the impact on the pilot of some aspects of the proposed solution, such as the performance of occlusion routines and some ergonomic aspects of the augmented reality headset.