The influence of augmented reality interaction design on Pilot's perceived workload and situation awareness

Abstract

This work explored the potential for Augmented Reality (AR) rendering information superimposed over the flight deck to increase a pilot's situation awareness (SA). This emerging technology introduced novel human-computer interaction paradigms that would have impact on pilot's cognitive demands. The objective of this research was to evaluate both the pilot's perceived workload and SA while interacting with an AR device using different interactive modes. Participants performed traditional landing checklists as a baseline to compare with the AR gesture-command and voice-command checklists. The research results showed that gesture-commands created additional cognitive and physical demands. Conversely, voice-command checklists could constitute a significant improvement in terms of reducing participants' perceived workload and maximising SA performance. The findings provided evidence that the interactive modes of AR user interface design could influence participant's cognitive information processing and perceived workload in flight operations. However, there were some limitations with AR applications that included latency on response time, narrow field of view, accuracy of voice recognition, calibration within dynamic environment and inexplicable movements of the head position that required further investigation. An AR device can be a great tool for training at the initial stage to increase cost-efficiency in flight operations. Furthermore, the implementation of an AR design may provide part of the potential solution for single pilot operations in the future.