Collaborative Virtual Environment to Simulate on-the-Job Aircraft Inspection Training Aided by Hand Pointing

Abstract

The human inspector performing visual inspection of an aircraft is the backbone of the aircraft inspection process, a vital element in assuring safety and reliability of an air transportation system. Training is an effective strategy for improving their inspection performance. A drawback of present-day on-the-job (OJT) training provided to aircraft inspectors is the limited exposure to different defect types. Previous studies have shown offline feedback training using virtual reality (VR) simulators to be effective in improving visual inspection performance. This research aims at combining the advantages of VR technology that includes exposure to a wide variety of defects and the one-on-one tutoring approach of OJT by implementing a collaborative virtual training environment. In an immersive collaborative virtual environment (CVE), avatars are used to represent the co-participants. In a CVE, information of where the trainer is pointing can be provided to a trainee as visual deictic reference (VDR). This study evaluates the effectiveness of simulating on-the-job training in a CVE for aircraft inspection training, providing VDR slaved to a 3D mouse used by the trainer for pointing. The results of this study show that the training was effective in improving inspection performance.