Augmented Reality for AI-driven Inspection? – A Comparative Usability Study

Abstract

Inspection in Aerospace industry can, as well as many other industrial applications, benefit from using Augmented Reality (AR) due to its ability to superimpose helpful digital information in 3D, leading to fewer errors and decreased mental demand. However, each AR device has advantages and disadvantages, and not all AR devices are suitable for use in industrial settings. We compare a tripod-fitted-adjustable-arm tablet-based AR solution (Apple iPad Pro) to head-mounted AR (Microsoft HoloLens 2) and a traditional, computer screen-based human-machine interface (HMI), all three designed to guide operators based on previously performed AI-based image analysis. Following an iterative design process with three formative evaluations, a final field test in a real industrial shop floor engaging 6 professional inspectors revealed an overall preference for the tripod-fitted iPad variant which receiving the best scores in most dimensions covered in both a usability-focused SUS questionnaire (score 71) and a NASA-RTLX form focused on perceived workload. More specifically, the tripod-fitted iPad was considered more usable (SUS) than the classic computer display HMI (M=5.83, SD=4.92, p=0.034, N=6); the temporal demand (NASA-RTLX) was considered lower using the iPad compared to both HoloLens 2 and the HMI (M=6.67, SD=4.08, p=0.010; M=10.83, SD=9.70, p=0.040, N=6), respectively.