Performance gains from adaptive eXtended Reality training fueled by artificial intelligence

Abstract

While virtual, augmented, and mixed reality technologies are being used for military medical training and beyond, these component technologies are oftentimes utilized in isolation. eXtended Reality (XR) combines these immersive form factors to support a continuum of virtual training capabilities to include full immersion, augmented overlays that provide multimodal cues to personalize instruction, and physical models to support embodiment and practice of psychomotor skills. When combined, XR technologies provide a multi-faceted training paradigm in which the whole is greater than the sum of the constituent capabilities in isolation. When XR applications are adaptive, and thus vary operational stressors, complexity, learner assistance, and fidelity as a function of trainee proficiency, substantial gains in training efficacy are expected. This paper describes a continuum of XR technologies and how they can be coupled with numerous adaptation strategies and supportive artificial intelligence (AI) techniques to realize personalized, competency-based training solutions that accelerate time to proficiency. Application of this training continuum is demonstrated through a Tactical Combat Casualty Care training use case. Such AI-enabled XR training solutions have the potential to support the military in meeting their growing training demands across military domains and applications, and to provide the right training at the right time.