Abstract
IntroductionAugmented reality (AR), mixed reality (MR), and virtual reality devices are enabling technologies that may facilitate effective communication in healthcare between those with information and knowledge (clinician/specialist; expert; educator) and those seeking understanding and insight (patient/family; non-expert; learner). Investigators initiated an exploratory program to enable the study of AR/MR use-cases in acute care clinical and instructional settings.MethodsAcademic clinician educators, computer scientists, and diagnostic imaging specialists conducted a proof-of-concept project to 1) implement a core holoimaging pipeline infrastructure and open-access repository at the study institution, and 2) use novel AR/MR techniques on off-the-shelf devices with holoimages generated by the infrastructure to demonstrate their potential role in the instructive communication of complex medical information.ResultsThe study team successfully developed a medical holoimaging infrastructure methodology to identify, retrieve, and manipulate real patients’ de-identified computed tomography and magnetic resonance imagesets for rendering, packaging, transfer, and display of modular holoimages onto AR/MR headset devices and connected displays. Holoimages containing key segmentations of cervical and thoracic anatomic structures and pathology were overlaid and registered onto physical task trainers for simulation-based “blind insertion” invasive procedural training. During the session, learners experienced and used task-relevant anatomic holoimages for central venous catheter and tube thoracostomy insertion training with enhanced visual cues and haptic feedback. Direct instructor access into the learner’s AR/MR headset view of the task trainer was achieved for visual-axis interactive instructional guidance.ConclusionInvestigators implemented a core holoimaging pipeline infrastructure and modular open-access repository to generate and enable access to modular holoimages during exploratory pilot stage applications for invasive procedure training that featured innovative AR/MR techniques on off-the-shelf headset devices.
Highlights
Augmented reality (AR), mixed reality (MR), and virtual reality devices are enabling technologies that may facilitate effective communication in healthcare between those with information and knowledge and those seeking understanding and insight
Augmented reality (AR) overlays a supplemental digital realm onto the real world through various devices, enabling users to continue to interact with their physical surroundings while simultaneously experiencing and interacting with digital objects and artifacts linked to actual environmental elements. (The associated concept of mixed reality [MR] encompasses all combinations of real, augmented, and virtual environments.1) A recreational yet acutely illustrative example is that of Pokémon Go (Niantic, San Francisco, CA), a popular mobile AR game in which players see and interact with digitally rendered creatures in video-captured, real-world landscapes on their AR device screens.[2]
To emphasize anatomic visualization with AR/MR assistance and to review “blind insertion” techniques, the learners were intentionally not provided with ultrasound devices; standard approaches, equipment, and procedural kits were otherwise used for both procedures
Summary
Augmented reality (AR), mixed reality (MR), and virtual reality devices are enabling technologies that may facilitate effective communication in healthcare between those with information and knowledge (clinician/specialist; expert; educator) and those seeking understanding and insight (patient/family; non-expert; learner). Augmented Reality/Mixed Reality for Acute Care Procedure Training signals These worlds are accessible only when users wear opaque VR goggles and relinquish several essential and interactive aspects of the physical realm of reality. (The associated concept of mixed reality [MR] encompasses all combinations of real, augmented, and virtual environments.1) A recreational yet acutely illustrative example is that of Pokémon Go (Niantic, San Francisco, CA), a popular mobile AR game in which players see and interact with digitally rendered creatures in video-captured, real-world landscapes on their AR device screens.[2]. A team of academic clinician educators, computer scientists, and diagnostic imaging specialists conducted a proof-of-concept project to apply AR/ MR to specialized acute care procedure training
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Free) 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a call
