Augmented reality simulator for CT-guided interventions

D. Amiras,C. Watura,B. Pitrola,M. Hamady,G. J. Shimshon,P. J Pratt,T. J. Hurkxkens,D. Figueroa,S. Rostampour

doi:10.1007/s00330-021-08043-0

D. Amiras, C. Watura + Show 7 more

Open Access

https://doi.org/10.1007/s00330-021-08043-0

Copy DOI

Abstract

IntroductionCT-guided interventions are taught using a mentored approach on real patients. It is well established that simulation is a valuable training tool in medicine. This project assessed the feasibility and acceptance of replicating a CT-guided intervention using a bespoke software application with an augmented reality head-mounted display (ARHMD).MethodsA virtual patient was generated using a CT dataset obtained from The Cancer Imaging Archive. A surface mesh of a virtual patient was projected into the field-of-view of the operator. ChArUco markers, placed on both the needle and agar jelly phantom, were tracked using RGB cameras built into the ARHMD. A virtual CT slice simulating the needle position was generated on voice command. The application was trialled by senior interventional radiologists and trainee radiologists with a structured questionnaire evaluating face validity and technical aspects.ResultsSixteen users trialled the application and feedback was received from all. Eleven felt the accuracy and realism was adequate for training and twelve felt more confident about their CT biopsy skills after this training session.DiscussionThe study showed the feasibility of simulating a CT-guided procedure with augmented reality and that this could be used as a training tool.Key Points• Simulating a CT-guided procedure using augmented reality is possible.• The simulator developed could be an effective training tool for clinical practical skills.• Complexity of cases can be tailored to address the training level demands.

Highlights

CT-guided interventions are taught using a mentored approach on real patients
A key advantage of the use of virtual reality (VR) and augmented reality (AR) in simulation for procedural training is that these technologies inherently require active learner engagement, which is widely recognized as a cornerstone of effective learning [7]
We present a simulator for CT-guided biopsies with haptic feedback using the HoloLens 2 and a bespoke software application

Summary

Introduction

CT-guided interventions are taught using a mentored approach on real patients. It is well established that simulation is a valuable training tool in medicine. Procedural training in medicine has relied on the application of Halsted’s model of “see one, do one, teach one” [1, 2] This apprenticeship model of learning is based on observation, performance, and demonstration. This model has some drawbacks: firstly, one cannot reliably and objectively monitor or predict the output of a training program, since feedback is given by the judgement of a trainer. It requires that an apprentice learns a procedure by practising on a real patient in a clinical setting, which causes. Recent evidence to support the use of VR and AR simulations in medical education and training is abundant [8,9,10,11,12,13,14,15,16,17,18]

Methods

Results

Conclusion