Design of virtual reality for teaching ultrasound in medical and engineering education

Abstract

This works presents the design of a virtual reality (VR) platform that generates 3D models from ultrasound imaging used to teach medical and engineering students about anatomical structures. The VR platform will allow students to learn about the theory of wave propagation in tissues by providing 3D visualizations of abstract physics concepts and organ systems in an immersive and engaging environment. This phase of the project has been focused on learning to develop VR environments and how to translate medical imaging formats into a feasible tool. The specific focus has been on converting DICOM (Digital Imaging and Communications in Medicine) files into elements that can be managed in the VR environment (Unity 3D Development). This includes converting imaging data sets into 3D meshes that can be displayed and manipulated. The nearly infinite control over virtual environments can present alternative visualizations of ultrasound that may be accessible to the learner. The use of acquired ultrasound data within the virtual space will help learners transfer skills into point-of-care ultrasound (POCUS). The VR environment will help students to explore ultrasound without the limitations of a real patient and guide them to the physics principles to better understand ultrasound propagation in the human body.