A Novel Anatomy Education Method Using a Spatial Reality Display Capable of Stereoscopic Imaging with the Naked Eye

Tomoki Itamiya,Takeshi Oguchi,Masahiro To,Masato Matsuo,Katsuhiko Kimoto,Hiromasa Kawana,Shinya Fuchida,Iwao Hasegawa

doi:10.3390/app11167323

Abstract

Several efforts have been made to use virtual reality (VR) and augmented reality (AR) for medical and dental education and surgical support. The current methods still require users to wear devices such as a head-mounted display (HMD) and smart glasses, which pose challenges in hygiene management and long-term use. Additionally, it is necessary to measure the user’s inter-pupillary distance and to reflect it in the device settings each time to accurately display 3D images. This setting is difficult for daily use. We developed and implemented a novel anatomy education method using a spatial reality display capable of stereoscopic viewing with the naked eye without an HMD or smart glasses. In this study, we developed two new applications: (1) a head and neck anatomy education application, which can display 3D-CG models of the skeleton and blood vessels of the head and neck region using 3D human body data available free of charge from public research institutes, and (2) a DICOM image autostereoscopic viewer, which can automatically convert 2D CT/MRI/CBCT image data into 3D-CG models. In total, 104 students at the School of Dentistry experienced and evaluated the system, and the results suggest its usefulness. A stereoscopic display without a head-mounted display is highly useful and promising for anatomy education.

Highlights

Several efforts have been made to use virtual reality (VR) and augmented reality (AR) for medical and dental education and surgical support
This study developed and implemented a novel anatomy education method using a spatial reality display (SRD) capable of stereoscopic viewing with the naked eye [22]
This study developed and implemented a novel anatomy education method using a spatial reality display (SRD: Sony, ELF-SR1, Tokyo, Japan, 2020) capable of stereoscopic viewing with the naked eye without an head-mounted display (HMD) or smart glasses

Summary

Introduction

Several efforts have been made to use virtual reality (VR) and augmented reality (AR) for medical and dental education and surgical support. These technologies have been shown to be helpful during use in several VR- and AR-assisted surgeries [1,2,3,4], and beneficial in several reports of anatomy education using VR and AR [5,6,7,8,9]. 3D-CG models located as close as 30 cm in proximity do not appear truly three-dimensional This is a structural problem of AR smart glasses that requires a solution. These displays are not practical, as it is challenging to achieve both a high-quality image and high-speed screen refresh rates [20,21]

Methods

Results

Conclusion