A tele-instruction system for ultrasound probe operation based on shared AR technology

Abstract

This paper proposes a tele-instruction system for ultrasound probe operation, based on shared Augmented Reality (AR) technology. Telemedicine, a strategy to diminish geographic gaps in the quality of medical service, is fashionable. However, existing medical-data transmission systems cannot convey the skills of physicians, so they cannot eliminate the problem of geographic gaps. This research developed a telemedicine system that transports physicians' skills over a shared AR space. The shared AR technology provides an environment where users can exchange spatial information, and facilitates smooth communication. This research concentrates on interfaces for physicians and technicians at the patient site. The proposed system provides intuitive and unrestricted interfaces for the physician and technician, using a data projector and an LCD tablet. At the patient site, instructions for the technician are projected directly onto the patient's body, using a data projector. The physician site allows the physician to send instructions on probe operation using an LCD tablet. This information is displayed as a web-mark, which provides spatial information for ultrasound probe operation. Furthermore, the system sends environmental information about the patient to the physician, such as the technician's behavior and patient's posture, via an immersive display. The proposed system was tested with a physician using real tele-diagnosis. The results demonstrated the effectiveness of the proposed method in providing smooth communication in telemedicine.