Design of a haptic system for medical image manipulation using augmented reality

Abstract

This work discusses the development of an augmented reality (AR) interface that allows users to manipulate 3D anatomical structures (segmented and reconstructed from real medical studies) through haptic interactions by means of a five-degrees-of-freedom hand-exoskeleton. The exoskeleton allows the hand to move throughout its nominal range of motion. Our interface allows users to manipulate virtual objects more naturally thanks to its three points of contact, unlike most commercial haptic systems, which only have one point of contact. The preliminary results indicated a proper 3D segmentation and reconstruction of the anatomical structures of interest, as well as an adequate interaction between the haptic exoskeleton and the AR interface.