HoloBrain: 3D low-cost mobile augmented reality rendering of brain tumour using the GVF snake model segmentation

Abstract

ABSTRACT Augmented reality (AR) is a dynamic field intersecting various disciplines, with applications spanning medicine and diagnostics. Our focus on advancing medical imaging has led to groundbreaking progress in brain tumor diagnosis, fostering optimism in treatment. In this pursuit, we introduce HoloBrain, an accessible AR application designed to transform medical education. Utilizing smartphones, HoloBrain enables automatic segmentation, AR visualization, and 3D interaction without the need for head-mounted devices. Emphasizing practicality over hyper-realism, our innovation allows medical students to seamlessly integrate a virtual brain tumor model into their surroundings. This immersive approach facilitates exploration of the 3D representation of an afflicted brain, enhancing educational experiences. Tests in a controlled environment using a phantom head yielded promising results, with our solution demonstrating average errors of 2 mm to 4.5 mm on smartphone displays. These outcomes highlight the precision and effectiveness of our contribution, underlining its potential in transforming medical education and training. HoloBrain represents a step forward in making AR accessible and impactful for aspiring medical professionals, offering a valuable tool for enhancing their understanding of complex medical scenarios.