Research on Accuracy of Augmented Reality Surgical Navigation System Based on Multi-View Virtual and Real Registration Technology

Fengfeng Zhang,Long Chen,Lining Sun,Wenhua Miao

doi:10.1109/access.2020.3007178

Fengfeng Zhang, Long Chen + Show 2 more

Open Access

https://doi.org/10.1109/access.2020.3007178

Copy DOI

Abstract

The traditional navigation system used in spinal puncture is not able to monitor the surgical process in real time and the accuracy of navigation is unsatisfactory. In this study, an augmented reality surgical navigation system based on multi-view virtual and real registration is proposed to solve these problems. The theory of virtual and real registration in augmented reality technology is analyzed, and the methods of single-view and multi-view virtual and real registration are compared. The principle of coordinate transformation in the surgical navigation module is analyzed. The platform of augmented reality surgical navigation system based on multi-view virtual and real registration technology is designed. The experiments of the spinal model are used to verify the accuracy of virtual and real registration. The accuracy of the proposed navigation system is verified by the experiment of simulating puncture operation with robotic control of surgical tool. The experimental results show that the accuracy of single-view and multi-view virtual and real registration is 9.85±0.80mm and 1.62±0.22mm respectively. The accuracy of the augmented reality surgical navigation system added with multi-view virtual and real registration technology is 1.70±0.25mm, which is 35% higher than that of the augmented reality surgical navigation system not previously used. The augmented reality surgical navigation system for spinal puncture based on multi-view virtual and real registration proposed in this study can meet the requirements of physician on the accuracy of surgery. It can also help physician to monitor the surgical process in real time and improve the success rate of surgery.

Highlights

Augmented reality (AR) is the interaction between the images generated by the device and the realistic environment [1]
The design of augmented reality surgical navigation (ARSN) system platform enables the simulated experiments of spinal puncture based on the system to achieve the following goals: 1. During the experiment, the virtual and real model of the spine are registered through the augmented reality module, enabling the physician to observe the shape of the bone covered with silica gel in real time (In order to verify the authenticity of the experiment, the method of silica gel wrapping the spinal model was used to replace the skin and muscles of the real patient’s spine, so that the physician could not see the shape of the bones)
Based on the study of navigation system in spinal puncture, this study carried out an in-depth study on the virtual and real registration technology in augmented reality

Summary

Introduction

Augmented reality (AR) is the interaction between the images generated by the device and the realistic environment [1]. AR has been rapidly applied in commercial, military, medical and other fields. The application of AR is showing a rapidly rising trend [2]–[4]. Invasive surgery is one of the early applications of AR technology. The spinal structure required for surgery is projected from a computed tomography (CT) or magnetic resonance imaging (MRI) to a real surgical scene. Visual techniques are used to view images in two or

Methods

Results

Discussion

Conclusion