A research of surgical navigation system of mixed reality based on image registration

Abstract

This paper studies a registration method that is more suitable for using Microsoft HoloLens as a surgical navigation instrument. The most important step in the surgical navigation process is to register the virtual model with the corresponding lesion. Our registration method is mainly as follows: first use the 3D model recognition in vuforia for coarse registration; then extract the point cloud data of model and real scene scanned by HoloLens; finally use the normal vector geometric features to extract the feature points of the point cloud data, and then use the ICP algorithm Perform fine registration. Our registration method can solve the problem that the traditional ICP algorithm is easy to fall into a local optimum, and it can also improve the registration accuracy to a certain extent.