A universal calibration framework for mixed-reality assisted surgery

Abstract

Background:Mixed-reality-assisted surgery has become increasingly prominent, offering real-time 3D visualization of target anatomy such as tumors. These systems facilitate translating preoperative 3D surgical plans to the patient’s body intraoperatively and allow for interactive modifications based on the patient’s real-time conditions. However, achieving sub-millimetre accuracy in mixed-reality (MR) visualization and interaction is crucial to mitigate device-related risks and enhance surgical precision. Objective:Given the critical role of camera calibration in hologram-to-patient anatomy registration, this study aims to develop a new device-agnostic and robust calibration method capable of achieving sub-millimetre accuracy, addressing the prevalent uncertainties associated with MR camera-to-world calibration. Methods:We utilized the precision of surgical navigation systems (NAV) to address the hand-eye calibration problem, thereby localizing the MR camera within a navigated surgical scene. The proposed calibration method was integrated into a representative surgery system and subjected to rigorous testing across various 2D and 3D camera trajectories that simulate surgeon head movements. Results:The calibration method demonstrated positional errors as low as 0.2 mm in spatial trajectories, with a standard error also at 0.2 mm, underscoring its robustness against camera motion. This accuracy complies with the accuracy and stability requirements essential for surgical applications. Conclusion:The proposed fiducial-based hand-eye calibration method effectively incorporates the accuracy and reliability of surgical navigation systems into MR camera systems used in intraoperative applications. This integration facilitates high precision in surgical navigation, proving critical for enhancing surgical outcomes in mixed-reality-assisted procedures.