Application and exploration of mixed reality technology in accurate operation of bone and soft tissue tumors

Abstract

Objective To explore the application value of mixed reality technology in the surgical operation of bone and soft tissue tumors. Methods A 48-year-old female inpatient with axillary soft tissue tumor in the Department of Orthopedics of the First People's Hospital Affiliated to Shanghai Jiao Tong university was selected.The DICOM raw data of axillary soft tissue tumors on the patient by 64-slice CT scan and 3.0 T MR scan were obtained and its 3D model reconstruction was completed. Then the 3D model was mapped to the real world through hololens glasses to form mixed reality 3D images, which assisted doctors in preoperative surgical design, simulated surgical operation and effective communication with patients, and guided by mixed reality technology for tumor resection. Results The bone, tumor tissue and surrounding anatomical structure of the patient were visualized and clearly displayed in surgery by high-definition reconstruction based on original CT and MRI imaging data with the assistance of mixed reality. The operation pathway was clear, and the tumor tissue was accurately located and completely removed outside the boundary. The patient recovered after operation with normal activities of the limb. Blood vessels and nerves around the tumor retain complete. Postoperative pathological diagnosis was schwannoma. Conclusions The combination of mixed reality technology with bone and soft tissue tumor surgery has brought revolutionary progress to the clinical diagnosis and treatment. It has great application prospects in the surgical treatment of bone and soft tissue tumors. Key words: Bone neoplasms; Soft tissue neoplasms; Mixed reality technology; Tomography, spiral computed; Magnetic resonance imaging; Precision medicine