Abstract
Mixed reality in surgical telepresence has not been practically implemented as yet and research done, until now, is only theoretical. Aiming to implement a proposed new solution by merging virtual and augmented realities and bringing about improvements by removing occlusion and the noise caused by hand motions during surgery. The proposed system consists of an extended Camshift algorithm for the detection of the remote expert surgeon’s hand during surgery and enhancement of an image synthesization algorithm to remove the occlusion by including two Red-Green-Blue-Depth (RGBD) cameras. The experimental results from 10 breast samples reduce the average accuracy error of the video frame image overlay from 1.44 mm to 1.28 mm with average processing time enhanced to 76 sec compared to the state-of-the-art method. The proposed system provides a satisfactory outcome in terms of accuracy and operating time, which allows surgeons in local and remote sites to collaborate more effectively.
Highlights
Any surgery is requiring expertise surgeon that has good knowledge and skill (DeSantis et al, 2017)
The idea here is to share mutual space between local and remote sites resulting in a mixed reality. the aim of this paper is to propose a new solution for the use of Mixed Reality (MR) in surgical telepresence
The proposed solution (Fig. 4) takes necessary features from the state of art solution that proposed by Shen et al (2012) and has some good features of second and third best solution for image synthesisation proposed by Habert et al (2017) and extensive Continuously Adaptive Mean Shift (CAMSHIFT) algorithm proposed by Przybyło (2010) respectively to address the limitation we found in Shen et al (2012) model
Summary
Any surgery is requiring expertise surgeon that has good knowledge and skill (DeSantis et al, 2017). In the surgery preparation stage, the Computed Tomography (CT) scan reports of the patient should be produced and had to be shared with the expert surgeon for pre-planning (Bruellmann et al, 2013). This is costly and time-consuming process was later replaced by a video-guided monitoring system, the System for Telemonitoring with Augmented Reality (STAR), which facilitated remote collaboration between local site; surgery site and remote site; expertise surgeon site (Andersen et al, 2016; Guo et al, 2014).
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.