31.2: Invited Paper: Enhanced Minimally Invasive Surgery by 2D to 3D Conversion

Abstract

AbstractMinimally Invasive Surgery (MIS) is a growing surgical technique comparing to traditional open surgery since it dramatically reduces patient trauma and costs but MIS technique is difficult because of looking at a 2D screen to perform the surgery. Depth perception is thus lost due to 2D endoscopic capturing and display. Therefore, the paper proposes real‐time 2D to 3D conversion for enhancing MIS to provide depth perception on 3D display for increasing surgical quality, improving in safety and speed of procedures, and also to lower learning curve. The proposed method to convert an endoscopic 2D video frame into a depth map and consequently into a pair of right and left image for viewing on a stereoscopic display is based on the use of a bilateral filter approximated by a bilateral grid. The architecture is to make edges sharp to enhance moving instruments and to preserve chamber geometry segmentation. Results of verification by simulated surgery and questionnaire for surgeons proof the feasibility of 2D to 3D conversion on MIS.