1515 TOUCHLESS GESTURE USER INTERFACE FOR INTERACTIVE IMAGE VISUALIZATION IN UROLOGICAL SURGERY

Abstract

You have accessJournal of UrologyTechnology & Instruments: Surgical Education & Skills Assessment/Ureteroscopy II1 Apr 20121515 TOUCHLESS GESTURE USER INTERFACE FOR INTERACTIVE IMAGE VISUALIZATION IN UROLOGICAL SURGERY Guilherme Ruppert, Leonardo Reis, Paulo Amorim, Tiago Moraes, and Jorge Silva Guilherme RuppertGuilherme Ruppert Campinas, Brazil More articles by this author , Leonardo ReisLeonardo Reis Campinas, Brazil More articles by this author , Paulo AmorimPaulo Amorim Campinas, Brazil More articles by this author , Tiago MoraesTiago Moraes Campinas, Brazil More articles by this author , and Jorge SilvaJorge Silva Campinas, Brazil More articles by this author View All Author Informationhttps://doi.org/10.1016/j.juro.2012.02.1282AboutPDF ToolsAdd to favoritesDownload CitationsTrack CitationsPermissionsReprints ShareFacebookTwitterLinked InEmail INTRODUCTION AND OBJECTIVES In the operating room a touchless interface is an ideal solution since it does not demand any physical contact and still can provide the necessary control features in a cleansed and sterilized environment. METHODS Using open-source software libraries and image processing techniques, we implemented a hand tracking and gesture recognition system based on the Kinect device that enables surgeon to successfully navigate through the image in the intraoperative setting. We used the InVesalius software, which provides high-quality 3D reconstruction of medical images. The hand of the user is tracked and the corresponding position is used to move the mouse pointer and button clicks events are also virtually generated. RESULTS Nephron-sparing surgery can be facilitated by using intra-operative hand gestures to provide touchless control of 3D medical imaging software. Computed tomography data from patients with renal masses were fruitfully accessed during surgery through a simple and cheap solution. The model was easily transferred to a personal computer, allowing the surgeon to touchlessly navigate through the 3D images in the intraoperative setting. We have utilized the proposed solution in 3 tumor enucleations in 2 male patients in whom elective nephron sparing surgery was performed for small non-exophitic tumors. Mean tumor length was 2.7 cm (2.1, 2.9 and 3.1 cm) and real-time ultrasound was not necessary in 2 tumors. All surgeries were guided by image review through gesture interface during the procedure, allowing anatomical support based on the 3D imaging previously obtained by CT scan. All pathological reports revealed renal cell carcinoma, Furhman grade I, and negative inked surgical margins. CONCLUSIONS The solution was successfully used intraoperative and can be used with any mouse-controlled software. This is an important step in bringing technology to the operating room to assist the surgeon directly, opening an avenue for potential applications in many other areas, such as: data visualization, augmented reality, accessibility and robotics. © 2012 by American Urological Association Education and Research, Inc.FiguresReferencesRelatedDetails Volume 187Issue 4SApril 2012Page: e613-e614 Advertisement Copyright & Permissions© 2012 by American Urological Association Education and Research, Inc.MetricsAuthor Information Guilherme Ruppert Campinas, Brazil More articles by this author Leonardo Reis Campinas, Brazil More articles by this author Paulo Amorim Campinas, Brazil More articles by this author Tiago Moraes Campinas, Brazil More articles by this author Jorge Silva Campinas, Brazil More articles by this author Expand All Advertisement Advertisement PDF downloadLoading ...