Abstract Aim Training in laparoscopic surgery is limited to observing what the trainee is doing on the screen and reliant on verbal coaching. The idea of a physical pointer onto the screen in real-time to allow for more focused supervision and to improve communication was conceptualised. The study aims to demonstrate the feasibility and identify the challenges of using eye-tracking glasses in producing this digital pointer onto a screen. Method Pupil Core (Pupil Labs GmbH) eye-tracking glasses were used to calibrate the edges of a computer monitor to the pupil tracking cameras (200Hz) and the point-of-view (POV) cameras. Utilising the accompanying open-source Pupil Core software, a red-dot cursor was programmed to display in real-time on an accompanying screen. A video of a simulated laparoscopic cholecystectomy and geometric shapes were displayed onto the screen to demonstrate the technology. Results A red dot pointer was successfully displayed on a screen as an overlay controlled entirely by gaze. It was able to track the edges of shapes and used to point out anatomical structures in a video in real-time. Despite the tester looking away from the screen and leaving the seated position, the glasses were able to recallibrate automatically and work seamlessly after. The saccadic nature of eye movements meant that the tracing lines were not always smooth. Conclusions This study demonstrates that the technology exists to make this feasible. Further optimisation in software design is required to mitigate the effects of saccadic eye movements. Further studies collecting objective data is required to demonstrate a minimum viable product.
Read full abstract