The system overlaying the stereoscopic images onto the haptic interface is proposed. In order to develop the tnaining systems based on virtual reality for medical doctors to experience medical treatments, it is important to improve the reality that visual and haptic information are synchronized. Our training system proposed in a previous paper for central venous injection uses the stereoscopic glasses and the haptic interface. This system has a palpation phase and an injection phase. During the injection phase, it is important that the user can see 3D injector images and the stylus of the haptic interface corresponding. In the proposed system, the user can look down the images projected from the display and reflected on the half mirror, and the haptic interface through the mirror. Using infrared LEDs wirelessly attached to the stereoscopic glasses and the infrared camera set under the display, the proposed system can show the 3D images considering with the face position in real-time. This system can achieve higher reality and more effectiveness than our conventional system. This system is evaluated by the experienced medical doctor as effective one.
Read full abstract