A high-performance haptic rendering system for virtual reality molecular modeling

Abstract

To provide a virtual reality 3D user interface with comprehensive molecular modeling, we have developed a novel haptic rendering system with a fingertip haptic rendering device and a hand-tracking Leap Motion controller. The system handles virtual molecular objects with real hands motion captured by the Leap Motion controller in a virtual reality environment. The fingertip haptic rendering device attached on each finger and a wrist gives haptic display, when virtual hands manipulating virtual molecular objects. Based on preliminary software development studies using existing 3D graphics toolkit such as CHAI3D and Unity, the fingertip haptic rendering device works with a reasonable performance for a polygon surface model and a ribbon model, but not for an atomic model due to the low rendering performance. On the other hand, the device provides us a grasping feeling of a large molecule represented by an atomic model, when used with the particle simulation system running on graphics library, DirectX 12. The haptic rendering performances, among the three software systems are discussed.