Two‐handed multiple‐finger virtual object manipulation environment with haptic cues

Abstract

AbstractIn this paper, the authors propose a system for implementing direct, two‐handed, multifinger manipulations in a virtual world. To implement an easier‐to‐use means of direct, two‐handed, multifinger manipulations, it is necessary to give a sense of touch to the hands to make them feel like they are grasping an object and to make it easier for the user to understand the positional relationship between the user's hands and the virtual object. Therefore, the authors constructed a system that provides force feedback to eight fingertips and that can display virtual hands making the same movements as the user's actual hands in real time. The system uses the SPIDAR‐8 device for force feedback. SPIDAR‐8 is a device that can measure the positions of eight points and provide force feedback by using strings. Force feedback can be provided to a fingertip by attaching a cap‐like apparatus to the ends of the strings and fitting this apparatus onto the fingertip. The virtual hands are displayed according to the eight fingertip positions calculated by SPIDAR‐8. The hand shapes are estimated from the positions of the eight points, and these hands are displayed together with the virtual object via computer graphics. Virtual hands making the same movements as the user's actual hands are displayed in this way. With this kind of system, the user can integrate the haptic and visual information that is presented to efficiently perform direct, two‐handed, multifinger manipulations. © 2004 Wiley Periodicals, Inc. Electron Comm Jpn Pt 2, 87(9): 65–73, 2004; Published online in Wiley InterScience (www.interscience.wiley.com). DOI 10.1002/ecjb.20117