Poster: Auditory feedback of contact state during object manipulation

Abstract

This paper reports our preliminary investigation of substituting haptic information in object manipulation with sound. A haptic sensation is considered to provide information such as the area of contact on the hand, the intensity of pressure, and the geometric features of the object in the contact area. In our investigation, this information was mapped to the pitch, timbre, volume level, and fluctuations in the pitch. The performance in object recognition and manipulation was evaluated, which showed that the representation of sound facilitated the performance of these tasks in non-visual conditions.