Multi-sensory user interface for a virtual-reality-based computeraided design system

Abstract

The generation of geometric shapes called ‘geometric concept designs’ via the multi-sensory user interface of a virtual reality (VR) based system motivates the current research. In this new VR-based system, geometric designs can be more effectively inputted into the computer in a physically intuitive way. The interaction mechanism is similar to the way in which industrial designers sit and discuss concept design shapes across a table from each other, prior to making a final decision about the product details. By using different sensory modalities, such as voice, hand motions and gestures, product designers can convey design ideas through the VR-based computer-aided design (CAD) system. In this scenario, the multi-sensory interface between human and computer plays a central role with respect to usability, usefulness and accuracy. The current paper focuses on determining the requirements for the multi-sensory user interface and assessing the applications of different input and output mechanisms in the virtual environment (VE). In order to evaluate this multi-sensory user interface, this paper formulates the typical activities in product shape design into a set of requirements for the VR-CAD system. On the basis of these requirements, we interviewed typical CAD users about the effectiveness of using different sensory input and output interaction mechanisms such as visual, auditory and tactile. According to the results of these investigations, a nodal network of design activity that defines the multi-sensory user interface of the VR-CAD system is determined in the current research. The VR-CAD system is still being developed. However, voice command input, hand motion input, three-dimensional visual output and auditory output have been successfully integrated into the current system. Moreover, several mechanical parts have been successfully created through the VR interface. Once designers use the VR-CAD system that we are currently developing, the interface requirements determined in the current paper may be verified or refined. The objectives of the current research are to expand the frontiers of product design and establish a new paradigm for the VR-based conceptual shape design system.