Guess the Gesture: Uncovering an Intuitive Gesture-based User Interface for 3D Content Interaction in Virtual Reality

Abstract

This paper presents a novel approach to co-designing an immersive virtual reality (VR) experience where users can participate in a guessability process for a full gesture-based user interface for 3D content interactions using hand controllers. The proposed VR system includes animated visual prompts to allow users to create their own gestures for 13 different object interactions. A pilot study with two participants demonstrated that the visual prompts helped users understand expected interactions and enhanced their creativity in gesture design while maintaining an enjoyable user experience. Hand motion data and user feedback were collected and will be analyzed to provide quantitative insights into gesture efficiency and economy. This paper contributes to developing an intuitive and interactive gesture-based interface for VR and sets the foundation for future studies with more participants to gather additional gesture design ideas.