Using 3D hand gestures and touch input for wearable AR interaction

Abstract

While wearable devices have been developed that incorporate computing, sensing and display technology into a head-worn package, they often have limited input methods that might not be appropriate for natural 3D interaction which is necessary for Augmented Reality (AR) applications. In this paper we report on a prototype interface that supports natural 3D free-hand gestures on wearable computers. In addition to using hand gestures for AR interaction, we also look into allowing users to combine low resolution hand gestures in 3D with high resolution touch input. We show how this could be used in a wearable AR interface and present early pilot study results.