Investigating the Effect of Interface Type on Embodied Interactions in 3D Gestural Human-Computer Interaction

Abstract

Through emerging technologies, it is possible to use hand gestures to interact with computing systems in the form of embodied human-computer interaction (eHCI). There is much research done on improving gesture recognition accuracy and on understanding the factors that influence intuitive gesture choice; however, there is a lack of work investigating how to design the interface for 3D gestural interactions. Therefore, a between subjects experimental study was done to study the effect of interface design (e.g, 3D vs. 2D) on intuitive gesture choice and cognitive load for performing an embodied interaction. Two out of ten functions had the same intuitive gesture function mapping for 2D and 3D conditions. However, many of the functions had different mappings between the two different display types. The results illustrate the differences in embodied interactions between 2D and 3D interfaces, and future work should investigate the interface design comprehensively.