Using the Interactive Design of Gesture Recognition in Augmented Reality

Abstract

Due to the rapid development of computer hardware, the mobile computer systems such as PDAs, high-end mobile phones are capable of running augmented reality (AR, hereafter) system nowadays. The mouse and keyboard based user interfaces of the traditional AR system may not be suitable for the mobile AR system because of different hardware interface and use environment. The goal of this research is to propose a novel computer-vision based human-computer interaction model, which is expected to greatly improve usability of the mobile augmented reality. In this research, we will conduct an experiment on testing the usability of a new gesture-based interface and propose a product evaluation model for e-commerce applications based on the gesture interface. In the end, we expected the new interaction model could encourage more commercial applications and other research projects. In this paper, we propose a new interface interaction model called PinchAR. The focus of PinchAR is on adapting the interface design to the changing hardware design. This paper summarizes the PinchAR project, that is, the design of an intuitive interaction model in an AR environment. Also included in this paper are the results of the PinchAR experiments.