Finger-Ray Interaction using Real Hand in Handheld Augmented Reality Interface

Abstract

Augmented Reality (AR) is the technology that augments the real world by using virtual information of 3D objects overlaid on a view of the real environment. This will create an immersive and intuitive experience. As handheld devices are widely used and now has climb with increasing demand of specifications, its interaction based on touch is a natural and appealing input style for the application of AR. Furthermore, most heuristic studies of interaction in AR usually focus on interactions with AR Target close to the user, generally within arm’s reach. As the user’s move farther away, the effectiveness and usability of the interaction modalities may be different. This study explores handheld AR interaction using real hand gesture at a distance in a room-scale setup. Our aim is to investigate the effectiveness of performing selection while being far away from the 3D object and performing selection task towards object that is being occluded. As object manipulation is one of the key features to explore for mobile handheld AR, we hope our study can give some contribution towards its practical use, especially for real-world assembly structure. Hence, our paper proposes finger ray interaction technique for real hand in handheld AR interface to work for selecting objects at distances ranging from 3 feet to 8 feet and when the object being occluded ranging from 20% to 80% occluded.