Manipulating Virtual Objects in Augmented Reality Using a New Ball-Shaped Input Device

Abstract

Today’s Augmented Reality (AR) technology allows users to explore the real world enriched with digital artifacts, learn from it, or shape it (i.e., creating your own virtual objects). To properly use virtual objects in AR space, users must be able to manipulate them (i.e., rotate or move them). The prerequisite for manipulation is an intuitive interaction technique controlled by an input device. To explore novel AR interaction techniques, a new ball-shaped input device called BIRDY is combined with the HoloLens for the first time. This paper presents findings regarding this combination of devices. Four new interaction techniques were designed that benefit from BIRDY’s orientation invariance. Aiming to identify promising interaction rules, a prototype was developed to evaluate these interaction techniques. Results indicate that using gravity as a placement tool and separating the degrees of freedom when manipulating virtual objects provides the best experience for users. Findings further confirm the potential of using ball-shaped devices for interaction in AR.