Physical query interface for tangible augmented tagging and interaction

Abstract

A new physical query interface is proposed for tangible augmented tagging and interaction using two types of context-aware AR interfaces, visual and invisible interfaces. In visual interfaces, augmented reality markers are utilized for supporting intuitive interactions and manipulations with digital contents. RFID is used as an invisible interface for supporting line-of-sight, direct and query interactions. By combining the advantages of visual and invisible interfaces, more natural interaction with digital contents can be provided, which can remove the difficulty of using typical AR paddles, cubes and gadgets that are widely used in AR interactions. Semantic ontology is adopted in order to effectively support physical querying, filtering and grouping through the combination of multiple RFID tags. The proposed approach has been applied to a variety of multi-media interactions, such as digital product review and digital catalog or book interaction. We show the effectiveness and the advantages of the proposed approach by demonstrating several implementation results and by a usability study.