Augmented reality displaying scheme in a smart glass based on relative object positions and orientation sensors

Abstract

To interactively browse augmented reality (AR) content from a smart glass and to display the proper 3D visual contents on a smart glass are challenging research issues. In this paper, we propose to use a depth camera to detect a human subject in a real 3D space, and orientation sensors on a smart glass are used to reveal the attitude and orientations of a user’s head for pose estimation in an AR application. By implementing a prototype for detecting a user’s head and measuring the orientations of the head, the proposed method provides three contributions: (i) a top-view depth camera is used to detect a user’s head position, (ii) the orientation sensors on a smart glass are used to reveal the attitude and orientation properties of the head, and (iii) the displayed AR content in a virtual space is properly mapped from a real 3D space. The experimental results demonstrated the spatial displaying accuracy in three testing spaces: a research lab, an office, and the center for art and technology. In addition, the proposed method is applied in a tech-art installation to allow audience to reliably view the AR content in a smart glass.