Abstract

In this paper we introduce MoSART, a novel approach for Mobile Spatial Augmented Reality on Tangible objects. MoSART is dedicated to mobile interaction with tangible objects in single or collaborative situations. It is based on a novel “all-in-one” Head-Mounted Display (AMD) including a projector (for the SAR display) and cameras (for the scene registration). Equipped with the HMD the user is able to move freely around tangible objects and manipulate them at will. The system tracks the position and orientation of the tangible 3D objects and projects virtual content over them. The tracking is a feature-based stereo optical tracking providing high accuracy and low latency. A projection mapping technique is used for the projection on the tangible objects which can have a complex 3D geometry. Several interaction tools have also been designed to interact with the tangible and augmented content, such as a control panel and a pointer metaphor, which can benefit as well from the MoSART projection mapping and tracking features. The possibilities offered by our novel approach are illustrated in several use cases, in single or collaborative situations, such as for virtual prototyping, training or medical visualization.

Highlights

  • The use of Augmented Reality technologies has been proposed in many application fields so far, such as for industrial, medical or robotic applications (Van Krevelen and Poelman, 2010)

  • We introduce MoSART, a novel approach for mobile spatial augmented reality on tangible objects

  • We have proposed a novel approach for Spatial Augmented Reality (SAR) with tangible objects called MoSART

Read more

Summary

INTRODUCTION

The use of Augmented Reality technologies has been proposed in many application fields so far, such as for industrial, medical or robotic applications (Van Krevelen and Poelman, 2010). MoSART (OST-AR) consists in displaying virtual content on neareye semi-transparent screens, so that the real world can be directly looked at Such systems often have low latency, accurate positioning and are well-designed for interactive environments by freeing the user’s hands. SAR systems are based on a direct projection over real physical surfaces through projection mapping This technique enables a larger field-of-view with a reduced latency, and shared experiences with other people. Our novel approach, called MoSART (for Mobile Spatial Augmented Reality on Tangible objects) is based on an “all-in-one” headset gathering all the necessary AR equipment (projection and tracking systems) together with a set of tangible objects and interaction tools (Figure 1). An operational prototype of the MoSART concept based on: (1) a novel all-in-one headset gathering head-mounted projection and optical tracking, and (2) a set of tangible objects and interaction tools.

RELATED WORK
MoSART
Projection
Tracking
Interaction tools
PROOF-OF-CONCEPT
Optical Tracking
Projection Mapping
Virtual Scene Generation
Interaction Tools
Adding Collaboration
Characteristics and Performances
USE CASES
Virtual Prototyping
Medical Visualization
CURRENT LIMITATIONS
DISCUSSION
CONCLUSION

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.