Abstract
Reconstruction and projection mapping enable us to bring virtual worlds into real spaces, which can give spectators an immersive augmented reality experience. Based on an interactive system with RGB-depth sensor and projector, we present a combined hardware and software solution for surface reconstruction and dynamic projection mapping in real time. In this article, a novel and adaptable calibration scheme is proposed, which is used to estimate approximate models to correct and transform raw depth data. Besides, our system allows for smooth real-time performance using an optimization framework, including denoising and stabilizing. In the entire pipeline, markers are only used in the calibration procedure, and any priors are not needed. Our approach enables us to interact with the target surface in real time, while maintaining correct illumination. It is easy and fast to develop different applications for our system, and some interesting cases are demonstrated at last.
Highlights
Augmented reality is a live view of a physical, realworld environment whose objects or elements are augmented by computer-generated sensory inputs such as sound, video, or graphics
These cases rely on strong priors based on pre-learned statistical models or morphable shape models, which cannot work in general scenes
We will detail some example applications based on our calibration procedures and optimization framework
Summary
Augmented reality is a live view of a physical, realworld environment whose objects or elements are augmented by computer-generated sensory inputs such as sound, video, or graphics. Despite considerable advances in the field of reconstruction, there has been limited research on real-time techniques that work on flexible surface with desultory interference noise. Special cases such as hands, faces, or full bodies have been studied for years and researchers have demonstrated compelling real-time reconstructions of non-rigid articulated motion[7] and shape.[8] these cases rely on strong priors based on pre-learned statistical models or morphable shape models, which cannot work in general scenes. A real-time interactive system with RGB-D sensor and projector that uses consumer hardware for immersive augmented reality experience, which provides real-time reconstruction, dynamic projection mapping and convenient interactions. An optimization framework for denoising and stabilizing to update the target surface mesh, which will bring spectators a comfortable and fluent experience
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callMore From: International Journal of Distributed Sensor Networks
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
