IpProjector: A Vision-Based Framework for Unsupervised Ubiquitous Object Augmentation Using a Portable Projector-Camera System

Thitirat Siriborvornratanakul,Masanori Sugimoto

doi:10.1155/2011/572596

Thitirat Siriborvornratanakul, Masanori Sugimoto

Open Access

https://doi.org/10.1155/2011/572596

Copy DOI

Abstract

ipProjector stands for interactive portable projector which is a project trying to make a smart projection system while retaining absolute portability of the devices and setups. In this paper, an ipProjector framework is proposed for unsupervised real-time object augmentation applications. Scene-independent projector-camera geometric calibration is introduced so that the projected augmentation always appears in the desired geometry despite an unconstrained surface. Using nonintrusive projection, the system can ensure correct vision-based analysis because external appearances of the environment and object (as seen by the camera) are hardly changed by the overlaid projected content. Finally, an unsupervised visual detector is used to guarantee robustness of the detection regardless of lighting variations. Several image processing algorithms are applied in the framework, including image warping using perspective transformation, color conversion using the nearest-neighbor search algorithm, and multiscale visual detection. Based on a small-scale laboratory setting, experiments were conducted to evaluate the proposed approaches, and one example was built to prove the proposed concept in object augmentation.

Highlights

Because of the trend in mobile projector phones, people have started to imagine using mobile projectors ubiquitously in the same way as mobile phones
We proposed a complete vision-based framework for real-time object augmentation applications using
The geometric aspect of the system is concerned in order to detect the target object and project real-time 2-D augmentation in the desired geometry

Summary

Introduction

Because of the trend in mobile projector phones, people have started to imagine using mobile projectors ubiquitously in the same way as mobile phones. While the mobility of a projector has recently been successfully proposed, intelligent mobile projection has not yet been accomplished in practice. We focus on a vision-based ubiquitous projection system that is able to perform real-time object augmentation in a robust manner. Object augmentation using a projector has been proposed continuously in the past decade. This trend has become more prominent with the recent proposal of the SixthSense project [1] that uses a wearable projector to augment the physical world with virtual information projected from a projector. The vision-based projector-camera (i.e., pro-cam) system is often the choice for researchers in this field because it allows object augmentation everywhere without relying on separate tracking hardware, and a user can interact directly with the projection

Objectives

Results

Conclusion