Displaying digital documents on real paper surface with arbitrary shape

Abstract

In this paper, we propose a system that displays digital components on real paper surface with arbitrary shape, so that the viewer can feel as if the digital document images are printed on the real paper surface. Such displaying of the digital documents is realized by rendering the document images on the arbitrary shaped surface via a projector. We apply a holography between a source image plane and a projector image plane to render the images on the surface. For adapting the arbitrary shape of the surface, we divide the shaped surface into many small rectangular regions, and generate warp images of each region by calculating this holography of the plane of each divided region. By protecting the warp image on the real surface, the image can be observed as if the image is printed on the surface. Since the system always compute the holography of each divided region, the image can be aligned onto the surface even the surface moves.