View generation for a virtual camera using multiple depth maps

Abstract

AbstractThis paper proposes a method of generation of images taken from a virtual viewpoint, based on depth information on the object when viewed from multiple positions. First, the depth map from a viewpoint is converted to the depth map of the object as viewed from a virtual point. Then, based on the depth map from another viewpoint, the occlusion area of the virtual viewpoint depth map is complemented and the depth value is corrected. By appropriate use of real images through interpolation of depth values and smoothing, a virtual viewpoint image is generated. Applying the proposed method makes it possible to generate a virtual viewpoint image with less occlusion, even for a viewpoint deviating greatly from the actual camera position. © 2004 Wiley Periodicals, Inc. Electron Comm Jpn Pt 3, 87(10): 81–88, 2004; Published online in Wiley InterScience (www.interscience.wiley.com). DOI 10.1002/ecjc.20110