Geometrically valid pixel reprojection methods for novel view synthesis

Abstract

Conventional methods for scene visualization involve 3-D model reconstruction and direct rendering of the model. More recently, however, there has been an increasing interest in an alternative means for novel view synthesis, namely image-based rendering. It refers to a collection of techniques for creating new views directly from a set of input images; these images act as the scene `model'. This paper describes in detail a particular subset of image-based rendering techniques, which we refer to as geometrically valid pixel reprojection techniques. These techniques are based on established bilinear and trilinear image constraints in the forms of the fundamental matrix and trilinear tensor, respectively. We also describe an image-based rendering technique that uses as input a collection of cylindrical panoramic images.