Spectral analysis of image-based rendering data with scene geometry

Abstract

The plenoptic function is commonly used to model image-based rendering (IBR) in terms of sampling and reconstruction. In this paper, we study the influence of scene geometry on the spectrum of a plenoptic function using spectral analysis. As the scene geometry becomes more complicated, the spectrum of the plenoptic function will broaden. Therefore, the bandwidth of the plenoptic function is closely related to the scene geometry, and the end goal of the bandwidth is to determine the minimum sampling rate (i.e., the minimum number of cameras) for IBR. Under the spectral analysis, we mathematically derive an analytical function to determine the spectral support of the plenoptic function. Based on the support of the plenoptic spectrum, the minimum number of cameras is determined to reconstruct the plenoptic function up to a certain frequency that allows a certain reconstruction quality when performing IBR. Furthermore, we derive a reconstruction filter for the plenoptic sampling for irregularly shaped scenes. Last, the experimental results are presented and compared with the theory.