Frequency analysis of light field sampling for texture information.

Abstract

Light field sampling (LFS) theory can properly reduce minimum sampling rate while ensuring that novel views are not distorted for image-based rendering (IBR). The minimum sampling rate is determined by spectral support of light field. The spectral support of light field has studied the influence of the following factors: the minimum depth and the maximum depth, non-Lambertian reflections, whether the scene surfaces are flat, maximum frequency of painted signals. In this paper, we further perfect the light field spectrum analysis from the quantitative description of scene texture information based on the existing spectrum analysis theory. The quantification of texture information can be interactively refined via detected regional entropy. Thus, we can derive a spectral analytical function of light field with respect to texture information. The new function allows the spectral support of light field to be analyzed and estimated for different texture information associated with scene objects. In this way, we limit the spectral analysis problems of light field to those of a simpler signal. We show that this spectral analysis approach can be easily extended to arbitrary scene complexity levels, as we simplify the LFS of complex scenes to a plane. Additionally, the spectral support of light field broadens as the plane texture information becomes more complex. We present experimental results to demonstrate the performance of LFS with texture information, verify our theoretical analysis, and extend our conclusions on the optimal minimum sampling rate.