Light field camera decoding based on two-plane ray model

Abstract

2D raw image of Light Field (LF) camera needs to be decoded into 4D LF data for representation and processing. In decoding, the main lens is usually modeled as a thin lens while the micro-lens array is modeled as a pinhole array. Although this model takes into account the main lens distortion, it is still difficult to accurately characterize the complex imaging relationship of the LF camera. In order to obtain more accurate 4D LF data, this paper proposes a LF camera decoding method based on a two-plane ray model. By calibrating the ray corresponding to the pixel point of the LF camera, the mapping relationship between the real object point and the image point is established to obtain a new two- plane model of LF; then by interpolating and resampling on this two-plane, the correction of 4D LF data is achieved. Compared with traditional methods, our method improves the decoding accuracy of LF camera, and provides new ideas and methods for studying LF imaging.