Real-time implementation of multiview image synthesis system

Abstract

In this paper, we generate a virtual right image corresponding to an input left image by using given RGB texture data and 8-bit gray-scale depth data from a depth camera. First we transform the depth data to disparity data. Then, using this disparity data, we produce a virtual right image. Further, we propose a real-time multiple-view synthesis algorithm using geometric transformations, such as rotation and translation after the stereo image synthesis, and also a fast LUT (look-up table) method for real-time processing through analyzing the correlation between the depth data and the disparity data. As a result, we are able to achieve real-time synthesis of 11-viewpoint stereo images using only RGB texture data and the 8-bit depth information.