Efficient view synthesis scheme with ray casting and pull-push techniques

Abstract

View synthesis, composed of depth-image-based rendering followed by hole-filling, is a crucial technology for 3D TV and free-viewpoint TV. To realize view synthesis in practical systems, the efficiency of view synthesis must be considered to achieve good a trade-off between the image quality and the computational complexity. We propose a efficient view synthesis scheme that, when compared to state-of-the-art backward warping, requires only half of the runtime with comparable quality. Specifically, the proposed scheme uses ray casting and pull-push processing to render in one pass, which can be regarded as applying 3D filters in the depth-image-based rendering. Moreover, the proposed scheme can benefit the hole-filling process to further improve the efficiency of view synthesis.