A New Perspective on Hole Generation and Filling in DIBR Based View Synthesis

Abstract

Depth-image-based rendering (DIBR) technique is widely used to synthesize virtual views in many applications including multiview and free viewpoint video systems. In view of disocclusion problem in the view synthesis, the disoccluded regions known as holes in the virtual view need to be dealt with properly to generate a synthesized view of high quality. This paper first investigates the generation of holes in view interpolation and reveals concretely under what conditions the holes will appear. Accordingly a novel hole-filling method is proposed by fully utilizing the occlusion information. The proposed scheme can effectively locate the relevant background pixels including those occluded around the hole and make use of integrated background information in the hole filling. Experimental results show that our proposed approach demonstrates superior performance in terms of visual quality of the synthesized view.