Depth image based rendering for multiview stereoscopic displays: role of information at object boundaries

Abstract

Depth image based rendering (DIBR) is useful for multiview autostereoscopic systems because it can produce a set of new images with different camera viewpoints, based on a single two-dimensional (2D) image and its corresponding depth map. In this study we investigated the role of object boundaries in depth maps for DIBR. Using a standard subjective assessment method, we asked viewers to evaluate the depth and the image quality of stereoscopic images in which the view for the right eye was rendered using (a) full depth maps, (b) partial depth maps containing full depth information but that was only located at object boundaries and edges, and (c) partial depth maps containing binary depth information at object boundaries and edges. Results indicate that depth quality was enhanced and image quality was slightly reduced for all test conditions, compared to a reference condition consisting of 2D images. The present results confirm previous observations indicating that depth information at object boundaries is sufficient in DIBR to create new views such as to produce a stereoscopic effect. However, depth ratings for the partial depth maps tended to be slightly lower than those generated with the full depth maps. The present study also indicates that more research is needed to increase the depth and image quality of the rendered stereoscopic images based on DIBR before the technique can be of wide and practical use.