GPU-accelerated real-time free-viewpoint DIBR for 3DTV

Abstract

Multi-view 3D video may succeed stereo 3DTV in multimedia and TV applications. The MPEG committee has installed a special task force to establish a standard for multiview 3D video coding. Enabling free-viewpoint selection by the consumer is one of the major purposes of multi-view 3D encoded data. One focal point of our research work concerns an efficient implementation of the rendering part of stereoscopic free-viewpoint visualization, which is a computationally expensive task and significantly determines the final image quality. The free-viewpoint DIBR algorithm that is described in this article is implemented with an off-theshelf GPU that can be integrated in advanced 3DTV systems. We present the principal steps of a representative freeviewpoint DIBR, based on image warping and image artifact reduction techniques, and show the key differences between the reference software and our GPU implementation. One of those differences is the joint execution of signal processing blocks to share memory usage. Using a combination of the highly parallel programming architecture CUDA and a graphics API, we have achieved real-time performance executing 1080p HD multi-view video with a rendering quality that is comparable to the software implementation.