Abstract

Interest in 3D video applications and systems is growing rapidly and technology is maturating. It is expected that multiview autostereoscopic displays will play an important role in home user environments, since they support multiuser 3D sensation and motion parallax impression. The tremendous data rate cannot be handled efficiently by representation and coding formats such as MVC or MPEG-C Part 3. Multiview video plus depth (MVD) is a new format that efficiently supports such advanced 3DV systems, but this requires high-quality intermediate view synthesis. For this, a new approach is presented that separates unreliable image regions along depth discontinuities from reliable image regions, which are treated separately and fused to the final interpolated view. In contrast to previous layered approaches, our algorithm uses two boundary layers and one reliable layer, performs image-based 3D warping only, and was generically implemented, that is, does not necessarily rely on 3D graphics support. Furthermore, different hole-filling and filtering methods are added to provide high-quality intermediate views. As a result, high-quality intermediate views for an existing 9-view auto-stereoscopic display as well as other stereo- and multiscopic displays are presented, which prove the suitability of our approach for advanced 3DV systems.

Highlights

  • Creating a 3D depth impression requires that a viewer looking at a 3D display sees a different view with each eye

  • Wearing glasses is widely accepted in such a scenario and motion parallax is not a big issue. 3D cinema with display technology based on glasses is expected to remain the standard over the years

  • Multiview autostereoscopic displays support head motion parallax viewing and multiuser applications without the necessity to wear glasses. They are in the center of the advanced concept for 3D video home systems considered in this paper

Read more

Summary

INTRODUCTION

Creating a 3D depth impression requires that a viewer looking at a 3D display sees a different view with each eye. Multiview autostereoscopic displays support head motion parallax viewing and multiuser applications without the necessity to wear glasses They are in the center of the advanced concept for 3D video home systems considered in this paper. Around 10–20% of the bit rate necessary for the corresponding color video are required to compress depth at a sufficient quality This means that the final stereo pair rendered using this decoded depth is of same visual quality as if the 2 video signals were transmitted instead. Sender side signal processing includes a lot of advanced algorithms such as camera calibration, color correction, rectification, segmentation as well as depth estimation or generation The latter is crucial for DIBR since any error of depth estimation results in reduced quality of rendered output views. The rest of this paper presents an efficient solution for high-quality rendering at receiver side

GENERAL FORMULATION OF DEPTH-BASED INTERMEDIATE VIEW SYNTHESIS
IMPLEMENTATION OF LAYERED INTERMEDIATE VIEW SYNTHESIS
Layer extraction
Layer projection
Intermediate view enhancement
VIEW SYNTHESIS EXAMPLES
Findings
CONCLUSIONS
Full Text
Paper version not known

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.