Abstract
Multiview video plus depth is a popular 3D video format which can provide viewers a vivid 3D feeling. However, its requirements in terms of computational complexity and transmission bandwidth are more than that of conventional 2D video. To mitigate these limitations, some works have proposed to reduce the amount of transmitted data by adopting different resolutions for different views, and consequently, the transmitted video is called mixed resolution video. In order to further reduce the transmitted data and maintain good quality at the decoder side; in this paper, we propose a down/upsampling algorithm for 3D multiview video which systematically takes into account the video encoder and decoder. At the encoder side, the rows of the two adjacent views are downsampled following an interlacing and complementary fashion, whereas, at the decoder side, the discarded pixels are recovered by fusing the virtual view pixels with the directional interpolated pixels from the complementary downsampled views. Moreover, the patterns of the texture surrounding the discarded pixels are used to aid the data fusion, so as to enhance edges recovery. Meanwhile, with the assistance of virtual views, at the decoder side, the proposed approach can effectively recover the discarded high-frequency details. The experimental results demonstrate the superior performance of the proposed framework.
Highlights
The development of 3D technologies and communication networks makes 3D video applications increasingly popular
In this work, some theoretical supports for the proposed view packing arrangement were missing. Both [19, 20] had shown superior performance than other state-of-the-art frame-compatible coding frameworks, they mainly focus on stereoscopic video which may not be optimal for multiview or Multiview video plus depth (MVD) video
6 Conclusions In this paper, an interlacing-and-complementary-rowdownsampling method is employed on the two adjacent views of a multiview video at the encoder side to reduce the transmitted data
Summary
The development of 3D technologies and communication networks makes 3D video applications increasingly popular. In this work, some theoretical supports for the proposed view packing arrangement were missing Both [19, 20] had shown superior performance than other state-of-the-art frame-compatible coding frameworks, they mainly focus on stereoscopic video which may not be optimal for multiview or MVD video. A systematical down/upsampling framework for MVD video is proposed to enhance the coding performance at low bit rate (Fig. 1). The LR views will be upsampled by fusing the virtual view pixels with directional interpolated pixels with the aid of the pattern of the texture surrounding the discarded pixels The proposed directional interpolation approach can overcome the limitation of the virtual-view-based upsampling mechanism, which suffers in the areas corresponding to depth map discontinuity.
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Free) 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a call
