Abstract
The hybrid digital-analog (HDA) video transmission scheme can be used to avoid the cliff effect and saturation effect. However, directly using HDA in 3D video transmission requires too much bandwidth. This paper addresses synthesis-distortion-aware HDA transmission for 3D videos to improve transmission performance. First, a 3D HDA framework that transmits both texture and depth videos in HDA mode is designed. Second, a recursive synthesis distortion estimation model, called RSDE-3D-HDA, is derived, where the transmission errors of both the texture and depth sequences are considered. Third, we optimize the power allocation between digital and analog signals based on the RSDE-3D-HDA. Finally, simulation results show that our model is accurate and the proposed 3D-HDA achieves better performance in terms of synthesis quality than state-of-the-art methods.
Highlights
Three-dimensional (3D) video has drawn extensive attention from both industry and academia in recent years. 3D video contents are usually represented in the multiview video plus depth (MVD) format [1], including texture videos and associated depth videos
By transmitting the MVD data, a virtual view between any two captured views can be rendered on the decoder side by using depth image-based rendering (DIBR) technology [2], which has been adopted in the Moving Picture Experts Group View Synthesis Reference Software (MPEGVSRS) [3]
First, when the channel quality is lower than a threshold, the received video quality will degrade dramatically, which is known as the cliff effect [4]; second, when the channel quality is greater than a threshold, even if the channel quality improves further, a better video quality cannot be obtained, this is called the quality saturation effect [5]
Summary
Three-dimensional (3D) video has drawn extensive attention from both industry and academia in recent years. 3D video contents are usually represented in the multiview video plus depth (MVD) format [1], including texture videos and associated depth videos. A recursive distortion estimation method is proposed in [15] for HDA-based single-view video transmission, which recursively estimates the decoder-side distortion from the encoder and adaptively allocates the transmission power between the digital and analog signals in HDA. After DCT and power allocation, the analog Yla and digital Yld are superposed to obtain the transmission signal Slc, as expressed by Eq (1). Xld is decoded by H.264 with error concealment and power allocation to obtain the recovered depth Dl and the texture Tld. the demodulated digital signal Yld is modulated and subtracted from the received superposed signals Slc. After that, the reconstructed analog signal Tla is obtained by Yla through power allocation and analog decoding, including inverse DCT and LLSE, which is similar to Softcast. We use an interpolated pixel SsI (i, m, n) to represent the hole pixel value when there is no information provided by either the left or right view
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Free) 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a call
