Abstract

Panoramic video with its flawless immersive tele-presence is considered to be the near-future video format of choice since they carry 360 degree coverage of the designated scenes. However, the viewers may focus their specific attention on perfectly lip-synchronized video as part of the panoramic video scene, hence only have a peripheral vision of the remaining parts of a frame. Therefore, it is intuitive to allocate stronger protection to the panoramic video region of interest. As a solution, we propose Region of Interest Aware Unequal Error Protection (ROI-UEP) for wireless transmission of high-efficiency video code (HEVC) sequences. Specifically, the ROI of a panoramic frame may be deemed to be within the 120° angular range of the viewing center, which can be estimated from the viewing trajectory of a head mounted display. Then, the most appropriate unequal forward error correction (FEC) coding rates will be found for the ROI signals by minimizing the expected video distortion. Moreover, the so-called weighted peak signal-to-noise ratio (WPSNR) is proposed for evaluating the quality of the reconstructed panoramic video, where the weights of pixels are taken into account for calculating the distortion caused by the related pixels. Our simulation results show that the ROI based equal error protection (ROI-EEP) scheme substantially outperforms the EEP by a WPSNR of more than 10 dB, while the ROI-UEP scheme further improves its ROI-EEP counterpart by a WPSNR of 9.4 dB at a channel E b /N 0 of 6 dB.

Highlights

  • In [8], tiling was applied by Gaddam et al in a real-time interactive panoramic video system, which progressively increases the quality toward the point of specific region of viewerfocus, while managing to reduce the bandwidth requirement at the cost of a slight quality of experience (QoE) reduction compared to a full-resolution panoramic system

  • This may be attributed to the fact that the optimization procedure of the Region of Interest Aware Unequal Error Protection (ROI-unequal error protection (UEP)) scheme seen in Algorithm 1 may fail to find the global optimum

  • Motivated by the fact that viewers tend to focus on certain parts of the panoramic frame, we proposed the region of interest (ROI)-UEP and ROI based equal error protection (ROI-equal error protection (EEP)) concept for video communications over wireless channels

Read more

Summary

INTRODUCTION

Different video signals within the ROI may have different importance, UEP should be employed for the sake of improving the performance. In this treatise, for each panoramic frame, we propose ROI aware UEP (ROI-UEP) for wireless transmission of high efficiency video coded. This OF aims for maximizing the weighted peak signal-to-noise ratio (WPSNR) of the viewers’ ROI signals By optimizing this OF relying on both the Lagrange Multiplier and Newton’s down-hill method, a specific set of blocks with specific FEC coding rates may be selected and transmitted for minimizing the expected video distortion. Let us briefly introduce the equi-rectangular projection (ERP) [1], [2], namely the geographic projection

TRANSFORMING SPHERICAL COORDINATES INTO
TRANSFORMING PLANAR COORDINATES INTO SPHERICAL COORDINATES
PANORAMIC VIDEO STREAMING SCENARIOS
OFF-LINE LUT GENERATION
CONCLUSIONS
Full Text
Paper version not known

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.