Abstract

Scalable video coding (SVC) has been an active research topic for the past decade. In the past, most SVC technologies were based on a coarse-granularity scalable model which puts many scalability constraints on the encoded bitstreams. As a result, the application scenario of adapting a preencoded bitstream multiple times along the distribution chain has not been seriously investigated before. In this paper, a model-based multiple-adaptation framework based on a wavelet video codec, MC-EZBC, is proposed. The proposed technology allows multiple adaptations on both the video data and the content-adaptive FEC protection codes. For multiple adaptations of video data, rate-distortion information must be embedded within the video bitstream in order to allow rate-distortion optimized operations for each adaptation. Experimental results show that the proposed method reduces the amount of side information by more than 50% on average when compared to the existing technique. It also reduces the number of iterations required to perform the tier-2 entropy coding by more than 64% on average. In addition, due to the nondiscrete nature of the rate-distortion model, the proposed framework also enables multiple adaptations of content-adaptive FEC protection scheme for more flexible error-resilient transmission of bitstreams.

Highlights

  • Multimedia distribution over heterogeneous networks and devices has become the mainstream enabling technology for new generations of services

  • Because there is no inherent layer structure for wavelet video bitstreams, video parameters such as resolution, frame rate, and bitrate can be dynamically adapted with fine granularity after the encoding procedure

  • With a fully embedded bitstream where both RD information and the wavelet video data are transmitted to the notebook, the notebook can extract an R-D optimized bitstream according to the runtime constraints of the target device

Read more

Summary

INTRODUCTION

Multimedia distribution over heterogeneous networks and devices has become the mainstream enabling technology for new generations of services. With a fully embedded bitstream where both RD information and the wavelet video data are transmitted to the notebook, the notebook can extract an R-D optimized bitstream according to the runtime constraints of the target device This approach achieves better quality than the layerstructured scheme, but the side information, namely the R-D information, is required and the complexity of the bitstream adaptor is higher. The most popular rate adaptation scheme is the 3D-ESCOT proposed by Xu et al [4] In this approach, R-D information is computed from real data points and is encoded into the bitstream for later adaptation. A parameterized R-D model-based approach for R-D optimized multiple adaptations of video bitstream and content-adaptive FEC protection is proposed.

MULTIPLE-ADAPTATION PROBLEM OF FEC-PROTECTED WAVELET VIDEO DATA
R-D side information and R-D optimized rate allocation
R-D side information and content-adaptive FEC protection
THE PROPOSED R-D SIDE INFORMATION FOR MULTIPLE-ADAPTATION APPLICATIONS
Parameterized coding block-level R-D models
GOP-level model and the proposed side information encoding mechanism
R-lambda model and the model for a GOP of coding blocks
Proposed rate-distortion side information coding mechanism
Rate adaptation procedure
Adaptation of content-adaptive FEC protection
Computational cost reduction for runtime bitstream adaptation
Side information saving for multiple adaptations
Content-adaptive FEC protection experiments
CONCLUSIONS AND FUTURE WORK

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.