Abstract

In an increasingly connected world, consumer video experiences have diversified away from traditional broadcast video into new applications with increased use of non-camera-captured content such as computer screen desktop recordings or animations created by computer rendering, collectively referred to as screen content. There has also been increased use of graphics and character content that is rendered and mixed or overlaid together with camera-generated content. The emerging Versatile Video Coding (VVC) standard, in its first version, addresses this market change by the specification of low-level coding tools suitable for screen content. This is in contrast to its predecessor, the High Efficiency Video Coding (HEVC) standard, where highly efficient screen content support is only available in extension profiles of its version 4. This paper describes the screen content support and the five main low-level screen content coding tools in VVC: transform skip residual coding (TSRC), block-based differential pulse-code modulation (BDPCM), intra block copy (IBC), adaptive color transform (ACT), and the palette mode. The specification of these coding tools in the first version of VVC enables the VVC reference software implementation (VTM) to achieve average bit-rate savings of about 41% to 61% relative to the HEVC test model (HM) reference software implementation using the Main 10 profile for 4:2:0 screen content test sequences. Compared to the HM using the Screen-Extended Main 10 profile and the same 4:2:0 test sequences, the VTM provides about 19% to 25% bit-rate savings. The same comparison with 4:4:4 test sequences revealed bit-rate savings of about 13% to 27% for <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$Y'C_{B}C_{R}$ </tex-math></inline-formula> and of about 6% to 14% for <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$R'G'B'$ </tex-math></inline-formula> screen content. Relative to the HM without the HEVC version 4 screen content coding extensions, the bit-rate savings for 4:4:4 test sequences are about 33% to 64% for <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$Y'C_{B}C_{R}$ </tex-math></inline-formula> and 43% to 66% for <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$R'G'B'$ </tex-math></inline-formula> screen content.

Highlights

  • T HE Versatile Video Coding (VVC) standard

  • ITU-T H.266 and ISO/IEC 23090-3) [1]–[3] includes low-level coding tools developed for screen content signals, highlighting the importance of screen content videos that have become increasingly prominent since the specification of the first version of the High Efficiency Video Coding (HEVC) in 2013 [4], [5]

  • The sequence groups labelled as Class F and TGM (Text and Graphics with Motion) of the 4:2:0 test set are from interests since they represent screen content signals

Read more

Summary

Introduction

T HE Versatile Video Coding (VVC) standard (Rec. ITU-T H.266 and ISO/IEC 23090-3) [1]–[3] includes low-level coding tools developed for screen content signals, highlighting the importance of screen content videos that have become increasingly prominent since the specification of the first version of the High Efficiency Video Coding (HEVC) in 2013 [4], [5]. Screen content is an umbrella term for non-camera captured signals, and typically refers to computer-generated text, graphics and animations. Due to its different signal characteristics, such as sharp edges, repeated patterns, or the non-existence of a noise level, not all coding technologies suitable for camera-captured content are efficient for screen content. VVC includes the following low-level screen content coding tools already in its first version to address the developments above:

Methods
Results
Conclusion
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call