Abstract

This paper presents an overview of the technologies for in-loop processing and filtering in the Versatile Video Coding (VVC) standard. These processes comprise luma mapping with chroma scaling, deblocking filter, sample adaptive offset, adaptive loop filter and cross-component adaptive loop filter. They are qualified as “in-loop” because they are applied inside the encoding and decoding loops, before storing the pictures in the decoded picture buffer. The filters are complementary and address different purposes. Luma mapping with chroma scaling aims at adaptively modifying the coded samples distribution for improved coding efficiency. The deblocking filter aims at reducing blocking discontinuities. Sample adaptive offset mostly aims at reducing artifacts resulting from the quantization of transform coefficients. Adaptive loop filter and cross-component adaptive loop filter are adaptive filters enabling to enhance the reconstructed signal, using for instance Wiener-filter encoding approaches. The paper provides an overview of the in-loop filtering process and a detailed description of the filtering algorithms. Objective compression efficiency results are provided for each filter, with indication of cumulative coding gains. Subjective benefits are illustrated. Implementation issues considered during the design of the VVC in-loop filters are also discussed.

Highlights

  • V ERSATILE Video Coding (VVC) [1] is a new video coding standard developed by the Joint Video Experts Team (JVET) grouping experts from the ITU-T SG 16/Q.6 Video Coding Experts Group (VCEG), and the ISO/IEC JTC 1/SC 29/WG 11 Moving Pictures Experts Group (MPEG), which had jointly developed the AVC (H.264) [2] and HEVC (H.265) [3] standards

  • The Deblocking Filter (DBF) focuses on visual artifacts at block boundaries while Sample Adaptive Offset (SAO) complementarily reduces artifacts resulting from the transform coefficients quantization which can arise inside the blocks

  • CC-Adaptive Loop Filtering (ALF) and Luma Mapping with Chroma Scaling (LMCS) are tested using the common test conditions (CTC) defined for high dynamic range (HDR) content [64]

Read more

Summary

INTRODUCTION

V ERSATILE Video Coding (VVC) [1] is a new video coding standard developed by the Joint Video Experts Team (JVET) grouping experts from the ITU-T SG 16/Q.6 Video Coding Experts Group (VCEG), and the ISO/IEC JTC 1/SC 29/WG 11 Moving Pictures Experts Group (MPEG), which had jointly developed the AVC (H.264) [2] and HEVC (H.265) [3] standards. The filters are applied after the picture reconstruction and before saving the picture in the DPB, in the following decoding process order (see Fig. 1): inverse LMCS (luma mapping part), DBF, SAO, ALF, and CC-ALF. The DBF focuses on visual artifacts at block boundaries while SAO complementarily reduces artifacts resulting from the transform coefficients quantization which can arise inside the blocks VVC DBF uses the HEVC DBF design, with some adaptations mainly related to the addition of long-tap filters for both luma and chroma and for some specific coding conditions, leading for example to stronger smoothing in case of large coding blocks.

ADAPTIVE LOOP FILTER
Luma Sub-Block Level Filter Adaptation
Coding Tree Block Level Filter Adaptation
Syntax Design
Line Buffer Reduction
ALF Encoder Design in VTM
CROSS-COMPONENT ADAPTIVE LOOP FILTER
Filter Shape and Precision
Latency and Buffering
DEBLOCKING FILTER
Luma Deblocking
Chroma Deblocking
Adaptive Control of Deblocking
Computational Complexity and Parallelism
LUMA MAPPING WITH CHROMA SCALING
Development of LMCS
LMCS Coding Tool in VVC
LMCS Syntax Design and Model Derivation
LMCS Encoder Parameters Estimation
Test Conditions
SAO Performance
DBF Performance
LMCS Performance
In-Loop Filter Overall Performance
CONCLUSION

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.