Abstract
This article presents an extensive review of the state-of-the-art system-level solutions featuring complexity reduction and/or dedicated hardware designs for the AV1 and VVC video coding formats. These formats introduced several novel coding techniques compared to their predecessors to improve the coding efficiency at the cost of a significant computational cost. In this article, we discuss the main novelties of AV1 and VVC in each coding module, including block partitioning, intra and inter prediction, transform, entropy coding, and in-loop filters. Then, we present the main published works focusing on complexity reduction and hardware designs for AV1 and VVC. Most of the complexity reduction solutions target the complex and flexible block partitioning structures of these encoders to provide a better tradeoff between coding efficiency and complexity reduction whereas the hardware designs focus on the challenge of implementing the new coding tools to attend real-time processing of high-definition videos. Even with the presented works reaching impressive results, these research fields remain opened for innovative contributions, as discussed in this article.
Highlights
T HE LIMITS of the telecommunication infrastructures available bandwidth are being pushed each day by the digital video traffic over the Internet due to the continuous growth in consumption of products that rely heavily on videos, such as social media, streaming services and video conferencing platforms.According to Cisco, the digital video traffic grew 29% annually over the past four years, and this type of traffic is expected to reach 325 Exabytes monthly in 2022, representing 82% of the global Internet traffic [1]
This paper presents an extensive review of the complexity reduction solutions and dedicated hardware designs for Alliance for Open Media (AOMedia) Video 1 (AV1) and Versatile Video Coding (VVC) published to date, and it is an invited extended version of our previous work [10]
This article presented an extensive review of published works related to algorithmic optimizations and dedicated hardware designs for the state-of-the-art AV1 and VVC video coding formats
Summary
T HE LIMITS of the telecommunication infrastructures available bandwidth are being pushed each day by the digital video traffic over the Internet due to the continuous growth in consumption of products that rely heavily on videos, such as social media, streaming services and video conferencing platforms. ALGORITHMIC OPTIMIZATION FOR VVC This section presents the related works focusing on complexity reduction solutions for VVC through algorithmic optimizations Most of these works targeted the block partitioning structure of intra prediction employing statistical analysis and/or machine learning approaches. Seven works developed solutions based on machine learning, such as Bayesian theorem, decision trees, SVM, and CNN, and five works proposed heuristics based on statistical analysis These works used encoder context information and/or statistical information of block samples to build efficient complexity reduction solutions capable of reducing the number of encoding modes evaluated. DEDICATED HARDWARE DESIGNS FOR VVC there are few works in the literature related to hardware architecture designs for the different modules of VVC, we discuss the main published works These works focused on intra-frame prediction, fractional interpolation filters, and transform, considering FPGA and ASIC-based designs. These works are based on early versions of the reference software, the proposed approaches could be adjusted to comply to the current standard
Sign-in/Register to view highlights & summary Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
