Abstract

Motion compensated prediction is one of the essential methods to reduce temporal redundancy in inter coding. The target of motion compensated prediction is to predict the current frame from the list of reference frames. Recent video coding standards commonly use interpolation filters to obtain sub-pixel for the best matching block located in the fractional position of the reference frame. However, the fixed filters are not flexible to adapt to the variety of natural video contents. Inspired by the success of Convolutional Neural Network (CNN) in super-resolution, we propose CNN-based fractional interpolation for Luminance (Luma) and Chrominance (Chroma) components in motion compensated prediction to improve the coding efficiency. Moreover, two syntax elements indicate interpolation methods for the Luminance and Chrominance components, have been added to bin-string and encoded by CABAC using regular mode. As a result, our proposal gains 2.9%, 0.3%, 0.6% Y, U, V BD-rate reduction, respectively, under low delay P configuration.

Highlights

  • H.265/High Efficiency Video Coding (HEVC) [1] has outperformed its predecessor H.264/AVC [2] to become the stateof-the-art video coding standard

  • motion compensated prediction (MCP) aims to predict the current frame from the reference frames which are previously reconstructed and store the residual along with the motion vector between the corresponding blocks, which benefits for reducing the temporal redundancy in inter coding

  • We obtain a 2.9, 0.3, and 0.6 % Y, U, and V BD-rate saving compared to the original HEVC Test Model (HM) under Low Delay P configuration and up to 6.5%, 2.1%, 2.9 % Y, U, V BD-rate reduction on sequence BQTerrace

Read more

Summary

Introduction

H.265/High Efficiency Video Coding (HEVC) [1] has outperformed its predecessor H.264/AVC [2] to become the stateof-the-art video coding standard. Compared to H.264/AVC, H.265/HEVC has been improved its coding techniques and achieves a 25-50% better data compression at the same image quality [3]. One of the critical technologies that significantly contributes to the high coding performance of HEVC is motion compensated prediction (MCP). MCP aims to predict the current frame from the reference frames which are previously reconstructed and store the residual along with the motion vector between the corresponding blocks, which benefits for reducing the temporal redundancy in inter coding. If the best matching block does not fall into integer samples, fractional pixels and fractional motion vector are required for these movements. MCP applies interpolation filters on the reference frame, considered as integer samples, to obtain fractional samples.

Methods
Results
Conclusion

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.