Abstract

Different visual perception characteristic saliencies are the key to constitute the low-complexity video coding framework. A hierarchical video coding scheme based on human visual systems (HVS) is proposed in this paper. The proposed scheme uses a joint video coding framework consisting of visual perception analysis layer (VPAL) and video coding layer (VCL). In VPAL, effective visual perception characteristics detection algorithm is proposed to achieve visual region of interest (VROI) based on the correlation between coding information (such as motion vector, prediction mode, etc.) and visual attention. Then, the interest priority setting for VROI according to visual perception characteristics is completed. In VCL, the optional encoding method is developed utilizing the visual interested priority setting results from VPAL. As a result, the proposed scheme achieves information reuse and complementary between visual perception analysis and video coding. Experimental results show that the proposed hierarchical video coding scheme effectively alleviates the contradiction between complexity and accuracy. Compared with H.264/AVC (JM17.0), the proposed scheme reduces 80% video coding time approximately and maintains a good video image quality as well. It improves video coding performance significantly.

Highlights

  • Due to the rapid growth of the multimedia service, the video compression becomes essential for reducing the required bandwidth for transmission and storage in many applications

  • We propose an efficient hierarchical video coding algorithm based on visual perception characteristics

  • Compared with the H.264/AVC standard algorithm, under various quantization parameter (QP) (28, 32, and 36), the hierarchical video coding algorithm reduces 78.55%, 78.88%, and 79.22% coding time on average, the bit rate increases by 1.93%, 1.74%, and 1.27% on average, the PSNR-Y reduces 0.188 dB on average, in nonzero region with visual perception characteristics which is the human visual attention region, and the PSNRY reduces 0.153 dB on average

Read more

Summary

Introduction

Due to the rapid growth of the multimedia service, the video compression becomes essential for reducing the required bandwidth for transmission and storage in many applications. Considering the region of interest, the above video coding methods based on HVS lack computing resource allocation optimization, and the additional computational complexity which was caused by visual perception analysis is neglected . The above computing resource optimizations do not distinguish the various regions according to the saliency of the visual perception This kind of algorithm ignores the differences of the perception in various video scenes that use the same coding algorithm for all encoding contents in video. The proposed method optimizes computing resource allocation more effectively by using visual perception principle and proposes an efficient hierarchical video coding algorithm based on visual perception characteristics

Visual Perception Characteristics Analysis for VPAL
Hierarchical Coding Scheme for VCL
Experimental Results and Analysis
Conclusion
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call