CTU Layer Rate Control Algorithm in Scene Change Video for Free-Viewpoint Video

Tao Yan,Yan Che,In-Ho Ra,Min-Hang Weng,Hui Wen,Qian Zhang

doi:10.1109/access.2020.2970063

Tao Yan, Yan Che + Show 4 more

Open Access

https://doi.org/10.1109/access.2020.2970063

Copy DOI

Abstract

At present, the rate control algorithm for multiview high-efficiency video coding (MV-HEVC) does not have the capability of efficient coding tree unit(CTU) layer bit allocation, and the video quality varies greatly for sequences with sudden scene changes or large motions. To overcome this limitation, this paper proposes a rate control algorithm for MV-HEVC based on scene detection. Firstly, we established ρ domain rate control model based on multi-objective optimization. Then, it uses image similarity to make reasonable bit allocation among viewpoints. If the video scene is switched, the image similarity is recalculated, and then the correlation between the weights of the interview point rates and the correlation between the viewpoints are analyzed. Finally, the frame layer rate control considers the layer B-frame and other factors in allocating the code rate, and the basic unit layer rate control adopts different quantization methods according to the content complexity of the CTU. Experimental results show that the proposed rate control algorithm can maintain good coding efficiency and decrease the average video quality variation by 25.29%.

Highlights

In a 3DTV/FTV system, multiview video coding (MVC) and decoding are common techniques regardless of the method used by the multiview acquisition section and the threedimensional (3D) stereoscopic display section
EXPERIMENTAL RESULTS To verify the proposed rate control algorithm, this section uses five different nature video sequences to simulate the CTU layer rate control algorithm based on scene detection
After analyzing the characteristics of the existing rate control and multiview video coding, a new rate control algorithm based on scene detection is presented in this paper

Summary

Introduction

In a 3DTV/FTV system, multiview video coding (MVC) and decoding are common techniques regardless of the method used by the multiview acquisition section and the threedimensional (3D) stereoscopic display section. Videos are commonly two-dimensional or unrealistic threedimensional scenes. Multiview video is a new type of video with real three-dimensional stereoscopic and viewpoint interaction functions. Users can select and examine 360-degree 3D scenes from multiple angles with the naked eye. It has become a new research interest for scholars at home and abroad [1]–[7]. Video encoding has come up with many excellent algorithms.

Objectives

Results

Conclusion