A Fast and Efficient 3D-HEVC Method for Complexity Reduction Based on the Correlations of Inter-View, Spatio-Temporal, and Texture-Depth

Qiuwen Zhang,Yihan Wang,Tao Wei,Rijian Su,Lixun Huang

doi:10.1109/access.2020.3009424

Abstract

3D High Efficiency Video Coding (3D-HEVC) is the latest High Efficiency Video Coding (HEVC) standard development to improve the compression performance of multi-view video plus depth (MVD) format. It adopts several additional coding tools for better representation of the dependent texture and depth data. These tools achieve high compression efficiency, but require high computational complexity. In this paper, we introduce a fast 3D-HEVC method for the complexity reduction of MVD. A simulation analysis is performed to study the coding information correlations of inter-view, spatio-temporal and texture-depth. The proposed fast algorithm decides to skip some treeblocks of texture and depth map at the early stage without a normal coding process, which includes fast depth level, early SKIP/Merge mode, adaptive early termination, based on the correlations of inter-view, spatio-temporal, and texture-depth. Experimental results show that the proposed fast scheme can save 70.2% encoding runtime of 3D-HEVC, with negligible loss of rate-distortion (RD) performance.

Highlights

3D video is getting more and more popular due to the recent advances in stereoscopic display technologies and related applications, such as 3D television (3DTV), 3D film and 3D game
The main contributions of the proposed method are as follows: (1) unlike the formerly fast coding unit (CU) depth decision, fast CU depth level range determination makes decision based on a motion complexity parameter, which is defined according to the correlations of motion information among spatial-temporal neighboring treeblocks, and between previously coded view and texture-depth; (2) early SKIP and Merge mode detection reduces unnecessary prediction modes according to the mode context of inter-view, spatio-temporal and texture and depth video neighboring treeblocks; (3) adaptive early termination mode prediction uses the RD cost correlations between the coding information of inter-view, spatio-temporal, texturedepth neighboring CUs, and the previously coded treeblocks to exploit the adaptive threshold for fast coding
PROCEDURE OF THE PROPOSED OVERALL METHOD Based on strategies of fast CU depth level, early SKIP and Merge mode detection and adaptive early termination mode prediction, the proposed fast 3D High Efficiency Video Coding (3D-High Efficiency Video Coding (HEVC)) method is described as follows: Step 1) Start mode decision for a treeblock

Summary

Introduction

Adaptive DE and fast mode size decision are developed in our former work [13] by utilizing the correlation of texture image and depth map to achieve the complexity reduction of MVD. A fast texture video mode decision method based on the depth information is investigated in [36], which can achieve the computational complexity reduction of 3D-HEVC.

Results

Conclusion