Optimizing rate allocation between multiview videos and associated depth maps with quantization-based virtual view distortion model and genetic algorithm

Abstract

In three-dimensional video coding (3-DVC), it is reasonable to allocate different coding bits for multiview videos and associated depth maps because of their different characteristics to meet the bits’ restraints of bandwidth/storage. We first propose a virtual view average distortion model. Then, based on the quantization parameter (QP), the average distortion-QP models and sum bitrate-QP models are proposed to depict the average distortions and sum bitrates of the referenced views for multiview videos and depth maps. Finally, the 3-DVC bit allocation problem is converted as a constrained optimization problem, which is solved by a genetic algorithm to search for the optimal QP pair. Experimental results demonstrate the effectiveness of our proposed models. Since the bit allocation scheme takes the performance of synthesized view and bitrate utilization into consideration, the absolute difference between the constraint and the actual coding bitrates (referred to as “rate inaccuracy”) of the proposed method is only 7.405% on average, which greatly outperforms the fixed 5 ∶ 1 ratio-based method with a rate inaccuracy of 19.103% and the planar model-based method with a rate inaccuracy of 20.556%. Compared with these two methods, our proposed method can achieve a maximum 1.951-dB gain under the same bitrates constraint.