An Adaptive Error Concealment Method for Depth Map in 3D Video Coding

Abstract

Stereoscopic images and video are synthesized from virtual views, which are produced from a real view and its depth map. However, this process involves a large amount of data which not only increases the transmission load, but also must be stored within the display devices which therefore must possess huge storage capacities. To solve these problems, the Joint Video Team has developed the 3D video coding (3DVC) standard to reduce the redundant data for multiview video and its depth map through the correlation between the real view and its corresponding depth map. When depth data in the 3DVC bitstream are lost during transmission, it causes the decoded depth map to be incomplete. Then the quality of the decoded depth map is reduced and the quality of the stereoscopic video will also be decreased. To increase the reconstructed quality of the damaged macro-block, this paper proposes an adaptive error concealment selection to determine the most suitable error concealment method based on fuzzy reasoning. The temporal and spatial correlations of the damaged macro-block which are defined by the motion vectors of neighboring blocks and their depth information are used for the adaptive selection. From the simulation result, the proposed algorithm can reduce the concealing time by at least 0.15–2.86 frame/sec and can improve quality by about 0.13–0.17 dB. The proposed algorithm is suitable for the 3DVC video transmission.