Optimal mode selection and channel coding for 3-D video streaming over the internet

Abstract

This paper addresses the problem of joint source and channel coding for 3-D video coding and transmission. Firstly, we formulate a packet-level joint texture and depth coding mode selection framework for error-resilient source coding using Lagrange multiplier. Then, we evolve to the more general formulation that jointly optimizes error-resilient source coding and channel coding for texture and depth with unequal error protection. Finally, based on the adjacent packet dependency, we derive a theoretic approach to efficiently find the optimal solution. The proposed algorithm explicitly considers the interaction between error-resilient source coding and channel coding tailored to 3-D video, and the different sensitivities of the view synthesis quality to texture distortion and depth distortion. Experimental results are presented for a wide range of packet loss rates in order to illustrate the benefit of the proposed 3-D video coding framework.