Object-based coding of stereo image sequences using three-dimensional models

Abstract

An object-based stereo image coding algorithm is proposed. The algorithm relies on modeling of the object structure using 3-D wire-frame models and motion estimation using globally rigid and locally deformable motion models. Algorithms for the estimation of motion and structure parameters from stereo images are described. Motion parameters are used to construct predicted images by mapping the image texture on the object surface. Coding of object parameters, appearing background regions, and prediction errors are investigated, and experimental results with standard stereo image sequences depicting general scenes are presented. The proposed algorithm is seen to be very efficient for applications such as stereoscopic video transmission. Furthermore, it is especially well suited to advanced applications such as generation and transmission of intermediate views for multiview receiver systems and applications in which object-wise editing of the bit stream is required. The latter include video production using preanalyzed scenes and virtual reality applications.