ウォークスルー自由視点映像伝送を効率化するテクスチャの適応的な選択方法

Abstract

This paper describes an immersive video transmission system that can provide users with a walk-through experience enabling them to feel as if they were passing through real objects. A server-client model is assumed for the transmission system configuration. Specifically, texture data and model data are generated and stored at the server in advance, and these signals are transmitted in response to the requested viewpoint. Finally, the view synthesis and the output image rendering are conducted at the client side. In the conventional scheme, the camera image is selected as the transmission content. However, this scheme requires a large number of camera images for precise reconstruction of occluded areas, and also requires a huge network bandwidth. To overcome this, we propose a new scheme in which the server stores orthogonal projection images as an alternative to texture data, and the appropriate selection from these images is realized. Our proposed scheme guarantees the successful reconstruction of so-called walk-through images under the basis of transmitting only two orthogonal projection images per object. The experimental results indicated that the proposed scheme was effective for reducing the amount of transmitted data compared to the conventional scheme, while maintaining the synthesized picture quality at an equivalent level.