A User Dependent System for Multi-view Video Transmission

Abstract

Multi-view video consists of multiple views which are taken by multiple cameras from different positions and angles. It allows the users to freely change their viewpoints. Typical applications of multi-view video include Free Viewpoint TV, remote medical surgery, wireless multimedia sensor networks and so on. However, the traffic of multi-view video is also several times larger than traditional multimedia, which brings much more increment in the bandwidth requirement. To overcome this problem, Simulcast and MVC (Multi-view Video Coding) can be used to decrease the traffic for multi-view video. However, although Simulcast removes redundant information within each view, it still contains a large amount of inter-view redundant information. MVC further removes the correlation between the views, but all the views should be encoded and transmitted. So the bit-rates are still too high in these schemes. In this paper, in order to reduce the bit-rate for multi-view video transmission, we analyze the user's motion which is classified into random access model and successive motion model. We find that in the successive motion model only part of frames are possible to be displayed in a period of time. According to the analytical result, we propose a user dependent system to decrease the bit-rate of multi-view video transmission. The proposed system only encodes and transmits those frames that are possible to be displayed according to the user's motion. Further, in order to support the proposed system, we also propose a prediction structure as a substitute of the prediction structure in MVC. Performance evaluation proves that the proposed system reduces the average bit-rate for the transmission of multi-view video and is to be more effective when the number of views is large.