Abstract
Holoscopic imaging, also known as integral, light field, and plenoptic imaging, is an appealing technology for glassless 3D video systems, which has recently emerged as a prospective candidate for future image and video applications, such as 3D television. However, to successfully introduce 3D holoscopic video applications into the market, adequate coding tools that can efficiently handle 3D holoscopic video are necessary. In this context, this paper discusses the requirements and challenges for 3D holoscopic video coding, and presents an efficient 3D holoscopic coding scheme based on High Efficiency Video Coding (HEVC). The proposed 3D holoscopic codec makes use of the self-similarity (SS) compensated prediction concept to efficiently explore the inherent correlation of the 3D holoscopic content in Intra- and Inter-coded frames, as well as a novel vector prediction scheme to take advantage of the peculiar characteristics of the SS prediction data. Extensive experiments were conducted, and have shown that the proposed solution is able to outperform HEVC as well as other coding solutions proposed in the literature. Moreover, a consistently better performance is also observed for a set of different quality metrics proposed in the literature for 3D holoscopic content, as well as for the visual quality of views synthesized from decompressed 3D holoscopic content.
Highlights
Three dimensional (3D) video technologies are continuously maturing to provide more immersive visual experiences to the end-users
In Intra-coded frames, an optimal prediction for each SS vector is computed for each prediction units (PU) partition, in RD optimization (RDO) sense, using a scheme derived from the High Efficiency Video Coding (HEVC) Advanced Motion Vector Prediction (AVMP) [9], but considering only the vector candidates from spatially neighboring coding block (CB)
X Results for different coding schemes: Comparing the performance for solutions based on the micro-image arrangement (i.e., HEVC, 3DHolo, HEVC RExt 6.0, HEVC SCC 1.0), in Fig. 12 and Table 2, it is possible to conclude that coding solutions that somehow exploit the inherent correlation of the 3D holoscopic content (i.e., 3DHolo, HEVC RExt 6.0, HEVC SCC 1.0) lead to a better RD performance compared to the conventional HEVC
Summary
Three dimensional (3D) video technologies are continuously maturing to provide more immersive visual experiences to the end-users. In [10], the authors have already presented preliminary results that show that further performance improvements relatively to HEVC can be reached for 3D holoscopic image coding. This is possible by making use of a self-similarity (SS) compensated prediction. While addressing the aforementioned challenges, this paper proposes an efficient 3D holoscopic codec for Intra and Inter coding based on HEVC.
Sign-in/Register to view highlights & summary Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
