Abstract

Light field imaging based on a single-tier camera equipped with a micro-lens array has currently risen up as a practical and prospective approach for future visual applications and services. However, successfully deploying actual light field imaging applications and services will require identifying adequate coding solutions to efficiently handle the massive amount of data involved in these systems. In this context, this chapter presents some of the most recent light field image coding solutions that have been investigated. After a brief review of the current state of the art in image coding formats for light field photography, an experimental study of the rate-distortion performance for different coding formats and architectures is presented. Then, aiming at enabling faster deployment of light field applications and services in the consumer market, a scalable light field coding solution that provides backward compatibility with legacy display devices (e.g., 2D, 3D stereo, and 3D multiview) is also presented. Furthermore, a light field coding scheme based on a sparse set of microimages and the associated blockwise disparity is also presented. This coding scheme is scalable with three layers such that the rendering can be performed with the sparse micro-image set, the reconstructed light field image, and the decoded light field image.

Highlights

  • Light field imaging based on a single-tier camera equipped with a microlens array has currently risen up as a practical and prospective approach for future visual applications and services

  • Light field imaging based on a single-tier camera equipped with a microlens array (MLA) – referred to as Light Field (LF) in this chapter – has currently risen up as a practical and prospective approach for future visual applications and services

  • The results show that, by exploiting redundancies in the spatial and view angle domain, the High Efficiency Video Coding (HEVC) encoding tools are more efficient than JPEG exploiting only spatial redundancies in the whole LF image

Read more

Summary

Introduction

Light field imaging based on a single-tier camera equipped with a microlens array (MLA) – referred to as Light Field (LF) in this chapter – has currently risen up as a practical and prospective approach for future visual applications and services. Successfully deploying actual LF imaging applications and services will require identifying adequate coding solutions to efficiently handle the massive amount of data involved in these systems. In this context, this chapter overviews some relevant LF image coding solutions that have been recently proposed in the literature. This coding scheme is scalable with three layers such that the rendering can be performed with the sparse MI set, the reconstructed LF image, and the decoded LF image. It is shown that this coding scheme improves considerably the coding efficiency with respect to HEVC Intra and is slightly better than the spatial displacement compensated prediction with multiple hypotheses

Light Field Image Representation
Light Field Image Coding Formats
Light field image coding using HEVC
12 SkinSpots
Coding efficiency
45 SpiSraplirRaal nLdoowm-D-AeclacyesPs
Scalable Light Field Coding for Backward Display Compatibility
Display Scalable Coding Architecture
Hierarchical Content Generation
Efficient LF Enhancement Layer Coding Solution
Self-Similarity (SS) Prediction
Inter-Layer (IL) Prediction
Patch Remapping
Patches
MI Refilling
Intra Prediction
Header Formatting & CABAC
Performance Assessment
Overall DS-LFC RD Performance
Quality of Rendered Views
Sparse Set of Micro-Lens Images and Disparities for an Efficient Scalable Coding of Light Field Images
Scalability
Displacement Intra and Inter Prediction Scheme
Sparse set of micro-lens images
Disparity maps
Refinement by inter and intra prediction
Decoding and Reconstruction
Evaluation
Remarks
Conclusions
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call