Abstract

The rising demand for high quality display has ensued active research in high dynamic range (HDR) imaging, which has the potential to replace the standard dynamic range imaging. This is due to HDR's features like accurate reproducibility of a scene with its entire spectrum of visible lighting and color depth. But this capability comes with expensive capture, display, storage and distribution resource requirements. Also, display of HDR images/video content on an ordinary display device with limited dynamic range requires some form of adaptation. Many adaptation algorithms, widely known as tone mapping operators, have been studied and proposed in the last few decades. In this state of the art report, we present a comprehensive survey of 50+ tone mapping algorithms that have been implemented on hardware for acceleration and real-time performance. These algorithms have been adapted or redesigned to make them hardware-friendly. All real-time application poses strict timing constraints which requires time exact processing of the algorithm. This design challenge require novel solution, and in this report we focus on these issues. In this we survey will discuss those tonemap algorithms which have been implemented on GPU [1-10], FPGA [11-41], and ASIC [42-53] in terms of their hardware specifications and performance. Output image quality is an important metric for tonemap algorithms. From our literature survey we found that, various objective quality metrics have been used to demonstrate the functionality of adapting the algorithm on hardware platform. We have compiled and studied all the metrics used in this survey [54-67]. Finally, in this report we demonstrate the link between hardware cost and image quality thereby illustrating the underlying trade-off which will be useful for the research community.

Highlights

  • Superior display quality is a dominant feature that has been driving the consumer electronics industry

  • Durand and Dorsey in the year 2002 demonstrated an interesting application of the bilateral edge-preserving filter (EPF) as a tone mapping (TM) operator to compress the dynamic range (DR) in high dynamic range (HDR) scenes [120]. They were inspired from an earlier work of Tumblin and Turk who proposed a low-curvature image simplifier (LCIS) based on anisotropic diffusion to decompose an image into base and detail layer [127]

  • As a future perspective we would like to leverage its potential by accelerating MLbased TM operators using HW platforms

Read more

Summary

INTRODUCTION

Superior display quality is a dominant feature that has been driving the consumer electronics industry. We have to adapt the HDR image so that we can match the DR of HDR scene with the DR of the standard display devices This process is widely known as tone mapping (TM). Global TM which can be mathematically expressed as follows: Ld(x, y) = T M (Lw(x, y)) They are easy to implement on HW as same function maps all pixels in the image. TM function have been implemented on different platforms (see Table II), and the choice is determined by the target application and specification Adams studied these technologies for real-time signal processing application and draws a comparison between them in [72]. The rest of the paper is organized as follows: Section II covers HDR imaging, and section III presents an introduction to tone mapping and a detailed survey of all HW TM algorithms.

HIGH DYNAMIC RANGE IMAGING
HDR Image Sensor
HDR Merge
TONE MAPPING ALGORITHMS AND THEIR HARDWARE
Color Conversion
Hardware tone mapping algorithms
Hardware architectures for transcendental functions
Hardware
Data Conversion for Optimal Hardware Specification
Image Quality Metrics used to measure HW TMO accuracy
Hardware Specification versus Image Quality
Video tone mapping artifacts
Design Bottlenecks
FUTURE PERSPECTIVE AND CONCLUSION
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call