A Hybrid Dehazing Method and its Hardware Implementation for Image Sensors

Abstract

The demand for image dehazing is ever-increasing in image sensor based outdoor systems such as self-driving vehicles, automatic driver assistance, and in highway monitoring and analytics. These applications require dedicated hardware solution to meet high frame-rate and low power constraints. Previously, a few prior based hardware dehazing methods have been presented. However, they produce artifacts in the restored images due to the failure of the underlying assumptions. To address this problem and to meet the stringent requirements, a data-driven image dehazing approach based on convolutional neural network (CNN) and dark channel prior (DCP) is proposed that automatically learns the important features and produces better results. The proposed method is hardware friendly and its hardware implementation is also presented. The design employs few line buffers to store activations and eliminates the requirement of off-chip memory like dynamic random-access memory (DRAM). Field programmable gate array (FPGA) and application specific integrated circuit (AISC) implementations show that the architecture is highly suitable for application scenarios with constrained computational resources, low memory, and tight power budget. The quantitative analysis shows more than 11% average PSNR improvement in image quality on standard datasets as compared to the state-of-the-art hardware methods while consuming comparable hardware resources and power.