Abstract
Deep convolutional neural networks have been used extensively in recent image processing research, exhibiting drastically improved performance. In this study, we apply convolutional neural networks to color filter array demosaicking, which plays an essential role in single-sensor digital cameras. Contrary to conventional convolutional neural network-based demosaicking models, the proposed model does not require any initial interpolation step for mosaicked input images, which increases the computational complexity. Using a mosaicked image as input, the proposed model is trained in an end-to-end manner to generate demosaicked images outputs. Many deep neural networks experience vanishing-gradient problem, which makes models hard to be trained. To solve this problem, we apply residual learning and densely connected convolutional neural network. Moreover, we apply block-wise convolutional neural networks to consider local features. Finally, we apply a sub-pixel interpolation layer to generate demosaicked output images more efficiently and accurately. Experimental results show that our proposed model outperforms conventional solutions and state-of-the-art models.
Highlights
IntroductionTo obtain exact information of these components, digital cameras need three sensors, which make cameras expensive and bulky
Digital color image pixels consist of three color components: red, green, and blue
The number of green pixels in the Bayer pattern is twice that of red or blue pixels. This is because the human eye perceives spatial details from luminance information, and the luminosity function is similar to the CIE 1931 green matching function [2]
Summary
To obtain exact information of these components, digital cameras need three sensors, which make cameras expensive and bulky. The number of green pixels in the Bayer pattern is twice that of red or blue pixels. This is because the human eye perceives spatial details from luminance information, and the luminosity function is similar to the CIE 1931 green matching function [2]. As there is only information of one color per pixel in single-sensor digital cameras, information of the other two colors should be interpolated This interpolation process, referred to as demosaicking, is CFA interpolation
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have