Abstract

Digital cameras with a single sensor use a color filter array (CFA) that captures only one color component in each pixel. Therefore, noise and artifacts will be generated when reconstructing the color image, which reduces the resolution of the image. In this paper, we proposed an image demosaicing method based on generative adversarial network (GAN) to obtain high-quality color images. The proposed network does not need any initial interpolation process in the data preparation phase, which can greatly reduce the computational complexity. The generator of the GAN is designed using the U-net to directly generate the demosaicing images. The dense residual network is used for the discriminator to improve the discriminant ability of the network. We compared the proposed method with several interpolation-based algorithms and the DnCNN. Results from the comparative experiments proved that the proposed method can more effectively eliminate the image artifacts and can better recover the color image.

Highlights

  • Images are widely used in people’s daily life

  • Numerical experiments showed that the proposed algorithm can effectively reduce the artifacts at the edges and produce near-real reconstructed images, which can be the basis for subsequent image processing, such as image recognition and image transmission. e proposed method can produce better recovered color images; the learning-based strategy is relatively time-consuming in the data training phase. erefore, how to improve the efficiency of the network training is an important aspect to further enhance the performance of the learning-based technology

  • We proposed an image demosaicing method based on generative adversarial network (GAN). e generator is designed by using the improved U-net architecture to directly generate the demosaicing images

Read more

Summary

Introduction

Images are widely used in people’s daily life. Compared to analog images, digital images are more superior in their higher resolution and easier storage, and they are more suitable for computer processing. As only one color component is captured for each pixel in the CFA, without image demosaicing, the CFA image can only reflect the general outline of the scenery instead of the complete color information, which affects subsequent image processing [8]. (1) We proposed a CFA image demosaicing method based on GAN (2) We carefully designed each part for the GAN model (3) We introduced long jump connections for the improved U-net [20] model to design the generator (4) We used the dense residual network, which includes dense residual blocks with long jump links and dense connections for the discriminator (5) We combined the adversarial loss, the feature loss, and the pixel loss together to further strengthen the network performance. E results prove that the proposed method can more effectively remove artifacts and recover the full-color image, especially for some high-frequency areas such as edges and angles We show the performance of our method using some comparative experiments. e results prove that the proposed method can more effectively remove artifacts and recover the full-color image, especially for some high-frequency areas such as edges and angles

Related Works
Problem Formulation
The Proposed Method
D Discriminator
Experiments
Discussion
Conclusions

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.