The first two important steps in the pipeline for processing picture signals are de-noising and de-mosaicking. The joint solution of the highly uncertain inverse problem of de-noising and de-mosaicking has garnered increased attention in research today. It is difficult to restore high-quality images from raw data in low light because of a variety of disturbances brought on by a low photon count and a complex image signal processing scheme. Even if some restoration and improvement techniques have been used, they might not work in harsh situations, including raw data imaging with brief exposure. Therefore, this research focuses on developing a de-mosaicking and de-noising model with effective end to end manner outcomes. Initially, the pre-processing is conducted using Gaussian filtering to eliminate artifacts from the input image, thereby enhancing the image quality. Then, the proposed method incorporates an Enhanced Spatial Convolutional Residual Net (EnConvResNet) for image de-mosaicking and an Adaptive U-net restoration model for image de-noising. An enhanced gazelle optimization (EnGa) algorithm is used to fine-tune the hyper-parameters of the model in order to maximize its performance and improve its generalization capacity. The proposed method accomplished peak signal to noise ratio (PSNR) and structural similarity index measure (SSIM) of 46.65 and 98.89, respectively.
Read full abstract