Two-subnet fusion for perceptual quality driven based underwater image enhancement

Abstract

In recent years, enhancement of underwater images based on generative adversarial network (GAN) has been widely used. Aiming at the shortcoming that the texture details of the images generated by GAN are not clear enough, an underwater image pre-process unit and a generator including a perceptual subnet and a refine subnet are designed to improve visual quality of underwater images. The role of the perceptual subnet is to maintain the structure and semantic information of the input image. Refine subnet is to make the generated image clearer in the details of the texture. Specially, considering that underwater images may prevent the network from learning effectively, an underwater image pre-process unit is proposed to improve the quality of underwater images. To maintain the structure and semantic information of underwater images and preserve texture details of underwater images, the perceptual subnet and the refine subnet are proposed, respectively. Then, color-structure perception loss is proposed to obtain good performance in color and structure, and content loss and detail loss are proposed to keep content consistent and sharper texture. Ablation study verify the rationality and effectiveness of each loss function. Finally, subjective and objective experiments prove that the proposed method can obtain underwater images with higher visual quality and clearer texture details.