Unsupervised Low-Light Image Enhancement by Extracting Structural Similarity and Color Consistency

Abstract

A novel structure-aware unsupervised network is proposed to deal with low-light image enhancement issues based on the inspiration of Retinex theory and self-supervised perceptual loss. It comprises four main components, namely the original structural similarity module, the novel color consistency module, the attentional enhancement module, and the naturalness discriminator module. Specially for the structural similarity module, an embedded structural feature extractor (SFE) model capable of generating structure correspondence is well designed and pre-trained by employing the contrastive learning technique, and a multi-scale structural similarity distance is introduced to optimize the SFE network. Besides, a self-supervised color consistency module is established by using a degraded estimation algorithm for recovering the missing colors. The whole enhancement framework operates in unsupervised manners and finally obtains the best naturalness image quality evaluator metric. Experimental results demonstrate that the proposed unsupervised network is able to recover natural structure and color images more effectively, which would also help to enlarge the practical application without collecting paired datasets in advance.