Automatic Image Colorization via Weighted Sparse Representation Learning

Abstract

Automatic image colorization is to generate a colorful image from a given gray image automatically. It is an ill-conditioned task and remains a challenging problem in computer vision. One main challenge in example-based image colorization is how to find the correct correspondence between the grayscale image and the reference color image. In this paper, we propose a novel automatic example-based image colorization method via weighted sparse matching. First, we segment the images into superpixels, and operates at the superpixel level rather than pixels. Then we extract intensity features and texture features for each superpixel, which are then concatenated to form its descriptor. The feature descriptors collected from the reference image composes the representation dictionary. Finally, the correspondence between target grayscale image and the colorful reference image is built by solving a weighted sparse representation learning problem, and the target superpixels are colorized based on the chrominance information from the corresponding reference superpixels. Experimental results demonstrate that our colorization method outperforms several state-of-the-art methods.