Image super-resolution by textural context constrained visual vocabulary

Abstract

Example-based super-resolution (SR) approach hallucinates the missing high-resolution (HR) details by learning the example image patches. This approach implicitly assumes that the similarity of the low-resolution (LR) patches can infer the similarity of the corresponding HR patches. However, this similarity preserving assumption may not be held in practice. Thus the example-based super-resolved image inevitably contains artifacts not close to the ground truth. In this paper, we propose a novel single-image SR method by integrating an enforced similarity preserving process by using visual vocabulary into example-based SR approach. By jointly learning the HR and LR visual vocabularies, we can obtain a geometric co-occurrence prior to make the geometric similarity preserved within each visual word. We further propose a two-step framework for SR. The first step estimates the optimum visual word using textural context cue while the second step enforces the visual word subspace constraint and reconstruction constraint for estimating the final result. Experiments demonstrate the effectiveness of our method for recovering the missing HR details, especially texture.