Learning super resolution with global and local constraints

Abstract

In learning based single image super-resolution (SR) approach, the super-resolved image are usually found or combined from training database through patch matching. But because the representation ability of small patch is limited, it is difficult to guarantee that the super-resolved image is best under global view. To tackle this problem, we propose a statistical learning method for SR with both global and local constraints. Firstly, we use maximum a posteriori (MAP) estimation with learned image priors by fields of experts (FoE) model, and regularize SR globally guided by the image priors. Secondly, for each overlapped patch, the higher-order Markov random fields (MRFs) is used to model its local relationship with corresponding high-resolution candidates, then belief propagation is used to find high-resolution image. Compared with traditional patch based learning method without global constraint, our method could not only preserve the global image structure, but also restore the local details well. Experiments verify the idea of our global and local constraint SR method.