Contourlet Transform based Multi-scale Fusion Network for Face Hallucination

Abstract

Recently, Convolutional neural network (CNN) has achieved great success in the field of face hallucination. However, such approaches usually generate blurry and over-smoothed Super Resolution (SR) results, and the performance suffers from degradation when super-resolve a very Low Resolution (LR) face image. To solve these problems, this paper proposes an contourlet transform based accurate CNN architecture, namely Multi-scale Fusion CNN (MSFC), which are able to reconstruct a High Resolution (HR) face image from a very low resolution input. First of all, we present multi-scale fusion CNN (MSFC) to fully detect and exploit features from LR inputs. And then, we formulate the SR problem as the prediction of contourlet transform coefficients, which is able to make MSFC further capture the texture details for super-resolve face images. Extensive qualitative and quantitative experiments show that the proposed method is capable of preserving details and achieves superior SR performance compared to the state-of-the-art methods.