Degradation model and attention guided distillation approach for low resolution face recognition

Abstract

Deep convolution neural networks (CNN) have shown their efficacy in face recognition tasks due to their ability to extract highly discriminant face representations from face images. On high-resolution benchmark datasets, outstanding identification and verification results have been achieved. However, the performance of these algorithms is significantly degraded when tested on low-resolution (LR) images such as those captured from surveillance cameras. A straightforward solution to this problem is to use both high-resolution (HR) images and corresponding down-sampled LR images during training. Although this strategy improves the performance for LR images, it has some limitations. First, there is a significant difference between down-sampled LR images and LR images from surveillance cameras, leading to performance saturation at an earlier stage. Another limitation is the deterioration in the performance of HR images. In this work, solutions to both these limitations are proposed. A degradation model is proposed that synthesizes LR images from corresponding HR, emulating the real-world degradation effects in synthetic data, thus enabling the face recognition system to tolerate various blurry and noisy effects. To address the deterioration in the performance of HR images, an attention-guided distillation is proposed, which utilizes attention maps from convolutional layers in combination with deep features to transfer informative HR features from teacher to student network. The attention maps from the teacher network guide the student network to a better optimum and produce resolution robust face representations. The results of the proposed approach on the popular LR datasets like SCface, Coxface, and PaSC show that it outperforms the recent state-of-the-art (SOTA) techniques by a significant margin demonstrating its effectiveness for different cross-resolution scenarios.