EARNet: Error-Aware Reconstruction Network for no-reference image quality assessment

Abstract

Deep learning-based no-reference image quality assessment (NRIQA) methods have demonstrated advanced performance. In this paper, a deep learning-based NRIQA method with strong error-aware and content-aware capabilities is proposed, which consists of Error-Aware Reconstruction Network (EARNet) module, Content Feature Extraction Network (CFENet) module, and Subjective Quality Regression Network (SQRNet) module. We first build a database to pre-train EARNet to obtain the ability to extract error features. For content features, CFENet pre-trained on large-scale image classification tasks is adopted to extract. The pre-trained EARNet and CFENet are serially connected with SQRNet so that the features received by SQRNet are both error-aware and content-aware. Extensive experimental results show that the proposed method achieves state-of-the-art performance on many well-known IQA databases. The robustness of the proposed method is verified on the large-scale Waterloo Exploration Database (WED), and its superiority is demonstrated by the group maximum differentiated (gMAD) competition game. Furthermore, we also verify that the proposed EARNet is highly extensible, which can further improve the performance of the existing deep learning-based NRIQA method.