Abstract

Accurately assessing image quality is a challenging task, especially without a reference image. Currently, most of the no-reference image quality assessment methods still require reference images in the training stage, but reference images are usually not available in real scenes. In this paper, we proposed a model named MSIQA inspired by biological vision and a convolution neural network (CNN), which does not require reference images in the training and testing phases. The model contains two modules, a multi-scale contour prediction network that simulates the contour response of the human optic nerve to images at different distances, and a central attention peripheral inhibition module inspired by the receptive field mechanism of retinal ganglion cells. There are two steps in the training stage. In the first step, the multi-scale contour prediction network learns to predict the contour features of images in different scales, and in the second step, the model combines the central attention peripheral inhibition module to learn to predict the quality score of the image. In the experiments, our method has achieved excellent performance. The Pearson linear correlation coefficient of the MSIQA model test on the LIVE database reached 0.988.

Highlights

  • Image is an important source of information for human perception and machine recognition [1–3]

  • Inspired by the biological vision, we simulated the mechanism of the biological optic nerve and receptive field, and proposed a two-stage training method that does not require reference images

  • The current NR-image quality assessment (IQA) methods based on convolutional neural network (CNN) are divided into image-based and patch-based according to the input image [25]

Read more

Summary

Introduction

Image is an important source of information for human perception and machine recognition [1–3]. The former relies on the subjective perception of experimenters to evaluate the quality of the object The latter simulates the perception mechanism of the human visual system based on the quantitative indicators given by the model. The FR-IQA [7–10] method requires a distortion-free reference image and compares the information or feature similarity of two images to obtain the evaluation result of the distorted image. Inspired by the biological vision, we simulated the mechanism of the biological optic nerve and receptive field, and proposed a two-stage training method that does not require reference images. This was tested on the LIVE [23] data set and TID2013 [24] data set.

Related Work
Approach
Model Architecture
Multi-Scale Contour Features
Quality Score Prediction
Training
Multi-Task Model
Database and Evaluation
Convergence Test
Effect of Patch Size
Performances Comparison
Multi-Task Model Test
Findings
Conclusions
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call