Stereoscopic images quality assessment based on deep learning

Abstract

With the popularity of stereoscopic 3D (S3D) images and videos, many advanced objective quality assessment methods have been proposed to evaluate viewers' Quality of Experience (QoE). Among them, most algorithms take advantages of the disparity maps to extract useful features. On the other hand, deep learning has been one of the hottest research topics during these years, but limited efforts focused on the field in objective quality evaluation of S3D images. In this paper, we propose a S3D image quality assessment (S3D IQA) method based on deep learning. In this method, the Convolutional Restricted Boltzmann Machines (CRBM) combined with Factored Third-Order RBM (FTO-RBM) is considered as learning model to extract feature maps from pre-processed left and right images automatically. Then an improved traversal algorithm based on two pooling strategies is put forward to optimize extracted feature maps, which improves the final quality assessment performance significantly. Experimental results show that our S3D IQA method achieves good performance on 3D databases tested.