LIVE 3D Image Quality Database Research Articles

Blind Stereoscopic Image Quality Assessment Based on Hierarchical Learning

We proposed a blind image quality assessment model which used classification and prediction for three-dimensional (3D) image quality assessment (denoted as CAP-3DIQA) that can automatically evaluate the quality of stereoscopic images. First, in the classification stage, the model separated the distorted images into several subsets according to the types of image distortions. This process will assign the images with the same distortion type to the same group. After the classification stage, the classified distorted image set is fed into the image quality predictor that contains five different perceptual channels which predict the image quality score individually. Finally, we used the regression module of the support vector machine to evaluate the final image quality score, where the input of the regression model is the combination of five channel’s outputs. The model, we proposed is tested on three public and popular databases, which are LIVE 3D Image Quality Database Phase I, LIVE 3D Image Quality Database Phase II, and MCL 3D Image Quality Database. The experimental results show that our proposed model leads to significant performance improvement on quality prediction for stereoscopic images compared with other existing state-of-the-art quality metrics.

Bivariate analysis of 3D structure for stereoscopic image quality assessment

Human visual system (HVS) identifies each unit of stereo-pair into binocular or monocular perception depending on distortions and depth perception. However, these HVS properties still have a large room for exploration in stereoscopic image quality assessment (SIQA) research field. In this paper, a bivariate natural scene statistics (NSS) model is proposed to capture image quality by extracting features from binocular and monocular perception regions, respectively. In the implementation details, the stereo-pair is first segmented into various regions based on spatial information of its disparity. Then the regions are classified into categories of binocular fusion, binocular rivalry and binocular suppression. Bivariate statistics of spatially adjacent Gabor response of image are extracted from each category of regions, based on which features are calculated for image quality representation. In particular, the extraction strategy depends on the type of image patch. Experimental results show that the proposed model is promising at handling the task of SIQA on LIVE 3D Image Quality Database.

Binocular spatial activity and reverse saliency driven no-reference stereopair quality assessment

We develop a new model for no-reference 3D stereopair quality assessment that considers the impact of binocular fusion, rivalry, suppression, and a reverse saliency effect on the perception of distortion. The resulting framework, dubbed the S3D INtegrated Quality (SINQ) Predictor, first fuses the left and right views of a stereopair into a single synthesized cyclopean image using a novel modification of an existing binocular perceptual model. Specifically, the left and right views of a stereopair are fused using a measure of “cyclopean” spatial activity. A simple product estimate is also calculated as the correlation between left and right disparity-corrected corresponding binocular pixels. Univariate and bivariate statistical features are extracted from the four available image sources: the left view, the right view, the synthesized “cyclopean” spatial activity image, and the binocular product image. Based on recent evidence regarding the placement of 3D fixation by subjects viewing stereoscopic 3D (S3D) content, we also deploy a reverse saliency weighting on the normalized “cyclopean” spatial activity image. Both one- and two-stage frameworks are then used to map the feature vectors to predicted quality scores. SINQ is thoroughly evaluated on the LIVE 3D image quality database (Phase I and Phase II). The experimental results show that SINQ delivers better performance than state of the art 2D and 3D quality assessment methods on six public databases, especially on asymmetric distortions.

No-reference stereo image quality assessment based on joint wavelet decomposition and statistical models

The widespread use of 3D acquisition and display technologies has increased the interest of stereo image dataset in various application fields. As a result, it becomes necessary to have an efficient 3D quality assessment method to measure the human perception of stereoscopic images. While most of the state-of-the-art methods belong to the class of full-reference methods which require the original stereo images to be able to assess the quality, we propose in this paper a no-reference quality metric which does not require any information of the original stereo images. The proposed method operates in the wavelet transform domain and adopts a statistical framework to predict the quality of stereo images. More precisely, a joint wavelet decomposition is first performed on the stereo images to exploit simultaneously the intra and inter-views redundancies. A wavelet transform is also applied to their associated estimated disparity maps. Then, relevant features are extracted from the resulting wavelet subbands by resorting to appropriate statistical models. Simulations, carried out on the standard Live 3D image quality database, show that our proposed design model achieves significant improvement compared to the state-of-the-art 3D quality assessment methods.

No-Reference Quality Assessment of Natural Stereopairs

We develop a no-reference binocular image quality assessment model that operates on static stereoscopic images. The model deploys 2D and 3D features extracted from stereopairs to assess the perceptual quality they present when viewed stereoscopically. Both symmetric- and asymmetric-distorted stereopairs are handled by accounting for binocular rivalry using a classic linear rivalry model. The NSS features are used to train a support vector machine model to predict the quality of a tested stereopair. The model is tested on the LIVE 3D Image Quality Database, which includes both symmetric- and asymmetric-distorted stereoscopic 3D images. The experimental results show that our proposed model significantly outperforms the conventional 2D full-reference QA algorithms applied to stereopairs, as well as the 3D full-reference IQA algorithms on asymmetrically distorted stereopairs.