Reduced-reference Quality Metric Research Articles

Reduced-Reference Quality Assessment of Point Clouds via Content-Oriented Saliency Projection

Many dense 3D point clouds have been exploited to represent visual objects instead of traditional images or videos. To evaluate the perceptual quality of various point clouds, in this letter, we propose a novel and efficient Reduced-Reference quality metric for point clouds, which is based on Content-oriented sAliency Projection (RR-CAP). Specifically, we make the first attempt to simplify reference and distorted point clouds into projected saliency maps with a downsampling operation. Through this process, we tackle the issue of transmitting large-volume original point clouds to user-ends for quality assessment. Then, motivated by the characteristics of the human visual system (HVS), the objective quality scores of distorted point clouds are produced by combining content-oriented similarity and statistical correlation measurements. Finally, extensive experiments are conducted on SJTU-PCQA and WPC databases. The experimental results demonstrate that our proposed algorithm outperforms existing reduced-reference and no-reference quality metrics, and significantly reduces the performance gap between state-of-the-art full-reference quality assessment methods. In addition, we show the performance variation of each proposed technical component by ablation tests.

Multi-Channel Decomposition in Tandem With Free-Energy Principle for Reduced-Reference Image Quality Assessment

The visual quality of perceptions is highly correlated with the mechanisms of the human brain and visual system. Recently, the free-energy principle, which has been widely researched in brain theory and neuroscience, is introduced to quantize the perception, action, and learning in human brain. In the field of image quality assessment (IQA), on one hand, the free-energy principle can resort to the internal generative model to simulate the visual stimulus of the human beings. On the other hand, abundant psychological and neurobiological studies reveal that different frequency and orientation components of one visual stimulus arouse different neurons in the striate cortex, and the striate cortex processes visual information in the cerebral cortex. Motivated by these two aspects, a novel reduce-reference IQA metric called the multi-channel free-energy based reduced-reference quality metric is proposed in this paper. First, a two-level discrete Haar wavelet transform is used to decompose the input reference and distorted images. Next, to simulate the generative model in the human brain, the sparse representation is leveraged to extract the free-energy-based features in subband images. Finally, the overall quality metric is obtained through the support vector regressor. Extensive experimental comparisons on four benchmark image quality databases (LIVE, CSIQ, TID2008, and TID2013) demonstrate that the proposed method is highly competitive with the representative reduced-reference and classical full-reference models.

Edge Dissimilarity Reduced-Reference Quality Metric with Low Overhead Bitrate

In multimedia transmission, it is important to rely on an objective quality metric which accurately represents the subjective quality of processed images and video sequences. Reduced-reference metrics make use of side-information that is transmitted to the receiver for estimating the quality of the received sequence with low complexity. In this paper, an Edge-based Dissimilarity Reduced-Reference video quality metric with low overhead bitrate is proposed. The metric is evaluated by finding the dissimilarity between the edge information of original and distorted sequences. The edge degradation can be detected in this manner as perceived video quality is highly associated with edge structural. Due to the high overhead using the Soergel distance, it is pertinent to find a way to reduce the overhead while maintaining the edge information that can convey the quality measure of the sequences. The effects of different edge detection operator, video resolution and file compressor are investigated. The aim of this paper is to significantly reduce the bitrate required in order to transmit the side information overhead as the reduced reference video quality metric. From the results obtained, the side information extracted using Sobel edge detector maintained consistency throughout the reduction of spatial and temporal down-sample.

Edge Dissimilarity Reduced-Reference Quality Metric with Low Overhead Bitrate

In multimedia transmission, it is important to rely on an objective quality metric which accurately represents the subjective quality of processed images and video sequences. Reduced-reference metrics make use of side-information that is transmitted to the receiver for estimating the quality of the received sequence with low complexity. In this paper, an Edge-based Dissimilarity Reduced-Reference video quality metric with low overhead bitrate is proposed. The metric is evaluated by finding the dissimilarity between the edge information of original and distorted sequences. The edge degradation can be detected in this manner as perceived video quality is highly associated with edge structural. Due to the high overhead using the Soergel distance, it is pertinent to find a way to reduce the overhead while maintaining the edge information that can convey the quality measure of the sequences. The effects of different edge detection operator, video resolution and file compressor are investigated. The aim of this paper is to significantly reduce the bitrate required in order to transmit the side information overhead as the reduced reference video quality metric. From the results obtained, the side information extracted using Sobel edge detector maintained consistency throughout the reduction of spatial and temporal down-sample.

Reduced-reference quality assessment of DIBR-synthesized images based on multi-scale edge intensity similarity

Depth-image-based-rendering (DIBR) plays an important role in view synthesis for free-viewpoint videos. The warping process in DIBR causes geometric displacement, which distributes intensively around edges, and the subsequent rendering process results in the impairment of edges. Traditional 2D image quality metrics are limited in the quality evaluation of DIBR-synthesized images. In this paper, we present a reduced-reference quality metric for DIBR-synthesized images by only extracting several feature values, namely multi-scale Edge Intensity Similarity (EIS). The original and synthesized images are first downsampled to generate images with different resolutions. Then an edge detection process is conducted on each scale and the edge intensity is calculated. The similarity of the edge intensity between each downsampled original image and the corresponding synthesized image is computed. Finally, the average similarity is calculated as the quality score of the DIBR-synthesized image. Experiments conducted on IRCCyN/IVC DIBR image and video databases demonstrate that the proposed method overall outperforms traditional 2D and existing DIBR-targeted quality metrics.

Reduced Reference Quality Metric for Synthesized Virtual Views in 3DTV

Multi-view video plus depth (MVD) has been widely used owing to its effectiveness in three-dimensional data representation. Using MVD, color videos with only a limited number of real viewpoints are compressed and transmitted along with captured or estimated depth videos. Because the synthesized views are generated from decoded real views, their original reference views do not exist at either the transmitter or receiver. Therefore, it is challenging to define an efficient metric to evaluate the quality of synthesized images. We propose a novel metric—the reduced-reference quality metric. First, the effects of depth distortion on the quality of synthesized images are analyzed. We then employ the high correlation between the local depth distortions and local color characteristics of the decoded depth and color images, respectively, to achieve an efficient depth quality metric for each real view. Finally, the objective quality metric of the synthesized views is obtained by combining all the depth quality metrics obtained from the decoded real views. The experimental results show that the proposed quality metric correlates very well with full reference image and video quality metrics.

Reorganized DCT-based image representation for reduced reference stereoscopic image quality assessment

In this paper, a novel reduced reference (RR) stereoscopic image quality assessment (SIQA) is proposed by characterizing the statistical properties of the stereoscopic image in the reorganized discrete cosine transform (RDCT) domain. Firstly, the difference image between the left and right view images is computed. Afterwards, the left and right view images, as well as the difference image, are decomposed by block-based discrete cosine transform (DCT). The DCT coefficients are further reorganized into a three-level coefficient tree, resulting in ten RDCT subbands. For each RDCT subband, the statistical property of the coefficient distribution is modeled by the generalized Gaussian density (GGD) function. And the mutual information (MI) and energy distribution ratio (EDR) are employed to depict the statistical properties across different RDCT subbands. Moreover, EDR can further model the mutual masking property of the human visual system (HVS). By considering the GGD modeling behavior within each RDCT subband and MI together EDR characterizing behavior across RDCT subbands, the statistical properties of the stereoscopic image are fully exploited, including the left view, right view, and the difference image. Experimental results demonstrated that the statistical properties of the difference image can well represent the perceptual quality of the stereoscopic image, which outperforms the representative RR quality metrics for stereoscopic image and even some full reference (FR) quality metrics. By considering the left view, right view, and difference image together, the performances of the proposed RR SIQA can be further improved, which presenting a more closely relationship between the quality metric output and human visual perception.

Edge-Based Reduced-Reference Quality Metric for 3-D Video Compression and Transmission

3-D video applications are delivered over a range of different transmission systems. In order to provide demanding customers with a better service over unreliable communication channels, compression and transmission system parameters can be changed “on the fly.” For interactive 3-D video services, video compression can be adapted (e.g., it can be made more robust and/or rate adaptive) based on the quality measured at the receiver. It has been shown that measuring the (3-D) video quality at the receiver-side, and using this information as a feedback to fine tune the system parameters, will result in improved performance in such systems. However, measuring 3-D video quality using Full-Reference (FR) quality metrics is not feasible due to the need of the original 3-D video sequence at the receiver-side for comparison. Therefore, this paper proposes a Reduced-Reference (RR) quality metric for color plus depth 3-D video compression and transmission, using the extracted edge information of color plus depth map 3-D video. This work is motivated by the fact that the edges/contours of the depth map can represent different depth levels and this can be considered for measuring structural degradations. Since depth map boundaries are also coincident with the corresponding color image object boundaries, edge information of the color image and of the depth map is compared to obtain a quality index (structural degradation) for the corresponding color image sequence. The performance of the method is evaluated for different compression ratios and network conditions. The proposed method achieves good results compared to its counterpart FR quality metric, with a lower overhead for side-information.