3D Video Quality Of Experience Research Articles

Measuring 3D Video Quality of Experience (QoE) Using A Hybrid Metric Based on Spatial Resolution and Depth Cues.

A three-dimensional (3D) video is a special video representation with an artificial stereoscopic vision effect that increases the depth perception of the viewers. The quality of a 3D video is generally measured based on the similarity to stereoscopic vision obtained with the human vision system (HVS). The reason for the usage of these high-cost and time-consuming subjective tests is due to the lack of an objective video Quality of Experience (QoE) evaluation method that models the HVS. In this paper, we propose a hybrid 3D-video QoE evaluation method based on spatial resolution associated with depth cues (i.e., motion information, blurriness, retinal-image size, and convergence). The proposed method successfully models the HVS by considering the 3D video parameters that directly affect depth perception, which is the most important element of stereoscopic vision. Experimental results show that the measurement of the 3D-video QoE by the proposed hybrid method outperforms the widely used existing methods. It is also found that the proposed method has a high correlation with the HVS. Consequently, the results suggest that the proposed hybrid method can be conveniently utilized for the 3D-video QoE evaluation, especially in real-time applications.

Automatically optimised stereoscopic camera control based on an assessment of 3D video quality of experience

Stereoscopic 3D (S3D) technologies have gained significant attention due to their wide applications. However, producing high-quality S3D content is still a challenging task that requires careful handling to achieve the artistic intent and maintain visual comfort. In this study, we present an automatically controlled stereoscopic camera controller that specifically addresses the challenges in S3D content production. The key idea that distinguishes our method from the existing work is that our method aims to predict the 3D Quality of Experience (QoE) in the production stage so that the optimised camera parameters can be obtained automatically. To this end, considering two interconstraint indicators, i.e., visual comfort and perceived depth, we collect and label a data set of S3D video scene clips and generate a 3D video QoE assessment model that can guide the optimisation of the stereoscopic camera parameters. We describe how to implement our system into a modern production pipeline that has been used in some projects, including commercial ones. The experimental results, including the user studies, demonstrate that our system enhances the perceived depth without creating visual fatigue and that our controller can make the production of S3D content easier and more efficient.

Automatically optimised stereoscopic camera control based on an assessment of 3D video quality of experience

Stereoscopic 3D (S3D) technologies have gained significant attention due to their wide applications. However, producing high-quality S3D content is still a challenging task that requires careful handling to achieve the artistic intent and maintain visual comfort. In this study, we present an automatically controlled stereoscopic camera controller that specifically addresses the challenges in S3D content production. The key idea that distinguishes our method from the existing work is that our method aims to predict the 3D Quality of Experience (QoE) in the production stage so that the optimised camera parameters can be obtained automatically. To this end, considering two interconstraint indicators, i.e., visual comfort and perceived depth, we collect and label a data set of S3D video scene clips and generate a 3D video QoE assessment model that can guide the optimisation of the stereoscopic camera parameters. We describe how to implement our system into a modern production pipeline that has been used in some projects, including commercial ones. The experimental results, including the user studies, demonstrate that our system enhances the perceived depth without creating visual fatigue and that our controller can make the production of S3D content easier and more efficient.

A novel depth perception prediction metric for advanced multimedia applications

Ubiquitous multimedia applications diffuse our everyday life activities which appreciate their significance about improving our experiences. Therefore, proliferation of the multimedia applications enhancing these experiences needs critical attention of the researchers. Considering this motivation, to overcome the possible barrier of the proliferation of the 3D video-related multimedia applications providing enhanced quality of experience (QoE) to the end users, an objective metric is proposed in this study. The proposed metric tackles the depth perception prediction part reflecting the most important aspect of the 3D video QoE from the user point of view. Considering that the no reference metric type is the most effective one compared to its counterparts, the proposed metric is developed based on this type. In the light of the envision that human visual system-related cues have critical importance on developing accurate metrics, the focus of the proposed metric is directed on the association of the z-direction motion and stereopsis depth cues in the metric development. These cues are derived from the depth map contents having stressed significant depth levels. In addition, the analysis results of the conducted subjective experiments which are currently the “gold standards” for the reliable depth perception prediction are incorporated with the proposed metric. Considering the effective correlation coefficient and root mean square error performance assessment results taken using the proposed metric in comparison to the widely exploited quality assessment metrics in literature, it can be clearly stated that the development of the improved 3D video multimedia applications can be accelerated using it.

A no reference depth perception assessment metric for 3D video

Recent technological breakthroughs in 3-Dimensional (3D) video capture, display, coding, transmission, rendering, etc. have led the advances of 3D multimedia applications into the consumer market. However, the effect of these technologies on 3D video Quality of Experience (QoE) has not been thoroughly investigated to speed up the wide-spread proliferation of the 3D video applications in this market. Quality and depth perception assessment of 3D video from the view of end users reflects the most important aspect of 3D video QoE. Therefore, evaluating quality and depth perception of 3D video should be given the utmost attention. Currently, the depth perception assessment of 3D video can only be achieved using time consuming and rigorous subjective assessments due to the lack of reliable and efficient objective metrics. Assessing the depth perception using Full-Reference (FR)/Reduced Reference (RR) objective metrics is not efficient for on the fly 3D video applications due to the requirement of original video/extracted information at the receiver side. Thus, a No Reference (NR) metric, which does not need any original video related information at the receiver side to predict the depth perception, is proposed in this paper. Three important cues (i.e., binocular parallax, lateral motion, and aerial perspective) for Human Visual System (HVS) to perceive the depth of a 3D video are utilized to develop the NR metric. Experimental results devised using the proposed metric prove the effectiveness of it to predict the depth perception.

Multimodal Interactive Continuous Scoring of Subjective 3D Video Quality of Experience

People experience a variety of 3D visual programs, such as 3D cinema, 3D TV and 3D games, making it necessary to deploy reliable methodologies for predicting each viewer's subjective experience. We propose a new methodology that we call multimodal interactive continuous scoring of quality (MICSQ). MICSQ is composed of a device interaction process between the 3D display and a separate device (PC, tablet, etc.) used as an assessment tool, and a human interaction process between the subject(s) and the separate device. The scoring process is multimodal, using aural and tactile cues to help engage and focus the subject(s) on their tasks by enhancing neuroplasticity. Recorded human responses to 3D visualizations obtained via MICSQ correlate highly with measurements of spatial and temporal activity in the 3D video content. We have also found that 3D quality of experience (QoE) assessment results obtained using MICSQ are more reliable over a wide dynamic range of content than obtained by the conventional single stimulus continuous quality evaluation (SSCQE) protocol. Moreover, the wireless device interaction process makes it possible for multiple subjects to assess 3D QoE simultaneously in a large space such as a movie theater, at different viewing angles and distances. We conducted a series of interesting 3D experiments showing the accuracy and versatility of the new system, while yielding new findings on visual comfort in terms of disparity, motion and an interesting relation between the naturalness and depth of field (DOF) of a stereo camera.

Evaluating Depth Perception of 3D Stereoscopic Videos

3D video quality of experience (QoE) is a multidimensional problem; many factors contribute to the global rating like image quality, depth perception and visual discomfort. Due to this multidimensionality, it is proposed in this paper, that as a complement to assessing the quality degradation due to coding or transmission, the appropriateness of the non-distorted signal should be addressed. One important factor here is the depth information provided by the source sequences. From an application-perspective, the depth-characteristics of source content are of relevance for pre-validating whether the content is suitable for 3D video services. In addition, assessing the interplay between binocular and monocular depth features and depth perception are relevant topics for 3D video perception research. To achieve the evaluation of the suitability of 3D content, this paper describes both a subjective experiment and a new objective indicator to evaluate depth as one of the added values of 3D video.