Abstract
Research in the field of video quality assessment relies on the availability of subjective scores, collected by means of experiments in which groups of people are asked to rate the quality of video sequences. The availability of subjective scores is fundamental to enable validation and comparative benchmarking of the objective algorithms that try to predict human perception of video quality by automatically analyzing the video sequences, in a way to support reproducible and reliable research results. In this paper, a publicly available database of subjective quality scores and corrupted video sequences is described. The scores refer to 156 sequences at CIF and 4CIF spatial resolutions, encoded with H.264/AVC and corrupted by simulating the transmission over an error-prone network. The subjective evaluation has been performed by 40 subjects at the premises of two academic institutions, in standard-compliant controlled environments. In order to support reproducible research in the field of full-reference, reduced-reference, and no-reference video quality assessment algorithms, both the uncompressed files and the H.264/AVC bitstreams, as well as the packet loss patterns, have been made available to the research community.
Highlights
The use of IP networks for video delivery is gaining an increasing popularity as a mean of broadcasting data from content providers to consumers
With respect to others cited above, the database described in this paper, (1) includes data collected at the premises of two different laboratories, showing high correlation among the two sets of collected results, as an indicator of reliability of the subjective data as well as of the adopted evaluation methodology, (2) includes the decoded sequences and the compressed video streams affected by packet losses, as well as the packet loss patterns, it can be used for testing stream-based and hybrid No-Reference and ReducedReference metrics, (3) includes the complete set of collected subjective results, including the raw scores before any data processing, allowing reproducible research on subjective data processing and detailed statistical analysis of metrics performance
Each test session referred to a single spatial resolution and included 83 video sequences: 6 × 12 test sequences, that is, realizations corresponding to 6 different contents and 6 different Packet Loss Rates (PLRs); 6 reference sequences, that is, packet loss free video sequences; 5 stabilizing sequences, that is, dummy presentations shown at the beginning of the experiment to stabilize observers’ opinion
Summary
The use of IP networks for video delivery is gaining an increasing popularity as a mean of broadcasting data from content providers to consumers. The LIVE Wireless Video Quality Assessment Database [5] focuses on distortions due to transmission over a wireless network and takes into account a set of video sequences having similar content concerning airplanes These databases include the test video sequences and the processed subjective results and have been used to evaluate the performance of a set of Full-Reference video quality metrics in [4, 5]. With respect to others cited above, the database described in this paper, (1) includes data collected at the premises of two different laboratories, showing high correlation among the two sets of collected results, as an indicator of reliability of the subjective data as well as of the adopted evaluation methodology, (2) includes the decoded sequences and the compressed video streams affected by packet losses, as well as the packet loss patterns, it can be used for testing stream-based and hybrid No-Reference and ReducedReference metrics, (3) includes the complete set of collected subjective results, including the raw scores before any data processing, allowing reproducible research on subjective data processing and detailed statistical analysis of metrics performance.
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
