Abstract

High frame rates are acknowledged to increase the perceived quality of certain video content. However, the lack of high frame rate test content has previously restricted the scope of research in this area—especially in the context of immersive video formats. This problem has been addressed through the publication of a high frame rate video database BVI-HFR, which was captured natively at 120 fps. BVI-HFR spans a variety of scenes, motions, and colors, and is shown to be representative of BBC broadcast content. In this paper, temporal down-sampling is utilized to enable both subjective and objective comparisons across a range frame rates. A large-scale subjective experiment has demonstrated that high frame rates lead to increases in perceived quality, and that a degree of content dependence exists—notably related to camera motion. Various image and video quality metrics have been benchmarked on these subjective evaluations, and analysis shows that those which explicitly account for temporal distortions (e.g., FRQM) provide improved correlation with subjective opinions compared to generic quality metrics such as PSNR.

Highlights

  • A S THE demand for higher quality and more engaging video experiences increases, the pressure to extend the video parameter space beyond current spatial and temporal resolutions, dynamic ranges and screen sizes becomes ever greater [1]

  • [9], there is a commonly held belief that the maximum perceptible temporal resolution of the human visual system is 50–60 fps. While this may be true for the case of flicker, when it comes to objects in motion, the frame rate determines the spatial displacement between samples

  • The remainder of this paper is organised as follows: Section II summarises the state-of-the-art; Section III characterises the Bristol Vision Institute High Frame Rate (BVI-HFR) video database; Section IV provides an analysis of temporal down-sampling; Section V presents a subjective experiment that quantifies the relationship between frame rate and visual quality; Section VI benchmarks existing quality metrics

Read more

Summary

A Study of High Frame Rate Video Formats

Abstract—High frame rates are acknowledged to increase the perceived quality of certain video content. The lack of high frame rate test content has previously restricted the scope of research in this area—especially in the context of immersive video formats. This problem has been addressed through the publication of a high frame rate video database BVI-HFR, which was captured natively at 120 fps. Temporal down-sampling is utilized to enable both subjective and objective comparisons across a range frame rates. A large-scale subjective experiment has demonstrated that high frame rates lead to increases in perceived quality, and that a degree of content dependence exists—notably related to camera motion.

INTRODUCTION
Benefits of Increased Frame Rates
High Frame Rate Video Databases
Characterisation of Video Content
Frame Rate Dependent Video Quality Metrics
BVI-HFR VIDEO DATABASE
Source Sequences
Content Description
TEMPORAL DOWN-SAMPLING
Spectral Analysis
Source Statistics
Video Compression
Test Sequences
Experimental Setup and Methodology
Analysis of Opinion Scores
Content Dependence
QUALITY METRICS
Methodology
Generic Quality Metrics
Significance Testing
CONCLUSIONS
VIII. FUTURE WORK
Temporal Down-Sampling Framework
Findings
Implementation
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call