Abstract
High-quality video is being increasingly delivered over Internet Protocol networks, which means that network operators and service providers need methods to measure the quality of experience (QoE) of the video services. In this paper, we propose a method to speed up the development of no-reference bitstream objective metrics for estimating QoE. This method uses full-reference objective metrics, which makes the process significantly faster and more convenient than using subjective tests. In this process, we have evaluated six publicly available full-reference objective metrics in three different databases, the EPFL-PoliMI database, the HDTV database, and the Live Video Wireless database, all containing transmission distortions in H.264 coded video. The objective metrics could be used to speed up the development process of no-reference real-time video QoE monitoring methods that are receiving great interest from the research community. We show statistically that the full-reference metric Video Quality Metric (VQM) performs best considering all the databases. In the EPFL-PoliMI database, SPATIAL MOVIE performed best and TEMPORAL MOVIE performed worst. When transmission distortions are evaluated, using the compressed video as the reference provides greater accuracy than using the uncompressed original video as the reference, at least for the studied metrics. Further, we use VQM to train a lightweight no-reference bitstream model, which uses the packet loss rate and the interval between instantaneous decoder refresh frames, both easily accessible in a video quality monitoring system.
Highlights
Streaming high-quality digital video over Internet Protocol (IP)-based networks is increasing in popularity both among users and operators
We show the plots of the Video Quality Metric (VQM) objective metric because the VQM metric performs very well in all the video databases
No-reference bitstream model development we demonstrate how the full-reference objective metrics can be used to speed up the development process of no-reference bitstream real-time video Quality of Experience (QoE) monitoring methods
Summary
Streaming high-quality digital video over Internet Protocol (IP)-based networks is increasing in popularity both among users and operators. We have selected a concrete example, where we perform all the necessary steps for the procedure described above This does not mean that we claim that this is the first time FR models are evaluated for packet loss, but to our knowledge, it has not been done for this particular scope, i.e., packet loss combined with coded reference. Still, it is presented for illustrating the methodology. Database varying all the parameters of the extended model (model with compression and transmission distortions), execute the selected full-reference metric for compression distortions on the training database, and redesign the model incorporating the compression dependent parameters
Published Version (Free)
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have