Concealment Support and Error Resilience for HEVC to Improve Consumer Quality of Experience

Abstract

Consumer electronics have started to support 8K/4K/UHD/SUHD videos in order to improve the perceived QoE. It is beneficial to assess the consumer’s perceived quality degradation at the output prior to transmitting the video in an error prone channel, to include concealment support and error resilient features to minimize these artifacts. While existing error resilient schemes have attempted to include source coding error and the channel’s error propagation, they have ignored the error resilience and concealment accuracy at the decoder when encoding the video which allows for end-to-end error capture and mitigation to improve consumer QoE. This paper proposes a two-pass codec encoding scheme that determines the motion vectors and the coding modes which not only mitigate the source coding error and the channel error propagation, but also improve the accuracy of the error concealment operation. The proposed method incorporates an end-to-end probabilistic distortion model and utilizes the concealment error in the subsequently encoding frames while estimating the motion vectors for the current frame. The experiment achieves up to 1.47dB PSNR gain for diverse video contents in comparison to the state-of-the-art techniques at a 10% packet error rate. This objective gain was also supported by the user perceived QoE.