Abstract

To increase the overall visual quality of the video services without increasing data rate, a human visual system-based video coding, founded on a hierarchy of the video stream in different levels of importance, is developed. Determining these importance levels takes in count three classification criteria: the position of current image in the group of images (image level), the importance of the motion vectors of macroblocks in the current image (macroblock level) and belonging or not of a pixel in a spatial region of interest (pixel level). At the end of this classification process, an interpolation between the results of the three-level selection allows to establish an index of importance for each macroblock of the image to be encoded. This index determines the type of channel coding to be applied to the corresponding macroblock. Tests have shown that the technique presented in this paper achieves better results in PSNR and SSIM (structural similarity) than an equal error protection technique.

Highlights

  • Many subjective studies and experiences in the fields of human vision and electronic imaging revealed that the human visual system (HVS) tends to focus on a few favorite areas in images or scenes data

  • We propose to express the visual importance of a macroblock in terms of distortion that would be caused by the loss of this macroblock

  • For comparing the bit rate generated by this unequal error protection and of equal error protection, the number of bits used to encode each image of GOP was calculated

Read more

Summary

INTRODUCTION

Many subjective studies and experiences in the fields of human vision and electronic imaging revealed that the human visual system (HVS) tends to focus on a few favorite areas in images or scenes data. A loss occurred in the region of the image drawing the viewer's attention, causes a bigger discomfort than if it occurs outside of this area. This discomfort can be amplified by the temporal spread of damage related to loss in several images. This phenomenon of propagation is accentuated because of the intensive use of intra and inters images in hybrid video encoders. Because of the high efficiency of the compression, the resulting data is very sensitive to the effects of transmission errors To remedy this problem, the encoding based on the regions of interest was combined with unequal error protection approaches.

VISUAL ATTENTION IN VIDEO CODING
Significant Motion Vectors
ROBUST VIDEO ENCODER BASED ON THE PERCEPTUAL UNEQUAL ERROR PROTECTION
IMAGE CLASSIFICATION LEVEL
C2 C2 C3
First approach: classification based on the global distortion
PIXELS LEVEL CLASSIFICATION
Second approach: classification based on the amplitude of motion vectors
DETERMINATION OF THE INDEX OF IMPORTANCE IG AND CORRECTING CODES ALLOCATION
VIII. TESTS AND RESULTS
The distribution of Macroblocks according to their importance
Visual quality of images
CONCLUSIONS

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.