Enhancement of video data using motion-compensated postprocessing techniques

Abstract

In many video coding schemes, especially at low bitrates, spatial and temporal subsampling of the image sequences is considered. This is realized by leaving out rows and columns from the images, and skipping whole frames at the transmitter. To get the best possible quality image sequence at the receiver side, the skipped portion of the video should be reconstructed using advanced motion-compensated (MC) postprocessing techniques. Our paper mainly focuses on the restoration/generation of unknown frames of the sequence at time instances, where the original scene has not been sampled, or which were skipped from the original sequence in the transmitter. This enhancement of the temporal resolution is performed using our advanced MC interpolation algorithm, utilizing an accelerated motion model and motion-based segmentation with proper handling of covered and uncovered areas. The algorithm can be used to avoid jerkiness and blurring of the restored image sequences.