Coefficient Thresholding with Image Restoration

Abstract

During Coefficient thresholding (CT), the last several nonzero DCT coefficients after quantization are dropped if better Rate-Distortion (RD) performance can be achieved. Since image data can be reconstructed by incomplete frequency information with some prior knowledge of image property (e.g., luminance continuity), the quality degradation caused by CT can be sometimes alleviated by some prior knowledge based image restoration. Consider an 8×8 image block I that is represented by 64 transform coefficients of the prediction residual, C_(1~64)=DCT(I-I_pred). When CT is performed, the last few nonzero coefficients of C1~64 are dropped as long as the RD cost can be reduced. Then the reconstructed block Irec can be calculated by I_rec1=IDCT(C_(1~k) )+I_pred, where k denotes the index of last nonzero coefficient of the remaining. With some certain image restoration technique, the lost information during CT can be partially recovered, I_rec2=RESTORE(DCT(C_(1~k) )+I_pred). We employ Bilateral Filter (BF) for the image restoration after CT. This CT/BF approach is implemented as a candidate mode in addition to the traditional IDCT mode, and RD optimization is utilized for the mode selection. The CT/BF mode is enabled for the blocks with texture and edges, which saves considerable computational complexity. Moreover, to save the overhead of the mode flags, the mode information are transmitted covertly in terms of the parity of the number of nonzero coefficients like watermarks. Experiments show that the codec with CT/BF improves the quality of decoded video by up to 0.54 dB compared to H.264 high profile.