Image-registration-based local noise reduction for noisy video sequences

Abstract

This paper presents a method for localizing noise-corrupted areas in quality degraded video frames, and for reducing the additive noise by utilizing the temporal redundancy in the video sequence. In the proposed algorithm, the local variance of each pixel is computed to obtain the spatial distribution of noise. After adaptive thresholding, region clustering, and merging, the corrupted areas of highest energy are detected. Due to the high temporal redundancy in the video sequence, the corrupted information can be compensated by overlapping the corrupted regions with the appropriate regions from adjacent video frames. The corresponding pixel locations in the adjacent frames are computed by using image registration and warping techniques. New pixel values are calculated based upon multi-frame stacking. Pixel values in the adjacent frames are weighted according to registration errors, whereas the values in the noisy frame are evaluated according to local variance. Knowing the location of the local noise enables the denoising process to be much more specific and accurate. Moreover, since only a portion of the frame is processed, as compared to standard denoising methods that operate on the entire frame, the details and features in other areas of the frame are preserved. The proposed scheme is applied to UAV video sequences, where the outstanding noise localization and reduction properties are demonstrated.