Mosaics of video sequences with moving objects

Abstract

This paper aims to construct mosaics from video sequences with moving objects. We propose to explicitly eliminate moving objects from the background. When dealing with only the retained background, we can simplify the following global motion estimation and exclude moving objects from the video mosaic. The proposed method consists of three stages. First, we apply a hierarchical block-based technique to detect and eliminate the moving regions from the background, and in the meantime we estimate the initial guess of the global motion. Next, we employ a hierarchical feature-based technique on the retained background regions to refine and derive the precise global motion. Last, we refine the segmentation results obtained at the first stage and warp all the retained background regions with respect to a reference coordinate system and integrate them into a video mosaic. Many experimental results are shown to demonstrate the effectiveness of the proposed work.