A hybrid method for video stabilization and retargeting

Abstract

Both video stabilization and retargeting are important post processing techniques for film production. In many cases, we need to stabilize the shaky handhold video and adapt it to target displays with different resolutions and aspect ratios. Video stabilization and retargeting are computationally costly and both require a large amount of memory. If we stabilize and retarget a video serially, the time cost will be the sum of two separate operation's spending. To obtain the result with high quality in both stabilization and retargeting, we hope we can use recent outstanding stabilization and retargeting techniques, but no matter which operation we do first, previous operation will cause that the latter operation can not proceed or fail; Can we integrate video stabilization and retargeting in one routine? In this paper, we present an integrated approach which can solve video stabilization and retargeting at one time. The central component of our approach is a least square minimization which warps video to the target resolution and achieves high quality camera motion for a wide range of videos. Retargeting problem was solved by employing motion information and by distributing distortion in both spatial and temporal dimensions, and stabilization problem was solved by smoothing camera motion and frame homography. Experimental results confirm the effectiveness of the proposed approach.