Real-time rolling shutter compensation for a complementary metal-oxide semiconductor image sensor

Abstract

Complementary metal-oxide semiconductor image sensors suffer from undesirable geometric image distortion due to the rolling shutter effect. However, conventional algorithms cannot be used for strict real-time use in mobile devices. An extremely low computational method to compensate rolling shutter effect for the mobile devices is proposed. The proposed method efficiently predicts the rotational camera motion in three-dimensional space from the global motion vectors predicted in two-dimensional image space. Hence, the computational complexity is extremely reduced. To further improve the video quality, the video stabilization to reduce the high-frequency jitter of the camera motion without increasing the complexity is introduced. The results of simulation demonstrate that while the computational complexity is extremely low, the proposed algorithm provides acceptable performance.