Abstract
Most consumer cameras are equipped with electronic rolling shutter, leading to image distortions when the camera moves during image capture. We explore a surprisingly simple camera configuration that makes it possible to undo the rolling shutter distortion: two cameras mounted to have different rolling shutter directions. Such a setup is easy and cheap to build and it possesses the geometric constraints needed to correct rolling shutter distortion using only a sparse set of point correspondences between the two images. We derive equations that describe the underlying geometry for general and special motions and present an efficient method for finding their solutions. Our synthetic and real experiments demonstrate that our approach is able to remove large rolling shutter distortions of all types without relying on any specific scene structure.
Highlights
Thanks to low price, superior resolution and higher frame rate, CMOS cameras equipped with rolling shutter (RS) dominate the market for consumer cameras, smartphones, and many other applications
Real image pairs were acquired with a rig of two RS cameras, see Fig. 2, and undistorted into global shutter geometry to visually illustrate the high quality of the corrected images across a range of motion patterns and scenes
We present a novel configuration of two RS cameras that is easy to realise in practice, and makes it possible to accurately remove significant RS distortions from the images: by mounting two cameras close to each other and letting the shutters roll in opposite directions, one obtains different distortion patterns
Summary
Superior resolution and higher frame rate, CMOS cameras equipped with rolling shutter (RS) dominate the market for consumer cameras, smartphones, and many other applications. Even with multiple views, removing RS distortion either requires strong assumptions, like a piece-wise planar scene observed at a high frame-rate with known shutter timings [19]; or it amounts to full SfM reconstruction [14], requiring sufficient camera translation. SfM with rolling shutter suffers from a number of degeneracies, in particular it has long been known that constant translational motion along the baseline (e.g., side-looking camera on a vehicle) does not admit a solution [2] It has been shown [6] that (nearly) parallel RS read-out directions are in general degenerate, and can only be solved with additional constraints on the camera motion [16]. We first discuss the solution for the general case of unconstrained
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
