Abstract
We present an effective video frame (including reference frame and key frames) acquisition method for image stitching. The method simultaneously analyzes different types of factors, namely, the video-level stability, image-level stability, and content scale stability, to take advantage of their complementary strengths. We model the three factors with three modules that are learned from an analysis of the shooting process. The video stabilization module (VSM) selects a stable segment, while the shooting distance module (SDM) obtains a similar content scale. They collaborate during the reference video sequence so that they can benefit from each other. Then, the image quality module (IQM) obtains a reference frame from the above sequence by choosing high-quality images. Finally, to obtain the key frame set, the SDM and IQM are again used to continuously filter the overlapping video sequences formed by the reference frame or the latest key frame. In particular, a comprehensive dataset containing a variety of challenges and scenarios is introduced. We have conducted an extensive set of experiments on this dataset. The results confirm the effectiveness of each module and their collaboration; our method outperforms current state-of-the-art methods.
Highlights
Image stitching is the study of combining a group of images to form a single wider field of view (FOV) image [1]
Based on the above analysis, we have proposed three modules, namely, the video stabilization module (VSM), image quality module (IQM), and shooting distance module (SDM), to address these three issues separately
VIDEO PREPROCESSING In the reference frame selection stage, to find a stable reference frame, since it is impossible to calculate whether a video frame is stable in the video, we find a stable video segment and select the reference frame from the stable video segment to ensure that the reference frame is stable
Summary
Image stitching is the study of combining a group of images to form a single wider field of view (FOV) image [1]. These images need to have as little parallax as possible, good image quality, similar content scale, and certain overlap rate. We want to create a panoramic image of a campus In this scene, we cannot take images one by one and we cannot guarantee that every image we take meets the requirements of stitching. To obtain stable stitching results, it is necessary to select effective video frames (EVFs) that meet the requirements of stitching
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Free) 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a call
