Year-end Sale % OFF 
Abstract
Virtual walk through can be widely applied in many industries such as virtual environment construction, history heritage conservation and scenic site exhibition etc. This paper proposes a more convenient and efficient approach to create realistic virtual walk through from catadioptric omni-directional images via view synthesis technique. Our innovation mainly lies in three aspects: omni-directional image preprocessing, image rectification and novel view interpolation. Acquisition and unwarping of omni-directional image are discussed firstly. Then, for specialty of cylindrical panoramic imaging, epiline-sampling method is adopted for rectification, which samples reference images along epilines as much as possible grounding on epipolar geometry. In this way, it can detract the rectified images from image deformation and resolution degeneration, which usually take place due to perspective transformation when using some other algorithms. As to novel view generation, a corresponding interpolation algorithm is developed. Pixels on novel view are formulated according to the cylindrical panoramic imaging model. Experiments carried out on both synthetic and real scene are given at the end of this paper, with a demonstration of the method's application in realistic virtual walk through.
Highlights
With the advantage of wide field of view (360°horizontally), Technologies based on catadioptric omni-directional images develop rapidly, and has been vastly applied in 3D reconstruction, virtual reality, robot navigation, augmented reality and so on
In view of the specialty of the cylindrical panoramic imaging model, we found that rectification via re-sampling reference images along epilines is superior to other approaches using HPPT in terms of retentive-pixel-rate and effective-pixel-rate, which are criterions been propose to measures re-sampling effect [2],[17]-[19]
Stereo matching is done via approach of [16] and view synthesis results are given in Fig.8 and Fig.9, where the five figures are respective novel views at different positions between the reference cylinders centers, and a presents the ratio of novel viewpoint’ distance from the right cylinder center to the total distance of two cylinder centers
Summary
With the advantage of wide field of view (360°horizontally), Technologies based on catadioptric omni-directional images develop rapidly, and has been vastly applied in 3D reconstruction, virtual reality, robot navigation, augmented reality and so on. As to convenient and efficient virtual walk through application, a more nature idea is to utilize omni-directional images for the wider FOV, compared with other methods ground on normal perspective images. To create realistic virtual walk through from omni-directional image pair via view synthesis technique, there are three key steps: (1) reference images acquisition and preprocessing; (2) image rectification; and (3) novel view synthesizing. In [2], the authors represented omni-directional image coordinates as a point z in complex plane, and specified the rectification by coth 1 z. This method is shown to be conformal, locally distortionless, and unique up to scale and transformation. This method is shown to be conformal, locally distortionless, and unique up to scale and transformation. [4] encoded the nonlinearity of the projection model of omni-directional image system in a catadioptric fundamental matrix with bilinear form, and estimated it with a quotient of two Lie groups to implement the rectification. [3] and [5] introduced the geometric characterization of panoramic omni-directional camera and applied warping equations to images, so that the epipolar lines of image pair can become parallel scanlines
Sign-in/Register to view highlights & summary Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
