3D reconstruction from a single image using geometric constraints

Abstract

Photogrammetry has many advantages as a technique for the acquisition of three-dimensional models for virtual reality. But the traditional photogrammetric process to extract 3D geometry from multiple images is often considered too labour-intensive. In this paper a method is presented with which a polyhedral object model can be efficiently derived from measurements in a single image combined with geometric knowledge on the object. Man-made objects can often be described by a polyhedral model and usually many geometric constraints are valid. These constraints are inferred during image interpretation or may even be extracted automatically. In this paper different types of geometric constraints and their use for object reconstruction are discussed. Applying more constraints than needed for reconstruction will lead to redundancy and thereby to the need for an adjustment. The redundancy is the basis for reliability that is introduced by testing for possible measurement errors. The adjusted observations are used for object reconstruction in a separate step. Of course the model that is obtained from a single image will not be complete, for instance due to occlusion. An arbitrary number of models can be combined using similarity transformations based on the coordinates of common points. The information gathered allows for a bundle adjustment if highest accuracy is strived for. In virtual reality applications this is generally not the case, as quality is mainly determined by visual perception. A visual aspect of major importance is the photo-realistic texture mapped to the faces of the object. This texture is extracted from the same (single) image. In this paper the measurement process, the different types of constraints, their adjustment and the object model reconstruction are treated. A practical application of the proposed method is discussed in which a texture mapped model of a historic building is constructed and the repeatability of the method is assessed. The application shows the feasibility of the method and the potential of photogrammetry as an efficient tool for the production of 3D models for virtual reality applications.