Non-metric Camera Research Articles

GENERATING ACCURATE 3D MODELS OF ARCHITECTURAL HERITAGE STRUCTURES USING LOW-COST CAMERA AND OPEN SOURCE ALGORITHMS

Abstract. These studies have been conductedusing non-metric digital camera and dense image matching algorithms, as non-contact methods of creating monuments documentation.In order toprocess the imagery, few open-source software and algorithms of generating adense point cloud from images have been executed. In the research, the OSM Bundler, VisualSFM software, and web application ARC3D were used. Images obtained for each of the investigated objects were processed using those applications, and then dense point clouds and textured 3D models were created. As a result of post-processing, obtained models were filtered and scaled.The research showedthat even using the open-source software it is possible toobtain accurate 3D models of structures (with an accuracy of a few centimeters), but for the purpose of documentation and conservation of cultural and historical heritage, such accuracy can be insufficient.

Measuring rill erosion using structure from motion: A plot experiment

In this paper the results of a plot experiment on rill erosion are reported. The rill network, manually incised on the soil and further shaped by a clear inflow discharge, was surveyed using the three-dimensional photo-reconstruction (3D-PR) technique which allows to obtain a digital terrain model (DTM) by a large series of oblique images of the channel from consumer un-calibrated and non-metric cameras. The three-dimensional (3D) DTM and the quasi-tridimensional (2.5D) model were generated by Agisoft Photoscan software. For a single rill channel, the reliability of the 3D image-based ground measurements of morphological and hydraulic variables was positively tested by the corresponding measurements carried out on the rill gypsum cast. Moreover, the morphological and hydraulic variables were measured at 11 transects of the plot by a profilometer P, the 2.5D and 3D models. Using the 3D model as reference, the analysis showed that the reliability of the measurements by P and 2.5D methods was comparable and the error was generally lower than 15%. The rill measurements carried out by the three methods agreed with the available literature measurements and supported the applicability of both the empirical relationship between rill length and its eroded volume and the theoretical dimensionless relationship among the morphological variables describing the channelized erosion process. The analysis also showed that the effect of the distance between two consecutive cross sections on the rill volume measurement by 3D model is negligible. Finally, the shaping effect of different flow discharges on three straight rills incised into the plot was tested. In particular, three increasing flow discharges (0.15, 0.35 and 0.5ls−1) were used sequentially in two rills while the maximum discharge of the sequence (0.5ls−1) was used into the third rill. Both the grain-size distribution of the eroded sediment and the total amount of soil loss were affected by the discharge sequence.

Internet Photogrammetry for Inspection of Seaports

Abstract This paper intends to point out the possibility of using Internet photogrammetry to construct 3D models from the images obtained by means of UAVs (Unmanned Aerial Vehicles). The solutions may be useful for the inspection of ports as to the content of cargo, transport safety or the assessment of the technical infrastructure of port and quays. The solution can be a complement to measurements made by using laser scanning and traditional surveying methods. In this paper the authors recommend a solution useful for creating 3D models from images acquired by the UAV using non-metric images from digital cameras. The developed algorithms, created and presented software allows to generate 3D models through the Internet in two modes: anaglyph and display in shutter systems. The problem of 3D image generation in photogrammetry is solved by using epipolar images. The appropriate method was presented by Kreiling in 1976. However, it applies to photogrammetric images for which the internal orientation is known. In the case of digital images obtained with non-metric cameras it is required to use another solution based on the fundamental matrix concept, introduced by Luong in 1992. In order to determine the matrix which defines the relationship between left and right digital image it is required to have at least eight homologous points. To determine the solution it is necessary to use the SVD (singular value decomposition). By using the fundamental matrix the epipolar lines are determined, which makes the correct orientation of images making stereo pairs, possible. The appropriate mathematical bases and illustrations are included in the publication.

An accelerated image matching technique for UAV orthoimage registration

Using an Unmanned Aerial Vehicle (UAV) drone with an attached non-metric camera has become a popular low-cost approach for collecting geospatial data. A well-georeferenced orthoimage is a fundamental product for geomatics professionals. To achieve high positioning accuracy of orthoimages, precise sensor position and orientation data, or a number of ground control points (GCPs), are often required. Alternatively, image registration is a solution for improving the accuracy of a UAV orthoimage, as long as a historical reference image is available. This study proposes a registration scheme, including an Accelerated Binary Robust Invariant Scalable Keypoints (ABRISK) algorithm and spatial analysis of corresponding control points for image registration. To determine a match between two input images, feature descriptors from one image are compared with those from another image. A “Sorting Ring” is used to filter out uncorrected feature pairs as early as possible in the stage of matching feature points, to speed up the matching process. The results demonstrate that the proposed ABRISK approach outperforms the vector-based Scale Invariant Feature Transform (SIFT) approach where radiometric variations exist. ABRISK is 19.2 times and 312 times faster than SIFT for image sizes of 1000×1000 pixels and 4000×4000 pixels, respectively. ABRISK is 4.7 times faster than Binary Robust Invariant Scalable Keypoints (BRISK). Furthermore, the positional accuracy of the UAV orthoimage after applying the proposed image registration scheme is improved by an average of root mean square error (RMSE) of 2.58m for six test orthoimages whose spatial resolutions vary from 6.7cm to 10.7cm.

Reconstruction of measurable three-dimensional point cloud model based on large-scene archaeological excavation sites

This paper outlines a low-cost, user-friendly photogrammetric technique with nonmetric cameras to obtain excavation site digital sequence images, based on photogrammetry and computer vision. Digital camera calibration, automatic aerial triangulation, image feature extraction, image sequence matching, and dense digital differential rectification are used, combined with a certain number of global control points of the excavation site, to reconstruct the high precision of measured three-dimensional (3-D) models. Using the acrobatic figurines in the Qin Shi Huang mausoleum excavation as an example, our method solves the problems of little base-to-height ratio, high inclination, unstable altitudes, and significant ground elevation changes affecting image matching. Compared to 3-D laser scanning, the 3-D color point cloud obtained by this method can maintain the same visual result and has advantages of low project cost, simple data processing, and high accuracy. Structure-from-motion (SfM) is often used to reconstruct 3-D models of large scenes and has lower accuracy if it is a reconstructed 3-D model of a small scene at close range. Results indicate that this method quickly achieves 3-D reconstruction of large archaeological sites and produces heritage site distribution of orthophotos providing a scientific basis for accurate location of cultural relics, archaeological excavations, investigation, and site protection planning. This proposed method has a comprehensive application value.

A method of determining inland vessel position using a single stationary, non-metric camera

A method of determining inland vessel position using a single stationary, non-metric camera

In-situ Self-calibration of Non-metric Camera and Digital Stereo Plotting for Public Survey

In-situ Self-calibration of Non-metric Camera and Digital Stereo Plotting for Public Survey

Detection of Catchment-Scale Gully-Affected Areas Using Unmanned Aerial Vehicle (UAV) on the Chinese Loess Plateau

The Chinese Loess Plateau suffers from serious gully erosion induced by natural and human causes. Gully-affected areas detection is the basic work in this region for gully erosion assessment and monitoring. For the first time, an unmanned aerial vehicle (UAV) was applied to extract gully features in this region. Two typical catchments in Changwu and Ansai were selected to represent loess tableland and loess hilly regions, respectively. A high-powered quadrocopter (md4-1000) equipped with a non-metric camera was used for image acquisition. InPho and MapMatrix were applied for semi-automatic workflow including aerial triangulation and model generation. Based on the stereo-imaging and the ground control points, the highly detailed digital elevation models (DEMs) and ortho-mosaics were generated. Subsequently, an object-based approach combined with the random forest classifier was designed to detect gully-affected areas. Two experiments were conducted to investigate the influences of segmentation strategy and feature selection. Results showed that vertical and horizontal root-mean-square errors were below 0.5 and 0.2 m, respectively, which were ideal for the Loess Plateau region. The overall extraction accuracy in Changwu and Ansai achieved was 84.62% and 86.46%, respectively, which indicated the potential of the proposed workflow for extracting gully features. This study demonstrated that UAV can bridge the gap between field measurement and satellite-based remote sensing, obtaining a balance in resolution and efficiency for catchment-scale gully erosion research.

Time synchronization of consumer cameras on Micro Aerial Vehicles

This article discusses the problem of time registration between navigation and imaging components on Micro Aerial Vehicles (MAVs). Accurate mapping with MAVs is gaining importance in applications such as corridor mapping, road and pipeline inspections or mapping of large areas with homogeneous surface structure, e.g. forests or agricultural fields. Therefore, accurate aerial control plays a major role in efficient reconstruction of the terrain and artifact-free ortophoto generation. A key prerequisite is correct time stamping of images in global time frame as the sensor exterior orientation changes rapidly and its determination by navigation sensors influence the mapping accuracy on the ground. A majority of MAVs is equipped with consumer-grade, non-metric cameras for which the precise time registration with navigation components is not trivial to realize and its performance not easy to assess. In this paper, we study the problematic of synchronization by implementing and evaluating spatio-temporal observation models of aerial control to estimate residual delay of the imaging sensor. Such modeling is possible through inclusion of additional velocity and angular rate observations into the adjustment. This moves the optimization problem from 3D to 4D. The benefit of this approach is verified on real mapping projects using a custom build MAV and an off-the-shelf camera.

Precision Investigation of the Number of Photographs Taking Station in Photogrammetric Evaluation for Non-metric Cameras

In this study, the effect of number of picture taking on precision was investigated and non-metric digital camera was used. In the study, triplet convergent picture taking and sestet convergent picture taking were compared. As a result of the study carried out, It was observed that the number of picture taking station is more did not provide an important improvement in metric accuracy and, instead, it was concluded that picture taking geometry, which will cover the object to be measured in a good way, would be enough.

APPLICATION OF DIGITAL TERRESTRIAL PHOTOGRAMMETRY IN ARCHITECTURAL CONSERVATION: THE MOSQUE OF ABDULLAH IBN SALAM OF ORAN

Abstract. Studies on the architectural heritage can now be supported by three-dimensional reconstruction of actual buildings. The 3D digital model can be an effective medium for documenting the current state of historic buildings but also to create a resource for researchers who conduct their analysis on historical evolution. Architectural photogrammetry has its own specifications in relation to other photogrammetric applications, however it meets these expectations. The traditional approach requires the use of metric cameras but with the development of computational techniques, this requirement is overcome and opens the way for the use of non-metric camera. The use of the shots that is no longer restricted to the parallel configuration of bundles, the images may be convergent, horizontal or oblique. Combining and modelling several cameras increasingly powerful in resolution and stability, has great scope and the same workflow can be used in varied applications. ISPRS and ICOMOS created CIPA because they both believe that a monument can be restored and protected only when it has been fully measured and documented and when its development has been documented several times, i.e. monitored, also with respect to its environment, and stored in proper heritage information and management systems. In this paper the 3D modelling of an important cultural site using terrestrial photogrammetric techniques for architectural preservation is presented. The site is the mosque of Abdullah Ibn Salam, Built in 1880 at the initiative of Simon Kanoui, also known as the Great Synagogue of Oran was inaugurated in 1918 only. It was one of the largest and most beautiful synagogues in North Africa. It was built with stone imported from Jerusalem. This place of worship became in 1975 the mosque of Abdullah Ibn Salam who was a rich Jew of Medina who was converted to Islam. The structure is modelled using 321 oriented photos taken in five series of shots that cover all the façade and the interior of the building where more than 9200 points are created. Also some orthophotos of the important elements are produced and used as materials in the final stage which is the edition in a 3D modelling software. And a video virtual tour is generated using this software.

A novel post-calibration method for digital cameras using image linear features

ABSTRACTWith the advent of new digital cameras, especially low-weight non-metric ones mounted on unmanned aerial vehicles (UAVs), camera calibration models should be reinforced in accordance with their complex multiple-distortion nature. In this article, a new calibration method is proposed and evaluated, which is highly capable of modelling complex image distortions and needs no additional ground information. This method applies the straight line features to detect and model image distortion via the self-calibration process. This method is then used to upgrade the 3D positional information of existing digital maps in a post-correction scheme. The proposed method was implemented on the metric UltraCam digital images as well as the UAV-based images taken by a non-metric camera. The obtained results were extremely promising because 56% and 58% of planimetric and vertical accuracy improvements were achieved, respectively, in the case of UAV-based images. Similar results were also obtained for the UltraCam project. This level of accuracy can only be achieved in traditional photogrammetric methods with the aid of five times more ground control points (GCPs). The proposed method is extremely effective in terms of the reduction of costs and time consumption due to the decrease in ground operations. This advantage is of great interest, especially in the case of UAV-based operations, where the primary objective is cost reduction. Furthermore, in the case of improving previously generated maps, where the utilization of new ground points is not possible at all, this method is the only applicable approach since it is entirely executed in the image space.

Geomatic methods applied to the study of the front position changes of Johnsons and Hurd Glaciers, Livingston Island, Antarctica, between 1957 and 2013

Abstract. Various geomatic measurement techniques can be efficiently combined for surveying glacier fronts. Aerial photographs and satellite images can be used to determine the position of the glacier terminus. If the glacier front is easily accessible, the classic surveys using theodolite or total station, GNSS (Global Navigation Satellite System) techniques, laser-scanner or close-range photogrammetry are possible. When the accessibility to the glacier front is difficult or impossible, close-range photogrammetry proves to be useful, inexpensive and fast. In this paper, a methodology combining photogrammetric methods and other techniques is applied to determine the calving front position of Johnsons Glacier. Images taken in 2013 with an inexpensive nonmetric digital camera are georeferenced to a global coordinate system by measuring, using GNSS techniques, support points in accessible areas close to the glacier front, from which control points in inaccessible points on the glacier surface near its calving front are determined with theodolite using the direct intersection method. The front position changes of Johnsons Glacier during the period 1957–2013, as well as those of the land-terminating fronts of Argentina, Las Palmas and Sally Rocks lobes of Hurd glacier, are determined from different geomatic techniques such as surface-based GNSS measurements, aerial photogrammetry and satellite optical imagery. This provides a set of frontal positions useful, e.g., for glacier dynamics modeling and mass balance studies.Link to the data repository: https://doi.pangaea.de/10.1594/PANGAEA.845379.

Accuracy of Digital Surface Models and Orthophotos Derived from Unmanned Aerial Vehicle Photogrammetry

AbstractThis paper explores the influence of flight altitude, terrain morphology, and the number of ground control points (GCPs) on digital surface model (DSM) and orthoimage accuracies obtained with unmanned aerial vehicle (UAV) photogrammetry. For this study, 60 photogrammetric projects were carried out considering five terrain morphologies, four flight altitudes (i.e., 50, 80, 100, and 120 m), and three different numbers of GCPs (i.e., 3, 5, and 10). The UAV was a rotatory wing platform with eight motors, and the sensor was a nonmetric mirrorless reflex camera. The root-mean-square error (RMSE) was used to assess the accuracy of the DSM (Z component) and orthophotos (X, Y, and XY components RMSEX, RMSEY, and RMSEXY, respectively). The results show that RMSEX, RMSEY, and RMSEXY were not influenced by flight altitude or terrain morphology. For horizontal accuracy, differences between terrain morphologies were observed only when 5 or 10 GCPs were used, which were the best accuracies for the flattest morph...

BEACH VOLUME CHANGE USING UAV PHOTOGRAMMETRY SONGJUNG BEACH, KOREA

Natural beach is controlled by many factors related to wave and tidal forces, wind, sediment, and initial topography. For this reason, if numerous topographic data of beach is accurately collected, coastal erosion/acceleration is able to be assessed and clarified. Generally, however, many studies on coastal erosion have limitation to analyse the whole beach, carried out of partial area as like shoreline (horizontal 2D) and beach profile (vertical 2D) on account of limitation of numerical simulation. This is an important application for prevention of coastal erosion, and UAV photogrammetry is also used to 3D topographic data. This paper analyses the use of unmanned aerial vehicles (UAV) to 3D map and beach volume change. UAV (Quadcopter) equipped with a non-metric camera was used to acquire images in Songjung beach which is located south-east Korea peninsula. The dynamics of beach topography, its geometric properties and estimates of eroded and deposited sand volumes were determined by combining elevation data with quarterly RTK-VRS measurements. To explore the new possibilities for assessment of coastal change we have developed a methodology for 3D analysis of coastal topography evolution based on existing high resolution elevation data combined with low coast, UAV and on-ground RTK-VRS surveys. DSMs were obtained by stereo-matching using Agisoft Photoscan. Using GCPs the vertical accuracy of the DSMs was found to be 10 cm or better. The resulting datasets were integrated in a local coordinates and the method proved to be a very useful fool for the detection of areas where coastal erosion occurs and for the quantification of beach change. The value of such analysis is illustrated by applications to coastal of South Korea sites that face significant management challenges.

BEACH VOLUME CHANGE USING UAV PHOTOGRAMMETRY SONGJUNG BEACH, KOREA

Abstract. Natural beach is controlled by many factors related to wave and tidal forces, wind, sediment, and initial topography. For this reason, if numerous topographic data of beach is accurately collected, coastal erosion/acceleration is able to be assessed and clarified. Generally, however, many studies on coastal erosion have limitation to analyse the whole beach, carried out of partial area as like shoreline (horizontal 2D) and beach profile (vertical 2D) on account of limitation of numerical simulation. This is an important application for prevention of coastal erosion, and UAV photogrammetry is also used to 3D topographic data. This paper analyses the use of unmanned aerial vehicles (UAV) to 3D map and beach volume change. UAV (Quadcopter) equipped with a non-metric camera was used to acquire images in Songjung beach which is located south-east Korea peninsula. The dynamics of beach topography, its geometric properties and estimates of eroded and deposited sand volumes were determined by combining elevation data with quarterly RTK-VRS measurements. To explore the new possibilities for assessment of coastal change we have developed a methodology for 3D analysis of coastal topography evolution based on existing high resolution elevation data combined with low coast, UAV and on-ground RTK-VRS surveys. DSMs were obtained by stereo-matching using Agisoft Photoscan. Using GCPs the vertical accuracy of the DSMs was found to be 10 cm or better. The resulting datasets were integrated in a local coordinates and the method proved to be a very useful fool for the detection of areas where coastal erosion occurs and for the quantification of beach change. The value of such analysis is illustrated by applications to coastal of South Korea sites that face significant management challenges.

3D MODELLING AND INTERACTIVE WEB-BASED VISUALIZATION OF CULTURAL HERITAGE OBJECTS

Nowadays, there are rapid developments in the fields of photogrammetry, laser scanning, computer vision and robotics, together aiming to provide highly accurate 3D data that is useful for various applications. In recent years, various LiDAR and image-based techniques have been investigated for 3D modelling because of their opportunities for fast and accurate model generation. For cultural heritage preservation and the representation of objects that are important for tourism and their interactive visualization, 3D models are highly effective and intuitive for present-day users who have stringent requirements and high expectations. Depending on the complexity of the objects for the specific case, various technological methods can be applied. The selected objects in this particular research are located in Bulgaria – a country with thousands of years of history and cultural heritage dating back to ancient civilizations. \this motivates the preservation, visualisation and recreation of undoubtedly valuable historical and architectural objects and places, which has always been a serious challenge for specialists in the field of cultural heritage. <br><br> In the present research, comparative analyses regarding principles and technological processes needed for 3D modelling and visualization are presented. The recent problems, efforts and developments in interactive representation of precious objects and places in Bulgaria are presented. Three technologies based on real projects are described: (1) image-based modelling using a non-metric hand-held camera; (2) 3D visualization based on spherical panoramic images; (3) and 3D geometric and photorealistic modelling based on architectural CAD drawings. Their suitability for web-based visualization are demonstrated and compared. Moreover the possibilities for integration with additional information such as interactive maps, satellite imagery, sound, video and specific information for the objects are described. This comparative study discusses the advantages and disadvantages of these three approaches and their integration in multiple domains, such as web-based 3D city modelling, tourism and architectural 3D visualization. It was concluded that image-based modelling and panoramic visualisation are simple, fast and effective techniques suitable for simultaneous virtual representation of many objects. However, additional measurements or CAD information will be beneficial for obtaining higher accuracy.

3D MODELLING AND INTERACTIVE WEB-BASED VISUALIZATION OF CULTURAL HERITAGE OBJECTS

Abstract. Nowadays, there are rapid developments in the fields of photogrammetry, laser scanning, computer vision and robotics, together aiming to provide highly accurate 3D data that is useful for various applications. In recent years, various LiDAR and image-based techniques have been investigated for 3D modelling because of their opportunities for fast and accurate model generation. For cultural heritage preservation and the representation of objects that are important for tourism and their interactive visualization, 3D models are highly effective and intuitive for present-day users who have stringent requirements and high expectations. Depending on the complexity of the objects for the specific case, various technological methods can be applied. The selected objects in this particular research are located in Bulgaria – a country with thousands of years of history and cultural heritage dating back to ancient civilizations. \\this motivates the preservation, visualisation and recreation of undoubtedly valuable historical and architectural objects and places, which has always been a serious challenge for specialists in the field of cultural heritage. In the present research, comparative analyses regarding principles and technological processes needed for 3D modelling and visualization are presented. The recent problems, efforts and developments in interactive representation of precious objects and places in Bulgaria are presented. Three technologies based on real projects are described: (1) image-based modelling using a non-metric hand-held camera; (2) 3D visualization based on spherical panoramic images; (3) and 3D geometric and photorealistic modelling based on architectural CAD drawings. Their suitability for web-based visualization are demonstrated and compared. Moreover the possibilities for integration with additional information such as interactive maps, satellite imagery, sound, video and specific information for the objects are described. This comparative study discusses the advantages and disadvantages of these three approaches and their integration in multiple domains, such as web-based 3D city modelling, tourism and architectural 3D visualization. It was concluded that image-based modelling and panoramic visualisation are simple, fast and effective techniques suitable for simultaneous virtual representation of many objects. However, additional measurements or CAD information will be beneficial for obtaining higher accuracy.

IMAGE NETWORK GENERATION OF UNCALIBRATED UAV IMAGES WITH LOW-COST GPS DATA

Abstract. The use of unmanned air vehicle (UAV) images acquired by a non-metric digital camera to establish an image network is difficult in cases without accurate camera model parameters. Although an image network can be generated by continuously calculating camera model parameters during data processing as an incremental structure from motion (SfM) methods, the process is time consuming. In this study, low-cost global position system (GPS) information is employed in image network generation to decrease computational expenses. Each image is considered as reference, and its neighbor images are determined based on GPS coordinates during processing. The reference image and its neighbor images constitute an image group, which is used to generate a free network through image matching and relative orientation. Data are then transformed from the free network coordinate system of each group into the GPS coordinate system by using the GPS coordinates of each image. After the exterior elements of each image are determined in the GPS coordinate system, the initial image network is established. Finally, self-calibration bundle adjustment constrained by GPS coordinates is conducted to refine the image network. The proposed method is validated on three fields. Results confirm that the method can achieve good image network when accurate camera model parameters are unavailable.

IMAGE NETWORK GENERATION OF UNCALIBRATED UAV IMAGES WITH LOW-COST GPS DATA

The use of unmanned air vehicle (UAV) images acquired by a non-metric digital camera to establish an image network is difficult in cases without accurate camera model parameters. Although an image network can be generated by continuously calculating camera model parameters during data processing as an incremental structure from motion (SfM) methods, the process is time consuming. In this study, low-cost global position system (GPS) information is employed in image network generation to decrease computational expenses. Each image is considered as reference, and its neighbor images are determined based on GPS coordinates during processing. The reference image and its neighbor images constitute an image group, which is used to generate a free network through image matching and relative orientation. Data are then transformed from the free network coordinate system of each group into the GPS coordinate system by using the GPS coordinates of each image. After the exterior elements of each image are determined in the GPS coordinate system, the initial image network is established. Finally, self-calibration bundle adjustment constrained by GPS coordinates is conducted to refine the image network. The proposed method is validated on three fields. Results confirm that the method can achieve good image network when accurate camera model parameters are unavailable.