Tasks In Photogrammetry Research Articles

Towards accurate binocular vision of satellites: A cascaded multi-scale pyramid network for stereo matching on satellite imagery

Stereo matching of high-resolution satellite stereo images is a fundamental and challenging task in photogrammetry, geoscience, and remote sensing. Some deep learning-based methods have shown great potential in solving this task recently. However, these methods have not attracted much attention as their accuracy is still unsatisfactory, especially in regions with intractable factors (e.g., occlusions, repetitive patterns, low texture, non-texture, and disparity discontinuities). To tackle these challenging factors and improve disparity accuracy, we propose an end-to-end stereo matching network named Cascaded Multi-Scale Pyramid Network (CMSP-Net). Firstly, to fully utilize the multi-level spatial context information and mitigate the ambiguous matching caused by repetitive patterns, low texture, non-texture, and occlusions, a cost volume pyramid is constructed with multi-scale image features. Then, each cost volume in the pyramid is aggregated with an hourglass structure to exploit the multi-scale context in a single cost volume. Secondly, considering that high-resolution cost volumes contain more detailed information but have small receptive fields, while low-resolution ones have large receptive fields but lack details, we design an Attention-Guided Cost Fusion (AGCF) strategy to fuse pyramid cost volumes, which effectively integrates the advantages of multi-scale cost volumes while mitigating the backfiring caused by semantic inconsistency across different scales. Thirdly, a disparity refinement module is designed to improve overall disparity accuracy further, which incorporates the reconstruction error and edge clues of input satellite stereo images. Extensive experimental results on multiple satellite datasets demonstrate that the proposed method can effectively reduce matching ambiguities and recover sharp disparity discontinuities, achieving clear superiority over existing state-of-the-art methods.

Depth estimation and 3D reconstruction from UAV-borne imagery: Evaluation on the UseGeo dataset

Depth estimation and 3D model reconstruction from aerial imagery is an important task in photogrammetry, remote sensing, and computer vision. To compare the performance of different image-based approaches, this study presents a benchmark for UAV-based aerial imagery using the UseGeo dataset. The contributions include the release of various evaluation routines on GitHub, as well as a comprehensive comparison of baseline approaches, such as methods for offline multi-view 3D reconstruction resulting in point clouds and triangle meshes, online multi-view depth estimation, as well as single-image depth estimation using self-supervised deep learning. With the release of our evaluation routines, we aim to provide a universal protocol for the evaluation of depth estimation and 3D reconstruction methods on the UseGeo dataset. The conducted experiments and analyses show that each method excels in a different category: the depth estimation from COLMAP outperforms that of the other approaches, ACMMP achieves the lowest error and highest completeness for point clouds, while OpenMVS produces triangle meshes with the lowest error. Among the online methods for depth estimation, the approach from the Plane-Sweep Library outperforms the FaSS-MVS approach, while the latter achieves the lowest processing time. And even though the particularly challenging nature of the dataset and the small amount of training data leads to a significantly higher error in the results of the self-supervised single-image depth estimation approach, it outperforms all other approaches in terms of processing time and frame rate. In our evaluation, we have also considered modern learning-based approaches that can be used for image-based 3D reconstruction, such as NeRFs. However, due to the significantly lower quality of the resulting 3D models, we have only included a qualitative comparison between NeRF-based and conventional approaches in the scope of this work.

The Plumb-Line Matching Algorithm for UAV Oblique Photographic Photos

Building facades has always been a challenge for feature matching in oblique photogrammetry due to weak textures, non-Lambertian objects, severe occlusion, and distortion. Plumb lines are essential building geometry structural feature lines in building facades, which show strong spatial relevance to these problems. Achieving plumb line matching has great application potential for optimizing the process and products of oblique photogrammetry. Thus, we proposed a novel matching algorithm for plumb lines based on spatial and color hybrid constraints according to its central projection imaging characteristics. Firstly, based on vanishing point theory, the plumb lines from photos were back-calculated to determine the matching target set; secondly, the property of its large elevation ranges was exploited to calculate the homonymous points as spatial constraints by projecting plumb lines onto the stratified spatial planes; thirdly, the neighboring primary colors on both sides of the plumb lines were extracted as feature descriptors and compared by colorimetry; then, the greedy strategy was employed to successively filter out the locally optimal solutions satisfying the spatial and color hybrid constraints to complete the initial matching; finally, the intersection-over-union analysis of the solution plane and the verticalness evaluation of the matching results were implemented to eliminate errors. The results show that the proposed algorithm can achieve an average accuracy of 97.29% and 78.41% in the forward and lateral overlap experiments from multi-scenes, respectively, displaying a strong adaptability to poor texture, inconsistency, and distortion. In conclusion, thanks to the plumb-line-oriented matching strategy, this algorithm owns inherent advantages in theory and computational complexity. It is suitable for all building-oriented oblique photogrammetry tasks and is highly worthy of promotion and application.

Альтернативная оценка точности в обратных задачах фотограмметрии

This is the fifth article in a series of publications on improving the statistical quality of solving inverse photogrammetry tasks. As a consequence of the algorithms developed before, to improve the statistical quality of the equalization, the possibility of evaluating its accuracy results has become quite obvious and unexpected at the same time. The essence of the methods used to assess the exactness of direct and indirect measurements is described. Their shortcomings are noted. Based on the analysis of the algorithms for correcting, a new, alternative method for evaluating the mentioned results is proposed. Its advantages in comparison with known methods are noted. The main ones are

Learning‐based encoded target detection on iteratively orthorectified images for accurate fisheye calibration

AbstractFisheye camera calibration is an essential task in photogrammetry. However, previous calibration patterns and the robustness of the adjoint processing methods are limited due to the fisheye distortion and various lighting. This problem leads to additional manual intervention in the data collection. Moreover, it is arduous to accurately detect the board target under fisheye's distortion. To increase the robustness in this task, we present a novel encoded board “Meta‐Board” and a learning‐based target detection method. Additionally, an automatic image orthorectification is integrated to alleviate the distortion effect on the target iteratively until convergence. A low‐cost control field with the proposed boards is built for the experiment. Results on both virtual and real camera lenses and multi‐camera rigs show that our method can be robustly used in calibrating the fisheye camera and reaches state‐of‐the‐art accuracy.

Веса косвенных измерений в обратных задачах фотограмметрии

This is the fourth article in the series of publications on ways of improving the statistical quality of solving inverse photogrammetry tasks. It deals with researching the impact of indirect measurement weights on the equalization’s statistical quality. The author established that following its criteria is the key to the most plausible distribution of errors on the effects of indirect measurements. Since the accuracy of the equalization is estimated by the remainder residuals of the indirect measurements groups, the reliability of these evaluations depends on how strictly the criteria for the statistical quality of the equalization are met. The standard of indicators’ accuracy reliability is obtained. An algorithm for adjusting their weights during equalization was developed. An experimental approbation of the technique was performed. Based on the results of the calculations, the effectiveness of the joint application of all ways developed in this and previous articles is established to improve the statistical quality and obtain a reliable estimate of the equalization computations accuracy. In addition, it turned out that the application of the developed algorithms enables increasing the numerical stability of the mentioned calculations and ensure the stability of the results. The expediency of clarifying the initial values of direct measurements of the equalized parameters is confirmed. The explanation of the obtained results in terms of covariance analysis is given.

Computer and Physical Modeling for the Estimation of the Possibility of Application of Convolutional Neural Networks in Close-Range Photogrammetry

Close-range photogrammetry is widely used to measure the surface shape of various objects and its deformations. The classic approach for this is to use a stereo pair of images, which are captured from different angles using two digital video cameras. The surface shape is measured by triangulating a set of corresponding two-dimensional points from these images using a predetermined location of cameras relative to each other. Various algorithms are used to find these points. Several photogrammetry methods use cross-correlation for this purpose. This paper discusses the possibility of replacing the correlation algorithm with neural networks to determine displacements of small areas in the images. They allow increasing the calculation speed and the spatial resolution of the measurement results. To verify the possibility of using convolutional networks for photogrammetry tasks, computer and physical modeling were carried out. For the first test, a set of synthetically generated images representing images of the Particle Image Velocimetry method was used. The displacements of particles in the images are known, it allows to estimate the accuracy of processing of such images. For the second test, a series of experimental images with surfaces with different deformation was obtained. Computational experiments were performed to process synthetic and experimental images using selected neural networks and a classical cross-correlation algorithm. The limitations on the use of the compared algorithms were determined and their error in reconstructing the three-dimensional shape of the surface was evaluated. Computer and physical modeling have shown the operability and efficiency of neural networks for processing photogrammetry images.

Design and manufacturing of an optimized retro reflective marker for photogrammetric pose estimation in ITER

Retro reflective markers can remarkably aid photogrammetry tasks in challenging visual environments. They have been demonstrated to be key enablers of pose estimation for remote handling in ITER. However, the strict requirements of the ITER environment have previously markedly constrained the design of such elements and limited their performance. In this work, we identify several retro reflector designs based on the cat’s eye principle that are applicable to the ITER usecase and propose a methodology for optimizing their performance. We circumvent some of the environmental constraints by changing the curvature radius and distance to the reflective surface. We model, manufacture and test a marker that fulfils all the application requirements while achieving a performance increase of at least 50% over the previous solution in the targeted working range.

ORIENTATION OF IMAGES WITH LOW CONTRAST TEXTURES AND TRANSPARENT OBJECTS

Abstract. Objects with non-collaborative or transparent surfaces pose challenges to image orientation procedures and are an open research task in photogrammetry and computer vision. In this paper, we analyse the critical issues that cause image orientation failures and propose two approaches that leverage the low-contrast textures present on object surfaces to accurately orient an image block. Both approaches privilege tie point detection on low-contrast textures, discarding specular reflections and static tie points. In the first approach local descriptors are extracted in those regions where roughness and micro-structures are better highlighted, applying the normalized cross-correlation (NCC) on the gradient map of the images to fully exploit the geometrical content of the patches. The second approach builds on the first method modifying the classic RootSIFT pipeline and obtaining a faster and more reliable approach. Different transparent objects with different surface characteristics are tested to evaluate the efficiency and reliability of the proposed pipelines for image orientation and successive dense 3D reconstruction.

Point2Roof: End-to-end 3D building roof modeling from airborne LiDAR point clouds

Three-dimensional (3D) building roof reconstruction from airborne LiDAR point clouds is an important task in photogrammetry and computer vision. To automatically reconstruct the 3D building models at Level of Detail 2 (LoD-2) from airborne LiDAR point clouds, the data-driven approaches usually need to be performed in two steps: geometric primitive extraction and roof structure inference. Obviously, the traditional approaches are not end-to-end, the accumulated errors in different stages cannot be avoided and the final 3D roof models may not be optimal. In addition, the results of 3D roof models largely depend on the accuracy of geometric primitives (planes, lines, etc.). To solve these problems, we present a deep learning-based approach to directly reconstruct building roofs from airborne LiDAR point clouds, named Point2Roof. In our method, we start by extracting the deep features for each input point using PointNet++. Then, we identify a set of candidate corner points from the input point clouds using the extracted deep features. In addition, we also regress the offset for each candidate corner point to refine their locations. After that, these candidates are clustered into a set of initial vertices, and we further refine their locations to obtain the final accurate vertices. Finally, we propose a Paired Point Attention (PPA) module to predict the true model edges from an exhaustive set of candidate edges between the vertices. Unlike traditional roof modeling approaches, the proposed Point2Roof is end-to-end. However, due to the lack of a building reconstruction dataset, we construct a large-scale synthetic dataset to verify the effectiveness and robustness of the proposed Point2Roof. The experimental results conducted on the synthetic benchmark demonstrate that the proposed Point2Roof significantly outperforms the traditional roof modeling approaches. The experiments also show that the network trained on the synthetic dataset can be applied to the real point clouds after fine-tuning the trained model on a small real dataset. The large-scale synthetic dataset, the small real dataset and the source code of our approach are publicly available in https://github.com/Li-Li-Whu/Point2Roof.

Dual Guided Aggregation Network for Stereo Image Matching.

Stereo image dense matching, which plays a key role in 3D reconstruction, remains a challenging task in photogrammetry and computer vision. In addition to block-based matching, recent studies based on artificial neural networks have achieved great progress in stereo matching by using deep convolutional networks. This study proposes a novel network called a dual guided aggregation network (Dual-GANet), which utilizes both left-to-right and right-to-left image matchings in network design and training to reduce the possibility of pixel mismatch. Flipped training with a cost volume consistentization is introduced to realize the learning of invisible-to-visible pixel matching and left–right consistency matching. In addition, suppressed multi-regression is proposed, which suppresses unrelated information before regression and selects multiple peaks from a disparity probability distribution. The proposed dual network with the left–right consistent matching scheme can be applied to most stereo matching models. To estimate the performance, GANet, which is designed based on semi-global matching, was selected as the backbone with extensions and modifications on guided aggregation, disparity regression, and loss function. Experimental results on the SceneFlow and KITTI2015 datasets demonstrate the superiority of the Dual-GANet compared to related models in terms of average end-point-error (EPE) and pixel error rate (ER). The Dual-GANet with an average EPE performance = 0.418 and ER (>1 pixel) = 5.81% for SceneFlow and average EPE = 0.589 and ER (>3 pixels) = 1.76% for KITTI2005 is better than the backbone model with the average EPE performance of = 0.440 and ER (>1 pixel) = 6.56% for SceneFlow and average EPE = 0.790 and ER (>3 pixels) = 2.32% for KITTI2005.

DEEP LEARNING FOR 3D BUILDING RECONSTRUCTION: A REVIEW

Abstract. 3D building reconstruction using Earth Observation (EO) data (aerial and satellite imagery, point clouds, etc.) is an important and active research topic in different fields, such as photogrammetry, remote sensing, computer vision and Geographic Information Systems (GIS). Nowadays 3D city models have become an essential part of 3D GIS environments and they can be used in many applications and analyses in urban areas. The conventional 3D building reconstruction methods depend heavily on the data quality and source; and manual efforts are still needed for generating the object models. Several tasks in photogrammetry and remote sensing have been revolutionized by using deep learning (DL) methods, such as image segmentation, classification, and 3D reconstruction. In this study, we provide a review on the state-of-the-art machine learning and in particular the DL methods for 3D building reconstruction for the purpose of city modelling using EO data. This is the first review with a focus on object model generation based on the DL methods and EO data. A brief overview of the recent building reconstruction studies with DL is also given. We have investigated the different DL architectures, such as convolutional neural networks (CNNs), generative adversarial networks (GANs), and the combinations of conventional approaches with DL in this paper and reported their advantages and disadvantages. An outlook on the future developments of 3D building modelling based on DL is also presented.

HMSM-Net: Hierarchical multi-scale matching network for disparity estimation of high-resolution satellite stereo images

Disparity estimation of satellite stereo images is an essential and challenging task in photogrammetry and remote sensing. Recent researches have greatly promoted the development of disparity estimation algorithms by using CNN (Convolutional Neural Networks) based deep learning techniques. However, it is still difficult to handle intractable regions that are mainly caused by occlusions, disparity discontinuities, texture-less areas, and repetitive patterns. Besides, the lack of training datasets for satellite stereo images remains another major issue that blocks the usage of CNN techniques due to the difficulty of obtaining ground-truth disparities. In this paper, we propose an end-to-end disparity learning model, termed hierarchical multi-scale matching network (HMSM-Net), for the disparity estimation of high-resolution satellite stereo images. First, multi-scale cost volumes are constructed by using pyramidal features that capture spatial information of multiple levels, which learn correspondences at multiple scales and enable HMSM-Net to be more robust in intractable regions. Second, stereo matching is executed in a hierarchical coarse-to-fine manner by applying supervision to each scale, which allows a lower scale to act as prior knowledge and guides a higher scale to attain finer matching results. Third, a refinement module that incorporates the intensity and gradient information of the input left image is designed to regress a detailed full-resolution disparity map for local structure preservation. For network training and testing, a dense stereo matching dataset is created and published by using GaoFen-7 satellite stereo images. Finally, the proposed network is evaluated on the Urban Semantic 3D and GaoFen-7 datasets. Experimental results demonstrate that HMSM-Net achieves superior accuracy compared with state-of-the-art methods, and the improvement on intractable regions is noteworthy. Additionally, results and comparisons of different methods on the GaoFen-7 dataset show that it can severs as a challenging benchmark for performance assessment of methods applied to disparity estimation of satellite stereo images. The source codes and evaluation dataset are made publicly available at https://github.com/Sheng029/HMSM-Net.

Locally Nonlinear Affine Verification for Multisensor Image Matching

Matching local features between two overlapped images is a fundamental task in photogrammetry and remote sensing. However, images acquired by multiple sensors often differ substantially in properties, thus posing a great challenge to the robustness and flexibility of feature matching methods. In this article, we propose a locally non-linear affine verification (LAV) method for robust multisensor image matching. The main idea of the LAV is the development of a nonlinear regression formulation that practically models the nonlinear deviation of a real surface around a point from its tangent plane during affine verification. Specifically, we start by selecting a restricted set of reliable and well-distributed putative matches as the matching seeds and assign them with neighbors to construct search spaces. In each search space, the regression seeks the smoothest affine model consistent with the latent correct matches, thereby deriving a set of affine parameters to verify correspondence hypotheses for true matches. The verification can be extended to all nearest neighbor matches to discover additional inlier matches. Evaluation on multisensor image datasets with different extents of variations in viewpoint, scale, illumination, and appearance shows that the proposed LAV consistently outperforms existing methods. LAV can achieve a considerable number of high-quality matches, in cases where existing methods provide few or no correct matches.

Learning Polynomial-Based Separable Convolution for 3D Point Cloud Analysis.

Shape classification and segmentation of point cloud data are two of the most demanding tasks in photogrammetry and remote sensing applications, which aim to recognize object categories or point labels. Point convolution is an essential operation when designing a network on point clouds for these tasks, which helps to explore 3D local points for feature learning. In this paper, we propose a novel point convolution (PSConv) using separable weights learned with polynomials for 3D point cloud analysis. Specifically, we generalize the traditional convolution defined on the regular data to a 3D point cloud by learning the point convolution kernels based on the polynomials of transformed local point coordinates. We further propose a separable assumption on the convolution kernels to reduce the parameter size and computational cost for our point convolution. Using this novel point convolution, a hierarchical network (PSNet) defined on the point cloud is proposed for 3D shape analysis tasks such as 3D shape classification and segmentation. Experiments are conducted on standard datasets, including synthetic and real scanned ones, and our PSNet achieves state-of-the-art accuracies for shape classification, as well as competitive results for shape segmentation compared with previous methods.

Point Cloud Semantic Segmentation Network Based on Multi-Scale Feature Fusion.

The semantic segmentation of small objects in point clouds is currently one of the most demanding tasks in photogrammetry and remote sensing applications. Multi-resolution feature extraction and fusion can significantly enhance the ability of object classification and segmentation, so it is widely used in the image field. For this motivation, we propose a point cloud semantic segmentation network based on multi-scale feature fusion (MSSCN) to aggregate the feature of a point cloud with different densities and improve the performance of semantic segmentation. In our method, random downsampling is first applied to obtain point clouds of different densities. A Spatial Aggregation Net (SAN) is then employed as the backbone network to extract local features from these point clouds, followed by concatenation of the extracted feature descriptors at different scales. Finally, a loss function is used to combine the different semantic information from point clouds of different densities for network optimization. Experiments were conducted on the S3DIS and ScanNet datasets, and our MSSCN achieved accuracies of 89.80% and 86.3%, respectively, on these datasets. Our method showed better performance than the recent methods PointNet, PointNet++, PointCNN, PointSIFT, and SAN.

Point Cloud Registration Based on One-Point RANSAC and Scale-Annealing Biweight Estimation

Point cloud registration (PCR) is an important task in photogrammetry and remote sensing, whose goal is to seek a seven-parameter similarity transformation to register a pair of point clouds. Traditional iterative closest point (ICP) variants highly rely on the initial parameters, and most of them cannot deal with cross-source (multisource) point clouds with scale changes. In this article, we propose a flexible correspondence-based PCR method, which is initial-guess free, fast, and robust. We first decompose the full seven-parameter registration problem into three subproblems, i.e., scale, rotation, and translation estimations, based on line vectors. Then, we propose a one-point random sample consensus (RANSAC) algorithm to estimate the scale and translation parameters. For the rotation estimation, we introduce a graduated optimization strategy into Tukey’s biweight function and propose a scale-annealing biweight estimator. We evaluate the proposed method on both same-source and cross-source data. Results show that the proposed method is robust against over 99% outliers and is one to two orders of magnitude faster than its competitors. The source code of our method will be made public.

A Geometric Estimation Technique Based on Adaptive M-Estimators: Algorithm and Applications

Robust fitting is a basic technique and has been widely applied in photogrammetry and remote sensing, such as geometric correction. As known, typical robust estimators (include M-estimators, S-estimators, MM-estimators, etc.) often fail when outlier rate is higher than 50%, even if the outliers are uniformly distributed. In this article, we propose simple yet effective estimators, called adaptive M-estimators (AM-estimators). They are still robust under 80% of outliers. The proposed AM-estimators are very important supplements of M-estimators. Different from M-estimators, we use a varying parameter (shape-control parameter) instead of the original constant parameter in the weight function. The shape-control parameter decreases along with iterations in iteratively reweighted least squares, namely, AM-estimators are optimized in a coarse-to-fine manner. We adapt the proposed estimators into classical remote sensing and photogrammetry tasks, including mismatch removal, camera orientation (or called perspective-n-point), and point set registration to demonstrate their powers. Extensive synthetic and real experiments show that AM-estimators are superior to M-estimators, S-estimators, MM-estimators, and RANSAC-type methods. The source code of AM-estimators will be publicly available at https://ljy-rs.github.io/web .

ГЕОДЕЗІЯ, КАРТОГРАФІЯ І АЕРОФОТОЗНІМАННЯ

Aim. Determination of the elements of external spatial orientation of the surveying systems at the moment of image acquisition is the fundamental task in photogrammetry. Principally, this problem is solving in two ways. The first way is direct positioning and measuring of directions of camera optical axis in the geodetic space with the help of GNSS/INS equipment. The second way is the analytical solution of the problem using a set of reference information (often such information is a set of ground control points whose geodetic positions are known with sufficient accuracy and which are reliably recognised on aerial images of the photogrammetric block). The authors consider the task of providing reference and control information using the second approach, which has a number of advantages in terms of reliability and accuracy of determining the unknown image exterior orientation parameters. It is proposed to obtain additional images of ground control points by the method of their auxiliary aerial photography using an unmanned aerial vehicle (UAV) on a larger scale compared to the scale of the images of the photogrammetric block. The aim of the presented work is the implementation of the method of creating reference points and experimental confirmation of its effectiveness for photogrammetric processing. Methods and results. For the entire realization of the potential of the analytical way to determine the elements of external orientation of images, it is necessary to have a certain number of ground control points (GCP) and to keep the defined scheme of their location on the photogrammetric block. As the main source of input data authors use UAV aerial images of the terrain, which are obtained separately from the block of aerial survey, and have a better geometric resolution and which clearly depict the control reference points. Application of such auxiliary images gives the possibility of automated transferring of the position of ground control point into images of the main photogrammetric block. In our interpretation, these images of ground control points and their surroundings on the ground are called "control reference images". The basis of the work is to develop a method for obtaining the auxiliary control reference images and transferring of position of GCP depicted on them into aerial or space images of terrain by means of computer stereo matching. To achieve this goal, we have developed a processing method for the creation of control reference images of aerial image or a series of auxiliary multi-scale aerial images obtained by a drone from different heights above the reference point. The operator identifies and measures the GCP once on the auxiliary aerial image of the highest resolution. Then there is an automatic stereo matching of the control reference image in the whole series of auxiliary images in succession with a decrease in the resolution and, ultimately, directly with the aerial images of photogrammetric block. On this stage there are no recognition/cursor targeting by the human operator, and therefore there are no discrepancies, errors or mistakes related to it. In addition, if to apply fairly large size of control reference images, the proposed method can be used on a low-texture terrain, and therefore deal in many cases without the physical marking of points measured by GNSS method. And this is a way to simplify and reduce the cost of photogrammetric technology. The action of the developed method has been verified experimentally to provide the control reference information of the block of archival aerial images of the low-texture terrain. The results of the experimental approbation of the proposed method give grounds to assert that the method makes it possible to perform geodetic reference of photogrammetric projects more efficiently due to the refusal of the physical marking of the area before aerial survey. The proposed method can also be used to obtain the information for checking the quality of photogrammetric survey for provision of check points. The authors argue that the use of additional equipment - UAV of semi-professional class to obtain control reference images is economically feasible. Scientific novelty and practical relevance. The results of approbation of the "control reference image" method with obtaining stereo pairs of aerial images with vertical placement of the base are presented for the first time. There was implemented the study of the properties of such stereo pairs of aerial images to obtain images of reference points. The effectiveness of including reference images in the main block of the digital aerial triangulation network created on UAV’s images is shown.

쿼터니언과 프로크루스테스를 이용한 점대선기반 3차원 좌표변환

3D coordinate transformation is the process of matching different three-dimensional coordinate systems equally, and is an important task in photogrammetry, computer vision, and robotics. This study proposed a method of using quaternions and Procrustes algorithms to fit different three-dimensional coordinate systems using points and straight lines. Rotational elements were calculated using quaternions by projecting the coordinates of the points in the model coordinate system onto those in the reference coordinate system. For the scale factor and three-dimensional translation, Procrustes algorithms using points and straight lines were then used. Indoor experiments using checker-boards were conducted, followed by experiments using outdoor data acquired from a terrestrial mobile mapping system. It was found that more than four point-to-line pairs are needed to perform three-dimensional transformation reliably.