Abstract

In order to reconstruct three-dimensional (3D) structures from an image sequence captured by unmanned aerial vehicles’ camera (UAVs) and improve the processing speed, we propose a rapid 3D reconstruction method that is based on an image queue, considering the continuity and relevance of UAV camera images. The proposed approach first compresses the feature points of each image into three principal component points by using the principal component analysis method. In order to select the key images suitable for 3D reconstruction, the principal component points are used to estimate the interrelationships between images. Second, these key images are inserted into a fixed-length image queue. The positions and orientations of the images are calculated, and the 3D coordinates of the feature points are estimated using weighted bundle adjustment. With this structural information, the depth maps of these images can be calculated. Next, we update the image queue by deleting some of the old images and inserting some new images into the queue, and a structural calculation of all the images can be performed by repeating the previous steps. Finally, a dense 3D point cloud can be obtained using the depth–map fusion method. The experimental results indicate that when the texture of the images is complex and the number of images exceeds 100, the proposed method can improve the calculation speed by more than a factor of four with almost no loss of precision. Furthermore, as the number of images increases, the improvement in the calculation speed will become more noticeable.

Highlights

  • Because of the rapid development of the unmanned aerial vehicle (UAV) industry in recent years, civil unmanned aerial vehicles’ camera (UAVs) have been used in agriculture, energy, environment, public safety, infrastructure, and other fields

  • Considering the continuity of the images taken by UAV camera, this paper proposes a 3D reconstruction method based on an image queue

  • Three principal component points reduce the computational complexity of feature point matching, we propose a method of compressing (PCPs) can be generated from PCA, each reflecting the distribution of the feature points in different the feature points based on principal component analysis (PCA)

Read more

Summary

Introduction

Because of the rapid development of the unmanned aerial vehicle (UAV) industry in recent years, civil UAVs have been used in agriculture, energy, environment, public safety, infrastructure, and other fields. The study of the methods in which 3D structures are generated by 2D images is an important branch of computer vision. In this field, many researchers have proposed several methods and theories [1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17]. Among these theories and methods, the three most important categories are the simultaneous localization and mapping (SLAM) [1,2,3], structure from motion (SfM) [4,5,6,7,8,9,10,11,12,13,14] and multiple view stereo (MVS) algorithms [15,16,17], which have been implemented in many practical applications

Methods
Results
Conclusion

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.