Abstract

With the growth of access to faster computers and more powerful cameras, the 3D reconstruction of objects has become one of the public's main topics of research and demand. This task is vigorously applied in creating virtual environments, creating object models, and other activities. One of the techniques for obtaining 3D features is photogrammetry, mapping objects and scenarios using only images. However, this process is very costly and can be pretty time-consuming for large datasets. This paper proposes a robust, efficient reconstruction pipeline with a low runtime in batch processing and permissive code. It is even possible to commercialize it without the need to keep the code open. We mix an improved structure from motion algorithm and a recurrent multi-view stereo reconstruction. We also use the Point Cloud Library for normal estimation, surface reconstruction, and texture mapping. We compare our results with state-of-the-art techniques using benchmarks and our datasets. The results showed a decrease of 69.4% in the average execution time, with high quality but a greater need for more images to achieve complete reconstruction.

Highlights

  • The creation of 3D assests is one of the main challenges in Virtual Reality (VR) and Augmented Reality (AR)

  • The proposed 3D reconstruction pipeline was evaluated through both qualitative and quantitative comparison of the reconstructed scenes with COLMAP and Multi­View Reconstruction Environment (MVE) pipeline

  • We managed to run the inference in C ++ using ONNX, but it was not a stable solution, and some adjustments are still needed for its conclusion

Read more

Summary

Introduction

The creation of 3D assests is one of the main challenges in Virtual Reality (VR) and Augmented Reality (AR). These can be done by photogrammetry, mapping objetcs and sce­ narios using only images or video frames. For the task of 3D reconstruction through images, they are usually made from several available technologies. This combination consists of Structure for Motion (SfM) (Ullman, 1979), the aforementioned MVS, and a mesh and texturing stage. SfM allows the mapping of previously unknown envi­ ronments and selects the pose information from the camera. Is in the final mesh step where the algorithm makes point cloud triangulation and gives texture to the reconstruction

Methods
Results
Discussion
Conclusion
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call