Abstract

Abstract. Structure-from-Motion (SfM) and Multi-View Stereo (MVS) are widely used methods in three dimensional (3D) model reconstruction for an infrastructure maintenance purpose. However, if a set of images is not captured from well-placed positions, the final dense model can contain low-quality regions. Since MVS requires a much longer processing time than SfM as larger amounts of images are provided, it is impossible for surveyors to wait for the SfM–MVS process to complete and evaluate the geometric quality of a final dense model on-site. This challenge results in response inefficiency and the deterioration of dense models in 3D model reconstruction. If the quality of the final dense model can be predicted immediately after SfM, it will be possible to revalidate the images much earlier and to obtain the dense model with better quality than the existing SfM–MVS process. Therefore, we propose a method for reconstructing a more plausible 3D mesh model that accurately approximates the geometry of the final dense model only from sparse point clouds generated from SfM. This approximated mesh model can be generated using Delaunay triangulation for the sparse point clouds and triangle as well as tetrahedron filtering. The approximated model can be used to predict the geometric quality of the final dense model and for an optimization-based view planning. Some experimental results showed that our method is effective in predicting the quality of the final dense model and finding the potentially degraded regions. Moreover, it was confirmed that the average reconstruction errors of the dense model generated by the optimization-based view planning went below tens of millimeters and falls within an acceptable range for an infrastructure maintenance purpose.

Highlights

  • The increasing cost for inspecting and repairing aging infrastructures has been recently recognized to be a serious social problem, especially in many developed countries (ASCE, 2017)

  • We introduced triangular and tetrahedral mesh filtering to remove the inappropriate triangles and tetrahedra from the approximated mesh model based on the geometric features, so that the approximated mesh model could better fit with the final dense model reconstructed using the Multi-View Stereo (MVS)

  • We proposed an improved method to reconstruct a plausible mesh model that approximates the final dense model geometry only from sparse point clouds obtained from the SfM results based on the triangle and tetrahedron filtering

Read more

Summary

INTRODUCTION

The increasing cost for inspecting and repairing aging infrastructures has been recently recognized to be a serious social problem, especially in many developed countries (ASCE, 2017). Structure-from-Motion (SfM) and Multi-View Stereo (MVS) are the most economical and easy-to-use methods for reconstructing the 3D as-is models These methods can automatically generate a 3D dense model of structures, with rich textures of damaged and degraded regions, from many overlapped images using only a camera. Since MVS requires much longer processing time than SfM as larger amounts of images are provided, it is impossible for surveyors to wait for the SfM–MVS process to complete and evaluate the geometric quality of the final dense model on-site This challenge results in response inefficiency and the deterioration of dense models in 3D model reconstruction. It is preferable to estimate the quality of the final dense model and validate the photocapturing positions (camera poses) at an earlier stage than MVS. We can predict more accurate lowquality regions on the approximated triangular mesh model than those obtained using our previous method (Moritani, 2019)

RELATED WORK
Quality predictors
QUALITATIVE VALIDATION
OPTIMIZATION-BASED VIEW PLANNING AND QUANTITAVIE VALIDATION
CONCLUSIONS
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call