What does it look like? An artificial neural network model to predict the physical dense 3D appearance of a large-scale object

Abstract

Object 3D reconstruction is a well-known ill-posed problem that has been extensively studied and making compelling progress, especially in recent years. This is owing to the rise of computational capability in enabling the efficient processing of neural networks. This article presents a benchmark for image-based 3D reconstruction in a realistic condition. Particularly, a novel pipeline is developed to localize the dense surface of a large-scale object at different twisting angles. A shallow artificial neural network with a single hidden layer is devised to learn the correlation between the simulated frame and ground-truth data points. As a result, the proposed framework demonstrates the robustness of the model by providing a valid and reasonable prediction performance in practical problems. Notably, remarkably low RMSE of 8 and a high R2 of 1 are yielded when evaluated in a dataset of 211 sample data. Specifically, a curvature dataset is constructed by twisting a 90 kg metal board at several angles, using two six-axis articulated industrial robots.