Value of Virtual Reality Technology in Image Inspection and 3D Geometric Modeling

Longyu Lu,Jinkai Ma,Shuying Qu

doi:10.1109/access.2020.3012207

Longyu Lu, Jinkai Ma + Show 1 more

Open Access

https://doi.org/10.1109/access.2020.3012207

Copy DOI

Abstract

Aiming at the poor expressive ability of image statistical information during the reconstruction process of traditional 3D image reconstruction method based on virtual reality technology, resulting in low accuracy of 3D image after reconstruction, a new image detection and 3D image reconstruction based on virtual reality technology are studied method. This paper first proposed a new two-level cascade convolutional neural network structure. The first level of the network predicts target positioning based on the image-level labels of the training image, generates a bounding box of the target in the original image, and generates a cropped image. The cropped image is input to the second-level network. The cropped image may contain areas where the target is stuck in the original image. Level 2 networks only use the adhesion area as training data. Secondly, the visualization software development platform and virtual reality 3D image processing software are selected as the platform for 3D image reconstruction. After the original image is imported into the computer through data input and file analysis steps, the original image is detected. The detected image is in the virtual in the real software, the bounding box method is first used to construct the three-dimensional data field of image reconstruction, and the three-dimensional direct volume of the image is drawn according to the three-dimensional data field of image reconstruction. Preferably, the three-dimensional image reconstruction output formula is obtained through the three-dimensional image direct volume to realize the three-dimensional image reconstruction based on the virtual reality technology. The simulation results show that the method proposed in this paper can effectively detect images. The average traversal coverage of 3D image reconstruction is up to 0.979, and the reconstruction accuracy is higher than 0.97.

Highlights

Virtual reality technology is a high-tech technology born with the development of science and technology
In order to make better use of the characteristic information implied in the data, this paper proposes an image detection and three-dimensional image reconstruction method based on virtual reality technology
2) POSITIONING RESULTS Since the goal of this paper is to solve the problem of multitarget adhesion in a single image, only using class activation mapping (CAM) cannot mark the overall position of the object for certain classes

Summary

Introduction

Virtual reality technology is a high-tech technology born with the development of science and technology. It refers to the formation of interactive three-dimensional dynamic simulation that simulates the real environment through the computer, enabling users to realize the immersive virtual reality effect through the computer [1]–[3]. The image has irregularities and is interfered by noise during the reconstruction process. 3D image reconstruction is more difficult [4], [5]. Traditional three-dimensional scene modeling methods mainly include modeling techniques based on geometric modeling and modeling techniques that use instrumentation to obtain scene depth information [10]–[11]. The modeling method based on a single image avoids complex image matching and constraints, data acquisition is more convenient and extensive, and has a wider application field, which is the current research hotspot [13]–[14]

Objectives

Results

Conclusion