3D Scene Construction Research Articles

A 3D interactive scene construction method for interior design based on virtual reality

A 3D interactive scene construction method for interior design based on virtual reality

Breakthroughs and Applications of Augmented Reality (AR) Technology in the Digital Media Field

Abstract This study pioneers the application of augmented reality (AR) in the realm of digital media, integrating AR technology with cultural education and artistic media concepts to forge a novel trajectory for digital media art creation. It delves into AR 3D scene construction technologies, employing calibration through the reconstruction of 2D image sequences, feature point extraction for spatial coordinate transformation, and 3D model development. Furthermore, it utilizes Level of Detail (LOD) models and texture mapping technologies to enhance visualization and interaction. The research culminates in a comparative analysis of traditional and AR-based media, evaluating differences in appeal and assessing functional capabilities. The findings indicate that AR-based media outperforms traditional media across several functions: media search (0.385), virtual design (0.424), immersive experience (0.466), real-time interaction (0.525), and user communication (0.396), with users expressing high satisfaction with these enhanced capabilities. This study not only diminishes the complexities associated with integrating digital media and AR technologies but also optimizes and innovates traditional methodologies.

Algorithm for Creating 3d Scenes of Recognized Objects from Depth Maps

Purpose of research. Development of an algorithm for constructing 3d scenes of recognized objects from synthesized depth maps in order to improve the speed of real-time image processing.Methods. The 3d scene construction algorithm is based on the method of stereo image construction using a threelevel fuzzy depth map construction model. At the first level of this model the boundaries of objects are determined using a modified Canny algorithm, at the second level the values of disparity are calculated on the basis of the sum of absolute differences algorithm modified by fuzzy logic methods, and at the final level the gradients of distances from the boundaries of images to the edges of recognized objects are calculated first and then according to the obtained values of disparity at the second and third levels of the fuzzy hierarchical model, the refined values of disparity are calculated, which are used to carry out the analysis of the depth map.Results. An algorithm for constructing 3d scenes of recognized objects using synthesized depth maps has been developed. It was determined that the proposed algorithm has better performance compared to existing depth map algorithms such as conjugate point algorithm and pyramidal algorithm.Conclusion. The experimental results showed that the proposed algorithm has a lower complexity compared to the analyzed algorithms (conjugate points and pyramidal). The minimum average execution time of the 3d scene construction operation was about 1-2 minutes, which is almost 120 times better compared to the conjugate point algorithms.

A large‐scale urban 3D model organisation method considering spatial distribution of buildings

AbstractThe rendering of urban 3D scenes involves a large number of models. In order to render scenes more efficiently, the main solution is to build a level of detail model (LOD). This may have the problem of building fragmentation, while relying on building a level of detail model (LOD) alone cannot meet the accuracy and fluency of large‐scale scene visualisation. Effective and reasonable data organisation has important research significance for the authors to achieve accurate and fast rendering of scenes. Therefore, the authors propose a large‐scale city model data organisation method considering building distribution to solve the above problems. This method first classifies the buildings in the scene at macro‐, meso‐ and microscales and records the classification using R‐trees. Then an adaptive quadtree is used to construct the data index of the city model. Finally, the data organisation of the large‐scale 3D city model is achieved by using the information of each node of the R‐tree as a constraint and combining with the adaptive quadtree. The results show that the method not only ensures the integrity of the user's area of interest but also can improve the efficiency of 3D scene construction.

The 3D model construction method of overhead transmission line based on GIM

With the continuous progress of power grid digitization, Building Information Model (building information modeling, BIM) technology can no longer meet the application display requirements of power grid engineering. Power grid information model (grid information model, GIM) technology uses parameterization to build a 3D model, which reduces redundancy and is conducive to the digital transfer of the project. This paper briefly analyzes the structure of the GIM data model. It carries out research on 3D parametric modeling of overhead transmission line ground wire, tower, foundation, and insulator string based on GIM. It uses a 3D graphics engine to realize the visual rendering of ontology 3D models. On this basis, a 3D scene construction method of overhead transmission line engineering based on GIM is proposed, which provides reliable technical support for digital power grid applications.

When a tree model meets texture baking: an approach for quality-preserving lightweight visualization in virtual 3D scene construction

ABSTRACT Three-dimensional (3D) high-fidelity surface models play an important role in urban scene construction. However, the data quantity of such models is large and places a tremendous burden on rendering. Many applications must balance the visual quality of the models with the rendering efficiency. The study provides a practical texture baking processing pipeline for generating 3D models to reduce the model complexity and preserve the visually pleasing details. Concretely, we apply a mesh simplification to the original model and use texture baking to create three types of baked textures, namely, a diffuse map, normal map and displacement map. The simplified model with the baked textures has a pleasing visualization effect in a rendering engine. Furthermore, we discuss the influence of various factors in the process on the results, as well as the functional principles and characteristics of the baking textures. The proposed approach is very useful for real-time rendering with limited rendering hardware as no additional memory or computing capacity is required for properly preserving the relief details of the model. Each step in the pipeline is described in detail to facilitate the realization.

Research on the Symbolic 3D Route Scene Expression Method Based on the Importance of Objects

In the study of 3D route scene construction, the expression of key targets needs to be highlighted. This is because compared with the 3D model, the abstract 3D symbols can reflect the number and spatial distribution characteristics of entities more intuitively. Therefore, this research proposes a symbolic 3D route scene representation method based on the importance of the object. The method takes the object importance evaluation model as the theoretical basis, calculates the spatial importance of the same type of objects according to the spatial characteristics of the geographical objects in the 3D route scene, and constructs the object importance evaluation model by combining semantic factors. The 3D symbols are then designed in a hierarchical manner on the basis of the results of the object importance evaluation and the CityGML standard. Finally, the LOD0-LOD4 symbolic 3D railway scene was constructed on the basis of a railroad data to realise the multi-scale expression of symbolic 3D route scene. Compared with the conventional loading method, the real-time frame rate of the scene was improved by 20 fps and was more stable. The scene loading speed was also improved by 5–10 s. The results show that the method can effectively improve the efficiency of the 3D route scene construction and the prominent expression effect of the key objects in the 3D route scene.

Real-Time Performance Comparison of Vision-Based Autonomous Landing of Quadcopter on a Ground Moving Target

The tremendous applications of unmanned aerial vehicles (UAVs), such as inspection in complex environments, search, and rescue missions, have established this area of research. The domain of UAVs autonomous navigation and landing has received considerable amount of interest of robotics researchers in the past decades. Nevertheless, the limited capability of UAVs for autonomous landing severely hampers the use of aerial vehicles specially in GPS-denied areas. Fortunately, with the rapid development of computer vision, vision-based techniques have become an important and cheap tool to be used in UAVs for moving target detection and landing. In this paper, four major vision-based techniques namely PID controller, fuzzy logic, sliding mode control and model predictive control have been investigated and their landing performance is compared to each other. These landing techniques are implemented on a quadcopter for the purpose of ground moving target detection and then landing on it. The Raspberry Pi board with two Pi cameras for 3D scene construction and depth estimation along with ultrasonic sensor have been used in the quadcopter. A wheeled mobile robot with landing platform is taken as the target. The landing performance of different techniques has been observed and compared in terms of landing displacement error, time taken and the distance travelled to finish the operation in an open and obstacle-free environment. The simulation results are further verified by the hardware experiments.

Construction of 3D Scene of Transmission Line Corridor Based on GIM and 3D GIS

Transmission lines have the characteristics of strip distribution, wide coverage, and close connection with the actual geographical environment. The traditional transmission line modeling method has the defects of insufficient spatial positioning ability and weak information expression ability. Therefore, in this paper, three-dimensional geographic information system (3D GIS) and grid information model (GIM) are coordinated to make the two complementary advantages and construct the three-dimensional scene of transmission line corridor. First, The visible light images and high-precision laser point cloud data of transmission line corridor are collected by helicopter, and extract power lines and towers from the laser point cloud data. Then, the oblique photogrammetric model of large-scale scene is made from visible light images and modified. Finally, according to the point cloud of power line and tower, the improved template matching method is used to realize the rapid modeling of transmission line GIM model, and the transmission line model is obtained. A complete 3D digital twin scene model of transmission line corridor is formed by fusing scene model and transmission line model. The research results show that the 3D scene construction method of transmission line corridor based on 3D GIS and GIM not only improves the efficiency of transmission line modeling, but also has a good visual effect. The abundant line information is helpful for the visual operation and maintenance management of existing transmission lines from macro to micro, which provides data support for the construction of digital power grid.

Key technologies of 3D scene construction for remote assisted driving of intelligent ships

Objectives In order to realize the shore-based remote monitoring and management of the whole life cycle of intelligent ship navigation, this paper studies a virtual reality (VR)-based remote assisted driving support system for ships. Methods Through the real-time acquisition and fusion of ship situation information regarding navigation, and the dynamic and static target information of the ship, VR technology is used to reconstruct and present a navigation scene in way of omni-direction and multiple angle of view, a ship collision risk prediction model is established and the three-dimensional dynamic display of the navigation risk relationship between surrounding ships is created. Results The system can accurately display the real scene and state information of the ships during voyage, and provide a three-dimensional and multi-perspective look-out function. It not only provides comprehensive navigation information for ship pilots, but also achieves shore-based remote assistance driving support. Conclusions The results of this study can provide technical support and guarantees for the construction of integrated ship-shore intelligent systems.

Visualization of Spatio-Temporal Building Changes Using 3D Web GIS

Modern laser scanning methods and photogrammetric techniques provide tools for rapid data acquisition and semi-automated 3D scene construction. The common access to measuring sensors allow building digital representation of scanned objects relatively easy. This enables the construction of photorealistic building models and complex GIS/BIM models.Recently, increasing number of government departments and local councils trying to use 3D models as part of their planning, development, promotion strategy can be observed. To date, there is no universal, low-cost methodology that will allow visualizing changes of building facades using the Internet. The article presents a study which explored the possibilities of building a web application to visualize the changes in the buildings with the use of 3D models. It allows to integrate current three-dimensional models with those based on historical data. An interactive web application presenting the spatio-temporal changes of buildings in two study areas was presented (campus of the University of Warmia and Mazury and the Old Town of Olsztyn). The proposed architecture is low-cost and easy to implement. The content displayed on the map is determined by the timeline slider, which allows presenting changes in the building facades over time. Each building has its own attributes, some of which also have one or more 3D models. In the end, the potential stages of the system’s development were presented, including the possibility of participating volunteers in the process of obtaining historical data and using the Augmented Reality to present 3D models of the buildings directly in the field.

Інформаційна технологія побудови 3D сцен для віртуальної реальності з підвищеною швидкодією

The analysis of organization features of information technology for the 3D-scene construction is carried out in researches. The software package for both CPU and GPU-oriented software and hardware platform was developed. By using GPU cores for particles processing of 3D-scene the performance increase of processing operation was achieved. &nbsp

网络三维虚拟校园仿真平台构建

基于三维可视化、计算机网络等技术，实现校园室内外一体化三维虚拟仿真平台构建与发布。通过师院二维校园平面图，结合遥感影像数据，依据真实校园场景布局进行三维场景建模。基于CityEngine的CGA (Computer Generated Architecture)规则语言进行的校园三维场景构建，实现建筑物模型的快速生成和纹理自动映射，以及室内场景与行人、车俩、动态水和标志性建筑物等特殊模型的快速构建。同时，将摄像头等多源时空数据与校园管理系统接入三维校园平台，实现各教学楼属性信息和安防多媒体信息的展现与查询。此外，通过自动漫游等功能可对校园进行多方位展示。 Based on the technologies such as 3D visualization, computer network and so on, the establish-ment and publishment of campus indoor and outdoor integration 3D virtual simulation platform have been achieved. Through the 2D campus plan of the Guangxi Teachers Education University, combined with remote sensing image data, 3D scene is modeled according to the real campus scene layout. Campus 3D scene construction, based on CGA (Computer Generated Architecture) rule language of City Engine, has achieved the rapid generation of building models and automatic texture mapping, as well as the rapid construction of indoor scenes and pedestrians, cars, dynamic water, landmark buildings and other special models. At the same time, the multi-source spatio-temporal data such as camera and campus management system are connected into 3D campus platform so that the display and inquiry of the attribute information of teaching buildings and security multimedia information can be achieved. In addition, the campus can be displayed in different directions through functions such as automatic roaming.

Integrated model/scene construction through context-based search, data-driven suggestion and component replacement

In recent years, 3D scene construction has become increasingly popular in movies and games. However, it is without doubt that the involved effort is significant, and therefore how to simplify such a process has drawn the attentions from many researchers. More specifically, the construction of a 3D scene consists of two parts: the creation of 3D objects, and their deployment. In general, one possible and popular solution is to reuse previous 3D scene construction results. In this regard, there are least two types of approaches. The first type of approaches places more emphasis on the spatial relationships. In particular, by placing a query box in the current scene and comparing its relationships with other objects under the current scene, a desired object in a previous scene can be retrieved if it shares a similar configuration. However, inappropriate representations of previous spatial relationships may lead to ambiguous or superfluous retrieval results. The second type of approaches focuses on the generation of a single object. A method of such could either start from an initial model and gradually evolve into a more complex/specific one by selecting a similar model in the database, or directly synthesize a new model by a combination of more than one model from the database. This paper proposes a framework that not only integrates the two types of approaches just mentioned, but also unifies the previous two different ways for model construction. In addition, the representation of spatial relationships is further refined so that more desired retrieval results can be obtained, together with a meaningful object class scheme to facilitate the involved interaction for model construction.

Improving the modelling of short‐wave radiation through the use of a 3D scene construction algorithm

Active satellite sensors, such as Cloud‐Aerosol Lidar and Infrared Pathfinder Satellite Observation (CALIPSO) and CloudSat, provide cloud properties that are not available from passive sensors, such as MODerate‐resolution Imaging Spectroradiometer (MODIS). While active sensors provide vertical profiles of clouds, their spatial coverage is limited to their narrow, nadir ground‐track. As a result, estimation of radiation by combining active sensors and broadband instrument has limitations due to their different spatial coverages. This study uses a scene construction algorithm (SCA) and MODIS data to extend two‐dimensional (2D) nadir cloud profiles into the cross‐track direction, and examines how the resulting constructed 3D cloud fields improve simulation of solar radiative transfer. Clouds and the Earth's Radiant Energy System (CERES) radiances are used as references to assess the improvements.While use of constructed 3D cloud fields only slightly impacts mean‐bias errors for instantaneous 20 km CERES footprint‐averaged top‐of‐atmosphere (TOA) radiances, reductions in random errors are about 40%. The largest improvements in TOA radiance simulation are for clouds with small‐scale horizontal inhomogeneity such as stratocumulus and cumulus. In contrast, uniform clouds such as nimbostratus, and deep convective clouds (Dc) show little response to the SCA. The impact of using the SCA on instantaneous surface irradiances is significant for stratocumulus and cumulus, but weak for nimbostratus and Dc. Conversely, SCA significantly influences atmospheric absorption and heating rates for nimbostratus and Dc.Differences in TOA radiances simulated by 1D and 3D transfer models are smaller than differences due to use of only the 2D nadir cross‐sections and the 3D constructed fields. This is because of smoothing of 3D radiative effects when averaged up to CERES footprints. For surface irradiance and atmospheric absorption, however, differences simulated by 1D and 3D transfer models are more comparable to differences that stem from use of 2D and 3D cloud information.

Estimation of errors associated with the EarthCARE 3D scene construction algorithm

The EarthCARE satellite mission plans to perform a continuous closure experiment to assess the quality of retrieved cloud and aerosol properties. It will do so by comparing top‐of‐atmosphere (TOA) broad‐band (BB) fluxes with simulated values produced by three‐dimensional (3D) radiative transfer models that act on the two‐dimensional (2D) retrieved cross‐section and a 3D atmosphere around it produced by a scene construction algorithm (SCA). This study proposes and tests a method for estimating errors in simulated TOA BB fluxes due to the SCA.Two methods for estimating SCA‐related errors for TOA fluxes are presented. The primary one relies on computation of errors for reconstructed narrow‐band imager nadir radiances. A‐train satellite data were used to show that for constructed domains measuring (11 km)2, approximately the size of the EarthCARE assessment domains, with total cloud fractions > 0.2, errors for reflected BB short‐wave fluxes due to the SCA are smaller than ±4.2 and ±11.5 W m−2 for 66 and 90% of the domains, respectively. Corresponding values for outgoing long‐wave fluxes are ±1.2 and ±3.0 W m−2. The largest and smallest errors are associated with fields of broken convective cloud and overcast stratiform cloud, respectively.The SCA was applied to simulated measurements for a (153 km)2 field of deep convective clouds produced by a cloud‐system‐resolving model. Actual and estimated TOA BB short‐wave flux errors due to the SCA agree well and are smaller than ±22 and ±40 W m−2 for 66 and 90% of the (11 km)2 sampled subdomains. Assuming that errors due to the SCA are purely bias errors, they were subtracted from fluxes estimated for the constructed domains. This resulted in TOA BB short‐wave flux errors smaller than ±7 and ±25 W m−2 for 66 and 90% of the sampled subdomains. This suggests that estimated errors due to the SCA should be removed directly from simulated TOA BB fluxes before executing a closure assessment.

Study on Main Function and Key Technology of Enterprises Contingency Plan Virtual Drill System Based on Virtools

This paper designs the contingency plan subsystems main function of cognition, tabletop derive, drill and data maintenance. Then it analyses the key technologies which include the construction of 3D scene, scene optimization, scene special efficiency, network communication and synchronization, and diffusion analysis of dangerous chemicals.

Sketch2Scene

This work presents Sketch2Scene , a framework that automatically turns a freehand sketch drawing inferring multiple scene objects to semantically valid, well arranged scenes of 3D models. Unlike the existing works on sketch-based search and composition of 3D models, which typically process individual sketched objects one by one, our technique performs co-retrieval and co-placement of 3D relevant models by jointly processing the sketched objects. This is enabled by summarizing functional and spatial relationships among models in a large collection of 3D scenes as structural groups . Our technique greatly reduces the amount of user intervention needed for sketch-based modeling of 3D scenes and fits well into the traditional production pipeline involving concept design followed by 3D modeling. A pilot study indicates that it is promising to use our technique as an alternative but more efficient tool of standard 3D modeling for 3D scene construction.

An Approach to Automatic Great-Scene 3D Reconstruction Based on UAV Sequence Images

In this paper, we propose an approach to automatic great-scene 3D reconstruction based on UAV sequence images. In this method, Harris feature point and SIFT feature vector is used to distill image feature, achieving images match; quasi-perspective projection model and factorization is employed to calibrate the uncalibrated image sequences automatically; Efficient suboptimal solutions to the optimal triangulation is plied to obtain the coordinate of 3D points; quasi-dense diffusing algorithm is bestowed to make 3D point denseness; the algorithm of bundle adjustment is taken to improve the precision of 3D points; the approach of Possion surface reconstruction is used to make 3D points gridded. This paper introduces the theory and technology of computer vision into great-scene 3D reconstruction, provides a new way for the construction of 3D scene, and provides a new thinking for the appliance of UAV sequence images.