Rapid 3D Modeling Research Articles

Integrating Artificial Intelligence Into the Visualization and Modeling of Three-Dimensional Anatomy in Pediatric Surgical Patients

BackgroundPediatric surgeons often treat patients with complex anatomical considerations due to congenital anomalies or distortion of normal structures by solid organ tumors. There are multiple applications for three-dimensional visualization of these structures based on cross-sectional imaging. Recently, advances in artificial intelligence (AI) applications and graphics hardware have made rapid 3D modelling of individual structures within the body accessible to surgeons without sophisticated and expensive hardware. In this report, we provide an overview of these applications and their uses in preoperative planning for pediatric surgeons. MethodsDeidentified DICOM files containing cross-sectional imaging of preoperative pediatric surgery patients were loaded from an institutional PACS database onto a secure PC with dedicated graphics and AI hardware (NVIDIA Geforce RTX 4070 laptop GPU). Visualization was obtained using an open-source imaging platform (3D Slicer). AI extensions to the platform were utilized to delineate the anatomy of interest. ResultsSegmentations of skeletal and visceral structures within a scan were obtained using the TotalSegmentator extension with an average processing time under 5 min. Additional AI modules were utilized for providing detailed mapping of the airways (AirwaySegmentation), lungs (Chest Imaging Platform), liver (SlicerLiver), or vasculature (SlicerVMTK). Other extensions were used for delineation of tumors within the hepatic parenchyma (MONAI Auto3DSeg) and hepatic vessels (RVesselX). ConclusionAI algorithms for image interpretation and processors dedicated to AI functions have significantly decreased the technical and financial requirements for obtaining detailed three-dimensional images of patient anatomy. Models obtained using AI algorithms have potential applications in preoperative planning, surgical simulation, patient education, and training. Level of EvidenceV, Case Series, Description of Technique.

A vibrating capillary for ultrasound rotation manipulation of zebrafish larvae.

Multifunctional micromanipulation systems have garnered significant attention due to the growing interest in biological and medical research involving model organisms like zebrafish (Danio rerio). Here, we report a novel acoustofluidic rotational micromanipulation system that offers rapid trapping, high-speed rotation, multi-angle imaging, and 3D model reconstruction of zebrafish larvae. An ultrasound-activated oscillatory glass capillary is used to trap and rotate a zebrafish larva. Simulation and experimental results demonstrate that both the vibrating mode and geometric placement of the capillary contribute to the developed polarized vortices along the long axis of the capillary. Given its capacities for easy-to-operate, stable rotation, avoiding overheating, and high-throughput manipulation, our system poses the potential to accelerate zebrafish-directed biomedical research.

Towards automatic and rapid 3D geological modelling of urban sedimentary strata from a large amount of borehole data using a parallel solution of implicit equations

Towards automatic and rapid 3D geological modelling of urban sedimentary strata from a large amount of borehole data using a parallel solution of implicit equations

Rapid femur modeling method based on statistical shape model

The geometric bone model of patients is an important basis for individualized biomechanical modeling and analysis, formulation of surgical planning, design of surgical guide plate, and customization of artificial joint. In this study, a rapid three-dimensional (3D) reconstruction method based on statistical shape model was proposed for femur. Combined with the patient plain X-ray film data, rapid 3D modeling of individualized patient femur geometry was realized. The average error of 3D reconstruction was 1.597-1.842 mm, and the root mean square error was 1.453-2.341 mm. The average errors of femoral head diameter, cervical shaft angle, offset distance and anteversion angle of the reconstructed model were 0.597 mm, 1.163°, 1.389 mm and 1.354°, respectively. Compared with traditional modeling methods, the new method could achieve rapid 3D reconstruction of femur more accurately in a shorter time. This paper provides a new technology for rapid 3D modeling of bone geometry, which is helpful to promote rapid biomechanical analysis for patients, and provides a new idea for the selection of orthopedic implants and the rapid research and development of customized implants.

Adaptive Cloud-to-Cloud (AC2C) Comparison Method for Photogrammetric Point Cloud Error Estimation Considering Theoretical Error Space

The emergence of a photogrammetry-based 3D reconstruction technique enables rapid 3D modeling at a low cost and uncovers many applications in documenting the geometric dimensions of the environment. Although the theoretical accuracy of photogrammetry-based reconstruction has been studied intensively in the literature, the problem remains in evaluating the accuracy of the generated point cloud in practice. Typically, checking the coordinates of ground control points (GCPs) using a total station is considered a promising approach; however, the GCPs have clear and identifiable features and consistent normal vectors or less roughness, which cannot be considered as a typical sample for an accuracy evaluation of the point cloud. Meanwhile, the cloud-to-cloud (C2C) and cloud-to-mesh (C2M) comparison methods usually consider either the closest point or the neighboring points within a fixed searching radius as the “ground truth”, which may not reflect the actual accuracy; therefore, the present paper proposes an adaptive cloud-to-cloud (AC2C) comparison method to search the potential “ground truth” in the theoretical error space. The theoretical error space of each point is estimated according to the position of the corresponding visible cameras and their distances to a target point. A case study is carried out to investigate the feasibility of the proposed AC2C comparison method. The results presented basically the same error distribution range from 0 to 20 mm with the C2C and C2M methods, but with a higher mean value and a much smaller standard deviation. Compared to the existing methods, the proposed method provides new thinking in evaluating the accuracy of SfM-MVS by including the theoretical error constraints.

TRIDENT: A Rapid 3D Radiative-transfer Model for Exoplanet Transmission Spectra

Abstract Transmission spectroscopy is one of the premier methods used to probe the temperature, composition, and cloud properties of exoplanet atmospheres. Recent studies have demonstrated that the multidimensional nature of exoplanet atmospheres—due to nonuniformities across the day–night transition and between the morning and evening terminators—can strongly influence transmission spectra. However, the computational demands of 3D radiative-transfer techniques have precluded their usage within atmospheric retrievals. Here we introduce TRIDENT, a new 3D radiative-transfer model which rapidly computes transmission spectra of exoplanet atmospheres with day–night, morning–evening, and vertical variations in temperature, chemical abundances, and cloud properties. We also derive a general equation for transmission spectra, accounting for 3D atmospheres, refraction, multiple scattering, ingress/egress, grazing transits, stellar heterogeneities, and nightside thermal emission. After introducing TRIDENT’s linear-algebra-based approach to 3D radiative transfer, we propose new parametric prescriptions for 3D temperature and abundance profiles and 3D clouds. We show that multidimensional transmission spectra exhibit two significant observational signatures: (i) day–night composition gradients alter the relative amplitudes of absorption features; and (ii) morning–evening composition gradients distort the peak-to-wing contrast of absorption features. Finally, we demonstrate that these signatures of multidimensional atmospheres incur residuals >100 ppm compared to 1D models, rendering them potentially detectable with the James Webb Space Telescope. TRIDENT’s rapid radiative transfer, coupled with parametric multidimensional atmospheres, unlocks the final barrier to 3D atmospheric retrievals.

Three-Dimensional Wheat Modelling Based on Leaf Morphological Features and Mesh Deformation

The three-dimensional (3D) morphological structure of wheat directly reflects the interrelationship among genetics, environments, and cropping systems. However, the morphological complexity of wheat limits its rapid and accurate 3D modelling. We have developed a 3D wheat modelling method that is based on the progression from skeletons to mesh models. Firstly, we identified five morphological parameters that describe the 3D leaf features of wheat from amounts of 3D leaf digitizing data at the grain filling stage. The template samples were selected based on the similarity between the input leaf skeleton and leaf templates in the constructed wheat leaf database. The leaf modelling was then performed using the as-rigid-as-possible (ARAP) mesh deformation method. We found that 3D wheat modelling at the individual leaf level, leaf group, and individual plant scales can be achieved. Compared with directly acquiring 3D digitizing data for 3D modelling, it saves 79.9% of the time. The minimum correlation R2 of the extracted morphological leaf parameters between using the measured data and 3D model by this method was 0.91 and the maximum RMSE was 0.03, implying that this method preserves the morphological leaf features. The proposed method provides a strong foundation for further morphological phenotype extraction, functional–structural analysis, and virtual reality applications in wheat plants. Overall, we provide a new 3D modelling method for complex plants.

Mechanical Property of Pixel Forming as the Rapid Shape-Adjustable 3d Model

Mechanical Property of Pixel Forming as the Rapid Shape-Adjustable 3d Model

Research on Rapid 3D Modeling of Airport Navigation Facilities based on Oblique Photography Technology

With its short time-consuming, high-precision, and low-cost characteristics, Oblique photography technology has been widely used in surveying, remote sensing, and other fields. Due to the airport usually has airplanes in operation, it is difficult to obtain aerial images of airports, especially for antennas and other facilities that require relatively high modeling accuracy. This paper takes the airport Instrument Landing System(ILS) glideslope, a complex building with antennas, as an example, to carry out the research on the rapid modeling of a single camera with free-photo-control-point based on Oblique photography. First, to obtain a complete, high-resolution aerial image of the ILS glideslope, plan the path of the Unmanned Aerial Vehicle (UAV) photography, determine the flight height, flight radius, and other parameters; Secondly, improve the 3D airport model by adding orthophotos. Finally, by comparing the accuracy of the 3D modeling of the two sets of different parameters, obtain a strategy suitable for rapid modeling. The study shows that the proposed method can complete the high-precision 3D reconstruction of the airport’s complex navigation facilities in a short time.

THE APPLICATION OF UAV OBLIQUE PHOTOGRAMMETRY IN SMART TOURISM: A CASE STUDY OF LONGJI TERRACED SCENIC SPOT IN GUANGXI PROVINCE

Abstract. With the application of UAV Oblique photography, rapid 3D real-time modeling based on aerial image data has become a new technology in the field of 3D modeling. In view of the current poor mapping and inability to reuse the basic surveying and mapping data in the publicity and display, dynamic planning, etc., based on the UAV photogrammetry technology that is used to rapidly and accurately collect image data of the Longji terraced scenic spot in Guilin, Guangxi, this paper develops a platform by 3D real-time modeling technology with the combination of the high-tech such as digital mapping to realize the three-dimensional navigation and smart tourism of the scenic spot. The practical results show that the application can better meet the actual needs of high precision, large scale, wide audience, strong interaction, etc., which effectively alleviates the contradiction between the protection and utilization of cultural resources in cultural tourism, expands the cultural resources audience, and provides high-tech support to the cultural tourism.

Standard methods for creating digital skeletal models using structure-from-motion photogrammetry.

This article assesses best practices for producing 3D digital cranial models through structure-from-motion (SfM) photogrammetry, and whether the metric accuracy and overall presentation of photogrammetric models are comparable to physical crania. It is intended to present a user-friendly standard method of creating accurate digital skeletal models using Agisoft PhotoScan. Approximately 200 photographs were taken of three different crania, and were separated into series consisting of 50, 75, 100, 150, and approximately 200 photos. Forty-five cranial models were created using different photo series and a variety of PhotoScan settings. These models were assessed based on defined qualitative criteria, and model measurement estimates were compared with physical skeletal measurements using Bland-Altman plots. The majority of all models (37/45) produced measurement estimates with mean differences of 2 mm or less regardless of PhotoScan settings, and therefore demonstrated high levels of agreement with the physical measurements. Models created with 150 photographs and on "high" PhotoScan settings scored the highest in terms of qualitative appearance in the shortest amount of time. In PhotoScan, it is recommended to create cranial models using 150 photographs and "high" settings; this produces digital cranial models that are comparable to physical crania in both appearance and proportion. SfM photogrammetry is a convenient, noninvasive, and rapid 3D modeling tool that can be used in almost any setting to produce digital models, and following the guidelines established here will ensure that these models are metrically accurate.

VEGETATION REMOVAL FROM UAV DERIVED DSMS, USING COMBINATION OF RGB AND NIR IMAGERY

Abstract. Current advancements on photogrammetric software along with affordability and wide spreading of Unmanned Aerial Vehicles (UAV), allow for rapid, timely and accurate 3D modelling and mapping of small to medium sized areas. Although the importance and applications of large format aerial overlaps cameras and photographs in Digital Surface Model (DSM) production and LIDAR data is well documented in literature, this is not the case for UAV photography. Additionally, the main disadvantage of photogrammetry is the inability to map the dead ground (terrain), when we deal with areas that include vegetation. This paper assesses the use of near-infrared imagery captured by small UAV platforms to automatically remove vegetation from Digital Surface Models (DSMs) and obtain a Digital Terrain Model (DTM). Two areas were tested, based on the availability of ground reference points, both under trees and among vegetation, as well as on terrain. In addition, RGB and near-infrared UAV photography was captured and processed using Structure from Motion (SfM) and Multi View Stereo (MVS) algorithms to generate DSMs and corresponding colour and NIR orthoimages with 0.2 m and 0.25 m as pixel size respectively for the two test sites. Moreover, orthophotos were used to eliminate the vegetation from the DSMs using NDVI index, thresholding and masking. Following that, different interpolation algorithms, according to the test sites, were applied to fill in the gaps and created DTMs. Finally, a statistic analysis was made using reference terrain points captured on field, both on dead ground and under vegetation to evaluate the accuracy of the whole process and assess the overall accuracy of the derived DTMs in contrast with the DSMs.

Creating a longitudinal, data-driven 3D model of change over time in a postindustrial landscape using GIS and CityEngine

PurposeThe purpose of this paper is to create a longitudinal data-driven model of change over time in a postindustrial landscape, using the “Copper Country” of Michigan’s Upper Peninsula as a case study. The models resulting from this project will support the heritage management and public education goals of the contemporary communities and Keweenaw National Historical Park that administer this nationally significant mining region through accessible, engaging, and interpretable digital heritage.Design/methodology/approachThe paper applies Esri’s CityEngine procedural modeling software to an existing historical big data set. The Copper Country Historical Spatial Data Infrastructure, previously created by the HESA lab, contains over 120,000 spatiotemporally specific building footprints and other built environment variables. This project constructed a pair of 3D digital landscapes comparing the built environments of 1917 and 1949, reflecting the formal and functional evolution of several of the most important copper mining, milling, and smelting districts of Michigan’s Keweenaw Peninsula.FindingsThis research discovered that CityEngine, while intended for rapid 3D modeling of the contemporary urban landscape, was sufficiently robust and flexible to be applied to modeling serial historic industrial landscapes. While this novel application required some additional coding and finish work, by harnessing this software to existing big data sets, 48,000 individual buildings were rapidly visualized using several key variables.Originality/valueThis paper presents a new and useful application of an existing 3D modeling software, helping to further illuminate and inform the management and conservation of the rich heritage of this still-evolving postindustrial landscape.

Geological and geophysical integrated interpretation and modelling techniques

Exploration is becoming harder, at depth or under cover and decisions need to be made in model rather than data space; supported by multiple data sets. Geophysics plays an ever increasing role and integration of information from various geophysical data sets in tight collaboration with geological control is required to maximise the return from the individual data sets. In terms of integrating geological and geophysical data, the essential goal is to interpret the available geophysical data in terms of geological domains. The process requires a common sense approach to interpretation that is flexible, adaptive and objective driven. It is not an exact formula or procedure; particularly when multiple geophysical surveys are involved. Understanding the relationships between geology, geophysical responses and rock properties is the key to develop a geological basis for your integrated interpretation. Following this, rapid 3D geological modelling and geologically based forward modelling and inversion are essential for model validation and quantitative integration of data. An integrated interpretation is not necessarily the simplest approach, but does provide answers to geoscientific questions that are stronger than individual elements interpreted on their own. This paper presents a review of the mechanics involved in integrated interpretation and demonstrates the results with selected case study examples.

Rapid Prototyping and 3D Modeling of Osteotomy Jigs and Drill Guides in Hand and Wrist Surgery

Computer-generated 3D modeling, prototyping, and custom jig fabrication have gained popularity in a short space of time in hand and wrist surgery. Currently used applications include custom jig fabrication for the correction of malunion and other deformities, computerized motion analysis of carpal and forearm kinematics, and 3D prints and renders for visual planning and analysis in skeletal pathology and trauma. Authors are reporting improvements for a variety of reasons, including identifying new carpal and forearm kinematic patterns and pathology, decreased planning and fluoroscopy times, more efficient surgery, and greater accuracy. Commercially available services offering this technology are becoming popular. Some centers are performing these services in-house, which has become easier with the availability of free software and relatively inexpensive 3D printers. The infancy of these techniques in hand and wrist surgery preclude the presence of long-term clinical studies, cost-benefit analysis, and randomized controlled trials, which will undoubtedly come with time. 3D preoperative planning and custom jig fabrication is a compelling addition to the hand and wrist surgeons’ practice, and has been well received in the literature. Improved access to desktop planning and 3D models will see the use of this technology expand. Future developments may include 3D-printed patient-specific prostheses and bone scaffolds.

Regenerative medicine: Rapid 3D bladder model engineering.

Regenerative medicine: Rapid 3D bladder model engineering.

Rapid interactive 3D urban scene reconstruction

In 3D modeling of urban environments based on multiple images, traditional automated stereo methods usually generate incomplete or simplistic scene structures, flowing to interference factors such as poorly textured regions and highly slanted surfaces. Furthermore, because of their complex interactive processes, interactive 3D modeling methods are difficult for general users to master. In order to address these problems, this paper proposes a rapid interactive 3D modeling method. Based on initial sparse spatial points and prior knowledge of the scene structure, our method can effectively and efficiently reconstruct accurate geometric models (e.g. planes, cylinders) for interactive regions provided by users in a complete 2D manner. Moreover, all interactions are performed in a single image, which facilitates operation by general users and eases the transition to mobile devices such as smartphones and tablet computers. Experiments on standard data sets and our own data sets show that our method can model complete scene structures more accurately than piecewise planar models commonly used in traditional stereo methods.

Rapid 3D Modeling and Parts Recognition on Automotive Vehicles Using a Network of RGB-D Sensors for Robot Guidance

This paper presents an approach for the automatic detection and fast 3D profiling of lateral body panels of vehicles. The work introduces a method to integrate raw streams from depth sensors in the task of 3D profiling and reconstruction and a methodology for the extrinsic calibration of a network of Kinect sensors. This sensing framework is intended for rapidly providing a robot with enough spatial information to interact with automobile panels using various tools. When a vehicle is positioned inside the defined scanning area, a collection of reference parts on the bodywork are automatically recognized from a mosaic of color images collected by a network of Kinect sensors distributed around the vehicle and a global frame of reference is set up. Sections of the depth information on one side of the vehicle are then collected, aligned, and merged into a global RGB-D model. Finally, a 3D triangular mesh modelling the body panels of the vehicle is automatically built. The approach has applications in the intelligent transportation industry, automated vehicle inspection, quality control, automatic car wash systems, automotive production lines, and scan alignment and interpretation.

SolidWorks Chain Drive Design and 3D Modeling Techniques

By analyzing the chart data and formulas in the traditional design of the roller chain, together with the SolidWorks modeling features, a fast modeling method of roller chain drive is presented on the basis of the main parameters in the chain drive design. In virtue of the Curve Driven Array, the chain modeling is executed in parts environment, with the track dimension property changed and the dimension driven mathematical formula established to correct the error between theoretical calculation and practical graphics, which ensures a successful array and provides an effective way for the rapid 3D model establishment of chains and the chain drive assembly.

Realization of the 3D Simulation Model of the Hui-Quan Substation

3D (three-dimensional) laser scanning can be used to collect spatial location of points rapidly and abundantly, and obtain three-dimensional coordinates of the target surface, which provides new technical means for the rapid creation of three-dimensional image model of the object. A three-dimensional modeling study on spatial object was carried out using the spatial data captured via ground-based 3D laser scanner in the Hui-Quan substation. The experiment result shows that rapid 3D visualization modeling on buildings can be achieved via the methods and procedures mentioned above. It has solved that the traditional equipment and the measuring technique is insufficiency in the special domain. It will bring the application mode and technical advantage, which tradition mapping way can not have. A platform for three-dimensional model of the substation can be achieved for the resources, landscape, security, environmental management and other social resources of digital, networked and dynamic visualization.