Virtual Reality Visualization Research Articles

Feasibility, accuracy, and reproducibility of device sizing in virtual reality for percutaneous left atrial appendage closure - a single center study

Abstract Background Left atrial appendage closure (LAAC) is a safe and effective procedure for stroke prevention in patient with non-valvular atrial fibrillation. Procedural planning and device sizing remains challenging due to the highly complex and variable three-dimensional (3D) anatomy of the left atrial appendage (LAA). Virtual reality (VR) is a innovative, recent technology allowing a superior spatial orientation visualization of 3D imaging datasets. Purpose Therefore, we aimed to evaluate feasibility and accuracy of LAA measurements in VR for device sizing in patients planned for LAAC. Methods Twenty-one patients (79±7 years, 62% male) with non-valvular atrial fibrillation scheduled for LAAC were randomly included in our study. Preprocedural a multi-slice computed tomography (MSCT) was performed for device sizing in all patients. MSCT-based 3D models were established and visualized in VR using a dedicated software (VMersive, Warsaw, Poland). LAA dimensions (Ostium, landing zone (LZ), and depth) were assessed directly in the virtual environment. Conventional measurements of LAA ostium, landing zone (LZ) and depth using commercially available software were compared to measurements in VR. Results 3D reconstruction of MSCT datasets and visualization in VR were successfully performed automatically in all patients within a few seconds. MSCT and VR demonstrated good correlations for ostium minimum (r = 0.93), maximum (r = 0.8) and mean (r = 0.88, all p<0.001) diameters. Additionally, LZ minimum (r=0.84), maximum (r=0.86) and mean (r=0.9) diameters showed good correlation (all p<0.001). Moderate correlation was observed for depth measurements (r=0.76, p<0.001). Furthermore, intraclass correlation coefficients ranging from 0.88 to 0.98 denoted high inter- and intraobserver agreement. Conclusion Immersive VR allows highly feasible, accurate and reproducible measurements of the LAA dimensions directly in the virtual environment, hence enabling accurate device sizing for LAAC.

Virtual reality visualisation of automatic crack detection for bridge inspection from 3D digital twin generated by UAV photogrammetry

This research develops a UAV photogrammetry methodology to generate 3D digital twins (DT) of the Elvanlı Bridge in Mersin, Turkey. These DTs are then analyzed using advanced image processing algorithms for automatic crack detection. The identified cracks were incorporated into the 3D model, creating a DT to damage-augmented digital twins (DADT). Subsequently, the DADT was rendered in virtual reality, offering an interactive alternative solution with remote access to on-site structural visual inspections in a digital environment. This approach has increased the objectivity and efficiency of inspections in the digital environment. The results demonstrate the potential of this integrated approach to enhance the accuracy and reliability of bridge inspections, reduce operational costs, and provide a comprehensive platform for structural health monitoring through non-invasive methods. The study transformative impact of combining emerging technologies such as UAV photogrammetry and VR in civil engineering, paving the way for more systematic and precise infrastructure assessments.

Beyond the hype: quantifying the impact of VR visualization on client preferences and price perception in AEC client pitching

The architectural, engineering, and construction (AEC) industries are using virtual reality (VR) to improve engagement and interactions. However, VR visualization’s effectiveness in client pitching is unclear. This study analyzes how VR visualization affects customer preferences and price, as well as the complex interaction between architectural scale and demographic aspects. The outcomes enable more precise and personalized VR implementation. VR is the favoured alternative, with 14% price premiums according to a statistical analysis. Its realistic field of view and immersion allow users to explore sites at their own leisure. VR represents all architectural typologies and sizes without compromise. This VR utilization can serve as an ameliorating tool to augment marketing and sales for the client pitching stage in the AEC sectors.

Immersive Photorealistic Three-Dimensional Neurosurgical Anatomy of the Cerebral Arteries: A Photogrammetry-Based Anatomic Study.

Neurosurgeons need a profound knowledge of the surgical anatomy of the cerebral arteries to safely treat patients. This is a challenge because of numerous branches, segments, and tortuosity of the main blood vessels that supply the brain. The objective of this study was to create high-quality three-dimensional (3D) anatomic photorealistic models based on dissections of the brain arterial anatomy and to incorporate this data into a virtual reality (VR) environment. Two formaldehyde-fixed heads were used. The vessels were injected with radiopaque material and colored silicone and latex. Before the dissections, the specimens were computed tomography scanned. Stratigraphical anatomic dissection of the neck and brain was performed to present the relevant vascular anatomy. A simplified surface scanning method using a mobile phone-based photogrammetry application was used, and the data were incorporated into a VR 3D modeling software for post-processing and presentation. Fifteen detailed layered photorealistic and two computed tomography angiography-based 3D models were generated. The models allow manipulation in VR environment with sufficient photographic detail to present the structures of interest. Topographical relevant anatomic structures and landmarks were annotated and uploaded for web-viewing and in VR. Despite that the VR application is a dedicated 3D modeling platform, it provided all necessary tools to be suitable for self-VR study and multiplayer scenarios with several participants in one immersive environment. Cerebral vascular anatomy presented with photogrammetry surface scanning method allows sufficient detail to present individual vessel's course and even small perforating arteries in photorealistic 3D models. These features, including VR visualization, provide new teaching prospects. The whole study was done with simplified algorithms and free or open-source software platforms allowing creation of 3D databases especially useful in cases with limited body donor-based dissection training availability.

Geometry import into virtual reality visualization engine for HEP experiments at BM@N

Modern visualization and multimedia platforms, such as Unity, provide immersive interaction for HEP experiment data analysis. In this work, we present the method for importing the detector geometry, solids hierarchy, and materials from GDML format directly to Unity. This method is based on parsing files in GDML format and generating the geometry using mesh generation algorithms and Constructive Solid Geometry methods. The provided method is applied to the BM@N experiment at NICA accelerator complex in Joint Institute of Nuclear Research and can be used in virtual reality and augmented reality applications for data analysis and outreach events in high energy physics experiments.

Segmentation and visualization of Retinal Detachment lesions through Retinal fundus images

Medical image segmentation is a prominent task in medical image processing and a fundamental aspect of medical image analysis. However, accurate segmentation is exceedingly challenging due to the variations in size, shape, and location of the lesions. U-Net is well-linked in the domain of medical image segmentation, but it fails to fully exploit the advantageous characteristics of the channel or leverage contextual information. This article presents a novel, improved MultiResU-Net framework called DCA-MultiResU-Net to minimize the loss of crucial features and also to enhance the efficiency of end-to-end image segmentation by utilizing the full advantages of U-Net, Res2Net, Channel attention mechanism, Dilated convolution layers, and MultiResUNet models. In contrast to the typical convolutions of U-Net in the encoder path, the dilated convolution modules are inserted into the MultiRes blocks to extract and concatenate the multi-scale features. Furthermore, a channel attention mechanism is employed in the bottom portion of the “U” shaped network and the decoder path to fuse the information from receptive fields of varying sizes. Afterward, the virtual reality visualization technology was implemented for the 3-D visualization of segmented RD lesions. The proposed segmentation model was evaluated on four online databases: Retinal Image Bank, RIADD, Kaggle, and Cataract Image Dataset or GitHub. The performance outcomes of this work were measured using standard evaluation indexes such as Dice similarity coefficient, Intersection over the union, F1-score, and Loss function score of 90.76%, 88.42%, 93.28%, and 0.1641, respectively. The experimental findings indicate that the DA-MultiResU-Net framework achieved superior performance and generalization capabilities while utilizing 6.76% fewer parameters than the U-Net model.

Research on Visualization and Interactive Design of Plant Configuration Virtual Reality in the Context of Digitalization

This study aims to explore the application of digital technology in landscape design, focusing on the research of virtual reality visualization and interactive design in the process of plant configuration. Through an in-depth analysis of digital technology, the study outlines its important role in landscape design, especially in the application of plant configuration. The current application status of virtual reality technology in landscape design is discussed, as well as how interactive design can enhance user experience and participation. Furthermore, the achievements and challenges of digital technology in landscape design are summarized. Finally, it proposes future research directions and suggestions, aiming to provide new ideas and methods for practice and research in the field of landscape design and promote the further application and development of digital technology in landscape design.

Multisensory Extended Reality Applications Offer Benefits for Volumetric Biomedical Image Analysis in Research and Medicine.

3D data from high-resolution volumetric imaging is a central resource for diagnosis and treatment in modern medicine. While the fast development of AI enhances imaging and analysis, commonly used visualization methods lag far behind. Recent research used extended reality (XR) for perceiving 3D images with visual depth perception and touch but used restrictive haptic devices. While unrestricted touch benefits volumetric data examination, implementing natural haptic interaction with XR is challenging. The research question is whether a multisensory XR application with intuitive haptic interaction adds value and should be pursued. In a study, 24 experts for biomedical images in research and medicine explored 3D medical shapes with 3 applications: a multisensory virtual reality (VR) prototype using haptic gloves, a simple VR prototype using controllers, and a standard PC application. Results of standardized questionnaires showed no significant differences between all application types regarding usability and no significant difference between both VR applications regarding presence. Participants agreed to statements that VR visualizations provide better depth information, using the hands instead of controllers simplifies data exploration, the multisensory VR prototype allows intuitive data exploration, and it is beneficial over traditional data examination methods. While most participants mentioned manual interaction as the best aspect, they also found it the most improvable. We conclude that a multisensory XR application with improved manual interaction adds value for volumetric biomedical data examination. We will proceed with our open-source research project ISH3DE(Intuitive Stereoptic Haptic 3D Data Exploration) to serve medical education, therapeutic decisions, surgery preparations, or research data analysis.

A comparison of conventional and advanced 3D imaging techniques for percutaneous left atrial appendage closure.

Understanding complex cardiac anatomy is essential for percutaneous left atrial appendage (LAA) closure. Conventional multi-slice computed tomography (MSCT) and transesophageal echocardiography (TEE) are now supported by advanced 3D printing and virtual reality (VR) techniques for three-dimensional visualization of volumetric data sets. This study aimed to investigate their added value for LAA closure procedures. Ten patients scheduled for interventional LAA closure were evaluated with MSCT and TEE. Patient-specific 3D printings and VR models were fabricated based on MSCT data. Ten cardiologists then comparatively assessed LAA anatomy and its procedure relevant surrounding structures with all four imaging modalities and rated their procedural utility on a 5-point Likert scale questionnaire (from 1 = strongly agree to 5 = strongly disagree). Device sizing was rated highest in MSCT (MSCT: 1.9 ± 0.8; TEE: 2.6 ± 0.9; 3D printing: 2.5 ± 1.0; VR: 2.5 ± 1.1; p < 0.01); TEE, VR, and 3D printing were superior in the visualization of the Fossa ovalis compared to MSCT (MSCT: 3.3 ± 1.4; TEE: 2.2 ± 1.3; 3D printing: 2.2 ± 1.4; VR: 1.9 ± 1.3; all p < 0.01). The major strength of VR and 3D printing techniques was a superior depth perception (VR: 1.6 ± 0.5; 3D printing: 1.8 ± 0.4; TEE: 2.9 ± 0.7; MSCT: 2.6 ± 0.8; p < 0.01). The visualization of extracardiac structures was rated less accurate in TEE than MSCT (TEE: 2.6 ± 0.9; MSCT: 1.9 ± 0.8, p < 0.01). However, 3D printing and VR insufficiently visualized extracardiac structures in the present study. A true 3D visualization in VR or 3D printing provides an additional value in the evaluation of the LAA for the planning of percutaneous closure. In particular, the superior perception of depth was seen as a strength of a 3D visualization. This may contribute to a better overall understanding of the anatomy. Clinical studies are needed to evaluate whether a more comprehensive understanding through advanced multimodal imaging of patient-specific anatomy using VR may translate into improved procedural outcomes.

Enhancing Condition Monitoring with Virtual Reality Visualization for Industrial Application

Enhancing Condition Monitoring with Virtual Reality Visualization for Industrial Application

Three‐dimensional mapping and immersive human–robot interfacing utilize Kinect‐style depth cameras and virtual reality for agricultural mobile robots

AbstractNavigation and autonomous operation in farmland or greenhouse environments present significant challenges for agricultural mobile robots on account of unstructured scene conditions and complex task requirements. The immersive interfaces based on human–robot interaction have been extensively developed, which bridge the high‐level decision of human beings and the precise sensing and high motion ability of robots. In this study, we propose a human–robot interaction framework based on three‐dimensional mapping and virtual reality (VR) visualization. On the construction client, dense three‐dimensional point‐cloud maps are created based on the simultaneous localization and mapping real‐time appearance‐based mapping algorithm with a Kinect‐style depth camera. Subsequently, point‐cloud filtering and mesh creation methods are introduced for postprocessing the map models. A data communication network is employed to transmit the optimized models to the VR‐based exploration client. Utilizing VR visualization, the operator can gain an intuitive and comprehensive understanding of the environments to be explored. The three‐dimensional agricultural scenes are mapped into VR models through the system, which can combine the physical worlds with the VR spaces in a better manner. Compared with the video streaming‐based method for three‐dimensional mapping, the map models with colors and textures are entirely displayed in the VR headset, thus providing robust and global human–robot interaction interfaces and enhancing the immersive exploration for human beings to a considerable extent. Experimental results indicate that the three‐dimensional map models exhibit relatively sufficient construction integrity and yield favorable optimization effects. Additionally, according to a user questionnaire survey, immersive VR‐based interfaces can be more effectively utilized for the three‐dimensional mapping of mobile robots. Research evidence and results demonstrate that our proposed system framework offers positive assistance and support for enhancing human–robot interaction and executing specific robotic tasks in unstructured field agricultural environments. Code implementation and related data sets are shared at the link https://github.com/WangDongBUAA/Mapping_Interfacing.

Immersive visualization of 3D subsurface ground model developed from sparse boreholes using virtual reality (VR)

Analytics and visualization of multi-dimensional and complex geo-data, such as three-dimensional (3D) subsurface ground models, is critical for development of underground space and design and construction of underground structures (e.g., tunnels, dams, and slopes) in engineering practices. Although complicated 3D subsurface ground models now can be developed from site investigation data (e.g., boreholes) which is often sparse in practice, it remains a great challenge to visualize a 3D subsurface ground model with sophisticated stratigraphic variations by conventional two-dimensional (2D) geological cross-sections. Virtual reality (VR) technology, which has an attractive capability of constructing a virtual environment that links to the physical world, has been rapidly developed and applied to visualization in various disciplines recently. Leveraging on the rapid development of VR, this study proposes a framework for immersive visualization of 3D subsurface ground models in geo-applications using VR technology. The 3D subsurface model is first developed from limited borehole data in a data-driven manner. Then, a VR system is developed using related software and hardware devices currently available in the markets for immersive visualization and interaction with the developed 3D subsurface ground model. The results demonstrate that VR visualization of the 3D subsurface ground model in an immersive environment has great potential in revolutionizing the geo-practices from 2D cross-sections to a 3D immersive virtual environment in digital era, particularly for the emerging digital twins.

Application and Challenges of Virtual Reality (VR) in Art Exhibition Planning

Abstract The combination of VR technology and art exhibition promotes a new form of art exhibition and enriches the multi-sensory experience of visitors. After analyzing the development form of VR art exhibition and the design process of VR art exhibition, this paper puts forward the solution countermeasures of using the sparse 3D map to optimize the presentation of virtual reality visualization scene, refining the 3D scene model and improving the presentation of the surface scene based on the Possion reconstruction for the lack of development of interactive experience in VR art exhibition. As well as based on the dimensions of interactive experiences, Kinect somatosensory interaction technology is used to update the interactive experience design in VR art exhibition planning. Explore the optimization effect of VR art exhibition planning, analyze the visitors’ interactive experience task completion time, participation, and interactive experience degree, and put forward effective countermeasures for the future development of VR art exhibitions. The mean value of scores of VR exhibitions and offline exhibitions are 5.887 and 5.657, respectively, with a difference of 0.23 and a total score difference of 2.07, which indicates that the art exhibition constructed on the basis of VR has a better sense of experience.

Visualization Challenges of Virtual Reality 3D Images in New Media Environments

Abstract This paper proposes a three-dimensional image visualization process to face-drawing three-dimensional image reconstruction algorithm to obtain the data field with three-dimensional space, using color adjustment based on global color correction and local Poisson fusion to optimize the splicing seams between the texture color blocks and updating the visualization technology of three-dimensional images. Divide the digital display design and create a virtual reality visualization display using 3D modeling in combination with the new media environment. Propose design steps to visualize virtual reality three-dimensional images in the new media environment by combining the key algorithms of three-dimensional image visualization from the previous section. Combined with the application of new media displaying 3D images, the concept of artifact shape in reconstructed images is proposed to analyze the quality of 3D image reconstruction by taking the Herman model and Sheep-Logan model as the research object. Test experiments are conducted to examine the visual impact of texture mapping algorithms, and different sampling intervals are set to measure the drawing time of 3D reconstruction. For the data size and number of pictures of other organizations, the processing time of the 3D image reconstruction algorithm based on surface drawing is no more than 2s. The denser the sampling points are, the higher the degree of fitting, the more complete the preservation of isosurface information is, the finer the effect of 3D reconstruction, and the higher the quality of the image.

Real-world applications of BIM and immersive VR in construction

The integration of immersive Virtual Reality (VR) and Building Information Modeling (BIM) has many applications within the Architecture, Engineering, and Construction (AEC) industries. In this context VR is often highlighted for its ability to convey scale and details, especially when compared to non-immersive visualizations. However, despite being an active area of research, there is currently a lack of real-world studies exploring immersive VR in a construction-oriented context. In addition, there are still technical challenges and barriers for an efficient integration, such as rendering performance and interoperability issues. This paper addresses these issues by investigating the use of immersive, single- and multi-user VR within the openBIM ecosystem. The contribution is two-fold: (a) an in-depth presentation of algorithms and technical details of a multi-user VR application for immersive visualization of large and complex BIMs and (b) an evaluation of this VR system on several real-world construction projects. In all cases the VR visualization has been directly realized from the design teams IFC-models and the multi-user sessions has been performed both co-located as well as fully remote. The results show that multi-user VR improves communication, understanding, and collaboration, and by letting staff with knowledge and experience from construction production review the project in VR, design errors and constructability issues can be identified and resolved before reaching the actual production stage. Moreover, the use of VR is helpful regarding sequencing and planning, and to identify alternative design solutions.

Full field-of-view virtual reality goggles for mice

Visual virtual reality (VR) systems for head-fixed mice offer advantages over real-world studies for investigating the neural circuitry underlying behavior. However, current VR approaches do not fully cover the visual field of view of mice, do not stereoscopically illuminate the binocular zone, and leave the lab frame visible. To overcome these limitations, we developed iMRSIV (Miniature Rodent Stereo Illumination VR)-VR goggles for mice. Our system is compact, separately illuminates each eye for stereo vision, and provides each eye with an ∼180° field of view, thus excluding the lab frame while accommodating saccades. Mice using iMRSIV while navigating engaged in virtual behaviors more quickly than in a current monitor-based system and displayed freezing and fleeing reactions to overhead looming stimulation. Using iMRSIV with two-photon functional imaging, we found large populations of hippocampal place cells during virtual navigation, global remapping during environment changes, and unique responses of place cell ensembles to overhead looming stimulation.

RPM: An open-source Rotation Platform for open- and closed-loop vestibular stimulation in head-fixed Mice

Head fixation allows the recording and presentation of controlled stimuli and is used to study neural processes underlying spatial navigation. However, it disrupts the head direction system because of the lack of vestibular stimulation. To overcome this limitation, we developed a novel rotation platform which can be driven by the experimenter (open-loop) or by animal movement (closed-loop). The platform is modular, affordable, easy to build and open source. Additional modules presented here include cameras for monitoring eye movements, visual virtual reality, and a micro-manipulator for positioning various probes for recording or optical interference. We demonstrate the utility of the platform by recording eye movements and showing the robust activation of head-direction cells. This novel experimental apparatus combines the advantages of head fixation and intact vestibular activity in the horizontal plane. The open-loop mode can be used to study e.g., vestibular sensory representation and processing, while the closed-loop mode allows animals to navigate in rotational space, providing a better substrate for 2-D navigation in virtual environments. The full build documentation is maintained at https://ranczlab.github.io/RPM/.

Creation of Three-dimensional Anatomic Models in Pediatric Surgical Patients Using Cross-sectional Imaging: A Demonstration of Low-cost Methods and Applications

BackgroundPediatric surgery patients often present with complex congenital anomalies or other conditions requiring deep understanding of their intricate anatomy. Commercial applications and services exist for the conversion of cross-sectional imaging data into three-dimensional (3D) models for education and preoperative planning. However, the associated costs and lack of familiarity may discourage their use in centers with limited resources. The purpose of this report is to present a low-cost, reproducible method for generating 3D images to visualize patient anatomy. MethodsDe-identified DICOM files were obtained from the hospital PACS system in preparation for assorted pediatric surgical procedures. Using open-source visualization software, variations in anatomic structures were examined using volume rendering and segmentation techniques. Images were further refined using available editing tools or artificial intelligence-assisted software extensions. ResultsUsing the described techniques we were able to obtain excellent visualization of desired structures and associated anatomic variations. Once structures were selected and modeled in 3D (segmentation), they could be exported as one of several 3D object file formats. These could then be retained for 3D printing, visualization in virtual reality, or as an anatomic reference during the perioperative period. Models may also be imported into commercial gaming engines for rendering under optimal lighting conditions and with enhanced detail. ConclusionPediatric surgeons are frequently tasked with the treatment of patients with complex and rare anomalies. Visualization and preoperative planning can be assisted by advanced imaging software at minimal to no cost, thereby facilitating enhanced understanding of these conditions in resource-limited environments. Level of EvidenceV, Case Series, Description of Technique.

Left atrial appendage sizing for percutaneous closure in virtual reality-a feasibility study.

The complex and highly variable three-dimensional anatomy of the left atrial appendage (LAA) makes planning and device sizing for interventional occlusion procedures (LAAC) challenging. Several imaging modalities [e.g. echocardiography, multi-slice computed tomography (MSCT)] are used for this purpose. Virtual reality (VR) is an emerging imaging technique to immerse into a three-dimensional left atrium and appendage, offering unprecedented options of visualization and measurement. This study aimed to investigate the feasibility, accuracy and reproducibility of visualizing the LAA in VR for preprocedural planning of LAAC. Twenty-one patients (79 ± 7 years, 62% male) who underwent LAAC at University Hospital Düsseldorf were included in our study. A dedicated software generated three-dimensional VR models from preprocedural MSCT imaging data. Conventional measurements of LAA dimensions (ostium, landing zone and depth) using a commercially available software were compared to measurements in VR: MSCT and VR ostium min. (r = 0.93), max. (r = 0.80) and mean (r = 0.88, all p < 0.001) diameters as well as landing zone (LZ) min. (r = 0.84), max. (r = 0.86) and mean diameters (r = 0.90, all p < 0.001) showed strong correlations. Three-dimensional orientation was judged superior by physicians in VR compared to MSCT (p < 0.05). Virtual reality visualization of the left atrium and appendage based on MSCT data is feasible and allows precise and reproducible measurements in planning of LAA occlusion procedures with enhanced 3D orientation. Further studies need to explore additional benefits of three-dimensional visualization for operators in preprocedural planning.

(Keynote) Electrochemical Devices for Lunar Exploration - JAXA's Concept

Japan has decided to participate in the space exploration program "ALTEMIS program" proposed by US. One of the manned mission, Lunar surface exploration using rover (vehicle), is also involved in this program and Japan has started to develop it with JAXA and several companies and planned to be operational by the end of the decade, probably in 2029. The ultimate goal of the project is to help humanity live on the moon by 2040, and eventually on Mars. These plans are summarized in Fig. 1.This project surely supports the resources exploration on the moon as in-situ Resources Utilization(ISRU). The Lunar Cruiser, which alludes to Toyota’s Land Cruiser <https://hypebeast.com/tags/Toyota-Land-Cruiser> SUV, is essentially a fuel-cell-powered mobile laboratory that features living quarters, workstations, and cutting-edge scientific instruments. The pressurized rover is expected to have a “lunar-surface cruising range of more than 10,000 km.” Now, other automobile companies like Honda and Nissan might collaborate with all Japan projects.They have since then been creating virtual reality visualizations, conducting simulations, telecommunication systems for automatic operation and building full-scale models with photovoltaic power generation, advanced battery, and fuel cell. This presentation mainly focuses the energy and electrical system design. Figure 1