Virtual Reality Visualization Research Articles

Segmentation and visualization of Retinal Detachment lesions through Retinal fundus images

Medical image segmentation is a prominent task in medical image processing and a fundamental aspect of medical image analysis. However, accurate segmentation is exceedingly challenging due to the variations in size, shape, and location of the lesions. U-Net is well-linked in the domain of medical image segmentation, but it fails to fully exploit the advantageous characteristics of the channel or leverage contextual information. This article presents a novel, improved MultiResU-Net framework called DCA-MultiResU-Net to minimize the loss of crucial features and also to enhance the efficiency of end-to-end image segmentation by utilizing the full advantages of U-Net, Res2Net, Channel attention mechanism, Dilated convolution layers, and MultiResUNet models. In contrast to the typical convolutions of U-Net in the encoder path, the dilated convolution modules are inserted into the MultiRes blocks to extract and concatenate the multi-scale features. Furthermore, a channel attention mechanism is employed in the bottom portion of the “U” shaped network and the decoder path to fuse the information from receptive fields of varying sizes. Afterward, the virtual reality visualization technology was implemented for the 3-D visualization of segmented RD lesions. The proposed segmentation model was evaluated on four online databases: Retinal Image Bank, RIADD, Kaggle, and Cataract Image Dataset or GitHub. The performance outcomes of this work were measured using standard evaluation indexes such as Dice similarity coefficient, Intersection over the union, F1-score, and Loss function score of 90.76%, 88.42%, 93.28%, and 0.1641, respectively. The experimental findings indicate that the DA-MultiResU-Net framework achieved superior performance and generalization capabilities while utilizing 6.76% fewer parameters than the U-Net model.

Geometry import into virtual reality visualization engine for HEP experiments at BM@N

Geometry import into virtual reality visualization engine for HEP experiments at BM@N

Research on Visualization and Interactive Design of Plant Configuration Virtual Reality in the Context of Digitalization

This study aims to explore the application of digital technology in landscape design, focusing on the research of virtual reality visualization and interactive design in the process of plant configuration. Through an in-depth analysis of digital technology, the study outlines its important role in landscape design, especially in the application of plant configuration. The current application status of virtual reality technology in landscape design is discussed, as well as how interactive design can enhance user experience and participation. Furthermore, the achievements and challenges of digital technology in landscape design are summarized. Finally, it proposes future research directions and suggestions, aiming to provide new ideas and methods for practice and research in the field of landscape design and promote the further application and development of digital technology in landscape design.

A comparison of conventional and advanced 3D imaging techniques for percutaneous left atrial appendage closure.

Understanding complex cardiac anatomy is essential for percutaneous left atrial appendage (LAA) closure. Conventional multi-slice computed tomography (MSCT) and transesophageal echocardiography (TEE) are now supported by advanced 3D printing and virtual reality (VR) techniques for three-dimensional visualization of volumetric data sets. This study aimed to investigate their added value for LAA closure procedures. Ten patients scheduled for interventional LAA closure were evaluated with MSCT and TEE. Patient-specific 3D printings and VR models were fabricated based on MSCT data. Ten cardiologists then comparatively assessed LAA anatomy and its procedure relevant surrounding structures with all four imaging modalities and rated their procedural utility on a 5-point Likert scale questionnaire (from 1 = strongly agree to 5 = strongly disagree). Device sizing was rated highest in MSCT (MSCT: 1.9 ± 0.8; TEE: 2.6 ± 0.9; 3D printing: 2.5 ± 1.0; VR: 2.5 ± 1.1; p < 0.01); TEE, VR, and 3D printing were superior in the visualization of the Fossa ovalis compared to MSCT (MSCT: 3.3 ± 1.4; TEE: 2.2 ± 1.3; 3D printing: 2.2 ± 1.4; VR: 1.9 ± 1.3; all p < 0.01). The major strength of VR and 3D printing techniques was a superior depth perception (VR: 1.6 ± 0.5; 3D printing: 1.8 ± 0.4; TEE: 2.9 ± 0.7; MSCT: 2.6 ± 0.8; p < 0.01). The visualization of extracardiac structures was rated less accurate in TEE than MSCT (TEE: 2.6 ± 0.9; MSCT: 1.9 ± 0.8, p < 0.01). However, 3D printing and VR insufficiently visualized extracardiac structures in the present study. A true 3D visualization in VR or 3D printing provides an additional value in the evaluation of the LAA for the planning of percutaneous closure. In particular, the superior perception of depth was seen as a strength of a 3D visualization. This may contribute to a better overall understanding of the anatomy. Clinical studies are needed to evaluate whether a more comprehensive understanding through advanced multimodal imaging of patient-specific anatomy using VR may translate into improved procedural outcomes.

Enhancing Condition Monitoring with Virtual Reality Visualization for Industrial Application

Enhancing Condition Monitoring with Virtual Reality Visualization for Industrial Application

Assessment of resectability of pancreatic cancer using novel immersive high-performance virtual reality rendering of abdominal computed tomography and magnetic resonance imaging.

Virtual reality (VR) allows for an immersive and interactive analysis of imaging data such as computed tomography (CT) and magnetic resonance imaging (MRI). The aim of this study is to assess the comprehensibility of VR anatomy and its value in assessing resectability of pancreatic ductal adenocarcinoma (PDAC). This study assesses exposure to VR anatomy and evaluates the potential role of VR in assessing resectability of PDAC. Firstly, volumetric abdominal CT and MRI data were displayed in an immersive VR environment. Volunteering physicians were asked to identify anatomical landmarks in VR. In the second stage, experienced clinicians were asked to identify vascular involvement in a total of 12 CT and MRI scans displaying PDAC (2 resectable, 2 borderline resectable, and 2 locally advanced tumours per modality). Results were compared to 2D standard PACS viewing. In VR visualisation of CT and MRI, the abdominal anatomical landmarks were recognised by all participants except the pancreas (30/34) in VR CT and the splenic (31/34) and common hepatic artery (18/34) in VR MRI, respectively. In VR CT, resectable, borderline resectable, and locally advanced PDAC were correctly identified in 22/24, 20/24 and 19/24 scans, respectively. Whereas, in VR MRI, resectable, borderline resectable, and locally advanced PDAC were correctly identified in 19/24, 19/24 and 21/24 scans, respectively. Interobserver agreement as measured by Fleiss κ was 0.7 for CT and 0.4 for MRI, respectively (p < 0.001). Scans were significantly assessed more accurately in VR CT than standard 2D PACS CT, with a median of 5.5 (IQR 4.75-6) and a median of 3 (IQR 2-3) correctly assessed out of 6 scans (p < 0.001). VR enhanced visualisation of abdominal CT and MRI scan data provides intuitive handling and understanding of anatomy and might allow for more accurate staging of PDAC and could thus become a valuable adjunct in PDAC resectability assessment in the future.

Immersive visualization of 3D subsurface ground model developed from sparse boreholes using virtual reality (VR)

Analytics and visualization of multi-dimensional and complex geo-data, such as three-dimensional (3D) subsurface ground models, is critical for development of underground space and design and construction of underground structures (e.g., tunnels, dams, and slopes) in engineering practices. Although complicated 3D subsurface ground models now can be developed from site investigation data (e.g., boreholes) which is often sparse in practice, it remains a great challenge to visualize a 3D subsurface ground model with sophisticated stratigraphic variations by conventional two-dimensional (2D) geological cross-sections. Virtual reality (VR) technology, which has an attractive capability of constructing a virtual environment that links to the physical world, has been rapidly developed and applied to visualization in various disciplines recently. Leveraging on the rapid development of VR, this study proposes a framework for immersive visualization of 3D subsurface ground models in geo-applications using VR technology. The 3D subsurface model is first developed from limited borehole data in a data-driven manner. Then, a VR system is developed using related software and hardware devices currently available in the markets for immersive visualization and interaction with the developed 3D subsurface ground model. The results demonstrate that VR visualization of the 3D subsurface ground model in an immersive environment has great potential in revolutionizing the geo-practices from 2D cross-sections to a 3D immersive virtual environment in digital era, particularly for the emerging digital twins.

Application and Challenges of Virtual Reality (VR) in Art Exhibition Planning

Abstract The combination of VR technology and art exhibition promotes a new form of art exhibition and enriches the multi-sensory experience of visitors. After analyzing the development form of VR art exhibition and the design process of VR art exhibition, this paper puts forward the solution countermeasures of using the sparse 3D map to optimize the presentation of virtual reality visualization scene, refining the 3D scene model and improving the presentation of the surface scene based on the Possion reconstruction for the lack of development of interactive experience in VR art exhibition. As well as based on the dimensions of interactive experiences, Kinect somatosensory interaction technology is used to update the interactive experience design in VR art exhibition planning. Explore the optimization effect of VR art exhibition planning, analyze the visitors’ interactive experience task completion time, participation, and interactive experience degree, and put forward effective countermeasures for the future development of VR art exhibitions. The mean value of scores of VR exhibitions and offline exhibitions are 5.887 and 5.657, respectively, with a difference of 0.23 and a total score difference of 2.07, which indicates that the art exhibition constructed on the basis of VR has a better sense of experience.

Real-world applications of BIM and immersive VR in construction

The integration of immersive Virtual Reality (VR) and Building Information Modeling (BIM) has many applications within the Architecture, Engineering, and Construction (AEC) industries. In this context VR is often highlighted for its ability to convey scale and details, especially when compared to non-immersive visualizations. However, despite being an active area of research, there is currently a lack of real-world studies exploring immersive VR in a construction-oriented context. In addition, there are still technical challenges and barriers for an efficient integration, such as rendering performance and interoperability issues. This paper addresses these issues by investigating the use of immersive, single- and multi-user VR within the openBIM ecosystem. The contribution is two-fold: (a) an in-depth presentation of algorithms and technical details of a multi-user VR application for immersive visualization of large and complex BIMs and (b) an evaluation of this VR system on several real-world construction projects. In all cases the VR visualization has been directly realized from the design teams IFC-models and the multi-user sessions has been performed both co-located as well as fully remote. The results show that multi-user VR improves communication, understanding, and collaboration, and by letting staff with knowledge and experience from construction production review the project in VR, design errors and constructability issues can be identified and resolved before reaching the actual production stage. Moreover, the use of VR is helpful regarding sequencing and planning, and to identify alternative design solutions.

Full field-of-view virtual reality goggles for mice

Visual virtual reality (VR) systems for head-fixed mice offer advantages over real-world studies for investigating the neural circuitry underlying behavior. However, current VR approaches do not fully cover the visual field of view of mice, do not stereoscopically illuminate the binocular zone, and leave the lab frame visible. To overcome these limitations, we developed iMRSIV (Miniature Rodent Stereo Illumination VR)-VR goggles for mice. Our system is compact, separately illuminates each eye for stereo vision, and provides each eye with an ∼180° field of view, thus excluding the lab frame while accommodating saccades. Mice using iMRSIV while navigating engaged in virtual behaviors more quickly than in a current monitor-based system and displayed freezing and fleeing reactions to overhead looming stimulation. Using iMRSIV with two-photon functional imaging, we found large populations of hippocampal place cells during virtual navigation, global remapping during environment changes, and unique responses of place cell ensembles to overhead looming stimulation.

RPM: An open-source Rotation Platform for open- and closed-loop vestibular stimulation in head-fixed Mice

Head fixation allows the recording and presentation of controlled stimuli and is used to study neural processes underlying spatial navigation. However, it disrupts the head direction system because of the lack of vestibular stimulation. To overcome this limitation, we developed a novel rotation platform which can be driven by the experimenter (open-loop) or by animal movement (closed-loop). The platform is modular, affordable, easy to build and open source. Additional modules presented here include cameras for monitoring eye movements, visual virtual reality, and a micro-manipulator for positioning various probes for recording or optical interference. We demonstrate the utility of the platform by recording eye movements and showing the robust activation of head-direction cells. This novel experimental apparatus combines the advantages of head fixation and intact vestibular activity in the horizontal plane. The open-loop mode can be used to study e.g., vestibular sensory representation and processing, while the closed-loop mode allows animals to navigate in rotational space, providing a better substrate for 2-D navigation in virtual environments. The full build documentation is maintained at https://ranczlab.github.io/RPM/.

Creation of Three-dimensional Anatomic Models in Pediatric Surgical Patients Using Cross-sectional Imaging: A Demonstration of Low-cost Methods and Applications

BackgroundPediatric surgery patients often present with complex congenital anomalies or other conditions requiring deep understanding of their intricate anatomy. Commercial applications and services exist for the conversion of cross-sectional imaging data into three-dimensional (3D) models for education and preoperative planning. However, the associated costs and lack of familiarity may discourage their use in centers with limited resources. The purpose of this report is to present a low-cost, reproducible method for generating 3D images to visualize patient anatomy. MethodsDe-identified DICOM files were obtained from the hospital PACS system in preparation for assorted pediatric surgical procedures. Using open-source visualization software, variations in anatomic structures were examined using volume rendering and segmentation techniques. Images were further refined using available editing tools or artificial intelligence-assisted software extensions. ResultsUsing the described techniques we were able to obtain excellent visualization of desired structures and associated anatomic variations. Once structures were selected and modeled in 3D (segmentation), they could be exported as one of several 3D object file formats. These could then be retained for 3D printing, visualization in virtual reality, or as an anatomic reference during the perioperative period. Models may also be imported into commercial gaming engines for rendering under optimal lighting conditions and with enhanced detail. ConclusionPediatric surgeons are frequently tasked with the treatment of patients with complex and rare anomalies. Visualization and preoperative planning can be assisted by advanced imaging software at minimal to no cost, thereby facilitating enhanced understanding of these conditions in resource-limited environments. Level of EvidenceV, Case Series, Description of Technique.

Left atrial appendage sizing for percutaneous closure in virtual reality-a feasibility study.

The complex and highly variable three-dimensional anatomy of the left atrial appendage (LAA) makes planning and device sizing for interventional occlusion procedures (LAAC) challenging. Several imaging modalities [e.g. echocardiography, multi-slice computed tomography (MSCT)] are used for this purpose. Virtual reality (VR) is an emerging imaging technique to immerse into a three-dimensional left atrium and appendage, offering unprecedented options of visualization and measurement. This study aimed to investigate the feasibility, accuracy and reproducibility of visualizing the LAA in VR for preprocedural planning of LAAC. Twenty-one patients (79 ± 7 years, 62% male) who underwent LAAC at University Hospital Düsseldorf were included in our study. A dedicated software generated three-dimensional VR models from preprocedural MSCT imaging data. Conventional measurements of LAA dimensions (ostium, landing zone and depth) using a commercially available software were compared to measurements in VR: MSCT and VR ostium min. (r = 0.93), max. (r = 0.80) and mean (r = 0.88, all p < 0.001) diameters as well as landing zone (LZ) min. (r = 0.84), max. (r = 0.86) and mean diameters (r = 0.90, all p < 0.001) showed strong correlations. Three-dimensional orientation was judged superior by physicians in VR compared to MSCT (p < 0.05). Virtual reality visualization of the left atrium and appendage based on MSCT data is feasible and allows precise and reproducible measurements in planning of LAA occlusion procedures with enhanced 3D orientation. Further studies need to explore additional benefits of three-dimensional visualization for operators in preprocedural planning.

(Keynote) Electrochemical Devices for Lunar Exploration - JAXA's Concept

Japan has decided to participate in the space exploration program "ALTEMIS program" proposed by US. One of the manned mission, Lunar surface exploration using rover (vehicle), is also involved in this program and Japan has started to develop it with JAXA and several companies and planned to be operational by the end of the decade, probably in 2029. The ultimate goal of the project is to help humanity live on the moon by 2040, and eventually on Mars. These plans are summarized in Fig. 1.This project surely supports the resources exploration on the moon as in-situ Resources Utilization(ISRU). The Lunar Cruiser, which alludes to Toyota’s Land Cruiser <https://hypebeast.com/tags/Toyota-Land-Cruiser> SUV, is essentially a fuel-cell-powered mobile laboratory that features living quarters, workstations, and cutting-edge scientific instruments. The pressurized rover is expected to have a “lunar-surface cruising range of more than 10,000 km.” Now, other automobile companies like Honda and Nissan might collaborate with all Japan projects.They have since then been creating virtual reality visualizations, conducting simulations, telecommunication systems for automatic operation and building full-scale models with photovoltaic power generation, advanced battery, and fuel cell. This presentation mainly focuses the energy and electrical system design. Figure 1

Visualization of sorting algorithms in the virtual reality environment

This study examines the use of virtual reality (VR) in programming, specifically in visualization of sorting methods. Addressing students’ needs to better understand and implement sorting methods, “VR sorting” application was developed to visualize the bubble sorting and selection sorting abstract methods in the VR environment. The effects of visualization were evaluated drawing on an extended taxonomy, specifically developed by the authors of this study. The results indicate that VR might significantly enhance students’ understanding of sorting tasks, further allowing them to employ these skills in practice. Specifically, 76.9% of students, who studied sorting methods in virtual environment drawing on “VR sorting” application, demonstrated higher outcomes in implementing sorting tasks. VR visualization of sorting methods, differs from existing ways of visualizing learning in the context of constructivism. Since VR allows the student to construct the algorithm himself directly interacting machine memory in the form of cells where the data is stored and managing the progress of sorting. These results shed some light to future research avenues on VR enabled constructive visualization.

Feeling the Earthship house: eliciting a perspective of posterity through immersive virtual reality

PurposeThe surging cost of living and shortage of affordable and sustainable homes fuel the global housing crisis. Earthship buildings are marketed as the epitome of affordable and sustainable alternative housing. This paper aimed to elicit the perception of Earthship buildings among youngsters in the United Kingdom using immersive virtual reality technology. Additionally, the impact of virtual reality on perception compared with two-dimensional drawings was investigated in the study.Design/methodology/approachA three-phase, experiment-based survey was adopted: Phase 1: literature review, Earthship house model conception and the virtual environment creation; Phase 2: two-dimensional drawing-based pre-visualisation survey; Phase 3: virtual reality–based post-visualisation survey.FindingsThe findings indicated that youngsters had a remarkable, positive change in attitude towards the uptake of the Earthship houses after virtual reality visualisation. In contrast, sustainability experts shared more concerns regarding the concept's viability in the United Kingdom, even after the virtual reality visualisation. However, both youngsters and experts agreed with the pre-eminence of virtual reality over two-dimensional drawings.Originality/valueThe lack of awareness about Earthship buildings for posterity was noted in previous studies, which could be attributed to there being very few Earthship buildings in the United Kingdom. The importance of this awareness among youngsters cannot be over-emphasised since youngsters are affected most by the shortage of affordable and sustainable homes. This gap was addressed by enlightening the youth about Earthship houses and imparting awareness through near-real-life virtual reality visualisation.

Digital twin exploration of a blended-wing-body underwater glider skeleton in the laboratory environment

ABSTRACT Due to the inherent unpredictability of marine trial conditions, safety issues in the launching and recovery process are commonplace. For these issues, digital twin (DT) maintenance offers a novel idea. In this paper, a blended-wing-body underwater glider skeleton is selected as a research object. And a simple demo is created to investigate the major technologies that may be involved in DT maintenance. According to this specimen, the necessary development environments are developed to obtain physical information and produce a DT model in cyberspace respectively. An attitude sensor is used as the physical data collector, while real-time structural field prediction and virtual reality visualisation are employed. By using the attitude angles and structural data, it is possible to achieve real-time monitoring of the skeleton strength. Through the means of this straightforward case study, the key technologies are supported and can be applied to far more complex inquiries.

Tactile and Visual Virtual Reality Attention Distraction From Pain in Cold Pressor Test

Tactile and Visual Virtual Reality Attention Distraction From Pain in Cold Pressor Test

Safe human-robot collaboration in construction: A conceptual perspective

Introduction: Small mobile robots have become increasingly popular in the construction domain over the last few years. They are stable on rough terrains, can walk over small obstacles, climb stairs, and carry various sensors or arms to perform diverse functions and sub-tasks required to complete construction-related tasks. Saving time, improving accessibility to difficult or unsafe spaces, and reducing costs while accomplishing construction tasks are some of the benefits of using small, mobile robots in construction. However, serious concerns about new workplace hazards could arise from having mobile robots on the jobsite. Unfortunately, no study has attempted to evaluate these risks, especially in the construction domain. Therefore, there was a significant need to develop a holistic understanding of the direct and indirect risks of mobile robot applications in construction. Method: In this paper, we used inferential and Virtual Reality (VR) visualization techniques to: (1) construct conceptual visualizations of proximal and distant human-robot interaction within the construction context; and (2) identify potential safety challenges of robots, which were categorized into three groups: (a) physical risks, (b) attentional costs, and (c) psychological impacts. These identified safety challenges were then validated and ranked by a group of construction safety and robotic experts who had knowledge and experience using such robots in construction. Practical Applications: The outcomes of the study provided a detailed understanding of how robots might adversely affect workers’ safety and health. The study outcomes could also be ultimately used in creating regulatory and administrative guidelines for the safe operations of small mobile robots in construction.

DIFFERENT DATA JOINING AS A BASIC MODEL FOR HBIM – A CASE PROJECT ST. PATALEIMON IN SKOPJE

Abstract. H-BIM (Heritage Building Information Modelling) is principle and system of use of historic buildings that can be used for the management, reconstruction or renovation and restoration of monuments. It is a set of geometric and descriptive information about a building. In the last decade, several historical objects were documented using modern methods, mainly advanced photogrammetrical and laser technologies, for a wide range of users to get benefits from economically, safety, presentation, and life cycle management of historical buildings. The rapid development in geomatics is possible thanks to advanced technologies of data capturing, sufficient capacity of computer technology and transmission and information networks. The most used technologies are terrestrial laser scanning (TLS), personal laser scanning (PLS) or mobile mapping systems (MMS), terrestrial or aerial drone based close-range digital photogrammetry (using SfM – structure from motion technology and MVS – multi view stereo). Today’s modern advanced technologies allow geometrical and textural data collection within a few centimetres’ accuracy outside and inside infrastructure by various methods of PLS, photogrammetrical SfM and TLS. In terms of object visualisation, VR or AR (virtual or augmented reality) technology is proving to be suitable. The following text discusses the use of geomatics technologies for the creation of H-BIM on the example of a cultural monument in Skopje, North Macedonia, including visualization in virtual reality (VR).