Virtual Reality Reconstruction Research Articles

Auditory time travel: Acoustic notes on the virtual reality reconstruction of the Queen's theatre (Adelaide, 1841)

This paper presents the results of an international interdisciplinary effort to reconstruct the Queen's Theatre in Adelaide as it stood on its inaugural debut in 1841. Our collaborative approach brings together real actors, set and costume designers, architects, virtual reality (VR) developers, motion capture specialists, and acoustic engineers in order to reproduce, as realistically as possible, the opening night monologue by Mr Gustavus Arabin. By combining the modelled ambisonics room impulse responses with a proprietary algorithm, we achieved an authentic representation of the historical environment both visually and acoustically by allowing the user to immerse themselves in the space at several locations within the theatre. Central to our VR reconstruction is the ability of our software to combine auralisations from multiple sound sources simultaneously as well as allowing the user to upload user-generated anechoic files. The paper focuses on the acoustic nuances throughout the VR reconstruction, providing a comprehensive overview of collaborative endeavours and technological advancements enabling users to grasp and appreciate the acoustic intricacies of Queen's Theatre. Emphasising the acoustic dimension of the space underscores the potential of our virtual model to serve as a dynamic platform for historical exploration, research, and educational pursuits.

Commemorating Stolen Generation experiences through virtual reality

State sanctioned removal of Australian Aboriginal children from family, culture, and country has had harmful and traumatic effects on the Survivors of this process and their children. Known as the Stolen Generations, children were detained in government settlements and church missions and stripped of Aboriginality. This article explores ways that a virtual reality reconstruction of mission environments may be implemented to memorialise and commemorate Survivor experience that avoid narratives of victimhood and destructive post-colonial overlays on their stories of survival. Our project is to develop a virtual reality model of Carrolup-Marribank Mission in Western Australia as a living digital memorial for use by Survivors and their families to help address their displacement and loss of culture and identity. This article shows how virtual reality may be a potent didactic tool to convey difficult histories as well as a purveyor of powerful stories that contest stereotyped perceptions of Aboriginal people.

3D Reconstruction and Virtual Reality Is an Acceptable and Feasible Method for Addressing Body Image in Bariatric Metabolic Surgery

BackgroundPatients living with obesity continue to experience body image dissatisfaction following bariatric metabolic surgery. The underlying reasons are poorly understood but may be due to unmet expectations. Negative body image perception following metabolic surgery leads to poorer psychological and clinical outcomes. This study aims to establish the acceptability and feasibility of three-dimensional (3D) reconstruction and virtual reality (VR) as a method of providing psychological support to bariatric patients to improve body image satisfaction and interventional outcomes.MethodsSeven participants were recruited from the Imperial Weight Centre. 3D photographs were captured and processed to produce two 3D reconstructed images with 15% and 25% total weight loss. Participants were shown their images using VR and participated in peer group workshops.ResultsSix participants were retained until the end of the study. Five out of six participants agreed the images provided them with a more accurate representation of their body changes and overall appearance following bariatric metabolic surgery. All participants strongly agreed with the group setting and felt VR facilitated discussions on body image. Overall, all participants felt that the use of VR and 3D reconstruction is beneficial in supporting patients to adjust to changes in their body image after bariatric metabolic surgery.ConclusionsThis is the first study to explore and demonstrate that 3D reconstruction and VR is an acceptable and feasible method providing patients with a realistic expectation of how their body will change following significant weight loss, potentially improving body image satisfaction after surgery, as well as psychological and interventional outcomes.Graphical

Advanced Fire Investigation Technique Utilizing Virtual Reality

This paper presents an advanced technique for fire investigation via the development and application of a virtual reality (VR)-based system. After capturing a fire scene with a 360° camera, the acquired image files are processed, edited, and executed through a developed program to reconstruct the scene in VR. Currently, fire investigation methods involve writing reports based on photographed pictures. However, this 2D approach has limitations, as individuals who cannot visit the site in person lack a sense of presence and immersion. When the proposed technique is applied to scene investigations, wearing an head-mounted display allows for the investigation of scenes from a 360° 3D perspective that maximizes vivacity and immersion. This technology facilitates collaboration with experts from various fields who could not otherwise participate in a scene, thereby enabling the reliable derivation of fire causes. Additionally, the proposed method allows for the 3D digital preservation of major national disaster incidents and can therefore convey lessons from accidents to future generations. In the future, the proposed VR reconstruction system could be utilized as valid evidence in court cases.

Full-body pose reconstruction and correction in virtual reality for rehabilitation training.

Existing statistical data indicates that an increasing number of people now require rehabilitation to restore compromised physical mobility. During the rehabilitation process, physical therapists evaluate and guide the movements of patients, aiding them in a more effective recovery of rehabilitation and preventing secondary injuries. However, the immutability of mobility and the expensive price of rehabilitation training hinder some patients from timely access to rehabilitation. Utilizing virtual reality for rehabilitation training might offer a potential alleviation to these issues. However, prevalent pose reconstruction algorithms in rehabilitation primarily rely on images, limiting their applicability to virtual reality. Furthermore, existing pose evaluation and correction methods in the field of rehabilitation focus on providing clinical metrics for doctors, and failed to offer patients efficient movement guidance. In this paper, a virtual reality-based rehabilitation training method is proposed. The sparse motion signals from virtual reality devices, specifically head-mounted displays hand controllers, is used to reconstruct full body poses. Subsequently, the reconstructed poses and the standard poses are fed into a natural language processing model, which contrasts the difference between the two poses and provides effective pose correction guidance in the form of natural language. Quantitative and qualitative results indicate that the proposed method can accurately reconstruct full body poses from sparse motion signals in real-time. By referencing standard poses, the model generates professional motion correction guidance text. This approach facilitates virtual reality-based rehabilitation training, reducing the cost of rehabilitation training and enhancing the efficiency of self-rehabilitation training.

Triboelectric Energy Harvesting from Highly Conjugated Fused Aromatic Ladder Structure Under Extreme Environmental Conditions.

Practical application of triboelectric nanogenerators (TENGs) has been challenging, particularly, under harsh environmental conditions. This work proposes a novel 3D-fused aromatic ladder (FAL) structure as a tribo-positive material for TENGs, to address these challenges. The 3D-FAL offers a unique materials engineering platform for tailored properties, such as high specific surface area and porosity, good thermal and mechanical stability, and tunable electronic properties. The fabricated 3D-FAL-based TENG reaches a maximum peak power density of 451.2 µW cm-2 at 5 Hz frequency. More importantly, the 3D-FAL-based TENG maintains stable output performance under harsh operating environments, over wide temperature (-45-100°C) and humidity ranges (8.3-96.7% RH), representing the development of novel FAL for sustainable energy generation under challenging environmental conditions. Furthermore, the 3D-FAL-based TENG proves to be a promising device for a speed monitoring system engaging reconstruction in virtual reality in a snowy environment.

Retracted: Multimedia Vision Improvement and Simulation in Consideration of Virtual Reality Reconstruction Algorithms

Retracted: Multimedia Vision Improvement and Simulation in Consideration of Virtual Reality Reconstruction Algorithms

Anomalous origin of the right coronary artery originating from the pulmonary trunk: pre- and postoperative computed tomography images and virtual reality reconstructions.

Anomalous origin of the right coronary artery originating from the pulmonary trunk: pre- and postoperative computed tomography images and virtual reality reconstructions.

Pilgrimage to Pureland: Art, Perception and the Wutai Mural VR Reconstruction

Virtual reality (VR) supports audiences to engage with cultural heritage proactively. We designed an easy-to-access and guided VR reconstruction of the murals in Mogao Grottoes, Pilgrimage To Pureland, to offer the general public an accessible and engaging way to experience the Dunhuang murals. We explored an immersive VR reconstruction approach that can efficiently convert complex 2D mural art into 3D digital VR content while maintaining its originality. Specifically, we reconstructed the Mt. Wutai pilgrimage mural in Cave 61 into a plot-based interactive VR environment that offers users a more accessible and immersive narrative to visit and appreciate Dunhuang murals’ complex religious, historical, and artistic value. We conducted a user study with twenty participants to further investigate how this reconstruction approach and the interactive narratives would affect users’ immersive experiences and knowledge acquisition, compared with other forms of virtual access as the control group. Findings from our user study revealed that participants from the VR experimental group reported a significantly higher level of immersion and understanding of the knowledge. To conclude, our 2D-to-VR reconstruction methods provided a VR reconstruction approach and insights for creating engaging user experiences and improving users understanding of cultural and historical concepts while preserving the originality of the cultural heritage.

Virtual reality and 3D printing in clinical anesthesia: a case series of two years' experience in a single tertiary medical centre.

Anatomically correct patient-specific models made from medical imaging can be printed on a three-dimensional (3D) printer or turned into a virtual reality (VR) program. Until recently, use in anesthesia has been limited. In 2019, the anesthesia department at Tel Aviv Medical Center launched a 3D program with the aim of using 3D modelling to assist in preoperative anesthesia planning. A retrospective review of all relevant patients between July 2019 and June 2021 referred for preoperative airway planning with 3D modelling. Patient files were reviewed for correlation between the model-based airway plan and the actual airway plan, the type of model used, and any anesthetic complications related to airway management. Twenty patients were referred for 3D modelling. Of these, 15 models were printed, including 12 children requiring one lung ventilation. Five patients had VR reconstructions, including three with mediastinal masses. One patient had both a 3D-printed model and a VR reconstruction. There were two cases (10%) where the model plan did not correlate with the final airway plan and one case where a model could not be created because of poor underlying imaging. For the remaining 17 cases, the plan devised on the model matched the final airway plan. There were no anesthetic complications. Three-dimensional modelling and subsequent printing or VR reconstruction are feasible in clinical anesthesia. Its routine use for patients with challenging airway anatomy correlated well with the final clinical outcome in most cases. High-quality imaging is essential.

Evaluating the Effects of Virtual Reality Environment Learning on Subsequent Robot Teleoperation in an Unfamiliar Building.

Using a map in an unfamiliar environment requires identifying correspondences between elements of the map's allocentric representation and elements in egocentric views. Aligning the map with the environment can be challenging. Virtual reality (VR) allows learning about unfamiliar environments in a sequence of egocentric views that correspond closely to the perspectives and views that are experienced in the actual environment. We compared three methods to prepare for localization and navigation tasks performed by teleoperating a robot in an office building: studying a floor plan of the building and two forms of VR exploration. One group of participants studied a building plan, a second group explored a faithful VR reconstruction of the building from a normal-sized avatar's perspective, and a third group explored the VR from a giant-sized avatar's perspective. All methods contained marked checkpoints. The subsequent tasks were identical for all groups. The self-localization task required indication of the approximate location of the robot in the environment. The navigation task required navigation between checkpoints. Participants took less time to learn with the giant VR perspective and with the floorplan than with the normal VR perspective. Both VR learning methods significantly outperformed the floorplan in the orientation task. Navigation was performed quicker after learning in the giant perspective compared to the normal perspective and the building plan. We conclude that the normal perspective and especially the giant perspective in VR are viable options for preparing for teleoperation in unfamiliar environments when a virtual model of the environment is available.

UAV Placement for VR Reconstruction: A Tradeoff Between Resolution and Delay

Unmanned aerial vehicle (UAV) can be combined with virtual reality (VR) to collect the rapidly changing physical environment by leveraging its high flexibility, so as to provide an immersive experience for metaverse users. In this letter, we study the UAV placement problem in UAV-assisted VR systems where UAVs are deployed to capture images of ground targets and then transmit them to ground users for virtual environment reconstruction. The goal is to minimize the transmission delay while satisfying the image resolution requirement. Firstly, the UAV placement problem is formulated into a non-convex optimization problem. Then, an efficient algorithm is proposed to obtain a high-quality solution by adopting the block coordinate descent and successive convex approximation techniques with low complexity. Finally, the numerical results are provided and show that considerable benefits can be obtained with a suboptimal UAV placement. Specifically, the proposed scheme can reduce the transmission delay by over 15 ms compared to the conventional scheme when the received signal-to-noise ratio at the reference distance is 10 <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">6</sup> and the resolution requirement is 0.5.

Meshed neuronal mitochondrial networks empowered by AI-powered classifiers and immersive VR reconstruction.

Mitochondrial networks are defined as a continuous matrix lumen, but the morphological feature of neuronal mitochondrial networks is not clear due to the lack of suitable analysis techniques. The aim of the present study is to develop a framework to capture and analyze the neuronal mitochondrial networks by using 4-step process composed of 2D and 3D observation, primary and secondary virtual reality (VR) analysis, with the help of artificial intelligence (AI)-powered Aivia segmentation an classifiers. In order to fulfill this purpose, we first generated the PCs-Mito-GFP mice, in which green fluorescence protein (GFP) could be expressed on the outer mitochondrial membrane specifically on the cerebellar Purkinje cells (PCs), thus all mitochondria in the giant neuronal soma, complex dendritic arborization trees and long projection axons of Purkinje cells could be easily detected under a laser scanning confocal microscope. The 4-step process resolved the complicated neuronal mitochondrial networks into discrete neuronal mitochondrial meshes. Second, we measured the two parameters of the neuronal mitochondrial meshes, and the results showed that the surface area (μm2) of mitochondrial meshes was the biggest in dendritic trees (45.30 ± 53.21), the smallest in granular-like axons (3.99 ± 1.82), and moderate in soma (27.81 ± 22.22) and silk-like axons (17.50 ± 15.19). These values showed statistically different among different subcellular locations. The volume (μm3) of mitochondrial meshes was the biggest in dendritic trees (9.97 ± 12.34), the smallest in granular-like axons (0.43 ± 0.25), and moderate in soma (6.26 ± 6.46) and silk-like axons (3.52 ± 4.29). These values showed significantly different among different subcellular locations. Finally, we found both the surface area and the volume of mitochondrial meshes in dendritic trees and soma within the Purkinje cells in PCs-Mito-GFP mice after receiving the training with the simulating long-term pilot flight concentrating increased significantly. The precise reconstruction of neuronal mitochondrial networks is extremely laborious, the present 4-step workflow powered by artificial intelligence and virtual reality reconstruction could successfully address these challenges.

Development of a Dundee Ground Truth imaging protocol for recording indoor crime scenes to facilitate virtual reality reconstruction

Early and accurate visualisation of a crime scene is highly desirable such that a rapid, agile, and informed decision-making process can be undertaken by an investigative team. We present a new standard operating procedure for imaging an indoor scene using DSLR cameras conventionally used by crime scene investigators and examiners. The standard operating procedure (SOP) enables the systematic photography of indoor spaces in such a way that the Structure from Motion (SfM) photogrammetry technique can be implemented, allowing the scene to be recreated in Virtual Reality (VR). To demonstrate the method’s validity, we compare two VR-rendered representations of an example scene using (a) photographs taken by an experienced crime scene examiner using a conventional photographic method and (b) photographs taken by a novice photographer following the developed SOP.

Multimedia Vision Improvement and Simulation in Consideration of Virtual Reality Reconstruction Algorithms

Due to the large noise and many discrete points of the image in the traditional image reconstruction process, the reconstruction quality of the image deviates greatly from the actual target. In this study, the virtual reality reconstruction algorithm is applied to multimedia vision, the virtual reality image is corrected by using the binocular offset positioning method, the denoising process is performed in the image reconstruction process, and the high-pass filter matrix is used to improve the image reproduction. At the same time, the three-dimensional reconstruction algorithm is used to perform correlation retrieval, the ensemble point set and the discrete point set are obtained, the maximum and minimum reconstruction degree areas are clarified, and the deviation reconstruction and peak relocation can be performed. Finally, the experimental test results show that the algorithm in this study can enhance the authenticity of image reconstruction, improve the accuracy of image corner detection, and effectively reduce the noise interference in the process of reconstructing the image.

A Novel Sentiment Analysis Model of Museum User Experience Evaluation Data Based on Unbalanced Data Analysis Technology.

With the development of virtual reality and digital reconstruction technology, digital museums have been widely promoted in various cities. Digital museums offer new ways to display and disseminate cultural heritage. It allows remote users to autonomously browse displays in a physical museum environment in a digital space. It is also possible to reproduce the lost heritage through digital reconstruction and restoration, so as to digitally present tangible cultural heritage and intangible cultural heritage to the public. However, the user's experience of using digital museums has not been fully and deeply studied at present. In this study, the user's experience evaluation data of digital museum are classified and processed, so as to analyze the user's emotional trend towards the museum. Considering that the user's evaluation data are unbalanced data, this study uses an unbalanced support vector machine (USVM) in the classification of user evaluation data. The main idea of this method is that the boundary of the support vector is continuously shifted to the majority class by repeatedly oversampling some support vectors until the real support vector samples are found. The experimental results show that the classification obtained by the used USVM has a good practical reference value. Based on the classification results of the evaluation data, the construction of the digital museum can be further guided and maintained, thereby improving the user experience satisfaction of the museum. This research will make an important contribution to the construction of the museum and the inheritance of culture.

Cinema memories in 3D modelling and virtual reality storytelling

This paper focuses on the project VR and AR in the valorisation of cultural and artistic heritage within the New Cinema History framework, aims to combine microhistory related to local cinema theatres and Cinema Heritage, and to investigate the possibilities that digital media – in this case Augmented and Virtual Reality – have in the valorisation and preservation of cultural heritage. The final output of the project is the Virtual Reality reconstruction of the Odeon cinema’s architecture and habits of cinemagoing that, thanks to an immersive experience via the Oculus Rift headset, could evoke and simulate historical spectatorship that dealt both with the moment of watching a movie and its peripheral practice. the development of the project, at least four different perspectives on the Odeon cinema converged to form the basis of the VR reconstruction: the literature on the topic, the consultation of public and private archives, the oral sources, and photographs taken on site. This paper focuses mostly on the documents and sources used in the VR project and it aims to investigate how various and heterogeneous documents can be woven together into a philologically reliable historical reconstruction, and how they can be used in 3D modelling and VR storytelling related to Cinema Heritage.

Virtual reality-based evaluation of neurovascular conflict for the surgical planning of microvascular decompression in trigeminal neuralgia patients.

Trigeminal neuralgia (TN) is a lightning bolt of violent, electrifying, and stinging pain, often secondary to the neurovascular conflict (NVC). The vessels involved in NVC are mostly arteries and rarely veins. Evaluation of NVC in the deep infratentorial region is inseparably connected with cranial imaging. We retrospectively analyzed the potential influence of three-dimensional (3D) virtual reality (VR) reconstructions compared to conventional magnetic resonance imaging (MRI) scans on the evaluation of NVC for the surgical planning of microvascular decompression in patients with TN. Medical files were retrospectively analyzed regarding patient- and disease-related data. Preoperative MRI scans were retrospectively visualized via VR software to detect the characteristics of NVC. A questionnaire of experienced neurosurgeons evaluated the influence of VR visualization technique on identification of anatomical structures involved in NVC and on surgical strategy. Twenty-four patients were included and 480 answer sheets were evaluated. Compared to conventional MRI, image presentation using 3D-VR modality significantly influenced the identification of the affected trigeminal nerve (p = 0.004), the vascular structure involved in the NVC (p = 0.0002), and the affected side of the trigeminal nerve (p = 0.005). In patients with TN caused by NVC, the reconstruction of conventional preoperative MRI scans and the spatial and anatomical presentation in 3D-VR models offers the possibility of increased understanding of the anatomy and even more the underlying pathology, and thus influences operation planning and strategy.

3D Virtual Reality Implementation of Tourist Attractions Based on the Deep Belief Neural Network.

In today's society, information technology is widely used, and virtual reality technology, as one of the emerging frontier technologies, has entered a stage of rapid development. Virtual reality is the use of computer technology to simulate the real-life environment into a virtual simulation environment, with the help of special equipment to realize the natural interaction between users and technical environment, in which the tourism industry is the most widely used. In order to realize 3D virtual reality of tourist attractions and improve users' immersive experience in the process of interaction, the deep belief neural network is introduced to realize the target recognition and reconstruction in virtual reality. The results show that the algorithm has excellent performance in target recognition and target reconstruction, and deep belief networks improve the accuracy by 0.57% and 0.81% and the accuracy by 0.21% and 2.06%, respectively, compared with the current optimal algorithm in target recognition of 12 and 20 view regular projection images. Compared with the current optimal algorithm, deep belief networks are reduced by 0.2%, 3.7%, and 0.6%, respectively. The accuracy index was increased by 2%, 0.1%, and 0.1%, respectively. The above results show that the proposed algorithm based on the deep belief neural network can realize 3D virtual reality of complex scenes such as tourist attractions according to its excellent performance.

Impact of Virtual Reality in Arterial Anatomy Detection and Surgical Planning in Patients with Unruptured Anterior Communicating Artery Aneurysms.

Anterior-communicating artery (ACoA) aneurysms have diverse configurations and anatomical variations. The evaluation and operative treatment of these aneurysms necessitates a perfect surgical strategy based on review of three-dimensional (3D) angioarchitecture using several radiologic imaging methods. We analyzed the influence of 3D virtual reality (VR) reconstructions versus conventional computed tomography angiography (CTA) scans on the identification of vascular anatomy and on surgical planning in patients with unruptured ACoA aneurysms. Medical files were retrospectively analyzed regarding patient- and disease-related data. Preoperative CTA scans were retrospectively reconstructed to 3D-VR images and visualized via VR software to detect the characteristics of unruptured ACoA aneurysms. A questionnaire was used to evaluate the influence of VR on the identification of aneurysm morphology and relevant arterial anatomy and on surgical strategy. Twenty-six patients were included and 520 answer sheets were evaluated. The 3D-VR modality significantly influenced detection of the aneurysm-related vascular structure (p = 0.0001), the recommended head positioning (p = 0.005), and the surgical approach (p = 0.001) in the planning of microsurgical clipping. Thus, reconstruction of conventional preoperative CTA scans into 3D images and the spatial presentation in VR models enabled greater understanding of the anatomy and pathology, provided realistic haptic feedback for aneurysm surgery, and influenced operation planning and strategy.