Virtual Reality Modeling Research Articles

Reply to Editorial Comment: Effect of 3-Dimensional, Virtual Reality Models for Surgical Planning of Robotic Partial Nephrectomy on Surgical Outcomes: Qualitative Data from a Randomized Clinical Trial

Reply to Editorial Comment: Effect of 3-Dimensional, Virtual Reality Models for Surgical Planning of Robotic Partial Nephrectomy on Surgical Outcomes: Qualitative Data from a Randomized Clinical Trial

Editorial Comment: Effect of 3-Dimensional, Virtual Reality Models for Surgical Planning of Robotic Partial Nephrectomy on Surgical Outcomes: Qualitative Data From a Randomized Clinical Trial

Editorial Comment: Effect of 3-Dimensional, Virtual Reality Models for Surgical Planning of Robotic Partial Nephrectomy on Surgical Outcomes: Qualitative Data From a Randomized Clinical Trial

Editorial Comment: Effect of 3-Dimensional, Virtual Reality Models for Surgical Planning of Robotic Partial Nephrectomy on Surgical Outcomes: Qualitative Data from a Randomized Clinical Trial

Editorial Comment: Effect of 3-Dimensional, Virtual Reality Models for Surgical Planning of Robotic Partial Nephrectomy on Surgical Outcomes: Qualitative Data from a Randomized Clinical Trial

Revolutionising Conventional Marketing with AI: Leveraging Machine Learning for Marketing

Amidst an age characterized by rapid technological progress, this research paper investigates the revolutionary capacity of artificial intelligence (AI) and machine learning (ML) to alter traditional marketing methodologies fundamentally. In order to address the drawbacks of conventional marketing methods, this article develops a theoretical framework that emphasizes the critical importance of machine learning algorithms, such as supervised, unsupervised, and reinforcement learning, and AI customer relationship management (ACRM). The research explores pragmatic approaches, including meta-analysis, case studies, and A/B testing, to demonstrate how artificial intelligence (AI) can generate concrete outcomes and confer a competitive advantage. The paper provides an overview of several emerging trends, including Explainable AI (XAI), Edge AI, Fog Computing, Neuromorphic Computing, and Generative AI. It highlights their potential impact on the success of businesses. By means of perceptive case studies involving notable companies such as Spotify, Sephora, and Netflix, the article illustrates how ML and AI strategies have been customized to improve customer retention and develop efficacious marketing approaches. Among the methodologies that are deliberated upon are hyper-targeting and AI-powered segmentation employing LSTMs and dynamic learning. Moreover, the study investigates novel methodologies and their benefits for enhancing user involvement, including the integration of chatbots, Conversational AI, Augmented Reality (AR), Virtual Reality (VR), and attribution models tailored for multi-touch marketing initiatives. By incorporating these sophisticated methodologies, organizations can not only adjust to the ever-changing marketing environment but also generate customized and influential consumer encounters. This paper functions as an all-encompassing manual for marketing practitioners, researchers, and enterprises aiming to exploit the complete capabilities of AI and ML in order to drive their marketing endeavors to an unparalleled level of achievement.

Three‐dimensional mapping and immersive human–robot interfacing utilize Kinect‐style depth cameras and virtual reality for agricultural mobile robots

AbstractNavigation and autonomous operation in farmland or greenhouse environments present significant challenges for agricultural mobile robots on account of unstructured scene conditions and complex task requirements. The immersive interfaces based on human–robot interaction have been extensively developed, which bridge the high‐level decision of human beings and the precise sensing and high motion ability of robots. In this study, we propose a human–robot interaction framework based on three‐dimensional mapping and virtual reality (VR) visualization. On the construction client, dense three‐dimensional point‐cloud maps are created based on the simultaneous localization and mapping real‐time appearance‐based mapping algorithm with a Kinect‐style depth camera. Subsequently, point‐cloud filtering and mesh creation methods are introduced for postprocessing the map models. A data communication network is employed to transmit the optimized models to the VR‐based exploration client. Utilizing VR visualization, the operator can gain an intuitive and comprehensive understanding of the environments to be explored. The three‐dimensional agricultural scenes are mapped into VR models through the system, which can combine the physical worlds with the VR spaces in a better manner. Compared with the video streaming‐based method for three‐dimensional mapping, the map models with colors and textures are entirely displayed in the VR headset, thus providing robust and global human–robot interaction interfaces and enhancing the immersive exploration for human beings to a considerable extent. Experimental results indicate that the three‐dimensional map models exhibit relatively sufficient construction integrity and yield favorable optimization effects. Additionally, according to a user questionnaire survey, immersive VR‐based interfaces can be more effectively utilized for the three‐dimensional mapping of mobile robots. Research evidence and results demonstrate that our proposed system framework offers positive assistance and support for enhancing human–robot interaction and executing specific robotic tasks in unstructured field agricultural environments. Code implementation and related data sets are shared at the link https://github.com/WangDongBUAA/Mapping_Interfacing.

Validation of technology acceptance model for virtual reality usage in collaborative learning to enhance learner performance

ABSTRACT The growing influence of technology has prompted numerous scholars to explore how virtual reality (VR) affects performance. This study aims to validate the technology acceptance model (TAM) for VR in collaborative learning to enhance performance. We employed a questionnaire for data collection, distributed to 423 master’s students in China engaging in VR-based collaborative learning. We employed partial least squares structural equation modelling (PLS-SEM) to analyse the data. The findings reveal that perceived usefulness and ease of use positively influence the intention to use VR and engage in collaborative learning. Furthermore, the intention to use VR and collaborative learning positively affect learner performance. Notably, habit does not significantly moderate the relationship between the intention to use VR and learner performance. Therefore, the proposed model can serve as a valuable tool for educators and decision-makers, aiding in the development of strategies to encourage students to use VR for enhanced performance.

Virtual reality and ANN-based three-dimensional tactical training model for football players

Virtual reality and ANN-based three-dimensional tactical training model for football players

Virtual reality modeling application based on multi perspective and deep learning in the new media presentation and brand building of Dongguan City memory

AbstractTo help the new media presentation and brand building of Dongguan City memory, a virtual reality modeling model based on multi‐perspective and deep learning is proposed. First, in order to address the issue of imbalanced input and output information in depth map prediction tasks, as well as poor accuracy of predicted depth map boundaries, a depth map prediction model based on multiple perspectives and deep learning is built. Then, a single perspective modeling framework is proposed to address the scarcity of perspectives in practical situations, and a dynamic fusion model is built for single‐view virtual reality scenes based on multi‐view generation networks. The results indicated that the mean square error, average relative error, and average logarithmic error were minimized at 0.52, 0.138, and 0.068, respectively. The multi‐threshold accuracy index demonstrated peak values at 0.772, 0.8821, and 0.947, respectively. The grid simplification algorithm exhibited the shortest running times at 1.57, 2.52, 3.91, and 6.53 s, respectively. Moreover, the single‐view modeling frame displayed the smallest angle distance at 0.1449, while the overlap degree of the point cloud scene reached the highest levels at 77.47, 79.49, 83.5, and 84.47, respectively. To sum up, the model has a good application effect in virtual reality modeling and positively affects virtual reality technology development.

Virtual reality applications in pediatric surgery

Virtual reality modeling (VRM) is a 3-dimensional (3D) simulation. It is a powerful tool and has multiple uses and applications in pediatric surgery. Patient-specific 2-dimensional imaging can be used to generate a virtual reality model, which can improve anatomical perception and understanding, and can aid in preoperative planning for complex operations. VRM can also be used for realistic training and simulation. It has also proven effective in distraction for pediatric patients experiencing pain and/or anxiety. We detail the technical requirements and process required for VRM generation, the applications, and future directions.

A Virtual Reality Anatomy Model of the Temporal Bone in ORL Residency Training-Gain or Gadget?

Virtual reality (VR) appears to be a promising educational tool for otorhinolaryngology (ORL) residency training, as it allows for safe and effective practice immediate feedback and potential improvements in patient outcomes. Despite these advantages, VR has not yet been incorporated into residency training in ORL, which may be due to limited availability or validation and skepticism toward incorporation of new training methods. This study investigates whether a VR model of the temporal bone improves learning success for ORL residents in comparison to standard plastic models and whether it depends on surgeon's experience. We also included a subjective evaluation of the learning experience with both models. ORL residents and specialists at 2 German university hospitals were tested on their knowledge of temporal bone anatomy after training with either VR or standard plastic models. In addition, we compared knowledge of the temporal bone anatomy before- and after-VR training. Lastly, a subjective survey on the benefits and limitations of VR was conducted to assess participants' views on this new technology. About 85% of the participants considered VR to be better than conventional models and agreed that VR was a useful tool for teaching complex anatomy. Objective evaluation showed significant improvement in knowledge after using VR (before/after comparison), especially in participants with a higher level of preexisting knowledge. Direct comparison to conventional plastic models showed no superiority of the VR model. VR models in ORL are not only appealing and motivating for residents, but also objectively improve their anatomical knowledge, especially in advanced residency. In addition, VR-in contrast to the plastic model-offers opportunities for further development and optimization.

Direct Solid Modelling in Virtual Reality for Systems Architecting

Virtual reality (VR) is gaining more and more interest in multidisciplinary early design activities, from eliciting stakeholder needs to designing a system architecture. The design of a system architecture can be simplified as the definition of three views: functional, behavioural, and structural. The geometric modelling capabilities needed for the embodiment design are still based on desktop-based parametric CAD models, which were eventually transformed into a polyhedral model that can be visualised in VR. When a multidisciplinary team gets together to generate candidate design architecture, they need to create conceptual 3D shapes and determine the layout of components. In this paper, we propose the Virtual Reality Shape Modelling (VRSM) environment for the immersive direct modelling of 3D shapes in VR. VRSM integrates the open-source FreeCAD shape modeller with the game engine Unity. FreeCAD enables the user to capture the history of feature-based operations and to create a parametric representation needed for detailed CAD activities, whereas Unity allows the interaction with polyhedral models in a 3D environment. The current version of VRSM offers modelling capabilities to create, delete, move and resize canonical shapes and apply Boolean operators on a polyhedral model in VR. At the same time, the parametric definition in FreeCAD evolves synchronously.

Effect of 3-Dimensional, Virtual Reality Models for Surgical Planning of Robotic Partial Nephrectomy on Surgical Outcomes: Qualitative Data from a Randomized Clinical Trial

Purpose: Planning for robotic-assisted partial nephrectomy requires surgeons to review two-dimensional CT or MRI scans to understand three-dimensional (3D) anatomy. We sought to determine the drivers of improvements in key surgical outcomes when using patient-specific 3D virtual reality (VR) models for operative planning. Materials and Methods: A multicenter, randomized, single-blind clinical trial was conducted from January 2019 to December 2020. Patients undergoing robotic-assisted partial nephrectomy were randomly assigned to a control group undergoing usual preoperative planning with CT and/or MRI only or to an intervention group where imaging was supplemented with a 3D VR model. A survey was administered to surgeons after review of the model and after the operation. The primary outcome measure was operative time, and secondary outcomes included clamp time, estimated blood loss, and hospital stay. Results: Qualitative data analysis of 44 cases in the treatment arm was performed. Surgeons reported seeing anatomic details much better in the 3D model 55% of the time and modified their preoperative plan based on anatomy shown in the 3D model 30% of the time. Cases in which the surgeon reported modifying their preoperative plan after viewing the model (30%) had significantly lower operative time, blood loss, and clamp time (P < .05). In addition, increased surgeon confidence after viewing the model significantly lowered operative time, estimated blood loss, and clamp time (P < .05). Conclusions: We demonstrate that surgeons who use 3D VR models for robotic kidney surgery are able to visualize anatomic structures and select the optimal approach, leading to better surgical outcomes. Trial Registration: ClinicalTrials.gov identifier NCT0333434.

Exploration of the Influence of Traditional Art Colors on the Visual Communication Effect of Modern Graphic Design Based on VR Models

Abstract This paper discusses how virtual reality (VR) technology effectively integrates traditional art colors in modern graphic design and its impact on the visual communication effect. Through structural equation modeling (SEM) and K-mean clustering algorithm, the application of traditional art colors in modern graphic design and its influence on visual communication are studied and analyzed. The results show that applying standard colors has a significant impact in contemporary graphic design, especially in emotional resonance, cultural symbols, guiding attention and brand identity. The application of conventional colors has a high visual communication effect with modern graphic design, and there is a significant positive correlation between the dimensions. Finally, through K-mean clustering analysis, the optical communication effect of graphic design is divided into four types, in which emotional resonance and cultural symbols occupy an essential position in the visual communication effect. The research results provide a theoretical basis for applying traditional delicate art colors in modern graphic design and a practical reference for designers in the actual design process.

Mixed reality in neurosurgery: redefining the paradigm for arteriovenous malformation planning and navigation to improve patient outcomes.

Brain arteriovenous malformations (AVMs) present significant challenges in neurosurgery, requiring detailed planning and execution. In this study, the authors aimed to evaluate the efficacy of mixed reality (MxR), a synergistic application of virtual reality (VR) and augmented reality (AR), in the surgical management of AVMs. A retrospective review was conducted on 10 patients who underwent AVM resection between 2021 and 2023. Preoperative planning used patient-specific 360° VR models, while intraoperative guidance used AR markers for targeted disconnection of arterial feeders. Data were analyzed for surgical duration, blood loss, and postoperative outcomes, stratified by Spetzler-Martin (SM) and supplemented Spetzler-Martin (Supp-SM) grades. In 10 patients with cerebral AVMs, MxR significantly facilitated the identification of 21 arterial feeders, including challenging deep feeders. MxR-assisted surgeries demonstrated efficient identification and disconnection of arterial feeders, contributing to precise AVM resection. The mean surgical duration was approximately 5 hours 11 minutes, with a mean intraoperative blood loss of 507.5 ml. Statistically significant variations in surgical duration and blood loss were observed based on SM and supplemented Supp-SM grades. Two patients experienced worsened postoperative neurological deficits, underscoring the inherent risks of AVM surgeries. The marked difference in hospital stays between patients with ruptured and those with unruptured AVMs, particularly for SM grade III, highlights the significant impact of rupture status on postoperative recovery. In this study, the authors delineated a novel paradigm using MxR for the surgical intervention of AVMs. Using 3D VR for preoperative planning and AR for intraoperative guidance, they achieved unparalleled precision and efficiency in targeting deep arterial feeders. While the results are promising, larger studies are needed to further validate this approach.

Virtual Reality and Language Models, a New Frontier in Learning

The proposed research introduces an innovative Virtual Reality (VR) and Large Language Model (LLM) architecture to enhance the learning process across diverse educational contexts, ranging from school to industrial settings. everaging the capabilities of LLMs and Retrieval-Augmented Generation (RAG), the architecture centers around an immersive VR application. This application empowers students of all backgrounds to interactively engage with their environment by posing questions and receiving informative responses in text format and with visual hints in VR, thereby fostering a dynamic learning experience. LLMs with RAG act as the backbones of this architecture, facilitating the integration of private or domain-specific data into the learning process. By seamlessly connecting various data sources through data connectors, RAG overcomes the challenge of disparate and siloed information repositories, including APIs, PDFs, SQL databases, and more. The data indexes provided by RAG solutions further streamline this process by structuring the ingested data into formats optimized for consumption by LLMs. An empirical study was conducted to evaluate the effectiveness of this VR and LLM architecture. Twenty participants, divided into Experimental and Control groups, were selected to assess the impact on their learning process. The Experimental group utilized the immersive VR application, which allowed interactive engagement with the educational environment, while the Control group followed traditional learning methods. The study revealed significant improvements in learning outcomes for the Experimental group, demonstrating the potential of integrating VR and LLMs in enhancing comprehension and engagement in learning contexts. This study presents an innovative approach that capitalizes on the synergy between LLMs and immersive VR technology, opening avenues for a transformative learning experience that transcends traditional boundaries and empowers learners across a spectrum of educational landscapes.

Analysis of the enhancement of computer simulation on physical education teaching in colleges and universities

Abstract The integration of computer simulation and modeling into physical education represents a significant shift in teaching methodologies within higher education, prompted by the advancements of the digital era. This study scrutinizes the effectiveness of such technologies in augmenting student learning outcomes and pedagogical efficiency in PE courses. Through the application of virtual reality and precise movement modeling, the research contrasts the impacts of traditional teaching with those of computer-assisted simulations. Findings demonstrate that computer simulation significantly improves students’ physical fitness (by 15%) and skill proficiency (by 20%) and markedly increases their engagement with the subject matter. Additionally, the ability to practice in a simulated, hazard-free environment reduces the time required to master skills. These results support the broad implementation of simulation technologies in physical education, promising enhanced student motivation, skill development, and academic interest.

Enhancing Industrial Operator Training through BIM-Enriched Virtual Reality Scenes

In today’s evolving industrial landscape, enhancing workforce resilience by improving the ability to navigate complex and unforeseen scenarios, is essential. This paper explores the role of training, especially during disruptions, introducing an innovative approach that combines Building Information Modeling (BIM) and Virtual Reality (VR). This aims to ease the creation of automatic BIM-enriched VR training environments. However, this process revealed some technical challenges that need to be addressed for an effective implementation. Therefore, this paper covers the theoretical background of VR and BIM, their common applications, and develops the conceptual basis of BIM-enriched VR models. A prototype of this integration has been developed, based on the case study proposed. This allowed to highlight the challenges the paradigm entails and for the definition of suggestions to overcome them.

A framework to integrate virtual reality into international standard safety trainings

PurposeThe objective of this research is to propose an immersive framework that integrates virtual reality (VR) technology with directives international safety training certification bodies to enhance construction safety training, which eventually leads to safer construction sites.Design/methodology/approachThe adopted methodology combines expert insights and experimentation to maximize the effectiveness of construction safety training. The first step was identifying key considerations for VR models such as motion sickness prevention and adult learning theories. The second step was developing a game-like VR model for safety training, with multiple hazards and scenarios based on the considerations of the previous step. After that, safety experts evaluated the model and provided valuable feedback on its alignment with international safety training practices. Finally, the developed model is tested by senior students, where the testing format followed the Institution of Occupational Safety and Health (IOSH) working safely exam structure.FindingsAn advanced immersive VR safety training model was developed based on extensive lessons learned from the literature, previous work and psychology-informed adult learning theories. Model testing – through focus groups and hands-on experimentation – demonstrated significant benefit of VR in upgrading and complementing traditional training methods.Originality/valueThe findings presented in this paper make a significant contribution to the field of safety training within the construction industry and the broader context of immersive learning experiences. It also fosters further exploration into immersive learning experiences across educational and professional contexts.

Synchronized Control of Robotic Arm based on Virtual Reality and IMU Sensing

This study introduces a robotic control system that combines virtual reality integration and inertial measurement units (IMU) using mixed reality (MR) devices. The system integrates three main modules: (1) virtual reality (VR), which simulates remote reality by the Hololens2, (2) the wearable IMUs device, which captures the operator's hand movements; and (3) the robotic arm UR5, which is controlled by the user and the VR environment. The virtual and physical systems communicate via a Message Queuing Telemetry Transport (MQQT) communication architecture to establish communication between modules. To introduce a closed-loop control system for the robotic arm, model predictive control (MPC) was achieved with precise path planning to provide a flexible, intuitive, and reliable method to operate the remote-controlled manipulator. To validate the system integration and functions, two demonstrations were conducted: (a) the offline mode, where the VR module of the robotic arm was controlled by the IMUs device to check correctness, and (b) the online mode, where the control command was transferred to UR5 to complete a target mission via artificial potential field (APF) adjustment. The primary outcome of this study was the development of virtual and real industrial robotic arms to test the developed model in VR and shop floor labs.

An auditory virtual reality of meeting room acoustics using wave-based acoustic simulations: A content for intuitive understanding of room-acoustics control effect by sound absorbers

Recently, wave-based room acoustic simulation technologies are becoming a realistic option as a small-room acoustics design tool and a virtual indoor sound environment creation tool for research and education. The present paper shows an auditory VR meeting room content, which makes us easily understand how sound absorbers play an essential role in creating a better acoustic environment. Unity creates the 3D virtual reality model, and a binaural room-acoustic auralization is realized by a hybrid technique combined with Ambisonics and the head-related transfer function using RIRs computed by a high-speed parallel wave-based room acoustics solver. The VR meeting room is constructed under various acoustic treatments with sound absorber modeling by wave-based material models.