Virtual Reality Simulation System Research Articles

Developing a Virtual Reality Simulation System for Preoperative Planning of Robotic-Assisted Thoracic Surgery.

Background. Robotic-assisted thoracic surgery (RATS) is now standard for lung cancer treatment, offering advantages over traditional methods. However, RATS's minimally invasive approach poses challenges like limited visibility and tactile feedback, affecting surgeons' navigation through com-plex anatomy. To enhance preoperative familiarization with patient-specific anatomy, we devel-oped a virtual reality (VR) surgical navigation system. Using head-mounted displays (HMDs), this system provides a comprehensive, interactive view of the patient's anatomy pre-surgery, aiming to improve preoperative simulation and intraoperative navigation. Methods. We integrated 3D data from preoperative CT scans into Perspectus VR Education software, displayed via HMDs for in-teractive 3D reconstruction of pulmonary structures. This detailed visualization aids in tailored preoperative resection simulations. During RATS, surgeons access these 3D images through Tile-ProTM multi-display for real-time guidance. Results. The VR system enabled precise visualization of pulmonary structures and lesion relations, enhancing surgical safety and accuracy. The HMDs offered true 3D interaction with patient data, facilitating surgical planning. Conclusions. VR sim-ulation with HMDs, akin to a robotic 3D viewer, offers a novel approach to developing robotic surgical skills. Integrated with routine imaging, it improves preoperative planning, safety, and accuracy of anatomical resections. This technology particularly aids in lesion identification in RATS, optimizing surgical outcomes.

Flightcrew Procedures Experimental Training: Simulation Testbed Design, Development, & Interactive Demonstration

In this interactive demonstration, participants will have the opportunity to use the UCF-developed Flight Procedures Experimental Training (FlightPET) research simulation testbed to complete an exterior preflight inspection of a multiengine transport category aircraft. FlightPET may be implemented using virtual reality (VR) or conventional desktop displays. FlightPET was developed to support research on modern training practices in the air carrier industry and was designed to help identify which combinations of display technologies and training approaches should be used for specific flightcrew-relevant topics, in what contexts, and how to leverage these configurations to create outcomes comparable to conventional training methods. In this paper, we document the iterative development of the FlightPET simulation testbed and discuss facets of the systematic instructional systems design (ISD) process in which human factors (HF) may be integrated to support the development of VR simulation systems for flightcrew training.

13 Surgical Priming Improves Operative Performance in Surgical Trainees: A Crossover Randomised Control Trial

Abstract Aim The aim of this study was to evaluate the impact of a surgical warm-up using a virtual reality simulator on operative performance. Method This was a single-blinded cross-over randomised control trial in a single tertiary Orthopaedic training centre. Orthopaedic trainees were recruited, and each morning participants rostered to theatre were randomised to either undergo a simulated surgical procedure on a virtual reality simulation system prior to their first case as primary operator (priming arm), or to perform their usual preparatory routine for surgery (control arm). Consultant orthopaedic trainers were recruited within the orthopaedic unit to carry out subjective surgical performance assessments using a validated global rating scale tool on the first case the participant performed on 46 the list as primary operator. Results Over 3 study periods a total of 151 datapoints were collected, with 49 matched datapoints across priming status and procedural level of difficulty. Subjective assessment tools consistently demonstrated improved operative performance by participants following surgical priming (p = 0.001). Conclusions This study highlights that introduction of preoperative priming to improve operative preparation and optimises operative performance. This has not only implications for improved resident training, but also signals towards beneficial downstream effects on patient outcomes, and theatre list planning.

A Digital Twin Model of Three-Dimensional Shading for Simulation of the Ironmaking Process

Advanced manufacturing is a new trend for sustainable industrial development, and digital twin is a new technology that has attracted attention. Blast furnace smelting is an effective method in the manufacturing of iron and steel. Comprehensive and dependable surveillance of the blast furnace smelting process is essential for ensuring the smooth operation and improving of iron and steel output quality. The current technology makes it difficult to monitor the entire process of blast furnace ironmaking. Based on Unity 3D, this study presents a digital-twin virtual reality simulation system of blast furnace ironmaking. First, shading modeling creates a three-dimensional dynamic geometric model in different ironmaking system scenarios. Then, we script the animation and call particle system according to the motion mode of distinct geometric objects to give the dynamic effect of geometric objects. Shaders are the focus of the design and contributions. In addition, shader optimization technology can reduce hardware resource consumption and increase system fluency. Vertex shaders are used for all types of coordinate space transformation and vertex output; fragment shaders are used for texture sampling, light model calculation, normal calculation, noise superposition, and color output. The shader rendering technique allows for more realistic lighting effects. The presented dynamic digital twin system implements more realistic lighting analyzed in the ironmaking process. Virtual interaction logic’s design and deployment process is based on HTC VIVE hardware and VRTK toolkit. In the actual simulation process, the typical animation frame rate is stable at about 75 FPS (frames per second). The simulation system runs smoothly and a cutting-edge and state-of-the-art method for observing the blast furnace ironmaking process is suggested.

Surgical Priming Improves Operative Performance in Surgical Trainees: A Crossover Randomized Control Trial

The aim of this study was to evaluate the impact of a surgical warm-up using a virtual reality simulator on operative performance. This was a single-blinded cross-over randomized control trial in a single tertiary Orthopedic training center. Orthopedic trainees were recruited, and each morning participants rostered to theatre were randomized to either undergo a simulated surgical procedure on a virtual reality simulation system prior to their first case as primary operator (priming arm), or to perform their usual preparatory routine for surgery (control arm). Consultant orthopedic trainers were recruited within the orthopedic unit to carry out subjective surgical performance assessments using a validated global rating scale tool on the first case the participant performed on the list as primary operator. Over 3 study periods a total of 151 data points were collected, with 49 matched data points across priming status and procedural level of difficulty. Subjective assessment tools consistently demonstrated improved operative performance by participants following surgical priming (p = 0.001). This study highlights that introduction of preoperative priming to improve operative preparation, and optimizes operative performance. This has not only implications for improved resident training, but also signals towards beneficial downstream effects on patient outcomes, and theatre list planning.

Dynamic Modeling and Simulation Analysis of Virtual Product Design and Creation Based on OSG Artificial Intelligence Platform

The creation of Koji Pottery art is a creative act that has risen rapidly in recent years. The difference in the proportion of ingredients in the glaze directly affects the roughness, luster, and glaze of the glazed surface of the work. The curve of heating and cooling is also the key to the success or failure of the work. Therefore, taking the Koji tea bowl shape as a research example, a virtual reality simulation system and an OSG (OpenSceneGraph) artificial intelligence platform are used to construct a Koji tea bowl shape simulation model, and then the physical production is performed according to the model. After the design and production of the Koji tea bowl shape, the RTM (resin transfer molding) model is used to evaluate the process quality standard requirements of the Koji bowl shape. According to the RTM model test results, the homogeneity test results show that the result is much larger than 0.10, from which it can be inferred that the Koji tea bowl shape has reached the national process quality standard requirements. At the same time, the OSG artificial intelligence platform uses the iterative random sampling method to extract and display the abnormal data in the simulation model, which greatly improves the success rate of ceramic creation. In this paper, the creation and simulation of virtual ceramics based on OSG artificial intelligence platform are deeply studied and analyzed, and the related processes are improved, which reduces the difficulty of software operation and improves the creation efficiency.

Validation of a novel virtual reality simulation system with the focus on training for surgical dissection during laparoscopic sigmoid colectomy

BackgroundMastery of technical skills is one of the fundamental goals of surgical training for novices. Meanwhile, performing laparoscopic procedures requires exceptional surgical skills compared to open surgery. However, it is often difficult for trainees to learn through observation and practice only. Virtual reality (VR)-based surgical simulation is expanding and rapidly advancing. A major obstacle for laparoscopic trainees is the difficulty of well-performed dissection. Therefore, we developed a new VR simulation system, Lap-PASS LP-100, which focuses on training to create proper tension on the tissue in laparoscopic sigmoid colectomy dissection. This study aimed to validate this new VR simulation system.MethodsA total of 50 participants were asked to perform medial dissection of the meso-sigmoid colon on the VR simulator. Forty-four surgeons and six non-medical professionals working in the National Cancer Center Hospital East, Japan, were enrolled in this study. The surgeons were: laparoscopic surgery experts with > 100 laparoscopic surgeries (LS), 21 were novices with experience < 100 LS, and five without previous experience in LS. The participants’ surgical performance was evaluated by three blinded raters using Global Operative Assessment of Laparoscopic Skills (GOALS).ResultsThere were significant differences (P-values < 0.044) in all GOALS items between the non-medical professionals and surgeons. The experts were significantly superior to the novices in one item of GOALS: efficiency ([4(4–5) vs. 4(3–4)], with a 95% confidence interval, p = 0.042). However, both bimanual dexterity and total score in the experts were not statistically different but tended to be higher than in the novices.ConclusionsOur study demonstrated a full validation of our new system. This could detect the surgeons' ability to perform surgical dissection and suggest that this VR simulator could be an effective training tool. This surgical VR simulator might have tremendous potential to enhance training for surgeons.

ASSESSMENT OF VISUAL ENVIRONMENT NECESSARY FOR BUSINESS CONTINUITY IN EMERGENCIES (PART 1) ： A STUDY OF VISUAL ENVIRONMENT ASSESSMENT USING HEAD MOUNTED DISPLAY VIRTUAL REALITY SYSTEM

Natural disasters that had recently happened in Japan, including Great East Japan Earthquake in 2011, destroyed social infrastructure especially electricity systems for more than several months. During this period, electric supply tremendously decreases and caused many problems to emergency response, lifeline infrastructure management, life supporting related activities in hospitals and refugee accommodations and also government administrative business. In order to sustain these basic activities, we need minimal lighting systems to facilitate workers in offices maintaining these activities. However, most of lighting research on emergency, Boyce et al., Akizuki among others, concentrate on emergency escape lighting system. Mochizuki et al. studied the impacts of shortage of electricity on office lighting environment during Great East Japan Earthquake aftermath. To our knowledge, there are no studies analyzing the minimum lighting system required in offices during emergency period. Appropriate assessment of visual environment for business in disaster effected areas is required. Thus, the purpose of this paper is to develop a virtual reality simulation system (VRS) which can provide real focal-ambient lighting environment for workers in the office and to find the minimum lighting environment required to continue working for more than 10 days during emergencies. 2400 observations from 20 participants (9 students and 11 office workers, 9 female and 11 male) assessing 30 VR scenes on 4 business continuing periods (1 day, 3 days, 10 days, over 10 days) were obtained in the experiment. We found the following results from the experiment: 1. VRS can provide focal-ambient lighting environment for experiment participants more realistically than other devices. It has high 96.7% accuracy representation percentage of real environment luminance-chromaticity values of VR scenes and provides 360 degrees experience of real visual environment at 3 degrees of freedom to participants. 2. Minimum lighting on working surfaces can be as small as 75 lux for more than 10 days office work in emergency. 3. Ambient lighting is strongly required to keep comfortable room brightness and focal ambient lighting system for the workers. At working surface illuminance of 75 lux, 100% of participants can continue to work for more than 10 days with ambient light and only 85% of participants can continue to work for 10 days without ambient light. 4. There may exist some possibilities that student participants of experiments may not have strong tolerance against less lighting than office workers. Office workers can work for 10 days with 15 lux on working surface while students require twice this illuminance of 30 lux. i.e. we need to study more about the effects of participants’ attributes on experiment results. 5. 360 degrees Brightness Estimation Image can be used to assess how much ambient and focal brightness is required in the given visual environment. 6. Ambient visual environment is confirmed to be strongly correlated with how much light is available in desk surroundings, walls, and ceilings and not with horizontal surfaces such as floor discussed in the literature.

Developing a virtual reality simulation system for preoperative planning of thoracoscopic thoracic surgery

BackgroundVideo-assisted thoracoscopic surgery (VATS) has become a standard approach for the treatment of lung cancer. However, its minimally invasive nature limits the field of view and reduces tactile feedback. These limitations make it vital that surgeons thoroughly familiarize themselves with the patient’s anatomy preoperatively. We have developed a virtual reality (VR) surgical navigation system using head-mounted displays (HMD). The aim of this study was to investigate the potential utility of this VR simulation system in both preoperative planning and intraoperative assistance, including support during thoracoscopic sublobar resection.MethodsThree-dimensional (3D) polygon data derived from preoperative computed tomography data was loaded into BananaVision software developed at Colorado State University and displayed on an HMD. An interactive 3D reconstruction image was created, in which all the pulmonary structures could be individually imaged. Preoperative resection simulations were performed with patient-individualized reconstructed 3D images.ResultsThe 3D anatomic structure of pulmonary vessels and a clear vision into the space between the lesion and adjacent tissues were successfully appreciated during preoperative simulation. Surgeons could easily evaluate the real patient’s anatomy in preoperative simulations to improve the accuracy and safety of actual surgery. The VR software and HMD allowed surgeons to visualize and interact with real patient data in true 3D providing a unique perspective.ConclusionsThis initial experience suggests that a VR simulation with HMD facilitated preoperative simulation. Routine imaging modalities combined with VR systems could substantially improve preoperative planning and contribute to the safety and accuracy of anatomic resection.

Automated Assessment of Neonatal Endotracheal Intubation Measured by a Virtual Reality Simulation System.

Manual assessment from experts in neonatal endotracheal intubation (ETI) training is a time-consuming and tedious process. Such subjective, highly variable, and resource-intensive assessment method may not only introduce inter-rater/intra-rater variability, but also represent a serious limitation in many large-scale training programs. Moreover, poor visualization during the procedure prevents instructors from observing the events occurring within the manikin or the patient, which introduces an additional source of error into the assessment. In this paper, we propose a physics-based virtual reality (VR) ETI simulation system that captures the entire motions of the laryngoscope and the endotracheal tube (ETT) in relation to the internal anatomy of the virtual patient. Our system provides a complete visualization of the procedure, offering instructors with comprehensive information for accurate assessment. More importantly, an interpretable machine learning algorithm was developed to automatically assess the ETI performance by training on the performance parameters extracted from the motions and the scores rated by experts. Our results show that the leave-one-out-cross-validation (LOOCV) classification accuracy of the automated assessment algorithm is 80%, which indicates that our system can reliably conduct a consistent and standardized assessment for ETI training.

Microsurgery training: A combined educational program

A proposed microsurgical training program is presented that includes all the existing training methods, such as simulation in nonliving models, virtual reality simulation system and exercise in living models. Our experience in microsurgery training over the last decades indicates the need of evolution in training programs. This can be achieved with the introduction of new technologies into education and training. The first primary results of the described training program are promising, however this system needs to be assessed by training greater number of microsurgeons. Furthermore, more complex scenarios (such as whole operations) should be inserted into the virtual reality simulation system to create a more interactive experience.

A Virtual Reality Soldier Simulator with Body Area Networks for Team Training.

Soldier-based simulators have been attracting increased attention recently, with the aim of making complex military tactics more effective, such that soldiers are able to respond rapidly and logically to battlespace situations and the commander’s decisions in the battlefield. Moreover, body area networks (BANs) can be applied to collect the training data in order to provide greater access to soldiers’ physical actions or postures as they occur in real routine training. Therefore, due to the limited physical space of training facilities, an efficient soldier-based training strategy is proposed that integrates a virtual reality (VR) simulation system with a BAN, which can capture body movements such as walking, running, shooting, and crouching in a virtual environment. The performance evaluation shows that the proposed VR simulation system is able to provide complete and substantial information throughout the training process, including detection, estimation, and monitoring capabilities.

Usefulness of immersive virtual reality simulation during femoral nail application in an orthopedic fracture skills course

Objectives: There is an increasing number of complex and varied surgical techniques and implants in orthopedic trauma. As the paradigm shift in orthopedic surgical education is turning to competency-based curricula and technology is becoming more affordable, new immersive virtual reality (IVR) simulation systems are emerging. The main objective of this study was to evaluate the utility of IVR simulation for learning a complex surgical technique; the application of a Trochanteric Femoral Nail Advanced (TFNA™). Methods: Ten residents participated in the evaluation of the application of TFNA™ in a Synbone® model during an advanced fractures treatment course. Five of them had a previous practice session using a VR simulator to learn the technique. All of them applied a TFNA™ during the course and were then asked to repeat it. Time to completion and the number of steps completed by each group were compared between both groups. Results: The VR group took 25.84 min to complete (standard deviation [SD] 6.14) and the control group 31.6 min to complete (SD 19.3). There was no statistically significant difference between both groups, but there was a tendency for the VR group to complete more steps and finish earlier than the control group (P = 0.554). Conclusion: IVR simulation could be a more accessible way to provide a safe environment where participants can learn a new surgical technique. It is important to develop proficiency-based progressive training programs with specific educational goals that incorporate simulation and emerging technology as a tool. Larger, randomized, internal and external validation studies are needed.

Virtual Reality Programs Applications in Healthcare

Current Virtual Reality (VR) applications in healthcare demonstrate potential abilities to address cognitive, psychological, motor, functional impairments and opportunities for training and education of clinical practitioners. Bearing in mind the overall wellness of their communities, healthcare officials had supported the idea of incorporating modern technology by increasing the budget shares and arranging for an access to advanced equipment and professional expertise. Clinicians are becoming more interested in applying VR simulation into their research and clinical trials because of the encouraging feedback published in the medical literature across a wide range of clinical health conditions. Numerous published articles propose novel concepts on applications VR technologies and their potential on disease prevention and management. Finally, the ability of sharing data collected by VR simulation systems through communication networks and electronic health records make it more attractive for the reason that it plays a role in decision making for specific case studies and distance learning.

Simulation and curriculum design: a global survey in dental education.

Curriculum reforms are being driven by globalization and international standardization. Although new information technologies such as dental haptic virtual reality (VR) simulation systems have provided potential new possibilities for clinical learning in dental curricula, infusion into curricula requires careful planning. This study aimed to identify current patterns in the role and integration of simulation in dental degree curricula internationally. An original internet survey was distributed by invitation to clinical curriculum leaders in dental schools in Asia, Europe, North America, and Oceania (Australia and New Zealand). The results (N=62) showed Asia, Europe and Oceania tended towards integrated curriculum designs with North America having a higher proportion of traditional curricula. North America had limited implementation of haptic VR simulation technology but reported the highest number of scheduled simulation hours. Australia and New Zealand were the most likely regions to incorporate haptic VR simulation technology. This survey indicated considerable variation in curriculum structure with regionally-specific preferences being evident in terms of curriculum structure, teaching philosophies and motivation for incorporation of VR haptic simulation into curricula. This study illustrates the need for an improved evidence base on dental simulations to inform curriculum designs and psychomotor skill learning in dentistry.

Research on the Construction of Virtual Reality Simulation System for Psychological Stress Training

Due to the lack of realistic training environment in psychological stress training problems, virtual reality (VR) technology is introduced into the psychological stress training. This paper summarizes the five psychological stress training courses for VR technology, carries on the demand analysis, structure design and function module design of the virtual reality simulation system for psychological stress training (VRSSPST), researches on the training organization, and enriches the psychological training method.

Evaluation of haptic interfaces for simulation of drill vibration in virtual temporal bone surgery

Surgical training is evolving from an observership model towards a new paradigm that includes virtual-reality (VR) simulation. In otolaryngology, temporal bone dissection has become intimately linked with VR simulation as the complexity of anatomy demands a high level of surgeon aptitude and confidence. While an adequate 3D visualization of the surgical site is available in current simulators, the force feedback rendered during haptic interaction does not convey vibrations. This lack of vibration rendering limits the simulation fidelity of a surgical drill such as that used in temporal bone dissection. In order to develop an immersive simulation platform capable of haptic force and vibration feedback, the efficacy of hand controllers for rendering vibration in different drilling circumstances needs to be investigated. In this study, the vibration rendering ability of four different haptic hand controllers were analyzed and compared to find the best commercial haptic hand controller. A test-rig was developed to record vibrations encountered during temporal bone dissection and a software was written to render the recorded signals without adding hardware to the system. An accelerometer mounted on the end-effector of each device recorded the rendered vibration signals. The newly recorded vibration signal was compared with the input signal in both time and frequency domains by coherence and cross correlation analyses to quantitatively measure the fidelity of these devices in terms of rendering vibrotactile drilling feedback in different drilling conditions. This method can be used to assess the vibration rendering ability in VR simulation systems and selection of ideal haptic devices.

Design and implementation of visual inspection system handed in tokamak flexible in-vessel robot

In-vessel viewing system (IVVS) is a fundamental tool among the remote handling systems for ITER, which is used to providing information on the status of the in-vessel components. The basic functional requirement of in-vessel visual inspection system is to perform a fast intervention with adequate optical resolution. In this paper, we present the software and hardware solution, which is designed and implemented for tokamak in-vessel viewing system that installed on end-effector of flexible in-vessel robot working under vacuum and high temperature. The characteristic of our in-vessel viewing system consists of two parts: binocular heterogeneous vision inspection tool and first wall scene emersion based augment virtuality. The former protected with water-cooled shield is designed to satisfy the basic functional requirement of visual inspection system, which has the capacity of large field of view and high-resolution for detection precision. The latter, achieved by overlaying first wall tiles images onto virtual first wall scene model in 3D virtual reality simulation system, is designed for convenient, intuitive and realistic-looking visual inspection instead of viewing the status of first wall only by real-time monitoring or off-line images sequences. We present the modular division of system, each of them in smaller detail, and go through some of the design choices according to requirements of in-vessel visual inspection task.

A mathematical model of virtual simulation for deepwater installation of subsea production facilities

Virtual reality (VR) based on deepwater installation training provides new workers or inexperienced workers with rehearsing and training environment so that they can immerse themselves in this environment and improve their manipulative skills fast and efficiently. It can greatly cut down the training cost and decrease losses produced by mis-operations. In order to effectively achieve this training goal, it is crucial to express the response of multi-body system comprised of vessel, crane, cable and lifted equipment, truly and reliably. This paper proposes a mathematical model for the response analysis of multi-body system. The solution of the mathematical model for virtual simulation is also presented. The architecture of VR simulation system and the crane simulator are designed. A case study was performed to validate the feasibility of the proposed model. The results show the VR simulation training system has a high reality and response rate. This indicates the applicability of the proposed mathematical model and the VR system in deepwater installation simulation of subsea production facilities.

Development of a 3D-printed external ventricular drain placement simulator: technical note.

In this paper, the authors present a physical model developed to simulate accurate external ventricular drain (EVD) placement with realistic haptic and visual feedbacks to serve as a platform for complete procedural training. Insertion of an EVD via ventriculostomy is a common neurosurgical procedure used to monitor intracranial pressures and/or drain CSF. Currently, realistic training tools are scarce and mainly limited to virtual reality simulation systems. The use of 3D printing technology enables the development of realistic anatomical structures and customized design for physical simulators. In this study, the authors used the advantages of 3D printing to directly build the model geometry from stealth head CT scans and build a phantom brain mold based on 3D scans of a plastinated human brain. The resultant simulator provides realistic haptic feedback during a procedure, with visualization of catheter trajectory and fluid drainage. A multiinstitutional survey was also used to prove content validity of the simulator. With minor refinement, this simulator is expected to be a cost-effective tool for training neurosurgical residents in EVD placement.