Virtual Simulation System Research Articles

Construction Method of a Digital-Twin Simulation System for SCARA Robots Based on Modular Communication

Due to the high cost of robots, the algorithm testing cost for physical robots is high, and the construction of motion control programs is complex, with low operation fault tolerance. To address this issue, this paper proposes a low-cost, cross-platform SCARA robot digital-twin simulation system based on the concept of digital twins. This method establishes a 5D architecture based on the characteristics of different platforms, classifies data and integrates functions, and designs a data-processing layer for motion trajectory calculation and data storage for a virtual-reality robot. To address the complexity of data interaction under different cross-platform communication forms, an editable, modular, cross-platform communication system is constructed, and various control commands are encapsulated into simple programming statements for easy invocation. Experimental results showed that, based on modular communication control, users can accurately control data communication and synchronous motion between virtual and physical models using simple command statements, reducing the development cost of control algorithms. Meanwhile, the virtual-robot simulation system, as a data mapping of the real experimental platform, accurately simulated the physical robot’s operating state and spatial environment. The robot algorithms tested using the virtual simulation system can be successfully applied to real robot platforms, accurately reproducing the operating results of the virtual system.

Deep-learning based single-shot 3D reconstruction with simulated color-crosstalk and randomized extrinsics

In recent years, many single-frame 3D reconstruction schemes based on fringe projection profilometry (FPP) have been proposed. However, most single-frame reconstruction schemes still face the following three issues: (1) obtaining large datasets is very time-consuming, (2) focusing only on achieving single-frame reconstruction for white objects, and (3) requiring fixing the camera-projector positional relationship, increasing operational difficulty. By building a virtual FPP simulation system, our method can quickly render the required datasets, avoiding cumbersome manual operations. When rendering the datasets, we simulate adverse factors such as color channel crosstalk, system extrinsic parameter variations, and object surface colors to guide the training of the neural network. Ultimately, from a single three-frequency color image, the corresponding three-frequency three-step phase-shift images are predicted, achieving single-frame 3D reconstruction of colored objects and allowing some variation in system extrinsic parameters. Real-world experiments demonstrate that the network trained with the diverse data generated by our virtual system has good accuracy, providing valuable guidance for the practical application of deep learning methods.

A performance-based mental workload identification method for special vehicle crews

Detecting the mental workload state of armored vehicle crews is of great significance for monitoring the driving state of the crew and improving comprehensive combat effectiveness. In this manuscript, we propose a performance-based mental workload identification method and carry out experimental validation to improve the accuracy of crew mental workload identification and realize the effective classification of mental workload. Based on the virtual simulation system of the special vehicle crew task, this manuscript selects 20 subjects for the mental workload experiment of special vehicle crews. The experiment collected NASA-TLX scale, EEG, eye-tracking data, and performance data. The results show that the mental workload of the crews fluctuates in the segmented tasks of complex operations in typical scenes of special vehicles. The method of determining mental workload using NASA-TLX generates label noise in classification, which is not suitable for special vehicle tasks. Performance-based mental workload identification method is able to recognize fluctuations in the crew's mental workload during segmented tasks. Performance-based and NASA-TXL-based methods were classified using linear discriminant analysis. The results show that the accuracy of the method based on performance is improved by 15.72 %. This manuscript found the NASA-TXL scale is not suitable for the complex tasks of special vehicles, and proposed a performance-based identification method that can help to categorize the mental workload states of special vehicle crews.

Camera-in-the-loop based test scenario generation method for pedestrian collision avoidance system

The Pedestrian Collision Avoidance System (PCAS) of Intelligent Vehicle (IV) can be effective in preventing the occurrence of traffic accidents. However, the complicated operation environments introduce great challenges to the camera used by the PCAS. Therefore, the camera based PCAS should be fully tested and evaluated before deployment. The traditional simulation test for the camera based PCAS attempted to use geometric or physical simulation models, which have low reality and are suitable for the primary stage of the PCAS development. Camera-in-the-Loop (CIL) test is one of Hardware-in-the-Loop methods that embeds the real camera hardware into the virtual simulation system to test the camera. CIL can utilize the real hardware response while overcoming the common simulation weakness of fidelity. In this paper, we construct a CIL test platform, and propose the CIL based test scenarios generation and scenario parameter impact evaluation method for PCAS. First, we construct the CIL test platform whose image quality and functional confidence are both validated to prove CIL credibility. Second, the PCAS under the test is analyzed and the corresponding test scenario parameters are designed. In order to accelerate the test scenario generation, a Greedy Based Combination test method (GBC) based on the CIL is proposed. The Chi-square analysis and two-factor of variance analysis verification methods are used to analyze the influence of individual and multiple scenario parameters on the PCAS performance. The experiment results show that the GBC improves the test speed by 12 times compared to the traversal test, and the frequency ratio of each scenario parameter is no more than 3% different from that of the traversal test. Also, GBC has an equivalent ability to find the PCAS collision scenarios parameter combination to the traversal test.

Effect of 3D printed teeth and virtual simulation system on the pre-clinical access cavity preparation training of senior dental undergraduates

BackgroundThe objective of the present study was to evaluate the effect of 3D printed teeth and virtual simulation system on the pre-clinical access cavity preparation training of senior dental undergraduates.MethodsThe 3D printed teeth were manufactured based on the micro-CT data of an extracted lower first molar. Ninety-eight senior dental undergraduate students were required to finish the access cavity preparation of lower first molar within 20 min on plastic and 3D printed teeth on the manikin system as well as on a virtual simulation machine respectively with randomly selected sequences. Expert dentists scored the operated teeth. The scores from the virtual simulation system were also recorded. All the scores were analyzed and compared. Following the procedure, two questionnaires were sent to students to further evaluate the feelings and optimal training sequence.ResultsNo significant differences were found between plastic and 3D printed teeth scores, while virtual simulation achieved a valid/invalid area removal ratio of 96.86% ± 5.08% and 3.97% ± 1.85%, respectively. Most students found plastic teeth training the easiest and favored the three-training combination (36.36%). 71.42% of the students thought the virtual simulation training should be put at the first place of the three trainings. Over 80% of students agreed with incorporating 3D printed teeth and virtual simulation into their routine training courses. In addition, the general advantages and disadvantages of the virtual simulation system and 3D printed teeth training received almost equal recognition by students.ConclusionsVirtual simulation system training + plastic teeth training + 3D printed teeth training might be the optimal training sequence. Virtual simulation system training could not completely replace the traditional training methods on the manikin system at the moment. With further modifications, 3D printed teeth could be expected to replace the plastic teeth for the pre-clinical access cavity preparation training.

Data-Driven Material Exploration of High Conductive Fluorides By Multi-Element Substitution

Barium fluoride (BaF2) has a fluorite-type structure and is attracting high attention as a solid electrolyte material for fluoride ion batteries that can be used under high voltage. Previous research has reported that the ionic conductivity increases by 4 to 5 orders of magnitude by partially replacing Ba in BaF2 with La. This indicates that elemental substitution is effective in improving the ionic conductivity of BaF2. However, single element substitution only explore much limited experimental space in elements, so that it should be difficult to discover innovative conductive compositions. By replacing various elements at the same time, the experimental space can be largely expanded and the possibility of finding the optimal composition increases. But, the combination numbers of multi-element substituted compositions are much over 10000, and exhaustive exploration of them is unrealistic. Therefore, we aimed to efficiently search for multi-element substitution compositions with high conductivity by creating a material-conductivity correlated exploring system under data-driven approach using large number of fluoride material database. The purpose of this research was to discover solid solution compositions in the multi-element substituted fluorides and understanding of the relationship between substitutional elements and solid solution formation.Approximately 20 types of multi-element substitution composition candidates were initially picked up using the D-optimal design (Dopt). The target compositions were synthesized to collect their XRD data. Next, we extracted the "number of peaks" from the XRD data as a feature values to express the degree of solid solution in the sample. Furthermore, we made a regression model with the element types and addition ratios as explanatory variables and the "number of peaks" as the objective variable. Using the regression model, approximately 20 candidate were predicted to form solid solution, in which we called as data-driven design of experiments (DOE) approach. Finally, the materials were actually prepared according to the proposal in DOE. The identification results were projected using the principal component analysis (PCA) to draw the material space.The obtained material space shows the number of peaks in the samples prepared using DOE decreased compared to those using Dopt. In detail, the Dopt-derived sample had 41.83 peaks, while the DOE-derived sample had 19.65 peaks on average. This result indicates that we were able to efficiently find preferable compositions that are advantageous for solid solution formation by using the data-driven method.In the presentation, we will also report the high-throughput composition exploration, their conductivities, and also development of virtual X-ray diffraction simulation system for over 10,000 kinds of multi-substituted composition of the fluorides. Acknowledgement s This research was partially supported by Knowledge Hub Aichi, the GIMRT Program of the Institute for Materials Research, Tohoku University (Proposal No. 202303-CRKKE-0048).

Application Research of Virtual Simulation System From Complexity Perspective

The “Intelligent Manufacturing Technology and its Application” in higher vocational colleges has some problems such as limited practical training resources, high maintenance costs and security risks in the running process. Even if there is a simulation, it is a simple simulation. The repetitive imitation of traditional practical training links, and the virtual simulation teaching does not fully reflect the characteristics of virtuality, interactivity and spatiotemporality. Because of the existing problems in the training simulation development and application of the current curriculum, the development and application of the virtual simulation system under the complexity perspective is proposed. The results show that this application can improve the effectiveness of virtual system applications.

Development and evaluation of a PICC virtual simulator in neonatal nursing: A randomized controlled trial

BackgroundPeripherally Inserted Central Catheter (PICC) is essential in neonatal care, especially for critically ill infants. Traditional training for neonatal PICC insertion faces challenges such as high costs and limited practice opportunities. Virtual simulation technology has emerged as a potential training tool, providing a realistic, risk-free learning environment. ObjectivesThe study aimed to assess the effectiveness of a virtual simulation teaching system in neonatal PICC care training, focusing on improving nursing students' knowledge， skills and interest in pediatric nursing. DesignA quasi-experimental design was used, with assessments conducted before and after the activity. ParticipantsThe study involved 58 graduate nursing students from China Medical University, divided into experimental and control groups. MethodsThe System Usability Scale (SUS) was utilized to assess teachers' experiences with the PICC virtual simulation software. Students' perceptions of the software and their interest in pediatric nursing were measured using Self-Administered Questionnaires. Furthermore, Theoretical and Operational Assessments were applied to determine the extent of students' knowledge and practical skills before and after experimentation. ResultsTeachers and students have favorably evaluated the software system, with notable improvements in theoretical scores following testing. While the virtual simulation system does not enhance practical skills, it does increase student interest in pediatric nursing and employment. ConclusionsThis neonatal virtual simulation software serves as a complement to, rather than a replacement for, traditional clinical training. Its integration into educational programs significantly enhances learning outcomes.

Application of Computer Virtual Reality Technology in Welding Simulation Training of Complex Structures Based on Unity3D

A virtual reality welding robot simulation system for practical application is developed based on the training and application of welding robot for practical application, which has important theoretical and practical application value for promoting the development of industrial robots in China. The simulation system is synchronized with the welding simulation training platform to achieve the purpose of VR simulation of the welding robot. By modeling the welding process, the process parameters can be inferred automatically, and the digital twin knowledge base for practical application is built. The OPC UA protocol is used to realize real-time communication with mobile devices. The digital twinning technology of CNC machine tool is studied through the simulation experiment of weld motion. This system lays a foundation for realizing the intelligentization of CNC machine tools.

Construction of Virtual Reality Rail Transit Simulation System

In order to enhance the quality of professional technology research and development and personnel training in rail transit, this study constructed a virtual reality rail transit simulation system, including the data input and processing of vehicle driving environment, vehicle structure and station scene data, as well as three-dimensional modeling and data storage. The data is stored in the Internet cloud server, which increases the accessibility and sharing of the data, and the rail transit simulation can be realized by calling the three-dimensional model in the cloud server. This efficient and convenient virtual reality content development tool helps to improve the level of scientific research and development and the quality of talent training in rail transit, it will also be the inevitable trend of the development of rail transit industry in the new era.

Research on the Teaching Resource Construction System of Computer VR Online Interactive Experiment Platform for Mechanical Engineering Graphics

The introduction of three-dimensional design experiment teaching in engineering drawing teaching. The experimental platform of "network engineering drawing" is established, and the corresponding multimedia teaching software is developed using WebVR, ASP, database and other technologies. The 3D modeling method of the reducer is established by using UGNX and optimized accordingly. In order to solve the problem that UGNX mode introduces packet loss in the simulation system, the model and data are reconstructed separately. Using VisualStudio2019 as the development platform, the 3D modeling of the reducer is realized. The establishment of the engineering graphics design virtual simulation system helps enterprises to simulate operations before actual production and processing. It greatly improves production efficiency and reduces production costs.

Perceptions and needs for a community nursing virtual simulation system for Chinese nursing students during the COVID-19 pandemic: A qualitative study

BackgroundVirtual simulation systems are being increasingly used in the field of nursing education. However, these systems are mostly designed based on the perspective of developers, and the needs of the end users are often neglected. The purpose of this study was to explore the perceptions and needs of Chinese undergraduate nursing students for the development of a community nursing virtual simulation system. MethodsThis was a descriptive qualitative study enrolling 12 undergraduate nursing students at a University in China. Data were collected through semi-structured interviews. The content analysis method was used for data analysis. ResultThree themes and 15 sub-themes were extracted from this study: (1) Positive perceptions regarding virtual systems: a) Provides space for trials and errors, b) Not limited by time and space, c) Provides auxiliary tools; (2) Design and use requirements: a) Performance needs, b) Contents design needs, c) Appearance design needs, d) Support Needs; (3) Competency enhancement needs: a) Community nursing practice ability, b) Critical thinking ability, c) Independent thinking ability, d) Ability to deal with emergencies, e)Teamwork skills, f) Self-efficacy, g) Resilience, h)Interpersonal communication skills. ConclusionDesigners and engineers should consider students' needs, aim to improve students' abilities, improve the diversity, the scientific and rigor of content, and enhance user immersion and interest. The system should be programmed to provide real-time feedback, timely technical and professional support, in order to optimize use experience of nursing students.

Design of an Optical Physics Virtual Simulation System Based on Unreal Engine 5

In response to challenges in traditional offline experiments in optical physics, such as high trial-and-error costs, expensive equipment, limited design parameters, and restricted explanations of instrument structures and principles, this paper proposes a design method for an optical physics virtual simulation system based on Unreal Engine 5. The method employs a generic design architecture to partition system units and utilizes technologies like pixel streaming, rendering engines, and physics engines to implement the design of the virtual simulation system. This system covers the entire experimental process, including video learning, instrument adjustment, phenomenon observation, data measurement and recording, and grade inquiry. The proposed design method enhances the immersive experience of experiments, reduces the hardware performance requirements for users, and allows access and utilization across multiple platforms. It efficiently facilitates physics teaching through simulated experiments, thereby effectively improving the quality of experimental teaching. Finally, through a comparison with existing virtual simulation systems, it is demonstrated that the system can save approximately 94.76% of the average CPU usage and provide better immersion and user experience advantages.

A brief investigation of the dose field virtual simulation tools for reactor decommissioning and preliminary design for the HWRR reactor in China

The calculation and visualization of the dose field in the decommissioning of nuclear facilities is one of the important functions of the decommissioning virtual simulation system. The dose field simulation tools can provide radiation field distribution and play an important role in determining the decommissioning plan and protecting personnel during the engineering implementation process. This article investigates the development of dose field calculation and visualization in the reactor decommissioning virtual simulation systems. A preliminary technology plan suitable for the development of the decommissioning dose field calculation and visualization display programs of the first Heavy Water Research Reactor (HWRR) in China is proposed. The applicability of the selected scheme is analyzed. The functional requirement and development direction of the HWRR reactor decommissioning dose field tool are preliminarily determined. Furthermore, the reactor vessel of HWRR reactor is modeled, the dose field distribution is calculated and visualized based on the preliminary decommissioning code. This research can provide technical support for the development of the decommissioning simulation system for the first HWRR reactor in China.

Developing a Virtual Reality Simulation System for Preoperative Planning of Robotic-Assisted Thoracic Surgery.

Background. Robotic-assisted thoracic surgery (RATS) is now standard for lung cancer treatment, offering advantages over traditional methods. However, RATS's minimally invasive approach poses challenges like limited visibility and tactile feedback, affecting surgeons' navigation through com-plex anatomy. To enhance preoperative familiarization with patient-specific anatomy, we devel-oped a virtual reality (VR) surgical navigation system. Using head-mounted displays (HMDs), this system provides a comprehensive, interactive view of the patient's anatomy pre-surgery, aiming to improve preoperative simulation and intraoperative navigation. Methods. We integrated 3D data from preoperative CT scans into Perspectus VR Education software, displayed via HMDs for in-teractive 3D reconstruction of pulmonary structures. This detailed visualization aids in tailored preoperative resection simulations. During RATS, surgeons access these 3D images through Tile-ProTM multi-display for real-time guidance. Results. The VR system enabled precise visualization of pulmonary structures and lesion relations, enhancing surgical safety and accuracy. The HMDs offered true 3D interaction with patient data, facilitating surgical planning. Conclusions. VR sim-ulation with HMDs, akin to a robotic 3D viewer, offers a novel approach to developing robotic surgical skills. Integrated with routine imaging, it improves preoperative planning, safety, and accuracy of anatomical resections. This technology particularly aids in lesion identification in RATS, optimizing surgical outcomes.

Virtual Preparations Versus Classic Preparations on Resin Models in Prosthodontics

Virtual reality technologies are important auxiliary tools in the process of learning and acquiring the manual skills necessary for clinical maneuvers in dental prosthodontics. This study shows the particularities in the use of the virtual simulation system designed for dental prosthodontics, compared to the classically preparations performed on resin models. The interactively simulation systems reproduce real clinical situations in which students practice specific dental prosthetics maneuvers. Resin models do not reproduce the accuracy of the dental structures at the time of the preparation. The advantages of using virtual technology are efficient clinical training, allowing for repeatability, self-assessment of procedures and the acquisition of manual skills. In this way, the advantages conferred by virtual simulators are superior to those resulting from the use of resin models in the acquirement of manual skills.

Navigating the calvaria with mobile mixed reality-based neurosurgical planning: how feasible are smartphone applications as a craniotomy guide?

Virtual simulation and imaging systems have evolved as advanced products of computing technology over the years. With advancements in mobile technology, smartphones, and tablets, the quality of display and processing speed have gradually improved, thanks to faster central processing units with higher capacity. Integrating these two technologies into the fields of healthcare and medical education has had a positive impact on surgical training. However, contemporary neurosurgical planning units are expensive and integrated neuronavigation systems in operating rooms require additional accessories. The aim of this study was to investigate the compatibility of smartphone applications in augmented reality (AR)-based craniotomy planning, which can be available even in disadvantaged workplaces with insufficient facilities. Thirty patients diagnosed with supratentorial glial tumor and who underwent operations between January 2022 and March 2023 were included in the study. The entire stages of the surgical procedures and the surgical plans were executed with neuronavigation systems. The patient CT scans were reconstructed using software and exported as a 3D figure to an AR-enhanced smartphone application. The evaluation of the application's success was based on the spatial relationship of the AR-based artificial craniotomy to the neuronavigation-based craniotomy, with each AR-based craniotomy scaled from 0 to 3. In the comparison between neuronavigation-based and AR fusion-based craniotomies, 8 of 30 (26.6%) patients scored 0 and were considered failed, 6 (20%) scored 1 and were considered ineffective, 7 (23.3%) scored 2 and were considered acceptable, and 9 (30%) scored 3 and were considered favorable. AR technology has great potential to be a revolutionary milestone of neurosurgical planning, training, and education in the near future. In the authors' opinion, with the necessary legal permissions, there is no obstacle to the integration of surgical technological systems with mobile technology devices such as smartphones and tablets that benefit from their low-budget requirements, wide-range availability, and built-in operating systems.

The practice and prospect of algorithm-driven virtual simulation technology in medical undergraduate education

Abstract Amid growing interest in the use of virtual simulation platforms in educational settings, the reform of medical education increasingly looks to virtual simulation technology as a promising new avenue. This study aims first to analyze the components of a virtual simulation system and to enhance the functionality of virtual simulation technology by optimizing the network model algorithm. Utilizing cloud computing technology, a virtual simulation teaching experiment platform was constructed. Further, a virtual simulation medical education system based on the BOPPPS teaching model was developed to address the constraints of practical experience in the traditional undergraduate medical education model. Empirical analysis of the virtual simulation medical education mode reveals that the CPU utilization rate on the constructed cloud platform ranged from 2% to 35%, and the memory usage varied between 15 and 25 GB. In comparative assessments of medical education practices, this study found that students trained under the virtual simulation technology-enhanced model scored 0.96 to 1.53 points higher in various skill assessments than those trained under traditional methods. Moreover, the total scores for communication abilities increased by 5.48 points, highlighting a significant improvement. These results affirm the superiority of the virtual simulation technology medical education model presented in this study. They underscore its practicality and feasibility for application and development in undergraduate medical education, providing a substantive pathway for integrating advanced virtual simulation technologies into medical training.

Utilization of Microsoft HoloLens Augmented Reality Technology in Health Care Virtual Simulation

This article investigated the application of Microsoft HoloLens augmented reality technology in Health Care virtual simulation. By designing a virtual simulation system based on HoloLens, it was proved that this technology provided a more realistic and intuitive medical experience, and helped doctors and medical students better understand and master medical operation skills. In addition, the technology was also simulated and trained before surgery to reduce surgical risks and improve surgical success rates. The results of this study showed that the reliability of using HoloLens augmented reality technology in Health Care virtual simulation could reach up to 93%, which had a positive promoting effect on the improvement of medical education and surgical quality.

Error Analysis of the plate beamsplitter in near optical coaxial phase measurement deflectometry

Phase-measuring deflectometry (PMD) is a key measurement technology for specular surfaces form measurement. Compared with the phase measuring deflectometry techniques based on the conventional configuration, the near optical coaxial phase measuring deflectometry (NCPMD) can achieve compact configuration, light weight and insignificant measurement error caused by structure shadows by utilizing a plate beamsplitter. However, the introduction of the plate beamsplitter will make some influence of the measurement accuracy of the NCPMD system. In the one hand, the introduction of the plate beamsplitter can reduce the measurement accuracy of the NCPMD system due to the refractive of the ray between the two surfaces of the beamsplitter. In the other hand, due to the processing and manufacturing problems of the beamsplitter, there are inevitably certain unevenness errors on the upper and lower surfaces. In this paper, a virtual simulation system of NCPMD is established, and an error model of the NCPMD system by considering both the refraction influence and reflection influence of the plate beamsplitter is presented to analyse the shape reconstruction error caused by the plate beamsplitter.