Virtual Training System Research Articles

Towards the adoption of virtual reality training systems for the self-tuition of industrial robot operators: A case study at KUKA

Interest is growing around Virtual Reality training systems (VRTSs), which started to be considered as a credible option to train companies’ workforce. Although the efficacy of VRTSs as a fancy alternative to traditional learning material used by trainers in their lectures has already been proved, their effectiveness as self-learning tools not requiring human instructors is still controversial, since experiments carried out within established training programmes are still rare. This paper reports the results of a user study aimed to investigate how an immersive VRTS designed to train industrial robot operators on light maintenance tasks actually compares to the training practice based on in-class and hands-on sessions that is adopted worldwide by an international company. After the training, study participants were evaluated by company's instructor while performing the taught task autonomously on a real robot. Obtained results showed that the effectiveness of the devised VRTS in making the trainees able to successfully complete the task was comparable to that of the traditional training. It was also found that there is still room for improvement, e.g., on virtually training interaction with physical tools and equipment, as well as on emulating and fortifying aspects of human trainer-trainee social dynamics.

Motor Indicators for the Assessment of Frozen Shoulder Rehabilitation via a Virtual Reality Training System

Adhesive capsulitis (also known as frozen shoulder) is a common clinical shoulder disorder and can be effectively improved through physical rehabilitation. With advancements in technology, virtual reality (VR) has been increasingly employed in rehabilitation treatments. However, most relevant studies have merely employed traditional assessment tools to assess the therapeutic effects rather than the substantial amount of motor trajectory data or task performance collected by motor training systems. In this research, an innovative frozen shoulder rehabilitation system using a Microsoft Kinect sensor and VR was successfully developed and five task-oriented motor indices and task performance were proposed to assess motor performance. A clinical experiment involving twenty patients was conducted. Objective clinical assessment outcomes verified the effectiveness of the developed system for frozen shoulder rehabilitation. The improvements assessed according to motor indices and task performance were consistent with the objective clinical assessment results. Furthermore, correlation analysis showed that several items in the task performance and motor indices were significantly correlated to clinical assessment items. Moreover, numerous items in the task performance and motor indices capable of predicting the clinical assessment results were identified through stepwise regression analysis. The results of this research can facilitate the subsequent development of new assessment methods.

The Application of an Impedance-Passivity Controller in Haptic Stability Analysis

This paper proposes a passivity theorem on the basis of energy concepts to study the stability of force feedback in a virtual haptic system. An impedance-passivity controller (IPC) was designed from the two-port network perspective to improve the chief drawback of haptic systems, namely the considerable time required to reach stability if the equipment consumes energy slowly. The proposed IPC can be used to achieve stability through model parameter selection and to obtain control gain. In particular, haptic performance can be improved for extreme cases of high stiffness and negative damping. Furthermore, a virtual training system for one-degree-of-freedom sticking was developed to validate the experimental platform of our IPC. To ensure consistency in the experiment, we designed a specialized mechanical robot to replace human operation. Finally, compared with basic passivity control systems, our IPC could achieve stable control rapidly.

Study on Collision Detection and Force Feedback Algorithm in Virtual Surgery.

The development of virtual reality technology is expected to solve traditional surgical training. The lack of methods has brought revolutionary advances in technology. The virtual surgery system based on collision detection and force feedback can enable the operator to have stronger interaction, which is an exploration of the feature of touch in virtual reality technology. Reality is an important indicator of the virtual surgical system. This article improves the realism of the system from the visual and tactile senses and uses the surrounding ball collision detection and force feedback algorithms to build a realistic surgical platform. In the virtual surgery training system, the introduction of force feedback greatly improves the sense of presence during virtual surgery interaction. The operator can feel the softness and hardness of different tissues and organs through the force feedback device. Virtual reality is an interdisciplinary comprehensive technology that has been widely used in military, film, medical, and gaming fields. Virtual reality can simulate the objective world and display it visually, making people feel immersive. Virtual surgery provides surgeons with a recyclable surgical practice platform and can help doctors perform preoperative rehearsals and predict the results of surgery. The design of collision detection and force feedback algorithms is a prerequisite to ensure the immersion and transparency of the virtual surgical training system. This article mainly introduces the collision detection and force feedback algorithm research in virtual surgery, with the intention of providing some ideas and directions for the development of virtual surgery. This paper proposes two collision detection algorithms, space decomposition method and hierarchical bounding box method, and three force feedback algorithms including spring mass point algorithm, Runge–Kutta method, and Euler method to construct virtual surgery collision detection and force feedback. Experiment with the Overall System Architecture. This paper proves through experimental results that the average collision detection time after the application of the improved collision detection and force feedback algorithm in the virtual surgery system is more than 80.7% less than the traditional method, which greatly improves the detection speed.

RETRACTED: Virtual reality sports auxiliary training system based on embedded system and computer technology

Virtual Reality technology, the complex environment can be a simulated, traditional sports courses at the stadium, equipment, it is due to limitations such as safety, to provide scientific and accurate teaching and learning's, a complex by visualizing the theoretical knowledge in the abstract sport, you can get more technical knowledge. Compared to the traditional physical education activities, simulate sports scene only by generating VR panoramas that cannot be virtual reality technology. Based on this, you can improve the enthusiasm and athletic ability of students effectively. Because of immaturity and high-priced equipment of VR technology, at present, people that education is using unpopular making, carefully virtual reality technology. In this context, we can apply virtual reality technology to sports training, which can obtain more effective training effect. In the first part of this paper, we talk about the research of virtual reality panorama, the second part about the research of virtual reality video, the third part about the application of virtual reality in physical education teaching, and the fourth part is the conclusion and investigation process. In the study, VR, as a new technology, found that you have the prospect of a wide range of applications. As long as it has been used in scientific and rational, you can VR is to promote the level of improvement and sports greatly sports scene. Users can increase users' interest; it can be immersed in a variety of preset virtual locations. Therefore, in the VR device, which allows the user to improve the experience of the VR device, you can interact well in a virtual scene.

Design and implementation of adversarial virtual simulation training system

With a view to further enriching the college practical teaching conditions and also for the college teaching being closer to actual combat, a study is made on basis of system demand analysis in the early stage about the internal interface relationship and information/control process of the antagonistic virtual simulation training system with a key technology analysis made to lay a solid foundation for the implementation of the antagonistic virtual simulation training system.

3D Bow and Posture Measurements for Virtual Reality Customer Service Training System

3D Bow and Posture Measurements for Virtual Reality Customer Service Training System

Visual Echolocation Concept for the Colorophone Sensory Substitution Device Using Virtual Reality.

Detecting characteristics of 3D scenes is considered one of the biggest challenges for visually impaired people. This ability is nonetheless crucial for orientation and navigation in the natural environment. Although there are several Electronic Travel Aids aiming at enhancing orientation and mobility for the blind, only a few of them combine passing both 2D and 3D information, including colour. Moreover, existing devices either focus on a small part of an image or allow interpretation of a mere few points in the field of view. Here, we propose a concept of visual echolocation with integrated colour sonification as an extension of Colorophone—an assistive device for visually impaired people. The concept aims at mimicking the process of echolocation and thus provides 2D, 3D and additionally colour information of the whole scene. Even though the final implementation will be realised by a 3D camera, it is first simulated, as a proof of concept, by using VIRCO—a Virtual Reality training and evaluation system for Colorophone. The first experiments showed that it is possible to sonify colour and distance of the whole scene, which opens up a possibility to implement the developed algorithm on a hardware-based stereo camera platform. An introductory user evaluation of the system has been conducted in order to assess the effectiveness of the proposed solution for perceiving distance, position and colour of the objects placed in Virtual Reality.

Cost Education Effectiveness Analysis of Immersion-type and Simulator-type Virtual Reality Training Systems -Focusing on The ROK Army Virtual Reality Training System-

Cost Education Effectiveness Analysis of Immersion-type and Simulator-type Virtual Reality Training Systems -Focusing on The ROK Army Virtual Reality Training System-

Long short-term memory network-based user behavior analysis in virtual reality training system—a case study of the ship communication and navigation equipment training

Virtual reality is playing an essential role in the training system. In this paper, we propose a method to analyze the behaviors of users in the VR training system to evaluate their knowledge about the contents and the performance to finish the trained task. First, the user status in the VR environment such as position, orientation, viewpoint, inputs, and timestamp is recorded. Then, we convert these user status data into spatial-temporal semantic trajectories by projecting the viewpoints into the semantic 3D object in the VR system. To speed up the projection and reduce the noises, the 3D targets are semantically generalized. Finally, an LSTM (long short-term memory)-based algorithm is created to classify the spatial-temporal semantic trajectories of user behaviors. The classification can be used to examine if the user is familiar with the training content. According to our experimental results, the proposed method based on the semantic projection can achieve 85% classification accuracy while the direct LSTM-based classification only has 64%.

A Fast and Accurate Vascular Tissue Simulation Model Based on Point Primitive Method

Virtual surgery simulation is indispensable for virtual vascular interventional training system, which provides the doctor with visual scene between catheter and vascular. Soft tissue deformation, as the most significant part, determines the success or failure of the virtual surgery simulation. However, most soft tissue deformation model cannot simultaneously meet the requirement of high deformation accuracy and real-time interaction. To solve the challenge mentioned above, this paper proposes a fast and accurate vascular tissue simulation model based on point primitive method. Firstly, the proposed model simulates a deformation of the internal structure of the vascular tissue by adopting a point primitive method. Besides, the stretching constraint and elastic potential energy constraint are introduced to control and correct node motion. Furthermore, a mapping function from the interior to the surface of the vascular tissue is constructed based on moving least squares algorithm to render the visual effect of deformation. Finally, a training system based on the proposed model is set up on the PHANTOM OMNI force-tactile feedback device to realize the deformation simulation of the virtual vascular tissue. Experimental results shows that the proposed model can enhance real-time performance of the training system under the premise of ensuring deformation accuracy, as well as simulate the elasticity of soft tissue.

Virtual Reality Training System as a comprehensive and effective method for delivering technical hands-on training in the field of Distribution System Operators

The Paper presents the possibilities of using virtual reality techniques in interactive training of technical employees of a Distribution System Operator (DSO). It also describes the concept, assumptions and implementation method of the created Flexible Training System. Thanks to its capabilities, employees can participate in sophisticated training conducted in an innovative way eliminating the current disadvantages and limitations of classic – “real” training approaches. The System enables practice in two main categories of training used in the DSO environment: commutating operations and live-line works. Benefits and risks associated with system implementation in DSO structures are presented

基于3D Max/Virtools软件的装备虚拟训练系统开发

基于3D Max/Virtools软件的装备虚拟训练系统开发

A Scoping Review on Virtual Reality-Based Industrial Training

The fourth industrial revolution has forced most companies to technologically evolve, applying new digital tools, so that their workers can have the necessary skills to face changing work environments. This article presents a scoping review of the literature on virtual reality-based training systems. The methodology consisted of four steps, which pose research questions, document search, paper selection, and data extraction. From a total of 350 peer-reviewed database articles, such as SpringerLink, IEEEXplore, MDPI, Scopus, and ACM, 44 were eventually chosen, mostly using the virtual reality haptic glasses and controls from Oculus Rift and HTC VIVE. It was concluded that, among the advantages of using this digital tool in the industry, is the commitment, speed, measurability, preservation of the integrity of the workers, customization, and cost reduction. Even though several research gaps were found, virtual reality is presented as a present and future alternative for the efficient training of human resources in the industrial field.

Application of VR Virtual Reality in Navigation Teaching

This paper discusses the various factors that restrict the quality of training in maritime practice teaching, analyzes the technical characteristics of virtual reality technology, and the various advantages of virtual reality technology applied in maritime practice teaching, and on the virtual practice training system. The development process is described. The application of virtual reality technology in the practical teaching of navigation can further improve the quality of practical teaching of navigation students.

자동차정비 가상훈련시스템의 경력별 반응평가 연구

자동차정비 가상훈련시스템의 경력별 반응평가 연구

Development and Usability of a Virtual Reality-Based Filler Injection Training System

PurposeAs filler procedures have increased in popularity, serious injection-related complications (e.g., blindness and stroke) have also increased in number. Proper and effective training is important for filler procedure safety; however, limitations exist in traditional training methods (i.e. anatomical illustrations and cadaver studies). We aimed to describe the development process and evaluate the usability of a virtual reality (VR)-based aesthetic filler injection training system.Materials and MethodsWe developed the virtual reality hardware for the training system and a short guide, with a lecture regarding safe filler injection techniques. One hundred clinicians who attended a conference tested the training system. Participants completed system usability scale (SUS) and satisfaction questionnaires.ResultsNearly half of the participants were aged 35–50 years, and 38% had more than 5 years of aesthetic experience. The mean SUS score was 59.8 (standard deviation, 12.23), with no significant differences among the evaluated subgroups. Approximately 76% of participants provided SUS scores of more than 51, indicating acceptable usability. Participants aged 35–50 years were more likely to rate the system as having poor usability than were those aged < 35 years (odds ratio = 5.20, 95% confidence interval: 1.35–20.08).ConclusionsThis study was the first to develop and explore the usability of a VR-based filler training system. Nearly three-fourths of participants indicated that the training system has an acceptable level of usability. However, assessments in precise target audiences and more detailed usability information are necessary to further refine the training system.Level of evidence IVThis journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine ratings, please refer to the Table of Contents or the online Instructions to Authors www.springer.com/00266.

Effectiveness of Virtual Versus Physical Training: The Case of Assembly Tasks, Trainer's Verbal Assistance, and Task Complexity.

Virtual immersive training (VIT) systems based on gamification of tasks are increasingly employed to train assembly workers. In this article, we present a study that compares the effectiveness of virtual and physical training for teaching a bimanual assembly task and in a novel approach, we introduce task complexity (T$_{\mathrm{CXB}}$ CXB ) as an indicator of assembly errors during final assembly. In a between-subjects experiment, 100 participants were trained to assemble a 3-D cube in one of the four conditions (physical, virtual and with trainer's verbal assistance or not). The results demonstrate that the best-performing conditions, both in terms of successful assemblies and time performance, are the ones that the physical objects are included in the training, whereas no significant difference is found when the trainer's verbal assistance is present or absent during training. Additionally, we address the validity of a practical T$_{\mathrm{CXB}}$ CXB list as a tool for supporting the design of VIT systems.

GESTURE RECOGNITION FOR PENCAK SILAT TAPAK SUCI REAL-TIME ANIMATION

The main target in this research is a design of a virtual martial arts training system in real-time and as a tool in learning martial arts independently using genetic algorithm methods and dynamic time warping. In this paper, it is still in the initial stages, which is focused on taking data sets of martial arts warriors using 3D animation and the Kinect sensor cameras, there are 2 warriors x 8 moves x 596 cases/gesture = 9,536 cases. Gesture Recognition Studies are usually distinguished: body gesture and hand and arm gesture, head and face gesture, and, all three can be studied simultaneously in martial arts pencak silat, using martial arts stance detection with scoring methods. Silat movement data is recorded in the form of oni files using the OpenNI ™ (OFW) framework and BVH (Bio Vision Hierarchical) files as well as plug-in support software on Mocap devices. Responsiveness is a measure of time responding to interruptions, and is critical because the system must be able to meet the demand.

CONCEPTUAL DESIGN AND PRELIMINARY RESULTS OF A VR-BASED RADIATION SAFETY TRAINING SYSTEM FOR INTERVENTIONAL RADIOLOGISTS.

To help minimise occupational radiation exposure in interventional radiology, we conceptualised a virtual reality-based radiation safety training system to help operators understand complex radiation fields and to avoid high radiation areas through game-like interactive simulations. The preliminary development of the system has yielded results suggesting that the training system can calculate and report the radiation exposure after each training session based on a database precalculated from computational phantoms and Monte Carlo simulations and the position information provided by the Microsoft HoloLens headset. In addition, real-time dose rate and cumulative dose will be displayed to the trainee to help them adjust their practice. This paper presents the conceptual design of the overall hardware and software design, as well as preliminary results to combine HoloLens headset and complex 3D X-ray field spatial distribution data to create a mixed reality environment for safety training purpose in interventional radiology.