Motion Virtual Reality Research Articles

VR–MOCAP-Enabled Ergonomic Risk Assessment of Workstation Prototypes in Offsite Construction

Workers in offsite construction facilities are often exposed to repetitive motion and awkward body postures that are associated with the risk of developing work-related musculoskeletal disorders despite the use of automated equipment on production lines. To reduce the exposure to these risks, an investigation of the physical demands that workstations impose on workers’ bodies is needed. Since traditional methods used to collect human body motions have limitations, such as workplace interruptions and biased results due to subjective observation, this paper proposes a virtual reality (VR)–motion capture (MOCAP)-based ergonomic assessment method to evaluate ergonomic risks in a laboratory setting during the design phase of workstation development. It is expected that the number of iterations of physical workstation prototypes would be reduced if ergonomic risk ratings are identified proactively in the initial phases of workstation design, which would thereby reduce the cost and time required to develop and implement an improved workstation design. The present study includes a feasibility analysis of the proposed method in which participants representative of specific percentiles of the population based on their physical stature were invited to voluntarily participate in a research experiment. The results obtained demonstrate that the proposed method can successfully simulate the elemental motions, referred to as therbligs, of reaching and positioning (Pearson’s correlation coefficient is found to equal 0.80 and 0.94, respectively), while the simulation of the assembling therblig requires further investigation. The contribution of this study is a virtual reality–motion captured-enabled ergonomic risk assessment method applied to workstation design for offsite construction production lines. In addition, the deployment of the proposed method allows a holistic ergonomic assessment that considers objective and subjective parameters.

가상환경에서 수직 운동에 대한 데이터 기반 카메라 조작1

In this paper, the goal is to investigate how manipulating the camera can minimize motion sickness and maximize immersion when a user moves in a virtual environment that requires vertical movement. In general, since a user uses virtual reality in a flat space, the actual movement of the user and the virtual movement are different, resulting in sensory conflict, which has the possibility of causing virtual reality motion sickness. Therefore, we propose three powerful camera manipulation techniques, implement them, and then propose which model is most appropriate through user experiments.

Data-Driven Classification of Human Movements in Virtual Reality-Based Serious Games: Preclinical Rehabilitation Study in Citizen Science.

BackgroundSustained engagement is essential for the success of telerehabilitation programs. However, patients’ lack of motivation and adherence could undermine these goals. To overcome this challenge, physical exercises have often been gamified. Building on the advantages of serious games, we propose a citizen science–based approach in which patients perform scientific tasks by using interactive interfaces and help advance scientific causes of their choice. This approach capitalizes on human intellect and benevolence while promoting learning. To further enhance engagement, we propose performing citizen science activities in immersive media, such as virtual reality (VR).ObjectiveThis study aims to present a novel methodology to facilitate the remote identification and classification of human movements for the automatic assessment of motor performance in telerehabilitation. The data-driven approach is presented in the context of a citizen science software dedicated to bimanual training in VR. Specifically, users interact with the interface and make contributions to an environmental citizen science project while moving both arms in concert.MethodsIn all, 9 healthy individuals interacted with the citizen science software by using a commercial VR gaming device. The software included a calibration phase to evaluate the users’ range of motion along the 3 anatomical planes of motion and to adapt the sensitivity of the software’s response to their movements. During calibration, the time series of the users’ movements were recorded by the sensors embedded in the device. We performed principal component analysis to identify salient features of movements and then applied a bagged trees ensemble classifier to classify the movements.ResultsThe classification achieved high performance, reaching 99.9% accuracy. Among the movements, elbow flexion was the most accurately classified movement (99.2%), and horizontal shoulder abduction to the right side of the body was the most misclassified movement (98.8%).ConclusionsCoordinated bimanual movements in VR can be classified with high accuracy. Our findings lay the foundation for the development of motion analysis algorithms in VR-mediated telerehabilitation.

Algorithms for Controlling the Hardware and Software Platform for Moving in Virtual Reality

Comprehensive training of specialists in machine-building, chemical and mining industries requires the use of modern means of education. The use of software and hardware platforms based on virtual reality technologies and controlled treadmills allows for a high level of immersion in the learning process and the development of the necessary practical skills. However, the existing control algorithms for treadmills have a number of disadvantages: the effect of lag, low adaptability to human actions. The paper discusses several approaches to organizing the management of a software and hardware platform to improve the quality of movement in virtual reality. Linear and nonlinear algorithms have been developed and have been tested, and the quality of human movement in virtual reality has been made. The nonlinear modified algorithm has allowed to obtain the best results and to reduce the amplitude of oscillations relative to the initial position.

A Systematic Literature Review on Extended Reality: Virtual, Augmented and Mixed Reality in Working Life

Extended reality (XR), here jointly referring to virtual, augmented, and mixed (VR, AR, MR) reality, is becoming more common in everyday working life. This paper presents a systematic literature review of academic publications on XR indicating changes in practical organization of work. We analyse both application areas of XR and theoretical and methodological approaches of XR research. The review process followed the PRISMA statement. Design, remote collaboration, and training were the main application areas of XR. XR enabled overcoming of obstacles set by time and space, safety, and resources by mediating experience of space. Research on XR applications in actual working life settings is yet relatively rare and covers primarily three areas: collaboration, evaluation of knowledge transfer, and work practices. Virtual reality was the most common form of applied XR, although the hardware used varied case by case. We identified four research areas regarding XR: collaboration, work practices, and evaluation of knowledge transfer, which somewhat followed the application areas. We did not find XR-specific methodologies in the reviewed articles, only few recent studies used novel ways of collecting research material, such as recording the movement in virtual reality. For now, XR still holds significant potential rather than clearly confirmed general advantages in working life.

The Core Competence Construction of Primary and Middle School Sports Skills Based on Decision Support System

Objectives: With the continuous development of sports, the current learning of motor skills in primary and secondary school students has become universal, so the research on the core literacy learning evaluation of primary and secondary school sports skills based on decision support system is established. Methods: According to the computer aided skills learning in sports, the model is established. Results: By adding the decision support system to the virtual reality motion model, the problems existing in the skills learning of primary and secondary school students are further studied, thus providing a better learning method. Conclusion: In the test for computing decision support technology, the test time and accuracy test for the model shows that proficient mastery of motor skills has a prominent role in improving core literacy.

The effect of music on body sway when standing in a moving virtual environment.

Movement of the visual environment presented through virtual reality (VR) has been shown to invoke postural adjustments measured by increased body sway. The effect of auditory information on body sway seems to be dependent on context with sounds such as white noise, tones, and music being used to amplify or suppress sway. This study aims to show that music manipulated to match VR motion further increases body sway. Twenty-eight subjects stood on a force plate and experienced combinations of 3 visual conditions (VR translation in the AP direction at 0.1 Hz, no translation, and eyes closed) and 4 music conditions (Mozart's Jupiter Symphony modified to scale volume at 0.1 Hz and 0.25 Hz, unmodified music, and no music) Body sway was assessed by measuring center of pressure (COP) velocities and RMS. Cross-coherence between the body sway and the 0.1 Hz and 0.25 Hz stimuli was also determined. VR translations at 0.1 Hz matched with 0.1Hz shifts in music volume did not lead to more body sway than observed in the no music and unmodified music conditions. Researchers and clinicians may consider manipulating sound to enhance VR induced body sway, but findings from this study would not suggest using volume to do so.

A Virtual Reality Game (The Secret Trail of Moon) for Treating Attention-Deficit/Hyperactivity Disorder: Development and Usability Study

BackgroundAttention-deficit/hyperactivity disorder (ADHD) affects between 4% and 8% of children worldwide. The treatment of choice is multimodal treatment. Multimodal interventions for ADHD may be improved by incorporating new treatments, such as treatment via serious video games. The Secret Trail of Moon (TSTM) is a virtual reality serious video game that was designed for cognitive training related to core ADHD symptoms and executive dysfunction.ObjectiveWe aimed to describe the development and usability of TSTM.MethodsThe usability study included 37 children and adolescents who tested TSTM during the early usability stage (preinclusion) of a randomized controlled clinical trial for testing the effectiveness of TSTM. Chi-square tests were performed to compare patients with ADHD (ADHD combined subtype vs inattentive subtype) and to compare frequent and infrequent video game players in the second study. We used SPSS version 20 for Macintosh (IBM Corporation).ResultsA total of 31/37 (86%) and 30/37 (83%) of participants liked playing TSTM and wanted to continue playing TSTM, respectively. Further, 5/37 (14%) of participants reported that they experienced either perceived dizziness or virtual reality motion sickness. We found no statistically significant differences after comparing the ADHD combined subtype to the inattentive subtype and frequent video game players to infrequent video game players.ConclusionsSerious video games, such as TSTM, may complement the current multimodal approach for treating ADHD.Trial RegistrationClinicalTrials.gov NCT04355065; https://clinicaltrials.gov/ct2/show/NCT04355065

A chain navigation grid based on cellular automata for large-scale crowd evacuation in virtual reality

Large-scale crowd evacuation simulation in virtual reality is of great significance for emergency response. However, the existing large-scale crowd evacuation simulation methods are challenging to apply to the virtual reality scene. Thus, the efficiency of large-scale crowd rendering in virtual reality needs to be improved. Here we proposed a chain navigation grid for virtual reality large-scale crowd evacuation simulation. The objective of this study was to apply traditional cellular automata crowd evacuation simulation algorithms to virtual reality scenes through a chain navigation grid. Combined with the characteristics of crowd movement, we proposed the vertex raster rendering method to efficiently visualize large-scale crowds in virtual reality scenes. Finally, we constructed two evacuation scenes and carried out experimental analyses. The results show that the chain evacuation navigation grid can transform the discrete crowd movement of cellular automata into continuous crowd movement in virtual reality and can connect multiple cellular automata corresponding to multi-floors. Compared with the evacuation results of Pathfinder software, the chain evacuation navigation can add the factor of environmental familiarity. Therefore, this study improved evacuation simulation by increasing about 6% efficiency in time and computing process. Compared with the traditional crowd evacuation rendering method, the vertex raster rendering method increases the maximum number of people rendering from 2 times to 31 times.

Gaze During Locomotion in Virtual Reality and the Real World.

How vision guides gaze in realistic settings has been researched for decades. Human gaze behavior is typically measured in laboratory settings that are well controlled but feature-reduced and movement-constrained, in sharp contrast to real-life gaze control that combines eye, head, and body movements. Previous real-world research has shown environmental factors such as terrain difficulty to affect gaze; however, real-world settings are difficult to control or replicate. Virtual reality (VR) offers the experimental control of a laboratory, yet approximates freedom and visual complexity of the real world (RW). We measured gaze data in 8 healthy young adults during walking in the RW and simulated locomotion in VR. Participants walked along a pre-defined path inside an office building, which included different terrains such as long corridors and flights of stairs. In VR, participants followed the same path in a detailed virtual reconstruction of the building. We devised a novel hybrid control strategy for movement in VR: participants did not actually translate: forward movements were controlled by a hand-held device, rotational movements were executed physically and transferred to the VR. We found significant effects of terrain type (flat corridor, staircase up, and staircase down) on gaze direction, on the spatial spread of gaze direction, and on the angular distribution of gaze-direction changes. The factor world (RW and VR) affected the angular distribution of gaze-direction changes, saccade frequency, and head-centered vertical gaze direction. The latter effect vanished when referencing gaze to a world-fixed coordinate system, and was likely due to specifics of headset placement, which cannot confound any other analyzed measure. Importantly, we did not observe a significant interaction between the factors world and terrain for any of the tested measures. This indicates that differences between terrain types are not modulated by the world. The overall dwell time on navigational markers did not differ between worlds. The similar dependence of gaze behavior on terrain in the RW and in VR indicates that our VR captures real-world constraints remarkably well. High-fidelity VR combined with naturalistic movement control therefore has the potential to narrow the gap between the experimental control of a lab and ecologically valid settings.

Investigating the User Experience of Virtual Reality Rehabilitation Solution for Biomechatronics Laboratory and Home Environment

Virtual reality (VR) technology is a promising tool in physical rehabilitation. Research indicates that VR-supported rehabilitation is beneficial for task-specific training, multi-sensory feedback, diversified rehabilitation tasks, and patient motivation. Our first goal was to create a biomechatronics laboratory with a VR setup for increasing immersion and a motion platform to provide realistic feedback to patients. The second goal was to investigate possibilities to replicate features of the biomechatronics laboratory in a home-based training system using commercially available components. The laboratory comprises of a motion platform with 6-degrees-of-freedom (Rexroth eMotion), fitted with a load cell integrated treadmill, and an Oculus Quest virtual reality headset. The load cells provide input for data collection, as well as VR motion control. The home-based rehabilitation system consists of a Nintendo Wii Balance Board and an Oculus Rift virtual reality headset. User studies in the laboratory and home environment used direct observation techniques and self-reported attitudinal research methods to assess the solution’s usability and user experience. The findings indicate that the proposed VR solution is feasible. Participants using the home-based system experienced more cybersickness and imbalance compared to those using the biomechatronics laboratory solution. Future studies will look at a setup that is safe for first patient studies, and exercises to improve diagnosis of patients and progress during rehabilitation.

The Effect of Motion Direction and Eccentricity on Vection, VR Sickness and Head Movements in Virtual Reality.

Virtual Reality (VR) experienced through head-mounted displays often leads to vection, discomfort and sway in the user. This study investigated the effect of motion direction and eccentricity on these three phenomena using optic flow patterns displayed using the Valve Index. Visual motion stimuli were presented in the centre, periphery or far periphery and moved either in depth (back and forth) or laterally (left and right). Overall vection was stronger for motion in depth compared to lateral motion. Additionally, eccentricity primarily affected stimuli moving in depth with stronger vection for more peripherally presented motion patterns compared to more central ones. Motion direction affected the various aspects of VR sickness differently and modulated the effect of eccentricity on VR sickness. For stimuli moving in depth far peripheral presentation caused more discomfort, whereas for lateral motion the central stimuli caused more discomfort. Stimuli moving in depth led to more head movements in the anterior-posterior direction when the entire visual field was stimulated. Observers demonstrated more head movements in the anterior-posterior direction compared to the medio-lateral direction throughout the entire experiment independent of motion direction or eccentricity of the presented moving stimulus. Head movements were elicited on the same plane as the moving stimulus only for stimuli moving in depth covering the entire visual field. Acorrelation showed a positive relationship between dizziness and vection duration and between general discomfort and sway. Identifying where in the visual field motion presented to an individual causes the least amount of VR sickness without losing vection and presence can guide development for Virtual Reality games, training and treatment programmes.

Mind the food: behavioural characteristics and imaging signatures of the specific handling of food objects

In our world with nearly omnipresent availability of attractive and palatable high-calorie food, the struggle against overweight and obesity is a major individual and public health challenge. Preference for unhealthy food and eating-related habits have a strong influence on health, suggesting that high-calorie food triggers fast and near-automatic reaching and grasping movements. Therefore, it is important to better understand the specific neural mechanisms that control the handling of food involving a coordinated interplay between sensoric, motoric, and cognitive subsystems. To this end, 30 healthy participants (Ø BMI: 22.86 kg/m2; BMI range: 19–30 kg/m2; 23 females) were instructed to collect one of two concurrently presented objects (food vs. office tools) by manual movement in virtual reality (VR) and on a touchscreen. Parallel to the task in VR, regional brain activity was measured by functional near-infrared spectroscopy (fNIRS). In the VR and on the touchscreen, stimulus recognition and selection were faster for food than for office tools. Yet, food was collected more slowly than office tools when measured in VR. On the background of increased brain activity in the right dorsolateral prefrontal cortex (dlPFC) during food trials, this suggests more behavioural control activity during handling foods. In sum, this study emphasizes the role of the right dlPFC in faster recognition and selection of food as part of a food-valuation network, more controlled handling of food in the VR which highlights the relevance of medium for modelling food-specific embodied cognitions.

Modified sensory feedback enhances the sense of agency during continuous body movements in virtual reality

The sense of agency refers to the feeling of control over one’s own actions, and through them, the external events. This study examined the effect of modified visual feedback on the sense of agency over one’s body movements using virtual reality in healthy individuals whose motor control was disturbed. Participants moved a virtual object using their right hand to trace a trajectory (Experiment 1) or a leading target (Experiment 2). Their motor control was disturbed by a delay in visual feedback (Experiment 1) or a 1-kg weight attached to their wrist (Experiment 2). In the offset conditions, the virtual object was presented at the median point between the desired position and the participants’ actual hand position. In both experiments, participants reported improved sense of agency in the offset condition compared to the aligned condition where the visual feedback reflected their actual body movements, despite their motion being less precise in the offset condition. The results show that sense of agency can be enhanced by modifying feedback to motor tasks according to the goal of the task, even when visual feedback is discrepant from the actual body movements. The present study sheds light on the possibility of artificially enhancing body agency to improve voluntary motor control.

Complex Plane based Realistic Sound Generation for Free Movement in Virtual Reality

A binaural rendering is a technology that generates a realistic sound for a user with a stereo headphone, so it is essential for the stereo headphone based virtual reality (VR) service. However, the binaural rendering has a problem that it cannot reflect the user's free movement in the VR. Because the VR sound does not match with the visual scene when the user moves freely in the VR space, the performance of the VR may be degraded. To reduce the mismatch problem in the VR, the complex plane based stereo realistic sound generation method was proposed to allow the user’s free movement in the VR causing the change of the distance and azimuth between the user and the speaker. For the calculation of the distance and the azimuth between the user and the speaker by the user’s position change, the 5.1 multichannel speaker playback system and the user are placed in the complex plane. Then, the distance and the azimuth between the user and the speaker can be simply calculated as the distance and the angle between two points in the complex plane. The 5.1 multichannel audio signals are scaled by the estimated five distances according to the inverse square law, and the scaled multichannel audio signals are mapped to the newly generated virtual 5.1 multichannel speaker layout using the measured five azimuths and the azimuth by the head movement. Finally, we can successfully obtain the stereo realistic sound to reflect the user’s position change and the head movement through the binaural rendering using the scaled and mapped 5.1 multichannel audio signals and the HRTF coefficients. Experimental results show that the proposed method can generate the realistic audio sound reflecting the user’s position and azimuth change in the VR only with less than about 5 % error rate.

A mathematical model of movement in virtual reality through thoughts

In this article, we'll introduce ways to build virtual worlds through different computer programs. We will show the method of rectangles for analyzing data obtained from the electroencephalogram. We will demonstrate basic mathematical models for movement prediction in a system of virtual reality. Using this data, the main transformations are possible-change of position and rotation (change of orientation).

A Novel Method to Understand Neural Oscillations During Full-Body Reaching: A Combined EEG and 3D Virtual Reality Study.

Virtual reality (VR) can be used to create environments that are not possible in the real-world. Producing movements in VR holds enormous promise for rehabilitation and offers a platform from which to understand the neural control of movement. However, no study has examined the impact of a 3D fully immersive head-mounted display (HMD) VR system on the integrity of neural data. We assessed the quality of 64-channel EEG data with and without HMD VR during rest and during a full-body reaching task. We compared resting EEG while subjects completed three conditions: No HMD (EEG-only), HMD powered off (VR-off), and HMD powered on (VR-on). Within the same session, EEG were collected while subjects completed full-body reaching movements in two conditions (EEG-only, VR-on). During rest, no significant differences in data quality and power spectrum were observed between EEG-only, VR-off, and VR-on conditions. During reaching movements, the proportion of components attributed to the brain was greater in the EEG-only condition compared to the VR-on condition. Despite this difference, neural oscillations in source space were not significantly different between conditions, with both conditions associated with decreases in alpha and beta power in sensorimotor cortex during movements. Our findings demonstrate that the integrity of EEG data can be maintained while individuals execute full-body reaching movements within an immersive 3D VR environment. Clinical impact: Integrating VR and EEG is a viable approach to understanding the cortical processes of movement. Simultaneously recording movement and brain activity in combination with VR provides the foundation for neurobiologically informed rehabilitation therapies.

Natural Interaction Design for Navigation in Virtual Environment of Sino-Portuguese Architecture in Museum

Virtual Environment (VE) is an artificial environment created for providing the information in Virtual Reality (VR). The audiences are able to obtain the information via interaction to the environment. Virtual Reality for Culture heritage buildings, which are inherited from past generations and maintained in the present, is an interested topic because its contents often built for giving the information and knowledge about the past to the new generation in virtual museums. However, there is a limitation of Virtual Reality (VR) applications in reproducing cultural sites as most of these applications are not successful in catching public’s attention and involvement. In this research, we focus on using Natural Interaction (NI) interfaces based on a body movement in Virtual Reality for museums to grab attention from audience and to increase public’s involvement. This paper presents the development of Natural Interaction using Microsoft Kinect to define the new grammar of gesture for Sino Portuguese Architecture which is a cultural heritage of Thailand. Results of early tests improved the prototype in progress which alllows more complexity in natural interchanges and connection between users and virtual world. The final result was evaluated after the system was installed in Peranakannitat museum and by interviewing 6 docents. It was found that our system was easy to use as it took only about 3 - 5 min to familiarize the system for navigation in the virtual environment without recognizing the grammar of gesture commands.

The Impact of a Multitasking-Based Virtual Reality Motion Video Game on the Cognitive and Physical Abilities of Older Adults

This study demonstrates how playing a well-designed multitasking motion video game in a virtual reality (VR) environment can positively impact the cognitive and physical health of older players. We developed a video game that combines cognitive and physical training in a VR environment. The impact of playing the game was measured through a four-week longitudinal experiment. Twenty healthy older adults were randomly assigned to either an intervention group (i.e., game training) or a control group (i.e., no contact). Participants played three 45-min sessions per week completing cognitive tests for attention, working memory, reasoning and a test for physical balance before and after the intervention. Results showed that compared to the control group, the game group showed significant improvements in working memory and a potential for enhancing reasoning and balance ability. Furthermore, while the older adults enjoyed playing the video game, ability enhancements were associated with their intrinsic motivation to play. Overall, cognitive training with multitasking VR motion video games has positive impacts on the cognitive and physical health of older adults.

NEW TECHNOLOGIES AND APPLICATIONS OF MOTION TRACKING IN VIRTUAL REALITY SYSTEMS

This article is centered around the sort of virtual reality (VR) – MoCap – motion capture. VR is utilized as a part of the planning and design procedure of the working environment. Firstly, the work environment is designed and before actual building the various conditions are simulated. Product of this simulation by VR is the working environment/ building. VR is utilized too in the medical treatments. This paper investigates a way to deal with physical rehabilitation using best in class advances in virtual reality and motion tracking. As of present, there has been a boom in the utilization of the Kalman channel in Virtual/ Augmented Reality. This paper presents a brief introduction to the Kalman filter and the development of the utilization of the filter in VR motion tracking.