Immersive Virtual Reality Research Articles

Integrating Virtual Reality Tools into Secondary School Classrooms to Address Gender Gap in STEM Education: An Action Plan

This action plan addresses the gender gap in STEM education by integrating Virtual Reality (VR) tools into secondary school classrooms. Despite various strategies to increase female participation in STEM fields, women remain underrepresented in these areas. The action plan proposes the use of immersive and interactive VR experiences to create more engaging learning environments that may attract a diverse student body, particularly female students. By leveraging the potential of VR to simulate science experiments and other STEM-related activities, this project aims to enhance students' interest and confidence in STEM subjects. A pilot will be conducted in a secondary school, with approximately 50-100 students and a dedicated STEM teaching team. Key strategies include virtual reality technology training for teachers, the design of inclusive STEM curricula, and continuous evaluation through both formative and summative assessments. The expected outcome is that female students will show increased willingness to pursue further study and careers in STEM fields, contributing to long-term reductions in the gender gap in STEM education.

The brain hierarchically represents the past and future during multistep anticipation

Memory for temporal structure enables both planning of future events and retrospection of past events. We investigated how the brain flexibly represents extended temporal sequences into the past and future during anticipation. Participants learned sequences of environments in immersive virtual reality. Pairs of sequences had the same environments in a different order, enabling context-specific learning. During fMRI, participants anticipated upcoming environments multiple steps into the future in a given sequence. Temporal structure was represented in the hippocampus and across higher-order visual regions (1) bidirectionally, with graded representations into the past and future and (2) hierarchically, with further events into the past and future represented in successively more anterior brain regions. In hippocampus, these bidirectional representations were context-specific, and suppression of far-away environments predicted response time costs in anticipation. Together, this work sheds light on how we flexibly represent sequential structure to enable planning over multiple timescales.

Real-Time Visibility Assessment in an Interactive Immersive Virtual Reality Application for Urban Public Space Design

Abstract. The design of urban public spaces (UPSs) aims to facilitate users’ physical and mental well-being by facilitating dynamic and stationary activities. The success of a UPS is often measured by its users’ engagement and experiences. However, UPSs frequently exhibit varying usage patterns, with some areas being heavily frequented and others neglected. This discrepancy is often due to users’ perceptions of safety, comfort, and liveliness. Failure to anticipate and address these aspects during the design phase of UPSs can result in dysfunctional urban spaces that fail to meet users’ needs. People experience UPSs primarily through their senses, with vision being the predominant sense and key to spatial cognition in UPSs. Therefore, adequate visibility of the spatial configuration must be integral to UPS design as a design goal. As a result of recent advances in Immersive Virtual Reality (IVR) end-users can participate in, interact and experience the possible UPS design scenarios, however, most IVR applications do not provide real-time feedback for design goals such as visibility. Established methods exist for analyzing visibility in UPS. However, these techniques are not usually integrated into VR apps to assess the effects of the designs. This paper addresses the gap for the lack of real-time visibility feedback within IVR applications for UPS design and its technical challenge. Building on a previous IVR application, CoHeSIVE, which was developed for UPS design, we integrated a ray-casting method and Unity’s built-in callbacks for dynamic visibility assessment of the features within the user’s field of view. The visibility assessment is then presented on a dashboard within the IVR app. This study serves as a cornerstone for future real-time feedback mechanisms of visibility assessment within IVR applications for urban design, facilitating informed design decisions.

Developing a Workflow for Transforming BIM Models into Immersive Virtual Reality Experiences

Abstract. The integration of Extended Reality (XR) and Building Information Modelling (BIM) has emerged as a promising approach for enhancing interaction with spatial data in the built environment. While the potential of BIM for advanced visualization has been recognized, there remains a need for standardized workflows that facilitate the transformation of BIM models into immersive virtual reality (VR) experiences. This research contributes to the ongoing development of BIM-VR integration by presenting a workflow that leverages Revit, Twinmotion, and Datasmith to create visually rich and interactive VR environments. The established process focuses on enhancing textures, incorporating dynamic lighting and weather simulations, and populating the virtual space with realistic elements. The workflow also addresses the integration of interactable objects to elevate user engagement and the use of cutting-edge VR headsets for an immersive experience. By providing a structured approach to bridging complex BIM data with VR, this research aims to support architects, engineers, construction professionals, and clients in design collaboration, project review, and decision-making across the building lifecycle. The workflow's potential for facilities management and training applications is also explored. Through a case study, the research demonstrates the workflow's effectiveness in facilitating a deeper understanding of architectural spaces before construction, highlighting its potential for improving efficiency and reducing rework. The paper also discusses the challenges and opportunities associated with integrating BIM with GIS and sensor data to create comprehensive digital twins. This research contributes to the growing body of knowledge on BIM-VR integration and underscores the importance of continued development in this field to enhance the design, communication, and experience of the built environment.

Advances in research on learning in immersive virtual reality.

Advances in research on learning in immersive virtual reality.

Benefits of Virtual Reality Training for Cardiopulmonary Resuscitation Skill Acquisition and Maintenance

Objectives To investigate the benefits of virtual reality (VR) first-aid training in acquiring cardiopulmonary resuscitation (CPR) skills. Methods A total of 100 non-medical professional volunteers from Nanchang were selected in March 2021 using the convenience sampling method. They were randomly divided into two groups: the VR training group (VR group) and the traditional simulation scenario training group (traditional group). The VR Group underwent immersive virtual reality CPR training with interactive feedback, while the Traditional Group received standard simulation-based CPR training using mannequins and instructor guidance. After training, relevant data were collected for comparative analysis. Results The study revealed that the VR group consistently outperforming the traditional group in theoretical knowledge test (cardiac arrest recognition, chest compressions, airway management, and artificial respiration) scores at 1, 3, 6, and 12 months post-training (p < 0.05). Similarly, the VR group showed superior performance in overall skills test scores and individual CPR quality metrics at all post-training assessments. The VR group scored higher in total skills, assessment, post-resuscitation assessment, chest compressions (at 1, 3, and 6 months), airway opening, and artificial respiration compared to the traditional group (p < 0.05). Despite these findings, both groups exhibited a gradual decrease in skills test scores over time. Conclusions Virtual reality training can significantly improve non-medical professional volunteers’ CPR knowledge and skill levels, helping them master and maintain these competencies. However, a decrease in CPR knowledge and skills among the participants over time was observed after VR training, suggesting the need for further retraining sessions.

Development of professional skills in kickboxing athletes using virtual reality technologies

Ukrainian sports are currently facing numerous problems due to the hostile military operations by the Russian Federation, leading to the emigration of gifted athletes from the nation. Considering these challenges, the search for novel ways to support and enhance athletes throughout their careers has become critically important. Cutting-edge technologies, especially virtual reality (VR), are being proposed as a potent means to enhance professional training. They facilitate the fusion of traditional and innovative methods, ensuring that athletic training evolves to meet contemporary demands. This strategy adjusts the requirements of athletes across the spectrum, from beginners to professionals, as well as mentors and sports entities eager to incorporate unconventional technologies into their training regimen. Employing immersive VR settings enables the replication of authentic competitive scenarios and training intensities. It offers the capability to monitor biometric data, evaluating the athletes' resilience to stress, their focus, and their strategic expertise. Anticipated outcomes of this holistic approach include enhanced training session productivity, reinforced mental strength in competitors during events, and expedited recuperation from injuries. The introduction and application of VR technology in sports training signifies a leap towards revitalizing traditional training techniques, ensuring they are modular and adaptable. This facilitates seamless integration into a range of sports disciplines and alignment with diverse training schemes, enhancing Ukraine's global sports standing and positioning the nation as a pioneer in athlete training innovation. In this study, we explored the incorporation of VR technology in kickboxing, specifically targeting the 10–12-year age bracket. At this developmental stage, children are particularly receptive to new experiences and stimuli, making such a technologically enriched environment a powerful tool to boost training enthusiasm. Virtual reality holds the promise of breaking the routine of standard training practices, rendering them more captivating and interactive, which is crucial for attracting young participants.

Immersive virtual reality in forestry work – implementation for chainsaw training

ABSTRACT Growing interest in virtual reality (VR) and its technical development has resulted in several applications for training and teaching purposes. This paper studied an immersive VR platform, hereafter referred to as IVR, developed for training in motor-manual tree delimbing as a learning tool, which is one of the first in forestry work training. The tested platform was the Husqvarna Limberjack, available for free download and publicly accessible. The platform uses an immersive VR to teach users how to delimb stems with a chainsaw. The study included four groups with different previous experience of using immersive VR as the first factor and a chainsaw as the second factor. The experiment included records of the time required to complete the tasks. That data was used in a procedural study in which the average and best times of the groups were utilized. Statistical analysis showed differences between the groups with and without experience in both factors. The learning curves showed a 12.4 to 26.7% improvement for all four groups. The IVR platform turned out to be a useful training aid, where skills can be gained before going to practice in field.

Impact of Visual Feedback Configurations in a Task-oriented Immersive Virtual Reality Mirror Therapy.

Mirror Therapy is a form of upper limb therapy in stroke, which consists on showing the mirrored symmetric movement of the unimpaired side using a mirror placed in the medial sagittal plane. The illusion of movement corresponding to the impaired extremity could facilitate neuroplasticity, and assists patients in regaining certain lost motor functions. Recent studies have shown the potential and benefit of translating this effective therapy in an immersive virtual reality (VR) environment, using head mounted display and hand tracking systems. This work investigates the feasibility to use myoelectric control in an immersive VR environment for the mirror therapy to accomplish a funtional task. Surface electromyography sensors were used to measure muscle activation and detect user intention to perform grasping actions in two visual feedback configurations: unimanual and bimanual. Even though in both conditions the virtual mirrored hand is controlled by the healthy hand, the latter creates the illusion that two functional hands cooperate for grasping. A total of 18 healthy subjects participated in the evaluation of the environment, control method and a comparison between the two configurations. This includes self-rating surveys and performance metrics. Results from the Simulator Sickness Questionnaire showed negligible adverse symptoms related to the use of the VR-application proposed. Positive outcomes from the System Usability Scale and Presence Questionnaire affirmed its feasible as a form of therapy for the rehabilitation of hemiparetic stroke patients. Although the adapted Box and Blocks Test proved immediate training-induced learning, performance measures revealed no significant distinctions between visual feedback configurations.

Prediction of Attention Groups and Big Five Personality Traits from Gaze Features Collected from an Outlier Search Game.

This study explores the intersection of personality, attention and task performance in traditional 2D and immersive virtual reality (VR) environments. A visual search task was developed that required participants to find anomalous images embedded in normal background images in 3D space. Experiments were conducted with 30 subjects who performed the task in 2D and VR environments while their eye movements were tracked. Following an exploratory correlation analysis, we applied machine learning techniques to investigate the predictive power of gaze features on human data derived from different data collection methods. Our proposed methodology consists of a pipeline of steps for extracting fixation and saccade features from raw gaze data and training machine learning models to classify the Big Five personality traits and attention-related processing speed/accuracy levels computed from the Group Bourdon test. The models achieved above-chance predictive performance in both 2D and VR settings despite visually complex 3D stimuli. We also explored further relationships between task performance, personality traits and attention characteristics.

Exploring the Impact of Digital Technologies on Team Collaborative Design

This paper presents the results of a protocol study exploring the impact of various digital technologies on team collaborative design processes. Previous studies have suggested that compared to traditional methods such as sketching, digital technologies can provide further benefits for collaborative processes. However, there persists a lack of understanding about the impacts of digital technologies on such processes, particularly in relation to emerging significant digital technologies such as immersive Virtual Reality (VR). Therefore, this study aims to fill that gap by exploring team collaboration behaviours of two groups of professionals working in two digital design environments—desktop 3D modelling with Revit and immersive VR using Hyve-3D—as well as their behaviours during traditional sketching sessions for benchmarking purposes. Utilising protocol analysis method, the think-aloud data of participants was recorded, transcribed and coded using an adapted collaborative practice model. Team collaboration activities are broadly categorised as ‘Content’ or ‘Process’: content referring to design task-based activities, while process refers to activities related to the organising of group processes. The results suggest that during the design collaboration process, designers allocated the majority of their efforts towards process-oriented design activities. Differences between design environments only had a minor impact on the amount of effort expended on process-oriented activities and content-oriented activities. Moreover, traditional sketching design environments were shown to be potentially beneficial for problem-solution and associated negotiation activities. Additionally, immersive environments were associated with a reduction in the designers’ cognitive effort that was expended on exploring the design environment.

Research Issues to Be Considered in Occupational Health Regarding the Application of Immersive Virtual Reality to Workplace Situations

Research Issues to Be Considered in Occupational Health Regarding the Application of Immersive Virtual Reality to Workplace Situations

Immersive Virtual Reality (IVR) Systems for Comprehensive Fire Safety Education in Primary School

In the evolving landscape of educational technology, immersive virtual reality (IVR) has emerged as a promising tool to enhance safety education for primary school students. Traditional fire safety methods, while foundational, face challenges in engaging young learners actively. This study aims to comprehensively investigate the intricate dynamics of integrating IVR technology into fire safety education for primary school students. By examining students' perceptions, assessing engagement levels, and evaluating learning outcomes, the research seeks to offer nuanced insights into the potential benefits and challenges associated with VR-based safety education. Conducted as a qualitative study, 25 semi-structured interviews were performed with primary school students (Grades 4-6 in China), employing a three-step thematic analysis. The research explores students' experiences with IVR fire safety simulations, comparing them with traditional methods, and addressing practical considerations for integration. Preliminary findings suggest positive perceptions, heightened engagement, and improved learning outcomes among students exposed to VR simulations. Practical challenges, including logistical considerations, were identified. The comparison with traditional methods illuminated strengths and weaknesses, guiding educators and policymakers. This research contributes to the intersection of education and technology by offering novel insights into the potential of IVR simulations in fire safety education. The study's significance lies in informing pedagogical practices, addressing practical challenges, and promoting safety awareness among primary school students, guiding future educational technology initiatives.

Linking brain-heart interactions to emotional arousal in immersive virtual reality.

The subjective experience of emotions is linked to the contextualized perception and appraisal of changes in bodily (e.g., heart) activity. Increased emotional arousal has been related to attenuated high-frequency heart rate variability (HF-HRV), lower EEG parieto-occipital alpha power, and higher heartbeat-evoked potential (HEP) amplitudes. We studied emotional arousal-related brain-heart interactions using immersive virtual reality (VR) for naturalistic yet controlled emotion induction. Twenty-nine healthy adults (13 women, age: 26 ± 3) completed a VR experience that included rollercoasters while EEG and ECG were recorded. Continuous emotional arousal ratings were collected during a video replay immediately after. We analyzed emotional arousal-related changes in HF-HRV as well as in BHIs using HEPs. Additionally, we used the oscillatory information in the ECG and the EEG to model the directional information flows between the brain and heart activity. We found that higher emotional arousal was associated with lower HEP amplitudes in a left fronto-central electrode cluster. While parasympathetic modulation of the heart (HF-HRV) and parieto-occipital EEG alpha power were reduced during higher emotional arousal, there was no evidence for the hypothesized emotional arousal-related changes in bidirectional information flow between them. Whole-brain exploratory analyses in additional EEG (delta, theta, alpha, beta and gamma) and HRV (low-frequency, LF, and HF) frequency bands revealed a temporo-occipital cluster, in which higher emotional arousal was linked to decreased brain-to-heart (i.e., gamma→HF-HRV) and increased heart-to-brain (i.e., LF-HRV → gamma) information flow. Our results confirm previous findings from less naturalistic experiments and suggest a link between emotional arousal and brain-heart interactions in temporo-occipital gamma power.

Move, React, Repeat! The Role of Continuous Cues in Immersive Exergames

Immersive virtual reality (VR) exergames blend playful environments with physical activities. In such games, providing continuous cues, i.e., real-time indications of how the movements are being performed, can guide players and improve the execution of movements. However, research about how continuous cues impact player performance and experience in VR exergames remains sparse. To this end, we conducted a within-participants study (N=32) with four conditions: (i) no, (ii) audio, (iii) visual, and (iv) audiovisual cueing. The results show that both unimodal and bimodal cueing improve the player experience without causing cybersickness, while bimodal cueing improves pose accuracy. We provide three main design implications for VR exergames: (i) considering the granularity of cues, (ii) exploring different continuous cue designs, and (iii) underlining the use of continuous cues in other immersive experiences.

A comparative analysis of face and object perception in 2D laboratory and virtual reality settings: insights from induced oscillatory responses.

In psychophysiological research, the use of Virtual Reality (VR) for stimulus presentation allows for the investigation of how perceptual processing adapts to varying degrees of realism. Previous time-domain studies have shown that perceptual processing involves modality-specific neural mechanisms, as evidenced by distinct stimulus-locked components. Analyzing induced oscillations across different frequency bands can provide further insights into neural processes that are not strictly phase-locked to stimulus onset. This study uses a simple perceptual paradigm presenting images of faces and cars on both a standard 2D monitor and in an immersive VR environment. To investigate potential modality-dependent differences in attention, cognitive load, and task-related post-movement processing, the induced alpha, theta and beta band responses are compared between the two modalities. No evidence was found for differences in stimulus-dependent attention or task-related post-movement processing between the 2D conditions and the realistic virtual conditions in electrode space, as posterior alpha suppression and re-synchronization of centro-parietal beta did not differ between conditions. However, source analysis revealed differences in the attention networks engaged during 2D and 3D perception. Midfrontal theta was significantly stronger in laboratory conditions, indicating higher cognitive load than in the VR environment. Exploratory analysis of posterior theta showed stronger responses in VR, possibly reflecting the processing of depth information provided only by the 3D material. In addition, the theta response seems to be generated by distinct neuronal sources under realistic virtual conditions indicating enhanced involvement of semantic information processing and social cognition.

Unlocking the power of immersive learning: The FAIRI instructional design proposition for adaptive immersive virtual reality

Immersive Virtual Reality (IVR) is a promising tool for providing immersive and adaptive learning experiences by simulating realistic work environments and gathering data on learner's interactions to offer personalized instructional content. However, IVR-supported instruction presents unique challenges due to its heightened immersion, including managing the learner's cognitive load and self-regulation. Incorporating adaptivity into IVR can mitigate these challenges by regulating the complexity of the virtual environment, reducing cognitive strain, and maintaining learner focus through real-time feedback for both learners and instructors. However, recent reviews highlight the underutilization of adaptivity within IVR research, making it difficult to inform the design of adaptive IVR instruction.This paper proposes FAIRI, an instructional design for adaptive IVR in domain-specific training. FAIRI synthesizes recent IVR research relevant to the design of adaptivity for IVR through a purposive literature review, guided by the instructional design elements of the Four-Component Instructional Design-model (4C/ID) and Intelligent Tutoring Systems (ITS). The instructional design elements of the 4C/ID-model and ITS are evaluated for their potential viability and further refined for adaptive IVR-supported instruction based on recent IVR studies. Two key design principles are identified for adaptive IVR: limiting IVR to tasks that benefit from its heightened realism and leveraging its adaptive features to manage the intensity of the experience. Additionally, the application of FAIRI's design principles and elements are demonstrated through a forklift operator training case in IVR. FAIRI aims to catalyse further research into adaptivity for IVR by proposing and aligning promising instructional design elements for adaptive IVR instruction.

Multisensory Stimulation in Amyotrophic Lateral Sclerosis Disease: Case Report of an Innovative Proposal through Immersive Virtual Reality

Physical–cognitive stimulation has emerged as a promising strategy for improving the quality of life of patients with amyotrophic lateral sclerosis (ALS). This case study reports on the use of immersive virtual reality (IVR) as a tool for multisensory stimulation in a woman with ALS (76 years old; 11 years since diagnosis; stage 2). The program consisted of IVR stimulation sessions (three sessions per week for 12 weeks). The results showed that the implementation of the program was feasible and safe (no adverse symptoms on the Simulator Sickness Questionnaire), as well as easy to execute (&gt;80% on the System Usability Scale). Additionally, the participant reported improvements in aspects related to her mental health (44% depression and 20% anxiety) and improvements in her quality of life, and she also maintained her values in her functional capacity. This study presents novel and important findings by demonstrating the feasibility of implementing physical–cognitive stimulation programs with IVR in a person with ALS, allowing for multisensory stimulation with commercially available hardware and software and the generation of benefits in their health-related quality of life and mental health.

Exploring neural efficiency in spatial cognition: A comparative study of 3D visual stimuli in virtual reality across STEM and non-STEM fields

Spatial cognition plays a crucial role in our daily lives. The relationship between spatial abilities and mathematical performance is well-established, with visuospatial training offering significant benefits in academic STEM (Science, Technology, Engineering, and Mathematics) disciplines. Developing visuospatial training requires an objective evaluation of spatial cognition and consideration of various 3D displays. This study aims to compare the neural efficiency of STEM and non-STEM individuals during mental rotation tasks (MRT) in 3D and 2.5D conditions (pseudo 3D) using virtual reality (VR). For that, we propose a novel integrative assessment of spatial cognition by combining a cost-effective VR headset and functional near-infrared spectroscopy (fNIRS). Overall, the findings reveal that STEM individuals exhibit greater neural efficiency in the dorsolateral prefrontal cortex (PFC) while solving MRT in a VR environment compared to their non-STEM counterparts. Additionally, the study shows that there is no significant difference in performance between 3D and 2.5D stimuli, suggesting that both conditions are equally suitable for MRT in VR. One possible explanation is that immersive VR reduces the distinctions between 3D models and 2.5D images, considering MRT scores and PFC activity. This research underscores the practicality and relevance of using VR and fNIRS to evaluate visuospatial tasks and the potential to identify distinct student learning profiles and enhance spatial skills. Furthermore, it highlights the potential of 2.5D stimuli as a cost-effective alternative for learning applications in VR. Here, we demonstrated that modeling the same task in 3D and 2.5D conditions can compare how humans interact with visuospatial tests, providing insights into applying VR devices to develop spatial skills.

Experiences of People With Persistent Nonspecific Neck Pain Who Used Immersive Virtual Reality Serious Games in the Home Setting: A Qualitative Study.

The purpose of this study was to explore the experiences of individuals with persistent nonspecific neck pain who used immersive virtual reality (VR) serious games at home for 2weeks. In this descriptive qualitative study, semi-structured one-on-one interviews were conducted at the participant's home after the 2-week period. Interviews were analyzed using qualitative content analysis. Sample size was determined using the information power concept (where "information power" refers to the amount of relevant information the sample provides for addressing the research question). Eleven adults with continuous or recurrent nonspecific neck pain participated in the study. Three main categories were identified. The first revolves around the home environment, revealing that participants had mixed perceptions about being at home, yet held a positive perspective on the utilization of immersive VR in that setting. The second pertains to immersive VR as a novel technology, indicating its overall comfort, user-friendliness, and varying degrees of immersion and presence experienced by the participants. The third focuses on exercising in immersive VR, drawing comparisons with conventional exercises, exploring the facilitators and barriers to usage, and addressing various aspects of integrating this technology into rehabilitation. Immersive VR was deemed comfortable for almost all participants and easy to use. Participants found exercising in immersive VR motivating and enjoyable, compared to conventional exercises. The home environment proved suitable for using immersive VR, though challenges included autonomy and reduced human contact. Participants highlighted facilitators and barriers in using immersive VR serious games, as well as immersive VR's rehabilitation potential. They also underscored the crucial role of physical therapists for guidance, remote supervision, and personalized treatment. These findings could help clinicians to better understand the experiences of individuals with persistent nonspecific neck pain when using immersive VR, as well as its use at home. This understanding can improve patient care and optimize the effectiveness of immersive VR as a treatment method.