Virtual Reality Environment Research Articles

A scene with an invisible wall - navigational experience shapes visual scene representation.

Human navigation heavily relies on visual information. Although many previous studies have investigated how navigational information is inferred from visual features of scenes, little is understood about the impact of navigational experience on visual scene representation. In this study, we examined how navigational experience influences both the behavioral and neural responses to a visual scene. During training, participants navigated in the virtual reality (VR) environments which we manipulated navigational experience while holding the visual properties of scenes constant. Half of the environments allowed free navigation (navigable), while the other half featured an 'invisible wall' preventing the participants to continue forward even though the scene was visually navigable (non-navigable). During testing, participants viewed scene images from the VR environment while completing either a behavioral perceptual identification task (Experimentl) or an fMRI scan (Experiment2). Behaviorally, we found that participants judged a scene pair to be significantly more visually different if their prior navigational experience varied, even after accounting for visual similarities between the scene pairs. Neurally, multi-voxel pattern of the parahippocampal place area (PPA) distinguished visual scenes based on prior navigational experience alone. These results suggest that the human visual scene cortex represents information about navigability obtained through prior experience, beyond those computable from the visual properties of the scene. Taken together, these results suggest that scene representation is modulated by prior navigational experience to help us construct a functionally meaningful visual environment.

Objectifying subjective memory complaints: VR-based Verbal Word Learning Test in chronic stroke patients

Memory impairment imposes a great burden on stroke patients and can be divided into Objective Memory Problems (OMPs) and Subjective Memory Complaints (SMCs). Studies have shown that these do not always co-occur. Possibly, the gap between SMCs and OMPs can be bridged when using a more ecologically valid memory test and considering the impact of other common stroke symptoms such as sensory hypersensitivity (SHS) and fatigue. In the present study, we applied Virtual Reality (VR) to create a sensory-rich environment with real-life stimuli. Memory performance was tested with the 15-Verbal Word Learning Test (VLT). Furthermore, we assessed SMCs (Everyday Memory Questionnaire), and the levels of SHS (Multi-Modal Evaluation of Sensory Sensitivity) and fatigue in the previous month. 31 chronic stroke patients and 32 healthy controls participated. The results showed that participants’ memory performance decreased in a sensory-rich compared to a neutral environment. This decrease did not significantly differ between the groups. Interestingly, fatigue and SHS are related to the level of SMC in stroke patients but no such evidence was found in healthy controls. Last, for stroke patients, we found a significant negative correlation between SMCs and memory performance in a sensory-rich environment, but not in a neutral environment. In conclusion, our study implicates that in stroke patients, fatigue and SHS are related to SMCs and that using a sensory-rich VR environment might be a more ecologically valid way to objectify SMCs. However, interpretative caution is warranted due to the absence of sex and age-matched controls and potential selection bias.

Beyond sight: Comparing traditional virtual reality and immersive multi-sensory environments in stress reduction of university students

IntroductionThis study aims to assess the efficacy of traditional virtual reality (VR) and Immersive Multi-sensory Environments (IME) in mitigating anxiety levels among university students. The study can address the following research questions: 1) What disparities exist in anxiety levels before and after exposure to traditional VR and IME? 2) How do anxiety levels compare between participants exposed to IME and those in a VR environment?MethodsThe research adopted a twophase approach involving participants exhibiting moderate to high-stress levels. In the second phase, participants were randomly assigned to either a VR group (solely visual stimulation) or an IME group (comprising visual, auditory, and olfactory stimuli). The State-Trait Anxiety Inventory (STAI) were utilized to assess stress and anxiety levels before and after each experiment.ResultsThe findings suggest that participants’ experiences in both VR and IME environments effectively contributed to reducing anxiety levels and fostering a tranquil atmosphere. Both experimental groups reported a significantly heightened sense of relaxation post-experiments. Although the disparity was not statistically significant, the IME group displayed a more pronounced reduction in stress levels compared to the VR group.DiscussionThe research underscores the significance of considering the built environment and sensory design in addressing mental health challenges among college students. Further exploration and integration of such approaches into educational settings could significantly contribute to establishing more supportive and conducive environments for student success.

Safety and Privacy in Immersive Extended Reality: An Analysis and Policy Recommendations

Extended reality (XR) technologies have experienced cycles of development—“summers” and “winters”—for decades, but their overall trajectory is one of increasing uptake. In recent years, immersive extended reality (IXR) applications, a kind of XR that encompasses immersive virtual reality (VR) and augmented reality (AR) environments, have become especially prevalent. The European Union (EU) is exploring regulating this type of technology, and this article seeks to support this endeavor. It outlines safety and privacy harms associated with IXR, analyzes to what extent the existing EU framework for digital governance—including the General Data Protection Regulation, Product Safety Legislation, ePrivacy Directive, Digital Markets Act, Digital Services Act, and AI Act—addresses these harms, and offers some recommendations to EU legislators on how to fill regulatory gaps and improve current approaches to the governance of IXR.

Utilization of Virtual Reality (VR) in Developing Interactive Learning Experiences

The development of Virtual Reality (VR) technology has opened up new opportunities for creating more immersive and interactive learning experiences. With its ability to simulate realistic virtual environments, Virtual Reality has the potential to increase student engagement in the learning process, aid understanding of complex concepts, and promote active learning. This research aims to explore the use of Virtual Reality technology in developing interactive learning experiences. The main focus is evaluating the effectiveness of Virtual Reality in increasing student motivation, engagement and learning outcomes, as well as identifying supporting factors and challenges in implementing Virtual Reality in educational environments. This research uses a combination of qualitative and quantitative approaches. Data was collected through observation, interviews, surveys and analysis of student performance in a Virtual Reality-based learning environment. A prototype Virtual Reality application for learning was built and tested on a group of students with diverse backgrounds. The research results show that the use of Virtual Reality in the learning environment significantly increases student motivation and engagement. Students feel more interested and involved in the learning process due to the immersive and interactive nature of the virtual environment. Additionally, understanding complex concepts becomes easier with the visualizations and simulations provided by Virtual Reality. However, challenges such as implementation costs, training needs, and technical issues were also identified. The research conclusion states that Virtual Reality is a promising technology for developing interactive learning experiences. Although there are challenges that must be overcome, research results show that Virtual Reality can increase student motivation, engagement and understanding in the learning process. Further research is needed to explore the potential of Virtual Reality in more depth.

Echo-aware room impulse response generation.

In real-time applications, like interactive virtual reality environments, there is a significant need for low-complexity simulation of room impulse responses in highly complex virtual scenes, but this remains a challenging issue. In particular, simulating late reverberation using physically based acoustic modeling requires much computational effort, contrary to the early reflections that can be modeled by simpler techniques, e.g., the image source method. To tackle this computational complexity issue, we propose a neural network-based hybrid artificial reverberation framework (Echo2Reverb) that generates late reverberation from given early reflections. The proposed model can control both temporal texture and frequency-dependent energy decay, i.e., echo density and spectral energy distribution, of the generated reverberations by extracting spectral and echo-related features and filtering sampled sparse sequences and Gaussian noises using estimated features. To support the end-to-end training with controlled echo density, a differentiable approximation of the normalized echo density profile is proposed. We train and test the model not only for nearly diffuse but also distinct echoes prominent in late reverberations, such as with flutter echoes in narrow corridors. Evaluation results demonstrate that the proposed model can accurately reproduce frequency-dependent energy decay and temporal texture of a room impulse response using only early reflections.

Integration of Virtual Reality (VR) and Artificial Intelligence (AI) in Autism Therapy

This concept note explores the integration of Virtual Reality (VR) and Artificial Intelligence (AI) in autism therapy, aiming to enhance therapeutic outcomes for children with autism spectrum disorder (ASD). VR provides immersive, controlled environments for practicing social, cognitive, and motor skills, while AI offers personalized, adaptive learning experiences and real-time feedback. The synergy of these technologies promises innovative, effective interventions that cater to the unique needs of each child. This project proposes the development and evaluation of a VR-AI therapy platform, focusing on improving social interaction, communication, and daily living skills among young children with autism. The integration of Virtual Reality (VR) and Artificial Intelligence (AI) into autism therapy offers a transformative approach to enhancing treatment effectiveness and accessibility. Autism Spectrum Disorder (ASD) presents unique challenges in social interaction, communication, and behavior, requiring tailored therapeutic interventions. VR provides immersive environments where individuals with ASD can safely practice social scenarios, sensory processing, and daily living skills. AI, particularly through machine learning algorithms, can personalize these virtual experiences by adapting to the user's progress and specific needs, offering real-time feedback and data-driven insights for therapists. This concept note explores the synergistic potential of combining VR and AI in autism therapy. VR environments can be meticulously controlled and replicated, allowing for consistent therapeutic sessions. AI can analyze user interactions within these environments, providing granular data to refine treatment plans. The integration aims to make therapy more engaging, individualized, and scalable. This approach not only enhances the effectiveness of traditional therapies but also addresses limitations such as therapist availability and the need for generalized settings. Furthermore, this technology-driven paradigm can democratize access to high-quality autism therapy, particularly in underserved regions. The proposed integration of VR and AI heralds a new era in autism therapy, promising improved outcomes and greater inclusivity.

Issues, Challenges, and Solutions in Data Acquisition in Virtual and Augmented Reality Environments

Issues, Challenges, and Solutions in Data Acquisition in Virtual and Augmented Reality Environments

Validation of the ViGaTu Immersive Virtual Reality Endoscopy Training System for Physicians and Nurses.

Endoscopy simulators are primarily designed to provide training in interventions performed during procedures. Peri-interventional tasks such as checking patient data, filling out forms for team time-out, patient monitoring, and performing sedation are often not covered. This study assesses the face, content, and construct validity of the ViGaTu (Virtual Gastro Tutor) immersive virtual reality (VR) simulator in teaching these skills. 71 nurses and physicians were invited to take part in VR training. The participants experienced an immersive VR simulation of an endoscopy procedure, including setting up the endoscopic devices, checking sign-in and team time-out forms, placing monitoring devices, and performing sedation. The actions performed by the participants and their timing were continuously recorded. Face and content validity, as well as the System Usability Scale (SUS), were then assessed. 43 physicians and 28 nurses from 43 centers took a mean of 27.8 min (standard deviation ± 14.42 min) to complete the simulation. Seventy-five percent of the items for assessing face validity were rated as realistic, and 60% of items assessing content validity and usefulness of the simulation for different learning goals were rated as useful by the participants (four out of five on a Likert scale). The SUS score was 70, demonstrating a high degree of usability. With regard to construct validity, experienced endoscopy staff were significantly faster in setting up the endoscope tower and instruments than beginners. This multicenter study presents a new type of interdisciplinary endoscopy training system featuring peri-interventional tasks and sedation in an immersive VR environment.

A Review of Olfactory Display Designs for Virtual Reality Environments

The field of Virtual Reality continues to evolve to provide an ever-greater sense of immersion to the user. However, VR experiences are still primarily constrained through the human senses of vision and audition, with some interest in haptic (mainly vibrotactile) applications. Only recently have olfactory displays—technologies that generate and deliver scent stimuli—been examined to provide the sense of smell to the human olfactory organ in virtual environments. This article presents a classification and review of olfactory-enhanced virtual reality systems, particularly those that deployed a Head-mounted Display or Cave Automatic Virtual Environment system. In addition, the article provides a discussion of the various technological and design challenges for developing an olfactory display suitable for enhancing virtual reality experiences. Finally, the article proposes future perspectives on the field and includes a table summarizing the characteristics and features of the reviewed systems.

Do Virtual Reality Relaxation Experiences Alleviate Stress in Parents of Children with Autism? A Pilot Study

Psychotherapeutic interventions such as cognitive training and psychoeducation tend to be effective for alleviating stress in caregivers of children with autism. However, these interventions are often time consuming and take place outside the home, posing challenges for accessibility. Technology, especially virtual reality (VR) technology, can be used to support a range of digital interventions at home. VR headsets, when used to simulate relaxing experiences, have already been linked with stress relieving effects for some caregiving groups. This study builds on this, exploring whether VR simulated relaxing environments engender positive psychological changes for caregivers of children with autism. A total of 18 caregivers were exposed to VR simulated natural environments (e.g., beach, forest) for 15 min in a single session. State mood, captured with POMS, was measured at baseline and immediately post intervention. Perceived stress (PSS) was captured at baseline and, to explore intervention effectiveness, at three- and seven-days post intervention. POMS scores for tension, anger, depression, fatigue and confusion were lower, and scores for vigour higher, immediately post intervention. PSS scores at three-and seven-days post intervention, while comparable with one another, were lower compared with baseline. Interacting with simulated natural environments in VR seems effective for improving caregivers’ state mood and reducing their perceived stress for up to seven days. Future research should aim to consolidate and expand on these findings with larger samples and longer follow up periods.

Unlocking the Puzzle: Investigating Problem-Solving Patterns in 2D and 3D Virtual Reality Environments Through Mixed Methods Analysis

This research investigates the intricate relationship between problem-solving patterns and various factors, including demographics, cognitive style, learning styles, puzzle completion, and emotional and behavioral responses in the context of 2D and 3D virtual reality (VR) puzzle-solving tasks. The study employed an explanatory sequential mixed methods design, where data were collected from 52 participants who voluntarily engaged in puzzle-solving activities in a VR environment. The first phase involved collecting quantitative data to determine the cognitive and learning styles of the participants. The second phase involved gathering qualitative data, including observations, audio, video, and screen recordings during puzzle-solving tasks. Findings revealed profound associations between problem-solving patterns and gender, education level, dominant hand, and previous VR experience. Notably, females tended to analyze puzzle pieces more thoroughly, and participants with higher education levels exhibited more remarkable analytical tendencies. The cognitive style also influenced problem-solving patterns for using two hands with a controller. Puzzle completion times were correlated with systematic/random arrangement, starting with big puzzle pieces and 3D localization skills. Emotional and behavioral responses were linked to problem-solving patterns, with systematic placement associated with lower negative emotions and higher joy, while random arrangement led to more negative emotions.

Attentional Bias, Pupillometry, and Spontaneous Blink Rate: Eye Characteristic Assessment Within a Translatable Nicotine Cue Virtual Reality Paradigm.

Incentive salience processes are important for the development and maintenance of addiction. Eye characteristics such as gaze fixation time, pupil diameter, and spontaneous eyeblink rate (EBR) are theorized to reflect incentive salience and may serve as useful biomarkers. However, conventional cue exposure paradigms have limitations that may impede accurate assessment of these markers. This study sought to evaluate the validity of these eye-tracking metrics as indicators of incentive salience within a virtual reality (VR) environment replicating real-world situations of nicotine and tobacco product (NTP) use. NTP users from the community were recruited and grouped by NTP use patterns: nondaily (n=33) and daily (n=75) use. Participants underwent the NTP cue VR paradigm and completed measures of nicotine craving, NTP use history, and VR-related assessments. Eye-gaze fixation time (attentional bias) and pupillometry in response to NTP versus control cues and EBR during the active and neutral VR scenes were recorded and analyzed using ANOVA and analysis of covariance models. Greater subjective craving, as measured by the Tobacco Craving Questionnaire-Short Form, following active versus neutral scenes was observed (F1,106=47.95; P<.001). Greater mean eye-gaze fixation time (F1,106=48.34; P<.001) and pupil diameter (F1,102=5.99; P=.02) in response to NTP versus control cues were also detected. Evidence of NTP use group effects was observed in fixation time and pupillometry analyses, as well as correlations between these metrics, NTP use history, and nicotine craving. No significant associations were observed with EBR. This study provides additional evidence for attentional bias, as measured via eye-gaze fixation time, and pupillometry as useful biomarkers of incentive salience, and partially supports theories suggesting that incentive salience diminishes as nicotine dependence severity increases.

Enabling personalized VR experiences: a framework for real-time adaptation and recommendations in VR environments

The personalization of user experiences through recommendation systems has been extensively explored in Internet applications, but this has yet to be fully addressed in Virtual Reality (VR) environments. The complexity of managing geometric 3D data, computational load, and natural interactions poses significant challenges in real-time adaptation in these immersive experiences. However, tailoring VR environments to individual user needs and interests holds promise for enhancing user experiences. In this paper, we present Virtual Reality Environment Adaptation through Recommendations (VR-EAR), a framework designed to address this challenge. VR-EAR employs customizable object metadata and a hybrid recommendation system modeling implicit user feedback in VR environments. We utilize VR optimization techniques to ensure efficient performance. To evaluate our framework, we designed a virtual store where product locations dynamically adjust based on user interactions. Our results demonstrate the effectiveness of VR-EAR in adapting and personalizing VR environments in real time. domains.

A gamified virtual environment intervention for gait rehabilitation in Parkinson’s Disease: co-creation and feasibility study

BackgroundTreadmill gait training has been shown to improve gait performance in People with Parkinson’s Disease (PwPD), and in combination with Virtual Reality, it can be an effective tool for gait rehabilitation. The addition of gamification elements can create a more stimulating and adherent intervention. However, implementation of new technologies in healthcare can be challenging. This study aimed to develop and evaluate the feasibility of a treadmill rehabilitation program in a Gamified Virtual Reality Environment (GVRE) for PwPD.MethodsThe GVRE was developed following a user-centered design approach, involving both PwPD and physiotherapists in the development and evaluation of the intervention. The intervention consisted of a walking simulation in three different environments (countryside, city, and park), which had a progressive increase in difficulty. To test its feasibility, three sessions were carried out with four PwPD and four physiotherapists. To assess the usability, the System Usability Scale (SUS), Assistive Technology Usability Questionnaire for people with Neurological diseases (NATU Quest) and Simulator Sickness Questionnaire (SSQ) were used. To assess the intervention’s acceptability, feedback and in-game performance was collected from participants.ResultsResults showed the feasibility of the intervention, with a SUS score of 74.82 ± 12.62, and a NATU Quest score of 4.49 ± 0.62, and positive acceptability feedback. Participants showed clear preferences for naturalistic environments, and gamification elements were seen as positive. Difficulty settings worked as intended, but lowered enjoyment of the experience in some cases.ConclusionsThis intervention was successfully shown as a feasible option for the training of gait under Dual Task conditions for PwPD. It offers a safe and replicable environment in which complex situations can be trained. However, further iterations of the intervention need to be improved in order to guarantee accurate tracking and a more realistic training progression.Trial registration numberNCT05243394–01/20/2022.

How Learners’ Visuospatial Ability and Different Ways of Changing the Perspective Influence Learning About Movements in Desktop and Immersive Virtual Reality Environments

Virtual reality (VR) applications are developing rapidly, becoming more and more affordable, and offer various advantages for learning contexts. Dynamic visualizations are generally suitable for depicting continuous processes (e.g., different movement patterns), and particularly dynamic virtual 3D-objects can provide different perspectives on the movements. The present study investigated through a low immersive (desktop “VR”, Study 1) and a high immersive virtual environment (immersive VR; Study 2) the effectiveness of different interaction formats to view 3D-objects from different perspectives. Participants controlled either the orientation of the 3D-objects (Study 1, mouse interaction; Study 2, hand interaction via VR controllers) or their viewpoint in relation to the 3D-objects (Study 1, camera position; Study 2, position of participants’ own body). Additionally, the moderating influence of learners’ visuospatial ability was addressed. Dependent variables were pictorial recognition (easy, medium, difficult), factual knowledge, presence, and motion sickness. Results showed that higher-visuospatial-ability learners outperformed lower-visuospatial-ability learners. In Study 1, higher-visuospatial-ability learners showed higher recognition performance (difficult items) by controlling the camera position, whereas lower-visuospatial-ability learners suffered from this interaction format. In Study 2, higher-visuospatial-ability learners achieved better recognition performance (easy items) by controlling the 3D-models, whereas lower-visuospatial-ability learners tended to profit from moving around the 3D-objects (medium items). The immersive VR yielded more presence and higher motion sickness. This study clearly shows that different interaction formats to view 3D-objects from multiple perspectives in Desktop-VR are not transferable on a one-to-one basis into immersive VR. The results and implications for the design of virtual learning environments are discussed.

Experience of intelligent speech robot in music online classroom based on deep learning and virtual reality

This study designs and implements an intelligent voice robot music online classroom teaching platform, providing students with a more personalized and interactive learning experience. Research the application of deep learning technology to establish a speech recognition model for music teaching, achieving accurate recognition and understanding of student speech; Combining speech recognition technology and robot interaction technology, construct an intelligent speech robot teaching platform to achieve interactive speech learning; Finally, utilizing virtual reality technology to create an immersive music teaching environment, enhancing students’ sense of participation and learning effectiveness. Through research and analysis of the needs of students and teachers, the functions and characteristics of the intelligent voice robot music online classroom teaching platform have been determined. We have established a comprehensive platform architecture and implemented functional modules such as speech recognition, virtual reality environment construction, and teaching resource management. Designed diverse interactive teaching and learning modes, enhancing the fun and effectiveness of learning. This study successfully designed and implemented an intelligent voice robot music online classroom teaching platform based on deep learning and virtual reality, injecting new vitality and possibilities into music teaching.

A Virtual Reality Environment Based on Infrared Thermography for the Detection of Multiple Faults in Kinematic Chains

Kinematic chains are crucial in numerous industrial settings, playing a key role in various processes. Over recent years, several methods have been developed to monitor and maintain these systems effectively. One notable method is the analysis of infrared thermal images, which serves as a non-invasive and effective approach for identifying various electromechanical issues. Additionally, Virtual Reality (VR) is a burgeoning technology that, despite its limited use in industrial contexts, offers a cost-effective and accessible solution for the training and education of industrial workers on specialized engineering subjects. Nevertheless, most virtual environments are based on numerical simulations. This paper presents the design and development of a Virtual Reality training module for the detection of fourteen electromechanical fault cases in a kinematic chain. The VR training tool developed is based on actual thermographic data derived from experiments conducted on an authentic kinematic chain. During these experiments, thermal images were captured using an low-cost infrared sensor. The thermographic images were processed by calculating the histogram and fifteen statistical indicators, which served to differentiate fault cases in the VR application. A comprehensive evaluation was carried out with a group of vocational students specialized in electrical and automation installations to determine the effectiveness and practicality of the VR training module.

Use of Mixed Reality in Attachment of Surgical Site Measurement Robot to Surgical Bed

Recently, we have observed that the digital potential function defined by the difference between the real and virtual organ depth images is globally stable where the real and virtual livers coincide. This globality is then used to overlay the real and virtual livers. In this study, we consider the installation of a robotic mechanical system for measuring the depth images of real organs in the surgical bed. In general, virtual organs measured by CT or MRI show the position and posture of blood vessel groups and malignant tumors, and if these can be presented to the physician during surgery, he or she can operate while confirming their positions in real time. Although this robotic mechanical system is designed such that the camera can be raised or lowered as necessary to avoid interfering with the movement of the doctor, assistant, or nurse during surgery, it may still shift owing to contact with the hands or head of the doctor or nurse. In this study, an experiment was conducted in which a surgical measurement robotic mechanical system was constructed in a VR environment, and an actual robot was installed using this as a model. In the experiment, a video image of a virtual object was superimposed on that of a real object to confirm whether the surgical robotic mechanical system was able to accurately measure the surgical site.

Utilizing Metaverse Technology for the Preservation of Indigenous Houses in Southeast Sulawesi: A Study of Bajo, Tolaki, Muna, and Buton Cultural Heritage

Abstract - Southeast Sulawesi, as one of the Provinces in Indonesia, has cultural artifacts that serve as diverse reflections of its culture and need to be preserved to ensure their continuity for future generations. There are four major indigenous ethnic groups in Southeast Sulawesi, namely Tolaki, Muna, Buton, Moronene, and Bajo, which represent the cultural diversity of the region. These ethnic groups have traditional houses that serve as cultural hubs, preserving cultural values and acting as iconic representations of the local culture in Southeast Sulawesi. The development of metaverse technology, a tangible proof of recent technological advancements, is known for its ability to create spatial environments in virtual reality. The urgency of this research arises from the lack of community interest in traditional houses, as evidenced by the eclectic and minimalist architectural designs, as well as the threat of extinction faced by traditional houses in Southeast Sulawesi. This study aims to preserve traditional houses in Southeast Sulawesi by integrating them with metaverse technology, enabling the transmission of cultural values to future generations. The research will employ a qualitative descriptive method. Additionally, this research aims to fill the gaps in previous studies by introducing metaverse technology as a groundbreaking innovation in addressing the threat of cultural artifact extinction in Southeast Sulawesi province. Keywords : Metaverse, Artifact, Preserving, Architectural.