Immersive VR Research Articles

You look so young, you look so cute. The relationship between physical appearance, age and mental abilities in social robots

ABSTRACT The study analyses differences in the perceived age, cuteness and mental abilities of robots displayed as 3D models in a VR setting, manipulating anthropomorphic variables such as height, head dimension, and limb length. Participants (N = 122) were randomly assigned to one of four experimental conditions where they interacted with a robot with a different combination of physical dimensions. The interactions took place in a CAVE – an immersive VR room, which allowed participants to directly perceive the dimensions of the robot. In the CAVE we collected from participants impressions about the robot using Likert scales and numeric input. After the interaction, they had to fill in a post-test questionnaire measuring their tendency to anthropomorphism, literacy about Artificial Intelligence, and sensitivity to cute stimuli. Results show that changes in the physical appearance of the robots affect the perception of their age. A small robot with an increased head-to-body ratio is also perceived to be cuter, and the tendency towards anthropomorphism is related to higher perceived levels of experience in the robot. Results thus may be considered relevant when developing robots for specific functions, such as serving adults or children activities, studies, or work.

Effects of Stereoscopic Representations in Sublime Experiences Induced by Immersive VR

Effects of Stereoscopic Representations in Sublime Experiences Induced by Immersive VR

The role of sensory experiences in evoking emotional responses in virtual reality

Abstract This study investigates the impact of multisensory stimuli—visual, auditory, tactile, and olfactory—on emotional responses in virtual reality, with a specific focus on trust and disgust. Drawing upon Plutchik’s Wheel of Emotions, this research explores how sensory modalities evoke distinct emotional reactions within a VR simulation of a spiritual experience. Eighteen participants, all with prior experience of a similar physical ritual, were immersed in a detailed virtual environment designed with high visual fidelity and a combination of physical and olfactory stimuli to replicate the spiritual setting. The study analyzed how different sensory inputs contribute to emotional engagement. Results indicated that visual and tactile stimuli significantly enhanced trust, while olfactory inputs were associated with feelings of disgust. Furthermore, multisensory integration, particularly between tactile and olfactory cues, played a pivotal role in shaping emotional intensity. This approach offers a deeper understanding of how specific sensory inputs shape emotional responses, providing valuable insights for creating emotionally immersive and authentic VR experiences, especially in culturally and spiritually significant contexts. A key contribution of this research lies in its development of a more refined method for measuring emotional responses, moving beyond the traditional focus on presence and immersion to capture the subtle emotional effects of multisensory stimuli.

Blended origo — Deixis in virtual reality

Abstract Studies on communication in Social Virtual Reality (SVR) have shown that the immersive qualities of VR — the sense of presence, and a sense of embodiment through increasingly realistic motion tracking and avatars — have an impact on verbal communicative interactions in the new medium. Misunderstandings and moments of linguistic creativity are observable, and many of them revolve around ambivalent locations, doubled ‘bodies’, and issues while coordinating attention, i.e.: they concern deixis. This paper presents the results of a qualitative analysis of deictic terms in verbal interactions in SVR. It demonstrates that the unusual communicative circumstances in immersive VR directly affect a speaker’s origo, the deictic zero-point of orientation in space and time. This paper concludes that the term blended origo may serve as an analytical concept to understand deixis while SVR users communicatively interact in two ‘realities’ simultaneously.

Development and Evaluation of a Haptic Virtual Walker for Wheelchair Users in Immersive VR Environments

This paper presents the development of a virtual walker for wheelchair users designed for use in highly immersive environments, such as Cave Automatic Virtual Environments (CAVEs). The system allows users to navigate virtual environments using their natural wheelchair movements, providing haptic feedback based on the terrain they traverse. Both the control software and hardware have been developed from scratch and integrated into various CAVEs, including one with a six-degree-of-freedom (DOF) motion platform. To test the system, a comparative study was conducted with 21 users, measuring the time taken to complete the same course using different interaction methods and various feedback configurations with the virtual environment. The results show that the shortest times were achieved when users navigated using their natural interaction with their wheelchairs.

VRx@Home protocol: A virtual reality at-home intervention for persons living with dementia and their care partners

IntroductionVirtual reality (VR) technology is increasingly used by researchers and healthcare professionals as a therapeutic intervention to improve the quality of life of persons living with dementia (PLwD). However, most...

A new approach for creating and testing safety components integrated into a robotic cell simulation scenario in a virtual reality environment

Abstract This research paper focuses on novel approaches for testing and debugging various simulation scenarios within robotic workplaces with the integration of various safety components, mainly in the pre-production phase and design of such workplaces. Nowadays, safety components are an integral part of every robotic workplace. Not only legislation but also workplace safety regulates that every single robotic workplace must be equipped with safety components. These components and the implementation of such a robotic workplace represent a significant financial investment. It is the testing of safety components such as safety barriers, traffic lights, central stop button, laser scanner for robotic systems that are very expensive components that significantly increase the overall price of the robotic workplace. It is the possibility of integrating these safety components within a simulation scenario in the ABB RobotStudio software environment and its direct interaction into the immersive VR environment that gives a very good scope for research and deployment of these safety components for robotic systems in order to eliminate the initial financial costs and save overall time in the design phase of new robotic systems with planed integration of the safety components.

Structural Coupling System for Cognitive Modeling in Immersive VR Assessment Tasks

Unilateral spatial neglect (USN) is a disorder characterized by the inability to attend to the space opposite the cerebral hemisphere lesion, significantly hindering daily activities. Due to the complex neural circuitry of the brain, understanding the mechanisms of USN has proven challenging. In clinical settings, the Behavioral Inattention Test (BIT), a paper-based examination, is commonly used to assess USN. However, improved scores on this test do not necessarily guarantee functional improvement, as it solely evaluates performance in a two-dimensional space. To address this limitation, various approaches utilizing information and communication technology (ICT) and measurement devices in rehabilitation engineering have been proposed. However, related studies have focused on analyzing motor responses to specific sensory stimuli, and the assessment measures often fail to capture a patient’s symptoms in dynamic environments. Therefore, this study proposes a methodology for modeling human spatial cognition. This cognitive architecture utilizes a structural coupling system that integrates parameters from multiple computational intelligence subsystems. In this study, we constructed a simulation environment capable of replicating the movements of patients with USN using empirical data collected from actual experiments. Furthermore, in this simulation environment, we developed patient agents that incorporated the proposed cognitive architecture. The experimental results suggest that hypothesis testing concerning attention mechanisms can be applied through the performance of patient agents within the simulation environment.

Immersive Virtual Reality: A Novel Approach to Second Language Vocabulary Acquisition in K-12 Education.

Today, immersive virtual reality (IVR) is increasing in popularity in a broad range of fields, including science, pedagogy, engineering and so forth. Therefore, this study discusses the Unified Theory of Acceptance and Use of Technology (UTAUT), which can be used to examine the factors that influence the adoption of immersive VR in the classroom, particularly in second language (L2) vocabulary acquisition. The sample for this study included 32 intermediate students and their teacher. For the purpose of evaluation, the researcher used partial least squares structural equation modelling (PLS-SEM) techniques to analyze the results. The findings of the students' survey showed that performance expectancy, effort expectancy and social influence were seen to have had a positive impact on the intention to use immersive VR. Likewise, the findings indicated that facilitating conditions were seen to have had a positive impact on the use behavior of actually using immersive VR, whereas behavioral intentions did not. In addition, the teacher's survey demonstrated a favorable view regarding the potential of immersive VR technology to support teaching L2 vocabulary acquisition. This particular study encouraged educators and educational technologists to utilize immersive VR games as a teaching-learning tool to reduce the challenge of L2 vocabulary acquisition.

Virtual reality-based retrospective think aloud (VR-RTA): a novel method for studying offender decision-making

ObjectivesThis article describes and tests a novel multi-method approach to examine decision-making: Virtual Reality-Based Retrospective Think-Aloud (VR-RTA). The VR-RTA method taps into the offender perspective and aims to enhance memory recall and information elicitation.MethodsWe applied VR-RTA among a sample of incarcerated burglars (N = 200) who scouted virtual neighborhoods to explore opportunities for burglary in immersive VR equipped with integrated eye tracking. Subsequently, they viewed a screen recording of their scouting process and simultaneously “thought aloud” about their assessment of the environment and decision-making strategies. Emerging themes were then further examined in an interview and linked to survey data. Recorded eye tracking data were used to examine burglars’ attention towards environmental features to identify deterrent and attracting cues, and were triangulated with the survey and interview data.ResultsRich and detailed insights into participants’ interpretation of the environment and their decision-making strategies were obtained. VR-RTA assisted in verbalizing automated cognitive processes and increased participant engagement by building rapport.ConclusionsAs a multi-method approach able to capture in-the-moment considerations underlying decision-making during crime commission, VR-RTA offers potential to develop into an important tool for crime research. It is able to both overcome limitations of studies using retrospective methods, such as interviews and surveys, and contribute to the nascent field of criminological research using immersive technologies.

Impact of Heat Stress on Individual Cognitive States: Utilizing EEG Metrics in Immersive VR–Based Construction Safety Training

Impact of Heat Stress on Individual Cognitive States: Utilizing EEG Metrics in Immersive VR–Based Construction Safety Training

Rehabilitation exoskeleton system with bidirectional virtual reality feedback training strategy

AbstractVirtual reality (VR) technology revitalises rehabilitation training by creating rich, interactive virtual rehabilitation scenes and tasks that deeply engage patients. Robotics with immersive VR environments have the potential to significantly enhance the sense of immersion for patients during training. This paper proposes a rehabilitation robot system. The system integrates a VR environment, the exoskeleton entity, and research on rehabilitation assessment metrics derived from surface electromyographic signal (sEMG). Employing more realistic and engaging virtual stimuli, this method guides patients to actively participate, thereby enhancing the effectiveness of neural connection reconstruction—an essential aspect of rehabilitation. Furthermore, this study introduces a muscle activation model that merges linear and non‐linear states of muscle, avoiding the impact of non‐linear shape factors on model accuracy present in traditional models. A muscle strength assessment model based on optimised generalised regression (WOA‐GRNN) is also proposed, with a root mean square error of 0.017,347 and a mean absolute percentage error of 1.2461%, serving as critical assessment indicators for the effectiveness of rehabilitation. Finally, the system is preliminarily applied in human movement experiments, validating the practicality and potential effectiveness of VR‐centred rehabilitation strategies in medical recovery.

Afrofuturist Values for the Metaverse (Extended Abstract)

Many emerging technologies, such as the immersive VR and AR devices forming the metaverse, are not just reminiscent of but inspired by devices found in popular science fiction texts. Yet, the stories that these technologies are drawn from do not often center marginalized communities and people of color. In this article, we propose that builders and users of these technologies turn to diverse creative texts as inspiration for the ethical codes that will shape the ways that these technologies are built and used. A study of 39 speculative fiction texts, including 20 that we identified as Afrofuturist, revealed three overarching themes that serve as recommendations for the creation and maintenance of a diverse and inclusive metaverse: Collective Power, Inclusive Engagement, and Cultural Specificity. We outline each recommendation through a textual analysis of three Afrofuturist texts – Esi Edugyan’s Washington Black (2018), Roger Ross Williams’ Traveling While Black (2019), and Ryan Coogler’s Black Panther (2018) – and specify the undercurrents of collectivity and co-production that bind them together. We suggest collaborative and critical reading methods for industry professionals and community members which may help to shape democratic processes governing the future of AI.

Changing Climate Change Mental Models Through Game-Based Learning: A Controlled Experiment Involving Cognitive Mapping

Climate change is one of humankind's grand challenges, and how we think about it influences how we perceive its risks and act. Understanding people's mental models of climate change (that is, how they internally represent it) and potentially challenging and changing them can be a fruitful avenue towards engagement. However, our understanding of how games can affect climate change mental models is limited, especially in the lack of control conditions with comparable content. In this experiment, participants created cognitive maps of climate change before and after experiencing an immersive VR game, a desktop PC game, or a text with graphs. We show that all conditions improved the quality, focus, and systems orientation of cognitive maps, but no significant differences were found between groups. The intervention effectively increased the salience of issues such as health and biodiversity impacts, even though changes were limited in scope. The game was on average more enjoyable than the text, with the VR version significantly more so than the other two conditions. The findings suggest that games can be a viable and attractive communication and learning method where engagement is a struggle. We provide avenues for future research and, especially, game design in this area.

TCT-297 Visuamed: Revolutionizing Surgical and Interventional Planning With Immersive VR

TCT-297 Visuamed: Revolutionizing Surgical and Interventional Planning With Immersive VR

Application of BIM and Virtual Reality of System Integration Design and Development in Medical Building Projects: A Case Study in China

Design outcomes in the Medical Building Projects (MBPs) must satisfy the demand of the medical staff and stakeholders. However, they often do not have the relevant engineering expertise, so the design team is prone to misunderstandings when communicating with them using traditional two-dimensional (2D) Computer-Aided Design (CAD) drawings. The medical staff may not readily visualize and understand the design and then provide feedback to the designer through professional medical requirements or advice, which results in the need to redesign and carry out additional work during the design phase, thus delaying the progress of the MBPs. To address these challenges, this study aims to develop an integrated system based on BIM, advanced rendering engines, and VR technology for use in non-immersive and immersive VR environments. Moreover, in this study, the integrated system was applied to the infection-building project of the People's Hospital of Qingbaijiang District, Chengdu City, and semi-structured interviews were distributed to 16 engineers, designers, contractors, and medical staff who had been involved in the whole project to validate the practicality and effectiveness of the integrated system. The results indicate that this system integration is an efficient visual communication and simulation tool in medical design. Key advantages include enhanced communication efficiency between the design team and medical stakeholders, improved visual interaction, and streamlined decision-making processes within a 3D VR/BIM environment. The successful implementation of this integrated system is expected to significantly aid design teams and stakeholders in effectively managing medical design tasks in future projects.

Enhancing educational experience through establishing a VR database in craniosynostosis: report from a single institute and systematic literature review.

Craniosynostosis is a type of skull deformity caused by premature ossification of cranial sutures in children. Given its variability and anatomical complexity, three-dimensional visualization is crucial for effective teaching and understanding. We developed a VR database with 3D models to depict these deformities and evaluated its impact on teaching efficiency, motivation, and memorability. We included all craniosynostosis cases with preoperative CT imaging treated at our institution from 2012 to 2022. Preoperative CT scans were imported into SpectoVR using a transfer function to visualize bony structures. Measurements, sub-segmentation, and anatomical teaching were performed in a fully immersive 3D VR experience using a headset. Teaching sessions were conducted in group settings where students and medical personnel explored and discussed the 3D models together, guided by a host. Participants' experiences were evaluated with a questionnaire assessing understanding, memorization, and motivation on a scale from 1 (poor) to 5 (outstanding). The questionnaire showed high satisfaction scores (mean 4.49 ± 0.25). Participants (n = 17) found the VR models comprehensible and navigable (mean 4.47 ± 0.62), with intuitive operation (mean 4.35 ± 0.79). Understanding pathology (mean 4.29 ± 0.77) and surgical procedures (mean 4.63 ± 0.5) was very satisfactory. The models improved anatomical visualization (mean 4.71 ± 0.47) and teaching effectiveness (mean 4.76 ± 0.56), with participants reporting enhanced comprehension and memorization, leading to an efficient learning process. Establishing a 3D VR database for teaching craniosynostosis shows advantages in understanding and memorization and increases motivation for the study process, thereby allowing for more efficient learning. Future applications in patient consent and teaching in other medical areas should be explored.

Virtual Reality Immersive Simulations for a Forensic Molecular Biology Course—A Quantitative Comparative Study

Molecular biology is a complex, abstract, subject that can be challenging for higher education students to comprehend. The current manuscript describes the design, implementation, and evaluation of two immersive VR simulations of a DNA lab and a crime scene investigation (CSI) for a forensic molecular biology course in the context of the “TESLA” Erasmus+ project. It illustrates the instructional design and technical aspects of the VR simulations’ development. The experimental study employed a comparative quantitative research design. The guiding research questions examined how instructional modalities (online vs. face-to-face) affect learners’ perceptions of VR-based training in higher education and the key factors influencing learners’ intention for their adoption. Forty-six (n = 46) undergraduate students completed a 17-item questionnaire, which served as the main data collection instrument. Results demonstrate that both online and face-to-face VR-based instruction can effectively convey core concepts, thus challenging the traditional notion that face-to-face interaction is inherently superior. Its implications underscore the potential of VR simulations to supplement or even substitute traditional teaching methods, particularly for complex science subjects.

The Effectiveness of Virtual and Augmented Reality in Surgical Pain Management: A Systematic Review of Randomized Controlled Trials.

Satisfactory management of postoperative pain remains challenging. Nonpharmacological modalities such as virtual and augmented reality (VR/AR) offer potential benefits and are becoming increasingly popular. This systematic review evaluates the effectiveness and safety of VR/AR interventions on postoperative pain and recovery. MEDLINE, Embase, CINAHL, Web of Science, and CENTRAL databases were searched from inception to July 27, 2023, for randomized controlled trials (RCTs), published in English, evaluating the use of VR/AR interventions for surgical pain relief. Study selection and data extraction were performed by pairs of reviewers independently and in duplicate, and potential risk of bias was determined using the Risk of Bias-version 2 (RoB 2) tool. Our outcomes included pain relief, reduction of anxiety, satisfaction, and adverse effects. Due to substantial heterogeneity, a narrative synthesis without meta-analysis was performed. We included 35 trials among 2257 citations, categorized as surgery (n = 12), minor procedures (n = 15), and postoperative physiotherapy (n = 8). Surgical group included various surgeries, with 11 using immersive VR predominantly in the postoperative period, and most reporting no differences in pain, but potential for reduced anxiety and sedation requirements. In the minor procedures group, most studies reported decreased pain and anxiety during the procedural performance. Two studies reported increased heart rate, while 2 others reported better hemodynamic stability. Home-based AR physiotherapy achieved (n = 6) similar pain and functional outcomes after knee replacement, with 1 large study (n = 306) reporting reduction of mean costs by $2745 for provision of 12 weeks physiotherapy. There were some concerns around potential bias for most studies, as the nature of interventions make it challenging to blind assessors and participants. No important adverse effects were noted using VR/AR technology. Evidence from RCTs indicates that the use of immersive VR during minor procedures may reduce procedural pain, decrease anxiety, and improve satisfaction. However, small studies, inconsistent effect, and variation in the application of interventions are important limitations. Evidence to support the application of AR/VR for major surgeries is limited and needs to be further investigated. Use of home-based physiotherapy with AR likely has economic advantages, and facilitates virtual care for appropriate patients who can access and use the technology safely.

Personalized rehabilitation approach for reaching movement using reinforcement learning

Musculoskeletal disorders challenge significantly the performance of many daily life activities, thus impacting the quality of life. The efficiency of the traditional physical therapy programs is limited by ecological parameters such as intervention duration and frequency, number of caregivers, geographic accessibility, as well as by subjective factors such as patient’s motivation and perseverance in training. The implementation of VR rehabilitation systems may address these limitations, but the technology still needs to be improved and clinically validated. Furthermore, current applications generally lack flexibility and personalization. A VR rehabilitation game simulation is developed, which focuses on the upper-limb movement of reaching, an essential movement involved in numerous daily life activities. Its novelty consists in the integration of a machine learning algorithm, enabling highly adaptive and patient-customized therapeutic intervention. An immersive VR system for the rehabilitation of reaching movement using a bubble popping game is proposed. In the virtual space, the patient is presented with bubbles appearing at different locations and is asked to reach the bubble with the injured limb and pop it. The implementation of a Q-learning algorithm enables the game to adjust the location of the next bubble according to the performance of the patient, represented by his kinematic characteristics. Two test cases simulate the performance of the patient during a training program of 10 days/sessions, in order to validate the effectiveness of the algorithm, demonstrated by the spatial and temporal distribution of the bubbles in each evolving scenario. The results show that the algorithm learns the patient’s capabilities and successfully adapts to them, following the reward policy dictated by the therapist; moreover, the algorithm is highly responsive to kinematic features’ variation, while demanding a reasonable number of iterations. A novel approach for upper limb rehabilitation is presented, making use of immersive VR and reinforcement learning. The simulation suggests that the algorithm offers adaptive capabilities and high flexibility, needed in the comprehensive personalization of a rehabilitation process. Future work will demonstrate the concept in clinical trials.