Virtual Reality Scenarios Research Articles

Optimising Healthcare Education with Design-Based Theory

Introduction In complex, and socially dynamic educational systems, traditional research methodologies often fail to connect with everyday practice, creating a need for “usable knowledge” when solving individual and collective education problems (Design-Based Research Collective, 2003). Traditional methods are effective, but do not necessarily uncover the nature of changes to student thinking during an education experience. With this, Design-Based Research (DBR) is a proposed solution that emerges as a pivotal methodology in educational research, as it aims to integrate theories of learning with practical experiences. Seen as a systematic yet adaptable approach, DBR integrates iterative cycles of analysis, design, and evaluation in collaboration with researchers and practitioners within authentic educational settings, (Harrington, 2012; Wang & Hannafin, 2005). This (poster) presentation will describe how DBR was utilised to create a learning environment to improve learning experiences within healthcare education. An analysis of the problem highlighted that healthcare students experienced high levels of anxiety during high-fidelity simulation when asked to perform and treat simulation manikins (Aiello et al., 2023). In part, the main issues relate to a lack of environmental authenticity, resulting in under-stimulation and performance anxiety resulting in over-stimulation. This relates to the Yerkes Dodson stress performance curve and suggests that too little or too much arousal results in poor performance (Yerkes, 1908). The hypothesis therefore was to design a solution for peak performance by increasing environmental authenticity and managing anxiety. Method The hypothesis is conceptualised as a ‘design solution’ rather than an intervention. To provide an authentic learning experience virtual reality environments were developed, and to aid performance anxiety, the centering technique was used. Centering is a visualisation technique that teaches participants to focus on the here and now, reduce negative thoughts, and lower anxiety. Virtual reality scenarios were provided prior to each simulation and included a ward-based environment (nurse students) and a rescue helicopter (paramedic students). The study involved 35 Master of Nursing Science, Entry to Practice student nurses at the University of Melbourne and 33 Bachelor of Health Science, Paramedicine students at Auckland University of Technology and industry experts within nurse and paramedic education. All data was collected for each cohort iteratively in 2023 and 2024 to evaluate and develop the design. Data collection included using the State-Trait Anxiety Inventory as a pre-test baseline to measure general and long-standing anxiety for each participant. Within-test heart rates was recorded on a Polar H10 chest strap to measure an objective physiological response to stress. Post-test participants completed the Competitive State Anxiety Inventory–2R after each simulation to understand subjective anxiety and several focus groups were completed to gain further insight into experiences and perspectives. Discussion and Conclusion This presentation outlines the design characteristics used to support student learning within healthcare education settings. Design-Based Research offers a robust framework to develop and refine educational practices through iterative design and implementation cycles. Early results suggest that both virtual reality and the centering technique impact healthcare learning and the implementation of this approach could lead to long-term resilience and build confidence that maximises potential.

Virtual Reality Exposure Therapy for Reducing School Anxiety in Adolescents: Pilot Study.

Virtual reality exposure therapy (VRET) is a promising treatment approach for anxiety disorders. However, while its efficacy has been demonstrated in adults, research on the efficacy of VRET in the treatment of adolescents with anxiety disorders is largely lacking. A pilot study was carried out to test whether exposure to a virtual reality (VR) school environment elicits state anxiety and autonomic arousal in adolescents with school anxiety (diagnoses covering social anxiety disorder or specific phobia involving school contexts). In addition, we examined whether repeated VR exposure led to a reduction in this fear response, trait school anxiety, and social anxiety symptoms. Moreover, the relationship of presence, the subjective sense of "being there," during VR exposure with anxiety measures and treatment response was examined. In a pilot study, 10 adolescents with school anxiety (age range 14 to 17 years) participated in five VRET sessions. Self-reported state anxiety, heart rate, and presence during exposure, as well as trait school anxiety and social anxiety before and after treatment, were measured. The VR scenario induced state anxiety and autonomic arousal. After VRET, a significant reduction in state anxiety (η2=0.74) and social anxiety symptoms (d=0.82) as well as a trend toward a decrease in trait school anxiety were observed, while autonomic arousal did not change. In addition, presence during VR exposure was associated with state anxiety and treatment response. Our findings indicate the feasibility and potential effectiveness of VRET as a treatment method for symptoms of school and social anxiety in adolescents.

MobiTangibles: Enabling Physical Manipulation Experiences of Virtual Precision Hand-Held Tools' Miniature Control in VR.

Realistic simulation for miniature control interactions, typically identified by precise and confined motions, commonly found in precision hand-held tools, like calipers, powered engravers, retractable knives, etc., are beneficial for skill training associated with these kinds of tools in virtual reality (VR) environments. However, existing approaches aiming to simulate hand-held tools' miniature control manipulation experiences in VR entail prototyping complexity and require expertise, posing challenges for novice users and individuals with limited resources. Addressing this challenge, we introduce MobiTangibles-proxies for precision hand-held tools' miniature control interactions utilizing smartphone-based magnetic field sensing. MobiTangibles passively replicate fundamental miniature control experiences associated with hand-held tools, such as single-axis translation and rotation, enabling quick and easy use for diverse VR scenarios without requiring extensive technical knowledge. We conducted a comprehensive technical evaluation to validate the functionality of MobiTangibles across diverse settings, including evaluations for electromagnetic interference within indoor environments. In a user-centric evaluation involving 15 participants across bare hands, VR controllers, and MobiTangibles conditions, we further assessed the quality of miniaturized manipulation experiences in VR. Our findings indicate that MobiTangibles outperformed conventional methods in realism and fatigue, receiving positive feedback.

Peer-led teaching with adjunctive virtual reality leads to increased confidence and engagement in surgical education amongst medical students

Abstract Purpose The aims of this study are to (1) evaluate the efficacy of peer-led teaching in post-surgical complications; (2) evaluate the role of virtual reality (VR) in peer-led teaching; and (3) assess the impact of performance-affecting factors (core knowledge coverage, quality of teaching, confidence in peer tutors, and engagement) in peer-led teaching with VR. Methods 30 medical students in clinical years of a 6-year Bachelor of Medicine and Bachelor of Surgery (MBChB) program participated in a peer-led tutorial and VR scenario on common post-surgical complications. Each tutorial consisted of two tutors and up to eight participants. Participants then answered a 13-item questionnaire using 5-point Likert scales. Results 28 (93%) participants showed marked improvement or remained at the previous ≥ 4 Likert rating for self-perceived experience and expertise after peer-led teaching (p < 0.05); and 30 (100%) after the VR scenario (p < 0.05). Increased confidence in peer tutors, quality of teaching and engagement correlated with improved confidence in VR and real-life post-surgical complications (p < 0.05). 24 (80%) participants felt performance pressure was diminished with VR simulation. Conclusions The use of peer-led teaching with VR scenarios increases medical student engagement in learning and confidence in dealing with post-surgical complications. Further long-term research with larger cohorts is recommended.

Using virtual reality technology to prevent substance misuse and violence among university students: A pilot and feasibility study.

Objectives: New prevention approaches that use engaging and innovative technologies are needed to reduce high rates of substance use and violence among university students. The present study developed and pilot-tested virtual reality (VR) technology that presented university students with immersive environments where they practiced skills with virtual peers. Methods: After viewing e-learning modules with prevention content, students engaged with immersive VR module prototypes to practice cognitive-behavioral skills for preventing risk behaviors, including assertive communication, negotiation, compromise, conflict resolution, and bystander intervention strategies. Results: Paired t-tests showed increases in life skills knowledge and anti-violence attitudes among students from the pretest to posttest assessments. Students and educators were enthusiastic about the VR prototypes, rating them as feasible, relevant, appealing, engaging, and innovative for prevention. Participants provided feedback on ways to improve the VR experience by including a greater variety of conflict situations, more nuanced branched scenarios and response options, and a more complete representation of all scenario outcomes. Conclusions: Findings suggest that VR scenarios are a promising strategy for enhancing life skills to help prevent health risk behaviors among university students.

Immersive visualization in infrastructure planning: Enhancing long-term resilience and sustainability

Infrastructure decisions today significantly impact future generations' quality of life, especially as severe storms and rising sea levels increasingly threaten communities across the United States. Decision-makers at all levels, including those involved in disaster prevention and response, must address climate change. However, those in infrastructure design and construction often prioritize immediate gains over long-term resilience. Engineering teams typically employ decision tools to manage complexity, but these methods may not highlight the long-term consequences of their choices. This study tests whether integrating Virtual Reality (VR) technology with engineering decision-making tools, can enhance engineers’ ability to visualize the future impacts of their infrastructure projects. A group of engineering students (n = 56) was given a case study on updating roadwork systems in Norfolk, Virginia, an area vulnerable to flooding. The control group viewed images depicting current and future conditions of sea-level rise (year 2100), while the intervention group experienced the same information but through an immersive VR scenario. Participants selected achievement levels for each credit using the Envision system, with total points reflecting the resilience and sustainability of decisions. The results indicate that participants who engaged with the VR experience, achieved higher scores than those who received the images. The results also indicate a variation in VR's impact based on political affiliation, with Democrats responding more positively to the VR experience than Republicans. The findings highlight that integrating VR into decision-making tools can be a crucial advancement in infrastructure planning, enabling engineers to make more informed, sustainable choices for a resilient future.

Electrophysiological (EEG) microstates during dream-like bizarre experiences in a naturalistic scenario using immersive virtual reality.

Monitoring the reality status of conscious experience is essential for a human being to interact successfully with the external world. Despite its importance for everyday functioning, reality monitoring can systematically become erroneous, for example, while dreaming or during hallucinatory experiences. To investigate brain processes associated with reality monitoring occurring online during an experience, i.e., perceptual reality monitoring, we assessed EEG microstates in healthy, young participants. In a within-subjects design, we compared the experience of reality when being confronted with dream-like bizarre elements versus realistic elements in an otherwise highly naturalistic real-world scenario in immersive virtual reality. Dream-like bizarreness induced changes in the subjective experience of reality and bizarreness, and led to an increase in the contribution of a specific microstate labelled C'. Microstate C' was related to the suspension of disbelief, i.e. the suppression of bizarre mismatches. Together with the functional interpretation of microstate C' as reported by previous studies, the findings of this study point to the importance of prefrontal meta-conscious control processes in perceptual reality monitoring.

Deep learning-driven optimization of real-time ray tracing for enhanced immersive virtual reality

Photorealistic rendering is essential for immersive virtual reality and real-time ray tracing is required for this, yet the necessary computational load has so far hindered its use in scenarios where a fast response and high frame rates are paramount. To overcome this challenge, we present a deep learning-based model that optimises the computational load of ray tracing through utilising convolutional neural networks (CNNs) to predict lightscene interactions. We achieve this by training CNNs from datasets with offline ray-traced images. Using this learning process, we approximate the contents of light transport simulations from scene point sampling. The use of this optimised algorithm in virtual reality scenes, thus, enables renderings of more complex scenes, with dynamic lighting, complex geometry and interactive elements under high frame rates, keeping users immersed and responsive to events. Our results show that this method achieves visual similarities to traditional ray tracing, which is photorealistic rendering, but can be performed in real-time in virtual reality. We anticipate this work leads to many potential applications of ray tracing in many scenarios in virtual reality, such as gaming, architectural rendering and training.

Seasonal variations in psychophysiological stress recovery from street greenery: A virtual reality study on vegetation structures and configurations

The benefits of street greenery for well-being in urban development are widely recognized. However, few studies have explored seasonal variations in the psychophysiological stress recovery effects of different street greenery. To address this gap, we conducted field research in the Guanzhong region of China and created virtual streetscapes representing different seasons using Mars 2020 software. This study categorized vegetation into various layers based on their biological attributes: deciduous and evergreen trees for the arbor layer, evergreen and colourful foliage hedges for the shrub layer, observable and unobservable flowering herbs for the herb layer. They were then classified into Tree, Tree-Shrub, Tree-Herb, and Tree-Shrub-Herb structures, all of which had different seasons and vegetation configurations. 1,136 participants were recorded for psychophysiological changes in different street greenery virtual reality scenarios. The results were as follows: 1. Streets with greenery exhibited greater stress recovery effects than those without greenery. Seasonally, the physiological stress recovery effects were greater in autumn and winter, and there was an interaction between season, structure, configuration factors. 2. Overall, the Tree-Shrub structure was most effective for stress recovery, the Tree-Shrub-Herb structure was least effective. However, the Tree-Shrub-Herb structure proved to be the best in winter. 3. Rich color and stable green coverage were most effective for improving psychological and physiological stress recovery, respectively. However, the optimal vegetation types and configurations for stress recovery vary with specific viewing periods within each season. These findings offer a theoretical foundation and practical reference for designing health-oriented street greenery and seasonal landscapes in future.

A randomized controlled experiment testing the use of virtual reality to trigger cigarette craving in people who smoke

Automated delivery of therapy in virtual reality (VR) has the potential to be used for smoking cessation. Most obviously, it could be used to practise and establish alternative reactions to smoking cues. The first step in treatment development is to show that VR environments can trigger sufficient cravings in smokers. We evaluated a new VR public house outdoor scenario with 100 individuals who smoked daily. Participants were randomly assigned to the VR scenario with smoking cues or a neutral experience in VR. The VR experiences were presented in a standalone VR headset. Before and after VR, we collected self-reported craving scores for cigarettes and alcohol using the Tobacco Craving Questionnaire (TCQ) and visual analogue scales (VAS). Physiological data were also collected. Compared to the neutral condition, exposure to the smoking cues led to a large increase in craving for a cigarette (TCQ β = 11.44, p < 0.0001, Cohen’s d = 1.10) and also a moderate increase in craving for alcohol (β=0.7,p=0.017,d=0.50)\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$(\\upbeta =0.7,\ ext{ p}=0.017,\ ext{ d}=0.50)$$\\end{document}. There were no significant physiological differences between the two conditions. These results provide good evidence that VR experiences can elicit strong craving for cigarettes. The programming can be part of developing a new VR cognitive therapy to help people reduce smoking.

Virtual reality tolerability, sense of presence and usability in Huntington disease: a pilot study.

Several studies demonstrated the utility of immersive virtual reality (VR) as a complementary approach to conventional therapy for improving motor, psychological and cognitive impairment in some pathological conditions. Our pilot study aims to evaluate for the first time: 1) sense of presence, tolerability and usability of VR immersive experience in patients with early stages of Huntington disease (eHDp) compared to healthy controls (HC); 2) correlation between the use of technology/cybersickness and the variables of presence/usability; 3) correlation between clinical characteristics (genetic, motor, functional and cognitive) and VR's variables. We recruited 10 eHDp and 10 age, gender and education matched HC. Participants completed questionnaires about sense of presence, usability, tolerability and technology use profile. Subjects were exposed to different VR scenarios from a first-person perspective through a standalone VR headset. Our results showed no significant statistical difference between eHDp and HC for the sense of presence (p=0.910), usability (p=0.744) and tolerability (p=0.730) during the VR experience. Familiarity with the use of technology was also comparable between groups (p=0.676). Regarding correlations in eHDp group, our results showed no correlations between use of technology/tolerability and the sense of presence/usability. Moreover, clinical characteristics of eHDp (genetic, motor, functional and cognitive scores) did not influence the sense of presence, tolerability and usability. Our research presents preliminary evidence for the applicability of VR in eHDp. These results open up the possibility to explore future applications of this methodology in rehabilitation (i.e., cognitive training, physiotherapy), diagnosis and psychological support in Huntington disease patients.

Analysis of visual and acoustic measures for self-evacuations in road tunnels using virtual reality

Emergency fire situations in tunnels can be especially dangerous when occurring in long underground or subsea tunnels, particularly when evacuation on foot is the only alternative. This paper presents the results from a study comparing different visual and acoustic measures to facilitate efficient and safe emergency evacuation and their effect on people's self-rescue behaviour in response to a tunnel fire. Eighty-one participants evaluated seven different scenarios in virtual reality with or without visual and acoustic supporting measures (i.e. signs, lights, acoustic beacons) to find their way to emergency doors. Objective behavioural data, such as orientation, and walking speed, were collected. The results suggest that the distance between the emergency doors increases uncertainty and affects the time to self-rescue significantly, with four times longer times for 500 m than 250 m between doors. Additionally, the use of continuous guiding lights positively supported orientation and walking speed, with 97 % of the participants finding their way and showing a reduction of time to reach the emergency door of 10–20 s. The study underscores the importance in the proper visual and acoustic evacuation measures for the wayfinding of emergency exits, improving self-rescue of people.

Impact of virtual reality experiences on destination image and visit intentions: the moderating effects of immersion, destination familiarity and sickness

PurposeThe aims of this study are to explore how the experience of “visiting” a destination in a virtual reality (VR) technology environment influences destination image and visit intentions and to evaluate the moderating effects of the immersion level of the technology, destination familiarity and VR sickness.Design/methodology/approachAn empirical study was conducted in a laboratory, using two types of immersive VR technologies. The data, collected through a personal survey of 144 participants, were analysed using PLS-SEM.FindingsThe results indicated that sense of presence is a crucial determinant of the user’s experience, which in turn contributed positively to destination image and visit intentions. VR sickness was observed to moderate the relationship between sense of presence and user experience, especially at low immersion levels. Destination familiarity did not influence the model’s relationships.Practical implicationsThe findings lead us to propose that tourism destination managers: use immersive VR technologies in their marketing strategies; in these VR scenarios enhance the user’s sense of presence and experience and implement segmentation strategies.Originality/valueThis is one of the first works to empirically analyse how the customer’s experience of immersive technologies affects destination image and visit intentions. The study also evaluates three moderating effects: the effects of the level of immersion evoked by the technology, and destination familiarity, on the model’s relationships, and the effects of a negative aspect of the technology, VR sickness, on the relationship between sense of presence and the customer experience.

Development and Validation of Virtual Reality Scenarios to Improve Disability Awareness among Museum Employees

Development and Validation of Virtual Reality Scenarios to Improve Disability Awareness among Museum Employees

Virtual Reality Environmental Enrichment Effects on Craving for Cigarette in Smokers.

Background: Preclinical studies suggested the exposure to environmental enrichment (EE) as an intervention able to prevent or reduce nicotine-taking and nicotine-seeking behaviors. Virtual reality (VR) may help to test the effects of EE in smokers in a reproducible and feasible manner. Materials and Methods: In the present study, 31 smokers (14 women) were divided into two groups: (1) exposure to a virtual EE (VR-EE) and (2) exposure to a virtual neutral environment (VR-NoEE). Cigarette craving was assessed as basal and evoked, at different timepoints during the session. Behavior activity during VR exposure, mood, and subjective measures were also collected. Results: EE exposure in VR significantly reduced craving scores from basal timepoint. This was not observed in the VR-NoEE group, which significantly increased craving compared with values at neutral scenario. When both groups were exposed to smoking-related VR scenario, the VR-EE group showed an increased craving compared with previous timepoint up to score values not different from those in the VR-NoEE group. A significant positive correlation between basal craving scores and interactive behavior with virtual smoking cues was observed in the VR-NoEE but not in the VR-EE group. Conclusion: These findings suggest that virtual EE might have an inhibitory effect in smokers on basal, but not on evoked cigarette craving. Noteworthily, the interactive activity correlation to craving scores in the VR-NoEE participants was not observed in the VR-EE group, adding further evidence that the enrichment simulation was nonetheless able to modify behavior in the smoking-related scenario.

Use and Design of Virtual Reality-Supported Learning Scenarios in the Vocational Qualification of Nursing Professionals: Scoping Review.

Numerous reviews advocate using virtual reality (VR) in educational contexts. This medium allows learners to test experiences in realistic environments. Virtually supported scenarios offer a safe and motivating way to explore, practice, and consolidate nursing skills in rare and critical nursing tasks. This is also cited as one of the reasons why VR can significantly increase the knowledge acquisition of nursing students. Nevertheless, studies are limited in their significance owing to the chosen design. Despite great interest, this results in a low level of confidence in VR as a curricular teaching method for nursing education. Therefore, defining concrete design and didactic-methodological parameters that support teachers in the use and implementation of VR is more relevant. This scoping review aims to provide an overview of significant design aspects for VR scenario conception and its transfer to generalist nursing education to generate value for the development of teaching scenarios and their sustainable implementation in teaching. A comprehensive literature search was performed using the MEDLINE (via PubMed) and CINAHL databases, and the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews) checklist was applied. The search was conducted from May to July 2022, using a specific search principle corresponding to the focus and the growing study corpus. A previously defined "population, concept, and context" scheme was employed as the basis for the double-blind review of all relevant international German and English publications released up to May 1, 2022. In accordance with the predefined selection procedure, 22 publications were identified. The identified aspects aided in the development of design, didactic, and research recommendations. The intuitive operation of realistically designed VR scenarios, which are standardized, reliable, and modifiable, as well as clear instructions and specific multimodal feedback functions were described positively. The same applied to the linear structure of the sequences with graduated demands and high image quality for increased immersion with low sensory overload. Changes in perspectives, multiuser options, dialogs, and recording functions can contribute to an interactive care practice. On the research side, it is advisable to define VR terminologies. In addition to considering larger samples, varying settings, and financial issues, it is recommended to conduct long-term studies on knowledge acquisition or improved patient outcomes. VR scenarios offer high potential in the context of nursing education if teachers and learners develop them co-creatively according to design features and implement them by means of a well-conceived concept. VR enables trainees to develop practical skills continuously in a standardized way. In addition, its deployment supports the sensitization of trainees to digital nursing technologies and the expansion of their digital skills in a practical setting. Furthermore, it allows sustainability issues to be addressed.

Effectiveness of virtual reality intervention in promoting sustainable hand hygiene for community participants: A mixed methods approach

Hand hygiene compliance is well known as an important measure in preventing the transmission of infectious disease. Even though general public was aware of this health message during the COVID-19 pandemic, sustaining such personal hygiene behavior is difficult. While personal hygiene virtual reality intervention via an immersive experience has been found as an effective health promotion strategy, its prior implementation was mostly among healthcare workers but not among people in the community. Using a mixed methods approach, this study draws on the theory of planned behaviors to design two experimental studies for testing this interventional approach's sustainability and applicability to the general population. The result confirmed the virtual reality scenario with both presence and embodiment demonstrated a more sustainable treatment effect in boosting individual's self-efficacy over other experimental arms. Post-hoc analysis revealed the reduction of perceived barrier after exposure to immersive environment was attributable to treatment effect. The findings were reconfirmed through triangulation in the qualitative post-intervention interviews. Finally, we highlight the theoretical and practical implication of the study for the future development of personal hygiene immersive environment-based intervention.

Virtual reality traffic prioritization for Wi-Fi quality of service improvement using machine learning classification techniques

The increase in the demand for eXtended Reality (XR)/Virtual Reality (VR) services in the recent years, poses a great challenge for Wi-Fi networks to maintain the strict latency requirements. In VR over Wi-Fi, latency is a significant issue. In fact, VR users expect instantaneous responses to their interactions, and any noticeable delay can disrupt user experience. Such disruptions can cause motion sickness, and users might end up quitting the service. Differentiating interactive VR traffic from Non-VR traffic within a Wi-Fi network can aim to decrease latency for VR users and improve Wi-Fi Quality of Service (QoS) with giving priority to VR users in the access point (AP) and efficiently handle VR traffic. In this paper, we propose a machine learning-based approach for identifying interactive VR traffic in a Cloud-Edge VR scenario. The correlation between downlink and uplink is crucial in our study. First, we extract features from single-user traffic characteristics and then, we compare six common classification techniques (i.e., Logistic Regression, Support Vector Machines, k-Nearest Neighbors, Decision Trees, Random Forest, and Naive Bayes). For each classifier, a process of hyperparameter tuning and feature selection, namely permutation importance is applied. The model created is evaluated using datasets generated by different VR applications, including both single and multi-user cases. Then, a Wi-Fi network simulator is used to analyze the VR traffic identification and prioritization QoS improvements. Our simulation results show that we successfully reduce VR traffic delays by a factor of 4.2x compared to scenarios without prioritization, while incurring only a 2.3x increase in delay for background (BG) traffic related to Non-VR services.

AdaptiX - A Transitional XR Framework for Development and Evaluation of Shared Control Applications in Assistive Robotics

With the ongoing efforts to empower people with mobility impairments and the increase in technological acceptance by the general public, assistive technologies, such as collaborative robotic arms, are gaining popularity. Yet, their widespread success is limited by usability issues, specifically the disparity between user input and software control along the autonomy continuum. To address this, shared control concepts provide opportunities to combine the targeted increase of user autonomy with a certain level of computer assistance. This paper presents the free and open-source AdaptiX XR framework for developing and evaluating shared control applications in a high-resolution simulation environment. The initial framework consists of a simulated robotic arm with an example scenario in Virtual Reality (VR), multiple standard control interfaces, and a specialized recording/replay system. AdaptiX can easily be extended for specific research needs, allowing Human-Robot Interaction (HRI) researchers to rapidly design and test novel interaction methods, intervention strategies, and multi-modal feedback techniques, without requiring an actual physical robotic arm during the early phases of ideation, prototyping, and evaluation. Also, a Robot Operating System (ROS) integration enables the controlling of a real robotic arm in a PhysicalTwin approach without any simulation-reality gap. Here, we review the capabilities and limitations of AdaptiX in detail and present three bodies of research based on the framework. AdaptiX can be accessed at https://adaptix.robot-research.de.

Research on Human Computer Interaction Technology in Virtual Reality Scenes

This paper discusses the current status, challenges and development trends of human computer interaction technology in virtual reality scenarios. Virtual reality technology has gradually become a frontier field of human computer interaction research. This paper analyzes virtual reality technology and human computer interaction technology. By introducing the commonly used human computer interaction hardware equipment and software technology in current virtual reality scenarios, it reveals the actual application of human computer interaction in virtual reality environments. From the three aspects of technology, user experience, and security and privacy protection, this paper analyzes the challenges faced by human computer interaction technology in virtual reality scenarios. In the future, with the continuous advancement of technological innovation, new human-computer interaction technologies will continue to emerge, and the integration of artificial intelligence technology will further enhance the intelligence level of human-computer interaction, making the user interaction experience more natural and convenient.