Interactive Virtual Reality Research Articles

Enhancing Human-Computer Interaction in Augmented Reality (AR) and Virtual Reality (VR) Environments: The Role of Adaptive Interfaces and Haptic Feedback Systems

Human-Computer Interaction (HCI) in Augmented Reality (AR) and Virtual Reality (VR) environments has emerged as a critical area of research, shaping how users interact with immersive technologies. This study explores the design and development of advanced HCI frameworks in AR/VR environments, with a particular focus on adaptive interfaces and haptic feedback systems. Adaptive interfaces employ real-time data to personalize user experiences, while haptic feedback systems provide tactile sensations to bridge the gap between digital and physical interactions. The integration of these technologies enhances user engagement, immersion, and efficiency across applications such as gaming, training simulations, healthcare, and remote collaboration. This research investigates the challenges in creating intuitive, responsive systems and examines cutting-edge solutions in multimodal interactions, gesture recognition, and real-time feedback processing. By analyzing user performance and satisfaction, this study contributes to the refinement of AR/VR systems, paving the way for next-generation immersive environments.

VRTree: Example‐Based 3D Interactive Tree Modeling in Virtual Reality

AbstractWe present VRTree, an example‐based interactive virtual reality (VR) system designed to efficiently create diverse 3D tree models while faithfully preserving botanical characteristics of real‐world references. Our method employs a novel representation called Hierarchical Branch Lobe (HBL), which captures the hierarchical features of trees and serves as a versatile intermediary for intuitive VR interaction. The HBL representation decomposes a 3D tree into a series of concise examples, each consisting of a small set of main branches, secondary branches, and lobe‐bounded twigs. The core of our system involves two key components: (1) We design an automatic algorithm to extract an initial library of HBL examples from real tree point clouds. These HBL examples can be optionally refined according to user intentions through an interactive editing process. (2) Users can interact with the extracted HBL examples to assemble new tree structures, ensuring the local features align with the target tree species. A shape‐guided procedural growth algorithm then transforms these assembled HBL structures into highly realistic, finegrained 3D tree models. Extensive experiments and user studies demonstrate that VRTree outperforms current state‐of‐the‐art approaches, offering a highly effective and easy‐to‐use VR tool for tree modeling.

Enhancing hand-object interactions in virtual reality for precision manual tasks

Enhancing hand-object interactions in virtual reality for precision manual tasks

Exploring and Modeling Directional Effects on Steering Behavior in Virtual Reality.

Steering is a fundamental task in interactive Virtual Reality (VR) systems. Prior work has demonstrated that movement direction can significantly influence user behavior in the steering task, and different interactive environments (VEs) can lead to various behavioral patterns, such as tablets and PCs. However, its impact on VR environments remains unexplored. Given the widespread use of steering tasks in VEs, including menu adjustment and object manipulation, this work seeks to understand and model the directional effect with a focus on barehand interaction, which is typical in VEs. This paper presents the results of two studies. The first study was conducted to collect behavioral data with four categories: movement time, average movement speed, success rate, and reenter times. According to the results, we examined the effect of movement direction and built the SθModel. We then empirically evaluated the model through the data collected from the first study. The results proved that our proposed model achieved the best performance across all the metrics (r2 > 0.95), with more than 15% improvement over the original Steering Law in terms of prediction accuracy. Next, we further validated the SθModel by another study with the change of device and steering direction. Consistent with previous assessments, the model continues to exhibit optimal performance in both predicting movement time and speed. Finally, based on the results, we formulated design recommendations for steering tasks in VEs to enhance user experience and interaction efficiency.

Frankenstein's Monster in the Metaverse: User Interaction With Customized Virtual Agents.

Enabled by the latest achievements in artificial intelligence (AI), computer graphics as well as virtual, augmented, and mixed reality (VR/AR/MR), virtual agents are increasingly resembling humans in both their appearance and intelligent behavior. This results in enormous potential for agents to support users in their daily lives, for example in customer service, healthcare, education or the envisioned all-encompassing metaverse. Today's technology would allow users to customize their conversation partners in the metaverse - as opposed to reality - according to their preferences, potentially improving the user experience. On the other hand, there is little research on how reshaping the head of a communication partner might affect the immediate interaction with them. In this paper, we investigate the user requirements for and the effects of agent customization. In a two-stage user study ($N=30$), we collected both self-reported evaluations (e.g., intrinsic motivation) and interaction metrics (e.g., interaction duration and number of tried out items) for the process of agent customization itself as well as data on how users perceived the subsequent human-agent interaction in VR. Our results indicate that users only wish to have full customization for agents in their personal social circle, while for general services, a selection or even a definite assignment of pre-configured agents is sufficient. When customization is offered, attributes such as gender, clothing or hair are subjectively more relevant to users than facial features such as skin or eye color. Although the customization of human interaction partners is beyond our control, customization of virtual agents significantly increases perceived social presence as well as rapport and trust. Further findings on user motivation and agent diversity are discussed in the paper.

Fast prediction of compressor flow field based on a deep attention symmetrical neural network

Accurate and rapid prediction of compressor performance and key flow characteristics is critical for digital design, digital twin modeling, and virtual–real interaction. However, the traditional methods of obtaining flow field parameters by solving the Navier–Stokes equations are computationally intensive and time-consuming. To establish a digital twin model of the flow field in a transonic three-stage axial compressor, this study proposes a novel data-driven deep attention symmetric neural network for fast reconstruction of the flow field at different blade rows and spanwise positions. The network integrates a vision transformer (ViT) and a symmetric convolutional neural network (SCNN). The ViT extracts geometric features from the blade passages. The SCNN is used for deeper extraction of input features such as boundary conditions and flow coordinates, enabling precise flow field predictions. Results indicate that the trained model can efficiently and accurately reconstruct the internal flow field of the compressor in 0.5 s, capturing phenomena such as flow separation and wake. Compared with traditional numerical simulations, the current model offers significant advantages in computational speed, delivering a three-order magnitude speedup compared to computational fluid dynamics simulations. It shows strong potential for engineering applications and provides robust support for building digital twin models in turbomachinery flow fields.

Assessing quality of experience for manipulation modes in virtual reality interaction

Assessing quality of experience for manipulation modes in virtual reality interaction

Virtual Children’s Hospital for Learning Pediatric Nursing

Abstract Background In the context of a funded Erasmus+ program, a platform of a Virtual Children’s Hospital for Learning Pediatric Nursing - VLPN is being developed. The education of nurses working with children, adolescents and families, needs to include specialized knowledge, skills, attitudes and behaviors that will empower them to provide optimal and high-quality care. The virtual platform enables the improvement of pediatric nursing competences of the nursing students through interactive and self-paced activities and content. Objectives 1. To develop an immersive and interactive virtual reality learning environment (VRLE), a virtual children’s hospital and new teaching and learning methods and practices, utilizing virtual reality and simulation in teaching. 2. To promote the international collaboration of students and lecturers through the VRLE Results The results are preliminary. 1. The VRLE includes educational materials developed to be integrated in the pediatric nursing studies, easy to access and use by the students and teachers with innovative self-pace learning material i.e. videos, 3D-models, interactive tests. Digital patients can react to the provided care with speech, movement, facial expressions and gestures, something that is not possible with the manikins in the Labs. 2. Nursing students and lecturers from different countries can participate in joint remote seminars or workshops in the VRLE, sharing and comparing their country and culture-specific differences and similarities in the nursing practices. VRLE and digital materials enables synchronous and asynchronous learning. Conclusions VRLE is highly conducive to clinical and procedure-focused training by enabling simulation. VR methods offer nursing students the opportunity to practice skills in a safe and risk-free environment in an immersive way. It can be accessed by multiple students, teachers or nurses at the same time from different locations in different countries. Key messages • New innovative VRLE enhances nursing students’ knowledge and skills that are needed when working with sick children and their families. • International collaboration, interaction and mobilization are enabled by using a virtual platform instead of traveling, thus strengthening the co-operation in European higher educational institutes.

Integrating Virtual Reality Tools into Secondary School Classrooms to Address Gender Gap in STEM Education: An Action Plan

This action plan addresses the gender gap in STEM education by integrating Virtual Reality (VR) tools into secondary school classrooms. Despite various strategies to increase female participation in STEM fields, women remain underrepresented in these areas. The action plan proposes the use of immersive and interactive VR experiences to create more engaging learning environments that may attract a diverse student body, particularly female students. By leveraging the potential of VR to simulate science experiments and other STEM-related activities, this project aims to enhance students' interest and confidence in STEM subjects. A pilot will be conducted in a secondary school, with approximately 50-100 students and a dedicated STEM teaching team. Key strategies include virtual reality technology training for teachers, the design of inclusive STEM curricula, and continuous evaluation through both formative and summative assessments. The expected outcome is that female students will show increased willingness to pursue further study and careers in STEM fields, contributing to long-term reductions in the gender gap in STEM education.

Virtual Reality-Based Exposure With 360° Environments for Social Anxiety Disorder: Usability and Feasibility Study.

Social anxiety disorder (SAD) is a long-term and overwhelming fear of social situations that can affect work, school, and other daily activities. Although cognitive behavioral therapy is effective, few seek treatment, and many who do start often drop out. This may be due to the component of exposure inherent to cognitive behavioral therapy, where the patient confronts feared stimuli outside the therapist's office, which they otherwise try to avoid. As an alternative, research has explored the effectiveness of virtual reality (VR)-based exposure therapy with promising results. However, few studies have investigated the feasibility of VR tools using mixed methodologies before assessing their efficacy. This study aims to assess the usability, feasibility, and presence of four 360° virtual environments and whether these were able to evoke anxiety in patients with SAD. A total of 10 adult participants with SAD and 10 healthy controls were recruited for 1 experimental session (age range 21-32 y; 12/20, 60% male participants). Questionnaire and interview data were collected and analyzed. A mixed methods triangulation design was applied to analyze and compare the data. Participants with SAD experienced increased anxiety when exposed to VR, and environments were considered relevant and useful as an exposure tool. Participants with SAD reported significantly higher average anxiety levels (P=.01) and peak anxiety levels (P=.01) compared with controls during exposure; however, significant differences in anxiety when accounting for baseline anxiety levels were only found in 2 of 4 environments (P=.01, P=.01, P=.07, and P=.06). While presence scores were acceptable in both groups, participants with SAD scored significantly lower than controls. Qualitative analyses highlight this finding within the SAD group, where some participants experienced presence reduction due to being observed while in VR and in situations with reduced interaction in VR. VR exposure with 360° videos seems to be useful as a first step of exposure therapy for patients with SAD. Future exploration in the clinical application of VR-based exposure for SAD, as well as means of increasing presence within the virtual environments, may be useful.

Developing a Workflow for Transforming BIM Models into Immersive Virtual Reality Experiences

Abstract. The integration of Extended Reality (XR) and Building Information Modelling (BIM) has emerged as a promising approach for enhancing interaction with spatial data in the built environment. While the potential of BIM for advanced visualization has been recognized, there remains a need for standardized workflows that facilitate the transformation of BIM models into immersive virtual reality (VR) experiences. This research contributes to the ongoing development of BIM-VR integration by presenting a workflow that leverages Revit, Twinmotion, and Datasmith to create visually rich and interactive VR environments. The established process focuses on enhancing textures, incorporating dynamic lighting and weather simulations, and populating the virtual space with realistic elements. The workflow also addresses the integration of interactable objects to elevate user engagement and the use of cutting-edge VR headsets for an immersive experience. By providing a structured approach to bridging complex BIM data with VR, this research aims to support architects, engineers, construction professionals, and clients in design collaboration, project review, and decision-making across the building lifecycle. The workflow's potential for facilities management and training applications is also explored. Through a case study, the research demonstrates the workflow's effectiveness in facilitating a deeper understanding of architectural spaces before construction, highlighting its potential for improving efficiency and reducing rework. The paper also discusses the challenges and opportunities associated with integrating BIM with GIS and sensor data to create comprehensive digital twins. This research contributes to the growing body of knowledge on BIM-VR integration and underscores the importance of continued development in this field to enhance the design, communication, and experience of the built environment.

Effects of vr-based interactive interior design on the emotional and mental health of office worker

ABSTRACT From the perspective of the evolution of the concept of health, the purpose of mental health is to achieve better living conditions, higher adaptability and development level, and also the best combination of physical and mental well-being and social well-being. According to the literature, the region and privacy of office interior design, the comfort and convenience of office furniture, the charm of office environment and individuation all have an impact on the mental health of office workers. Interactive interior design based on virtual reality can improve the office environment, thus improving the work efficiency and productivity of employees. A comfortable office environment has a positive impact on physical factors for office workers, which is beneficial for improving their mental health. This paper aimed to study how to analyze and study the impact of interactive interior design based on virtual reality (VR) on the emotional and psychological health of office workers. In this paper, the impact of VR interior design was evaluated by fuzzy comprehensive evaluation method, and the analytic hierarchy process (AHP) was used to quantify the weight. In the experiment part of this paper, through the analysis of the questionnaire of the office workers in Chengdu, Sichuan Province, and the comparison of the experimental data, it can be known that before the experiment, the control group and the experimental group were both very healthy, and after the experiment, the psychological health of the two groups was very healthy, which was 0 and 4 people. It can be seen that the psychological health of the workers in the experimental group has changed significantly. This paper studied the influence of VR interaction design on worker’s emotion from the experimental point of view and proved its influence on employee’s emotion from the empirical point of view, which had certain reference significance for future research.

Virtual Reality-Based Alcohol Prevention: The Results of a Cross-Sectional Study with Visitors of an Art Exhibition

Virtual reality (VR) can help to prevent alcohol consumption by simulating peer pressure. While existing VR applications for adolescents are primarily tested in schools, expanding them to museums and art galleries offers setting-specific benefits and could enhance their reach. An interactive VR simulation was presented in an art exhibition on substance use reflection. This study aimed to (1) describe visitor experiences with the simulation and (2) analyse differences according to gender and age. Visitors (n = 293) explored Virtual LimitLab for about 15 min before completing a survey on user experience and perceived learning experiences, which also included open questions on its positive and negative aspects. The quantitative user experience and perceived learning experience items were rated positively, except for knowledge increase. Young visitors (≤18 years of age) perceived Virtual LimitLab as more interesting (p = 0.043) and exciting (p = 0.047) than older ones. Female visitors rated the reflective response (p = 0.016) and sensitisation to social pressure (p = 0.024) higher than males. The qualitative evaluation showed that visitors appreciated the simulation’s realism, authenticity and adaptability. VR-based public health interventions in the arts setting need further research to study their preventive potential.

The “Cognitive” Architectural Design Process and Its Problem with Recent Artificial Intelligence Applications

The connection between cognitive science and the architectural design process reveals significant gaps that limit the full potential of creating effective built environments. A key issue is the insufficient integration of cognitive principles into design workflows. Architects frequently rely on traditional methods and aesthetic considerations without fully understanding how spatial configurations influence human cognition and behavior. While recent AI applications in architecture, such as Computer-Aided Drafting (CAD), Building Information Modeling (BIM), and interactive web and VR presentations, show promising advancements, AI still struggles with complex architectural functions. AI lacks the creativity and imagination inherent in human cognition. It operates based on fixed programming, producing specific outcomes and requiring human oversight to apply insights from one dataset to another. The primary challenge in using AI for architectural design is ensuring minimal design flaws, as replicating human cognitive abilities with AI and various machine learning techniques remains difficult. This research paper aims to explore the relationship between cognitive science, artificial intelligence, and the architectural design process through four main objectives: First, to investigate the integration of AI with current architectural software applications. Second, to examine potential connections between AI and major architectural design trends. Third, to define two frameworks for the Cognitive Architectural Design Process to guide the development of AI systems in architectural design by analyzing key cognitive design theories. Finally, to create a proposed "Architectural Design Process-Cognitive Pilot Map" from an architectural perspective to aid AI programmers in developing architecture design software applications.

Quantifying drivers of virtual reality acceptance in tourism planning using a grey system theory-based approach

PurposeThis study examines the role of Virtual Reality (VR) in tourism marketing, analyzing its psychological effects, demographic differences and factors influencing adoption. It seeks to identify and measure the main drivers and obstacles to VR acceptance, improving predictions of adoption trends in tourism planning and experiences across various demographics.Design/methodology/approachThis study employs a quantitative method, blending statistical analysis with Grey System Theory. It analyzes data from VR-experienced participants using ANOVA, regression models and dynamic grey relational analysis to produce actionable insights. Data were collected from July to September 2023 from participants experienced with VR in tourism.FindingsUser engagement, positive word-of-mouth and a desire for immersive experiences drive VR acceptance, especially among frequent travelers and tech enthusiasts. While VR can enhance trip enjoyment, its long-term impact varies. To increase VR adoption in tourism, strategies include targeting frequent travelers and online users, creating accessible and engaging content, leveraging positive feedback and partnering with influencers to develop interactive VR experiences that mitigate travel planning uncertainties and attract specific user groups.Practical implicationsThe study demonstrates how VR can expand access to tourism for those unable to travel, enhance engagement and streamline planning. By leveraging VR in marketing, providers can create immersive, targeted content, reduce uncertainties, attract tech-savvy travelers and boost appeal through influencer partnerships.Originality/valueThis study pioneers the integration of Grey System Theory with traditional statistical methods to elucidate the dynamics of VR adoption in tourism. By uniquely combining ANOVA, regression models and dynamic grey relational analysis, it offers a precise model to interpret complex data, highlighting the nuanced effects of demographic factors on technology acceptance. This approach not only advances the analytical frameworks in tourism marketing but also provides critical insights into the demographic and psychological drivers of VR adoption.

The Interaction Fidelity Model: A Taxonomy to Communicate the Different Aspects of Fidelity in Virtual Reality

Fidelity describes how closely a replication resembles the original. It can be helpful to analyze how faithful interactions in virtual reality (VR) are to a reference interaction. In prior research, fidelity has been restricted to the simulation of reality—also called realism. Our definition includes other reference interactions, such as superpowers or fiction. Interaction fidelity is a multilayered concept. Unfortunately, different aspects of fidelity have either not been distinguished in scientific discourse or referred to with inconsistent terminology. Therefore, we present the Interaction Fidelity Model (IntFi Model). Based on the human-computer interaction loop, it systematically covers all stages of VR interactions. The conceptual model establishes a clear structure and precise definitions of eight distinct components. As a communication tool, it helps teams to understand and discuss fidelity in VR. It was reviewed through workshops with fourteen VR experts. We provide guidelines, diverse examples, and educational material to apply the IntFi Model universally to any VR experience and propose foundational research opportunities.

Feasibility Test of A Testing Station Trainer Situated in Virtual Reality Integrates Computational Thinking Concepts

This research focuses on integrating the Computational Thinking (CT) concept of automation system in vocational education to address the high costs and scarcity of educational resources in practical learning. The rapid industrial expansion of automation, particularly in Modular Production Systems (MPS), necessitates that students grasp both the components' functionalities and operational principles. Another point that needs to be considered is the integrated CT concept in the learning process. The CT for 21st-century skills, this research aims to facilitate knowledge absorption through systematic problem-solving strategies. To reduce cost and scarcity, this research developed an Interactive Virtual Reality Testing Station (IVRTS) employing a CT methodology to replicate MPS functions effectively in a Flexible Manufacturing System (FMS) Laboratory setting. Developing an Interactive Virtual Reality Testing Station (IVRTS) with a CT approach to simulate the working process is expected to overcome this problem in the Flexible Manufacturing System (FMS) Laboratory. The research procedure adopted from Lee Owens' ADDIE development procedure aims to create a CT-based IVRTS as an innovative educational tool. Experimental validation will compare the efficacy of CT-enhanced IVRTS against traditional methods among 36 students from higher schools. Based on the results of research on the IVRTS indicates its significant potential, receiving mainly "Good/Worth It" feedback. Despite the overall positive reception, users reported issues regarding its complex nature and the necessity for ongoing technical support. Refinements to make the system more intuitive and autonomous by streamlining the interface and clarifying functions are essential for broader user adoption.

Effects of VR technical interaction and acceptance on rural cultural identity: The mediating role of embodied cognition and flow experience

With the development of digital media, an increasing number of new technologies are being used in cultural communication, and virtual reality (VR) technology for cultural communication has become a modern tool of transmission. To investigate the factors that influence rural cultural identity (RCI) through technical interaction (TI) and technology acceptance (TA) in VR in cultural communication, this study initially constructed a model of the influence path mediated by embodied cognition (EC) and flow experience (FE) based on compensatory media, technology acceptance, embodied cognition and flow experience theory. All participants had experienced some rural historical and cultural VR work and then completed a corresponding questionnaire. A total of 356 questionnaires were collected and analyzed using SPSS and SmartPLS software. The results indicated that the technological interaction and acceptance of VR influenced identification with rural culture through the mediating role of embodied cognition and flow experience. These findings provide a reference for strengthening audiences' embodied cognition and flow experience to promote their rural cultural identity. When VR technology is used to communicate culture, its technological interaction and acceptance can be improved to provide audiences with a better experience and perhaps influence the development of local tourism.

Research on Mixed Reality Hand Interaction Technology in Flight Simulation Teaching

Abstract The integration of mixed reality simulation training in institutional education and teaching processes can yield significant quality benefits. Non-wearable interactive methods represent a more natural form of hand interaction within flight cockpits, covering various emerging fields such as mixed reality, computer vision, and human-computer interaction. This paper is guided by a “human-centered” approach to natural human-computer interaction and proposes a virtual hand mixed reality interaction scheme based on hand natural feature points. This study introduces a hand detection, segmentation, and recognition algorithm based on skin colour and key hand feature points. Initially, the algorithm uses the Otsu adaptive threshold algorithm in the YCbCr space for skin colour detection to accommodate varying image brightness levels. Subsequently, it employs a hand Keypoint model for rapid hand detection within skin-like areas while excluding interference from other regions. During the process of hand tracking, optimization prediction is performed using the particle filter algorithm combined with the artificial fish swarm algorithm to achieve tracking accuracy within six pixels in both horizontal and vertical directions. Gesture recognition involves extracting Fourier descriptive contour features of the hand bone structure through identification of feature points. Furthermore, this study combines the optimization capabilities of the artificial fish swarm algorithm to enhance support vector machine model parameter optimization for improved recognition rates. Testing involved 800 processed images as part of a test set for gesture recognition; only five commonly used gestures within flight cockpits were recognized and classified with an accuracy rate reaching up to 98%. Finally, this research presents virtual representations of common operational gestures including natural hand states, control stick manipulation, and throttle handling positions, button activations, and rotational movements via head-mounted displays or screens. The proposed mixed reality-based hand gesture interaction system addresses challenges related to complex background interference during hand detection in cockpit environments as well as issues arising from lighting disturbances. Additionally it resolves problems associated with insufficient particles leading to tracking failures while significantly enhancing registration effects during tracking processes. Moreover it mitigates issues related to Fourier descriptive features being influenced by background variations or changes in pose along with limitations pertaining to expressing singular forms of gestures thereby improving overall classification accuracy.

Interest-aware joint caching, computing, and communication optimization for mobile VR delivery in MEC networks

In the upcoming B5G/6G era, Virtual Reality (VR) over wireless has become a typical application, which is an inevitable trend in the development of video. However, in immersive and interactive VR experiences, VR services typically exhibit high delay, while simultaneously posing challenges for the energy consumption of local devices. To address these issues, this paper aims to improve the performance of VR service in the edge-terminal cooperative system. Specifically, we formulate a joint Caching, Computing, and Communication (3C) VR service policy problem by optimizing the weighted sum of the total VR delivery delay and the energy consumption of local devices. To design the optimal VR service policy, the optimization problem is decoupled into three independent subproblems to be solved separately. To improve the caching efficiency within the network, a Bert-based user interest analysis method is first proposed to accurately characterize the content request behavior. Based on this, a service cost minimum-maximization problem is formulated under the consideration of performance fairness among users. Then, the joint caching and computing scheme is derived for each user with a given allocation of communication resources while a bisection-based communication scheme is acquired with the given information on the joint caching and computing policy. With alternative optimization, an optimal policy for joint 3C based on user interest can be finally obtained. Simulation results are presented to demonstrate the superiority of the proposed user interest-aware caching scheme and the effectiveness of the joint 3C optimization policy while considering user fairness. Our code is available at https://github.com/mrfuqaq1108/Interest-Aware-Joint-3C-Optimization.