Interactive Virtual Reality Environment Research Articles

Exploring Multimodal Feedback Mechanisms for Improving User Interaction in Virtual Reality Environments

As Virtual Reality (VR) technology progresses, the need for intuitive and immersive interaction mechanisms becomes increasingly important. However, current VR systems primarily rely on visual and auditory feedback, often overlooking other sensory modalities, which limits the depth of user immersion. While visual and auditory inputs allow users to perceive virtual objects and sounds, the experience remains somewhat one-dimensional compared to real-world, multi-sensory interactions. To address this limitation, this paper explores the impact of multimodal feedback mechanisms, particularly through the incorporation of haptic (touch) and olfactory (smell) cues, on user experience in VR environments. By enriching the sensory inputs, these additional feedback mechanisms can significantly enhance the realism and intuitiveness of virtual interactions, making the experience more engaging and immersive.

Interactive virtual reality environments and emotions: a systematic review

Emotions influence the way people react in different contexts. Virtual reality (VR) makes it possible to generate environments that can resemble a real experience. These concepts were taken as the basis of the review, focusing on the use of VR on emotions. The search for information was carried out in the Scopus database (179) and other sources of information (17), and the selection criteria were applied to 196 results, such as the user’s interaction with the environment and the application of a software development of VR applications, resulting in the analysis of 16 studies. Unity was found to be used in 81.25% of the articles, HTC Vive appears in 37.5% of the research. The minimum time of application of the experience is 1-min contrasting with the maximum time of 30 min. Only theories of emotions were mentioned in 18.75% of the articles, most of the research uses VR to influence users (56.25%) and with the indicators only 1 article coincides with ISO 25000.

Developing a Workflow for Transforming BIM Models into Immersive Virtual Reality Experiences

Abstract. The integration of Extended Reality (XR) and Building Information Modelling (BIM) has emerged as a promising approach for enhancing interaction with spatial data in the built environment. While the potential of BIM for advanced visualization has been recognized, there remains a need for standardized workflows that facilitate the transformation of BIM models into immersive virtual reality (VR) experiences. This research contributes to the ongoing development of BIM-VR integration by presenting a workflow that leverages Revit, Twinmotion, and Datasmith to create visually rich and interactive VR environments. The established process focuses on enhancing textures, incorporating dynamic lighting and weather simulations, and populating the virtual space with realistic elements. The workflow also addresses the integration of interactable objects to elevate user engagement and the use of cutting-edge VR headsets for an immersive experience. By providing a structured approach to bridging complex BIM data with VR, this research aims to support architects, engineers, construction professionals, and clients in design collaboration, project review, and decision-making across the building lifecycle. The workflow's potential for facilities management and training applications is also explored. Through a case study, the research demonstrates the workflow's effectiveness in facilitating a deeper understanding of architectural spaces before construction, highlighting its potential for improving efficiency and reducing rework. The paper also discusses the challenges and opportunities associated with integrating BIM with GIS and sensor data to create comprehensive digital twins. This research contributes to the growing body of knowledge on BIM-VR integration and underscores the importance of continued development in this field to enhance the design, communication, and experience of the built environment.

Echo-aware room impulse response generation.

In real-time applications, like interactive virtual reality environments, there is a significant need for low-complexity simulation of room impulse responses in highly complex virtual scenes, but this remains a challenging issue. In particular, simulating late reverberation using physically based acoustic modeling requires much computational effort, contrary to the early reflections that can be modeled by simpler techniques, e.g., the image source method. To tackle this computational complexity issue, we propose a neural network-based hybrid artificial reverberation framework (Echo2Reverb) that generates late reverberation from given early reflections. The proposed model can control both temporal texture and frequency-dependent energy decay, i.e., echo density and spectral energy distribution, of the generated reverberations by extracting spectral and echo-related features and filtering sampled sparse sequences and Gaussian noises using estimated features. To support the end-to-end training with controlled echo density, a differentiable approximation of the normalized echo density profile is proposed. We train and test the model not only for nearly diffuse but also distinct echoes prominent in late reverberations, such as with flutter echoes in narrow corridors. Evaluation results demonstrate that the proposed model can accurately reproduce frequency-dependent energy decay and temporal texture of a room impulse response using only early reflections.

Research on Human Computer Interaction Technology in Virtual Reality Scenes

This paper discusses the current status, challenges and development trends of human computer interaction technology in virtual reality scenarios. Virtual reality technology has gradually become a frontier field of human computer interaction research. This paper analyzes virtual reality technology and human computer interaction technology. By introducing the commonly used human computer interaction hardware equipment and software technology in current virtual reality scenarios, it reveals the actual application of human computer interaction in virtual reality environments. From the three aspects of technology, user experience, and security and privacy protection, this paper analyzes the challenges faced by human computer interaction technology in virtual reality scenarios. In the future, with the continuous advancement of technological innovation, new human-computer interaction technologies will continue to emerge, and the integration of artificial intelligence technology will further enhance the intelligence level of human-computer interaction, making the user interaction experience more natural and convenient.

Scientific virtual reality as a research tool in prehistoric archaeology: the case of Atxurra Cave (northern Spain)

Highlights: This study proposes the practical utility of an immersive Virtual Reality (VR) experience for the dissemination and study of Palaeolithic Rock Art. Thanks to a series of multidisciplinary studies, a virtual reconstruction of the archaeological context of an area with rock art has been achieved. The Palaeolithic lighting systems documented in Atxurra cave have been virtually recreated, allowing real-time interaction through VR. Abstract: The Upper Palaeolithic period (ca. 45000 - 12000 BP) was the time when figurative art chiefly produced by Homo sapiens emerged and developed. The Upper Palaeolithic rock art entails a multisensory experience that goes beyond depicted images observation: it includes aspects related to the cognitive development of human mind, the spatial dimensions, the type of rock surface, artificial lighting, and challenges of navigating the underground environment. Traditionally, the study of Palaeolithic art in caves has focused on paintings and illustrated subjects' graphic analysis. However, a recent shift in methodological focus has favoured a comprehensive and interdisciplinary study of rock art. This new perspective has allowed the investigation of surrounding elements that significantly influence the art and its interpretation. Combining this with new digital technologies, it is now possible to reconstruct Palaeolithic artistic creation and contemplation environments with precision, offering researchers an immersive and interactive experience through virtual reality (VR). The two documented Palaeolithic lighting systems in the sector J “Ledge of the Horses” have been virtually recreated. The lighting simulation parameters are based on those obtained from an anthracological study of the charcoal remains found in the cave and the subsequent experimental program. The study included analysing both three-dimensional (3D) models of the cave, obtained through photogrammetry and laser scanning, and the lighting systems in the graphics engine ©Unreal Engine 5; this allowed the researchers to create an interactive VR environment that faithfully reflects the current state of scientific knowledge about the cavity. Using VR is a substantial methodological advancement, regarding both knowledge transmission and the creation of more robust and coherent archaeological interpretations through sensory perception and historical empathy. This approach has been applied to the main decorated sector of the Atxurra Cave (Basque Country, Spain), a space containing dozens of engraved and painted representations, and surface archaeological material, subjected to a comprehensive multidisciplinary study.

Developing a virtual reality and AI-based framework for advanced digital manufacturing and nearshoring opportunities in Mexico.

The growing expansion of the manufacturing sector, particularly in Mexico, has revealed a spectrum of nearshoring opportunities yet is paralleled by a discernible void in educational tools for various stakeholders, such as engineers, students, and decision-makers. This paper introduces a state-of-the-art framework, incorporating virtual reality (VR) and artificial intelligence (AI) to metamorphose the pedagogy of advanced manufacturing systems. Through a case study focused on the design, production, and evaluation of a robotic platform, the framework endeavors to offer an exhaustive educational experience via an interactive VR environment, encapsulating (1) Robotic platform system design and modeling, enabling users to immerse themselves in the design and simulation of robotic platforms under varied conditions; (2) Virtual manufacturing company, presenting a detailed virtual manufacturing setup to enhance users' comprehension of manufacturing processes and systems, and problem-solving in realistic settings; and (3) Product evaluation, wherein users employ VR to meticulously assess the robotic platform, ensuring optimal functionality and customer satisfaction. This innovative framework melds theoretical acumen with practical application in advanced manufacturing, preparing entities to navigate Mexico's manufacturing sector's vibrant and competitive nearshoring landscape. It creates an immersive environment for understanding modern manufacturing challenges, fostering Mexico's manufacturing sector growth, and maximizing nearshoring opportunities for stakeholders.

Immersive presentations of real-world medical equipment through interactive VR environment populated with the high-fidelity 3D model of mobile MRI unit

The primary goal behind the system presented in this paper is to investigate the efficacy of using virtual reality (VR) for showcasing sizable medical equipment. Specifically, we focused on a mobile magnetic resonance imaging (MRI) scanner mounted on a truck trailer. The latter is integral to the mobile MRI setup and must be presented as part of the immersive experience. Therefore, we not only have to depict the medical apparatus but also provide the means of understanding its surroundings. This is especially important to radiologists and other medical personnel to ascertain if a given mobile medical facility fulfills their needs and wants. Furthermore, despite such MRI devices being designed for mobility, their long-distance transportation can be time-consuming, troublesome and expensive. Therefore, we can observe the need for showcasing such mobile MRI units without additional cost and burden related to transportation. To achieve this, we designed an immersive environment in which the users can interact with the real-life scale 3D model of a mobile MRI. In addition, we also verified the usability and expressiveness of our system using established heuristical approaches.

Human-computer interaction in virtual reality environments for educational and business purposes

This paper examines the integration of Human-Computer Interaction (HCI) in Virtual Reality (VR) environments, with a focus on its application in educational and business domains. It explores the transformative potential of VR in enhancing user interface design, optimizing user experience, and integrating advanced technologies like natural language processing and gesture recognition. The research highlights VR's efficacy in improving learning outcomes and operational efficiencies, demonstrating significant advancements in immersive and intuitive interaction within virtual settings. The study underscores the critical role of user-centered design in VR systems and the impact of integrating natural language processing and gesture recognition technologies in creating more natural and intuitive user interactions. Through comprehensive analysis and case studies, the paper presents the latest developments in VR technology and its application, offering insights into the future of immersive digital environments in education and business sectors.

Thelxinoë: Recognizing Human Emotions Using Pupillometry and Machine Learning

In this study, we present a method for emotion recognition in Virtual Reality (VR) using pupillometry. We analyze pupil diameter responses to both visual and auditory stimuli via a VR headset and focus on extracting key features in the time-domain, frequency-domain, and time-frequency domain from VR-generated data. Our approach utilizes feature selection to identify the most impactful features using Maximum Relevance Minimum Redundancy (mRMR). By applying a Gradient Boosting model, an ensemble learning technique using stacked decision trees, we achieve an accuracy of 98.8% with feature engineering, compared to 84.9% without it. This research contributes significantly to the Thelxinoë framework, aiming to enhance VR experiences by integrating multiple sensor data for realistic and emotionally resonant touch interactions. Our findings open new avenues for developing more immersive and interactive VR environments, paving the way for future advancements in virtual touch technology.

Computer vision meets metaverse

<p>This comprehensive analysis delves into the historical progression and important technological and contemporary advancements of computer vision inside the metaverse. The metaverse, which can be characterized as an interactive virtual reality environment that mirrors the physical world, signifies a novel domain for the utilization of computer vision in various applications. These applications span from object identification and tracking to gesture recognition and augmented reality. Additionally, a thorough evaluation of specific case studies occurs to provide a deeper understanding of the subject. Despite notable progress, the incorporation and utilization of computer vision inside the metaverse present numerous obstacles, including computational expenses, apprehensions regarding data privacy, and the faithful replication of physical aspects of reality. Potential solutions are examined, including deep learning approaches, optimization strategies, and the formation of ethical guidelines. A comprehensive analysis of anticipated patterns within the industry is also included, with emphasis on the confluence of artificial intelligence, the Internet of Things, and blockchain technologies. These convergences are predicted to create substantial prospects for the advancement of the metaverse. This review culminates by offering a contemplation on the ethical considerations and duties that arise from the utilization of computer vision in the realm beyond mortal existence. Research findings demonstrate that these technologies have greatly augmented user engagement and immersion within the digital domain. Readers can enhance their understanding of the interdependent connection between computer vision and the metaverse through the present analysis of existing scholarly works. Thus, this study aspires to make a valuable contribution to the advancement of research in this new domain.<strong></strong></p>

Mathematical Modeling of Embodied Cognition and Personalized Learning in Interactive Virtual Reality: A Nonlinear Systems Approach

Abstract This study develops a mathematical model of embodied cognition integrated with personalized learning within an interactive Virtual Reality (VR) environment, employing nonlinear systems theory to optimize educational outcomes. The study mathematically formulates the interactions between learners’ cognitive states, bodily actions, and environmental inputs by applying state-space models and multi-modal data analysis. The framework incorporates real-time affective feedback and dynamic adjustment mechanisms, improving mental performance and reducing cognitive load. A randomized controlled trial validates the model, demonstrating significant enhancements in learning satisfaction and knowledge retention. This research provides a novel quantitative basis for integrating nonlinear mathematical methods into the design and optimization of personalized learning systems in VR.

Pilgrimage to Pureland: Art, Perception and the Wutai Mural VR Reconstruction

Virtual reality (VR) supports audiences to engage with cultural heritage proactively. We designed an easy-to-access and guided VR reconstruction of the murals in Mogao Grottoes, Pilgrimage To Pureland, to offer the general public an accessible and engaging way to experience the Dunhuang murals. We explored an immersive VR reconstruction approach that can efficiently convert complex 2D mural art into 3D digital VR content while maintaining its originality. Specifically, we reconstructed the Mt. Wutai pilgrimage mural in Cave 61 into a plot-based interactive VR environment that offers users a more accessible and immersive narrative to visit and appreciate Dunhuang murals’ complex religious, historical, and artistic value. We conducted a user study with twenty participants to further investigate how this reconstruction approach and the interactive narratives would affect users’ immersive experiences and knowledge acquisition, compared with other forms of virtual access as the control group. Findings from our user study revealed that participants from the VR experimental group reported a significantly higher level of immersion and understanding of the knowledge. To conclude, our 2D-to-VR reconstruction methods provided a VR reconstruction approach and insights for creating engaging user experiences and improving users understanding of cultural and historical concepts while preserving the originality of the cultural heritage.

Various Types of Virtual Reality-Based Therapy for Eating Disorders: A Systematic Review.

(1) Background: Interactive VR (virtual reality) environments (i.e., using three-dimensional graphics presented with a head-mounted display) have recently become a popular professional tool for the treatment of patients with eating disorders (EDs). However, there are no published review reports that have analyzed the original papers between 2015 and 2021, which additionally focused only on HMD (head-mounted display) 3DVR (three-dimensional virtual reality) exposure and included only three therapeutic categories for ED patients. (2) Methods: The EbscoHost and Scopus databases were searched to identify relevant papers on VR research employing VR in the assessment and treatment of eating disorders. (3) Results: In addition to the known therapeutic divisions for ED, there are new forms of therapy based on 360 cameras, eye-tracking, and remote therapy. (4) Conclusions: The potential of VR in combination with different therapies may offer an alternative for future research. More rigorous testing, especially in terms of larger sample sizes, the inclusion of control groups or multisessions, and follow-up measures, is still needed. The current state of research highlights the importance of the nature and content of VR interventions for ED patients. Future research should look to incorporate more home-based and remote forms of VR tools.

Co-Designing a Virtual Reality Application to Enhance Reminiscence Therapy for Persons with Dementia

Reminiscence therapy for persons with dementia is often being conducted by employing analog media including pictures and videos organized and presented by a caregiver. However, such media lacks the immersive experience to support patient engagement and successful recollection of reminiscence events. Recently, Virtual Reality (VR) is gaining momentum as a potential technological tool to support dementia care due to its increased immersion, presence, and embodiment. Haptic artifacts can be used to enrich reminiscence therapy as part of the multi-sensory stimuli to increase immersion and patient engagement, as well as improving social connectedness and cognitive health. The purpose of this project is to explore the use of VR application to advance reminiscence therapy for persons with dementia. We have prototyped an immersive and non-immersive VR framework that allows caregivers to deliver reminiscence therapy for persons with dementia with varying stages in their disease progression. These reminiscence therapy sessions are built by employing a narrative storyboard and content management through a series of co-designing sessions with content experts at the Geriatric Dementia Unit in Ontario, Canada. A caregiver-led VR framework will be adopted to enable the caregiver to guide the persons with dementia to safely navigate through the interactive VR environment, while allowing the patients to engage with the interactive VR elements using a point-and-pinch gesture approach. We anticipate that the VR experiences hold the potential for improving the interactions between persons with dementia and caregivers, as well as enhancing the reminiscence experiences to promote the maximal therapeutic benefit of patient’s recovery.

4D modelling using virtual collaborative planning and scheduling

During the last decades, the introduction of Building Information Models (BIM) has opened new possibilities to ensure better communication and a shared understanding between stakeholders in construction projects. Similar benefits have been found in 4D simulations of the schedule. While BIM and 4D use has seen a steady increase, the potential benefits have not fully been realised, primarily due to tools not supporting and enabling the full potential of collaborative stakeholder involvement in scheduling. The benefits of 4D simulations come from improving communication between stakeholders. While traditional 4D modelling connects an existing BIM model with an existing schedule, a move from this type of passive 4D visualisation toward social co-creation enables all stakeholders to be involved in the scheduling process. This connection is further enhanced with the use of Virtual Reality (VR). Recent research has shown VR to enhance understanding and perception of the space and details and, thus, a better understanding of the project. This paper maps collaborative planning and scheduling method and traditional 4D scheduling using process modelling. This mapping is followed by implementing the 4D collaborative planning and scheduling method in the virtual project planning system with support for a multi-user interactive VR environment. The system enables social co-creation both during the planning and scheduling and during 4D modelling; it improves understanding of the project and the planning and scheduling.

CellexalVR: A virtual reality platform to visualize and analyze single-cell omics data

SummarySingle-cell RNAseq is a routinely used method to explore heterogeneity within cell populations. Data from these experiments are often visualized using dimension reduction methods such as UMAP and tSNE, where each cell is projected in two or three dimensional space. Three-dimensional projections can be more informative for larger and complex datasets because they are less prone to merging and flattening similar cell-types/clusters together. However, visualizing and cross-comparing 3D projections using current software on conventional flat-screen displays is far from optimal as they are still essentially 2D, and lack meaningful interaction between the user and the data. Here we present CellexalVR (www.cellexalvr.med.lu.se), a feature-rich, fully interactive virtual reality environment for the visualization and analysis of single-cell experiments that allows researchers to intuitively and collaboratively gain an understanding of their data.

Effect of visual elements on Indoor soundscape perception in open-plan office

This study examined the effect of changes in visual elements on spatial comfort and work productivity in the aspect of indoor soundscape perception in the open-plan office (OPO) sound environment. Various OPO visual stimuli were simulated using computer software (Unity 3D engine) to change the visual environment by varying variables such as worker density, window ratio, green ratio, and ceiling height. An interactive virtual reality environment was implemented to perform a specific task while experiencing the audio-visual stimuli combining the general OPO noise stimulus and the simulated OPO visual stimulus. Subjective evaluation was performed on a total of 30 subjects to evaluate indoor soundscape quality and work performance for each stimulus. Based on the results of this study, a pleasant OPO design guideline was proposed. Keywords: Open-plan office, indoor soundscape, interactive VR test, spatial comfort

The effect of attentional focus on movement accuracy in an immersive and interactive virtual reality environment

The effects of attentional focus (AF) instruction were examined in a reciprocal aiming task implemented in a 3-dimensional, fully immersive virtual environment (VE). Within the VE, participants (N = 19) moved a cube between two targets at two paces (750 ms and 500 ms) while being asked to focus externally (EXF) and internally (INF). Performance accuracy was measured as two-dimensional error and its variability between the center of the target to the center of the cube and one-dimensional bias (undershooting/overshooting behavior in the anteroposterior and mediolateral directions). The results indicated better performance, specifically greater accuracy and lower one-dimensional bias in the anteroposterior direction when adopting an EXF compared to an INF. Our findings reveal that the beneficial effects of an EXF on motor performance are not restricted movements within physical environments only but also work in VE. This has implications for rehabilitation and training protocols in VE.

Expert system for identifying and analyzing the IoT devices using Augmented Reality Approach

Biometrics In conjunction with the new development of the Internet of Things (IoT), augmented reality (AR) systems are evolving to visualize 3D virtual models of the real world into an intelligent and interactive virtual reality environment that facilitates physical identification of objects and defines their specifications efficiently. The integration between AR and IoT in a complementary way helps identify network-related items' specifications and interact with the Internet of Things more efficiently. An identity is a dedicated, publicly known attribute or set of names for an individual device. Typically, identifiers operate within a specific area or network, making it difficult to identify things globally. This paper explores the use of Augmented Reality (AR) Technology for identifying devices and displaying relevant information about the device to the user. Based on the developed model network, the developed system of identification of IoT devices was tested. Also, the traffic generated by the AR device when generating requests to the organization server was investigated. According to the test results, the system is undemanding to the main network indicators. The system-generated traffic is self-similar. The test results show that the server software can solve the problems of identifying IoT devices through interaction with augmented reality devices.