Interactive Virtual Reality Environment Research Articles

Developing a Workflow for Transforming BIM Models into Immersive Virtual Reality Experiences

Abstract. The integration of Extended Reality (XR) and Building Information Modelling (BIM) has emerged as a promising approach for enhancing interaction with spatial data in the built environment. While the potential of BIM for advanced visualization has been recognized, there remains a need for standardized workflows that facilitate the transformation of BIM models into immersive virtual reality (VR) experiences. This research contributes to the ongoing development of BIM-VR integration by presenting a workflow that leverages Revit, Twinmotion, and Datasmith to create visually rich and interactive VR environments. The established process focuses on enhancing textures, incorporating dynamic lighting and weather simulations, and populating the virtual space with realistic elements. The workflow also addresses the integration of interactable objects to elevate user engagement and the use of cutting-edge VR headsets for an immersive experience. By providing a structured approach to bridging complex BIM data with VR, this research aims to support architects, engineers, construction professionals, and clients in design collaboration, project review, and decision-making across the building lifecycle. The workflow's potential for facilities management and training applications is also explored. Through a case study, the research demonstrates the workflow's effectiveness in facilitating a deeper understanding of architectural spaces before construction, highlighting its potential for improving efficiency and reducing rework. The paper also discusses the challenges and opportunities associated with integrating BIM with GIS and sensor data to create comprehensive digital twins. This research contributes to the growing body of knowledge on BIM-VR integration and underscores the importance of continued development in this field to enhance the design, communication, and experience of the built environment.

Echo-aware room impulse response generation.

In real-time applications, like interactive virtual reality environments, there is a significant need for low-complexity simulation of room impulse responses in highly complex virtual scenes, but this remains a challenging issue. In particular, simulating late reverberation using physically based acoustic modeling requires much computational effort, contrary to the early reflections that can be modeled by simpler techniques, e.g., the image source method. To tackle this computational complexity issue, we propose a neural network-based hybrid artificial reverberation framework (Echo2Reverb) that generates late reverberation from given early reflections. The proposed model can control both temporal texture and frequency-dependent energy decay, i.e., echo density and spectral energy distribution, of the generated reverberations by extracting spectral and echo-related features and filtering sampled sparse sequences and Gaussian noises using estimated features. To support the end-to-end training with controlled echo density, a differentiable approximation of the normalized echo density profile is proposed. We train and test the model not only for nearly diffuse but also distinct echoes prominent in late reverberations, such as with flutter echoes in narrow corridors. Evaluation results demonstrate that the proposed model can accurately reproduce frequency-dependent energy decay and temporal texture of a room impulse response using only early reflections.

Research on Human Computer Interaction Technology in Virtual Reality Scenes

This paper discusses the current status, challenges and development trends of human computer interaction technology in virtual reality scenarios. Virtual reality technology has gradually become a frontier field of human computer interaction research. This paper analyzes virtual reality technology and human computer interaction technology. By introducing the commonly used human computer interaction hardware equipment and software technology in current virtual reality scenarios, it reveals the actual application of human computer interaction in virtual reality environments. From the three aspects of technology, user experience, and security and privacy protection, this paper analyzes the challenges faced by human computer interaction technology in virtual reality scenarios. In the future, with the continuous advancement of technological innovation, new human-computer interaction technologies will continue to emerge, and the integration of artificial intelligence technology will further enhance the intelligence level of human-computer interaction, making the user interaction experience more natural and convenient.

Developing a virtual reality and AI-based framework for advanced digital manufacturing and nearshoring opportunities in Mexico.

The growing expansion of the manufacturing sector, particularly in Mexico, has revealed a spectrum of nearshoring opportunities yet is paralleled by a discernible void in educational tools for various stakeholders, such as engineers, students, and decision-makers. This paper introduces a state-of-the-art framework, incorporating virtual reality (VR) and artificial intelligence (AI) to metamorphose the pedagogy of advanced manufacturing systems. Through a case study focused on the design, production, and evaluation of a robotic platform, the framework endeavors to offer an exhaustive educational experience via an interactive VR environment, encapsulating (1) Robotic platform system design and modeling, enabling users to immerse themselves in the design and simulation of robotic platforms under varied conditions; (2) Virtual manufacturing company, presenting a detailed virtual manufacturing setup to enhance users' comprehension of manufacturing processes and systems, and problem-solving in realistic settings; and (3) Product evaluation, wherein users employ VR to meticulously assess the robotic platform, ensuring optimal functionality and customer satisfaction. This innovative framework melds theoretical acumen with practical application in advanced manufacturing, preparing entities to navigate Mexico's manufacturing sector's vibrant and competitive nearshoring landscape. It creates an immersive environment for understanding modern manufacturing challenges, fostering Mexico's manufacturing sector growth, and maximizing nearshoring opportunities for stakeholders.

Immersive presentations of real-world medical equipment through interactive VR environment populated with the high-fidelity 3D model of mobile MRI unit

The primary goal behind the system presented in this paper is to investigate the efficacy of using virtual reality (VR) for showcasing sizable medical equipment. Specifically, we focused on a mobile magnetic resonance imaging (MRI) scanner mounted on a truck trailer. The latter is integral to the mobile MRI setup and must be presented as part of the immersive experience. Therefore, we not only have to depict the medical apparatus but also provide the means of understanding its surroundings. This is especially important to radiologists and other medical personnel to ascertain if a given mobile medical facility fulfills their needs and wants. Furthermore, despite such MRI devices being designed for mobility, their long-distance transportation can be time-consuming, troublesome and expensive. Therefore, we can observe the need for showcasing such mobile MRI units without additional cost and burden related to transportation. To achieve this, we designed an immersive environment in which the users can interact with the real-life scale 3D model of a mobile MRI. In addition, we also verified the usability and expressiveness of our system using established heuristical approaches.

Human-computer interaction in virtual reality environments for educational and business purposes

This paper examines the integration of Human-Computer Interaction (HCI) in Virtual Reality (VR) environments, with a focus on its application in educational and business domains. It explores the transformative potential of VR in enhancing user interface design, optimizing user experience, and integrating advanced technologies like natural language processing and gesture recognition. The research highlights VR's efficacy in improving learning outcomes and operational efficiencies, demonstrating significant advancements in immersive and intuitive interaction within virtual settings. The study underscores the critical role of user-centered design in VR systems and the impact of integrating natural language processing and gesture recognition technologies in creating more natural and intuitive user interactions. Through comprehensive analysis and case studies, the paper presents the latest developments in VR technology and its application, offering insights into the future of immersive digital environments in education and business sectors.

Thelxinoë: Recognizing Human Emotions Using Pupillometry and Machine Learning

In this study, we present a method for emotion recognition in Virtual Reality (VR) using pupillometry. We analyze pupil diameter responses to both visual and auditory stimuli via a VR headset and focus on extracting key features in the time-domain, frequency-domain, and time-frequency domain from VR-generated data. Our approach utilizes feature selection to identify the most impactful features using Maximum Relevance Minimum Redundancy (mRMR). By applying a Gradient Boosting model, an ensemble learning technique using stacked decision trees, we achieve an accuracy of 98.8% with feature engineering, compared to 84.9% without it. This research contributes significantly to the Thelxinoë framework, aiming to enhance VR experiences by integrating multiple sensor data for realistic and emotionally resonant touch interactions. Our findings open new avenues for developing more immersive and interactive VR environments, paving the way for future advancements in virtual touch technology.

Computer vision meets metaverse

<p>This comprehensive analysis delves into the historical progression and important technological and contemporary advancements of computer vision inside the metaverse. The metaverse, which can be characterized as an interactive virtual reality environment that mirrors the physical world, signifies a novel domain for the utilization of computer vision in various applications. These applications span from object identification and tracking to gesture recognition and augmented reality. Additionally, a thorough evaluation of specific case studies occurs to provide a deeper understanding of the subject. Despite notable progress, the incorporation and utilization of computer vision inside the metaverse present numerous obstacles, including computational expenses, apprehensions regarding data privacy, and the faithful replication of physical aspects of reality. Potential solutions are examined, including deep learning approaches, optimization strategies, and the formation of ethical guidelines. A comprehensive analysis of anticipated patterns within the industry is also included, with emphasis on the confluence of artificial intelligence, the Internet of Things, and blockchain technologies. These convergences are predicted to create substantial prospects for the advancement of the metaverse. This review culminates by offering a contemplation on the ethical considerations and duties that arise from the utilization of computer vision in the realm beyond mortal existence. Research findings demonstrate that these technologies have greatly augmented user engagement and immersion within the digital domain. Readers can enhance their understanding of the interdependent connection between computer vision and the metaverse through the present analysis of existing scholarly works. Thus, this study aspires to make a valuable contribution to the advancement of research in this new domain.<strong></strong></p>

Mathematical Modeling of Embodied Cognition and Personalized Learning in Interactive Virtual Reality: A Nonlinear Systems Approach

Abstract This study develops a mathematical model of embodied cognition integrated with personalized learning within an interactive Virtual Reality (VR) environment, employing nonlinear systems theory to optimize educational outcomes. The study mathematically formulates the interactions between learners’ cognitive states, bodily actions, and environmental inputs by applying state-space models and multi-modal data analysis. The framework incorporates real-time affective feedback and dynamic adjustment mechanisms, improving mental performance and reducing cognitive load. A randomized controlled trial validates the model, demonstrating significant enhancements in learning satisfaction and knowledge retention. This research provides a novel quantitative basis for integrating nonlinear mathematical methods into the design and optimization of personalized learning systems in VR.

Pilgrimage to Pureland: Art, Perception and the Wutai Mural VR Reconstruction

Virtual reality (VR) supports audiences to engage with cultural heritage proactively. We designed an easy-to-access and guided VR reconstruction of the murals in Mogao Grottoes, Pilgrimage To Pureland, to offer the general public an accessible and engaging way to experience the Dunhuang murals. We explored an immersive VR reconstruction approach that can efficiently convert complex 2D mural art into 3D digital VR content while maintaining its originality. Specifically, we reconstructed the Mt. Wutai pilgrimage mural in Cave 61 into a plot-based interactive VR environment that offers users a more accessible and immersive narrative to visit and appreciate Dunhuang murals’ complex religious, historical, and artistic value. We conducted a user study with twenty participants to further investigate how this reconstruction approach and the interactive narratives would affect users’ immersive experiences and knowledge acquisition, compared with other forms of virtual access as the control group. Findings from our user study revealed that participants from the VR experimental group reported a significantly higher level of immersion and understanding of the knowledge. To conclude, our 2D-to-VR reconstruction methods provided a VR reconstruction approach and insights for creating engaging user experiences and improving users understanding of cultural and historical concepts while preserving the originality of the cultural heritage.

Various Types of Virtual Reality-Based Therapy for Eating Disorders: A Systematic Review.

(1) Background: Interactive VR (virtual reality) environments (i.e., using three-dimensional graphics presented with a head-mounted display) have recently become a popular professional tool for the treatment of patients with eating disorders (EDs). However, there are no published review reports that have analyzed the original papers between 2015 and 2021, which additionally focused only on HMD (head-mounted display) 3DVR (three-dimensional virtual reality) exposure and included only three therapeutic categories for ED patients. (2) Methods: The EbscoHost and Scopus databases were searched to identify relevant papers on VR research employing VR in the assessment and treatment of eating disorders. (3) Results: In addition to the known therapeutic divisions for ED, there are new forms of therapy based on 360 cameras, eye-tracking, and remote therapy. (4) Conclusions: The potential of VR in combination with different therapies may offer an alternative for future research. More rigorous testing, especially in terms of larger sample sizes, the inclusion of control groups or multisessions, and follow-up measures, is still needed. The current state of research highlights the importance of the nature and content of VR interventions for ED patients. Future research should look to incorporate more home-based and remote forms of VR tools.

Co-Designing a Virtual Reality Application to Enhance Reminiscence Therapy for Persons with Dementia

Reminiscence therapy for persons with dementia is often being conducted by employing analog media including pictures and videos organized and presented by a caregiver. However, such media lacks the immersive experience to support patient engagement and successful recollection of reminiscence events. Recently, Virtual Reality (VR) is gaining momentum as a potential technological tool to support dementia care due to its increased immersion, presence, and embodiment. Haptic artifacts can be used to enrich reminiscence therapy as part of the multi-sensory stimuli to increase immersion and patient engagement, as well as improving social connectedness and cognitive health. The purpose of this project is to explore the use of VR application to advance reminiscence therapy for persons with dementia. We have prototyped an immersive and non-immersive VR framework that allows caregivers to deliver reminiscence therapy for persons with dementia with varying stages in their disease progression. These reminiscence therapy sessions are built by employing a narrative storyboard and content management through a series of co-designing sessions with content experts at the Geriatric Dementia Unit in Ontario, Canada. A caregiver-led VR framework will be adopted to enable the caregiver to guide the persons with dementia to safely navigate through the interactive VR environment, while allowing the patients to engage with the interactive VR elements using a point-and-pinch gesture approach. We anticipate that the VR experiences hold the potential for improving the interactions between persons with dementia and caregivers, as well as enhancing the reminiscence experiences to promote the maximal therapeutic benefit of patient’s recovery.

4D modelling using virtual collaborative planning and scheduling

During the last decades, the introduction of Building Information Models (BIM) has opened new possibilities to ensure better communication and a shared understanding between stakeholders in construction projects. Similar benefits have been found in 4D simulations of the schedule. While BIM and 4D use has seen a steady increase, the potential benefits have not fully been realised, primarily due to tools not supporting and enabling the full potential of collaborative stakeholder involvement in scheduling. The benefits of 4D simulations come from improving communication between stakeholders. While traditional 4D modelling connects an existing BIM model with an existing schedule, a move from this type of passive 4D visualisation toward social co-creation enables all stakeholders to be involved in the scheduling process. This connection is further enhanced with the use of Virtual Reality (VR). Recent research has shown VR to enhance understanding and perception of the space and details and, thus, a better understanding of the project. This paper maps collaborative planning and scheduling method and traditional 4D scheduling using process modelling. This mapping is followed by implementing the 4D collaborative planning and scheduling method in the virtual project planning system with support for a multi-user interactive VR environment. The system enables social co-creation both during the planning and scheduling and during 4D modelling; it improves understanding of the project and the planning and scheduling.

CellexalVR: A virtual reality platform to visualize and analyze single-cell omics data

SummarySingle-cell RNAseq is a routinely used method to explore heterogeneity within cell populations. Data from these experiments are often visualized using dimension reduction methods such as UMAP and tSNE, where each cell is projected in two or three dimensional space. Three-dimensional projections can be more informative for larger and complex datasets because they are less prone to merging and flattening similar cell-types/clusters together. However, visualizing and cross-comparing 3D projections using current software on conventional flat-screen displays is far from optimal as they are still essentially 2D, and lack meaningful interaction between the user and the data. Here we present CellexalVR (www.cellexalvr.med.lu.se), a feature-rich, fully interactive virtual reality environment for the visualization and analysis of single-cell experiments that allows researchers to intuitively and collaboratively gain an understanding of their data.

Effect of visual elements on Indoor soundscape perception in open-plan office

This study examined the effect of changes in visual elements on spatial comfort and work productivity in the aspect of indoor soundscape perception in the open-plan office (OPO) sound environment. Various OPO visual stimuli were simulated using computer software (Unity 3D engine) to change the visual environment by varying variables such as worker density, window ratio, green ratio, and ceiling height. An interactive virtual reality environment was implemented to perform a specific task while experiencing the audio-visual stimuli combining the general OPO noise stimulus and the simulated OPO visual stimulus. Subjective evaluation was performed on a total of 30 subjects to evaluate indoor soundscape quality and work performance for each stimulus. Based on the results of this study, a pleasant OPO design guideline was proposed. Keywords: Open-plan office, indoor soundscape, interactive VR test, spatial comfort

The effect of attentional focus on movement accuracy in an immersive and interactive virtual reality environment

The effects of attentional focus (AF) instruction were examined in a reciprocal aiming task implemented in a 3-dimensional, fully immersive virtual environment (VE). Within the VE, participants (N = 19) moved a cube between two targets at two paces (750 ms and 500 ms) while being asked to focus externally (EXF) and internally (INF). Performance accuracy was measured as two-dimensional error and its variability between the center of the target to the center of the cube and one-dimensional bias (undershooting/overshooting behavior in the anteroposterior and mediolateral directions). The results indicated better performance, specifically greater accuracy and lower one-dimensional bias in the anteroposterior direction when adopting an EXF compared to an INF. Our findings reveal that the beneficial effects of an EXF on motor performance are not restricted movements within physical environments only but also work in VE. This has implications for rehabilitation and training protocols in VE.

Expert system for identifying and analyzing the IoT devices using Augmented Reality Approach

Biometrics In conjunction with the new development of the Internet of Things (IoT), augmented reality (AR) systems are evolving to visualize 3D virtual models of the real world into an intelligent and interactive virtual reality environment that facilitates physical identification of objects and defines their specifications efficiently. The integration between AR and IoT in a complementary way helps identify network-related items' specifications and interact with the Internet of Things more efficiently. An identity is a dedicated, publicly known attribute or set of names for an individual device. Typically, identifiers operate within a specific area or network, making it difficult to identify things globally. This paper explores the use of Augmented Reality (AR) Technology for identifying devices and displaying relevant information about the device to the user. Based on the developed model network, the developed system of identification of IoT devices was tested. Also, the traffic generated by the AR device when generating requests to the organization server was investigated. According to the test results, the system is undemanding to the main network indicators. The system-generated traffic is self-similar. The test results show that the server software can solve the problems of identifying IoT devices through interaction with augmented reality devices.

Developmental differences across the lifespan in the use of perceptual information to guide action-based decisions

Perceptual information about unfolding events is important for guiding decisions about when and how to move in real-world action situations. As an exemplary case, road-crossing is a perceptual-motor task where age has been shown to be a strong predictor of risk due to errors in action-based decisions. The present study investigated age differences between three age groups (Children: 10–12 years old; Adults: 19–39 years old; Older Adults: 65 + year olds) in the use of perceptual information for selection, timing, and control of action when crossing a two-way street in an immersive, interactive virtual reality environment. Adults and children selected gaps to cross that were consistent with the use of a time-based information variable (tau), whereas older adults tuned less into the time-based variable (tau) to guide road-crossing decisions. For action initiation and control, children and adults also showed a strong ability to precisely time their entry with respect to the lead vehicle maximising the available time to cross and coordinating walking movements with the tail vehicle to ensure they were not on a collision course. In contrast, older adults delayed action initiation and showed difficulty coordinating self-movement with the approaching vehicle. This study and its results tie together age-based differences in the three components of action decision-making (selection, timing and control) within a unified framework based on perceptual information. The implications of these age-related differences in action decisions and crossing behaviours are discussed in the context of road safety.

Virtual Reality for Monitor and Control of Electrical Substations.

This project presents the results obtained from a new strategy based on Virtual Reality techniques, which intends to minimize the operational issues caused in electric power substations due to the lack of spatial and functional information on the traditional operation interfaces. For this purpose, a three-dimensional interactive virtual reality environment was built in a realistic and accurate way regarding an energy supplier substation in Minas Gerais - Brazil and subsequently implanted it in its operation center for tasks related to its functioning. Lastly, tests were applied to operators to obtain results aiming at the contextualized problems.

A Comparative Usability Study of Bare Hand Three-Dimensional Object Selection Techniques in Virtual Environment

Object selection is the basis of natural user–computer interaction (NUI) in a virtual environment (VE). Among the three-dimensional object selection techniques employed in virtual reality (VR), bare hand-based finger clicking interaction and ray-casting are two convenient approaches with a high level of acceptance. This study involved 14 participants, constructed a virtual laboratory environment in VR, and compared the above two finger-based interaction techniques in terms of aspects of the task performance, including the success rate, total reaction time, operational deviation, and accuracy, at different spatial positions. The results indicated that the applicable distance range of finger clicking interaction and finger ray-casting was 0.2 to 1.4 m and over 0.4 m, respectively. Within the shared applicable distance, the finger clicking interaction achieved a shorter total reaction time and higher clicking accuracy. The performance of finger clicking interaction varied remarkably at the center and edge of the horizontal field of view, while no significant difference was found among ray-casting at various horizontal azimuths. The current findings could be directly applied to the application of bare-hand interaction in VR environments.