Sense Of Immersion Research Articles

Drone Rider: Foot Vibration Stimuli to Enhance Immersion and Flight Sensation in VR

Simulating the experience of flight is a key objective of virtual reality (VR) technology. To enhance the sense of flying and immersion, we developed Drone Rider, a VR system that simulates free-flight atop a drone. In this study, we investigated whether delivering vibratory stimuli to the user’s feet could improve these sensations. While high-frequency drone propeller vibrations typically induce sensory numbness, alternative vibration patterns were explored. In Experiment 1, participants rated 13 different vibration patterns derived from various mechanical sounds, such as those from chainsaws, motorcycles, and washing machines. The motorcycle-based vibrations were most effective in enhancing both the sense of flight and immersion. In Experiment 2, we synthesized new vibration patterns by superimposing the highest-rated vibrations from Experiment 1, but no combination outperformed the original motorcycle vibration. These findings suggest that vibrations with multiple components below 100 Hz may reduce sensory adaptation and enhance the sense of flight and immersion in VR. This work provides valuable insights for developers aiming to optimize haptic feedback in VR flight simulators.

A method for dynamically adjusting the difficulty of rehabilitation training tasks driven by attention level.

Enhancements in the rehabilitation of motor and cognitive functions are significantly attainable through proactive patient engagement. The difficulty of rehabilitation tasks and the environment in which they are conducted directly impact patient motivation. Consequently, this study introduces a dynamic difficulty adjustment method for rehabilitation training tasks based on attention levels, designed to adjust task difficulty in real-time and augment the focus of participants on their training tasks. 
Approach: EEG signals from participants were harnessed to train an attention classification model, enabling the acquisition of real-time attention level signals. Task difficulty levels were adjusted based on the fluctuating attention levels. A cohort of 30 participants was engaged to evaluate: (1) the impact on engagement when attention levels are utilized as dynamic difficulty 18 triggers; (2) the influence of various task environments on concentration. The experiment was assessed through EEG signals and questionnaire data, with frequency domain analysis conducted on EEG signals to calculate concentration values and statistical analysis performed on additional data. 
Main Results: The findings reveal that within an identical virtual reality (VR) environment, leveraging attention levels as triggers for difficulty adjustment markedly improves participants' task concentration. Compared to 2D environments, VR environments substantially enhance participants' sense of immersion, interest, and flow state, albeit with increased physical exertion during training. The integration of VR and attention level feedback is deemed the most effective strategy. 
Significance: These exploratory insights indicate that the proposed method paves a novel path for boosting patient engagement in rehabilitation. Immersive rehabilitation training, driven by attention levels, promises a more effective and captivating patient experience. This study advances the field by offering data-driven, personalized rehabilitation approaches, potentially culminating in superior patient outcomes and enhanced quality of life.

Development of Immersive 360° Virtual Reality Videos for Intervention with Test Anxiety

This study explores the impact of 360-degree virtual reality (VR) videos on simulating test anxiety in students who already experience it. Using a phenomenological design, participants answered questions about their immersion in the virtual environment, including the realism of visuals, emotional responses, and adaptation. Seven students (four girls and three boys) were selected based on specific criteria, and the collected data underwent content analysis. Findings indicate that 360-degree VR videos effectively simulated test environments, creating a strong sense of realism and immersion. Participants reported that VR exposure elicited test anxiety symptoms similar to those experienced in real tests, with emotional distress intensifying during VR sessions. Test-anxious individuals noted that VR exposure triggered stronger emotional responses compared to imagination-based scenarios. While VR exposure proved effective in evoking realistic experiences and emotions, it was not deemed superior to real-life exposure techniques. This suggests that 360-degree VR has potential as a tool for anxiety interventions.

A Novel E-Social Servicescape Perspective: A Mixed-Methods Exploration of Audience Members’ Interactions During Sports Event Broadcasting in a Livestreaming Media Environment

Nowadays, platforms like Douyin attract large audiences during major sports events. In this study, with the aim of enhancing audience satisfaction in livestreaming media environments, we applied social servicescape theory to a livestreaming media environment and used a mixed-methods approach to understand why audiences choose to watch sports events on new media. We developed a theoretical model of audience satisfaction to examine sports event broadcasts on short video platforms. Following 24 semi-structured interviews, we conducted a quantitative survey of 490 participants. The results showed that user interaction and similarity are crucial factors influencing audience members’ choice of livestreaming and that the social attributes and interactive features of livestreaming enhance their sense of immersion, belonging, and nostalgia. Moreover, interactivity and similarity positively impact these emotional experiences, significantly boosting audience satisfaction. This research expands the theoretical understanding of online interactions and offers new insights for designing engaging livestreaming platforms.

Video2Haptics: Converting Video Motion to Dynamic Haptic Feedback with Bio-Inspired Event Processing.

In cinematic VR applications, haptic feedback can significantly enhance the sense of reality and immersion for users. The increasing availability of emerging haptic devices opens up possibilities for future cinematic VR applications that allow users to receive haptic feedback while they are watching videos. However, automatically rendering haptic cues from real-time video content, particularly from video motion, is a technically challenging task. In this article, we propose a novel framework called "Video2Haptics" that leverages the emerging bio-inspired event camera to capture event signals as a lightweight representation of video motion. We then propose efficient event-based visual processing methods to estimate force or intensity from video motion in the event domain, rather than the pixel domain. To demonstrate the application of Video2Haptics, we convert the estimated force or intensity to dynamic vibrotactile feedback on emerging haptic gloves, synchronized with the corresponding video motion. As a result, Video2Haptics allows users not only to view the video but also to perceive the video motion concurrently. Our experimental results show that the proposed event-based processing methods for force and intensity estimation are one to two orders of magnitude faster than conventional methods. Our user study results confirm that the proposed Video2Haptics framework can considerably enhance the users' video experience.

The Impact of Augmented Reality Through User-Platform Interactions Towards Continuance Intention with the Effect of User Generation

When users interact with mobile platforms in an Augmented Reality (AR) environment, cognitive and emotional engagements change through different stimuli cues that respond to users’ behavioral intentions. Although AR engages more interactions in mobile platforms, there is a significant gap in assessing UX, considering the physical distance between users and virtual products in a mobile platform. Considering the effect of user generation, the impacts of perceived engagements toward continuance intention through user-platform interactions are unexplored. This study investigated a nuanced understanding of how stimuli cues in augmented reality affect sense of immersion and sense of presence, followed by an Interaction-Engagement-Intention (I-E-I) model. A quantitative method was used to validate the proposed model. Based on an online survey with 886 responses, product fit, network quality, and Artificial Intelligence-driven Recommendation (AIR) influences were assessed for cognitive engagements. This study examined the importance of engaging satisfaction and trust as emotional engagements, influencing users’ continuance intention. The findings showed that sense of presence has a more significant influence on building trust and satisfaction. Also, trust has a more significant impact on the continuance intention to use AR mobile platforms. This study also explored the positive effects of user generation on continuance intention. This could enhance the capabilities of information system designers, researchers, marketing professionals, and solution providers to attain sustainable user retention.

A Novel Ungrounded Haptic Device for Generation and Orientation of Force and Torque Feedbacks.

To provide deeper immersion for the user in the virtual environments, both force and torque feedbacks are required rather than the mere use of visual and auditory ones. In this paper, we develop a novel propeller-based Ungrounded Handheld Haptic Device (UHHD) that delivers both force and torque feedbacks in one device to help the user experience a realistic sensation of immersion in a three-dimensional (3D) space. The proposed UHHD uses only a pair of propellers and a set of sliders to continuously generate the desired force and torque feedbacks up to 15N and 1N.m in magnitude in less than 370ms, respectively. The produced force and torque feedbacks are oriented in a desired direction using a gimbal mechanism where the propellers are mounted inside in such a way that a simple structure is obtained. These features facilitate the control of the proposed UHHD and enhance its practicality in various applications. To prove the capability of the system, we model it and elaborate on the force and torque analyses. Next, we develop a robust parallel force/position controller to tackle the structured and unstructured uncertainties. Finally, a measurement setup is manufactured to experimentally evaluate the performance of the UHHD and the controller. The implementation of the controller on the developed UHHD prototype shows that a satisfactory control performance is achievable in terms of offering the desired force and torque feedbacks.

Mixed reality strategies for piano education

Head-mounted mixed reality interfaces, in which a user perceives a seamless blend of real, virtual or remote content, have great potential in a wide range of educational contexts. In this paper, we explore the use of mixed reality (MR) in piano education. We begin with a review of previous examples of virtual and mixed reality for piano teaching and learning, identifying four major categories of functionality: remote teaching, learning to read musical notation, providing alternative notation systems to Western musical notation, and enhancing users’ understanding and experience of music. Following this review, we present an application designed to demonstrate the use of MR for facilitating remote student-teacher piano lessons. Additionally, hand-tracking enables real-time, bi-directional visualization of both the student’s and teacher’s hand movements while playing, which is a crucial communication channel in piano instruction. We also present the Piano Theory Hub, an interactive area for independent learning and practice designed to compliment remote instructions. The Piano Theory Hub uses MR to provide spatial in situ explanations and exercises on notes, intervals, scales, and chords. User studies were conducted to evaluate both remote and solo aspects of the application. The first study with 10 participants revealed a strong sense of immersion and co-presence with the teacher during remote lessons. Trials also revealed that, in addition to virtual hands, visual highlighting of key-presses was found to improve visualisation of the remote users’ play. The second study, with 15 participants found the Piano Theory Hub to be helpful for beginners and some intermediate players, with feedback suggesting improvements in user experience and highlighting the limitations of replacing traditional piano teachers. Our experiments demonstrate that MR can be successfully employed for the following strategies for piano education: hand interaction coaching, flexible virtual hand and piano visibility, augmented feedback including key highlighting, gamified learning elements, and flexible teacher positioning options. Overall, the findings suggest that mixed reality holds promise as an effective tool for remote piano learning and music education, offering immersive and engaging learning experiences.

Exploring the Viewer’s Role in Narrative-Based Animated Virtual Reality Experiences: Strategies for Role Activation and Immersive Storytelling

Virtual reality (VR) storytelling offers immersive experiences that engage viewers in unique and interactive ways. This study investigates the viewer’s role within animated narrative-based VR and explores strategies and techniques employed to facilitate this engagement. Using thematic analysis, the authors examined 22 animated VR experiences and identified six key themes: viewer interaction, virtual body, viewer’s spatial perspective, voice of the narrator, directed viewing and providing options. These themes encompass various strategies used to activate the viewer’s role and enhance their immersion in the narrative. The findings reveal that interactive elements, such as viewer interactions and decision-making opportunities, contribute to a heightened sense of agency and immersion. Additionally, the incorporation of a visible and functional virtual body, strategic placement of the viewer and guidance from a narrator potentially shape the viewer’s experience and understanding of the narrative. However, it is essential to strike a balance between directed viewing and viewer agency to ensure a satisfying and engaging storytelling encounter. The implications of these findings provide valuable insights for VR creators, highlighting the importance of considering these strategies when designing narrative-based VR experiences. By utilizing these techniques effectively, creators can craft immersive and engaging VR narratives that captivate and involve viewers in dynamic and meaningful ways.

Exploring the Implementation Methods of AI-Driven Robots in Media Interaction Experience Design

The purpose of this study is to deeply explore the innovative implementation methods of artificial intelligence (AI)-driven robots in media interactive experience design. Firstly, this paper expounds how AI-driven robot technology can provide users with a more natural and intelligent interactive experience through natural language processing (NLP), speech recognition, computer vision and other technologies, thus enhancing users' sense of participation and immersion. In order to realize the efficient application of AI-driven robot in media interaction, this study proposes a series of implementation methods, including improving the accuracy and personalization of robot interaction by using NLP and deep learning algorithm; Identify user expressions and gestures through computer vision technology to enhance the naturalness of interaction; Multi-modal interactive technology is used to integrate multi-sensory channel information to provide comprehensive interactive experience; Use deep learning technology to train the robot's ability to perceive and understand users' needs, and introduce emotion analysis technology to realize more humanized service; By constructing user portraits, we design personalized interaction schemes that adapt to different scenarios and users. In the experimental part, three different scenes, library, shopping mall and museum, are selected to verify the effectiveness of the design scheme. The results show that the AI-driven robot significantly improves the user's satisfaction and emotional experience under the personalized interaction scheme.

The potential use of immersive virtual environments for collecting and archiving heritage gameplay activities in digital libraries

Purpose This paper aims to discuss and propose the potential use of immersive virtual environments (IVEs) for archiving and collecting heritage gameplay activities in digital libraries, which is expected to triangulate further discussions on the said knowledge scopes. Design/methodology/approach The key question of this paper is, how we can preserve and revitalize fading heritage game activities in digital libraries? To answer this, the paper is going to understand the applications of IVEs in heritage studies; the use of telepresence experiences in IVEs for activity-based collection; the creation of virtual and telepresence experiences in digital libraries; and a proposed use of IVEs for archiving heritage gameplay activities. Findings The applications of IVEs and/or other virtual technologies have certainly been gaining positive feedback about their ability to provide vivid images of artefacts and art pieces; perform a high level of interactivity between the exhibits and visitors; enhance visitors’ sense of immersion that evoke their memories of heritage issues; facilitate visitors’ learning process in libraries; increase enjoyment in digital libraries. As mentioned in the previous section, the activity-based historical collection, for instance, the heritage gameplay activities, can be preserved and archived vividly using IVEs. Research limitations/implications This paper is explorative, there is no empirical result for generalization. Originality/value This paper aims to provide librarians with valuable insight to apply IVEs for archiving and collecting heritage gameplay activities. Setting up a new type of digital library is affected greatly by the openness of librarians, visitors’ expectations and a whole lot of things that are happening around the technological world and digital culture. This paper addresses the applications of IVEs in heritage studies, the importance of creating virtual and telepresence experiences for library visits as well as proposing the use of IVEs for archiving heritage gameplay activities.

A Study of Game Localization Translation under the Perspective of Skopos Theory--Taking the Game Red Dead Redemption 2 as an Example

As economic globalization continues to advance, the international market for video games is rapidly growing. For game companies aiming to expand their business globally, the localization of game translations is a crucial aspect. A well-executed localization can greatly boost a game’s international sales and appeal, attracting players from diverse regions. Thus, game localization is a vital strategy for companies seeking success on the global stage. Skopos theory, a key framework in translation studies, offers valuable insights for different types of translation work. This paper applies the principles of Skopos theory to examine the Chinese localization of various texts in the large-scale single-player game Red Dead Redemption 2. The analysis reveals that, under the guidance of Skopos theory, the localization enhances both the gaming experience and the sense of immersion for Chinese players. During the localization process, the translation, adaptation, or even rewriting of the original text is performed with the goal of aligning the final product with the cultural and linguistic preferences of local players.

Rehabilitation exoskeleton system with bidirectional virtual reality feedback training strategy

AbstractVirtual reality (VR) technology revitalises rehabilitation training by creating rich, interactive virtual rehabilitation scenes and tasks that deeply engage patients. Robotics with immersive VR environments have the potential to significantly enhance the sense of immersion for patients during training. This paper proposes a rehabilitation robot system. The system integrates a VR environment, the exoskeleton entity, and research on rehabilitation assessment metrics derived from surface electromyographic signal (sEMG). Employing more realistic and engaging virtual stimuli, this method guides patients to actively participate, thereby enhancing the effectiveness of neural connection reconstruction—an essential aspect of rehabilitation. Furthermore, this study introduces a muscle activation model that merges linear and non‐linear states of muscle, avoiding the impact of non‐linear shape factors on model accuracy present in traditional models. A muscle strength assessment model based on optimised generalised regression (WOA‐GRNN) is also proposed, with a root mean square error of 0.017,347 and a mean absolute percentage error of 1.2461%, serving as critical assessment indicators for the effectiveness of rehabilitation. Finally, the system is preliminarily applied in human movement experiments, validating the practicality and potential effectiveness of VR‐centred rehabilitation strategies in medical recovery.

Assessing the Determinants of Metaverse Adoption for E-Commerce Retailing

ABSTRACT The advent of metaverse technology has impacted the retail sector, shaping e-commerce platforms into a new form of metaverse-based online shopping environments. The metaverse e-commerce experience is new to shoppers, making it crucial to comprehend consumer reactions to this technology in the context of retail. This study explores the shopping intention and potential use of the metaverse for shopping using the UTAUT2 model and metaverse-based context-specific antecedents. Using a structured questionnaire, data from 1340 consumers were collected and analyzed through PLS-SEM. The findings indicated that factors such as performance expectancy, effort expectancy, social influence, hedonic motivation, and facilitating conditions influence shopping intention in the e-commerce metaverse. The metaverse-related antecedents, namely, a sense of immersion and imagination, have a positive influence, whereas technological anxiety and perceived security and privacy concerns have a negative impact on e-commerce shopping intention in the metaverse. It was also found that shopping intention influences the potential use of metaverse for shopping and that stickiness to traditional shopping negatively moderates this relationship. This unique research explores consumer buying behavior in the metaverse. It provides marketers, e-commerce managers, designers, and developers of metaverse platforms with the antecedents of the potential use of the metaverse for shopping insights. Consumer policymakers can also draw insights from this study.

Rapid and sustained reduction of treatment-resistant PTSD symptoms after intravenous ketamine in a real-world, psychedelic paradigm.

Traditional treatments for post-traumatic stress disorder (PTSD) often show limited success with high dropout. Ketamine, an N-methyl-D-aspartate antagonist known for rapid antidepressant effects, has decreased PTSD symptoms in some studies but not in others. Administering ketamine in ways that parallel psychedelic-assisted treatments-including preparatory, integration, sensory immersion, and psychotherapy sessions-could decrease PTSD symptoms meaningfully. A retrospective sample of 117 screened outpatients with elevated PTSD Checklist for DSM-5 (PCL-5) scores received intravenous ketamine in supportive environments. The protocol included preparation, intention-setting, and integration sessions accompanying at least six administrations. Administration sessions included eye shades and evocative music paralleling typical psychedelic therapy trials. Mean PCL scores decreased from 52.54 (SD = 12.01) to 28.78 (SD = 16.61), d = 1.64. Patients tolerated treatment well, with no serious adverse events. Covariates, including age, gender, days between PCL assessments, number of psychiatric medications, and suicidal ideation were not significant moderators; concomitant psychotherapy did reach significance, d = 0.51. Of the 117 patients' final PCL scores, 88 (75.21%) measures suggested clinically meaningful improvement and 72 (61.54%) suggested remission of PTSD symptoms. Intravenous ketamine in supportive environments, with hallmarks of psychedelic therapy, preceded large reductions in PTSD symptoms. These results highlight ketamine's potential when delivered in this manner, suggesting environmental factors might account for some variation seen in previous work. Given the molecule's cost, minimal interaction with other psychiatric medications, and legal status, intravenous ketamine in a psychedelic paradigm may be a promising option for PTSD unresponsive to other treatments.

Walking Methodologies in the Uplands of the North York Moors National Park

As a research interviewer, walking alongside research participants is a creative methodology that enables researchers to discover more democratic, richer data on places, spaces, and surroundings. This article reflects upon walking methods in National Park landscapes from experiences of working on a social research project, which applied a walking methodology in the North York Moors National Park. From the findings of this project and drawing on walking methods literature, the article argues that walking blurs any cultural–natural divisions and allows the interview to be placed into a natural environment where the interview is influenced and shaped by the landscape. The article contributes to the social sciences by innovatively demonstrating how walking acts as an everyday, collaborative research method which through its multi-sensory interactions is an important approach to understand non-human environments and protected landscapes. Applying a participatory research lens, the article reveals the relationships between walking and routine, heritage, participation, nature, sensory immersion, and identity in a contested environment.

Unified Effort: Developing a Mixed Reality Serious Game for Collaborative Crisis Management Training

Abstract: Crises and disasters include both predictable and unpredictable events. In a turbulent world that has recently experienced a pandemic and wars, and is increasingly affected by climate change, there is a growing need to develop effective public crisis management capabilities. Emergency preparedness is a critical foundation for crisis management. Training and exercises are essential components of preparedness and are becoming increasingly relevant for a wide range of organisations in society. To achieve a unified response to threatening events, a wide range of actors - with different backgrounds, objectives, competencies and organisational frameworks - must overcome the challenges of working together. To address this complex situation, forums for knowledge sharing and learning are required. Serious games in mixed reality can be used as a platform for collaborative training and serve as such a forum. Mixed reality systems connect virtual and physical reality, providing users with a sense of immersion, engagement and interaction in both environments. The aim of this paper is to design a short, serious game for collaboration training with two command levels in a mixed reality. Theories of crisis management, along with related research on serious games design, create the framework for the game. The game content was further developed in a co-design process with selected professionals. This paper describes the development of the “Unified Effort” game. The serious game is designed for basic training of municipalities and county offices in soft skills such as communication, situational awareness and group decision making. The game is not intended to replace hard skills such as procedural training and field drills, but can be used as a supplement to this type of training.

Designing for human-nature connectedness: A case study of the Barefoot Path Spalt, Germany

There is a need to bridge the disconnection between humans and nature through conscious landscape architectural designs. Recreation infrastructure can be a tool to guide humans towards a stronger connection with nature, improving health, welfare, and care for environmental issues. Considering Haraway's (2016) work on making kin with the more-than-human other and being with the trouble through cognisant presence of the self within a natural world, it appears that progress towards human-nature connectedness is stunted by commodification of the natural environment. This is reflected in nature discourse, and a risk perception driven by fear of nature which has become the unknown. A mixed methods study of the Barefoot Path Spalt, Germany, implementing document analysis, interviews, and criticism incorporating autoethnography and expert field assessments, generated knowledge on how trail designs can improve human-nature connectedness. The study based its findings on three major trail attributes, environmentally conscious trail design, the barefoot component, and interactive equipment and art. Results show that an intrinsic connection with the environment can be targeted with intentional trail design that entices curiosity, gradually guiding participants to build human-nature connectedness, contesting false risk perception. Management implicationsResults show that well designed trails have the potential to enhance human-nature connectedness with relatively cost-effective implementations. Future trail development and upgrades should consider (1) Conscious integration of a trail into the natural environment through a low-impact approach. (2) Using a creative feature that delivers a unique, nature-centric experience, for example through sensory immersion. (3) Installing both play equipment and art to mask the border between trail and context environment makes use of, and encourages more traffic to a trail, generating positive nature-contextual experiences.

Enhancing immersive sensation at the Iwami Kagura performance space using omnidirectional speakers: a case study of the worship halls at Shrines in the Iwami region, Japan

Iwami Kagura, originated from Iwami region in western Shimane, Japan-is a religious rituals narrating Japanese mythology has been persevered through centuries, maintaining its relevance in the present time. These religious rituals mainly dedicated to gods, features dynamic masked dance, fast music and vibrant costume creating an immersive experience for diverse audiences. The Iwami Kagura performances are popular inside and outside of Japan making a source of tourism for the region. Originally, Iwami Kagura was performed in the worship halls at shrines, therefore, it is important to understand the sacred atmosphere created by the performance considering acoustic measures that make the space immersive. In this study, we focused on the Iwami Kagura performed at worship halls of two shrines and compared the acoustic effects of omnidirectional speakers in both the shrines. Usually, directional speakers are used to amplify parts of performers' voices and music, however, performing space at shines are small in volume, and the directional speakers will provide strong direct sound to performers' voices and sound of flute. Thus, we studied acoustic characteristics of performance space within the precincts of the shrines, the acoustic effects of loudspeakers used and improved sense of presence using omnidirectional speakers.

Enhancing User Experience on Social Media Platforms: A Flow Theory-Based Approach

In recent years, social media platforms, such as Facebook and Twitter have seen rapid growth and are favored by users of all ages. However, in the age of information overload, the quality of interactions on social media platforms varies significantly, leading to negative feelings among users and affecting their overall experience and loyalty. This study takes the Flow theory as its starting point and investigates the needs of social media users at various stages of the flow experience. We propose modifications to the flow theory model with the aim of enhancing user experience and satisfaction. Firstly, based on literature review, we identify micro-level issues of the product, propose hypotheses, and construct validation experiments in the context of social media. The experiment collects Electrodermal Activity (EDA) and heart rate variability (HRV) data of 31 participants using a multi-channel physiological instrument and collects their emotional experience data using the Pleasure-Arousal-Dominance (PAD) scale. Results indicate that a combined textual-graphical interface layout is superior to other layouts in positively inducing flow and emotional experiences. Positive content tonality is more effective at eliciting positive flow and emotional experiences than negative or neutral content. Video presentations have a stronger sense of immersion and emotional expression, making them more conducive to inducing flow experiences and positive emotional feedback. This study, grounded in user psychology, provides a theoretical framework based on flow and emotional experiences for social media product design, quantitatively examining the positive psychological activities of users when using social media.