Immersive Experience Research Articles

What Educational Escape Rooms can Learn from the World's Best Rooms

In the context of playful learning, escape games have the potential to enrich learning experiences through interactive problem-solving and narrative engagement. However, educational escape games differ significantly from the commercial offerings they reference in name and game mechanics. They often draw on the concepts of escape rooms that were popular a decade ago, relying primarily on traditional puzzle types such as code deciphering and number locks. Meanwhile, commercial escape rooms have evolved significantly over the past ten years, now offering highly immersive experiences based on captivating stories, convincing scenographic presentations, and well-thought-out tension arcs. Each year, enthusiasts vote for the top 100 escape rooms in the world. To investigate which best practices from these rooms can be applied to educational games, my master's thesis, which forms the basis of this paper (Neubig 2024) analyzed 38 of these award-winning games in detail. This analysis covered the gameplay, puzzle typology, room design and player guidance, as well as interactions with the game masters. Significant patterns were identified in all these areas that can be utilized in the design of educational games. Simultaneously, it reveals the types of challenges that the world's best games almost entirely avoid, despite their popularity in educational games. The study provides detailed insights into the diversity of puzzle types used, their variations throughout the game, and identifies particularly effective puzzle combinations. Escape games as a method of knowledge transfer have been adopted worldwide in schools, universities, museums, and libraries. They are used in various ways, such as recruitment tools, as orientation aids for institutional services, or to promote specific or generic knowledge and skills (Veldekamp et al. 2020). This work emphasizes the necessity to adapt educational games to the latest developments in the escape game industry if they are to be classified within this genre. In doing so, they can fully leverage the potential of escape games to create an engaging and motivating gaming experience.

Transforming academic assessment: The metaverse‐backed Web 3 secure exam system

AbstractMetaverse—a three‐dimensional computational environment—combines physical and virtual reality to enable social relationships and immersive experiences by mimicking real‐world scenarios. Metaverse is considered the third wave of the internet revolution (exploiting Web 3.0), leveraging upcoming technologies such as extended reality and artificial intelligence shaping a new era of human–‐machine interactions. In recent years, increased research and development on educational technologies (EduTech) based on blockchain technology has seen substantial growth of metaverse‐based solutions within the higher education context. This research aims to synergize blockchain technology and metaverse environments to conduct online exams (metaExam) in a trustworthy, reliable, and secure way. The synergy between blockchain and the metaverse brings various benefits, such as improved security, cost effectiveness, and increased efficiency in the online examination process. One of the central features of the proposed solution metaExam is to leverage cryptographic protocols via blockchain to control data access, making verification faster and protecting against misuse. Exam scores and grades are stored on a blockchain ledger using a digital signature method to enhance security. We validated the proposed solution by testing a prototype on the Ethereum platform using the Sepolia Testnet network using Microsoft Windows environment. Evaluation results indicate (i) query response time (10–50 ms), (ii) and query execution performance (CPU utilization between 1%–5%) offering computationally feasible solution. This research contributes by integrating blockchain and metaverse technologies to offer a solution metaExam that can offer improved security and immersive user experience for exam management. The proposed solution and its validation can provide insights into transforming online exams, offering a fresh perspective on addressing concerns about exam grade authenticity and verifying academic credentials in EduTech.

Vision-sharing system for android avatars to enable remote eye contact

Maintaining eye contact is a fundamental aspect of non-verbal communication, yet current remote communication tools, such as video calls, struggle to replicate the natural eye contact experienced in face-to-face interactions. This study presents a cutting-edge vision-sharing system for android avatars that enables remote eye contact by synchronizing the eye movements of the operator and the avatar. Our innovative system features an eyeball integrated with a wide-angle lens camera, meticulously designed to mimic human eyes in both appearance and functionality. This technology is seamlessly integrated into android avatars, enabling operators to perceive the avatar’s surroundings as if physically present. It provides a stable and immersive visual experience through a head-mounted display synchronized with the avatar’s gaze direction. Through rigorous experimental evaluations, we demonstrated the system’s ability to faithfully replicate the operator’s perspective through the avatar, making eye contact more intuitive and effortless compared with conventional methods. Subjective assessments further validated the system’s capacity to reduce operational workload and enhance user experience. These compelling findings underscore the potential of our vision-sharing system to elevate the realism and efficacy of remote communication using android avatars.

NFTs for accessing, monetizing, and teleporting digital twins and digital artifacts in the metaverse

Digital twins and digital artifacts have become integral components of metaverse platforms, providing users with a rich, immersive, and interactive digital experience through the deployment of diverse digital twins and digital artifacts such as 3D avatars, images, and objects. To date, a significant challenge persists in the lack of practical mechanisms to enable seamless teleportation and cross-metaverse interoperability for these digital twins and digital artifacts. There is also a lack of trusted monetization methods that facilitate trading and leasing of digital twins and digital artifacts. To address these important challenges, this paper proposes a blockchain and Non-Fungible Token (NFT)-based solution that facilitates the integration and teleportation of these digital twins and digital artifacts by providing trusted metadata, verifying ownership, and ensuring the authenticity of digital creations in the virtual world. Key to our solution is the introduction of a bridging mechanism that enables cross-metaverse interoperability, allowing for the portable transfer of NFTs across decentralized metaverse platforms. In addition, our solution focuses on empowering original digital creators by enabling the monetization of their creations through the ownership management capabilities offered by NFTs. To reliably and securely store the metadata and content of tokenized digital twins and digital artifacts, we integrate into our solution the Interplanetary File System (IPFS), a decentralized storage system. To demonstrate the feasibility of our solution, we have developed and deployed all necessary smart contracts that govern the main functionalities and interactions of the proposed system on the Ethereum Goerli Testnet. We present our proposed system architecture, accompanied by informative sequence diagrams, algorithms, and testing details. We discuss how our proposed solution attains the main objectives outlined in the paper. We evaluate our proposed solution in terms of cost and security. We have made the complete source code of our smart contracts publicly available on GitHub.

Exploring perception and immersive experience of visually impaired people in 360° video and 3D ambisonic audio

For a long time, immersive experiences have been designed with primarily sighted users in mind. However, recent advancements open exciting possibilities for expanding this realm to include individuals with visual impairments such as Cataracts, Glaucoma, and Severe low visual. One promising avenue lies in utilizing 360-degree videos with 3D Ambisonic audio recordings to create immersive experiences specifically tailored to their unique perceptual abilities. In this context, this preliminary study investigates audio-visual perception and presence of visually impaired people (VIP) in immersive reality (IR) environments, by applying 360-degree video and 3D Ambisonic audio recordings in three different environments of a public park "Parking area, Green space, and Playground". The methodological approach of this study is based on a comparative study between sighted (SIG) and visually impaired people (VIP), by conducting questionnaires such as the presence questionnaire and the emotional salience questionnaire. The findings show that both categories can experience the same presence within the IR environment with a difference in the evaluation of the acoustic environment, where the visually impaired show a greater influence on mechanical sounds. By designing inclusive experiences for all, IR has the potential to be equally engaging and immersive for everyone, regardless of sight.

3D audio recording of complex underwater sound fields

In this study, we developed a method to capture underwater sound fields and reproduce them for human listeners, providing an immersive 3D auditory experience. We recorded the sound field with an array of four hydrophones arranged in a tetrahedral structure. The side length of the tetrahedron (around 70 cm) was a compromise between capturing accurately the low frequency pressure gradients and spatial aliasing effects at higher frequencies. Subsequently, we transformed the signals into the domain of spherical harmonics facilitating a representation as first-order Ambisonics that is independent of the recording. For playback on devices such as headphones or loudspeaker systems, we used established decoding routines that enhance the immersive audio experience with techniques such as parametric decoding and diffuse sound field equalization. During an expedition to northern Norway, we recorded the underwater soundscape in deep fjords with vocalizing killer whales and singing humpback whales. The resulting binaural renderings for headphones of these sound scenes are astonishing and sparked interest among scientist, artists and general public. This research also helps to enhance our understanding and perception of these intelligent marine mammals and their unique acoustic underwater world, ultimately aiding in better protecting them from noise pollution.

Reconstructing the soundscape of the ancient Hippodrome of Olympia for an immersive sonic experience of heritage sites based on sound source description in texts

This study attempts to reconstruct and auralize the soundscape of the Hippodrome of Olympia in Greece. This UNESCO world-heritage-listed-site is considered the evidence of the Greek hippodromes. Hippodromes used to have several activities from which different combinations of sound sources created the soundscape. To collect sound sources, description in texts of site is sought by implementing methods of the archaeology of soundscape and the suggested criteria of contextual, internal, and comparative certainty for archaeoacoustics studies. The description of these activities facilitates reconstructing and auralizing the soundscape during different phases of events in the hippodrome. The results of the study showed that the information about the activities on the hippodrome, on similar hippodromes of different civilizations, and on similar hippodromes of later eras are rather sufficient to create a comprehensive soundscape of the site. Auralizing the reconstructed soundscape by using current auralization software and techniques promises of immersive experience of ancient sites that enhances understanding the sonic intangible cultural heritage element and the experience of the ancient soundscape. Furthermore, ancient users' perception of the soundscape can be approached by localizing the sound sources on the site and obtaining the corresponding acoustical properties, providing information of users' response to the sonic outcomes

Enhancing Lessons on the Internet of Things in Science, Technology, Engineering, and Medical Education with a Remote Lab

Integrating remote Internet of Things (IoT) laboratories into project-based learning (PBL) in higher education institutions (HEIs) while exploiting the approach of technology-enhanced learning (TEL) is a challenging yet pivotal endeavor. Our proposed approach enables students to interact with an IoT-equipped lab locally and remotely, thereby bridging theoretical knowledge with practical application, creating a more immersive, adaptable, and effective learning experience. This study underscores the significance of combining hardware, software, and coding skills in PBL, emphasizing how IoTRemoteLab (the remote lab we developed) supports a customized educational experience that promotes innovation and safety. Moreover, we explore the potential of IoTRemoteLab as a TEL, facilitating and supporting the understanding and definition of the requirements of remote learning. Furthermore, we demonstrate how we incorporate generative artificial intelligence into IoTRemoteLab’s settings, enabling personalized recommendations for students leveraging the lab locally or remotely. Our approach serves as a model for educators and researchers aiming to equip students with essential skills for the digital age while addressing broader issues related to access, engagement, and sustainability in HEIs. The practical findings following an in-class experiment reinforce the value of IoTRemoteLab and its features in preparing students for future technological demands and fostering a more inclusive, safe, and effective educational environment.

Eolization: A project on spatial auralisation of wind turbine noise

The increase of onshore wind farm projects in Europe has heightened concerns regarding the noise emitted by wind turbines and the potential nuisance to nearby residents. To address this issue, advanced tools are required for accurately assessing and predicting the noise levels and perceived annoyance from wind turbines. Physics-based auralization emerges as a promising approach for recreating with fidelity wind turbine noise in controlled environments. To enhance the immersive experience, this study proposes to extend the current methodologies with the spatial representation of wind turbine noise using ambisonics. In this work, the sound emitted by each turbine is computed using an extended source model. The propagation is simulated with a parabolic equation method accounting for the flow surrounding the wind turbines. Finally, the signal is auralized and spatialized using spherical harmonic decomposition. This methodology provides a complete framework for predicting and reproducing the three-dimensional time-varying sound field around the listener. Overall, these improvements offer valuable insights into the spatial characteristics of wind turbine noise.

Reconstruction of directional sources using physics-informed neural networks

In the context of augmented/virtual reality applications, replicating the directivity of sound sources is a critical step to ensure a high-quality immersive experience. However, accurate directivity measurements require complex experimental procedures involving a high number of microphones. In these scenarios, spatial interpolation allows to reconstruct the sound field with fewer sensors, which can be sparsely distributed around the source. The literature offers several interpolation schemes for sound field reconstruction, although they exhibit limited accuracy due to the lack of knowledge on the underlying physics. Recently, Physics-Informed Neural Networks (PINN) have been used to directly solve partial differential equations and thus better predict the evolution of dynamical systems. In this manuscript, we propose a spatial interpolation scheme based on PINN for the reconstruction of sound source directivity. PINN are used to solve the Helmholtz equation starting from acquisitions of the directivity over a limited set of sparsely distributed points. Results are compared with the outcomes of well-established methods based on Spherical Harmonics Decomposition (SH), Thin Plate Pseudo-Splines Interpolation (SPLI) and Piece-wise Linear Spherical Triangular Interpolation (TRI). PINN prove to provide better reconstruction of the directivity with respect to the proposed comparison methods, even when dealing with highly sparse sampling grids.

Enhancing immersive sensation at the Iwami Kagura performance space using omnidirectional speakers: a case study of the worship halls at Shrines in the Iwami region, Japan

Iwami Kagura, originated from Iwami region in western Shimane, Japan-is a religious rituals narrating Japanese mythology has been persevered through centuries, maintaining its relevance in the present time. These religious rituals mainly dedicated to gods, features dynamic masked dance, fast music and vibrant costume creating an immersive experience for diverse audiences. The Iwami Kagura performances are popular inside and outside of Japan making a source of tourism for the region. Originally, Iwami Kagura was performed in the worship halls at shrines, therefore, it is important to understand the sacred atmosphere created by the performance considering acoustic measures that make the space immersive. In this study, we focused on the Iwami Kagura performed at worship halls of two shrines and compared the acoustic effects of omnidirectional speakers in both the shrines. Usually, directional speakers are used to amplify parts of performers' voices and music, however, performing space at shines are small in volume, and the directional speakers will provide strong direct sound to performers' voices and sound of flute. Thus, we studied acoustic characteristics of performance space within the precincts of the shrines, the acoustic effects of loudspeakers used and improved sense of presence using omnidirectional speakers.

Immersive and virtual exhibitions: A reflection on… art?

This paper explores the conceptualization and evolution of virtual exhibitions and immersive art experiences, highlighting their distinctions and similarities. Virtual exhibitions, conducted online or through digital media, offer a platform for showcasing artworks to a global audience without physical constraints. They employ multimedia elements to engage viewers and provide flexibility in exploration. Conversely, immersive art experiences create environments that envelop the viewer, stimulating multiple senses and often incorporating advanced technologies, such as virtual reality and augmented reality. These experiences aim to evoke emotional responses and facilitate active engagement with the artwork. While proponents argue that virtual exhibitions and immersive art experiences democratize access to art and offer new avenues for artistic expression, critics have raised concerns about their impact on authenticity, viewer engagement, and art commercialization. Philosophical and cultural perspectives, including phenomenology and postmodern theory, shed light on the complexities of these art forms and their relationship with reality and simulation. This paper, further, examines the social and business implications of virtual exhibitions and immersive art experiences, noting their growing popularity and influence on the art market. It discusses the viewpoints of artists, critics, and scholars, both supportive and critical, regarding technology’s role in art and its effects on the viewer’s experience. Virtual exhibitions and immersive art experiences represent an evolving landscape in the art world, offering opportunities for innovation and debate. Their impact on the perception and consumption of art remains a subject of ongoing discussion. The paper concludes with a review of successful virtual exhibitions, highlighting their role in expanding access to art and cultural experiences globally.

Deciphering the evolution of metaverse - A techno-functional perspective in digital marketing

The metaverse has disrupted the traditional marketing practices and it has potential to transform entire world of marketing activities with thrilling immersive experiences. This study provides an analysis of evolving field of metaverse marketing in the context of information systems using state of the art bibliometric and scientometric tools coupled with machine learning algorithms. Utilizing 257 documents from Scopus database that published between 1996 and 2024, this research maps and unveils the development of metaverse marketing from its inception and the role of information systems in its evolution. The analysis of literature resulted in five main emerging themes of the role of information systems in metaverse marketing research as User Experience, Customer engagement, Convergence of metaverse Technology, Design of virtual goods & experience and Global Social Interaction. The major sub-themes of the study are User Behaviors and Preferences, Branding on virtual environment, Virtual reality, Virtual wearables and Virtual Socialization. This study also reveals the emerging trends and gaps in literature that pave the ways for future research expansion in the information systems and metaverse marketing. Few of the important future research areas identified are understanding user experience, design of immersive customer engagement strategies, customer virtual presence and Security & privacy concerns of the users on metaverse platform.

Unlocking the secrets of change: ethnographic insights into older adults’ leisure time physical activity during COVID-19

ABSTRACT The COVID-19 pandemic brought about significant alterations in various aspects of society, yet its impact on the leisure time physical activity (LTPA) of older adults still needs to be explored. Existing research points to substantial transformations in recreational and sports environments due to the pandemic. This study aims to bridge this gap by conducting ethnographic fieldwork spanning 17 months, delving into how Iranian older adults adapted their LTPA during this crisis. Data were gathered through immersive field experiences, detailed field notes, and opportunistic interviews. The findings reveal two primary shifts in the LTPA of older adults: (1) Disruption of social interactions within physical activities and (2) Psychological uncertainty and perplexity. In response, older adults have employed two coping mechanisms to navigate these changes. This research underscores the importance of policymakers reevaluating their approaches and devising strategies to support the continuity of LTPA, especially in exceptional circumstances like the COVID-19 pandemic.

Process and Practice in New Zealand Enviroschool Implementation

New Zealand's Enviroschools integrate school practice, policy and pedagogy for health promotion and environmental sustainability. We thematically analysed Enviroschools documentation and interviewed participating teachers, school leaders and Enviroschools staff. How adults and students ‘formed’ and ‘sustained’ relationships of interconnection and responsibility with natural and social environments were the key processes of an experiential, cognitive and affective journey. This journey through immersive experiences helps generate inquiry learning, an attunement to context, deeper connections between people and places and, subsequently, embed the approach overtime. The Enviroschools approach has the potential to inform the development of teaching and learning in other jurisdictions.

The Impact of AI on Enhancing Students’ Intercultural Communication Competence at the University Level: A Review Study

This systematic review explores the transformative role of Artificial Intelligence (AI) and Information and Communication Technologies (ICT) in enhancing intercultural communication competence (ICC) at the university level. As AI increasingly integrates into educational settings, its potential to revolutionize student learning and cultural interactions is profound. The review synthesizes findings from 11 empirical studies conducted globally, assessing the impact of AI-driven tools, such as chatbots and virtual reality simulations, on students' ability to handle cultural differences. While AI offers significant benefits in personalizing learning and fostering immersive cultural experiences, challenges remain, particularly in ensuring cultural sensitivity and addressing inequalities in technology access. The review stresses the need for careful integration of AI in education, cautioning the audience about potential pitfalls and emphasizing the importance of human oversight to reduce biases and enhance cultural understanding. The pedagogical implications stress the importance of blending AI with traditional teaching methods to create inclusive learning environments that prepare students for globalized society's demands. The review also identifies areas for future research, including the long-term impact of AI on ICC and the ethical considerations surrounding AI use in education. In the end, this study contributes to the ongoing discourse on AI's role in shaping the future of intercultural education.

Virtual Reality in Waste Management: Evaluating Its Impact on Community Classification Behavior

The purpose of this study is to explore the impact of virtual reality (VR) technology on improving community garbage sorting behavior through a questionnaire survey. Targeting residents of varying ages, educational backgrounds, and lengths of residence in the community, the study utilized VR technology for garbage classification education and behavior guidance. This comprehensive method evaluated improvements in individuals' willingness, cognition, and practices regarding garbage classification. We designed a multi-dimensional questionnaire and employed a random sampling method to select residents who met specific classification criteria as survey subjects. The research involved analyzing the influence of VR technology on enhancing garbage classification cognition across different demographics, exploring how VR can shift attitudes and willingness towards garbage classification, and investigating its role in promoting actual sorting behavior and frequency. Methodologically, we implemented an immersive VR experience that simulated various types of garbage and classification scenarios, followed by preand post-intervention surveys to measure changes in cognition and behavior. Additionally, we examined the interrelationship between VR technology and other influencing factors, such as policy advocacy, educational background, and community environment. The findings indicate that VR technology significantly enhances residents' understanding of garbage classification standards and improves classification accuracy. Furthermore, the visual representation of the negative environmental impacts of garbage, depicted through VR, profoundly heightened residents' environmental awareness and willingness to engage in garbage classification. This study confirms the practical application value and significant impact of VR technology in improving community garbage sorting behavior, providing a scientific basis for its further promotion and application in community waste management practices.

Rewarding interprofessional education: Designing and implementing an IPEP Distinguished Scholars Program

The Interprofessional Education and Practice Distinguished Scholar (IPEP DS) program was developed to reward students who go ‘above and beyond’ required interprofessional education and practice events. IPEP Distinguished Scholars (IPEP DS) must participate in at least two semesters of activities outside of their required IPEP coursework, serve on an interprofessional committee, and complete an interprofessional immersion experience. Following completion of these activities, students compose a reflection essay about their learning and experiences and ultimately receive transcript distinction, cords to wear at graduation, and a Credly™ badge (digital credentialing). This article provides an overview of the design of this program and outcomes for replication at other institutions.

Sustainable environmental education using virtual reality: A module for improving environmental citizenship competences in secondary schools

Sustainable environmental education (SEE) can develop global citizens. However, environmental education in schools does not develop environmental citizenship (EC). Virtual reality (VR) could provide authentic immersive experiences to evoke emotions for positive action for EC. A SEE module, designed to include VR experiences, was evaluated at a secondary school to determine if it could improve students’ EC. A quasi-experimental single-group pre-test post-test design was conducted with 30 students, followed by focus group interviews with the students. The findings indicated the module was effective in improving EC scores. Analysis of interview transcripts indicated students were engaged and motivated to learn with VR and improved in EC competences. However, the future actions for EC were limited to individual actions and not community-based actions. Although there was some potential in the SEE module, some improvements are needed. Future studies could investigate strategies for making students agents of change in the community.

Feeling senseless sensations: a crossmodal EEG study of mismatched tactile and visual experiences in virtual reality

Objective.To create highly immersive experiences in virtual reality (VR) it is important to not only include the visual sense but also to involve multimodal sensory input. To achieve optimal results, the temporal and spatial synchronization of these multimodal inputs is critical. It is therefore necessary to find methods to objectively evaluate the synchronization of VR experiences with a continuous tracking of the user.Approach.In this study a passive touch experience was incorporated in a visual-tactile VR setup using VR glasses and tactile sensations in mid-air. Inconsistencies of multimodal perception were intentionally integrated into a discrimination task. The participants' electroencephalogram (EEG) was recorded to obtain neural correlates of visual-tactile mismatch situations.Main results.The results showed significant differences in the event-related potentials (ERP) between match and mismatch situations. A biphasic ERP configuration consisting of a positivity at 120 ms and a later negativity at 370 ms was observed following a visual-tactile mismatch.Significance.This late negativity could be related to the N400 that is associated with semantic incongruency. These results provide a promising approach towards the objective evaluation of visual-tactile synchronization in virtual experiences.