Immersive Reality Research Articles

Body of Mine, Yours, and Everyone in Between: Communicating Gender Dysphoria Through Immersive Storytelling

<div><span>This article explores the potential of new, immersive realities to convey the complex experiences of gender dysphoria and body dissatisfaction, using the innovative and multi-award-winning experience <em>Body of Mine</em> as a case study. Recognizing a gap in understanding and empathy towards gender-queer communities, <em>Body of Mine</em> employs an innovative full-body tracking solution to place users into the body of someone else, combined with first-person documentary interviews and interactive elements aimed at fostering a deeper connection and insight into the transgender experience. Initial feedback from users indicates a heightened awareness and emotional connection to the challenges faced by individuals with gender dysphoria, as well as an increase in self-body positivity, based on a study conducted in collaboration with the University of Tübingen’s Department of Psychology. This project underscores the power of immersive storytelling in fostering embodied understanding, while also acknowledging the ethical complexities and voyeuristic risks when sharing narratives from vulnerable communities, and explores innovative methods for tackling social issues through emerging technology. It concludes by contemplating the implications of immersive technologies for the concept of identity in a world that increasingly transcends the physical body, suggesting a future where the notion of self is not confined to physical form but is fluid, multifaceted, and continually redefined within boundless digital horizons.</span></div>

Exploring perception and immersive experience of visually impaired people in 360° video and 3D ambisonic audio

For a long time, immersive experiences have been designed with primarily sighted users in mind. However, recent advancements open exciting possibilities for expanding this realm to include individuals with visual impairments such as Cataracts, Glaucoma, and Severe low visual. One promising avenue lies in utilizing 360-degree videos with 3D Ambisonic audio recordings to create immersive experiences specifically tailored to their unique perceptual abilities. In this context, this preliminary study investigates audio-visual perception and presence of visually impaired people (VIP) in immersive reality (IR) environments, by applying 360-degree video and 3D Ambisonic audio recordings in three different environments of a public park "Parking area, Green space, and Playground". The methodological approach of this study is based on a comparative study between sighted (SIG) and visually impaired people (VIP), by conducting questionnaires such as the presence questionnaire and the emotional salience questionnaire. The findings show that both categories can experience the same presence within the IR environment with a difference in the evaluation of the acoustic environment, where the visually impaired show a greater influence on mechanical sounds. By designing inclusive experiences for all, IR has the potential to be equally engaging and immersive for everyone, regardless of sight.

Assessing Student-User Experience in Building Design Studios Using Advanced Intelligent Tools: A Pilot Study at the University

Recent advancements in technology have revolutionized various fields, including architecture education. However, studies exploring immersive realities in architectural design studios remain limited. This research addresses this gap by conducting a pilot study at the Architectural Engineering Intermediate Design Studio, which thoroughly explores the use of Virtual Reality (VR) to help architectural students enhance their design skills, detect design flaws and clashes between different systems, and provide valuable insights for the advancement of architectural education and practice. The study will adopt a qualitative methodology that utilizes in-depth interviews conducted with the students while they explore their designs using VR hardware. The research findings revealed the effectiveness of VR in identifying the following: Enhancing the visualization of design challenges, providing a comprehensive building assessment, and holistically detecting design qualities and system integration problems. The pilot study recommends integrating the use of VR into the curriculum of the intermediate design studio level at the University. The research findings will contribute to the current knowledge base and guide future advancements in immersive design technologies.

EXPERIENCE MUSEOLOGY AND EPHESUS EXPERIENCE MUSEUM

In the rapidly changing world of the 21st century, museums are not only places where exhibits are stored, but also turn into experience centers that offer more opportunities to their visitors. As a concept created by this transformation, the experience museum offers visitors the opportunity to interact not only by watching the works, but also by experiencing the artifacts and historical processes. In addition, in this process, concepts such as experience museology and immersive reality have emerged with the use of technological tools such as AR (Augmented Reality), VR (Virtual Reality), MR (Mixed Reality), AI (Artificial intelligence), hologram, simulation and 360-degree video mapping. With the technologies used in the Ephesus Experience Museum, an immersive environment has been created that appeals to the visual or auditory senses of the audience. While visiting the museum in this immersive environment, visitors also experience the historical process by listening to it through audio guides. In this article, by focusing on the museums developed in line with technological possibilities, the Ephesus Experience Museum was visited and examined in the context of experience museology, and the data obtained from the literature review were tried to be analyzed by comparing them with the experience museums in the west. A different exhibition atmosphere has been created with the technological facilities used in the Ephesus Experience Museum. Visitors' experience of the museum has also increased the information opportunities. At the same time, the deficiencies of the Ephesus Experience Museum have been identified. Celsus (Selçuk) Library, one of the important structures of the ancient city of Ephesus, and other historical buildings were not included in the storytelling, and this created a lack of stories. It is thought that this deficiency can be achieved with QR code or augmented reality applications.

Immersive reality for robotic surgical training: a pilot study using 3D visors for immersive view of the operating field.

Immersive intracorporeal vision is a key feature of robotic surgery, limited today to only one trainee per operation when the dual console is available. We developed a tool that provides a virtually unlimited number of surgeons with the operator's view, with the possibility to also watch the surgeon's hand movements and the operating table. In this study, we aim to assess trainees' reaction to this innovative training method. Medical students and surgery residents were offered an immersive experience with head-mounted devices, showing a didactic video in a 360° virtual space with 3D intracorporeal robotic vision, the surgeon's hand movements and the surrounding operating room during a robotic rectal resection with total mesorectal excision. Subsequently, participants were asked to fill a questionnaire evaluating the user's reaction to the new training tool including the validated System Usability Scale (SUS) and Simulator Sickness Questionnaire (SSQ), and non-validated questions. 102 participants took part in the training and the assessment questionnaires, 94 (92%) medical students and 8 (8%) surgery residents. Users' feedback was overall positive. In the engagement and intention to use items, almost 90% of the respondents voted for a complete or near complete agreement. The median SUS score was 80 [IQR 70-90]. The median SSQ score was 44.88 [IQR 22.44-82.28]. Exposing trainees to immersive robotic vision of the surgical field had a positive reaction from our audience. Our initial results encourage further implementing this technology in surgical training of medical students and residents to prove its efficacy.

Metamorphosis of EduX: a comparative study for education in the metaverse

This research explores critical aspects of the ongoing educational transition from traditional two-dimensional digital platforms toward immersive realities in the metaverse. In this work, a networked, collaborative, ubiquitous, and immersive platform, “EduX” is developed to host different educational sessions. Several metrics are tracked and compared with parallel sessions using traditional digital platforms used by educational institutions, particularly during and after the Covid-19 pandemic, such as Zoom, MS Teams, and Black Board Ultra as the Learning Management System. Four groups of students from different domains of knowledge (n = 396) participated in the study, whereby each group was split into two subgroups, taking their session via EduX and BBUltra, followed by post-assessments and discussions. Using a mixed methods approach, quantitative and qualitative data were collected and analyzed to examine the influence of the platform on engagement, performance, and overall student achievements. The discussed results demonstrate superior usability and user experience levels of the proposed platform, with higher levels of engagement, leading to significantly improved attainments. Other than demonstrating the efficacy and feasibility of the platform, this work establishes fundamental metrics to be considered by software and hardware solution providers, academic institutions, and the research community concerned with the convergence towards immersive technologies.

Correction to: Impact of immersive realities and metaverse in the university training for health professions and medicine: a systematic review of preliminary evidence

Correction to: Impact of immersive realities and metaverse in the university training for health professions and medicine: a systematic review of preliminary evidence

Cardiac arrest and cardiopulmonary resuscitation in the next decade: Predicting and shaping the impact of technological innovations

IntroductionCardiac arrest (CA) is the third leading cause of death, with persistently low survival rates despite medical advancements. This article evaluates the potential of emerging technologies to enhance CA management over the next decade, using predictions from the AI tools ChatGPT-4 and Gemini Advanced. MethodsWe conducted an exploratory literature review to envision the future of cardiopulmonary arrest (CA) management. Utilizing ChatGPT-4 and Gemini Advanced, we predicted implementation timelines for innovations in early recognition, CPR, defibrillation, and post-resuscitation care. We also consulted the AI to assess the consistency and reproducibility of the predictions. ResultsWe extrapolate that healthcare may embrace new technologies, such as comprehensive monitoring of vital signs to activate the emergency system (wireless detectors, smart speakers, and wearable devices), use new innovative early CPR and early AED devices (robot CPR, wearable AEDs, and immersive reality), and post-resuscitation care monitoring (brain-computer interface). These technologies could enhance timely life-saving interventions for cardiac arrest. However, there are many ethical and practical challenges, particularly in maintaining patient privacy and equity. The two AI tools made different predictions, with a horizon for implementation ranging between three and eight years. ConclusionIntegrating advanced monitoring technologies and AI-driven tools offers hope in improving CA management. A balanced approach involving rigorous scientific validation and ethical oversight is necessary. Collaboration among technologists, medical professionals, ethicists, and policymakers is crucial to use these innovations ethically to reduce CA incidence and enhance outcomes. Further research is needed to enhance the reliability of AI predictive capabilities.

Heutagogy and Digital Media: An Exploration into the Digital Migration

Media technology in smartphones and tablets, enables the integration of innovations such as immersive realities. Innovation in mobile media may heighten the chances of problem-solving and skill acquisition for learners (Hernawan et al., 2022). Kugler (2017) predicted that this will be at the forefront of mobile learning. Taking a media studies approach, this paper addresses the question of how Heutagogy in mobile media facilitates and diverse the engagement of learners. Classical studies have restricted communication in learning in direct interaction between the knowledge provider and the learner in a fixed physical location, known as Pedagogy. In a post- covid-world, mobile media apps offer features that may extend the horizon of engagement. This transformation in learners’ autonomy from Andragogy to Heutagogy may pave the way for alternative possibilities in transforming the learning experience. In this paper, I will design a qualitative approach to investigate media and Heutagogy by assessing the autonomy and the engagement of learners with mobile media. I will execute a methodological triangulation between systematic literature review, interviews with learners, and a theoretical framework. The research design will be a sequential and exploratory. Ideally, the analysis will lead to a thematic analysis. The theoretical lens of interpretation will be viewed through the realm of self-determination theory. The findings will purposefully address the motivational elements in learning within a key learning app. The discussion of this paper may aspire to provide original evidence for autonomous learners in the pursuit of skill acquisition via new media. It may explore along the way the learners’ digital migration within the platforms of new media. Finally, this paper may contribute to the continuous progress of learning skills and extend the limits of knowledge regarding new media.

Understanding Media Consumption Habits of Gen Z in Metaverse and Virtual Reality Project

Generation Z, born amidst the digital revolution, navigates a media landscape vastly different from previous generations. Their unique habits, characterized by mobile-first content, community-driven engagement, and a preference for short-form, interactive experiences, present both challenges and opportunities for emerging technologies like the Metaverse and Virtual Reality (VR). This research embarks on an exploratory journey, delving into the nexus between Gen Z's media consumption patterns and their potential adoption of these immersive realities. Through a mixed-methods approach, the research will analyze how Gen Z's digital media preferences, ranging from short-form video platforms to online communities, influence their perception and potential engagement with the Metaverse and VR. In-depth interviews and focus groups will uncover their desired features and functionalities within these virtual environments, ensuring alignment with their existing media consumption habits. Additionally, content analysis of online forums and social media discussions will provide valuable insights into their concerns and expectations surrounding these new frontiers. By understanding the interplay between Gen Z's media consumption and their potential engagement with the Metaverse and VR, this research aims to achieve several key objectives. Firstly, it seeks to identify the potential influence of their media habits on their willingness to adopt these technologies. Secondly, it aims to explore their desired functionalities and the types of content they envision within these virtual spaces. Furthermore, the research strives to investigate the role of online communities and influencers in shaping their attitudes and decisions regarding the Metaverse and VR. Finally, it seeks to address the potential risks and ethical considerations associated with Gen Z's participation in these immersive realities, aiming to pave the way for a more inclusive and responsible digital future.

Immersive Reality in Education: Transforming Teaching and Learning through AR, VR, and Mixed Reality Technologies

Background and Aims: Understanding how immersive technologies like AR, VR, and MR can transform education by enabling interactive and experiential learning. By addressing adoption challenges and highlighting successful case studies, it aims to help educators and policymakers effectively integrate these technologies while promoting equitable access and informed decision-making. Thus, this paper aims to explore the role of AR, VR, and MR in enhancing learning experiences. Methodology: The methodology ensures a thorough review by taking a systematic approach to data collection and analysis from various sources, with a focus on recent advances in immersive technologies. By combining qualitative and quantitative analyses, the paper aims to provide a comprehensive overview of how AR, VR, and MR affect educational practices and outcomes. Results: Augmented Reality (AR), Virtual Reality (VR), and Mixed Reality (MR) improve education by making difficult concepts more accessible and engaging. AR makes abstract concepts tangible, VR provides immersive experiences for deeper understanding, and MR connects the digital and physical worlds. These technologies work together to create interactive learning environments that meet a variety of learning needs, promote critical thinking, and encourage creativity. Conclusion: Augmented Reality (AR), Virtual Reality (VR), and Mixed Reality (MR) all improve education by making complex concepts more understandable and engaging through interactive experiences. These technologies create a dynamic learning environment by combining AR's tangibility, VR's immersion, and MR's integration of the digital and physical worlds.

Impact of immersive realities and metaverse in the university training for health professions and medicine: a systematic review of preliminary evidence

Impact of immersive realities and metaverse in the university training for health professions and medicine: a systematic review of preliminary evidence

An exploratory study on manifesting decision-inertia in a 360-degree extended reality terrorist incident

Emergency response decision making is crucial in managing critical incidents; however, several studies have demonstrated the negative effects of decision inertia. Understanding the manifestation and impact of decision inertia, as well as utilising extended reality (XR) technology with 360-degree immersion, should enhance decision making in high-stress environments and improve emergency response efforts. This study investigated decision inertia, using 109 participants, in an XR 360-degree environment and its impact on decision-making outcomes. The findings revealed that participants often opted for a sub-optimal outcome, and decision inertia scores varied across these outcomes. Linear regression analysis demonstrated that decision inertia scores significantly predicted decision outcomes, with higher decision inertia scores associated with sub-optimal decision-making. Participants prior moral decision-making did influence subsequent immersive reality decision outcomes and demonstrated a Bayesian updating effect. The Structured Tabular Thematic Analysis highlighted the importance of information validity, decision confidence, and scenario fidelity in decision-making within the immersive environment. The study provides insights into decision inertia in immersive virtual reality critical incidents and offers practical solutions for improving decision-making processes in emergency response contexts.

Dental implant placement with immersive technologies: A preliminary clinical report of augmented and mixed reality applications

A preliminary clinical report of implant placements with 2 immersive reality technologies is described: augmented reality with head mounted display and mixed reality with a tablet PC. Both immersive realities are promising and could facilitate innovative dental applications. However, mixed reality requires further development for clinical optimization.

Shared attention in virtual immersive reality enhances electrophysiological correlates of implicit sensory learning

Shared attention effects on learning and memory demonstrate that experiences are amplified when we are not alone. Virtual reality poses new challenges to the study of co-presence. Above all, is coattending together with someone else’s avatar in an immersive VR setting comparable with shared experiences at a neural processing level? In the present study we investigate shared attention effects in VR for the first time. We recorded mismatch negativities (MMN) during an auditory roving paradigm, a well-known index of implicit perceptual learning. EEG responses to deviant and standard sounds were registered while subjects were alone (Solo condition) or together (Other condition) with a virtual avatar (Virtual scenario) or physically present confederate (Physical scenario). We found an overall main effect of co-presence on MMN revealed by a point-by-point 2 × 2 ANOVA, thereby replicating previous studies on physical co-presence. Additionally, we found no significant interaction between the scenario (Physical vs. Virtual) and co-presence (Solo vs. Other). Our results indicate that virtual immersive co-presence mimics physical co-presence.

Immersive Realities: A Comprehensive Guide from Virtual Reality to Metaverse

This comprehensive literature review explores the diverse landscape of immersive realities, offering a thorough examination of key technologies from Virtual Reality (VR) to the emerging and innovative concept of the Metaverse. The article concentrates the nuances of Extended Reality (XR), Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR), providing an in-depth understanding of their individual functionalities, applications, and evolving interplay. The paper also mentions about wearable technologies which play key role in the realization of these immersive realities. The article begins by explaining the fundamental principles of each immersive reality, tracing their technological evolution and highlighting distinctive features that define their user experiences. It then navigates through the complex intersections and synergies between these immersive technologies, shedding light on how they collectively contribute to shaping the future of digital interaction. The paper unfolds how the journey of immersive realities lead to the Metaverse which is relatively a novel paradigm that transcends individual immersive realities, creating a unified, interconnected digital space. The exploration of the Metaverse encompasses its conceptual foundations, potential societal impacts, and the fusion of various immersive technologies within this evolving ecosystem. With an inclusive approach, this paper caters to both novices and seasoned professionals in the field, offering insights into the practical applications associated with different immersive realities. By fostering a comprehensive understanding of these technologies, the paper aims to empower readers to navigate and contribute to the dynamic landscape of immersive realities.

Development of the Software agent «AIA» in the framework of IITU MetaUniversity Design

Metauniversity represents an innovative educational concept due to its ability to integrate different educational fields, providing students with unique opportunities for in-depth and multidisciplinary learning. The relevance of the Metauniversity is manifested in its ability to adapt to the rapidly changing needs of the labor market and society as a whole. Adaptability, versatility, and emphasis on diversified development make the Metauniversity an important element of the modern educational system. Metauniversity’s AIA software agent provides an innovative means of effective and personalized support to students, faculty, and staff. This intelligent assistant works based on advanced technologies and artificial intelligence, providing a unique interaction experience in the educational environment of the Metauniversity. The article provides an overview of the Metauniversity concept, including opportunities and limitations. Development of Metauniversity using augmented and virtual reality in the International Information Technology University (IITU, Almaty, Kazakhstan) is presented. The model of Metauniversity and the architecture of the software agent are presented. It is shown that the developed concept of a Metauniversity emphasizes the importance of combining various educational disciplines and fields of knowledge. Also important is the integration of modern technologies, including artificial intelligence and immersive reality.

Design for Global Challenges

The current emergencies such as climate change and sustainable development, are outlining the responsibility we have as researchers and designers to transform disruptive technologies into action/reaction tools able to address and overcome the nowadays challenges. From this perspective, as designers, we indeed believe that the key to change lies in human behavior, and thus precisely in this direction design can impact using disruptive technologies in raising awareness by resulting into behavioral change. Specifically, this paper aims to encompass how advanced technologies such as Data Visualization and Immersive Realities can cooperate in order to activate proactive behaviors in contemporary society through a careful analysis of opportunities and limitations. On the one hand, Data Visualization has always been used as a tool for analyzing and communicating emergencies (Snow, Nightingale, etc.), on the other hand, immersive realities are more recently beginning to explore this field. It is indeed at the meeting point between technology and Human Interface that the biggest gaps emerge, sometimes making the deployment of these technologies fail, due to sensory, sociological, psychological, and cognitive limitations. Have we ever wondered, for example, whether the rules of Gestalt and Bertin's theories, belonging to the first half of the 1900s, are sufficient today in making effective Data Visualization? Are we relying too much on the "astonishing" effect of immersive realities, paying more attention to their use rather than to the conveyance of the content? This paper attempts to critically analyze – in a multidisciplinary way and through a historical analysis, case studies, and personal experimentation – the use of disruptive technologies, such as XR and Data Visualization, trying to clarify their limits, potentialities, and plausible common application fields. The objective of the study is in fact related to the determination of possible theoretical and practical approaches for the development of validation tests regarding the use of disruptive technologies and their relationship with the Human Interface.

The role of metaverse on sexual health of people with disabilities: narrative review.

Metaverse is the implementation of an Internet-based hypothetical meta-universe, which should facilitate an immersive experience in meeting people, working, shopping and other leisure activities. Immersive reality makes it possible to feel involved in a virtual environment using the mechanism of the "embodied simulations", i.e., the capacity to evoke a sense of presence in a specific reality, whether real or imagined. The growing interest in the metaverse suggests exploring how this new kind of communicative space could be used to provide and guarantee sexual entertainment and/or education for people with disabilities. Through a thematic analysis, we aimed to define the theoretical framework and analyze scientific literature on this subject. Our purpose is to provide a comprehensive picture of the use of metaverse as a tool for sexuality, and of the possible benefits of such technologies for people with disabilities. To this end, we have also discussed a major topic, related to the Sexual Assistants, examining how their possible application can be implemented within the context of augmented reality. Our study further explores the importance of the metaverse in sexual education. Finally, we addressed the issue of cyber security as well as possible threats and negative consequences linked to metaverse misuse.

User and Content Dynamics of Edge-Aided Immersive Reality Services

User and Content Dynamics of Edge-Aided Immersive Reality Services