Extended Reality Technologies Research Articles

Virtual Experiences, Real Memories? A Study on Information Recall and Recognition in the Metaverse

AbstractThere are high expectations towards extended reality (XR), namely the “metaverse”. However, human performance in the metaverse has been called into question when undertaking everyday activities (e.g., working, shopping, and learning etc.), as complex human-technology interaction required may hinder cognitive abilities such as processing of information. Therefore, this study attempts to address whether and how XR impacts abilities to recall and recognize information in daily-life settings. We investigated the effects of VR and AR in a 2 (VR: yes vs. no) × 2 (AR: yes vs. no) between-subjects design experiment related to a shopping task (N = 153) on textual (product names) and pictorial (product pictures) recognition and recall. The results show that textual information recall and pictorial information recognition did not significantly suffer in XR compared to shopping in a brick-and-mortar store. While regarding textual information recognition performance, the results show that fully physical environments offered the highest performance compared to the different XR technologies being used. Overall, the study provides important findings and guidance for the use of extended reality technologies in consumer-facing businesses, as well as the use of XR in everyday life in general.

Stepping into safety: a systematic review of extended reality technology applications in enhancing vulnerable road user safety

Stepping into safety: a systematic review of extended reality technology applications in enhancing vulnerable road user safety

Intelligent Environment using Extended Reality and Machine Learning to Improve Healthcare

Intelligent Environments (IEs) represent a paradigm shift in the way we interact with our surroundings, leveraging Ambient Intelligence (AmI) to create responsive and adaptive spaces that seamlessly integrate technology into the built environment. By harnessing sensors, actuators, and artificial intelligence, IEs have the potential to enhance human experience, improve efficiency, and promote sustainability across various domains, including smart homes, workplaces, cities, and healthcare facilities. This paper provides an overview of IE concepts, discusses key technologies and applications, explores design considerations, and outlines future directions for research and development in this dynamic field. This paper focuses on the study of the potential use of Extended Reality technologies in order to promote Green Health as well as their use in Smart Hospitals, one of the variants of Smart Environments, incorporating Machine Learning and Computer Vision, as a tool to support and improve healthcare, both from the point of view of the health professional and the patient, through a literature review and analysis of the current situation. Resulting in the elaboration of a conceptual model with the suggestion of technologies that can be used to achieve this scenario selected for their potential, and then the development of prototypes of parts of the conceptual model for Extended Reality Headsets as concept validation.

PLUME: Record, Replay, Analyze and Share User Behavior in 6DoF XR Experiences.

From education to medicine to entertainment, a wide range of industrial and academic fields now utilize eXtended Reality (XR) technologies. This diversity and growing use are boosting research and leading to an increasing number of XR experiments involving human subjects. The main aim of these studies is to understand the user experience in the broadest sense, such as the user cognitive and emotional states. Behavioral data collected during XR experiments, such as user movements, gaze, actions, and physiological signals constitute precious assets for analyzing and understanding the user experience. While they contribute to overcome the intrinsic flaws of explicit data such as post-experiment questionnaires, the required acquisition and analysis tools are costly and challenging to develop, especially for 6DoF (Degrees of Freedom) XR experiments. Moreover, there is no common format for XR behavioral data, which restrains data-sharing, and thus hinders wide usages across the community, replicability of studies, and the constitution of large datasets or meta-analysis. In this context, we present PLUME, an open-source software toolbox (PLUME Recorder, PLUME Viewer, PLUME Python) that allows for the exhaustive record of XR behavioral data (including synchronous physiological signals), their offline interactive replay and analysis (with a standalone application), and their easy sharing due to our compact and interoperable data format. We believe that PLUME can greatly benefit the scientific community by making the use of behavioral and physiological data available for the greatest, contributing to the reproducibility and replicability of XR user studies, enabling the creation of large datasets, and contributing to a deeper understanding of user experience.

Assessing REALTER simulator: analysis of ocular movements in simulated low-vision conditions with extended reality technology.

Immersive technology, such as extended reality, holds promise as a tool for educating ophthalmologists about the effects of low vision and for enhancing visual rehabilitation protocols. However, immersive simulators have not been evaluated for their ability to induce changes in the oculomotor system, which is crucial for understanding the visual experiences of visually impaired individuals. This study aimed to assess the REALTER (Wearable Egocentric Altered Reality Simulator) system's capacity to induce specific alterations in healthy individuals' oculomotor systems under simulated low-vision conditions. We examined task performance, eye movements, and head movements in healthy participants across various simulated scenarios. Our findings suggest that REALTER can effectively elicit behaviors in healthy individuals resembling those observed in individuals with low vision. Participants with simulated binocular maculopathy demonstrated unstable fixations and a high frequency of wide saccades. Individuals with simulated homonymous hemianopsia showed a tendency to maintain a fixed head position while executing wide saccades to survey their surroundings. Simulation of tubular vision resulted in a significant reduction in saccade amplitudes. REALTER holds promise as both a training tool for ophthalmologists and a research instrument for studying low vision conditions. The simulator has the potential to enhance ophthalmologists' comprehension of the limitations imposed by visual disabilities, thereby facilitating the development of new rehabilitation protocols.

Unseen Sound: One Step into the Blind Future (Academic Access Version)

Abstract Elizabeth McLain interviews CripTech incubator artist Andy Slater about Unseen Sound (2023), his work for E.A.A.T.: Experiments in Art, Access and Technology. Slater discusses accessibility as artistic practice, the exclusion of blind folks from augmented and extended reality, and experimental art’s capacity for fostering access intimacy. While developing Unseen Sound, Slater experienced failures in access and technology. Hyperactive listening—the key to Slater’s creative practice— enabled him to pivot and continue the fight for accessible extended reality (XR) technology. In the process, he makes the case for a brilliant blind future by making noise in public spaces and leaning into the weirdness.

Applying STEM and extended reality technologies to explore students' artificial intelligence learning performance and behavior for sustainable development goals

PurposeTo support achieving sustainable development goals (SDGs), we integrated science, technology, engineering and math (STEM) and extended reality technologies into an artificial intelligence (AI) learning activity. We developed Feature City to facilitate students' learning of AI concepts. This study aimed to explore students' learning outcomes and behaviors when using Feature City.Design/methodology/approachJunior high school students were the subjects who used Feature City in an AI learning activity. The learning activity consisted of 90-min sessions once per week for five weeks. Before the learning activity, the teacher clarified the learning objectives and administered a pretest. The teacher then instructed the students on the features, supervised learning and unsupervised learning units. After the learning activity, the teacher conducted a posttest. We analyzed the students' prior knowledge and learning performance by evaluating their pretest and posttest results and observing their learning behaviors in the AI learning activity.Findings(1) Students used Feature City to learn AI concepts to improve their learning outcomes. (2) Female students learned more effectively with Feature City than male students. (3) Male students were more likely than female students to complete the learning tasks in Feature City the first time they used it.Originality/valueWithin SDGs, this study used STEM and extended reality technologies to develop Feature City to engage students in learning about AI. The study examined how much Feature City improved students' learning outcomes and explored the differences in their learning outcomes and behaviors. The results showed that students' use of Feature City helped to improve their learning outcomes. Female students achieved better learning outcomes than their male counterparts. Male students initially exhibited a behavioral pattern of seeking clarification and error analysis when learning AI education, more so than their female counterparts. The findings can help teachers adjust AI education appropriately to match the tutorial content with students' AI learning needs.

Cultural–Historical Activity Theory as an integrative model of socioscientific issue based learning in museums using extended reality technologies

ABSTRACT The transformation of natural history and science museums from receptacles (temples) to facilitators (forums) of knowledge fosters discourse around issues relating to science and society, known as social scientific issues (SSI). To assist guests with enhanced object-based learning, extended reality (XR) technologies are thought to leverage the leisure and social motivations of guests for greater object-based learning and SSI engagement. To model guests’ experiences using XR, this theoretical paper identifies and describes how a new conceptualization of Cultural–Historical Activity Theory (CHAT) to facilitate SSI outcomes through shared outcome spaces of interacting guest and museum activity systems, mediated by XR technology. We present two scenarios of forum-forward SSI-based learning utilizing this emergent CHAT model in: (i) scrutinizing the environmental and ecological consequences of human activity and (ii) unveiling the contributions of Indigenous Science Knowledge. Issues surrounding ownership and representation are discussed when ‘transforming’ singular objects into digital, decontextualized, and distributable entities.

Exponential Leaps in Medicine with XR – Regulatory Challenges vs. Clinical Solutions

Speakers address how XR technologies are revolutionizing healthcare, from surgical simulations to patient care. Regulatory challenges and clinical solutions associated with adopting XR in medicine are explored. Viewers can gain insights from speakers on their experiences with the transformative potential of XR in healthcare.
 Objectives• Provide an overview of the current state and applications of medical extended reality (XR) technologies in healthcare• Discuss the benefits and challenges of the state of XR in medicine• Explore the future potential and ethical considerations of medical XR in healthcare• Gain insights on how medical XR can be used in current and future healthcare environments• Understand regulatory frameworks that could be put in place to ensure consumers and end-users are appropriately protected

Evaluating User Experience in the Context of Cultural Heritage Dissemination Using Extended Reality: A Case Study of the Dacian Bronze Matrix with Hollow Design

Cultural institutions are increasingly prioritizing the utilization of diverse mixed reality technologies to enrich the visitor experience during their physical exhibitions. These institutions are actively integrating virtual assets to enhance interactivity and facilitate immersive storytelling experiences. The use of extended reality technologies in cultural heritage dissemination has become a common solution to improve the perception on cultural heritage of their visitors. The objective of the proposed research is to conduct a comparative analysis of three distinct extended reality applications used in cultural heritage experiences. The proposed workflow integrates advanced 3D scanning technology and additive manufacturing techniques to produce tangible replicas which are further enhanced using extended reality technologies, such as augmented reality, desktop virtual reality, and immersive virtual reality. To evaluate the developed extended reality applications, we have conducted various System Usability Scale tools to assess applications’ usability while also trying to identify the most appropriate application that can be integrated within the museum exhibition. From a utility point of view, we found no notable differences in the user perceptions between proposed solutions, whereas from a usability and satisfaction point of view, the most preferred solution was the augmented reality one. The workflow is presented in sufficient detail to ensure the replication of the results.

Phygital approach to value co-creation in international museums

PurposeThe purpose of this paper is, through an exploratory analysis, to identify good practices implemented by international museums in the phygital context and their classification in terms of customer experiences, in order to identify innovative cultural value creation and co-creation practices.Design/methodology/approachThe authors adopt a qualitative approach of multiple case studies. The analysis conducted formed the information base through which to proceed with the classification of phygital customer experiences through the extended reality technologies frameworkFindingsThe analysis conducted on the selected international museums shows that the phygital formula can take on different characteristics depending on the technologies used and the purpose to be achieved and can be a useful tool for the co-creation of cultural value.Originality/valueThe originality of this contribution lies in the comparative analysis proposed among the case studies to intercept best practices in the phygital field, in the classification of phygital experiences through a novel frame of reference and in the identification of prospects for improvement of an emerging phenomenon in the literature on cultural sector management.

Immersive Extended Reality (XR) Technology in Engineering Education: Opportunities and Challenges

Immersive Extended Reality (XR) Technology in Engineering Education: Opportunities and Challenges

How Cognitive Absorption Influences Responses to Immersive Narratives of Environmental Threats.

Nongovernment organizations are increasingly leveraging the metaverse and its suite of extended reality technologies, such as 360° video and virtual reality, to immerse audiences in situations depicting environmental threats. The promise of immersive storytelling as a conservation tool is predicated on the verisimilitude of the mediated experience, with exposure to environmental threats in immersive video akin to in vivo exposure. However, the psychological mechanisms explaining users' environmental responses to immersive stories remain ambiguous. In three controlled laboratory experiments, we examined unique properties (e.g., interactivity and modality) of immersive technologies vis-à-vis environmental stories and their influence on proenvironmental outcomes. Study 1 (N = 48) implemented a two-condition (interactivity: high vs. low) between-subjects experiment, showing that interactive 360° video significantly influenced attitudes through the mechanism of cognitive absorption. A 2 (interactivity: high/low) × 2 (distance: proximal/distant) between-subjects experiment (study 2; N = 76) further supported this mediation model by showing the mediating effects of cognitive absorption on attitudes and threat perceptions toward both distant and proximal threats. Lastly, study 3 (N = 68) replicated the mediating effects of cognitive absorption across 360° video modalities, though head-mounted display-based, rather than screen-based, 360° videos only significantly increased attitudes and absorption when threats were proximal. We discuss the results' practical and theoretical implications and propose avenues for future research. Moreover, we outline important considerations for environmental organizations seeking to leverage metaverse platforms for communicating environmental threats.

Virtual reality technology for surgical learning: qualitative outcomes of the first virtual reality training course for emergency and essential surgery delivered by a UK–Uganda partnership

IntroductionThe extensive resources needed to train surgeons and maintain skill levels in low-income and middle-income countries (LMICs) are limited and confined to urban settings. Surgical education of remote/rural doctors is,...

Using Metaverse in Education: Bibliometric and Content Analysis on Applications, Tools and Impacts

The study aims to investigate the impact of metaverse technologies in the field of education. To achieve this objective, bibliometrics and content analysis were employed. During the study, a total of 178 studies were subjected to bibliometric analysis, while 112 studies specifically focused on education were examined through content analysis. The analysis revealed that most publications were concentrated in 2023 (n=98) and 2022 (n=67). Furthermore, the most frequently employed keywords in these studies included metaverse, virtual reality, augmented reality, education, and artificial intelligence. In terms of country distribution, the highest number of publications originated from China (n=103), followed by South Korea (n=73), India (n=34), and the USA (n=30). On the authorship front, the most prolific contributors were Kim, J., Lee, H., Lee, L. H., and Niyato, D. In the realm of metaverse utilization in education, virtual reality, augmented reality, mixed reality, and extended reality technologies emerged as the most prominent. Additionally, the analysis identified higher education and secondary education as the primary contexts for metaverse application. The recommendations presented in the examined studies were categorized into five groups: To Ensure a Quality Learning Experience, To Improve Student Experience, For Skill Development, To Support Education Activities, and For Material Use. Finally, regarding the limitations of metaverse technology in education, a six-category structure was identified, encompassing Technical Problems, High Cost, Ethical and Safety Concerns, Learning Requirements, Limitations of the Technology Used, and Health Problems.

Museum Education Using XR Technologies: A Survey of Metadata Models

Museum education is a constantly evolving field that adapts to the changing needs and expectations of learners. By combining the unique assets of museums with innovative educational practices, the field continues to create enriching and engaging learning experiences. eXtended Reality technologies play a key role in this evolution, allowing museums to extend their reach and create more immersive, inclusive, and accessible educational experiences for a broader audience beyond their physical walls. Embracing well-structured and standardised metadata modelling is vital in achieving this vision. It can serve as the foundation that enables widespread interoperability and seamless integration of systems as well as in fostering synergies among the domains of cultural institutions, education, and XR technologies. This work surveys the historical and current state-of-the-art advancements in metadata models for each pillar of the work’s theme, namely the domains of education, cultural institutions, and XR while also detailing the key steps of metadata model amalgamation as a promising direction towards creating robust metadata frameworks from constituent models.

Using XR to Transform Todays Short-form Video Content Consumption

The purpose of this research is to investigate how Extended Reality (XR) technologies can help address the effects of consuming short form content, on social media platforms. With the rise in popularity of video apps its important to understand their impact on users, younger generations. While these platforms cater to peoples entertainment and news needs during their time they can have effects such as shorter attention spans, changes in cultural appreciation and even social disconnection. This research proposes an approach by combining Extended Reality technology with short form content to enhance user engagement while minimizing negative consequences. The proposed system includes experiences created by users that can be accessed individually or by viewers through an interactive feature called The Hall. Additionally the system includes features that encourage world connections and a transparent content recommendation mechanism that prioritizes user privacy. By prioritizing physical health well as privacy this Extended Reality based application has the potential to offer an effective solution to the challenges posed by current 2D short form content platforms. The findings are based on a survey conducted among 30 high school students in Beijing, which indicates the feasibility of this XR based application to transform short-form content consumption.

Virtual, augmented, mixed, and extended reality interventions in healthcare: a systematic review of health economic evaluations and cost-effectiveness

IntroductionHealth economic evaluations are required to best understand the value of interventions to the health economy. As extended reality technologies (an umbrella term including virtual, augmented, and mixed reality) become cheaper and more accessible it is likely that they will be used more within healthcare.ObjectiveThe aim of this study was to systematically review common practices within health economic evaluations of extended reality interventions in healthcare and to discuss the methods, outcomes, and methodological quality to inform future HEEs.MethodsMEDLINE, Embase, NHSEED, PubMed, and the ACM Digital Library were searched, and studies retrieved and screened. We extracted descriptions of the population, intervention, comparator, outcomes, context, costs, and economic evaluation data from studies that fit our criteria. We included studies that involved healthcare patients who were provided extended reality interventions versus standard care, other types of care, or another extended reality application within the same setting where the outcome included both health outcomes and health economic evaluations.ResultsThe search identified 1,693 records in total, of which 1,271 were excluded after title and abstract screening. A total of 422 articles were retrieved and screened and the majority (n = 233) were excluded as they did not contain a health economic analysis or cost data. Fourteen articles were included in this review, all of which found that extended reality health interventions could provide cost savings. Our findings showed considerable heterogeneity between studies and a lack of clear descriptions of XR interventions, limiting their use within procurement.ConclusionExtended reality in healthcare has the potential to offer significant clinical benefits and research has shown it to be promising at delivering cost-savings. We make recommendations based on the findings of our review for future health economic analyses to help ensure that health economic analyses can support decision-makers in procuring these technologies.Trial registrationPROSPERO 2022 CRD42022342110.

The use of virtual reality to assess the bony landmarks at the knee joint – The role of imaging modality and the assessor's experience

BackgroundAt present, extended reality technologies such as virtual reality (VR) have gained popularity in orthopedic surgery. The first aim of this study was to assess the precision of VR and other imaging modalities – computed tomography (CT), magnetic resonance imaging (MRI) – to localize bony landmarks near the knee joint. Secondly, the impact of the educational level of the assessor – medical master students, orthopedic residents, and orthopedic surgeons – on the precision with which landmarks near the knee joint could be localized was analyzed. MethodsWe included a total of 77 participants: 62 medical master students, 10 orthopedic residents, and 5 orthopedic surgeons to analyze three cadaver legs. Every participant localized a series of sixteen bony landmarks on six different imaging modalities (CT, MRI, 3D-CT, 3D-MRI, VR-CT, VR-MRI). ResultsConcerning the imaging modality, the inter- and intra-observer variability were lowest for 3D and VR, higher for MRI (respectively 7.6 mm and 6.9 mm), and highest for CT (respectively 9 mm and 8.7 m).Concerning the educational level of the assessor, inter- and intra-observer variability in VR were lowest for surgeons, (respectively 3.2 mm and 3.6 mm), higher for residents (respectively 5.9 mm and 6.5 mm) and medical students (respectively 5.9 mm and 5.8 mm). ConclusionsVR can be considered a reliable imaging technique. Localization of landmarks tends to be more precise in VR and on 3D than on conventional CT and MRI images. Furthermore, orthopedic surgeons localize landmarks more precisely than orthopedic residents and medical students in VR.

Corporate Learners' Perceptions of Extended Reality Technology as a Learning Aid in the Workplace

Virtual and augmented reality have grown in popularity as learning tools in the workplace in recent years. This study looks at how corporate learners perceive the use of extended reality technology in the workplace. Corporate learners utilise a variety of learning technologies, and their opinions of these resources have an impact on their adoption and learning process. A mixed-methods study was conducted using an online survey and follow-up interviews with the financial services participants (N = 106). The study was guided by the second-generation activity theory and the technology acceptance model (TAM). Findings showed that learners valued immersive technology because it increased teammate involvement and knowledge. However, issues with technological accessibility and incorporation into corporate learning programmes were also raised. According to this study, immersive technology may help with workplace learning, but its advantages and challenges should be taken into account as well. Extended reality (XR) technology offers notable advantages in learning by elevating enjoyment and facilitating a smoother learning experience, which greatly impacts learners' attitudes. However, its implementation in education presents challenges, primarily due to the increased need for resources. Additionally, the learning curve associated with XR technology poses hurdles for both educators and learners. Limited accessibility to virtual reality gear further complicates matters, potentially hindering proficiency and accessibility for learners trying to navigate this technology.