Augmented Reality Environment Research Articles

Simple and Efficient? Evaluation of Transitions for Task-Driven Cross-Reality Experiences.

The inquiry into the impact of diverse transitions between cross-reality environments on user experience remains a compelling research endeavor. Existing work often offers fragmented perspectives on various techniques or confines itself to a singular segment of the reality-virtuality spectrum, be it virtual reality or augmented reality. This study embarks on bridging this knowledge gap by systematically assessing the effects of six prevalent transitions while users remain immersed in tasks spanning both virtual and physical domains. In particular, we investigate the effect of different transitions while the user is continuously engaged in a demanding task instead of purely focusing on a given transition. As a preliminary step, we evaluate these six transitions within the realm of pure virtual reality to establish a baseline. Our findings reveal a clear preference among participants for brief and efficient transitions in a task-driven experience, instead of transitions that prioritize interactivity and continuity. Subsequently, we extend our investigation into a cross-reality context, encompassing transitions between virtual and physical environments. Once again, our results underscore the prevailing preference for concise and effective transitions. Furthermore, our research offers intriguing insights about the potential mitigation of visual incoherence between virtual and augmented reality environments by utilizing different transitions.

Enhancing Human-Computer Interaction in Augmented Reality (AR) and Virtual Reality (VR) Environments: The Role of Adaptive Interfaces and Haptic Feedback Systems

Human-Computer Interaction (HCI) in Augmented Reality (AR) and Virtual Reality (VR) environments has emerged as a critical area of research, shaping how users interact with immersive technologies. This study explores the design and development of advanced HCI frameworks in AR/VR environments, with a particular focus on adaptive interfaces and haptic feedback systems. Adaptive interfaces employ real-time data to personalize user experiences, while haptic feedback systems provide tactile sensations to bridge the gap between digital and physical interactions. The integration of these technologies enhances user engagement, immersion, and efficiency across applications such as gaming, training simulations, healthcare, and remote collaboration. This research investigates the challenges in creating intuitive, responsive systems and examines cutting-edge solutions in multimodal interactions, gesture recognition, and real-time feedback processing. By analyzing user performance and satisfaction, this study contributes to the refinement of AR/VR systems, paving the way for next-generation immersive environments.

Effectiveness of AR-Based Formative Peer Assessment on Chinese Writing Performance of Students with Different Cognitive Styles

The ability to communicate effectively in writing and produce clear and cohesive text is a necessary skill in both educational settings and the workplace, yet many young students struggle to organize their thoughts and engage in deep thinking. To address these challenges, an augmented reality (AR) application titled “Explore Wild Animals” has been used to help students organize information; however, it may not accommodate different cognitive styles. Integrating formative peer assessment (FPA) strategy into AR-based instruction can enhance knowledge construction and address diverse cognitive needs. This study, conducted from May to June 2023, empirically investigates the effects of FPA in an AR environment on the writing performance of learners with field-independent (FI) and field-dependent (FD) cognitive styles. A total of 89 fifth-grade pupils from China were randomly assigned to two groups: one group adopting FPA in an AR environment (AR-FPA), and the other group adopting FPA in a conventional PowerPoint (PPT) version 2410 environment (FPA). The results of a two-way analysis of covariance (ANCOVA) indicate that the AR-FPA group outperformed the FPA group in writing performance. Specifically, FI learners benefitted more from the AR-FPA approach, while FD learners performed better with the FPA approach. However, multiple linear regression analysis reveals that the peer feedback quality and features showed little to no significant correlation with feedback providers’ writing performance, regardless of cognitive style. These results highlight the effectiveness of integrating AR and FPA in enhancing educational outcomes, providing practical insights for promoting the sustainability of technology-enhanced learning and teaching practices.

Assessing the Use of Virtual Pointers in Laparoscopic Surgery Training Activities.

Laparoscopic surgery has advanced significantly; however, effective communication within the surgical team remains challenging, particularly in training scenarios where misinterpretation of instructions can lead to errors. Virtual pointers, indicating the instructor's gaze through eye-tracking devices and overlaying it onto the screen using augmented reality (AR), can enhance understanding and reduce errors. In a study involving 10 participants divided into experts and novices in laparoscopic surgery, various pointers (differing in shape, size and colour) were analysed in an AR environment using the HoloLens2 device. The aim was to assess the acceptance of these pointers by both groups, understand how their characteristics affect perception, and evaluate the AR device's usefulness. Initial results showed an 80% acceptance rate. After analysing the pointers, this decreased to 60%, as some experts changed their opinion from positive to neutral. The study revealed that the characteristics of the pointers significantly affect their perception, with large, thick-rimmed pointers being preferred. Orange was the best-performing colour. The device used also influenced perception, as experts who changed their perception criticised certain aspects of the head-mounted display. The study highlights the potential of virtual pointers to improve communication in laparoscopic training, particularly when their size, shape, and colour are optimised. Further research with a larger sample size is needed to confirm these results and explore the HoloLens2's influence on users' perceptions. These insights could guide the development of more effective training tools for minimally invasive surgery.

Enhancing Visual Perception in Immersive VR and AR Environments: AI-Driven Color and Clarity Adjustments Under Dynamic Lighting Conditions

The visual fidelity of virtual reality (VR) and augmented reality (AR) environments is essential for user immersion and comfort. Dynamic lighting often leads to chromatic distortions and reduced clarity, causing discomfort and disrupting user experience. This paper introduces an AI-driven chromatic adjustment system based on a modified U-Net architecture, optimized for real-time applications in VR/AR. This system adapts to dynamic lighting conditions, addressing the shortcomings of traditional methods like histogram equalization and gamma correction, which struggle with rapid lighting changes and real-time user interactions. We compared our approach with state-of-the-art color constancy algorithms, including Barron’s Convolutional Color Constancy and STAR, demonstrating superior performance. Experimental results from 60 participants show significant improvements, with up to 41% better color accuracy and 39% enhanced clarity under dynamic lighting conditions. The study also included eye-tracking data, which confirmed increased user engagement with AI-enhanced images. Our system provides a practical solution for developers aiming to improve image quality, reduce visual discomfort, and enhance overall user satisfaction in immersive environments. Future work will focus on extending the model’s capability to handle more complex lighting scenarios.

A Robotic Teleoperation System with Integrated Augmented Reality and Digital Twin Technologies for Disassembling End-of-Life Batteries

Disassembly is a key step in remanufacturing, especially for end-of-life (EoL) products such as electric vehicle (EV) batteries, which are challenging to dismantle due to uncertainties in their condition and potential risks of fire, fumes, explosions, and electrical shock. To address these challenges, this paper presents a robotic teleoperation system that leverages augmented reality (AR) and digital twin (DT) technologies to enable a human operator to work away from the danger zone. By integrating AR and DTs, the system not only provides a real-time visual representation of the robot’s status but also enables remote control via gesture recognition. A bidirectional communication framework established within the system synchronises the virtual robot with its physical counterpart in an AR environment, which enhances the operator’s understanding of both the robot and task statuses. In the event of anomalies, the operator can interact with the virtual robot through intuitive gestures based on information displayed on the AR interface, thereby improving decision-making efficiency and operational safety. The application of this system is demonstrated through a case study involving the disassembly of a busbar from an EoL EV battery. Furthermore, the performance of the system in terms of task completion time and operator workload was evaluated and compared with that of AR-based control methods without informational cues and ‘smartpad’ controls. The findings indicate that the proposed system reduces operation time and enhances user experience, delivering its broad application potential in complex industrial settings.

Wearable Haptics for Orthotropic Actuation Based on Perpendicularly Nested Auxetic SMA Knotting.

Smart wearable tactile systems, designed to deliver different types of touch feedback on human skin, can significantly improve engagement through diverse actuation patterns in virtual or augmented reality environments. Here, a perpendicularly nested auxetic wearable haptic interface is reported for orthotropically decoupled multimodal actuation (WHOA), capable of producing diverse tactile feedback modes with 3D sensory perception. WHOA incorporates shape memory alloy wires that are intricately knotted into an auxetic structure oriented along orthotropic dual axes. Its perpendicularly nested auxetic structure enables orthotropic actuation, allowing independent expansion and contraction along both x and y-axes, as confirmed by force-strain and displacement-time performance tests. Additionally, the perylene coating provides orthogonal electrical isolation to WHOA, allowing for stripe-specific localized actuation and enabling multiple tactile feedback modes. As an orthotropic wearable haptic interface, WHOA distinguishes between x-axis and y-axis directions and ultimately delivers multi-dimensional information regarding movements in 3D space through tactile feedback. As a result, when worn on the foot or arm, WHOA naturally delivers spatiotemporal tactile information to the user, facilitating navigation and teleoperation with 3D sensory perception.

From Technology Acceptance to Platform Attachment: Hospitality Training in Metaverse

ABSTRACT Evolving from augmented and virtual reality environments, the metaverse offers unique immersion, presence, interaction, and persistence, setting it apart from other online platforms. This study employs an experimental design to test a model examining how technology acceptance and platform attachment, driven by situatedness in the metaverse, impact learning in hospitality education. We propose a framework combining technology acceptance with place attachment theory to explore the metaverse’s role in hospitality training. Statistical analysis reveals a significant positive correlation between technology acceptance and platform attachment (β = 0.399, p < .001), which in turn positively influences mental model change (β = 0.758, p < .001). These findings highlight the metaverse’s transformative potential in hospitality education by influencing cognitive frameworks, specifically mental model changes, and enhancing task performance during virtual training. The study also identifies the mediating role of platform attachment in shaping user experiences, providing a theoretical basis for understanding the metaverse’s impact and practical insights for improving hospitality training.

Connecting the Brain with Augmented Reality: A Systematic Review of BCI-AR Systems

The increasing integration of brain–computer interfaces (BCIs) with augmented reality (AR) presents new possibilities for immersive and interactive environments, particularly through the use of head-mounted displays (HMDs). Despite the growing interest, a comprehensive understanding of BCI-AR systems is still emerging. This systematic review aims to synthesize existing research on the use of BCIs for controlling AR environments via HMDs, highlighting the technological advancements and challenges in this domain. An extensive search across electronic databases, including IEEEXplore, PubMed, and Scopus, was conducted following the PRISMA guidelines, resulting in 41 studies eligible for analysis. This review identifies key areas for future research, potential limitations, and offers insights into the evolving trends in BCI-AR systems, contributing to the development of more robust and user-friendly applications.

Audio’s Impact on Immersive Experience in Extended Reality and Digital Games: A Systematic Review

Extended reality and digital games strive to deliver a high level of “immersion,” a complex phenomenon influenced by both perceptual and psychological factors. Audio plays a crucial role in shaping immersive experiences, yet there is no clear consensus on its impact or on the best methods to evaluate it. This paper presents a systematic literature review spanning two decades, outlining the methods and findings related to how audio influences immersion in extended reality and digital games. It reveals a strong preference for experiments using virtual reality headsets and headphones and notes a gap in research on augmented and mixed reality environments. Moreover, it underscores the need for audio-specific metrics to better assess the ways that audio variables impact immersion. The findings demonstrate that audio elements like spatial fidelity, music, and the integration of sound in multimodal environments generally contribute to the immersive experience but also highlight a threshold beyond which further enhancements may not perceptibly improve the experience. It emphasizes the need for realtime, objective measures of immersion as well as the consideration of diverse methodological approaches to deepen the understanding of audio’s role in immersive technologies.

EEG-based Incongruency Decoding in AR with sLDA, SVM, and EEGNet

Abstract Augmented reality (AR) technologies enhance a user’s physical environment by providing contextual information about their surroundings. This information might appear incongruent to users, either due to their current mental context or factual errors in the data. This paper explores the feasibility of incongruency decoding using electroencephalographic (EEG) signals from 19 participants acquired during an interactive AR task. Previous studies on single-trial N400 decoding for brain-computer interfaces using EEG data are limited. Therefore, we implemented commonly used classification approaches and assessed their decoding performance compared to the convolutional neural network EEGNet. We found that the investigated approaches offer comparable accuracies ranging from 63.3% to 64.8%. Successful decoding of incongruency effects can foster more contextually appropriate interactions within AR environments.

Evaluating Usability and UX in Touchable Holographic Solutions: A Validation Study of the UUXE-ToH Questionnaire

Touchable Holographic Solutions (THS) are an application type in Augmented and Mixed Reality (AR/MR) environments. Evaluating THS requires considering Usability and User eXperience (UX), particularly Immersion and Presence, often overlooked by current methods. A systematic mapping study and exploratory search revealed gaps, such as the lack of a unified instrument for THS usability and UX evaluation, methods that address THS-specific aspects, and challenges in adapting general evaluation technologies. To bridge these gaps, we present the Usability and User Experience Evaluation in Touchable Holograms (UUXE-ToH) questionnaire, with 67 Likert scale items and three open-ended questions. A validation study with 13 experts provided quantitative data and qualitative feedback. Results confirm the UUXE-ToH’s efficacy and offer insights for improvement. This research contributes to Human-Computer Interaction (HCI) by introducing a validated tool for evaluating THS, integrating hedonic and pragmatic aspects, and supporting early problem identification in development, accessible to professionals with diverse UX expertise.

Movement and positioning of a virtual cuboid in 3d space in an augmented reality environment

Human-virtual object interaction is common in both entertainment and work settings. This study investigated the movement time (MT) and subjective rating of difficulty (SRD) for moving a virtual cuboid in a 3D space. The participants wore an augmented reality (AR) headset, picked up a virtual cuboid, and placed it on an assigned target. They rated the SRD of the task on a five-point scale. The effects of the 3D coordinate of the target, sex, and handedness on the MT were analysed. The error placement rate was also recorded. Significant effects of spatial coordinates were found on both MT and SRD. Both single- and two-stage MT modelling were conducted using segmented and unsegmented MT data, respectively. The insignificant prediction error between the models indicates that the two-stage MT model is not superior to the single-stage one. The findings of this study are beneficial to software designers in designing user-friendly AR applications.

Enhancing surgical navigation: a robust hand-eye calibration method for the Microsoft HoloLens 2.

Optical-see-through head-mounted displays have the ability to seamlessly integrate virtual content with the real world through a transparent lens and an optical combiner. Although their potential for use in surgical settings has been explored, their clinical translation is sparse in the current literature, largely due to their limited tracking capabilities and the need for manual alignment of virtual representations of objects with their real-world counterparts. We propose a simple and robust hand-eye calibration process for the depth camera of the Microsoft HoloLens2, utilizing a tracked surgical stylus fitted with infrared reflective spheres as the calibration tool. Using a Monte Carlo simulation and a paired-fiducial registration algorithm, we show that a calibration accuracy of 1.65mm can be achieved with as little as 6 fiducial points. We also present heuristics for optimizing the accuracy of the calibration. The ability to use our calibration method in a clinical setting is validated through a user study, with users achieving a mean calibration accuracy of 1.67mm in an average time of 42s. This work enables real-time hand-eye calibration for the Microsoft HoloLens2, without any need for a manual alignment process. Using this framework, existing surgical navigation systems employing optical or electromagnetic tracking can easily be incorporated into an augmented reality environment with a high degree of accuracy.

Real-time object detection and augmentation

This study presents the development of a real-time object detection and augmentation system using TensorFlow and Unity it leverages TensorFlow model to identify and classify objects in real-time from a camera feed, and Unity to integrate and display corresponding 3D virtual objects in an augmented reality environment. By creating a mapping system to pair detected objects with their virtual counterparts, the system aims to enhance user interaction through dynamic and immersive AR experiences. The study addresses the challenges of real-time processing and seamless integration, demonstrating the potential of combining machine learning and augmented reality to enrich interactive applications across various domains.

Digitization of the Virtual Reality Laboratory Through Photogrammetry Tools (SfM)

The present paper focuses on generating a digital laboratory model at the department by applying the structure from motion technique. The generated digital model is then utilized to create simulation models for application in virtual and augmented reality environments. Nine different approaches to photogrammetric imaging in the laboratory were tested in the experiment. These approaches involved variations in the number of photographs and scanning positions. The results of the experiment were divided into three categories: unsuitable, which required significant modification; incomplete, which required further modification; and suitable, which was directly usable. Some images were unusable due to the similarity of objects in the scene. Experiments showed that some parts of the laboratory were more appropriate to image separately. It was also found that dark and shiny surfaces of objects presented a problem for the computation of the models. Therefore, it was necessary to use markers or colours to eliminate this problem.

Visual object detection system based on augmented reality and steady-state visual evoked potential

This study investigates a brain-computer interface (BCI) system based on an augmented reality (AR) environment and steady-state visual evoked potentials (SSVEP). The system is designed to facilitate the selection of real-world objects through visual gaze in real-life scenarios. By integrating object detection technology and AR technology, the system augmented real objects with visual enhancements, providing users with visual stimuli that induced corresponding brain signals. SSVEP technology was then utilized to interpret these brain signals and identify the objects that users focused on. Additionally, an adaptive dynamic time-window-based filter bank canonical correlation analysis was employed to rapidly parse the subjects' brain signals. Experimental results indicated that the system could effectively recognize SSVEP signals, achieving an average accuracy rate of 90.6% in visual target identification. This system extends the application of SSVEP signals to real-life scenarios, demonstrating feasibility and efficacy in assisting individuals with mobility impairments and physical disabilities in object selection tasks.

The Augmented Reality Experience and the Purchase Intention of Pakistan's Millennials When it Comes to Retail Shopping

Augmented Reality is a type of immersive technology that provides the user with a high level of sensory input, whether in terms of quality or quantity. The study will observe and identify research concerns about the impact of optimism, innovativeness, discomfort, and insecurity on purchase intention, as well as the mediating role of personal opinions towards Augmented Reality (AR) user experience. This study seeks to evaluate the impact of consumer personality traits on purchasing behavior in the context of electronic equipment in Lahore, Pakistan, with a focus on generation Y. This study will use a deductive approach and will be based on the positivist research philosophy. Based on the Technology Readiness Model and the Theory of Planned Behavior. This research will use a quantitative survey method and cross-sectional research to collect data from a specific point in time. The study will collect data using convenience sampling, which is a non-probability sampling technique. The study will take an experience-based method, followed by a survey, in which participants will be exposed to AR environments and a structured questionnaire will be used to gage their responses. The data will be gathered from 370 respondents and analysis will be done using IBM SPSS Statistics 29 for descriptive statistics and SmartPLS 4.0 for route analysis to investigate indirect correlations.

Understanding the Influence of Fatigue on Full Arm Gestures in Augmented Reality Environments

Understanding the Influence of Fatigue on Full Arm Gestures in Augmented Reality Environments

Visual perception of distance in 3D‐augmented reality head‐up displays

AbstractA head‐up display (HUD) is conveniently used to provide information on the display without changing the user's gaze. 3D HUDs, capable of projecting three‐dimensional information beyond the 2D HUDs, enable the projection of augmented reality (AR) objects into the real world. Research on the perception of 3D AR HUDs is crucial for their efficient utilization and secure commercialization. In this study, we examined whether a 3D HUD is more comfortable than a 2D HUD in the context of viewing real‐world environments and augmented reality objects together. Additionally, we analyzed participants' perception of distance and fatigue for AR objects at varying distances from the 3D HUD. The study found that using a 3D HUD in an AR environment resulted in less fatigue than using a 2D HUD, as determined by a Mann–Whitney statistical analysis. Participants were able to match the depth of AR objects in a 3D HUD within a range of 3 to 50 m, with similar diopter and parallax angular distance errors, regardless of the distance of the AR object. Visual fatigue increases with increasing distance from the virtual‐image plane and can be modeled as a quadratic function in the domain of diopter and parallax angles.