Augmented Reality Research Articles

Multi-Camera Lighting Estimation for Mobile Augmented Reality

Lighting estimation is an important and long-standing task in computer vision and graphics communities[1]. Over the past few years, we have observed a rising demand for creating immersive user experiences in mobile augmented reality (AR) applications. In particular, environment lighting estimation is essential to render visually coherent virtual objects that need to be overlaid on physical scenes in mobile AR. In this work, we explore the key research questions in lighting understanding for an emerging application domain, mobile AR on multi-camera handheld devices, particularly try-on applications where end users leverage handheld mobile devices, such as smartphones, to overlay products of interest on their faces. Mobile AR try-on apps promote online shopping and often require photorealism to provide user experiences on par with physical try-on.

Is minimally invasive surgery a game changer in spinal surgery?

Minimally invasive spine surgery (MISS) has revolutionized the treatment of spinal disorders over the past few decades. This review provides an in-depth analysis of MISS techniques, technologies, outcomes, and future directions. The evolution of MISS techniques-including tubular retractor systems, percutaneous pedicle screw fixation, minimally invasive transforaminal lumbar interbody fusion, lateral lumbar interbody fusion, and endoscopic spine surgery-has expanded the scope of treatable spinal pathologies while minimizing tissue trauma. Technological advancements such as intraoperative navigation, robotics, and augmented reality applications have enhanced precision and capabilities. Clinical evidence supports the efficacy and safety of MISS techniques for various spinal pathologies, demonstrating comparable or superior outcomes to traditional open approaches with reduced tissue trauma, blood loss, and hospital stays. Cost-effectiveness analyses also favor MISS over open techniques. Future directions in MISS include expanding indications, integrating artificial intelligence and machine learning, advancing tissue engineering and biologics, and refining robotic and augmented reality applications. As MISS continues to evolve, it is poised to play an increasingly important role in the treatment of spinal disorders, offering improved patient outcomes with reduced morbidity. However, ongoing rigorous evaluation of new techniques and technologies is crucial to balance potential benefits with associated risks and costs.

Comparative Analysis of AR-HUDs Crash Warning Icon Designs: An Eye-Tracking Study Using 360° Panoramic Driving Simulation

Augmented Reality Head-Up Displays (AR-HUDs) enhance driver perception and safety, yet optimal hazard warning design remains unclear. This study examines three AR-HUD crash warning icon types (BD, BR, BW) across various turning scenarios. Using a 360-degree video-based driving simulation with 36 participants, eye-tracking metrics were collected. Results show BW icons, dynamically linked to hazards, significantly improve drivers’ pedestrian risk awareness and visual attention allocation compared to BD and BR systems. BW consistently demonstrated longer gaze duration, higher fixation counts, and shorter time to first fixation across all turns. BD and BR icons were more susceptible to lane changes, potentially diverting attention from hazards. Findings suggest prioritizing dynamic tracking warning icons over fixed-position alternatives to minimize visual competition and distraction, providing crucial insights for AR-HUD optimization in automated vehicles.

Augmented Landscapes of Empathy: Community Voices in Augmented Reality Campaigns

In contrast with virtual reality which often aims to isolate a user from their surroundings in order to transport them to a distant place, augmented reality (AR) was uniquely designed to (re)contextualize local landscapes and to provide expanded human experiences in situ. This critical reflection adopts a “research through design” process to examine AR’s technological and affective capabilities in the context of three community co-created AR campaigns. We discuss how AR can become both a conceptual and practical tool for creating conditions of self-identification and, potentially, empathy between audience and content. Further, we explore how people and place become a critical part of AR’s infrastructure through the practice of empathic feedback loops.

Augmented Reality for Air Quality Monitoring: Case Study in the Marche Region (Italy)

Abstract. Augmented Reality (AR) allows the real world to be enhanced through the overlapping of digital information generated by an algorithm or software amplifying the user's perception. In this research, the potential of AR is exploited by applying it to the problem of air pollution visualization to raise awareness of the issue. It is well known that the principal sources of air pollution include industry, domestic heating, traffic, production processes and more others. According to European Environment Agency, air pollution is the largest environmental health risk in Europe in 2022 affecting respiratory and cardiovascular diseases and premature deaths. A suitable combination of GIS-based procedures for data analysis and georeferencing, AR systems for the visualization and exploitation of the results, can be a strategic driver. The research presented in this paper has been experimented in the Marche Region, in the central part of Italy, and in particular the city of Ancona. The pollutant data collected come from 17 Agenzia Regionale per la Protezione Ambientale delle Marche (ARPAM) meteorological ground-based stations located in Marche Region. The data processing have been executed using the software ArcGis Pro instead of a 3D City Model has been acquired from the online 3D ArcGIS platform. According to the Dlgs.155/2010 regulation, the AQI index (Air Quality Index) has been provided by the interpolation of the meteorological ground stations data. The visualization phase has been tackled exploiting in a WebGIS platform and an APP by AR. A 3D immersive visualization is made using five AQI level of air quality (excellent, good, fair, poor, bad) in order to increase the urban sensing.

Augmented reality experiences: Consumer‐centered augmented reality framework and research agenda

AbstractSince the launch of Pokémon Go, augmented reality (AR) has been one of the main research areas within new technologies. Integrating digital elements into the physical world presents exceptional opportunities for different sectors, enabling enhanced interactions and experiences. This study conducts a systematic review of AR literature, highlighting the main theories, theoretical frameworks, and research methodologies employed. It also classifies the main types of AR devices and the diverse contexts in which they are applied. Through a comprehensive thematic analysis, four principal areas of current research are identified: (1) media characteristics and consumer outcomes, (2) psychological influential factors and outcomes, (3) AR app features and technology adoption, and (4) recommendations for implementation in the industry and advantages. Furthermore, the study provides key insights and introduces the consumer‐centered AR framework. The article concludes by proposing a future research agenda, highlighting prospective studies that can contribute from the perspective of the content, context, device, and consumer, as well as avenues for future research from a methodological perspective.

Accuracy of Cup Placement Angle, Leg Lengthening, and Offset Measurement Using an AR-Based Portable Navigation System: Validation in Supine and Lateral Decubitus Positions for Total Hip Arthroplasty

Background and Objectives: Total hip arthroplasty (THA) requires accurate implant placement to ensure optimal outcomes. In this study, the AR Hip navigation system, an imageless portable navigation tool using augmented reality (AR), was evaluated for measuring radiographic inclination (RI), anteversion (RA), leg lengthening (LL), and offset (OS) changes in supine and lateral decubitus THA. Notably, this is the first report to assess the accuracy of LL and OS measurements using AR technology. Methods: We analyzed 48 hips from primary THA patients: 17 in the supine (S) group and 31 in the lateral (L) group. RI, RA, LL, and OS were measured intraoperatively using AR Hip and postoperatively using Zed Hip 3D software (Version 18.0.0.0). The absolute errors and outlier rates (≥5° for RI/RA and ≥5 mm for LL/OS) were compared between groups. Results: The mean intraoperative RI values with AR Hip were 40.1 ± 0.6° (S), 40.2 ± 1.2° (L), and 40.1 ± 1.0° (total), while the postoperative RI values with Zed Hip were 39.7 ± 2.9° (S), 39.5 ± 2.5° (L), and 39.6 ± 2.6° (total). The absolute errors were 1.8 ± 1.7° (total), with no significant group differences (p = 0.957). For RA, the errors were 2.0 ± 1.2° (total) (p = 0.771). The LL errors were 2.3 ± 2.2 mm (total) (p = 0.271), and the OS errors were 3.5 ± 2.8 mm (total) (p = 0.620). The outlier rates for RI were 11.8% (S) and 3.2% (L); for RA, 0% (S) and 3.2% (L); for LL, 29.4% (S) and 6.5% (L) with a significant difference (p = 0.031); and for OS, 23.5% (S) and 25.8% (L). No significant differences were observed for RI, RA, or OS. Conclusions: AR Hip provided accurate measurements of cup orientation, LL, and OS in both supine and lateral THA. Importantly, this study is the first to report the accuracy of LL and OS measurements using AR technology, demonstrating the potential of AR Hip for improving THA precision.

Development of Augmented Reality Media using Gender-Based Tri Hita Karana to Facilitate Students' Liability towards Local Culture

This study aims to develop Augmented Reality (AR) media using Gender-based Tri Hita Karana to facilitate students' liability towards local culture. This study utilized the Research and Development (R&D) approach with 48 fifth-grade students at SD Negeri 11 Denpasar as subjects. The instruments used in this research were expert validation questionnaires and student questionnaires, while the data analysis techniques include Aiken's V index for expert validation and descriptive analysis of student responses. With an average score of 0.992, the expert validation results using Aiken's V index demonstrate that this augmented reality media was quite legitimate. Furthermore, the study of the student questionnaire reveals a favorable reaction towards the enjoyment of local culture, as indicated by an average score of 3.137. This study determined that combining augmented reality (AR) technology with cultural knowledge-based learning could be a novel approach in contemporary education.

A larger augmented-reality field of view improves interaction with nearby holographic objects.

Augmented-reality (AR) applications have shown potential for assisting and modulating gait in health-related fields, like AR cueing of foot-placement locations in people with Parkinson's disease. However, the size of the AR field of view (AR-FOV), which is smaller than one's own FOV, might affect interaction with nearby floor-based holographic objects. The study's primary objective was to evaluate the effect of AR-FOV size on the required head orientations for viewing and interacting with real-world and holographic floor-based objects during standstill and walking conditions. Secondary, we evaluated the effect of AR-FOV size on gait speed when interacting with real-world and holographic objects. Sixteen healthy middle-aged adults participated in two experiments wearing HoloLens 1 and 2 AR headsets that differ in AR-FOV size. To confirm participants' perceived differences in AR-FOV size, we examined the head orientations required for viewing nearby and far objects from a standstill position (Experiment 1). In Experiment 2, we examined the effect of AR-FOV size on head orientations and gait speeds for negotiating 2D and 3D objects during walking. Less downward head orientation was required for looking at nearby holographic objects with HoloLens 2 than with HoloLens 1, as expected given differences in perceived AR-FOV size (Experiment 1). In Experiment 2, a greater downward head orientation was observed for interacting with holographic objects compared to real-world objects, but again less so for HoloLens 2 than HoloLens 1 along the line of progression. Participants walked slightly but significantly slower when interacting with holographic objects compared to real-world objects, without any differences between the HoloLenses. To conclude, the increased size of the AR-FOV did not affect gait speed, but resulted in more real-world-like head orientations for seeing and picking up task-relevant information when interacting with floor-based holographic objects, improving the potential efficacy of AR cueing applications.

Improving Exposure Therapy Through Projection-Based Augmented Reality for the Treatment of Cockroach Phobia: A Feasibility, Multiple-Baseline, Single-Case Study

Augmented Reality (AR) is helpful for overcoming the challenges of in vivo exposure therapy for Specific Phobia (SP). Specifically, Projection-based AR exposure therapy (P-ARET) allows the individual to face the feared animal without intrusive hardware, the phobic stimulus can be controlled, and it can maximize “variability”, producing a positive effect in the generalization of the results. The goal of this work is to assess the feasibility of P-ARET for SP, comparing multiple stimuli (MS) versus single stimulus (SS) conditions and evaluating the participants’ user experience. Adherence to a daily monitoring app (Emotional Monitor) and preliminary efficacy of the P-ARET treatment were assessed. Four participants diagnosed with SP of cockroaches (DSM-5) were randomly assigned to different baselines. Episodic and daily evaluations were performed. Participants considered the MS condition more aversive but more effective than the SS condition. Adherence to the mobile app was 83% for three participants and 55% for the remaining person. Analyses of non-overlap of all pairs and changes in the functionality levels showed a decrease in the SP symptoms at post-treatment and follow-ups. This study offers preliminary feasibility results for a novel form of P-ARET to treat participants with cockroach phobia, which may also apply to other phobias.

Using Eye-Tracking to Evaluate Novel Augmented Reality Applications for Maritime Operations

This paper presents the developments across a multi-year collaborative industry-academia R&D project designing and testing novel Augmented Reality (AR) solutions for differing maritime operations and work tasks. We describe the step-wise approach taken in our Human Factors testing program exploring the effects of AR on maritime operators. This paper focuses specifically on our empirical simulator laboratory experiments using differing data collection designs, tools and operational scenarios to investigate operator Situation Awareness, cognitive workload, performance and usability. Moving from comparatively rudimentary measures using static scenarios, desktop data collections and post hoc video analysis to implementing eye-tracking and automated object identification in dynamic scenarios and full-mission simulated environments, we present an overview of how our testing program has evolved and lessons learned. Further, we discuss ongoing research and future plans to better understand the effects of AR on maritime end-users to implement human-centred solutions more effectively in maritime settings.

The Fuse Platform: Integrating data from IoT and other Sensors into an Industrial Spatial Digital Twin

Abstract. Digital Twins as virtual representations of industrial assets are being used to assimilate varied sources of data for improved awareness and decision making in operations and process optimisation. This paper explores the integration of IoT sensors into a spatial digital twin called Fuse that Woodside Energy has been building for the assets it operates. We describe the Fuse platform and its knowledge graph data core that is used to organise and inter-relate data for presentation within 3D visualisations, domain-specific contexts and immersive augmented reality presentations. The key contribution here is the use of a knowledge graph to link diverse data sources so as to contextualise sensor data for actionable insights. One area of significant innovation has been the development and use of new Internet of Things (IoT) devices which have been enabled by advances in sensor technology, connectivity, and cloud computing. These new tailored data sources are complimenting existing plant and resource planning data for improved asset monitoring, predictive maintenance and process automation.

Enhancing Algorithmic Thinking Skills through Phygital Games: The Case of Space Codyssey

This paper presents an educational phygital game, Space Codyssey, aiming at cultivating the algorithmic thinking skills of young children. Space Codyssey is a phygital game, and its contains programming activities for the Sequence, Repetition, and Selection Structures, as well as Code Debugging activities (Debugging). The game utilizes Augmented Reality technology to present missions via QR cards. Additionally, digital storytelling is used as a means of assistance and teaching for preschool and early primary students. In the game, reading skills are not a prerequisite, and programming is accomplished using symbolic commands through a "Visual Programming Language." The participatory design methodology that was adopted, involving 28 educators from various specialties, reflects a holistic approach to the development of educational technologies. This interdisciplinary collaboration allowed for the integration of diverse pedagogical perspectives, ensuring that the game meets the multifaceted needs of modern education. The paper highlights the educational goals and learning outcomes for the designtated age group. It presents the scenario, the subject, the elements of the game, the rules, and the game mechanics. It also describes the implementation stages and the development of the application. Finally, it presents the results from a study, which involved 28 educators and aimed to improve the game before its use in educational settings.

Wearable Biosensor Smart Glasses Based on Augmented Reality and Eye Tracking.

With the rapid development of wearable biosensor technology, the combination of head-mounted displays and augmented reality (AR) technology has shown great potential for health monitoring and biomedical diagnosis applications. However, further optimizing its performance and improving data interaction accuracy remain crucial issues that must be addressed. In this study, we develop smart glasses based on augmented reality and eye tracking technology. Through real-time information interaction with the server, the smart glasses realize accurate scene perception and analysis of the user's intention and combine with mixed-reality display technology to provide dynamic and real-time intelligent interaction services. A multi-level hardware architecture and optimized data processing process are adopted during the research process to enhance the system's real-time accuracy. Meanwhile, combining the deep learning method with the geometric model significantly improves the system's ability to perceive user behavior and environmental information in complex environments. The experimental results show that when the distance between the subject and the display is 1 m, the eye tracking accuracy of the smart glasses can reach 1.0° with an error of no more than ±0.1°. This study demonstrates that the effective integration of AR and eye tracking technology dramatically improves the functional performance of smart glasses in multiple scenarios. Future research will further optimize smart glasses' algorithms and hardware performance, enhance their application potential in daily health monitoring and medical diagnosis, and provide more possibilities for the innovative development of wearable devices in medical and health management.

Robust and accurate visual geo-localization using prior map constructed by handheld LiDAR SLAM with camera image and terrestrial LiDAR point cloud

ABSTRACT Visual geo-localization using prior map of known environments has extensive applications in the fields such as self-driving, augmented reality and navigation. Currently, such prior maps are usually constructed by visual SLAM or SFM. However, the recent advances in LiDAR SLAM technology with RGB camera demonstrate great potential in efficient and accurate prior map construction and visual geo-localization. In this research, we developed a novel prior map construction approach which seamlessly integrates a handheld LiDAR SLAM system, a global LiDAR localization algorithm and a sparse set of terrestrial LiDAR scans as accurate control within a factor graph optimization framework. The developed LiDAR SLAM system augmented by terrestrial LiDAR scans achieves an improved mapping accuracy of 8 cm under GNSS-denied conditions in the areas over 50,000 m2 while the state-of-art FAST-LIO2 alone fails and produces a mapping error over 30 m. The results show that a competitive accuracy of visual geo-localization on a mobile phone using the constructed prior map is achieved (i.e. 60 and 76 cm in two tests respectively). Finally, this work also demonstrates a novel LiDAR point cloud fusion method that produces optimized and consistent coarse-to-fine 3D reconstruction in large and complex scenes.

VonEdgeSim: A Framework for Simulating IoT Application in Volunteer Edge Computing

Recently, various emerging technologies have been introduced to host IoT applications. Edge computing, utilizing volunteer devices, could be a feasible solution due to the significant and underutilized resources at the edge. However, cloud providers are still reluctant to offer it as an edge infrastructure service because of the unpredictable nature of volunteer resources. Volunteer edge computing introduces challenges such as reliability, trust, and availability. Testing this infrastructure is prohibitively expensive and not feasible in real-world scenarios. This emerging technology will not be fully realized until dedicated research and development efforts have substantiated its potential for running reliable services. Therefore, this paper proposes VonEdgeSim, a simulation of volunteer edge computing. To the best of our knowledge, it is the first and only simulation capable of mimicking volunteer behavior at the edge. Researchers and developers can utilize this simulation to test and develop resource management models. We conduct experiments with various IoT applications, including Augmented Reality, Infotainment, and Health Monitoring. Our results show that incorporating volunteer devices at the edge can significantly enhance system performance by reducing total task delay, and improving task execution time. This emphasizes the potential of volunteers to provide reliable services in an edge computing environment. The simulation code is publicly available for further development and testing.

Harnessing the Power of VR and AR Technologies in Internet Celebrity Marketing and User Interaction

The integration of Virtual Reality (VR) and Augmented Reality (AR) technologies into internet celebrity marketing offers unprecedented opportunities for enhancing user engagement, personalizing user experiences, and creating interactive content. This paper explores how VR and AR can revolutionize user interaction by providing immersive experiences and valuable data collection capabilities. By examining various applications, including virtual events, AR advertisements, and branded experiences, we highlight the significant business opportunities these technologies present for internet celebrities and brands. The ability to monetize VR and AR content, combined with insights gained from data analysis, drives innovative marketing strategies and fosters deeper connections with audiences. Through collaborations between internet celebrities, brands, and tech companies, the potential of VR and AR to transform digital marketing and engagement is immense, offering exciting new avenues for growth and success.

Virtual Reality and Augmented Reality: Reshaping the Future of Interactive Experiences

In the modern society, nowadays, Virtual Reality (VR) and Augmented Reality (AR) are permeating into our daily lives. Not only it changes the way individuals interact with digital content, but also has a significant influence on urbanization, migration, social justice, urban right and so on. This paper aims at analyzing the potential of VR and AR, particularly in different areas of society as they transform society in different ways. Regarding the concepts above, it investigates how these technologies affect questions of urbanism, equality, mobility, prejudice, and rights in cities. Through the examination of the concepts of Virtual Reality and Augmented Reality and their utilization, the paper exposes the possibility of developing an equitable built environment in cities. In this paper, having provided an overview of the existing literature and cases, issues and prospects are revealed in VR and AR development. Thus, studies imply that the implementation of both VR and AR into the main urban planning and social policies can promote social equity and inclusion.

The Transformation of Retail Through Digitalization: Analyzing the Impact of Online-Offline Integration and Augmented Reality on Consumer Shopping Experience

The retail industry has especially changed in the last three decades by the effect of the technological change. This study examines the impact of two major innovations: two emerging issues, namely the omnichannel retailing and the augmented reality (AR). Omnichannel retailing combines online and offline selling pointers wherein consumers get a completely integrated purchasing experience whereas AR makes product differentiation easy and allows consumers to engage with products. The concern of this research is to examine how these technologies affect consumers behavior, satisfaction, and loyalty. Therefore, the study adopted a mixed research method, where data was gathered through online questionnaires, interviews and case studies of organizations such as Walmart, Nordstrom, IKEA, and Sephora. Based on the research, there is a suggestion that the synchronization of online and offline purchase touchpoints enhances the shopping convenience and customization; meanwhile, the application of AR enhances the interaction and the confidence of the purchase. Some of other issues that were realized include data privacy and consistent branding throughout the communication channels. This research establishes that these technologies use in strategic processes improves consumer shopping experiences, but more research is required to investigate long-term outcomes and new directions for the retail industry.

Practical tips for teaching medicine in the metaverse

The metaverse is based on immersive technologies such as virtual and augmented reality, body tracking, tactile sensation, etc. A growing number of studies are demonstrating the potential of the metaverse as an attractive resource for learning medicine. However, in practice, medical teachers and students often encounter significant challenges when utilizing the underlying technologies, potentially leading to frustrating learning experiences. A significant part of the teaching time is often devoted to troubleshooting technical issues with the metaverse, and the medical content itself taking a backseat until students become proficient in navigating the metaverse environment. Therefore, it is essential to fit the metaverse's underlying technologies specifically for medical education, minimizing technical hurdles for both teachers and students. In this paper, we deal with this challenge and we present a collection of practical tips that serves as a guide for medical educators making decisions in this emerging field, where they may lack prior experience. Drawing on our observation with a cohort of 776 medical students, we conclude how to effectively identify, design, or implement educational applications tailored for efficient medical learning through the metaverse. Our work may support teachers considering metaverse learning platforms for their classrooms and it is a beneficial reference for the medical education community during the initial stages of implementing the metaverse for teaching.