Mobile Augmented Reality Applications Research Articles

Mobile Augmented Reality Application to Evaluate the River Flooding Impact in Coimbra

The downtown area of the city of Coimbra, Portugal, is at low altitude and has historically suffered floods that have caused serious economic losses. The present research proposes a mobile augmented reality (MAR) application aimed at visualising the effect of possible scenarios of flooding in an area of higher risk in the city. A realistic 3D model of the city was created, using data extracted with BLosm and processed through Blender, followed by its integration into Unity with Vuforia for AR visualisation. The methodology encompasses the extraction and simplification of 3D models, mapping real-world coordinates in Unity, analysing several datasets, obtaining a model through regression and implementing a workflow to manage interactions between various Unity objects. The MAR application enables users to visualise potential flood impacts on buildings, utilising colour-coded indicators to represent different levels of water contact. The system’s efficacy was evaluated by simulating various use-case scenarios, demonstrating the application’s capability to provide real-time, interactive flood risk assessments. The results underline the potential of integrating AR and machine learning for enhancing urban flood management and prevention.

Teaching students with autism spectrum disorder how to use an augmented reality application and the vocabulary of the natural sciences

Technology-based interventions are considered evidence-based for teaching students with Autism Spectrum Disorder (ASD). The main purpose of this study is to teach students with ASD the use of augmented reality (AR) mobile applications through systematic instruction and to test the effectiveness of the presented AR mobile application in teaching science concepts. The secondary aim of this study was to examine the students’ and teachers’ views on the acceptability of the AR mobile application in teaching science vocabulary. Three primary and one secondary school students with ASD, aged 10-13 years, participated in the study. A multiple probe design across participants was used to evaluate the effects of the intervention package. The findings showed that systematic instruction using an AR mobile application is effective in science vocabulary for students with ASD. All students reported using an AR mobile application to learn science vocabulary words was socially acceptable. These results suggest that the AR mobile applications may be a promising instruction instrument that is effective, efficient, and cost-effective. Implications for future research and practice are then discussed.

An augmented reality mobile application designed for pharmacology teaching.

An augmented reality mobile application designed for pharmacology teaching.

Robust Collaborative Visual-Inertial SLAM for Mobile Augmented Reality.

Achieving precise real-time localization and ensuring robustness are critical challenges in multi-user mobile AR applications. Leveraging collaborative information to augment tracking accuracy on lightweight devices and fortify overall system robustness emerges as a crucial necessity. In this paper, we propose a robust centralized collaborative rnulti-agent VI-SLAM system for mobile AR interaction and server-side efficient consistent mapping. The system deploys a lightweight VIO frontend on mobile devices for real-time tracking, and a backend running on a remote server to update multiple submaps. When overlapping areas between submaps across agents are detected, the system performs submap fusion to establish a globally consistent map. Additionally, we propose a map registration and fusion strategy based on covisibility areas for online registration and fusion in multi-agent scenarios. To improve the tracking accuracy of the frontend on agent, we introduce a strategy for updating the global map to the local map at a moderate frequency between the camera-rate pose estimation of the frontend VIO and the low-frequency global map optimization, using a tightly coupled strategy to achieve consistency of the multi-agent frontend poses estimation in the global map. The effectiveness of the proposed method is further confirmed by executing backend mapping on the server and deploying VIO frontends on multiple mobile devices for AR demostration. Additionally, we discuss the scalability of the proposed system by analyzing network traffic, synchronization frequency, and other factors at both the agent and server ends.

Cooperative augmented assembly (CAA): augmented reality for on-site cooperative robotic fabrication

Recent years have witnessed significant advances in computational design and robotic fabrication for large-scale manufacturing. Although these advances have enhanced the speed, precision, and reproducibility of digital fabrication processes, they often lack adaptability and fail to integrate manual actions in a digital model. Addressing this challenge, the present study introduces cooperative augmented assembly (CAA), a phone-based mobile Augmented Reality (AR) application that facilitates cooperative assembly of complex timber structures between humans and robots. CAA enables augmented manual assembly, intuitive robot control and supervision, and task sharing between humans and robots, creating an adaptive digital fabrication process. To allocate tasks to manual or robotic actions, the mobile AR application allows multiple users to access a shared digital workspace. This is achieved through a flexible communication system that allows numerous users and robots to cooperate seamlessly. By harnessing a cloud-based augmented reality system in combination with an adaptive digital model, CAA aims to better incorporate human actions in robotic fabrication setups, facilitating human–machine cooperation workflows and establishing a highly intuitive, adaptable digital fabrication process within the Architecture, Engineering, and Construction sector.

Multi-Camera Lighting Estimation for Mobile Augmented Reality

Lighting estimation is an important and long-standing task in computer vision and graphics communities[1]. Over the past few years, we have observed a rising demand for creating immersive user experiences in mobile augmented reality (AR) applications. In particular, environment lighting estimation is essential to render visually coherent virtual objects that need to be overlaid on physical scenes in mobile AR. In this work, we explore the key research questions in lighting understanding for an emerging application domain, mobile AR on multi-camera handheld devices, particularly try-on applications where end users leverage handheld mobile devices, such as smartphones, to overlay products of interest on their faces. Mobile AR try-on apps promote online shopping and often require photorealism to provide user experiences on par with physical try-on.

Task offloading scheme in Mobile Augmented Reality using hybrid Monte Carlo tree search (HMCTS)

Mobile Augmented Reality (MAR) applications enhance user experiences by providing realistic information about the current location through mobile devices. However, MAR applications are computationally intensive, leading to high energy consumption and latency issues. To address these challenges, this research presents a Hybrid Monte Carlo Tree Search (HMCTS) based task offloading scheme, combining a genetic algorithm with Monte Carlo tree search for efficient task management. The proposed method uses YoloV7 for object recognition and aims to reduce energy consumption, response time, and migration time. Experimental results demonstrate that the HMCTS approach significantly reduces energy consumption to 1290 kJ, response time to 24 ms, and migration time to 0.52 ms, outperforming existing techniques. These improvements highlight the potential of the HMCTS method for enhancing the performance of MAR applications. Proposed hybrid approach aims to improve the efficiency and effectiveness of task offloading in MAR applications. The HMCTS model dynamically offloads tasks to edge servers, optimizing scheduling time, response time, and energy consumption.

SCI-AR: ENHANCE SCIENCE LEARNING THROUGH AUGMENTED REALITY

This research work is focused on development of a mobile augmented reality application, for use in helping kids with learning problem in science class. Science per se has inherent features that are abstract in nature, thus complicating the processes of learning and at the same time giving a negative outlook towards science. In this regard, the application has the use of graphics and symbols combining with the use of AR that enhances understanding and leads to involvement of students. It can be on Android OS for mobile phones with Unity3D and ARFoundation/ARCore as the development tools. Acceptance of consumer Credit has used the Technology Acceptance Model for developing its theoretical modelling of prediction. In making the system, the development model of Agile Methodology Model has been adopted. This study tries to apply a new approach that enhances the learners’ motivation and confidence in science learning without pre-empting any other teaching strategy. As for the application of a mobile and graphically augmented reality, it raises a lot of potential for improvement of science learning for children with certain learning difficulties in this new, interactive type of format.

Augmented Reality Mobile Application for Promoting Culture and Heritage in Thailand and Malaysia: The Prototype Development and Heuristic Evaluation

The global coronavirus pandemic sparked widespread lockdowns and travel restrictions, leading to a significant economic downturn. However, the subsequent development of vaccines prompted governments to ease restrictions and explore technology-driven strategies for tourism revival, including the use of mobile applications and augmented reality (AR). In light of the progress of AR, this study addresses the lack of AR applications for promoting tourism in Southeast Asia, particularly in Thailand and Malaysia, where language barriers hinder cross-cultural communication. Therefore, this study aims to develop a content-specific AR mobile application to enhance tourists’ exploration of cultural heritage and facilitate communication in these multicultural and Islamic-influenced regions. This study adopts the design thinking approach for a solution-based methodology. The developed AR mobile application aims to enhance the tourist experience by providing immersive and informative content specific to the culture and heritage. The prototype undergoes a heuristic evaluation by ten experts in human-computer interaction (HCI). The results show a positive consensus on many aspects, highlighting the potential of the AR mobile application to promote culture and heritage effectively. Qualitative exploration through expert feedback is recommended in future studies to refine specific elements for a universally satisfactory user experience.

Text Entry Performance and Situation Awareness of a Joint Optical See-Through Head-Mounted Display and Smartphone System.

Optical see-through head-mounted displays (OST HMDs) are a popular output medium for mobile Augmented Reality (AR) applications. To date, they lack efficient text entry techniques. Smartphones are a major text entry medium in mobile contexts but attentional demands can contribute to accidents while typing on the go. Mobile multi-display ecologies, such as combined OST HMD-smartphone systems, promise performance and situation awareness benefits over single-device use. We study the joint performance of text entry on mobile phones with text output on optical see-through head-mounted displays. A series of five experiments with a total of 86 participants indicate that, as of today, the challenges in such a joint interactive system outweigh the potential benefits.

Development of a mobile augmented reality application to enhance youth engagement in planning and designing public spaces in urban areas

Development of a mobile augmented reality application to enhance youth engagement in planning and designing public spaces in urban areas

What Does an IMoART Application Look Like? IMoART—An Interactive Mobile Augmented Reality Application for Support Learning Experiences in Computer Hardware

What Does an IMoART Application Look Like? IMoART—An Interactive Mobile Augmented Reality Application for Support Learning Experiences in Computer Hardware

ДОПОВНЕНА РЕАЛЬНІСТЬ ЯК ЕФЕКТИВНИЙ ІНСТРУМЕНТ ВДОСКОНАЛЕННЯВМІНЬ ГОВОРІННЯ НА УРОКАХ АНГЛІЙСЬКОЇ МОВИ

The article explores the role of augmented reality (AR) as an effective tool of developing speaking skills in English language classes. In the modern world, where technologies intertwine with reality, AR not only emerges as a trend but also stands as a powerful tool for education. By immersing themselves in an interactive environment, students gain a unique opportunity to apply their communication skills in real-life situations, fostering not only increased motivation but also the development of key linguistic abilities. It is noted that the research topic has gained significant popularity abroad in the past decade, yet in the domestic educational segment of English language teaching, it remains on the periphery of scientific investigations. Therefore, the author of the article aims to uncover the potential of AR applications and platforms as effective tools for enhancing students’ speaking skills in English language classes. The article examines mobile AR applications and platforms and proposes specific exercises for the development of speaking skills suitable for use by teachers. The author reveals the immense potential of augmented reality for revolutionizing the teaching of English as a foreign language (EFL), as AR applications seamlessly integrate digital elements into the real environment, offering a unique and immersive learning experience beyond traditional methods. One of the main advantages highlighted in using augmented reality in the context of speaking development is the ability to create immersive scenarios where students find themselves in different situations requiring the use of English for effective communication. For example, they can interact with virtual characters, solve tasks, and engage in role-playing games, contributing to the development of linguistic skills and confidence in oral communication.

INTERACTIVE VIRTUAL COMPARISON OF PURE AND ALLOY CRYSTAL STRUCTURES IN MATERIAL SCIENCE LESSONS

Visualizing something invisible to the naked eye, such as the crystal structure of a material, presents a significant challenge in understanding the field of material science. Thus, this project aims to develop an augmented reality (AR) mobile application that can visualize and compare the crystal structure of pure and alloy metals to assist in understanding material science. AR is used to integrate real-world data with computer-generated content to provide an interactive approach that goes beyond traditional methods. The models of the crystal structures are generated using SolidWorks software and then integrated into Unity software to blend the structure into the real-world application. Next, Vuforia software is used to make AR accessible on mobile phones. As a result, ‘Crystal View 1.0’ is developed and ready to use on students’ smartphones. The application offers a mixed reality view, enabling the real-time visualization of the crystal structures and detailed descriptions. 81% of mechanical engineering students taking material science courses are interested in using AR to learn crystal structure. In conclusion, the application can help students visualize and differentiate the crystal structures of pure and alloy metals interactively with real-world applications, thereby boosting the motivation of science students to learn material science.

Systematic Review on the Impact of Mobile Applications with Augmented Reality to Improve Health.

Physical inactivity represents a significant public health challenge globally. Mobile applications, particularly those utilizing augmented reality (AR), have emerged as innovative tools for promoting physical activity. However, a systematic evaluation of their efficacy is essential. This systematic review aims to evaluate and synthesize the evidence regarding the effectiveness and benefits of mobile applications with augmented reality in enhancing physical activity and improving health outcomes. A comprehensive search was conducted in Scopus, PubMed, WOS, and the Cochrane Library databases following PRISMA guidelines. Observational and interventional studies evaluating AR mobile applications for physical exercise were included, without restrictions on publication date or language. The search terms included "Mobile Applications", "Augmented Reality", "Physical Fitness", "Exercise Therapy", and "Health Behavior". The methodological quality was assessed using the ROBINS tool. The review identified twelve eligible studies encompassing 5,534,661 participants. The findings indicated significant increases in physical activity and improvements in mental health associated with the use of AR applications, such as Pokémon GO. However, potential risk behaviors were also noted. The evidence suggests that AR interventions can effectively promote physical activity and enhance health. Nonetheless, further research is needed to address limitations and optimize their efficacy. Future interventions should be tailored to diverse cultural contexts to maximize benefits and mitigate risks. AR mobile applications hold promise for promoting physical activity and improving health outcomes. Strategies to optimize their effectiveness and address identified risks should be explored to fully realize their potential.

Mobile AR Interaction Design Patterns for Storytelling in Cultural Heritage: A Systematic Review

The recent advancements in mobile technologies have enabled the widespread adoption of augmented reality (AR) to enrich cultural heritage (CH) digital experiences. Mobile AR leverages visual recognition capabilities and sensor data to superimpose digital elements into the user’s view of their surroundings. The pervasive nature of AR serves several purposes in CH: visitor guidance, 3D reconstruction, educational experiences, and mobile location-based games. While most literature reviews on AR in CH focus on technological aspects such as tracking algorithms and software frameworks, there has been little exploration of the expressive affordances of AR for the delivery of meaningful interactions. This paper (based on the PRISMA guidelines) considers 64 selected publications, published from 2016 to 2023, that present mobile AR applications in CH, with the aim of identifying and analyzing the (mobile) AR (interaction) design patterns that have so far been discussed sporadically in the literature. We identify sixteen (16) main UX design patterns, as well as eight (8) patterns with a single occurrence in the paper corpus, that have been employed—sometimes in combination—to address recurring design problems or contexts, e.g., user navigation, representing the past, uncovering hidden elements, etc. We analyze each AR design pattern by providing a title, a working definition, principal use cases, and abstract illustrations that indicate the main concept and its workings (where applicable) and explanation with respect to examples from the paper corpus. We discuss the AR design patterns in terms of a few broader design and development concerns, including the AR recognition approach, content production and development requirements, and affordances for storytelling, as well as possible contexts and experiences, including indoor/outdoor settings, location-based experiences, mobile guides, and mobile games. We envisage that this work will thoroughly inform AR designers and developers abot the current state of the art and the possibilities and affordances of mobile AR design patterns with respect to particular CH contexts.

The Impact of Teaching the Lives of Scientists in a Mobile Augmented Reality Environment on Students’ Success and Opinions

This research aims to investigate the impact of a Mobile Augmented Reality (MAR) application called TISAR-3D on the success and opinions of secondary school students when learning about the lives of scientists. A mixed-method approach was employed. The research was conducted on students in the 7th grade of a public school located in the city center of Elazig, Turkey. The sample consisted of 90 students, comprising 41 girls and 49 boys. The research was conducted with one experimental and one control group. Over the course of eight weeks, the experimental group utilized the TISAR-3D application, while the control group acquired knowledge by reading texts about scientists. The research showed that students using the MAR application had significantly higher academic success than the control group. Interviews with the experimental group supported integrating MAR technology, indicating it improved understanding of science topics and boosted academic success. Teachers are recommended to use the TISAR-3D application in their lessons to enhance students’ learning experiences.

The effect of augmented reality application (ARSINAPS) on learning motivation and outcomes in biology

This study aims to determine the effectiveness of using the ARSINAPS mobile augmented reality application on learning motivation and outcomes in high school and biology education students. The method used in this study was quasi-experimental with a post-test control group design. The research sample consisted of two experimental classes and two control classes from three schools in the Jakarta, Bekasi, and Tangerang areas, totalling 140 students, and from the college level, consisting of one experimental class and one control class, totalling 68 students. The data obtained were in the form of learning outcomes in the respiratory system and learning motivation scores in biology learning. The average high school-level motivation score in the control class was 85.99, and the overall average for learning outcomes was 77.33 and 63.05. Based on the results of the data calculations, the application effectively improves students’ learning outcomes at the high school and undergraduate levels

Delay-guaranteed Mobile Augmented Reality Task Offloading in Edge-assisted Environment

With the introduction of Augmented Reality (AR) into mobile devices, it becomes a trend to develop mobile AR applications in various fields. However, the execution of AR task demands the extensive resources of computation, memory and storage, which makes it difficult for mobile terminals with constrained hardware resources to carry out AR applications within the limited delay. In response to this challenge, we propose a mobile AR offloading method under the edge-assisted environment. Firstly, we divide an AR task into consecutive subtasks, and then collect the features of hardware, software, configuration, and runtime environments from the edge servers to be offloaded. With the features, we construct an AR subtask Execution delay Prediction Bayesian Network (EPBN) to predict the execution delay of different subtasks on each edge platform. Based on the prediction, we model the task offloading as the NP-hard Traveling Salesman Problem (TSP), and then propose a PSO-GA based solution by adopting the heuristic algorithm of Particle Swarm Optimization (PSO) to encode the offloading strategy and using Genetic Algorithm (GA) for particle update. The extensive experiments prove that the average performances of EPBN outperform the others with 17.23%, 23.97%, and 20.67% on micro-P, micro-R, and micro-F1 respectively, and the PSO-GA ensures that the offloading latency is reduced by nearly 5% compared to the suboptimal algorithm.

Algo-AR: Development of an Augmented Reality-Supported Tangible Programming Tool to Improve Algorithmic Thinking Skills

The main purpose of this study is to develop an educational tool to help children acquire algorithmic thinking skills at an early age while having fun. The methodology combines modern technologies and approaches such as augmented reality (AR), gamification, and tangible user interfaces. In this application, the coding components consist of specially designed tangible command blocks in the form of jigsaw puzzle pieces. The application contains a 3D multi-level game environment, and the user is expected to control the game character by constructing an algorithm with physical command blocks. The constructed algorithm is scanned using a mobile AR application and converted into code that controls the game environment. The major design considerations during the development of this application were simplicity and accessibility. All design decisions were delineated extensively in the paper. In conclusion, an augmented reality-based gamified tangible programming kit is proposed to improve children’s algorithmic thinking skills at an early age. The application requires only a smartphone and printable command blocks. Thus, an inexpensive, accessible, and entertaining educational tool is developed.