Mobile Augmented Reality Applications Research Articles

Mobile Application with Augmented Reality and its Impact on Anatomy Learning in Human Medicine Students

This paper presents the development of an augmented reality (AR) mobile application to display 3D structures of the human body and evaluate its impact on anatomy learning in students of the Faculty of Human Medicine of a university in northern Peru. The need to improve educational quality is addressed, given that traditional methods often lack adequate resources and effective motivation for students. Through the application, which uses the Mobile-D methodology, 3D anatomical models, a database, and a supporting web page were created. The results indicate that the AR mobile application had a positive impact on the learning of first-year Human Medicine students with a significant improvement of 0.88 in the averages, since it provides them with the basic knowledge for the introduction to this subject, in addition to improving their motivation and being considered as a learning and feedback tool.

Exploring the Application of a Co-Creation Model in Archaeological Tourism: Two Case Studies developed under TURARQ's project within the frame of Link Me Up - 1000 ideas project

This paper discusses two projects that revolve around the conceptualization of tourism products within the framework of interpreting and understanding archaeological sites through a sustainable approach as part of TURARQ's initiative. The primary objective was to explore the application of a co-creation model, specifically the Project Based Learning methodology of "Demola" with the support of the "Link me Up" project, in the field of archaeological tourism. The first project, Show Me the Past, involved the development of a mobile app that utilized an agile requirement analysis to create a prototype. The second project, Showcasing Prehistory, focused on entrepreneurship, inclusion, heritage, and sustainability, using a diagnosis of the social issues affecting the Mação territory. The outcomes of the first project included the creation of a Mobile Augmented Reality (MAR) application, which allows users to visualize virtual objects in the real environment of discovery. In the second project, empathy maps were developed, encompassing archaeotourism, the local community, theme parks, and special needs. The findings indicated that these programs generated high levels of participant satisfaction and positively impacted competency development. However, further studies are required to ascertain the number of participants who have transitioned into entrepreneurs because of their involvement in these projects.

Using Augmented Reality to Teach Digital Literacy Course to Primary School Children with Special Educational Needs

Augmented reality technologies can create unique interactive learning environments for students with special educational needs that enrich the learning process and provide immediate feedback. This research analyzed the use of augmented reality in teaching digital literacy courses for primary school children with special educational needs. The study involved a quasi-experiment with participants using a mobile augmented reality application to assess its impacts on learning outcomes. The results showed the positive effects of augmented reality on student achievement. The results highlight the potential of augmented reality in inclusive education. In addition, the findings emphasize the importance of further research and development in this area and an increased use of augmented reality to improve the educational experience of students with disabilities. In light of the results, we conclude with recommendations for integrating augmented reality into educational programs and improving educational practices.

Effects of Augmented Reality with Pedagogical Agent on EFL Primary Students’ Vocabulary Acquisition, Motivation, and Technology Perceptions

Mobile augmented reality (MAR) technology provides EFL learners with a combination of real and virtual learning environments. However, little research has been conducted to investigate the effects of integrating pedagogical agent (PA) into AR applications. Therefore, this study designed and developed a MAR application with the pedagogical agent (PA-MAR) to support EFL primary school students' vocabulary learning. A total of 60 students from a primary school in central China participated in the experiment, and a QUAN-qual sequential mixed-method design was used. The results showed that students in the PA-MAR group outperformed students in the NoPedagogical Agent Augmented Reality Mobile Application (NPA-MAR) group and those who learned vocabulary in a traditional classroom in terms of vocabulary acquisition, motivation, and perception of technology. The results of the qualitative analyses showed that the students perceived PA-MAR as a useful tool for their vocabulary learning and that it improved their motivation and enjoyment. The theoretical and practical value of the study is also discussed.

The Effectiveness of Augmented Reality with Adapted Books as Emotional Expression Media for Children with Autistic Spectrum Disorders (ASD)

Autism Spectrum Disorder (ASD) is a neurological condition that affects a person's ability to recognize and understand emotions, thereby hindering social interactions. This research introduces AREmotion, an augmented reality (AR) mobile application integrated with an adapted book, designed to aid children with ASD in recognizing emotional expressions. Using images as markers in the AR application, AREmotion facilitates the learning process for these children. The study employed a pre-experimental design with a one-group pre-test and post-test to evaluate the application's effectiveness. Results indicated a significant improvement in the participant's ability to understand emotional expressions, with each respondent showing a significance value of less than 0.05. These findings demonstrate that combining AR technology with traditional printed books can effectively enhance emotional recognition in children with ASD, showcasing a promising advancement in this field.

Pengaruh Teknologi Mobile Augmented Reality terhadap Niat Beli Looké Beauty

The Mobile Augmented Reality (MAR) application is a marketing innovation that enhances consumer experiences by enabling virtual product trials despite distance and time constraints. This study examines the impact of MAR on purchase intention through perceived enjoyment and usefulness. Data were collected via online questionnaires using purposive and snowball sampling methods and analyzed using SmartPLS. Results indicate that virtual presence and devices influence enjoyment and usefulness directly and indirectly in shaping purchase intentions. Moreover, enjoyment and usefulness are found to have a positive effect on purchase intentions.

Implementation of Augmented Reality Snap That Animal Using MDLC Method as Learning Media

This research introduces Snap That Animal, an augmented reality (AR) mobile application designed as an innovative educational tool for early childhood education. The study focuses on identifying challenges faced by teachers at Aisyiyah Bustanul Athfal Krajan Kindergarten when using traditional teaching methods to engage young learners. To address these challenges, the application was developed using the Multimedia Development Life Cycle (MDLC) method, incorporating the Vuforia SDK on the Android platform to create interactive 3D animal models activated by markers. This interactive approach aims to enhance student interest and learning outcomes by offering more engaging and accessible educational content. The app underwent thorough testing, including marker recognition under varying light intensities, tilt angles, and distances, as well as compatibility with different devices. Results demonstrated that the application performs efficiently in real-life educational settings. A quantitative descriptive approach was employed, with data collected through a questionnaire. The study population consisted of kindergarten teachers, and a total sample of nine teachers participated as respondents. The processed questionnaire results, evaluated using an assessment scale, revealed a feasibility rating of “very good,” with a score of 93.56%. In conclusion, the findings suggest that AR applications like Snap That Animal significantly enhance student engagement and learning effectiveness in early childhood education.

Mring: Contactless MR/AR Extended Input Method Based on Magnetic Signal

In recent years, the rapid rise of Mixed Reality (MR) and Augmented Reality (AR) technologies has transformed digital interactions and immersive experiences, as evidenced by their widespread adoption in AR glasses, MR headsets, and mobile AR applications. However, integrating MR and AR into everyday life also presents unique problems, particularly concerning user interactions within limited visual fields and discomfort caused by prolonged arm elevation. To address these challenges, our research introduces an innovative input device utilizing common wearable device magnetometer sensors and a strong magnet as input controls. We employ innovative methods to eliminate environmental magnetic field and soft magnetic offset, achieving trajectory restoration with an error margin of 5.23 mm through machine learning and trajectory smoothing algorithms. This enables our input device to interact with MR and AR devices beyond the user’s visual range, expanding operational space, and enhancing usability.

BioApp: A Mobile Augmented Reality Application to Enhance Junior High School Students’ Academic Performance in the field of Ecological Relationship in Biology.

This study investigates student difficulties in understanding biology concepts, particularly during the transition from basic topics like sexuality to complex areas such as genetics. Challenges include reduced engagement and participation, leading to lower performance in assessments. To address these issues, researchers propose "BIOAPP," an Augmented Reality (AR)-based solution designed to enhance learning experiences through interactive and immersive methods. The application prioritizes cost-effective implementation and accessibility, even in low-connectivity areas. The study employs a quantitative research methodology with purposive sampling to assess AR's effectiveness in improving biology education. The resulting mobile game integrates AR to create a dynamic and engaging learning environment, functioning as both an instructional tool and a diagnostic system for tracking student comprehension. This innovative approach aims to renew student interest and participation in biology, offering a transformative and accessible educational solution.

Mobile Augmented Reality Application to Evaluate the River Flooding Impact in Coimbra

The downtown area of the city of Coimbra, Portugal, is at low altitude and has historically suffered floods that have caused serious economic losses. The present research proposes a mobile augmented reality (MAR) application aimed at visualising the effect of possible scenarios of flooding in an area of higher risk in the city. A realistic 3D model of the city was created, using data extracted with BLosm and processed through Blender, followed by its integration into Unity with Vuforia for AR visualisation. The methodology encompasses the extraction and simplification of 3D models, mapping real-world coordinates in Unity, analysing several datasets, obtaining a model through regression and implementing a workflow to manage interactions between various Unity objects. The MAR application enables users to visualise potential flood impacts on buildings, utilising colour-coded indicators to represent different levels of water contact. The system’s efficacy was evaluated by simulating various use-case scenarios, demonstrating the application’s capability to provide real-time, interactive flood risk assessments. The results underline the potential of integrating AR and machine learning for enhancing urban flood management and prevention.

Teaching students with autism spectrum disorder how to use an augmented reality application and the vocabulary of the natural sciences

Technology-based interventions are considered evidence-based for teaching students with Autism Spectrum Disorder (ASD). The main purpose of this study is to teach students with ASD the use of augmented reality (AR) mobile applications through systematic instruction and to test the effectiveness of the presented AR mobile application in teaching science concepts. The secondary aim of this study was to examine the students’ and teachers’ views on the acceptability of the AR mobile application in teaching science vocabulary. Three primary and one secondary school students with ASD, aged 10-13 years, participated in the study. A multiple probe design across participants was used to evaluate the effects of the intervention package. The findings showed that systematic instruction using an AR mobile application is effective in science vocabulary for students with ASD. All students reported using an AR mobile application to learn science vocabulary words was socially acceptable. These results suggest that the AR mobile applications may be a promising instruction instrument that is effective, efficient, and cost-effective. Implications for future research and practice are then discussed.

An augmented reality mobile application designed for pharmacology teaching.

An augmented reality mobile application designed for pharmacology teaching.

Robust Collaborative Visual-Inertial SLAM for Mobile Augmented Reality.

Achieving precise real-time localization and ensuring robustness are critical challenges in multi-user mobile AR applications. Leveraging collaborative information to augment tracking accuracy on lightweight devices and fortify overall system robustness emerges as a crucial necessity. In this paper, we propose a robust centralized collaborative rnulti-agent VI-SLAM system for mobile AR interaction and server-side efficient consistent mapping. The system deploys a lightweight VIO frontend on mobile devices for real-time tracking, and a backend running on a remote server to update multiple submaps. When overlapping areas between submaps across agents are detected, the system performs submap fusion to establish a globally consistent map. Additionally, we propose a map registration and fusion strategy based on covisibility areas for online registration and fusion in multi-agent scenarios. To improve the tracking accuracy of the frontend on agent, we introduce a strategy for updating the global map to the local map at a moderate frequency between the camera-rate pose estimation of the frontend VIO and the low-frequency global map optimization, using a tightly coupled strategy to achieve consistency of the multi-agent frontend poses estimation in the global map. The effectiveness of the proposed method is further confirmed by executing backend mapping on the server and deploying VIO frontends on multiple mobile devices for AR demostration. Additionally, we discuss the scalability of the proposed system by analyzing network traffic, synchronization frequency, and other factors at both the agent and server ends.

Cooperative augmented assembly (CAA): augmented reality for on-site cooperative robotic fabrication

Recent years have witnessed significant advances in computational design and robotic fabrication for large-scale manufacturing. Although these advances have enhanced the speed, precision, and reproducibility of digital fabrication processes, they often lack adaptability and fail to integrate manual actions in a digital model. Addressing this challenge, the present study introduces cooperative augmented assembly (CAA), a phone-based mobile Augmented Reality (AR) application that facilitates cooperative assembly of complex timber structures between humans and robots. CAA enables augmented manual assembly, intuitive robot control and supervision, and task sharing between humans and robots, creating an adaptive digital fabrication process. To allocate tasks to manual or robotic actions, the mobile AR application allows multiple users to access a shared digital workspace. This is achieved through a flexible communication system that allows numerous users and robots to cooperate seamlessly. By harnessing a cloud-based augmented reality system in combination with an adaptive digital model, CAA aims to better incorporate human actions in robotic fabrication setups, facilitating human–machine cooperation workflows and establishing a highly intuitive, adaptable digital fabrication process within the Architecture, Engineering, and Construction sector.

Multi-Camera Lighting Estimation for Mobile Augmented Reality

Lighting estimation is an important and long-standing task in computer vision and graphics communities[1]. Over the past few years, we have observed a rising demand for creating immersive user experiences in mobile augmented reality (AR) applications. In particular, environment lighting estimation is essential to render visually coherent virtual objects that need to be overlaid on physical scenes in mobile AR. In this work, we explore the key research questions in lighting understanding for an emerging application domain, mobile AR on multi-camera handheld devices, particularly try-on applications where end users leverage handheld mobile devices, such as smartphones, to overlay products of interest on their faces. Mobile AR try-on apps promote online shopping and often require photorealism to provide user experiences on par with physical try-on.

Task offloading scheme in Mobile Augmented Reality using hybrid Monte Carlo tree search (HMCTS)

Mobile Augmented Reality (MAR) applications enhance user experiences by providing realistic information about the current location through mobile devices. However, MAR applications are computationally intensive, leading to high energy consumption and latency issues. To address these challenges, this research presents a Hybrid Monte Carlo Tree Search (HMCTS) based task offloading scheme, combining a genetic algorithm with Monte Carlo tree search for efficient task management. The proposed method uses YoloV7 for object recognition and aims to reduce energy consumption, response time, and migration time. Experimental results demonstrate that the HMCTS approach significantly reduces energy consumption to 1290 kJ, response time to 24 ms, and migration time to 0.52 ms, outperforming existing techniques. These improvements highlight the potential of the HMCTS method for enhancing the performance of MAR applications. Proposed hybrid approach aims to improve the efficiency and effectiveness of task offloading in MAR applications. The HMCTS model dynamically offloads tasks to edge servers, optimizing scheduling time, response time, and energy consumption.

SCI-AR: ENHANCE SCIENCE LEARNING THROUGH AUGMENTED REALITY

This research work is focused on development of a mobile augmented reality application, for use in helping kids with learning problem in science class. Science per se has inherent features that are abstract in nature, thus complicating the processes of learning and at the same time giving a negative outlook towards science. In this regard, the application has the use of graphics and symbols combining with the use of AR that enhances understanding and leads to involvement of students. It can be on Android OS for mobile phones with Unity3D and ARFoundation/ARCore as the development tools. Acceptance of consumer Credit has used the Technology Acceptance Model for developing its theoretical modelling of prediction. In making the system, the development model of Agile Methodology Model has been adopted. This study tries to apply a new approach that enhances the learners’ motivation and confidence in science learning without pre-empting any other teaching strategy. As for the application of a mobile and graphically augmented reality, it raises a lot of potential for improvement of science learning for children with certain learning difficulties in this new, interactive type of format.

Augmented Reality Mobile Application for Promoting Culture and Heritage in Thailand and Malaysia: The Prototype Development and Heuristic Evaluation

The global coronavirus pandemic sparked widespread lockdowns and travel restrictions, leading to a significant economic downturn. However, the subsequent development of vaccines prompted governments to ease restrictions and explore technology-driven strategies for tourism revival, including the use of mobile applications and augmented reality (AR). In light of the progress of AR, this study addresses the lack of AR applications for promoting tourism in Southeast Asia, particularly in Thailand and Malaysia, where language barriers hinder cross-cultural communication. Therefore, this study aims to develop a content-specific AR mobile application to enhance tourists’ exploration of cultural heritage and facilitate communication in these multicultural and Islamic-influenced regions. This study adopts the design thinking approach for a solution-based methodology. The developed AR mobile application aims to enhance the tourist experience by providing immersive and informative content specific to the culture and heritage. The prototype undergoes a heuristic evaluation by ten experts in human-computer interaction (HCI). The results show a positive consensus on many aspects, highlighting the potential of the AR mobile application to promote culture and heritage effectively. Qualitative exploration through expert feedback is recommended in future studies to refine specific elements for a universally satisfactory user experience.

Text Entry Performance and Situation Awareness of a Joint Optical See-Through Head-Mounted Display and Smartphone System.

Optical see-through head-mounted displays (OST HMDs) are a popular output medium for mobile Augmented Reality (AR) applications. To date, they lack efficient text entry techniques. Smartphones are a major text entry medium in mobile contexts but attentional demands can contribute to accidents while typing on the go. Mobile multi-display ecologies, such as combined OST HMD-smartphone systems, promise performance and situation awareness benefits over single-device use. We study the joint performance of text entry on mobile phones with text output on optical see-through head-mounted displays. A series of five experiments with a total of 86 participants indicate that, as of today, the challenges in such a joint interactive system outweigh the potential benefits.

Development of a mobile augmented reality application to enhance youth engagement in planning and designing public spaces in urban areas

Development of a mobile augmented reality application to enhance youth engagement in planning and designing public spaces in urban areas