Mobile Augmented Reality Applications Research Articles

Machine learning based augmented reality for improved learning application through object detection algorithms

Detection of objects and their location in an image are important elements of current research in computer vision. In May 2020, Meta released its state-of-the-art object-detection model based on a transformer architecture called detection transformer (DETR). There are several object-detection models such as region-based convolutional neural network (R-CNN), you only look once (YOLO) and single shot detectors (SSD), but none have used a transformer to accomplish this task. These models mentioned earlier, use all sorts of hyperparameters and layers. However, the advantages of using a transformer pattern make the architecture simple and easy to implement. In this paper, we determine the name of a chemical experiment through two steps: firstly, by building a DETR model, trained on a customized dataset, and then integrate it into an augmented reality mobile application. By detecting the objects used during the realization of an experiment, we can predict the name of the experiment using a multi-class classification approach. The combination of various computer vision techniques with augmented reality is indeed promising and offers a better user experience.

Smart pictorial dictionary via mobile augmented reality

Augmented reality (AR) technology offers many benefits for language teaching and learning. Using the AR technique in pedagogy attracts and engages children to learn and memorize easily, even in a short time. Visual representation learning method like a pictorial dictionary is one of the beginnings of learning for children. It helps children to visualize the object and memorize it in effective ways. Based on the survey conducted in one of the primary schools at Merlimau, Melaka, it was found that the children have difficulties in learning English. The development of pictorial dictionaries with the combination of AR technology in 3D that are presented in the form of mobile applications can be used to improve existing learning methods in English. The method used during the development of this application is the ADDIE model, which comes with five phases: analysis, design, development, implementation, and evaluation. The development of the ‘smart pictorial dictionary via mobile AR application has been done successfully and has received positive results. Based on the evaluation using the attention relevance confidence satisfaction (ARCS) model, the output has an overall mean of 4.58, which shows that using AR technology in early childhood learning makes children learn more.

Collaborative Content Caching and Task Offloading in Multi-Access Edge Computing

Mobile augmented reality (MAR) applications are gaining popularity. There are significant challenges in handling the latency-sensitive and computation-intensive tasks generated by MAR applications on mobile devices. The emergence of mobile edge computing (MEC) provides a new idea to improve the computing capability of resource-constrained mobile terminals. In this paper, we study the task offloading and cache placement of MAR tasks in multi-MEC server cooperation system. The problem of the task offloading and cache placement is formulated to maximize the hit ratio and minimize the service latency under the constraints of MEC server's computing resources and cache space. To solve this problem, we propose a task offloading and cache placement (MOTOCP) algorithm based on multi-objective artificial bee colony. Pareto optimal relation is introduced in the optimization process to find the optimal solution. Extensive evaluation verifies that our proposed algorithm has better performance.

Design Media Interactive of Mobile Augmented Reality (AR) in Education for Health Learning

Abstract− Augmented Reality (AR) is a technology that is developing rapidly nowadays, the use of Augmented reality technology is widely used in various fields, one of which is health. The application of augmented reality to health is not only done technically but also in the form of learning. There are still many things that have not been achieved regarding Health education. This research was conducted to realize innovative and interesting learning for students, this application is designed to simplify, save costs and increase student interest in learning without having to reduce the information conveyed. The result of this research is the Design of an Augmented Reality Mobile Application for health that focuses on learning. Test results 80% of students said that 80% said they were very good at implementing AR applications for health learning.

Usability Evaluation with Eye Tracking: The Case of a Mobile Augmented Reality Application with Historical Images for Urban Cultural Heritage

Eye-tracking technologies have matured significantly in recent years and have become more affordable and easier to use. We investigated how eye-tracking technology can be applied to evaluate the usability of mobile augmented reality applications with historical images for urban cultural heritage. The experiment involved a series of complex user evaluation sessions, combining semi-structured interviews, observations, think-aloud protocol, SUS questionnaire, and product reaction cards, complemented by eye tracking, to gather insights on the Spotlight Timisoara AR mobile application, part of a digital storytelling multiplatform for the city of Timisoara (Romania), soon to be European Capital of Culture in 2023. The results indicate strong and weak aspects of the application, both as expressed by the participants and as derived from analyzing the eye-tracking data. The paper also lists the main challenges we identified in using eye-tracking equipment to evaluate the usability of such mobile augmented reality applications for urban outdoor heritage.

Immersive Learning Experience Design (ILXD): Augmented Reality Mobile Application for Placing and Interacting with 3D Learning Objects in Engineering Education

The Computer Numerical Control (CNC) machine operates based on a numerical control program generated semi-automatically by a Computer Aided Manufacturing (CAM) system or manually by the operator. Repeated practice is required to operate a CNC machine. For an inexperienced operator (student), the practicum requires extensive use of materials and cutting instruments. In the meantime, the number of laboratory equipment for the CNC programming practicum remains limited, and the 3-axis CNC milling machine training unit is inadequate for the number of students. For this reason, we need a medium that can simulate the machining process to aid students in their early stages of learning. This research aims to create a mobile application for milling machine visualization based on augmented reality. This augmented reality (AR) application, "MM: CTU 3-Axis," or Machine Milling CNC Training Unit 3-Axis, was designed with 3D virtual objects to provide students with knowledge and practical experience. The application development model used Multimedia Development Life Cycle (MDLC). This research yields an Android-based augmented reality (AR) application called "MM: CTU 3-Axis" that does not require markers. The development and verification results demonstrated that this application could aid in learning CNC programming and machining practicum, as well as reduce the cost of using cutting tools and the cost of using materials due to repeated experiments on CNC machines.

The Effects of Mobile AR-based Biology Learning Experience on Students' Motivation, Self-Efficacy, and Attitudes in Online Learning.

The purpose of this study is to enhance online biology learning with mobile augmented reality (AR) applications and to assess the impact of mobile AR applications on students' motivation, self-efficacy, and attitudes toward biology learning. Students were interviewed, and the usefulness of mobile AR applications was evaluated using a quasi-experimental pretest-posttest approach. The study group consists of 71 high school students, 26 in the control group and 45 in the experimental group, attending a public high school in the Western Black Sea Region of Turkey during the academic year 2020-2021. The self-efficacy ratings of the experimental group of students who participated in mobile AR-based biology learning were statistically higher than those of the control group after a 12-week trial. However, there were no statistically significant differences between experimental and control group students' motivation and attitudes toward biology learning. In addition, as a result of student interviews, mobile AR applications were deemed innovative, non-distracting, successful in knowledge acquisition, engaging, intriguing, and entertaining, boosting information retention, concretizing the subject, and facilitating learning.

The effects of augmented reality on consumer responses in mobile shopping: The moderating role of task complexity

Augmented reality (AR) solutions help facilitate consumers' direct examinations, enhancing their shopping experiences in the digital commerce context. This study examines consumer responses to AR in mobile shopping. It investigates the relationships among perceived media richness, interactivity, telepresence, utilitarian and hedonic values, and behavioral intentions. Furthermore, it explores whether these relationships differ depending on consumers’ perceived task complexity. A total of 279 mobile application users participated in the online survey. The participants were guided to answer an online questionnaire after utilizing an AR mobile application to purchase a jewelry product. The findings reveal that media richness and interactivity positively influence telepresence, and telepresence increases behavioral intentions through perceived utilitarian and hedonic values. The effect of interactivity on telepresence and the impact of telepresence on utilitarian value are higher for consumers with low task complexity perception. By contrast, the impact of telepresence on hedonic value is higher for consumers with high task complexity perception. The results suggest practical implications for mobile retailers that apply advanced AR technology in retailing.

Optimal service decomposition for mobile augmented reality with edge cloud support

Mobile augmented reality (MAR) applications are starting to attract significant attention due to the enhanced capabilities stemming from both the network and the end devices that propel their realization. However, despite the progress on the end user devices, MAR applications are inherently hugely demanding in terms of computational and memory requirements since they combine, inter alia, video streams, computer generated images, intense computer vision algorithms and geolocation. To this end, edge cloud computing is envisioned as a key technology for supporting such applications where part of the computationally demanding algorithms could be offloaded to suitably selected edge clouds. Within that context the inherent user mobility should be considered to allow an efficient service continuum between edge and the end-terminal. To this end, in this paper, an optimal edge cloud resource MAR service decomposition is presented that takes explicitly into account the AR service composition as well as the inherent user mobility to proactively allocate resources to satisfy the required strict latency and frame accuracy requirements of MAR applications. In addition to the optimal decision making using mathematical programming, and as a mean to provide real-time decision making two advanced heuristic techniques are proposed. A Simulated Annealing based mobility aware AR algorithm (SAMAR) is developed to enhance computing efficiency and a Long Short-Term Memory (LSTM) neural network which is trained offline with optimal solutions. Numerical investigations reveal that significant gains can be achieved by the proposed schemes compare to a number of baseline previously proposed techniques.

Using an augmented reality application for teaching plant parts: A case study in 1ˢᵗ-grade primary school students

The rapid development of augmented reality (AR) applications has led to wide adoption in education, acting as a supporting tool to increase the transmitted information. However, children need to improve their knowledge of plants, their categories, their conceptual framework as well as the human relationship with them. This research studies the learning outcomes of a plant-themed augmented reality mobile application and its key features designed for 1st graders of primary school. The results of the research showed that there was no statistically significant improvement between the experimental group and the control group.

Usability Analysis Aplikasi Mobile Augmented Reality (MAR) untuk Multimedia Pembelajaran Motherboard (Aplikasi AR-Mobo)

Currently, Augmented Reality (AR) technology has developed into an easy-to-use, efficient and effective technology for providing innovative educational media. Mobile Augmented Reality (MAR) is an Augmented Reality technology that utilizes mobile devices, for example, smartphones. The MAR application for multimedia learning on the motherboard is seldom used in classroom learning so the effectiveness of learning is less than optimal. The research objective was to determine the level of usability of the MAR application system using the USE questionnaire. According to Arnold M. Lund, Usability analysis has 4 aspects: usefulness, ease of use, ease of learning, and satisfaction. The method used is usability testing with 90 engineering students participating as research subjects. This study uses a questionnaire as a data collection tool and uses descriptive statistical analysis. The results of this study, that the average usability analysis score is 86.22 is included in the very feasible category, based on the system feasibility category table. The developed MAR application shows that it has provided better user interaction. This research has the benefit of knowing the use of MAR applications on students, for specific purposes, namely effectiveness, efficiency, and satisfaction. Lack of user motivation, and lack of features, will cause stress. This occurs when the system cannot meet the goals of its users.

3D Augmented Reality Marker-based Mobile Apps Design of Face Mask Layer

The outbreak of COVID-19 has spread rapidly across the globe, affecting how people interact, work and experience their daily lifestyles. The face mask is essential to personal protective equipment (PPE) even though COVID-19 is endemic today. A face mask is required to protect humans, and its description is important. Augmented reality is one new attractive technology for distributing information. This research presents a 3D augmented reality mobile application that visualizes a protective face mask and its material layers called 3DAR-FML. It was designed by utilizing 3D marker-based images on an Android smartphone platform. Ten types of protective face masks and each layer were designed in 3D images using Blender Animation and Unity 3D software. Vuforia Engine applications were used to build a personalized mobile Augmented Reality application. This initiative educates society and markets products in interactive ways that allow visualization of the 3D model of various face masks from android phones. Results present that successful mobile apps were developed. A survey shows that 70% of respondents agreed on the design app based on menu interactivity. This app also has been identified as a helper tool for The National Institute for Occupational Safety and Health (NIOSH) agency Malaysia for safety and health apps for the market and public. This product is significant in societies to gain information on face mask characteristics that help to contribute content based on the standard mask in Malaysia.

Mobile augmented reality system for object detection, alert, and safety

The usefulness of mobile devices has increased greatly in recent years allowing users to perform more tasks in daily life. Mobile devices and applications provide many benefits for users, perhaps most significantly is the increased access to point-of-use tools, navigation, and alert systems. This paper presents a prototype of a cross-platform mobile augmented reality (AR) system with the core purpose of finding a better means to keep the campus community secure and connected. The mobile AR System consists of four core functionalities – an events system, a policing system, a directory system, and a notification system. The events system keeps the community up-to-date on current events that are happening or will be happening on campus. The policing system allows the community to stay in arms reach of campus resources that will allow them to stay secure. The directory system serves as a one-stop-shop for campus resources, ensuring that staff, faculty, and students will have a convenient and efficient means of accessing pertinent information on the campus departments. The mobile augmented reality system includes integrated guided navigation system that users can use to get directions to various destinations on campus. The various destinations are different buildings and departments on campus. This mobile augmented reality application will assist the students and visitors on campus to efficiently navigate the campus as well as send alert and notifications in case of emergencies. This will allow campus police to respond to the emergencies in a quick and timely manner. The mobile AR system was designed using Unity Game Engine and Vuforia Engine for object detection and classification. Google Map API was integrated for GPS integration in order to provide location-based services. Our contribution lies in our approach to create a user specific customizable navigational and alert system in order to improve the safety of the users at their workplace. Specifically, the paper describes the design and implementation of the proposed mobile AR system and reports the results of the pilot study conducted to evaluate their perceived ease-of-use, and usability.

Mobile Augmented Reality: User Interfaces, Frameworks, and Intelligence

Mobile Augmented Reality (MAR) integrates computer-generated virtual objects with physical environments for mobile devices. MAR systems enable users to interact with MAR devices, such as smartphones and head-worn wearables, and perform seamless transitions from the physical world to a mixed world with digital entities. These MAR systems support user experiences using MAR devices to provide universal access to digital content. Over the past 20 years, several MAR systems have been developed, however, the studies and design of MAR frameworks have not yet been systematically reviewed from the perspective of user-centric design. This article presents the first effort of surveying existing MAR frameworks (count: 37) and further discusses the latest studies on MAR through a top-down approach: (1) MAR applications; (2) MAR visualisation techniques adaptive to user mobility and contexts; (3) systematic evaluation of MAR frameworks, including supported platforms and corresponding features such as tracking, feature extraction, and sensing capabilities; (4) and underlying machine learning approaches supporting intelligent operations within MAR systems. Finally, we summarise the development of emerging research fields and the current state-of-the-art and discuss the important open challenges and possible theoretical and technical directions. This survey aims to benefit both researchers and MAR system developers alike.

Students’ Opinions on the Usage of Mobile Augmented Reality Application in Health Education

The use of mobile augmented reality technology has recently improved in education and training methods. Studies have shown that this new technology has a positive effect on education and students. This study aims to present a synthesis of the studies on mobile augmented reality in health education with a critical approach and to develop suggestions for future researchers. In addition, by presenting an application on the effect of the use of augmented reality in health education on the performance of students, it is aimed to investigate the students' perspectives on the use of this technology and its use as an educational tool in teaching-learning through students' perspectives. For this purpose, an anatomy application for anatomy lesson was designed with Unity 3B platform, Blender and After Effect, and 150 students studying at Vocational Department of Health Services were asked to experience the augmented reality application developed. Mobile augmented reality application was made available to students during the application process. as a result, “Student Views Questionnaire on the Use of Augmented Reality Application in Health Education” was applied. Frequency and percentage distributions were used to determine student views. The results obtained in the research show that students respond positively to the use of technology and they believe that the use of technology in the learning-teaching process will increase their performance.

The Effect of Augmented Reality Mobile Application on Visitor Impact Mediated by Rational Hedonism: Evidence from Subak Museum

This study expands our comprehension of museum visitor impact within a system quality, information quality, and augmented reality (AR) media content quality on mobile applications. Museums meet new defiance of escalating expectancies of their visitors. As a result of the universal mobile phone tool, AR has arisen as the latest technology offered to the museum to increase its visitors. These expectancies are fostered by the improvement of modern technologies like AR on the mobile app. Across an online survey of 241 visitors, the study determines the constructs affecting visitor impact within museum' mobile apps and the consequential results of AR-linked visitor impact. The study proposes a recent set of AR features, explicitly, system quality, information system, and AR media content quality, and establishes their influence on rational hedonism and satisfaction experienced, thus enhancing visitor impact. The findings also show that the rational hedonism and satisfaction experienced are positioned as full mediators for the relationship between system quality & information quality and visitor impact. In contrast, these mediators partially influence the indirect relationship between AR media content quality and visitor impact. Moreover, the results affirm that AR media content quality within the mobile application is the most critical construct to directly enhance visitor impact, whereas the system quality and information quality have no influence yet. From a practical point of view, the importance of AR technology for the museum can support entice new visitors to museums and improve to make more incomes.

Mobile Augmented Reality Applications in Higher Education

Visual technologies such as AR (Augmented Reality), VR (Virtual Reality), or MR (Mixed Reality) show an increase in popularity in the educational field. In addition to the fact that they can significantly improve the transfer of information in education, they can turn lessons into more interesting and interactive activities. Among these technologies, AR has become the most accessible, due to the rise in the popularity of mobile devices. The increasing popularity of distance teaching and the increasing performance of mobile devices and applications will make this topic an important one in the future in educational psychology. The current study aims to evaluate the effectiveness of using AR in learning and compare it with classical 3D models. Following the calculations, we discovered a minor influence. This implies that the group of students who used simple 3D outperformed the group of students who used Assemblr AR, but the gap between the 2 learning methods was not very wide. The results indicate that the use of 3D models is effective in learning but there is no significant difference between the AR and normal 3D models. The limited effects and the findings of other studies on AR in education imply that additional research is required.

Students’ Acceptance of Mobile Augmented Reality Applications in Primary and Secondary Biology Education

Augmented reality is often indicated as a usable educational technology that can be integrated into biology classes to overcome the shortcomings of traditional teaching (such as lack of visualization of abstract teaching content, students’ low participation and interest in classes, and their insufficient understanding of complex topics). Mobile applications with augmented reality experience mode have the potential to be used in online, blended/hybrid, and in-person teaching, which is particularly important during emergencies. This study’s purpose was to determine primary and secondary school students’ acceptance of augmented reality content in commercial mobile applications that can be used as a supplement in biology teaching. A total of 188 students (from schools included in this research) completed the online questionnaire. The results showed that the majority of students perceived mobile augmented reality applications as useful and easy to use, had a positive attitude, and expressed intention to use this educational technology if given the opportunity. The importance of prior evaluation regarding educational usability and performance is highlighted since technical quality (of used mobile applications) had a strong positive effect on perceived usefulness and perceived ease of use. There were no statistically significant differences between female and male and primary and secondary students, but students with prior experience with augmented reality rated perceived usefulness higher. Despite positive results, we need to raise our concerns regarding the reliability of using mobile augmented reality in biology education due to the lack of usable free content and the frequent cancellation of authoring tools and applications.

Improving Grade 8 Students’ Academic Performance and Attitude in Teaching Science through Augmented Reality

Strategic Intervention Material for Teaching Augmented Reality (SIMaTAR) is a collection of teaching and learning materials in Science which uses augmented reality technology to greatly improve learning experience through digital immersion in different 3D and 4D worlds and is under the innovative approaches in science education project of DOST-SEI. This study aimed to assess the effectiveness of using SIMaTAR mobile application as a tool on improving the Grade 8 students’ academic performance, motivation, and attitude towards learning science as well as the teachers’ assessment upon using the application. Results showed that all indicators on the teachers and students’ assessment on SIMaTAR mobile augmented reality application were rated as strongly agree. All indicators of students’ attitude towards science showed improvement after implementing the AR application in science teaching. Further, the scores of the student participants in pre-test and post-test were remarkably increased after using the application. As for the challenges, results revealed that students do not have the gadgets to use and they lack the knowledge on how to manipulate the application. Through data analysis using paired samples t-test, it is concluded that the integration of SIMaTAR in teaching science increases the engagement and interest of the students in learning the subject and the application of mobile augmented reality could substantially improve the teaching and learning process.

The usability of a novel mobile augmented reality application for excavation process considering safety and productivity in construction

PurposeThis study aims to assess the usability of augmented reality (AR) based mobile app for excavation and earthmoving processes using a novel tool entitled Excavator Augmented Reality (EAR).Design/methodology/approachA mixed-methods research approach was used through conducting experimentation to collect qualitative and quantitative data collected from the Sri Lankan construction sector. EAR app was used for experimentation in outdoor areas examining how a 360° tracked hydraulic excavator can be navigated in different physical environments similar to the real prospected job.FindingsThe findings reveal that EAR could make a considerable impact on enhancing productivity, safety and training processes. However, the developed EAR App subjected to assessment demonstrated the highest satisfaction gap for the auditory aspects. Among the remaining criterion, the satisfaction met user expectations for comfortability and no-risk practice. An analysis of strengths, weaknesses, opportunities and threats (SWOT analysis) conducted revealed that visualising the excavator activities and the requirements of improved features were the highest agreed strengths and weaknesses of the EAR. Among the opportunities for improvement, the necessity of improving emergency and safety reached the highest agreement. Moreover, the study presented the challenges in introducing mobile augmented reality (MAR) to the construction sector under the political, economic, sociocultural, technological, environmental and legal (PESTEL) model along with solutions to be taken.Originality/valueThis study provides a novel approach to addressing the safety, productivity and training concerns in heavy mobile plants and machinery on construction sites which remains to be unexplored to this end.