Augmented Reality Applications Research Articles

User-Centered Evaluation Framework to Support the Interaction Design for Augmented Reality Applications

User-Centered Evaluation Framework to Support the Interaction Design for Augmented Reality Applications

A look into the neighboring discipline: eHealth in oncology

Digitalization is dramatically changing the entire healthcare system. Keywords such as artificial intelligence, electronic patient files (ePA), electronic prescriptions (eRp), telemedicine, wearables, augmented reality and digital health applications (DiGA) represent the digital transformation that is already taking place. Digital becomes real! This article outlines the state of research and development, current plans and ongoing uses of digital tools in oncology in the first half of 2024. The possibilities for using artificial intelligence and the use of DiGAs in oncology are presented in more detail in this overview according to their stage of development as they already show anoticeable benefit in oncology.

Development and Implementation of Visualization of CPU Components using AR

Augmented Reality (AR) technology presents innovative solutions for visualizing complex concepts and systems. This paper investigates the utilization of AR in the visualization of CPU (Central Processing Unit) components, with the objective of augmenting comprehension and learning within computer architecture. By developing an AR application, CPU components are depicted in three dimensions, enabling users to interactively explore and comprehend their functionalities and interconnections. The paper delineates the design and execution of the AR system and discusses its potential advantages for education, training, and technical problem-solving in computer science and engineering. Keywords: Augmented Reality, CPU Components, Visualization, Computer Architecture.

The effect of augmented reality application (ARSINAPS) on learning motivation and outcomes in biology

This study aims to determine the effectiveness of using the ARSINAPS mobile augmented reality application on learning motivation and outcomes in high school and biology education students. The method used in this study was quasi-experimental with a post-test control group design. The research sample consisted of two experimental classes and two control classes from three schools in the Jakarta, Bekasi, and Tangerang areas, totalling 140 students, and from the college level, consisting of one experimental class and one control class, totalling 68 students. The data obtained were in the form of learning outcomes in the respiratory system and learning motivation scores in biology learning. The average high school-level motivation score in the control class was 85.99, and the overall average for learning outcomes was 77.33 and 63.05. Based on the results of the data calculations, the application effectively improves students’ learning outcomes at the high school and undergraduate levels

Delay-guaranteed Mobile Augmented Reality Task Offloading in Edge-assisted Environment

With the introduction of Augmented Reality (AR) into mobile devices, it becomes a trend to develop mobile AR applications in various fields. However, the execution of AR task demands the extensive resources of computation, memory and storage, which makes it difficult for mobile terminals with constrained hardware resources to carry out AR applications within the limited delay. In response to this challenge, we propose a mobile AR offloading method under the edge-assisted environment. Firstly, we divide an AR task into consecutive subtasks, and then collect the features of hardware, software, configuration, and runtime environments from the edge servers to be offloaded. With the features, we construct an AR subtask Execution delay Prediction Bayesian Network (EPBN) to predict the execution delay of different subtasks on each edge platform. Based on the prediction, we model the task offloading as the NP-hard Traveling Salesman Problem (TSP), and then propose a PSO-GA based solution by adopting the heuristic algorithm of Particle Swarm Optimization (PSO) to encode the offloading strategy and using Genetic Algorithm (GA) for particle update. The extensive experiments prove that the average performances of EPBN outperform the others with 17.23%, 23.97%, and 20.67% on micro-P, micro-R, and micro-F1 respectively, and the PSO-GA ensures that the offloading latency is reduced by nearly 5% compared to the suboptimal algorithm.

What Is the Future of Augmented Reality in Science Teaching and Learning? An Exploratory Study on Primary and Pre-School Teacher Students’ Views

While extensive research has explored the impact of Augmented Reality (AR) on student perspectives, experiences, and outcomes, there remains a significant gap in empirical studies focusing on teachers’ viewpoints, particularly within Science Education. Given that uncovering teachers’ viewpoints is crucial for leveraging AR technology’s potential in education since teachers decide whether to integrate it into their classrooms, the research question guiding this exploratory study is as follows: How do primary and pre-school teacher students perceive the integration of AR into Science teaching and learning following their engagement with pertinent university courses? Following a mixed-method approach, the data were collected via written questionnaires from 69 teacher students and focus group discussions involving 12 participants. Subsequent descriptive statistical and thematic analyses revealed that teacher students hold positive stances towards the integration of AR in Science Education. They emphasized that AR could significantly enhance motivational and cognitive outcomes for their future students while also improving accessibility and inclusion. Furthermore, their involvement in creating AR-enhanced materials not only increased course engagement and interest but also broadened their knowledge and fostered a sense of innovation, with the AR platform and application used being perceived as easy to use. Finally, challenges associated with classroom implementation were also highlighted.

The Effect of Augmented Reality Applications on Intravenous Catheter Placement Skill in Nursing Students: A Randomized Controlled Study

BackgroundAugmented reality (AR) is an emerging technology that is beginning to find use in health science education due to the advantages it brings to the teaching-learning process. This present study assessed the use of AR for the development of IV catheter placement skills in nursing students and the effects of the process on their learning satisfaction and self-confidence levels. MethodsThis randomized controlled study was completed with 91 nursing students in October, 2021, from whom data were collected using the Student Satisfaction and Self-Confidence in Learning Scale (SCLS) and the Intravenous Catheter Placement Procedure Steps Form (IVC-PPSF). ResultsAlthough higher scores were recorded in the experimental group, there was no significant difference in the IV catheter placement success scores or satisfaction of the students (p > 0.05). The difference was statistically significant for Self-Confidence (p < 0.05). ConclusionThe use of an AR application for the teaching of IV catheter placement was found to increase the self-confidence levels of the students. Expanding the use of AR applications into the teaching of other nursing practices will contribute positively to student success levels.

An Investigation into whether Applying Augmented Reality (AR) in Teaching Chemistry Enhances Chemical Cognitive Ability

Chemical cognitive ability is a fundamental aspect of effective chemistry education, facilitating students’ understanding of essential concepts such as substance structure, chemical transformations, and atomic bonding processes. Augmented reality (AR) technology has emerged as a promising tool in science education, offering immersive learning experiences that enhance students’ comprehension of chemical phenomena. This study explored the utilization of AR applications, specifically QuimiAR, in the designing of six simulation videos focusing on chemical bonding processes. These videos were integrated into a teaching method centered around the topic “Chemical Bonding” and implemented in a secondary school classroom in Hanoi, Vietnam, comprising 32 students. Following the AR-enhanced teaching session, students’ chemistry cognitive ability was evaluated using three methods: standardized tests assessing five criteria of chemistry cognitive ability according to the Vietnamese educational curriculum; surveys gauging students’ interest and knowledge acquisition using AR; and in?depth interviews. The results indicate that AR usage significantly increased students’ engagement in learning, enhanced their understanding of substance composition and chemical bonding processes, and improved their ability to apply knowledge to solve learning challenges. This research provides practical guidance for educators in leveraging the advantages of QuimiAR software to design simulations focusing on chemical bonding, thereby fostering students’ cognitive ability in chemistry. By expanding the use of AR technology to create various chemical simulations, teachers can cultivate students’ cognitive abilities in chemistry, promoting active learning and facilitating academic success.

Adoption of AR/VR and gamification in Future Healthcare Applications: A Mini Review

Abstract: In the era of rapidly evolving technology, Augmented Reality (AR) and Virtual Reality (VR) has emerged as a transformative force. Nowadays applications of AR and VR technology along with gamification techniques and incentives in the individual health is popular topic of study in academia. However, there is a need and opportunity to study the usage and challenges of AR/VR along with gamification applications in the healthcare system. To explore this, we did a survey in the software-engineer system. Based on the response, we found some of AR/VR app used in healthcare, as well as information regarding the purpose of using their applications and user experience. This survey is beneficial for both software developer as well as researchers in field of CS and medical science. It can give them information about the existing products in the market and potential problems of AR/VR and gamificationin the healthcare system.

Augmented Reality in Early Childhood Education: The Effect of Quiver Application on Science Learning

The aim of this study is to investigate the effect of Quiver application on science learning in preschool period. The study was organized in an experimental design from the nice research type. The sample of the study consisted of a total of 40 children in two kindergartens in the same school determined by random assignment. Five different checklists determined by the researchers were used as data collection tools. Pre-test and post-test were conducted just before and just after the interventions with the pre-prepared checklists. The data were analyzed using the nonparametric Mann Whitney U test used in the analysis of quantitative data. As a general result of the research, it was concluded that the activity processes planned with augmented reality application created a significant difference compared to the activity processes planned with traditional methods and provided higher learning. Looking at the themes separately, there was a significant difference in favor of the experimental groups in the themes of the cycle of water and rain formation, the life cycle of plants and the food chain, while there was no significant difference between the knowledge levels of the experimental and control groups in the themes of the life cycle of the frog and sea creatures.

Personalized Recommendation of College Students' Innovative Entrepreneurship Education Course Content Based on Bayesian Classifier

Computer-aided technology has revolutionized product communication and promotion strategies across industries. With the advent of advanced software tools and digital platforms, businesses now have unprecedented capabilities to create immersive and interactive experiences that effectively showcase their products to consumers. From 3D modeling and rendering software to virtual and augmented reality applications, computer-aided technology enables the creation of highly realistic visualizations and simulations, allowing consumers to interact with products virtually before making purchasing decisions. the integration of Multi-Modal Feature Fusion Classification (MMFFC) computer-aided technology heralds a new era of innovation and effectiveness. MMFFC harnesses the power of multiple data sources and modalities, such as text, images, and videos, to provide a comprehensive understanding of products and consumer preferences. By fusing these diverse features through advanced machine learning algorithms, MMFFC enables businesses to create highly targeted and personalized promotional campaigns. Through sentiment analysis of textual descriptions, image recognition of product attributes, and video analytics of consumer interactions, MMFFC facilitates the generation of rich, multimedia content that resonates with customers on a deeper level. Moreover, MMFFC allows for real-time adaptation and optimization of promotional strategies based on feedback and engagement metrics, ensuring continuous improvement and relevance in an ever-evolving market landscape. The MMFFC computer-aided technology, businesses can enhance their product communication efforts, forge stronger connections with consumers, and drive sales growth in an increasingly competitive marketplace. MMFFC has demonstrated an increase in engagement rates by 20% and a conversion rate improvement of 15%, highlighting its effectiveness in elevating product communication and promotion strategies.

Quantifying dwell time with location-based augmented reality: Dynamic AOI analysis on mobile eye tracking data with vision transformer

Mobile eye tracking captures egocentric vision and is well-suited for naturalistic studies. However, its data is noisy, especially when acquired outdoor with multiple participants over several sessions. Area of interest analysis on moving targets is difficult because A) camera and objects move nonlinearly and may disappear/reappear from the scene; and B) off-the-shelf analysis tools are limited to linearly moving objects. As a result, researchers resort to time-consuming manual annotation, which limits the use of mobile eye tracking in naturalistic studies. We introduce a method based on a fine-tuned Vision Transformer (ViT) model for classifying frames with overlaying gaze markers. After fine-tuning a model on a manually labelled training set made of 1.98% (=7845 frames) of our entire data for three epochs, our model reached 99.34% accuracy as evaluated on hold-out data. We used the method to quantify participants’ dwell time on a tablet during the outdoor user test of a mobile augmented reality application for biodiversity education. We discuss the benefits and limitations of our approach and its potential to be applied to other contexts.

Evolution of the meta-neurosurgeon: A systematic review of the current technical capabilities, limitations, and applications of augmented reality in neurosurgery.

Augmented reality (AR) applications in neurosurgery have expanded over the past decade with the introduction of headset-based platforms. Many studies have focused on either preoperative planning to tailor the approach to the patient's anatomy and pathology or intraoperative surgical navigation, primarily realized as AR navigation through microscope oculars. Additional efforts have been made to validate AR in trainee and patient education and to investigate novel surgical approaches. Our objective was to provide a systematic overview of AR in neurosurgery, provide current limitations of this technology, as well as highlight several applications of AR in neurosurgery. We performed a literature search in PubMed/Medline to identify papers that addressed the use of AR in neurosurgery. The authors screened three hundred and seventy-five papers, and 57 papers were selected, analyzed, and included in this systematic review. AR has made significant inroads in neurosurgery, particularly in neuronavigation. In spinal neurosurgery, this primarily has been used for pedicle screw placement. AR-based neuronavigation also has significant applications in cranial neurosurgery, including neurovascular, neurosurgical oncology, and skull base neurosurgery. Other potential applications include operating room streamlining, trainee and patient education, and telecommunications. AR has already made a significant impact in neurosurgery in the above domains and has the potential to be a paradigm-altering technology. Future development in AR should focus on both validating these applications and extending the role of AR.

Profile of Celestial Object Identification Skills of Junior High School Students in Indonesia

The ability to identify celestial objects provides significant benefits for improving students' motivation, understanding of the subject matter, reasoning, and skills, yet this area remains underexplored by researchers. This study aims to describe the profile of junior high school students' ability to identify celestial objects in science learning, particularly in the Solar System topic, focusing on their experiences in recognizing the names of celestial objects at night. Using a qualitative approach, this research involved semi-structured interviews with three science teachers and a survey of 31 7th-grade students who had not been taught the Solar System topic. The research instruments included student characteristics, availability of learning resources, challenges faced by students, teaching methods, and responses to the idea of outdoor learning with the assistance of an Augmented Reality (AR) application. The results indicate that, generally, students are not yet able to identify celestial objects other than the Moon due to limited prior experience and knowledge. Although teachers have attempted to introduce identification methods through instructional videos and direct explanations, this method is considered less accurate due to discrepancies between classroom learning and field experiences. However, both teachers and students recognize that identifying celestial objects can enrich understanding of the subject matter, increase motivation, and stimulate gratitude for God's creation. The positive response to the idea of outdoor learning with an AR application indicates high interest from both teachers and students in this approach.

Usability and user expectations of a HoloLens-based augmented reality application for learning clinical technical skills

The application of augmented reality in training health science students is increasingly widespread. The aim of this work was to assess the usability and user expectations of an augmented reality application for smart glasses (Microsoft HoloLens) that can be used to train on four invasive procedures (i.e. intramuscular injection, nasogastric tube insertion, endotracheal intubation and suctioning via tracheostomy tube). A descriptive study was conducted with nursing students from three Spanish universities. Participants answered a questionnaire to assess the use of the ARSim2care application. This application offers the possibility of visualizing the internal anatomical structures during the training of the clinical technical skills for the performance of the mentioned invasive techniques. The questionnaire included demographic data, the System Usability Scale and questions about the user expectations in relation to learning with the use of augmented reality. In total, 61 participants responded to the questionnaire after using the ARSim2care application. The mean score of the System Usability Scale was 73.15 (standard deviation: 15.04) and 62.4% (n = 38) of the participants considered their experience with the application as excellent or good. In relation to user expectations, more than 90% of students indicated that the use of the application could improve their motivation and stimulation in learning, their content retention and their anatomical understanding. The developed ARSim2care application for Microsoft HoloLens showed a high level of usability and acceptance as a learning tool for training certain clinical procedures by visualizing the internal structures of the body.

Wafer-Scale Characterization of 1692-Pixel-Per-Inch Blue Micro-LED Arrays with an Optimized ITO Layer

Wafer-scale blue micro-light-emitting diode (micro-LED) arrays were fabricated with a pixel size of 12 μm, a pixel pitch of 15 μm, and a pixel density of 1692 pixels per inch, achieved by optimizing the properties of e-beam-deposited and sputter-deposited indium tin oxide (ITO). Although the sputter-deposited ITO (S-ITO) films exhibited a densely packed morphology and lower resistivity compared to the e-beam-deposited ITO (E-ITO) films, the forward voltage (VF) values of a micro-LED with the S-ITO films were higher than those with the E-ITO films. The VF values for a single pixel and for four pixels with E-ITO films were 2.82 V and 2.83 V, respectively, while the corresponding values for S-ITO films were 3.50 V and 3.52 V. This was attributed to ion bombardment damage and nitrogen vacancies in the p-GaN layer. Surprisingly, the VF variations of a single pixel and of four pixels with the optimized E-ITO spreading layer from five different regions were only 0.09 V and 0.10 V, respectively. This extremely uniform VF variation is suitable for creating micro-LED displays to be used in AR and VR applications, circumventing the bottleneck in the development of long-lifespan and high-brightness organic LED devices for industrial mass production.

Participatory Exhibition-Viewing Using Augmented Reality and Analysis of Visitor Behavior

Augmented reality (AR) is rapidly becoming a popular technology for exhibitions. The extended content provided through virtual elements offers a higher level of interactivity and can increase the appeal of the exhibition for younger viewers, in particular. However, AR technology in exhibition settings is typically utilized to extend the effects of exhibits, focusing solely on individual experiences and lacking in shared social interactions. In order to address this limitation, in this study, we used AR technology to construct a participatory exhibition-viewing system in the form of an AR mobile application (app), “Wander Into Our Sea”. This system was developed as a component of the 2022 Greater Taipei Biennial of Contemporary Art exhibition titled “Log Into Our Sea”. The app features two modes: exhibition-viewing mode and message mode. The first embodies passive exhibition-viewing while the second offers channels for active participation. The app has three functions: (1) in exhibition mode, visitors passively view the exhibition content through the AR lens, (2) in message mode, visitors can use the AR lens to leave messages in the 3D space of the exhibition to become part of the exhibit, and (3) during the use of either mode, the app collects data on visitor behavior and uploads it to a cloud to create a research database. The third function allowed us to compare the behaviors of exhibition visitors while they used the two modes. Results revealed that without restricting the ways and sequences in which AR content was viewed, there were no significant differences in the duration of viewing, or the distance covered by visitors between the two modes. However, the paths they took were more concentrated in the exhibition-viewing mode, which indicates that this mode encouraged visitors to view the exhibit in accordance with the AR content. In contrast, in message mode, visitors were encouraged to leave text messages and read those left by others, which created disorganized unpredictable paths. Our study demonstrates an innovative application of AR positioning within an interactive exhibition-viewing system, showcasing a novel way to engage visitors and enrich their experience.

Analysis of the effectiveness of the training system of future computer profile specialists for the application of digital technologies

The purpose of the article is to verify and justify the effectiveness of implementing an authorial system for preparing future computer professionals to apply digital technologies. The methodological basis of the publication is methods of scientific analysis, pedagogical positions on the issues of preparing future computer professionals, implementation of an authorial system for preparing future computer professionals for the application of digital technologies. The scientific novelty lies in highlighting the main results of the pedagogical experiment, which aimed to verify the effectiveness of the system for preparing future computer professionals for the application of digital technologies. The pedagogical experiment was conducted in accordance with the main stages (diagnostic, formative, control), during each of which a series of tasks and research were carried out. The research hypothesis assumes that the quality of preparation of future computer professionals for the application of ICT in professional activities will improve by implementing organizational and pedagogical conditions, principles, approaches, content, forms, and methods laid down in the authorial system for preparing future computer professionals for the application of ICT. To substantiate the conclusions regarding the effectiveness of the content and methodology of the pedagogical experiment, statistical processing of the obtained data will be conducted. It was found that EG students demonstrated significantly higher knowledge and skills in mastering and using modern ICT tools and instruments: 3D modeling technologies, including for graphic reconstruction; additive technologies; development of adaptive web resources; development and application of virtual and augmented reality applications; use of Smart technologies in education, and so on. Conclusions. Summarizing the research results, we believe that the authorial system for preparing future computer professionals for the application of ICT in professional activities is effective and positively influences the formation of their readiness for professional activities in general.

Neural étendue expander for ultra-wide-angle high-fidelity holographic display

Holographic displays can generate light fields by dynamically modulating the wavefront of a coherent beam of light using a spatial light modulator, promising rich virtual and augmented reality applications. However, the limited spatial resolution of existing dynamic spatial light modulators imposes a tight bound on the diffraction angle. As a result, modern holographic displays possess low étendue, which is the product of the display area and the maximum solid angle of diffracted light. The low étendue forces a sacrifice of either the field-of-view (FOV) or the display size. In this work, we lift this limitation by presenting neural étendue expanders. This new breed of optical elements, which is learned from a natural image dataset, enables higher diffraction angles for ultra-wide FOV while maintaining both a compact form factor and the fidelity of displayed contents to human viewers. With neural étendue expanders, we experimentally achieve 64 × étendue expansion of natural images in full color, expanding the FOV by an order of magnitude horizontally and vertically, with high-fidelity reconstruction quality (measured in PSNR) over 29 dB on retinal-resolution images.

Every "Body" Gets a Say: An Augmented Optimization Metric to Preserve Body Pose during Avatar Adaptation in Mixed/Augmented Reality.

User-Avatar interaction within augmented reality applications is rapidly increasing in frequency. Applications routinely place users in rooms with other, remote users embodied by photorealistic avatars, or require users to work with an avatar of a remote user to complete a task. During these types of interactions, it is often required to modify or redirect the posture of an avatar to achieve goals such as contact with or pointing at an object or maintaining eye gaze with the local user. A key limitation of modern redirection techniques is successfully preserving body posture, a critical component of nonverbal communication. This paper presents a new pose-preserving objective function to be used in the multi-objective optimization of an avatar's kinematic configuration. This objective function not only mimics the correct placement of body joints, but also preserves their orientation in space. We have tested this approach against several commonly used and current state-of-the-art redirection techniques and have found that our new approach achieves a significant reduction in targeted redirection error while simultaneously reducing body posture error. Additionally, human subject testing has shown that our new technique provides both a significantly more natural looking redirection and a significantly more realistic and believable overall body posture.