Augmented Reality Experiences Research Articles

Revolutionization of augmented reality in tourism via deep learning

Tourism has become an integral part of social and economic development across the globe. It does not only serve as a recreational activity but also as a source of revenue for the nation. The paper systematically explores the potential enhancements in the tourist experience through cutting-edge technology. Employing deep learning methods, the study specifically concentrates on refining augmented reality encounters for visitors. The proposed approach utilizes deep learning algorithms to optimize and tailor tourists’ augmented reality experiences, addressing current sectoral challenges like customization and engagement shortcomings. The methodology’s selection is predicated on it is capability to elevate user experience, accurately identify objects, offer visual guided tours, integrate historical context, and ultimately propel augmented reality adoption in tourism. Notably, the investigation culminates in a noteworthy average accuracy of 99% when incorporating deep learning to enhance augmented reality in tourism.

Game-based augmented reality learning of Sarawak history in enhancing cultural heritage preservation

The augmented reality (AR) technology had been proliferating for years. However, the implementation of AR technology still has room to be explored, especially in the form of cultural heritage preservation. The aim of this study is to enhance AR technology in game-based cultural heritage and history preservation in Sarawak, as well as supplement the gamified experiences in learning James Brooke’s history. Three research objectives are proposed: to design an AR game prototype for the history of James Brooke; to develop an AR game prototype with a collaborative learning element; and to evaluate an AR game prototype for enhancing cultural heritage preservation. This study proposes a game-based prototype that contains AR markers to assign each with different game features. Furthermore, collaborative learning theory is enhanced through AR experiences with multiplayer support. The game-based prototype is evaluated by a group of participants through prototype measuring and testing. The participants feel mediocre about the challenge and knowledge factors of the prototype. Overall, this study highlights the enhancement of cultural heritage preservation through AR game-based experiences intensively learned from James Brooke’s history in Sarawak. These implementations have an apparent promising contribution to make in protecting the available cultural heritage in Sarawak and extensively to the country’s cultural heritage preservation.

ARcademy: Augmented Reality Adventures in Education

Abstract: Augmented reality (AR) technology holds enormous promise for transforming education by enabling interactive and immersive learning experiences. This research article provides an AR application built to highlight the different possibilities of AR in educational contexts. The program incorporates different interactive aspects, including a virtual dragon, as a showcase of the adaptability and potential of AR for boosting learning experiences. Users can connect with the virtual dragon and explore its interactions within the real-world setting, showing the seamless integration of digital material into physical spaces. Through a user-centered design approach, our team has built an easy and engaging AR experience geared at promoting curiosity, creativity, and critical thinking skills among learners. By exploiting the unique affordances of AR technology, educators can develop dynamic learning environments that cater to varied learning styles and interests. This study assesses the effectiveness of the AR application in encouraging active learning and boosting student engagement across diverse educational environments. It also investigates practical aspects such as usability, accessibility, and scalability to influence future innovations and implementations of AR-based teaching systems. By giving a real example of AR integration in education, our research contributes to the continuing discourse on the transformative potential of AR technology. It emphasizes the necessity of developing creative techniques to harness AR for interactive and personalized learning experiences in the digital age.

VisionCart: Enhancing E-Commerce with Augmented Reality for an Immersive Shopping Experience Using Flutter and Arkit

Abstract: In the fast-paced digital era, VisionCart stands out as an innovative solution blending e-commerce and Augmented Reality (AR). VisionCart revolutionizes shopping by offering customers an immersive AR experience, allowing them to visualize products in their actual surroundings before making a purchase. This is achieved through the powerful combination of Flutter, ARKit, and Firebase. Central to our project is the ambition to redefine online shopping, with a special focus on enhancing accessibility for the visually impaired. VisionCart delivers a user-friendly interface, robust backend services, and advanced AR capabilities by seamlessly integrating these cutting-edge technologies. This abstract serves as an introduction to a detailed exploration of our project, covering its objectives, foundational technologies, implementation strategies, testing methods, and future prospects

How different text display patterns affect cybersickness in augmented reality.

Cybersickness remains a pivotal factor that impacts user experience in Augmented Reality (AR). Research probing into the relationship between AR reading tasks and cybersickness, particularly focusing on text display patterns and user characteristics, has been scant. Moreover, the influence of cybersickness on searching ability and the broader spectrum of user experience has not been rigorously tested. Recent investigations have aimed to pinpoint the variables that contribute to cybersickness during AR reading sessions. In one such study, 40 participants underwent a series of controlled experiments with randomized text display patterns, including variations in text speed and text movement modes. Post-experiment, participants completed a questionnaire that helped quantify their experiences and the degree of cybersickness encountered. The data highlighted that satiety, text speed, and text movement mode are significant contributors to cybersickness. When participants experienced higher levels of cybersickness, font color stood out as a particularly influential factor, whereas gender differences seemed to affect the onset of cybersickness more noticeably at lower levels. This study also drew attention to the impact of cybersickness on search ability within AR environments. It was noted that as cybersickness intensity increased, search ability was markedly compromised. In sum, the research underscores the importance of text display patterns and user characteristics, such as past AR experience, in understanding cybersickness and its detrimental effects on user experience and search ability, particularly under conditions of intense cybersickness.

Monash Rocks

This paper describes the development of the “Monash Rocks” app - designed to bring our landscape to life through augmented reality. We describe the highs and lows of the development process, the lessons we learned along the way, and our plans for further development of the app to showcase the Monash Earth Sciences Garden and extend the space into further innovative, immersive teaching and learning experiences. The creation of Monash University’s Earth Sciences Garden (MESG), a "living" geological map of Victoria collating nearly 500 rock specimens, gave us the perfect vehicle for an Augmented Reality (AR) experience. Students and visitors to the MESG can now use the Monash Rocks App on their phones to view a 3D display that overlays the live camera feed on the device enhancing the experience of the environment, taking it to another dimension. The value in augmenting a learning environment is in its ability to pull virtual objects into real scenes (Green & Chandler, 2014, p.549), in this case expanding the physical environment through time and space on a journey back millions of years. The rock now becomes alive, telling its story and supplying information that is missing in the “real life” walk through the garden.

Full-colour 3D holographic augmented-reality displays with metasurface waveguides

Emerging spatial computing systems seamlessly superimpose digital information on the physical environment observed by a user, enabling transformative experiences across various domains, such as entertainment, education, communication and training1–3. However, the widespread adoption of augmented-reality (AR) displays has been limited due to the bulky projection optics of their light engines and their inability to accurately portray three-dimensional (3D) depth cues for virtual content, among other factors4,5. Here we introduce a holographic AR system that overcomes these challenges using a unique combination of inverse-designed full-colour metasurface gratings, a compact dispersion-compensating waveguide geometry and artificial-intelligence-driven holography algorithms. These elements are co-designed to eliminate the need for bulky collimation optics between the spatial light modulator and the waveguide and to present vibrant, full-colour, 3D AR content in a compact device form factor. To deliver unprecedented visual quality with our prototype, we develop an innovative image formation model that combines a physically accurate waveguide model with learned components that are automatically calibrated using camera feedback. Our unique co-design of a nanophotonic metasurface waveguide and artificial-intelligence-driven holographic algorithms represents a significant advancement in creating visually compelling 3D AR experiences in a compact wearable device.

How New Developers Approach Augmented Reality Development Using Simplified Creation Tools: An Observational Study

Software developers new to creating Augmented Reality (AR) experiences often gravitate towards simplified development environments, such as 3D game engines. While popular game engines such as Unity and Unreal have evolved to offer extensive support and functionalities for AR creation, many developers still find it difficult to realize their immersive development projects. We ran an observational study with 12 software developers to assess how they approach the initial AR creation processes using a simplified development framework, the information resources they seek, and how their learning experience compares to the more mainstream 2D development. We observed that developers often started by looking for code examples rather than breaking down complex problems, leading to challenges in visualizing the AR experience. They encountered vocabulary issues and found trial-and-error methods ineffective due to a lack of familiarity with 3D environments, physics, and motion. These observations highlight the distinct needs of emerging AR developers and suggest that conventional code reuse strategies in mainstream development may be less effective in AR. We discuss the importance of developing more intuitive training and learning methods to foster diversity in developing interactive systems and support self-taught learners.

Development of Augmented Reality Platform Using Image Processing with Deep Learning Techniques

The development and structuring of an augmented reality (AR) platform integrating image processing, deep learning, and spatial tracking techniques have yielded promising results. AR technology, which enhances real-world objects with computer-generated information, holds vast potential for education, entertainment, and industry. Image processing enables real-time object detection, recognition, and tracking within the user's environment, while deep learning models enhance pattern recognition accuracy. Spatial tracking techniques ensure seamless integration of virtual content with the physical world, providing immersive AR experiences. Ant colony optimization (ACO) algorithms further enhance the AR platform's functionality by optimizing object placement and interaction. ACO mimics ant behavior to find optimal paths through graphs, effectively optimizing spatial layout and user interaction patterns in dynamic environments. The integration of ACO into the AR platform facilitates efficient pathfinding for augmented objects and enhances the system's responsiveness to user inputs. The successful implementation of the AR platform underscores its potential to revolutionize various industries, including healthcare, education, and marketing. By leveraging AI-driven algorithms and optimization techniques, AR systems can deliver personalized and engaging experiences that blur the boundaries between the digital and physical worlds. These results pave the way for future advancements in AR technology, driving innovation and reshaping human-computer interaction paradigms.

Enhancing User Experience: Exploring Mobile Augmented Reality Experiences

In recent years, the integration of augmented reality (AR) technology into mobile devices has revolutionized both human-computer interaction and computer graphics. This transformative blend of virtual elements into the physical world has led to a new era of possibilities for user experiences. However, the unique challenges posed by Mobile Augmented Reality (MAR) applications demand a closer examination of design and usability considerations to ensure optimal user engagement and satisfaction. This study investigates users' experiences with Mobile Augmented Reality applications, with particular emphasis on design and usability-related concerns. Using a controlled experiment with twenty different people, this study uses thematic analysis to investigate UX improvement options. The aim is to furnish practical design principles that consider the individual characteristics and preferences of users, thereby contributing to the development of empirical insights that enhance Human-Computer Interaction (HCI) standards and best practices. Moreover, the results highlight the importance of user-centered design and assessment approaches. This work fills important gaps in the literature on UX studies of MAR applications and advances our knowledge of creating, engaging and easy-to-use augmented reality experiences.

Antecedents and Consequences of Augmented Reality Experience in Mega-Sports

Given the increased adoption of immersive technologies in tourism events, there is a need to understand how to best implement such technologies and their effects on visitors. Thus, the present study examined the antecedents and effects of using augmented reality (AR) when spectating a mega-sport event. Data obtained from 204 participants that used AR during the attendance of the Beijing Winter Olympics showed that, indeed, there is an effect on event experience–physical, cognitive, and affective engagement and future revisit intention, as well as positive word of mouth. Additionally, the success of the AR implementation depended on the effective visual design of the AR platform that would significantly influence users??? perceived ease of use and usefulness of the AR. Results obtained to add to the existing body of knowledge in the field of event tourism and provide specific managerial implications to enhance event experience using AR.

Shark Dive and Hologram Zoo: Two Case Studies of Virtual Animal Encounters as Possible Models for Sustainable Wildlife Tourism.

Wildlife tourism is commonly argued to positively contribute to nature conservation by providing humans with educational and meaningful first-hand experiences with animals. However, concern for the sustainability of nature due to the negative impacts of wildlife tourism on animals and the environment invites alternative virtual opportunities for close encounters. Participant Observation framed by an Animal Studies perspective is employed to interpret two contemporary Australian family entertainments, Shark Dive and Hologram Zoo, centred on providing people with wild animal interactions but without real animals present. Shark Dive is a theatrical puppetry production replicating a real shark dive, and Hologram Zoo is an augmented reality experience that displays a variety of animals in 3D. The content of both is examined to understand how the animals are imagined, experienced, and given significance to determine whether they offer viable alternatives or complementary additions to in situ wildlife tourism. Findings reveal both hold potential for virtual wildlife tourism. Shark Dive provides a positive representation of marine life, generating awareness about conservation and encouraging self-reflection. Hologram Zoo's depiction of wild animals is impressive, but to more closely align with contemporary wildlife tourism ideals, the experience could enhance its conservation messaging and positive human-animal interactions.

The Impact of Artificial Intelligence (AI) on mobile App Development

Artificial Intelligence (AI) has revolutionized the landscape of mobile app development, bringing about transformative changes in functionality, user experience, and capabilities. This paper aims to explore and analyze the impact of AI on mobile app development, highlighting its significant contributions and potential implications. The integration of AI technologies such as machine learning, natural language processing, and computer vision has empowered mobile applications to offer personalized experiences, enhanced decision-making capabilities, and predictive functionalities. AI-driven algorithms enable apps to analyze vast amounts of data, allowing for real-time insights and intelligent responses, thereby optimizing user engagement and satisfaction. Moreover, AI has facilitated the development of innovative features like voice assistants, recommendation systems, and augmented reality experiences, fostering a more intuitive and interactive user interface. These advancements have not only enriched the user experience but also opened new avenues for businesses to better understand their users and tailor services accordingly. However, with these advancements come challenges, including privacy concerns, ethical considerations, and the need for robust security measures to safeguard sensitive user data. As AI-powered mobile apps become more prevalent, it is imperative to address these challenges to ensure responsible and ethical use of AI technologies. This paper examines the evolution of AI in mobile app development, evaluates its impact on user experience and functionality, discusses the challenges and ethical considerations, and provides insights into the future trends and opportunities that AI presents in shaping the landscape of mobile app development. Understanding the profound impact of AI on mobile app development is crucial for developers, businesses, and stakeholders to harness its full potential while navigating the associated challenges responsibly.

Analysis of the Mental Workload Generated by Learning Experiences Through Augmented Reality and Virtual Reality in Students of Regular Basic Education

Objetive: To analyze the mental workload produced by immersive learning experiences through augmented reality (AR) and virtual reality (VR). Theoretical framework: This section presents the main concepts and theories that support the research. The theory of cognitive mental workload includes dimensions such as Frustration, Performance, Effort, Physical, Mental, and Temporal Demand, providing a solid foundation for understanding the research context. Method: The methodology used for the research follows a qualitative quasi-experimental approach. The selected population consisted of 100 students, from which 2 groups of 50 members each were randomly selected using simple random sampling, experimental and control groups. Seven learning sessions were developed in the Social Sciences area. The experimental group experienced learning activities involving AR and VR, while the control group underwent traditional sessions. The experimental group students faced tasks related to navigation, movement, manual interaction, information processing, search, storage, and decision-making. The standardized NASA-TLX (Task Load Index) instrument, comprising 6 dimensions: Frustration, Performance, Effort, Physical, Mental, and Temporal Demand, was used for analysis. Results and conclusion: The results show that experimentation with AR presents a moderate mental workload, while experimentation with VR presents a significant mental workload, compared to students who did not participate in AR and VR experiences, who did not present mental workload in the development of their activities. Research implications: The practical and theoretical implications of this research are discussed, providing insights into how the results can be applied or influence practices in the field of mental workload. These implications may encompass frustration, performance, effort, physical, mental, and temporal demand. Originality/Value: This study contributes to the literature by showing how mental workload directly influences academic performance and learning effectiveness, as excessive levels of workload can negatively affect attention and information retention.

Message on a bottle: the use of augmented reality as a form of disruptive rhetoric in wine marketing

ABSTRACT Wine, a product steeped in tradition and history, is often challenging for consumers to decipher due to its intricate characteristics. Appealing to non-wine connoisseurs to break into untapped market segments requires both innovation and creative thinking. To accomplish this, three wine brands utilized augmented reality (AR) technology to craft unique brand storytelling experiences that centered around the label, without focusing on physical product attributes, ultimately resonating with new market segments. This article explores the use cases of three wine brands; 19 Crimes, Barefoot, and Enosophia Wines, that employed AR technology as a form of disruptive rhetoric, to supplement their wine label storytelling. The study sheds light on how multisensory technology such as AR can be used to carve out new wine target markets and proposes an AR experience model with accompanying propositions outlining how the experiential realms can be leveraged to achieve key brand objectives.

Transforming Nursing Education: Developing Augmented Reality Procedural Training.

The shortage of nursing faculty and the scarcity of clinical placements have compelled researchers to investigate innovative solutions for procedural development to bridge the gap between didactic teaching and clinical experiences. This feasibility study uses augmented reality (AR) with Microsoft HoloLens2 and Dynamics 365 Guides to train graduate nursing students on advanced nursing procedures, focusing on lumbar puncture. A convenience sample of 24 nurse practitioner students participated in the study. The System Usability Scale, Acceptability Scale, and Engagement Scale were used to assess participant's experiences and perceptions. The results are positive for the feasibility and acceptance of AR technology for procedural training. Participants found the HoloLens2 device easy to use and showed confidence in its functionality. The step-by-step instructions provided by Microsoft 365 Guides were understandable, useful, and satisfactory. The students reported high levels of engagement and found the AR experience to be helpful and motivating for learning. Faculty time was significantly reduced using the HoloLens2 for procedural training compared to traditional methods. This study demonstrates the potential for AR as an effective and efficient modality for nursing education. The findings support the integration of AR technology to enhance procedural development, address the challenges of limited clinical sites, and provide students with an immersive and self-paced learning experience. Additional studies will need to explore the impact of AR on clinical competency, patient outcomes, and cost-effectiveness. Overall, the use of AR technology may be useful and effective for nursing pedagogy.

Ergonomic‐Centric Holography: Optimizing Realism, Immersion, and Comfort for Holographic Display

AbstractErgonomic‐centric holography is introduced, an algorithmic framework that simultaneously optimizes for realistic incoherent defocus, unrestricted pupil movements in the eye box, and high‐order diffractions for filtering‐free holography. The proposed method outperforms prior algorithms on holographic display prototypes operating in unfiltered and pupil‐mimicking modes, offering the potential to enhance next‐generation virtual and augmented reality experiences.

Research on the technology of intelligent vehicle sensor positioning system in autonomous driving

In this comprehensive exploration of positioning and navigation technologies, we have delved into the intricacies of GPS (Global Positioning System), IMU (Inertial Measurement Unit), and VPS (Visual Positioning Systems) systems, shedding light on their unique attributes and applications. GPS, a global satellite-based system, offers precise positioning on a worldwide scale, although it encounters challenges in complex urban and environmental conditions. Its role in navigation and tracking is undeniable. IMU, characterized by accelerometers and gyroscopes, excels in delivering high-precision positioning over short durations, making it invaluable for applications in aviation, robotics, and virtual reality. However, it is susceptible to drift over time. Visual Positioning Systems (VPS), harnessing computer vision and visual sensors, provide remarkable sub-meter to centimeter-level accuracy when conditions are optimal. Their significance is particularly pronounced in indoor navigation, augmented reality, and robotics, although they may face challenges in less favorable environments. These technologies are not isolated but can synergize to enhance accuracy and reliability. GPS and IMU collaborate to compensate for signal disruptions, while GPS and VPS join forces to tackle urban complexities. IMU and VPS integration offer precise indoor navigation and augmented reality experiences, delivering impeccable positioning and orientation data. Ultimately, the choice of technology hinges on specific application requirements, encompassing accuracy, environmental considerations, cost factors, and the need for complementary systems. As these technologies advance, they hold the promise of revolutionizing navigation across various domains, from autonomous vehicles to immersive augmented reality environments.

The Influence of Augmented Reality on Purchase Intentions through Consumers of Madame Gie Products

Beauty products are needed by every individual, with various types of products offered, including quality, price, brand, and packaging. Therefore, the Purchase intentions of beauty products are very diverse. Madame Gie is one of the beauty product brands that has plunged into the use of Augmented Reality to make it easier for consumers to choose product variances. This study aims to determine and analyze the effect of Augmented Reality experiences on the purchase intention of Madame Gie products in Bandung, with Consumers’ Control as an intervening variable. This study uses a quantitative approach with a questionnaire through Google Form of 385 samples and analyzed by the Smart-PLS statistical program based on this research, the AR experience positively influences consumer Purchase Intention toward Madame Gie products. Consumer’s Control also plays a crucial role in the relationship between AR experience and Purchase Intention. Therefore, companies need to consider the importance of giving control to consumers in AR technology usage to maximize its impact on consumer purchase intention and enhance the performance of their beauty product marketing.

A METHODOLOGICAL APPROACH FOR AN AUGMENTED HBIM EXPERIENCE THE ARCHITECTURAL THRESHOLDS OF THE MOSTRA D'OLTREMARE

Abstract. Digital survey and parametric-semantic modeling of historical or conventional building artifacts are becoming progressively more oriented toward HBIM (Heritage Building Information Modelling) to XR (Extended Reality) digital fruition projects. This encompasses a wide range of applications, from technical management to historical-scientific popularization of the architectural heritage. In this sense, the research explores the potential of BIM-to-XR virtualization systems concerning the systematization of historiographic documentation and interaction between different types of datasets for managing and disseminating the heritage. In particular, the research presents a prototypal experience conducted on Mostra d'Oltremare in Naples, Italy, a mid-20th-century exhibition center. In particular, the northwest access area had a rationalist layout, while the current configuration strongly differs from the monumental, exedra-shaped one built on a project by Arch. Stefania Filo Speziale, which was largely destroyed by World War II bombing. Thus, to document and facilitate the analysis of the original configurations, the original archival sources have been digitized and cataloged; moreover, reality-based integrated digital survey campaigns have been performed for the acquisition of metric-morphological data of the complex and the segmentation of the characteristic chromatic features of the residual decorative apparatuses. This has enabled the development of a BIM-oriented multi-scale information repository to enrich the real environment with digital content, thus creating an augmented reality experience. The latter has been introduced to create a virtual tool for querying and manipulating BIM databases, using the potential of visual programming languages and traditional scripts to create a two-way flow of data between BIM and AR.