Augmented Reality Prototype Research Articles

Augmented reality for enhanced documentation and anchor inspection reporting in conventional tunnelling

This study explores the feasibility of Augmented Reality (AR) technology for efficient quality inspection documentation on tunnel construction sites. Conventional tunnel construction relies heavily on paper-based documentation processes, leading to potential errors and increased documentation and site inspection time requirements. Introducing AR as a digital tool offers a promising solution to address these challenges. The paper identifies potential use of AR for tunnel inspection reports. The methodology involves Design Science Research, including prototype development and a case study in a tunnel environment. The findings of the case study show that the developed AR prototype facilitates quality management and speeds up documentation processes compared to the current paper-based solutions. Despite some input detection issues and current hardware limitations, the approach presents a promising and robust solution suitable for real-world environments.

Developing and evaluating an immersive augmented reality application for children with developmental communication disability: InterPlay for language learning

Purpose This study aimed to examine the views of professionals working with children with developmental communication disability (e.g. associated with developmental disability, autism, developmental language disorder) on the features underlying effective augmented reality (AR) applications for language learning and education; and design, build, and evaluate a prototype AR application (InterPlay) to support language learning for children with developmental communication disability. Method A three-stage design methodology was used to (a) identify opportunities for AR to support children with developmental communication disability; (b) create a prototype application to provide an identified support; and (c) evaluate the features of AR that may afford the best support, using the InterPlay prototype as a foundation for discussion. Result Expert reference focus groups identified support opportunities and key design considerations, informing development of a prototype AR application, InterPlay. Evaluation identified a further four key themes: (a) designing an accessible reality, (b) integrating physical and virtual realities, (c) barriers to access and usability, and (d) contrasting new and existing technology. Conclusion Findings highlighted the need for careful consideration in the design and implementation stages of AR development to ensure AR applications are accessible and beneficial for children with developmental communication disability.

Does the Medium Matter? A Comparison of Augmented Reality Media in Instructing Novices to Perform Complex, Skill-Based Manual Tasks.

Past research comparing augmented reality (AR) media such as in-situ projection and head-mounted devices (HMD) has usually considered simple manual activities. It is unknown whether previously reported differences between different AR media also apply to complex, skill-driven tasks. In this paper, we explore the feasibility and challenges in designing AR instructions for expertise-driven, skilled activities. We present findings from a real-world, between-subjects experiment in which novices were instructed to trim and bone sub-primal cuts of pork using two interactive AR prototypes, one utilizing in-situ projection and a second using the Hololens 2. The prototypes and instructions were designed in consultation with experts. We compared novices' task performance and subjective perceptions and gathered experts' feedback. Although both users and experts indicated a subjective preference for in-situ projection, results indicate that when tasks require knowledge, skill and expertise, the choice of the AR medium itself may not be consequential. Rather, in our experiment, the instruction quality influenced comprehension, knowledge retention and task performance. Hence, from an engineering perspective, emphasis ought to be laid on gathering and structuring expert performance and knowledge to create effective instructions, which could be delivered using any AR medium suited to the task and work environment.

Improving balance using augmented visual orientation cues: a proof of concept

Falls are a major health concern. Existing augmented reality (AR) and virtual reality solutions for fall prevention aim to improve balance in dedicated training sessions. We propose a novel AR prototype as an assistive wearable device to improve balance and prevent falls in daily life. We use a custom head-mounted display toolkit to present augmented visual orientation cues in the peripheral field of view. The cues provide a continuous space-stationary visual reference frame for balance control using the user’s tracked head position. In a proof of concept study, users performed a series of balance trials to test the effect of the displayed visual cues on body sway. Our results showed that body sway can be reduced with our device, indicating improved balance. We also showed that superimposed movements of the visual reference in forward-backward or sideways directions induce respective sway responses. This indicates a direction-specific balance integration of the displayed cues. Based on our findings, we conclude that artificially generated visual orientation cues using AR can improve balance and could possibly reduce fall risk.

Augmented reality and gamification in higher education: Designing mobile interaction to enhance students’ motivation and learning

The emergence of augmented reality (AR) and gamification in higher education has gained relevance by virtue of their usefulness in learning spaces. Prior research has examined these technologies separately, but less is known about the impact of combining AR and gamification in the area of web development. This article examined how different educational materials on web development influence students’ motivation and learning in higher education. The educational materials included lecture notes, an AR prototype, and an AR prototype with gamification. A web-based experiment involving 95 students demonstrated that using AR could enhance students’ motivation compared to conventional educational materials, such as lecture notes. However, compared with using only AR, the combination of AR and gamification did not enhance students’ motivation or learning. The findings may serve as a basis to further AR in higher education and support authors in the design of AR in course literature.

Sports Visualization in the Wild: The Impact of Technical Factors on User Experience in Augmented Reality Sports Spectating.

The maturity of Augmented Reality (AR) technology allows for expansion into real-world applications, including visualizations for on-site sports spectating. However, it's crucial to understand the factors influencing user experience in AR applications. To optimize user experience, we conducted a user study where participants adjusted parameters to determine noticeable and disruptive values of latency, registration accuracy, and jitter using a mobile indirect AR prototype that simulates a rugby stadium experience. Our findings indicate that latency has the highest disruptive impact on users' experience, with registration accuracy following closely. Furthermore, when noticeable latency, registration accuracy, and jitter were combined, the user experience was negatively affected in a non-linear, combinatorial manner. This suggests that addressing factors individually is necessary but not enough for successful user experiences. By understanding these factors, developers can optimize AR experiences when creating immersive AR sports experiences and other large-scale AR applications to ensure maximum enjoyment for users.

ImpersonatAR: Using Embodied Authoring and Evaluation to Prototype Multi-Scenario Use Cases for Augmented Reality Applications

Abstract Prototyping use cases for augmented reality (AR) applications can be beneficial to elicit the functional requirements of the features early-on, to drive the subsequent development in a goal-oriented manner. Doing so would require designers to identify the goal-oriented interactions and map the associations between those interactions in a spatio-temporal context. Pertaining to the multiple scenarios that may result from the mapping, and the embodied nature of the interaction components, recent AR prototyping methods lack the support to adequately capture and communicate the intent of designers and stakeholders during this process. We present ImpersonatAR, a mobile-device-based prototyping tool that utilizes embodied demonstrations in the augmented environment to support prototyping and evaluation of multi-scenario AR use cases. The approach uses: (1) capturing events or steps in the form of embodied demonstrations using avatars and 3D animations, (2) organizing events and steps to compose multi-scenario experience, and finally (3) allowing stakeholders to explore the scenarios through interactive role-play with the prototypes. We conducted a user study with ten participants to prototype use cases using ImpersonatAR from two different AR application features. Results validated that ImpersonatAR promotes exploration and evaluation of diverse design possibilities of multi-scenario AR use cases through embodied representations of the different scenarios.

Drawing Connections: Designing Situated Links for Immersive Maps

We explore the design of situated visual links in outdoor augmented reality (AR) for connecting miniature buildings on a virtual map to their real-world counterparts. We first distill design criteria from prior work, then conduct two user studies to evaluate a set of proposed link designs to better understand users' preferences for different design choices of the links. In two user studies we evaluated, respectively, a set of link geometries in a virtual environment and a refined AR prototype in two different outdoor environments. The studies reveal that links help in identifying buildings in the environments. Participants prefer straight rather than curved links, simple and thin links to avoid information occlusion, and links and maps aligned with their direction of view. We recommend using a consistent color with a strong contrast to the background color for all links in a scene. To improve visibility, the diameter of links should grow with distance to the viewer and optional animated stripes can be placed on links. The findings of this study have the potential to bolster the development of various situated visualization applications, such as those used in urban planning, tourism, smart agriculture, and other fields.

Visualization of Volcanic Landform with Augmented Reality

Visualization of volcanic landforms with digital elevation model (DEM) data on the GIS desktop computer has limitations regarding access to the software display function and its use outside the room. This obstacle can be overcome by combining GIS and mobile augmented Reality. However, using digital elevation model data and satellite imagery in augmented reality software has not been widely explored. This study shows a practical way of integrating geospatial data with mobile augmented reality software. This research aims to create an augmented reality prototype to visualize virtual volcano objects. DEM data and satellite imagery create 3-dimensional (3D) objects and provide texture characteristics of volcanic landform objects. Visualization of volcanic landforms is done through an augmented reality (AR) application prototype on an Android smartphone. The experimental results show that augmented reality technology effortlessly combines DEM data and land features from satellite imagery. Evaluation of a smartphone device's manufacturing and installation stages shows results with a "successful" status. Through follow-up testing nine times, the AR prototype showed positive performance in all aspects of distance, angle, and lighting. The final test scenario in the form of responses regarding the application from other users obtained an average value of the "Good" category of 92.8%. In conclusion, these results indicate that the system built can be used in learning. However, further research requires more diverse test scenarios to see how far this application prototype can be used in various conditions. Keywords: Digital Elevation Model, GIS, Augmented Realit, 3D Visualization

Clutch & Grasp: Activation gestures and grip styles for device-based interaction in medical spatial augmented reality

Presenting medical volume data using augmented reality (AR) can facilitate the identification of anatomical structures, the perception of their spatial relations and the development of mental maps compared to more commonly used monitors. However, interaction methods explored in these conventional settings may not be applicable in AR environments, or perform differently. In terms of mode activation, gestural interaction was shown to be a viable, touchless alternative to traditional input devices, which is desirable in sterile medical use cases. Therefore, we present a user study (n = 21) comparing hand and foot gestures with voice commands for the activation of interaction modes within a projector-based, spatial AR prototype to visualize medical volume data. Interaction itself was performed via hand movements captured by a data glove. Consistent, statistically significant results across measured variables suggest advantages of voice commands. In addition, a second experiment (n = 17) compared the hand-based interaction with two motion-sensitive devices held in power and in precision grip respectively. All modes were activated using voice commands. No considerable differences between tested grip styles could be determined. The findings suggest that the choice of preferable interaction devices is user and use case dependent.

Fast optimization of computer-generated holograms using conjugate gradient

Holographic display, as an ideal three-dimensional (3D) display method, can provide a realistic stereo-perception sense, and is expected to be used in the next generation of augmented reality (AR) prototypes without complex optical devices. While holographic 3D displays have been proposed in the past decades, high-quality holographic reconstructed images have always relied on well-designed generation algorithms, and it is still a challenge to obtain an accurate phase profile fast. In this work, we utilize a first-order optimization algorithm to optimize the phase profile using the conjugate gradient direction instead of the steepest gradient direction to update the phase parameters. We validate this proposed method by comparing the current widely used stochastic gradient method and the wirtinger holography method. The simulation and experimental results illustrate the superiority of the proposed method, which can achieve faster optimization with the same quality metrics.

Using augmented reality to cue obstacles for people with low vision.

Detecting and avoiding obstacles while navigating can pose a challenge for people with low vision, but augmented reality (AR) has the potential to assist by enhancing obstacle visibility. Perceptual and user experience research is needed to understand how to craft effective AR visuals for this purpose. We developed a prototype AR application capable of displaying multiple kinds of visual cues for obstacles on an optical see-through head-mounted display. We assessed the usability of these cues via a study in which participants with low vision navigated an obstacle course. The results suggest that 3D world-locked AR cues were superior to directional heads-up cues for most participants during this activity.

An Indoor Location-Based Augmented Reality Framework.

This paper proposes an indoor location-based augmented reality framework (ILARF) for the development of indoor augmented-reality (AR) systems. ILARF integrates an indoor localization unit (ILU), a secure context-aware message exchange unit (SCAMEU), and an AR visualization and interaction unit (ARVIU). The ILU runs on a mobile device such as a smartphone and utilizes visible markers (e.g., images and text), invisible markers (e.g., Wi-Fi, Bluetooth Low Energy, and NFC signals), and device sensors (e.g., accelerometers, gyroscopes, and magnetometers) to determine the device location and direction. The SCAMEU utilizes a message queuing telemetry transport (MQTT) server to exchange ambient sensor data (e.g., temperature, light, and humidity readings) and user data (e.g., user location and user speed) for context-awareness. The unit also employs a web server to manage user profiles and settings. The ARVIU uses AR creation tools to handle user interaction and display context-aware information in appropriate areas of the device's screen. One prototype AR app for use in gyms, Gym Augmented Reality (GAR), was developed based on ILARF. Users can register their profiles and configure settings when using GAR to visit a gym. Then, GAR can help users locate appropriate gym equipment based on their workout programs or favorite exercise specified in their profiles. GAR provides instructions on how to properly use the gym equipment and also makes it possible for gym users to socialize with each other, which may motivate them to go to the gym regularly. GAR is compared with other related AR systems. The comparison shows that GAR is superior to others by virtue of its use of ILARF; specifically, it provides more information, such as user location and direction, and has more desirable properties, such as secure communication and a 3D graphical user interface.

Validation of a Prototype Augmented Reality Navigation System for Total Hip Replacement.

Assistive technologies are becoming more common in total hip replacement (THR) procedures, improving surgeons' abilities to achieve target implant orientations. These systems can be large, absorbing limited space in the operating theatre, and they can add complexity to surgery. We developed a small footprint prototype system that can assist in the accurate placement of implant components using augmented reality (AR) technology into preoperatively planned positions. This technology augments the 3D pelvis and the cup in its target position and displays the real-time position of instruments. The accuracy of the developed prototype system was assessed through a cadaveric study, comparing the achieved implant positions to the preoperative target. All cadavers received preoperative 3D planning to identify the target cup position and orientation. Cadaveric surgeries were completed using the AR system to achieve the target cup placement. Postoperative computed tomography (CT) was used to measure the achieved component position for each hip. The mean absolute deviation (range) from target acetabular placement to the achieved acetabular placement was 2.9° (-8.7 to 3.3°), 3.0° (-5.7 to 7°) and 1.6mm (-1.2 to 3.5mm) for inclination, anteversion, and depth, respectively. Sixty-six percent of results were within +/-5° of the preoperative target orientation. We present a cadaver validation study on a small footprint prototype system using augmented reality to enable accurate cup placement and provide additional information intraoperatively. Our results are comparable with reported results for image-based navigation from the literature.

AR-Supported Supervision of Conditional Autonomous Robots: Considerations for Pedicle Screw Placement in the Future.

Robotic assistance is applied in orthopedic interventions for pedicle screw placement (PSP). While current robots do not act autonomously, they are expected to have higher autonomy under surgeon supervision in the mid-term. Augmented reality (AR) is promising to support this supervision and to enable human–robot interaction (HRI). To outline a futuristic scenario for robotic PSP, the current workflow was analyzed through literature review and expert discussion. Based on this, a hypothetical workflow of the intervention was developed, which additionally contains the analysis of the necessary information exchange between human and robot. A video see-through AR prototype was designed and implemented. A robotic arm with an orthopedic drill mock-up simulated the robotic assistance. The AR prototype included a user interface to enable HRI. The interface provides data to facilitate understanding of the robot’s ”intentions”, e.g., patient-specific CT images, the current workflow phase, or the next planned robot motion. Two-dimensional and three-dimensional visualization illustrated patient-specific medical data and the drilling process. The findings of this work contribute a valuable approach in terms of addressing future clinical needs and highlighting the importance of AR support for HRI.

How augmented reality can enhance fashion retail: a UX design perspective

PurposeTo develop compelling augmented reality (AR) experiences, this paper aims to examine AR value to physical fashion retail, defines the most effective form (e.g. app vs magic mirror) and assesses AR’s impact on consumer behaviour.Design/methodology/approachThis study comprises two phases. Phase one conducted three co-design workshops with 15 participants (aged 18–34) to evaluate current shopping modes and discover design opportunities. Phase two designed two AR prototypes (AR Branded App and Magic Mirror) and evaluated the prototypes through experience prototype experiments with 42 participants.FindingsParticipants have a positive attitude towards AR shopping adoption, improving consumer satisfaction and boosting purchase intention. AR technology can be the value in enjoyment to make the shopping experience more fun. However, no participants thought entertainment would trigger their intention to use AR. Therefore, designing useful AR apps that provide substantial functional benefits with enjoyment-oriented elements will encourage consumers to engage in high-street physical retail. In this way, consumers can interact with products and receive more information. AR can help luxury brands tell a story from a hedonic perspective, enabling consumers to engage with the story while maintaining human interaction to ensure an elevated level of service quality.Originality/valueThis study devises six design requirements to guide innovators and retailers in creating AR retail environments that satisfy their customer’s desires.

Design and Field Test of a Mobile Augmented Reality Human–Machine Interface for Virtual Stops in Shared Automated Mobility On-Demand

Shared automated mobility on-demand (SAMOD) is considered as a promising mobility solution in the future. Users book trips on-demand via a smartphone, and service algorithms set up virtual stops (vStop) where users then need to walk to board the automated shuttle. Navigation and identification of the virtual pickup location, which has no references in the real world, can be challenging. Providing users with an intuitive information system in that situation is essential to achieve high user acceptance of new automated mobility services. Our novel vStop human–machine interface (HMI) prototype for mobile augmented reality (AR) supports users with information in reference to the street environment. This work firstly presented the results of an online interview study (N = 21) to conceptualize an HMI. Secondly, the HMI was prototyped by means of AR and evaluated (N = 45) regarding user experience (UX), workload, and acceptance. The results show that the AR prototype provided high rates of UX especially in terms of high pragmatic quality. Furthermore, cognitive workload when using the HMI was low, and acceptance ratings were high. The results show the positive perception of AR for navigation tasks in general and the highly assistive character of the vStop prototype in particular. In the future, SAMOD services can provide customers with vStop HMIs to foster user acceptance and smooth operation of their service.

Designing mobile museum experiences for teenagers

ABSTRACT While museums are often designed to engage and interest a wide variety of audiences, teenagers are a neglected segment. This article describes a set of findings that aids in designing enjoyable interactive experiences inside natural history museums for teenagers (15–19 years old). For this research, 223 teenagers have been involved through co-design sessions and testing of Augmented Reality prototypes (130 of these teenagers took part in a focus group as well). This work also involved 3 museums from Portugal, 12 cultural heritage professionals, and 17 master's students as sources of information who took part in different research studies. Through qualitative analysis, the findings from the studies provide a strong foundation to inform and inspire work within the emerging research field concerning museum offerings and the current teenage generation.

An augmented reality study for public participation in urban planning

ABSTRACT Ongoing urbanisation processes invoke immense construction activities, for which citizens often participate in planning. Yet, imagining planned buildings based on visual representations is a highly demanding task. While traditional methods, such as construction spans, 2D, or 3D visualisation often fail to offer a complete picture, we propose Augmented Reality (AR) as a more adequate tool. We first present an evaluation of the suitability of AR compared to construction spans for a future building and assess which degree of abstraction of AR is most effective, as well as difficulty of interpreting them correctly. In a between-subjects field study we compare construction spans and a prototype AR application including three levels of detail (LOD) of the same building project. Participants solve two estimation tasks using the construction spans and six estimation tasks using the AR application, before answering a questionnaire on the different visualisation methods. We find participants are confident about the potential of AR, but no significant differences between the different LOD groups in subjective assessment. Results suggest that previous knowledge (e.g. in GIS) may have a positive impact on dimension estimation performance. Also, details, such as façade elements or windows, could facilitate estimation tasks because they allow inferences about a building’s size.

IDSP activities of scientific libraries in the era of digitalization

The author reviews cultural and leisure activities of scientific libraries. These activities is realized in the form of intellectual, development and educational activities (IDEA) in the era of digitalization. The author defines the range of libraries that offer services and technologies that correspond to IDEA and IDSP (Intellectual Development and Science Popularization) in the digitalization era. The author provides the leisure definition and predicts the merge of educational and leisure activities. Based on the national and foreign experience in the area, the author offers the most promising vectors for scientific libraries: virtual reality (VR) technologies; augmented reality technologies (AR), science documentaries, robotics courses, prototyping and 3D-printing, makerspaces for digital technologies, digital storytelling. She concludes that IDEA and IDSP activities have made a quantum leap as compared to cultural and leisure activities of public libraries. The factors of this transformation are discussed. The author concludes on the prospects of developing IDSP activities of scientific libraries.