Traditional Augmented Reality Research Articles

AFFORDABLE AUGMENTED REALITY FOR SPINE SURGERY: AN EMPIRICAL INVESTIGATION INTO IMPROVING VISUALIZATION AND SURGICAL ACCURACY

The minimally invasive spine surgery, sometimes referred to as MISS, has changed spinal therapy by minimizing the length of time required for recovery, as well as the amount of worry and suffering that patients experience. Before we can consider the surgery to have been successful, there is a critical problem that has to be addressed. The use of augmented reality technology has been gaining traction over the course of the last few years as a method of improving the accuracy of MISS management. This research has a significant focus on the applications of augmented reality in minimally invasive spine surgery as its core investigation. The use of augmented reality (AR) technology, which supports medical professionals in performing difficult spine procedures, allows for the provision of real-time placement suggestions as well as information that is specific to the patient. This has a number of major benefits, some of which include improved vision, more accurate tool placement, and less problems. In order to include augmented reality into MISS, it was necessary to have a user interface that was easy to use, a data integration system that was comprehensive, and recording mechanisms that were reliable. It is necessary to make the necessary modifications to the registration process, delays, and physical issues before bringing it into clinical practice. This procedure must be completed before it can be implemented. In the context of this research project, an application for smartphones that is integrated with augmented reality is currently being created with the purpose of boosting minimally invasive spine surgery. "The innovation of this research is the creation of a mobile AR interface that bridges the gap between accessibility and high-quality surgical visualization tools, offering an alternative to traditional AR systems." This AR smartphone application is the first of its type to combine cost, accessibility, and sophisticated visualization features, resulting in a whole new approach to surgical help that is unlike any other surgical procedure.Using Unity3D, the Vuforia AR camera, and C#, the software is able to create an augmented reality (AR) experience for mobile devices. This objective is realized via the utilization of these three components. Technology that are regarded to be industry standards include HoloLens and head-mounted displays (HMDs), which are examples of augmented reality technology. On the other hand, the vast majority of people are unable to make use of them because of the tremendous cost that they carry. When it comes to visualizing three-dimensional MRI spine pictures, this technology offers an approach that is more efficient and economical. Taking into consideration the results of this study, it would seem that surveys and formal evaluations that make use of MISS and augmented reality might possibly be beneficial. By using augmented reality (AR), medical practitioners may be able to more effectively see important structures, plan surgical operations, and identify the required equipment, which may eventually result in improved patient outcomes. Increasing the capabilities of augmented reality technology, finding new uses for it, and incorporating artificial intelligence-driven decision improvement are the goals of the researchers.

Design of Compact Dielectric Metalens Visor for Augmented Reality Using Spin-Dependent Supercells

Augmented reality overlays computer-generated virtual information onto real-world scenes, enhancing user interaction and perception. However, traditional augmented reality optical systems are usually large, bulky, and have limited optical performance. In this paper, we propose a novel compact monochrome reflective dielectric metalens visor with see-through properties, engineered using a periodic structure of spin-dependent supercells. The supercell, which is composed of staggered twin nanofins, provides spin-dependent destructive or constructive interference with different circularly polarized incidences. The design combines the principles of interference with the Pancharatnam–Berry phase to enhance reflection at a working wavelength of 650 nm while maintaining good transmission. Right circularly polarized light incident from the substrate side causes destructive interference, enabling the supercell to work in reflection mode, while left circularly polarized light causes constructive interference, enabling the supercell to work in transmission mode. Furthermore, the supercell-constructed metalens can achieve near-diffraction-limited reflective focusing and a broad diagonal field of view of approximately 96°. In addition, compared to transmissive metalens visors, the reflective design eliminates the need for a beam splitter, significantly reducing the size and weight of the system. Our work could facilitate the development of compact and lightweight imaging systems and provide valuable insights for augmented reality near-eye display applications.

Ultracompact polarization multiplexing meta-combiner for augmented reality display.

Augmented reality (AR) display, as a next-generation innovative technology, is revolutionizing the ways of perceiving and communicating by overlaying virtual images onto real-world scenes. However, the current AR devices are often bulky and cumbersome, posing challenges for long-term wearability. Metasurfaces have flexible capabilities of manipulating light waves at subwavelength scales, making them as ideal candidates for replacing traditional optical elements in AR display devices. In this work, we propose and fabricate what we believe is a novel reflective polarization multiplexing gradient metasurface based on propagation phase principle to replace the optical combiner element in traditional AR display devices. Our designed metasurface exhibits different polarization modulations for reflected and transmitted light, enabling efficient deflection of reflected light while minimizing the impact on transmitted light. This work reveals the significant potential of metasurfaces in next-generation optical display systems and provides a reliable theoretical foundation for future integrated waveguide schemes, driving the development of next-generation optical display products towards lightweight and comfortable.

NAVIGATING ORGANIZATIONAL CRISES AND UNCERTAINTIES THROUGH WEB AUGMENTED REALITY (WebAR)

Web Augmented Reality (WebAR) has emerged as a pivotal component within the paradigm of Industry 4.0 technologies. Its proliferation across diverse sectors underscores its potential as a transformative tool, particularly in the context of organizational micro-environments. Unlike traditional Augmented Reality (AR) platforms, which often necessitate substantial financial and technical investments, WebAR offers a more cost-effective and accessible alternative. Despite its apparent advantages, the adoption rate of WebAR remains relatively subdued. This article aims to undertake a rigorous theoretical examination of WebAR’s capacity to address and mitigate crises and uncer-tainties inherent within organizational micro-environments. To this end, the paper will review WebAR, engage in a comparative analysis between WebAR and its traditional AR counterparts, highlighting the distinctive attributes and potential advantages of the former, and delve into the theoretical implications of WebAR’s utility in navigating orga-nizational crises and uncertainties, drawing from relevant academic literature and theoretical frameworks. By adop-ting a more abstract and theoretical lens, this paper seeks to contribute to the body of knowledge surrounding WebAR. It aspires to foster a deeper academic understanding of its potential applications and implications, eschewing a more pragmatic approach in favor of a comprehensive theoretical exploration.

Application of augmented reality models of canine skull in veterinary anatomical education.

Veterinary anatomy plays a crucial role in the curriculum for veterinary medicine and surgery. The integration of modern information technology in veterinary education can greatly benefit from innovative tools such as augmented reality (AR) applications. The aim of this study was to develop an accurate and interactive three-dimensional (3D) digital model of an animal skull using AR technology, aiming to enhance the learning of skull anatomy in veterinary anatomy education. In this study, a canine skull specimen was isolated, and the skull bones were scanned using a structured light scanner to create a 3D digital model of the canine skull, which was found to be indistinguishable from the original specimen by measurement of skull proportions. Furthermore, the interactive AR model of the canine skull, displayed using Unity3D, was subjected to testing and evaluation by 60 first-year veterinary medical students attending the gross anatomy of the animal. The students were divided into two groups: the traditional group and AR group. Both groups completed an objective test and a questionnaire. The evaluation of learning effectiveness in the test revealed no significant difference between the traditional group (which learned using textbooks and a canine skull specimen) and AR group (which learned using AR tools). However, in the questionnaire, students displayed high enthusiasm and interest in using the AR tool. Therefore, the application of AR tools can improve students' motivation for learning and enhance the comprehension of anatomical structures in three dimensions. Furthermore, this study exemplifies the use of AR as an auxiliary tool for teaching and learning in veterinary anatomy education.

Augmented reality training for improved learnability

In the current era of Industry 4.0, many new technologies offer manufacturing industries to achieve high productivity. Augmented Reality (AR) is one of the emerging technologies that has been adopted in industries to aid users in acquiring complex skills and carrying out many complicated tasks such product assembly and maintenance. Nevertheless, most AR applications have been developed without clear understanding of how such technology can facilitate improved learnability in terms of knowledge reusability. This paper proposed an enhanced AR-based training system that provides multimodal information with a contextualized information to improve task comprehension and knowledge reusability compared with traditional AR that presents unimodal and decontextualized information. An empirical test was carried out to assess the task performance and the task learnability aspects of this enhanced AR compared to the traditional AR and the paper-based document. The experiment consisted of a training phase where participants carried out an electrical connection task of a sensor followed by a knowledge reuse phase where participants had to wire a second sensor using their previous training. A pre-test quiz was given before the experiment followed by the post-tests phase after the training. Post-tests consist of one post-test given directly after the experiment (short-term retention test) and a second post-test quiz given one week later (long-term retention test) to measure information retention. The results indicated that AR-based approaches could enhance knowledge acquisition by around 18 % for traditional AR and almost 25 % for enhanced AR as compared to paper-based approach. While all training systems achieved relatively equivalent well for short-term retention test, trainees who used the enhanced AR training systems statistically outperformed those in the paper-based group for long term retention test. Furthermore, there was a positive correlation between the score of short-term retention test and the score in the knowledge reusability which was also shown by the higher scores in knowledge reusability for the enhanced AR training system compared to the other two approaches. These findings are discussed in relation to the Industry 5.0′s human centric core value.

Augmented reality and indoor positioning based mobile production monitoring system to support workers with human-in-the-loop

With the increasing demand for product customization, the exponential increase in large-scale and small-batch production orders has yielded new challenges for the capacity of traditional production lines. Due to the information redundancy and complex production process on the production site of the factory, the traditional monitoring system is incapable of meeting the information interaction requirements between the factory management level and the executive level. Meanwhile, the traditional augmented reality (AR) based on image recognition is not suitable in the complex industrial environments. To address the gap, we propose a novel mobile production monitoring system (AIMPMs) with human-in-the-loop control by leveraging the cutting-edge AR and indoor positioning technique. In the proposed system, Ultra-wideband (UWB) and Inertial Measurement Unit (IMU) fusion indoor positioning technology is proposed, which provides accurate indoor positioning information for the production factors in the factory. Subsequently, we build the lightweight indoor map for positioning that can serve as the location reference and path planning, and a nearest-neighbor decision algorithm with double rejection decision (NN-DRD) is proposed to match the positioning features to trigger virtual monitoring information. Finally, the AIMPMs is applied in a hydraulic cylinder factory to verify its enforceability and effectiveness, and the human factors evaluation model and index system are constructed to evaluate two systems, (1) the mobile monitoring system based on positioning information, and (2) the mobile monitoring system based on image recognition, respectively. The experimental results indicate that after the application of AIMPMs, the physiological and mental fatigue of the production personnel is immensely decreased. Therefore, the system realizes a smarter and highly humanized human-machine interaction mode with human-in-the-loop control.

Accurate and Robust Rotation-Invariant Estimation for High-Precision Outdoor AR Geo-Registration

Geographic registration (geo-registration) is a crucial foundation for augmented reality (AR) map applications. However, existing methods encounter difficulties in aligning spatial data with the ground surface in complex outdoor scenarios. These challenges make it difficult to accurately estimate the geographic north orientation. Consequently, the accuracy and robustness of these methods are limited. To overcome these challenges, this paper proposes a rotation-invariant estimation method for high-precision geo-registration in AR maps. The method introduces several innovations. Firstly, it improves the accuracy of generating heading data from low-cost hardware by utilizing Real-Time Kinematic GPS and visual-inertial fusion. This improvement contributes to the increased stability and precise alignment of virtual objects in complex environments. Secondly, a fusion method combines the true-north direction vector and the gravity vector to eliminate alignment errors between geospatial data and the ground surface. Lastly, the proposed method dynamically combines the initial attitude relative to the geographic north direction with the motion-estimated attitude using visual-inertial fusion. This approach significantly reduces the requirements on sensor hardware quality and calibration accuracy, making it applicable to various AR precision systems such as smartphones and augmented reality glasses. The experimental results show that this method achieves AR geo-registration accuracy at the 0.1-degree level, which is about twice as high as traditional AR geo-registration methods. Additionally, it exhibits better robustness for AR applications in complex scenarios.

Effects of AR‐ and VR‐based wearables in teaching English: The application of an ARCS model‐based learning design to improve elementary school students' learning motivation and performance

AbstractBackgroundPrevious research has examined the use of augmented reality (AR) and virtual reality (VR) in English language teaching. However, to the best of our knowledge, none of the earlier studies that investigated integrating AR and VR “wearables” into teaching and learning English based on the attention, relevance, confidence, and satisfaction (ARCS) motivation model compared the differences in learning motivation and performance between traditional teaching methods and those using AR‐ and VR‐based using wearables.ObjectivesTo create a thematic learning environment based on learners' lived experiences and provide them with an immersive English course that extends textbook knowledge using a technology‐assisted real‐life learning context.MethodThis study used a quasi‐experimental research design. A total of 119 participants were spilt into three learning groups based on teaching tools: traditional methods and AR‐ and VR‐based wearable devices. The performance of each group was evaluated through three stages using appropriate educational tools for traditional, AR‐, and VR‐based classrooms, followed by semistructured interviews. Multiple regression analysis was conducted to investigate the inference learning performance (remembering and analysing) of the four ARCS dimensions with the three teaching methods.ResultsThe results showed that confidence and relevance were positively correlated with learning performance in the VR‐based wearable group. In the context of the ARCS model, learners' confidence predicted learning performance and the remembering subdimension when VR‐based learning materials were used.ImplicationsThese results suggest that, compared to traditional teaching methods, VR‐based wearables make it easier to create a highly immersive learning environment and are more likely to help learners find the correct words, improve their accuracy, and increase their confidence and sense of accomplishment in the entire learning process.

Optical see-through augmented reality can induce severe motion sickness

The aim was to investigate whether severe symptoms of visually induced motion sickness (VIMS) can occur in augmented reality (AR) optical see-through applications. VIMS has been extensively studied in virtual reality (VR), whereas it has received little attention in the context of AR technology, in which the real world is enhanced by virtual objects. AR optical see-through glasses are becoming increasingly popular as technology advances. Previous studies showed minor oculomotor symptoms of VIMS with the aforementioned technology. New applications with more dynamic simulations could alter previously observed symptom severity and patterns. In experiment 1, we exposed subjects to a traditional static AR application for pilot candidate training. In experiment 2, subjects completed tasks in a dynamic starfield simulation. We analyzed symptom profiles pre and post with the simulator sickness questionnaire (SSQ) and during exposure with the Fast Motion Sickness Scale (FMS). We also developed a new FMS-D that captures symptoms of dizziness during simulation. As expected, in experiment 1 we found low VIMS symptomatology with predominantly oculomotor symptoms. In experiment 2, on the other hand, we detected severe VIMS symptoms in some subjects, with disorientation (SSQ subscale) as the main symptom group. The present work demonstrates that VIMS can be of serious concern in modern AR applications. The FMS-D represents a new tool to measure symptoms of dizziness during exposure. VIMS symptoms need to be considered in the design and usage of future AR applications with dynamic virtual objects, e.g. for flight training or machine maintenance work.

Using Cost Efficient Augmented Reality Glasses in Anatomical Identification

Augmented Reality (AR) is an emerging technology capable of integrating visual technology with the physical world in novel ways. AR uses may range from education delivery to the operating room. This study sought to evaluate cost-effective AR glasses compared to a traditional computer screen when identifying anatomical structures in a chest radiograph (X-ray). The purpose of this experiment was to determine if the Vuzix Blade AR technology is feasible for use in the medical field to identify anatomical structures. Novice undergraduate and graduate students (n = 14) were recruited to participate in this feasibility study. Radio-graphic images were compiled, and subjects were asked to identify 12 anatomical structures on each image. Images were randomly assigned to identify structures using either the AR glasses or a traditional computer screen for each set. Images were viewed randomly by each subject using a crossover design to compare traditional computer screen vs. AR screen. Subjects identified statistically fewer anatomical structures using the AR glasses compared to using the traditional computer screen (p<0.01). However, the glasses did not require significantly more subjective workload (NASA-TLX) on the user to use compared to the computer screen. When subjects used the cost-effective AR glasses, subjects were unable to differentiate as many anatomical structures as possible (10 vs. 9 structures at p < 0.01), but the glasses were not more demanding overall. Thus, AR glasses may soon be an integral part of the operating room, provided adequate resolution to visualize the necessary details.

Visual display for surgical targeting: concepts and usability study

PurposeInteractive image-guided surgery technologies enable accurate target localization while preserving critical nearby structures in many surgical interventions. Current state-of-the-art interfaces largely employ traditional anatomical cross-sectional views or augmented reality environments to present the actual spatial location of the surgical instrument in preoperatively acquired images. This work proposes an alternative, simple, minimalistic visual interface intended to assist during real-time surgical target localization.MethodsThe estimated 3D pose of the interventional instruments and their positional uncertainty are intuitively presented in a visual interface with respect to the target point. A usability study with multidisciplinary participants evaluates the proposed interface projected in surgical microscope oculars against cross-sectional views. The latter was presented on a screen both stand-alone and combined with the proposed interface. The instruments were electromagnetically navigated in phantoms.ResultsThe usability study demonstrated that the participants were able to detect invisible targets marked in phantom imagery with significant enhancements for localization accuracy and duration time. Clinically experienced users reached the targets with shorter trajectories. The stand-alone and multi-modal versions of the proposed interface outperformed cross-sectional views-only navigation in both quantitative and qualitative evaluations.ConclusionThe results and participants’ feedback indicate potential to accurately navigate users toward the target with less distraction and workload. An ongoing study evaluates the proposed system in a preclinical setting for auditory brainstem implantation.

Zoom Unit in Augmented Reality: Liquid Lens

With the development of modern technology and people’s demand for improving living standards, the traditional 2D display cannot meet the needs of people, so the augmented reality (AR) technology which combines virtual objects with real environment arises at the historic moment. AR technology sprouted in the 1960 s, and ushered in rapid development in the 21st century through continuous technical iteration. However, the traditional AR system cannot solve the vergence-accommodation conflict (VAC), to solve which, researchers introduced liquid lens into the optical system of AR. The methods and materials of making liquid lens are different. In this paper, the research progress of liquid lens is summarized from three aspects. Firstly, the research progress of liquid lens is briefly reviewed. Secondly, the classification and typical preparation technology of liquid lens are introduced, and different requirements for performance are described. Finally, the performance and testing method of liquid lens is introduced.

Is Augmented Reality the New Way for Teaching and Learning Veterinary Cardiac Anatomy?

The online version contains supplementary material available at 10.1007/s40670-021-01260-8.

Design and Validation of a Spinal Surgical Navigation System Based on Spatial Augmented Reality

Prospective observational study. This article aims to develop a spatial augmented reality-based surgical navigation system to assist in the placement of pedicle screws in minimally invasive spine surgery and to verify the accuracy of this method. Due to their high accuracy and good visualization ability, augmented reality surgical navigation systems have been used in minimally invasive surgeries. However, augmented reality does not allow information to be shared and restricts doctors. A surgical navigation system that implements augmented reality based on a projector can be used to realize the external visualization of virtual organs and surgical information through an improved multiple information fusion method. Using fiducial markers and imaging technology, the patient's spatial position is tracked and registered in real time. All the information is accurately fused with the patient's back skin, and the surgeon can see surgical information such as the preoperative plan and bones. Phantom experiments were used to verify the accuracy and effectiveness of the system. In the phantom experiments, the accuracy of the pedicle screw insertion point on the dummy's skin was 0.441 ± 0.214 mm, the average location error into the dummy's body was 1.645 ± 0.355 mm, and the average axial and sagittal angulation errors were <0.9°. This article introduces and verifies the design of a new surgical navigation system based on spatial augmented reality for lumbar pedicle screw implantation. The system passed a series of phantom accuracy experiments. Compared with the traditional augmented reality navigation system, this system avoids the use of glasses and truly realizes the effect of naked-eye 3D, which is more convenient for doctors to use for communication during an operation. N/A.

An efficient flood dynamic visualization approach based on 3D printing and augmented reality

ABSTRACT Flood visualization is an effective and intuitive tool for representing flood information from abstract spatiotemporal data. With the growing demand for flood disaster visualizations and mitigation, augmented flood visualizations that support decision makers’ perspectives are needed, which can be enhanced by emerging augmented reality (AR) and 3D printing technologies. This paper proposes an innovative flood AR visualization method based on a 3D-printed terrain model and investigates essential techniques, such as the suitable size calculation of the terrain models, the adaptive processing of flood data, and hybridizing virtual flood and terrain models. A prototype experimental system (PES) based on the proposed method and a comparison experimental system (CES) based on a virtual terrain are developed to conduct comparative experiments, which combine the system performance and questionnaire method to evaluate the efficiency and usability of the proposed method. The statistical results indicate that the method is useful for assisting participants in understanding the flood hazard and providing a more intuitive and realistic visual experience compared with that of the traditional AR flood visualization method. The frame rate is stable at 60 frames per second (FPS), which means that the proposed method is more efficient than the traditional AR flood visualization method.

Interoperable information model for geovisualization and interaction in XR environments

ABSTRACT Since the vision of a Digital Earth (DE) was introduced in 1998, geo-browsers seem to have nearly fulfilled this vision. Virtual reality (VR) for visualizing the DE provides an immersive user experience in a mirror world. Location-based augmented reality (AR) browsers have been introduced and provide content according to user and environmental contexts. However, the content models of traditional geo-browsers and AR browsers have very limited interoperability, because they are described in application-specific formats using their domain standards. Each application is vertically integrated from content to application. The Web is an interoperable and open platform, and hundreds of millions of users are already using it to create and share content. To envision DE browsers for cross-reality (XR) environments that concurrently support geovisualization as well as VR, AR, and mixed-reality environments, we propose a DE content model based on Web standards and architecture that provides full interoperability and openness for XR browsers as a first-class citizen of the Web. This is expected to improve the DE content development efficiency by fully using the Web content development environment.

Research on the Realization Method of Augmented Reality based on Unity3D

Aiming at the problems of low stability and limited application conditions in traditional augmented reality, Unity 3D software is applied to realize augmented reality by combining with Vuforia SDK and EasyAR SDK (Software Development Kit). The developed results can be used on mobile terminal and augmented reality glasses-Hololens. At the same time, the 3D registration technique is studied for the augmented reality. Moreover, the principle and process to realize augmented reality in Unity3D and SDK are given. Finally, with the common image markers, the stability of the two SDKs was tested and analyzed with the angular variation experiment. Compared with the traditional system, the model stability is improved.

Artistic Augmentation of Photographs with Droplets

Artistic augmentation of photographs with water droplets aims at generating aesthetic yet realistic images, and thus differs from traditional augmented reality in two aspects. One difference lies in the adoption of a new image as the environment map in order to render reflected or refracted effects on the surface of inserted water droplets. The other difference is in modeling of water droplets including hanging droplets and resting droplets. These differences raise two research challenges: 1) how to adjust the brightness and colors of the new environment map to maintain visual consistency between the new environment map and the original input image; 2) how to model hanging and resting droplets aesthetically. This paper proposes a framework that addresses these two challenges and demonstrates the effectiveness of our framework by generating example augmented images.

AR Enabled IoT for a Smart and Interactive Environment: A Survey and Future Directions.

Accompanying the advent of wireless networking and the Internet of Things (IoT), traditional augmented reality (AR) systems to visualize virtual 3D models of the real world are evolving into smart and interactive AR related to the context of things for physical objects. We propose the integration of AR and IoT in a complementary way, making AR scalable to cover objects everywhere with an acceptable level of performance and interacting with IoT in a more intuitive manner. We identify three key components for realizing such a synergistic integration: (1) distributed and object-centric data management (including for AR services); (2) IoT object-guided tracking; (3) seamless interaction and content interoperability. We survey the current state of these respective areas and herein discuss research on issues about realizing a future smart and interactive living environment.