Augmented Reality Goggles Research Articles

How Taste Perception Is Influenced by Environment Using Augmented Reality Goggles

How Taste Perception Is Influenced by Environment Using Augmented Reality Goggles

A Scaffolding Assembly Deficiency Detection System with Deep Learning and Augmented Reality

Scaffoldings play a critical role as temporary structures in supporting construction processes. Accidents at construction sites frequently stem from issues related to scaffoldings, including insufficient support caused by deviations from the construction design, insecure rod connections, or absence of cross-bracing, which result in uneven loading and potential collapse, leading to casualties. This research introduces a novel approach employing deep learning (i.e., YOLO v5) and augmented reality (AR), termed the scaffolding assembly deficiency detection system (SADDS), designed to aid field inspectors in discerning deficiencies within scaffolding assemblies. Inspectors have the flexibility to utilize SADDS through various devices, such as video cameras, mobile phones, or AR goggles, for the automated identification of deficiencies in scaffolding assemblies. The conducted test yielded satisfactory results, with a mean average precision of 0.89 and individual precision values of 0.96, 0.82, 0.90, and 0.89 for qualified frames and frames with the missing cross-tie rod, missing lower-tie rod, and missing footboard deficiencies, respectively. Subsequent field tests conducted at two construction sites demonstrated improved system performance compared to the training test. Furthermore, the advantages and disadvantages of employing mobile phones and AR goggles were discussed, elucidating certain limitations of the SADDS system, such as self-occlusion and efficiency issues.

Developing an integrated medication adherence system: Exploring the potential of i‐Ware's augmented reality goggles and mobile application

AbstractMedical therapists often manage medications to improve therapeutic outcomes for their patients. For senior patients who take multiple drugs to manage various conditions, medication adherence is critical. To provide an immersive and engaging medication reminder experience, the authors propose i‐Ware, a smart wearable m‐Health (mobile health) device. The system's hardware and software were co‐designed to meet non‐functional requirements. The model reminds patients to take their medication, and the augmented reality goggles aid those who struggle to manage their medicine. The navigation features help users find their way home, and the audio feature reads out the date and time, useful for patients with low vision. The i‐Ware system has the potential for real‐world application and can significantly improve medication adherence. As an AR‐enabled medicine reminder, i‐Ware is an innovative solution for medication management in senior patients.

Workflow assessment of an augmented reality application for planning of perforator flaps in plastic reconstructive surgery: Game or game changer?

In contrast to the rising amount of financial investments for research and development in medical technology worldwide is the lack of usability and clinical readiness of the produced systems. We evaluated an augmented reality (AR) setup under development for preoperative perforator vessel mapping for elective autologous breast reconstruction. In this grant-supported research pilot, we used magnetic resonance angiography data (MR-A) of the trunk to superimpose the scans on the corresponding patients with hands-free AR goggles to identify regions-of-interest for surgical planning. Perforator location was assessed using MR-A imaging (MR-A projection) and Doppler ultrasound data (3D distance) and confirmed intraoperatively in all cases. We evaluated usability (System Usability Scale, SUS), data transfer load and documented personnel hours for software development, correlation of image data, as well as processing duration to clinical readiness (time from MR-A to AR projections per scan). All perforator locations were confirmed intraoperatively, and we found a strong correlation between MR-A projection and 3D distance measurements (Spearman r = 0.894). The overall usability (SUS) was 67 ± 10 (=moderate to good). The presented setup for AR projections took 173 min to clinical readiness (=availability on AR device per patient). In this pilot, we calculated development investments based on project-approved grant-funded personnel hours with a moderate to good usability outcome resulting from some limitations: assessment was based on one-time testing with no previous training, a time lag of AR visualizations on the body and difficulties in spatial AR orientation. The use of AR systems can provide new opportunities for future surgical planning, but has more potential for educational (e.g., patient information) or training purposes of medical under- and postgraduates (spatial recognition of imaging data associated with anatomical structures and operative planning). We expect future usability improvements with refined user interfaces, faster AR hardware and artificial intelligence-enhanced visualization techniques.

PO120 / #873 AUGMENTED REALITY TECHNOLOGY IN NEUROMODULATION SURGERY: E-POSTER VIEWING

The advancement of wearable integrated augmented reality (AR) devices has rapidly progressed over recent years. We describe the first use of AR goggles during a revision neuromodulation surgery, which enabled specialist consultant support from remote despite ongoing coronavirus pandemic restrictions.

Intra-operative wearable visualization in spine surgery: past, present, and future.

The history of modern surgery has run parallel to the invention and development of intra-operative visualization techniques. The first operating room, built in 1804 at Pennsylvania Hospital, demonstrates this principle: illumination of the surgical field by the Sun through an overhead skylight allowed surgeries to proceed even prior to the invention of anesthesia or sterile technique. Surgeries were restricted to begin around when the Sun was at its zenith; without adequate light from the Sun and skylight, surgeons were unable to achieve adequate visualization. In the years since, new visualization instruments have expanded the scope and success of surgical intervention. Spine surgery in particular has benefited greatly from improved visualization technologies, due to the complex and intricate nervous, vascular and musculoskeletal structures that are closely intertwined which surgeons must manipulate. Over time, new technologies have also advanced to take up smaller footprints, leading to the rise of wearable tools that surgeons don intra-operatively to better visualize the surgical field. As surgical techniques shift to more minimally invasive methods, reliable, fidelitous, and ergonomic wearables are of growing importance. Here, we discuss the past and present of wearable visualization tools, from the first surgical loupes to cutting-edge augmented reality (AR) goggles, and comment on how emerging innovations will continue to revolutionize spine surgery.

Using augmented reality devices for remote support in manufacturing: A case study and analysis

Industry 4.0 forces increased digitization, production flexibility, improvement of employee competences and integration of employees and IT systems within an enterprise. To this end, state-of-the-art systems and IT solutions, such as the Virtual Reality (VR) and Augmented Reality (AR), are implemented. New systems must be integrated with the existing IT architecture, and their implementation forces the enterprise to provide network access with sufficient bandwidth to fully benefit from the capabilities of new technologies. The paper discusses the practical application of modern AR solutions in the industry, with a special focus on remote support for maintenance operations and training of production employees. Two experiments aimed determining the impact of various environmental conditions on the possibility of using the AR Remote Support are described. Basing on those experiments it is possible to determine the environmental conditions required to use HoloLens 2 AR goggles in two dedicated remote support applications.

Predictive Maintenance Neural Control Algorithm for Defect Detection of the Power Plants Rotating Machines Using Augmented Reality Goggles

The concept of predictive and preventive maintenance and constant monitoring of the technical condition of industrial machinery is currently being greatly improved by the development of artificial intelligence and deep learning algorithms in particular. The advancement of such methods can vastly improve the overall effectiveness and efficiency of systems designed for wear analysis and detection of vibrations that can indicate changes in the physical structure of the industrial components such as bearings, motor shafts, and housing, as well as other parts involved in rotary movement. Recently this concept was also adapted to the field of renewable energy and the automotive industry. The core of the presented prototype is an innovative interface interconnected with augmented reality (AR). The proposed integration of AR goggles allowed for constructing a platform that could acquire data used in rotary components technical evaluation and that could enable direct interaction with the user. The presented platform allows for the utilization of artificial intelligence to analyze vibrations generated by the rotary drive system to determine the technical condition of a wind turbine model monitored by an image processing system that measures frequencies generated by the machine.

Dimensions of Perception: 3D Real-Life Objects Are More Readily Detected Than Their 2D Images

Most of our interactions with our environment involve manipulating real 3D objects. Accordingly, 3D objects seem to enjoy preferential processing compared with 2D images, for example, in capturing attention or being better remembered. But are they also more readily perceived? Thus far, the possibility of preferred detection for real 3D objects could not be empirically tested because suppression from awareness has been applied only to on-screen stimuli. Here, using a variant of continuous flash suppression (CFS) with augmented-reality goggles (“real-life” CFS), we managed to suppress both real 3D objects and their 2D representations. In 20 healthy young adults, real objects broke suppression faster than their photographs. Using 3D printing, we also showed in 50 healthy young adults that this finding held only for meaningful objects, whereas no difference was found for meaningless, novel ones (a similar trend was observed in another experiment with 20 subjects, yet it did not reach significance). This suggests that the effect might be mediated by affordances facilitating detection of 3D objects under interocular suppression.

Augmented Reality in Medical Practice: From Spine Surgery to Remote Assistance.

Background: While performing surgeries in the OR, surgeons and assistants often need to access several information regarding surgical planning and/or procedures related to the surgery itself, or the accessory equipment to perform certain operations. The accessibility of this information often relies on the physical presence of technical and medical specialists in the OR, which is increasingly difficult due to the number of limitations imposed by the COVID emergency to avoid overcrowded environments or external personnel. Here, we analyze several scenarios where we equipped OR personnel with augmented reality (AR) glasses, allowing a remote specialist to guide OR operations through voice and ad-hoc visuals, superimposed to the field of view of the operator wearing them.Methods: This study is a preliminary case series of prospective collected data about the use of AR-assistance in spine surgery from January to July 2020. The technology has been used on a cohort of 12 patients affected by degenerative lumbar spine disease with lumbar sciatica co-morbidities. Surgeons and OR specialists were equipped with AR devices, customized with P2P videoconference commercial apps, or customized holographic apps. The devices were tested during surgeries for lumbar arthrodesis in a multicenter experience involving author's Institutions.Findings: A total number of 12 lumbar arthrodesis have been performed while using the described AR technology, with application spanning from telementoring (3), teaching (2), surgical planning superimposition and interaction with the hologram using a custom application for Microsoft hololens (1). Surgeons wearing the AR goggles reported a positive feedback as for the ergonomy, wearability and comfort during the procedure; being able to visualize a 3D reconstruction during surgery was perceived as a straightforward benefit, allowing to speed-up procedures, thus limiting post-operational complications. The possibility of remotely interacting with a specialist on the glasses was a potent added value during COVID emergency, due to limited access of non-resident personnel in the OR.Interpretation: By allowing surgeons to overlay digital medical content on actual surroundings, augmented reality surgery can be exploited easily in multiple scenarios by adapting commercially available or custom-made apps to several use cases. The possibility to observe directly the operatory theater through the eyes of the surgeon might be a game-changer, giving the chance to unexperienced surgeons to be virtually at the site of the operation, or allowing a remote experienced operator to guide wisely the unexperienced surgeon during a procedure.

Designing An Augmented Reality Based Interface For Wearable Exoskeletons

Full-body, powered wearable exoskeletons combine the capabilities of machines and humans to maximize productivity. Powered exoskeletons can ease industrial workers in manipulating heavy loads in a manner that is difficult to automate. However, introduction of exoskeletons may result in unexpected work hazards, due to the mismatch between user-intended and executed actions thereby creating difficulties in sensing the physical operational envelope, need for increased clearance, and maneuverability limitations. To control such hazards, this paper presents a rearview human localization augmented reality (AR) platform to enhance spatial awareness of people behind the exoskeleton users. This platform leverages a computer vision algorithm called Monocular 3D Pedestrian Localization and Uncertainty Estimation (MonoLoco) for identifying humans and estimating their distance from a video camera feed and off-the-shelf AR goggles for visualizing the surrounding. Augmenting rear view awareness of humans can help exoskeleton users to avoid accidental collisions that can lead to severe injuries.

Active Optical Beam Shaping Based on Liquid Crystals and Polymer Micro-Structures

Emerging applications requiring light beam manipulation, such as high-efficiency sunlight concentrators for solar cells, switchable micro-lens arrays for autostereoscopic displays, tunable lenses for augmented reality goggles, auto-focusing spectacles, and smart contact lenses, mostly depend on one or more active optical components with the desired and controllable beam modifying functionalities, preferably manufactured at relatively low cost. Recent progress in research on components based on the combination of liquid crystals (LCs) and various polymer micro-structures is reviewed in this paper. It is found that such components can address the demands appropriately and have the potential of paving the way for large-scale applications of active optical beam shaping components.

Augmented reality for the virtual dissection of white matter pathways

BackgroundThe human white matter pathway network is complex and of critical importance for functionality. Thus, learning and understanding white matter tract anatomy is important for the training of neuroscientists and neurosurgeons. The study aims to test and evaluate a new method for fiber dissection using augmented reality (AR) in a group which is experienced in cadaver white matter dissection courses and in vivo tractography.MethodsFifteen neurosurgeons, neurolinguists, and neuroscientists participated in this questionnaire-based study. We presented five cases of patients with left-sided perisylvian gliomas who underwent awake craniotomy. Diffusion tensor imaging fiber tracking (DTI FT) was performed and the language-related networks were visualized separated in different tracts by color. Participants were able to virtually dissect the prepared DTI FTs using a spatial computer and AR goggles. The application was evaluated through a questionnaire with answers from 0 (minimum) to 10 (maximum).ResultsParticipants rated the overall experience of AR fiber dissection with a median of 8 points (mean ± standard deviation 8.5 ± 1.4). Usefulness for fiber dissection courses and education in general was rated with 8 (8.3 ± 1.4) and 8 (8.1 ± 1.5) points, respectively. Educational value was expected to be high for several target audiences (student: median 9, 8.6 ± 1.4; resident: 9, 8.5 ± 1.8; surgeon: 9, 8.2 ± 2.4; scientist: 8.5, 8.0 ± 2.4). Even clinical application of AR fiber dissection was expected to be of value with a median of 7 points (7.0 ± 2.5).ConclusionThe present evaluation of this first application of AR for fiber dissection shows a throughout positive evaluation for educational purposes.

Application of holographic augmented reality for external approaches to the frontal sinus.

External approaches to the frontal sinus such as osteoplastic flaps are challenging because they require blind entry into the sinus, posing risks of injury to the brain or orbit. Intraoperative computed tomography (CT)-based navigation is the current standard for planning the approach, but still necessitates blind entry into the sinus. The aim of this work was to describe a novel technique for external approaches to the frontal sinus using a holographic augmented reality (AR) application. Our team developed an AR system to create a 3-dimensional (3D) hologram of key anatomical structures, based on CT scans images. Using Magic Leap AR goggles for visualization, the frontal sinus hologram was aligned to the surface anatomy in 6 fresh cadaveric heads' anatomic boundaries, and the boundaries of the frontal sinus were demarcated based on the margins of the fused image. Trephinations and osteoplastic flap approaches were performed. The specimens were re-scanned to assess the accuracy of the osteotomy with respect to the actual frontal sinus perimeter. Registration and surgery were completed successfully in all specimens. Registration required an average of 2 minutes. The postprocedure CT showed a mean difference of 1.4 ± 4.1 mm between the contour of the osteotomy and the contour of the frontal sinus. One surgical complication (posterior table perforation) occurred (16%). We describe proof of concept of a novel technique utilizing AR to enhance external approaches to the frontal sinus. Holographic AR-enhanced surgical navigation holds promise for enhanced visualization of target structures during surgical approaches to the sinuses.

DOES WEARING AUGMENTED-REALITY GOGGLES AFFECT OLDER ADULTS’ KINEMATICS DURING GAIT?

Virtual-reality (VR) testing can cause motion sickness and impair safety, especially for older adults, but augmented-reality (AR) may allow the testing of holograms embedded into a mixed-reality environment without the VR impediments. However, wearing AR googles may affect the way people walk, but this possibility has not being tested. The objective of this study was to evaluate if wearing AR googles during gait would affect the kinematics of older adults. Ten older adults (68±5 years), who could walk without assistive devices, participated in this study. The participants walked outdoors in a public park with and without the AR googles. The participants were instrumented inertial movement units to track their kinematics (MTw Awinda trackers, Xsens Technologies B.V., Enschede, the Netherlands). The goal of the study was to assess if simply wearing the googles would affect gait, therefore no holograms were displayed. Ten gait cycles were analyzed and the mean of each subject was used to compare the joint kinematics between the conditions (with vs without googles) using T-tests in SPSS 18. The foot, ankle, knee and hip angles were not different between the conditions (p>0.05), but there were significantly less trunk flexion at 44% of the gait cycle (p=0.035) and less forward head flexion throughout the gait cycle (p=0.023) when the participants were wearing the googles vs. when they were not. The findings indicate that wearing AR goggles changed the trunk and head posture cycle, but did not affect the lower limb kinematics during gait.

\u201cReal-life\u201d continuous flash suppression (CFS)-CFS with real-world objects using augmented reality goggles

Continuous flash suppression (CFS) is a popular method for suppressing visual stimuli from awareness for relatively long periods. Thus far, this method has only been used for suppressing two-dimensional images presented on screen. We present a novel variant of CFS, termed “real-life” CFS, in which a portion of the actual immediate surroundings of an observer—including three-dimensional, real-life objects—can be rendered unconscious. Our method uses augmented reality goggles to present subjects with CFS masks to the dominant eye, leaving the nondominant eye exposed to the real world. In three experiments we demonstrated that real objects can indeed be suppressed from awareness for several seconds, on average, and that the suppression duration is comparable to that obtained using classic, on-screen CFS. As supplementary information, we further provide an example of experimental code that can be modified for future studies. This technique opens the way to new questions in the study of consciousness and its functions.

Get real: Suppressing the real world from awareness using augmented reality goggles

Get real: Suppressing the real world from awareness using augmented reality goggles

Augmented reality goggles selection by using neutrosophic MULTIMOORA method

PurposeThe purpose of this paper is to present the augmented reality (AR) eyeglass selection problem based on Neutrosophic MULTIMOORA method which is a very new multi-objective method.Design/methodology/approachThe author evaluates five AR goggles according to six different criteria. Criteria have different weights and determined by analytic hierarchy process. The author used neutrosophic MULTIMOORA method in order to evaluate AR eyeglasses.FindingsFive different AR eyeglasses were evaluated and the best one was selected according to six different criteria (benefit and non-benefit). According to Neutrosophic MULTIMOORA method, Sony AR eyeglass is selected as the best one. Neutrosophic MULTIMOORA method uses simple computational equations and it handles multi-objective decision making problems effectively.Originality/valueEvaluating AR goggles by using the Neutrosophic MULTIMOORA method for the first time is the originality of this paper.

Augmented reality goggles selection by using neutrosophic MULTIMOORA method

Augmented reality goggles selection by using neutrosophic MULTIMOORA method

Enhancing visual performance in individuals with cortical visual impairment (homonymous hemianopsia): Tapping into blindsight

Abstract Homonymous hemianopsia is a type of cortical blindness in which vision is lost completely or partially in the left half or the right half of the field of vision. It is prevalent in approximately 12% of traumatic brain injury and 35% of strokes. Patients often experience difficulty with activities such as ambulating, eating, reading, and driving. Due to the high prevalence of homonymous hemianopsia and its associated difficulties, it is imperative to find methods for visual rehabilitation in this condition. Traditional methods such as prism glasses can cause visual confusion and result in patient noncompliance. There is a large unmet medical need for improving this condition. In this article, we propose that modifying visual stimuli to activate non-cortical areas of visual processing, such as lateral geniculate nucleus and superior colliculus, may result in increased visual awareness. Presenting high contrast and low spatial frequency visual stimuli can increase visual detection in patients with cortical blindness, a phenomenon known as blindsight. Augmented virtual reality goggles have the potential to alter real-time visual input to high contrast and low spatial frequency images, possibly improving visual detection in the blind hemifield and providing an alternative therapy for homonymous hemianopsia.