Augmented Reality Environment Research Articles

Evaluation of eXtended reality (XR) technology on motivation for learning physics among students in mexican schools

Developing countries, including Mexico, face the challenge of integrating technology to enhance education and improve learning outcomes. Despite evidence in many settings of the benefits of using virtual reality (VR) and augmented reality (AR) as learning tools, their potential use is still understudied in many developing regions. The objective of the present study is to evaluate the impact of a web-based eXtended Reality (XR) learning tool, PhysXR, among college-level students enrolled in a Mexican University. PhysXR is a web-based learning application designed to present users with information focused on Newtonian mechanics. This tool presents users with interactive experiences ranging from VR to AR environments and supports a physics simulator for experiments on physical phenomena of dynamics and kinematics. Overall, learning methodologies implemented using PhysXR follow the competency-based learning model implemented in Mexican Education Institutions, and include Learn by Doing and Problem Based Learning (PBL). In order to evaluate the PhysXR tool, 99 students were recruited and randomized to either experimental (VR and AR conditions using PhysXR) or control groups. Outcomes included student's learning and motivation, assessed using the John Keller's Attention, Relevance, Confidence and Satisfaction (ARCS) learning motivation model. Results from this study indicate that the use of the PhysXR tool, both VR and AR approaches, generates a significant improvement in learning gains and motivation compared with traditional methods, highlighting the potential of cross-platform capabilities that web-based XR technology could offer, as well as the use of real time physics simulations for learning.

Exploring the user experience (UX) of a multi-window augmented reality environment

Augmented reality is an emergent form of technology that allows users to interact with and manipulate virtual objects and information integrated into the physical environment. Whether it is replying to browser-based emails or playing a game, completing such tasks in augmented reality requires the use of hand-tracking gestures or interactions. With the anticipated growth of this technology, future users may experience it for extended periods with a variety of applications (e.g., metaverse). This study explores the perceptions and user experience of individuals when interacting with and maneuvering in a multi-window augmented reality environment, using a range of hand-tracking interactions. The results provide both qualitative and quantitative insights into these interactions, highlighting the impact of perceived usability, subjective user experience, perceived difficulty, and perceived workload on task completion.

Tracking Perceptual Depth with Eye Vergence Movements in Real World, Augmented Reality, and Virtual Reality Environments

Tracking Perceptual Depth with Eye Vergence Movements in Real World, Augmented Reality, and Virtual Reality Environments

Clutch & Grasp: Activation gestures and grip styles for device-based interaction in medical spatial augmented reality

Presenting medical volume data using augmented reality (AR) can facilitate the identification of anatomical structures, the perception of their spatial relations and the development of mental maps compared to more commonly used monitors. However, interaction methods explored in these conventional settings may not be applicable in AR environments, or perform differently. In terms of mode activation, gestural interaction was shown to be a viable, touchless alternative to traditional input devices, which is desirable in sterile medical use cases. Therefore, we present a user study (n = 21) comparing hand and foot gestures with voice commands for the activation of interaction modes within a projector-based, spatial AR prototype to visualize medical volume data. Interaction itself was performed via hand movements captured by a data glove. Consistent, statistically significant results across measured variables suggest advantages of voice commands. In addition, a second experiment (n = 17) compared the hand-based interaction with two motion-sensitive devices held in power and in precision grip respectively. All modes were activated using voice commands. No considerable differences between tested grip styles could be determined. The findings suggest that the choice of preferable interaction devices is user and use case dependent.

Novel Application of Furniture Product Using Augmented Reality

A tool for individualized consumer pleasure is augmented reality, particularly when it comes to the interior and exterior of furniture. Customers truly want to be able to visualise how the products will appear in their homes or places of business. The consumer or user wants to visualise virtual content for interior design concepts in real time, which AR enables. This study suggests a novel method for integrating augmented reality (AR) technology into interior design, allowing users to share information about 3D virtual furniture and view it on a flexible, dynamic user interface. One way to think of augmented reality technology is as a blend of actual space and virtual items. In an AR environment, the user can observe and modify the virtual furniture in real-time on the screen.

Validation of real-time inside-out tracking and depth realization technologies for augmented reality-based neuronavigation.

Concomitant with the significant advances in computing technology, the utilization of augmented reality-based navigation in clinical applications is being actively researched. In this light, we developed novel object tracking and depth realization technologies to apply augmented reality-based neuronavigation to brain surgery. We developed real-time inside-out tracking based on visual inertial odometry and a visual inertial simultaneous localization and mapping algorithm. The cube quick response marker and depth data obtained from light detection and ranging sensors are used for continuous tracking. For depth realization, order-independent transparency, clipping, and annotation and measurement functions were developed. In this study, the augmented reality model of a brain tumor patient was applied to its life-size three-dimensional (3D) printed model. Using real-time inside-out tracking, we confirmed that the augmented reality model remained consistent with the 3D printed patient model without flutter, regardless of the movement of the visualization device. The coordination accuracy during real-time inside-out tracking was also validated. The average movement error of the X and Y axes was 0.34 ± 0.21 and 0.04 ± 0.08mm, respectively. Further, the application of order-independent transparency with multilayer alpha blending and filtered alpha compositing improved the perception of overlapping internal brain structures. Clipping, and annotation and measurement functions were also developed to aid depth perception and worked perfectly during real-time coordination. We named this system METAMEDIP navigation. The results validate the efficacy of the real-time inside-out tracking and depth realization technology. With these novel technologies developed for continuous tracking and depth perception in augmented reality environments, we are able to overcome the critical obstacles in the development of clinically applicable augmented reality neuronavigation.

Fault Detection in Windmills Using Augmented Reality

Aim:: Wind energy, being a non-conventional and sustainable renewable resource, provides electrical energy through the rotation of the blades of a wind turbine caused by wind impact. To ensure the sustainability of this resource, maintenance of the wind turbines is essential. Methods:: The incorporation of emerging technologies into the tedious processes has enabled quality improvement in the performance of systems. Augmented reality, which enhances the 3D digital content over the real world, may be used to leverage the tedious process of wind turbine maintenance by providing a user-friendly environment. Results/Discussion: AR utilization provides great insights into the problems occurring in specific parts of a wind turbine, thereby easing out the complexity of field workers. The objective is to create an augmented reality environment to monitor the proper functioning and detect the faultiness in a wind turbine with accuracy. Conclusion:: AR utilization can help facilitate better maintenance service, thereby increasing the life of a wind turbine.

Robot-Assisted Teleoperation Ultrasound System Based on Fusion of Augmented Reality and Predictive Force

This study presents a novel method to realize an augmented reality (AR) and haptic feedback teleoperation ultrasound system, which can reduce the influence of time delay on the operator. The physician uses a haptic device to send commands to a remote site while observing the AR environment. In the virtual environment, the organ model is projected onto the corresponding position according to the human pose, and the UR robot model can respond to the physician's action in advance. Based on force data, the dynamic environmental model is updated by the recursive least-squares method, allowing real-time force feedback. The contact force is computed from the identified parameters together with the position and velocity of the master site. An experimental platform has been built, where experiments have been conducted to evaluate the overall architecture, highlighting the role of AR and contact-force prediction models, and including clinical validation. Results show that the system can correctly perform remote ultrasound scanning tasks and ensure authenticity and synchronization.

Development and Transformation in Digital Marketing and Branding with Artificial Intelligence and Digital Technologies Dynamics in the Metaverse Universe

The Metaverse will have a variety of effects on marketing. Businesses need to maintain their identities in the Metaverse realm. Generation Z and Generation alpha will have an easier time adjusting to virtual realms. The augmented reality environment allows buyers to interact with products without leaving the comfort of their own homes. Realization of in-store experiences is possible in the universe of the Metaverse. In addition, there will be an increase in the number of options for branding in the Metaverse. Virtual billboards and the virtual clothing consumers choose to wear will also influence brand awareness. Additionally, Non-Fungible Tokens (NFTs) will be used to produce branded virtual content for end users.
 Examining the influence that technologies powered by artificial intelligence have had on digital marketing and branding will be the primary focus of this research project. In addition, research will be conducted into the applications of the Metaverse, artificial intelligence, and other digital technologies in the marketing field and studies about these subject areas. The research investigated several digital technologies, including the Metaverse, artificial intelligence, blockchain, virtual reality, and augmented reality. It is of the utmost importance for businesses to be able to compete in digital and virtual environments within the context of digital transformation to thrive in an increasingly competitive world. Companies need to invest in the Metaverse, artificial intelligence, and various other forms of digital technology to expand their marketing awareness in virtual environments, expand their customer portfolios, and become brands to take the lead in their respective markets.

Enhancing Museum Visiting Experience: Investigating the Relationships Between Augmented Reality Quality, Immersion, and TAM Using PLS-SEM

Augmented reality (AR) has received increasing attention and has been utilized to enhance the customer experience in museums. This study employs the Information System (IS) success model, immersion theory, and Technology Acceptance Model (TAM) to investigate the impact of AR quality on various dimensions of immersion and the effects of different dimensions of immersion on perceived usefulness and ease of use. Quantitative research was conducted on 295 visitors surveyed at the Wuhan Natural History Museum. Partial least squares structural equation modeling (PLS-SEM) was utilized to test the model. The results indicate that higher-quality AR enhances immersion and that aesthetic experience can enhance the escapist experience within the AR environment. Both dimensions of immersion contribute to perceived usefulness, while the aesthetic experience of museum visits contributes to perceived ease of use. The results obtained from the experiments provide insights into designing AR systems for use in museums.

Head-mounted augmented reality to support reassurance and social interaction for autistic children with severe learning disabilities

Augmented Reality (AR) is promising to complement autism approaches, but so far has mainly focused on training socio-emotional abilities for autistic children with mild learning disabilities. To better consider autistic children with severe learning disabilities and complex needs (SLN), stakeholders advise using collaborative AR sensory-based mediation approaches. Magic Bubbles is a multisensory AR environment created based on stakeholders’ interviews, then adapted for a day hospital setting in collaboration with practitioners, and finally validated in terms of acceptability and usability for autistic children with SLN. In this paper, we report on our latest study that explores three main research questions: 1) To what extent can Magic Bubbles secure autistic children with SLN? 2) To what extent can Magic Bubbles prompt the dyadic relationship between an autistic child with SLN and a practitioner? 3) What is the overall quality of experience for autistic children with SLN when using Magic Bubbles? To answer these questions, seven autistic children with SLN participated in at least six weekly sessions over three months in a day hospital setting. Data collection and analysis used qualitative and quantitative methods, mainly drawing upon grounded theory to evaluate their experiences. Findings validate the three research questions, offer a detailed account of children’s experiences with AR, and outline future directions.

Digital Twin to Control and Monitor an Industrial Cyber-Physical Environment Supported by Augmented Reality

Increasing industrial development and digital transformations have given rise to a technology called Digital Twin (DT) that has the potential to break the barrier between physical and cyberspace. DT is a virtual and dynamic model enabled through a bidirectional data flow that creates high-reliability models with interconnection and fusion between the physical and digital systems for full integration. In smart manufacturing, this technology is increasingly used in research and industry. However, the studies conducted do not provide a definition or a single integrally connected model. To develop the Digital Twin shown in this research, the literature was reviewed to learn about the enabling technologies and architectures used at the industrial level. Then, a methodology was used to obtain the physical process information, create the digital environment, communicate the physical environment, apply simulation models in the digital environment, and parameterize the simulation environment with the physical process in real-time to obtain the digital twin supported with augmented reality. The system was implemented in the MPS-500 modular production station that has industrial sensors and actuators. The virtual environment was designed with Blender and Vuforia to create the augmented reality environment. In the proposed methodology, robust devices (field and control level) and low-cost embedded systems were used for the creation and communication of the virtual environment (monitoring and control); for the joint work of these technologies, they were carried out through the use of the following protocols: Open Platform Communications United Architecture (OPC UA), Ethernet, and machine to machine (M2M), with which a communication was achieved between the different levels of the automation pyramid. The results show that the proposed methodology for the implementation of the DT allows bidirectional communication between the physical and virtual environment and can also be visualized with the support of AR, thus providing its characteristics to the proposed DT. Digital Twin is an essential factor in creating virtual environments and improving applications between the real and digital world, establishing a bidirectional communication through the Ethernet protocol, with a communication time of approximately 100 ms. This technology interacts with the virtual environment and performs mappings, thus achieving timely and dynamic adjustment. This improves data management and production and incorporates process simulation and physical control in real-time, allowing to execute and trigger actions in the physical equipment simultaneously.

A WORKFLOW FOR VALIDATION AND EVALUATION OF A DYNAMIC VISUALIZATION PLATFORM FOR UNDERGROUND ANTIQUITIES

Abstract. Smart Eye is a research project focused on developing and operating, in real-time, an innovative system, that allows the visualization of invisible, known, covered by the ground or by constructions, monuments and finds in an archaeological site, using an Augmented Reality (AR) environment. The visitors of an archaeological site will be able to observe the covered antiquities (3D models and descriptive information) on the screen of their mobile device (smart phone and/or tablet). The system integrates mobile positioning and pose estimation technologies, AR algorithms, Geographic Information Systems (GIS) and spatial databases. The AR application is implemented by IT scientists and is subsequently evaluated in the field to identify both technical problems (e.g. are files uploaded at high speed?) and problems identified by the average user of the AR application (e.g. would it be better if the button to display the 3D model of the archaeological excavation was larger on the screen or of a different color?). The paper will present, on one hand, the validation and evaluation protocols according to the relevant literature, and on the other, the exact evaluation methodology of the Smart Eye system. In addition, the problems identified and the way they were solved during the 1st evaluation of the application will be presented, as well as the problems identified during the 2nd evaluation.

Impact of Metaverse Technology on Student Engagement and Academic Performance: The Mediating Role of Learning Motivation

Metaverse technology, encompassing virtual reality (VR) and augmented reality (AR), offers immersive and interactive learning environments that can enhance student engagement. The personalized and adaptive nature of metaverse experiences has the potential to spark students' intrinsic motivation and promote active involvement in their learning. In order to evaluate the impact of metaverse technology on academic performance and level of engagement this research was aimed to assess the academic performance with mediating effect of learning motivation. We conducted an empirical research through an online survey that initially utilized to measure the collected data. Data collected from 33 educational institution located in Dubai UAE. A total of 251 respondent’s data were utilized and assessed through structured equation modelling. SmartPLS 4 was used to check the model convergent validity, discriminant validity and hypothesis testing. The findings revealed student involvement can be positively impacted by the employment of metaverse technology, which in turn improves academic performance. However, it's critical to take into account potential access restrictions and the necessity for a well-rounded educational strategy that combines metaverse experiences with other teaching strategies. Future studies should focus on the precise mechanisms by which metaverse technology influences learning motivation, engagement, and performance, as this will give researchers important information for developing efficient metaverse-based educational interventions.

Wearable augmentative and alternative communication (wAAC): a novel solution for people with complex communication needs

Communication is a vital skill of a human’s life. People with different types of disabilities may have Complex Communication Needs and may need a wearable device to help them to communicate. Augmentative and Alternative Communication (AAC) is a term which refers to the methods of facilitating or replacing people’s communication abilities. Brain–computer interfaces (BCI) and Eye-Gaze Technology (EGT) are two widely used access technologies in AAC devices. However, there are only a few studies that have investigated the utilisation of these technologies in a Virtual Reality (VR) or Augmented Reality (AR) environment. VR and AR are both modern technologies which provide immersive environments. In addition, the Mixed Reality (MR) environment combines virtual reality with real life and may offer extra benefits such as better immersion, better interaction, and more information. This paper proposed an MR-based wearable AAC device and compared the usability and acceptability between its Eye-Gaze (EG) and BCI interaction options. Eight neurotypical participants and two participants with cerebral palsy participated. The result showed high usability (accuracy = 93.30%, the information transfer rate was 8.55 selections per minutes) and acceptability (QUEST 2.0 = 4.30, NASA-TLX = 2.14) in the EG session. In contrast, the usability of the BCI system in the current design was questionable. This novel interaction method using Electroencephalogram signals is not sufficiently exploited at the moment, and more research is suggested in the future.

Augmented Reality for Realtime Speech Recognition

Choosing the proper word out of samples with similar acoustic structures is a significant difficulty in speech recognition research, according to a case study of a basic domain-based speech recognition solution in speech recognition augmented reality products for hearing impaired persons. Our goal is to increase transcription accuracy in local vocabulary situations like meetings and lectures. To construct real-time ”live subtitles” utilising a unique voice recognition mechanism by combining our approach in an augmented reality environment. This programme allows hearing impaired and deaf persons to view real-time augmented reality subtitles while listening to a talk/speech on a certain topic. In the model of a tree-structured Hidden Markov Model (HMM) for speech recognition, there are different types of networks and graphs involved These networks and graphs play a crucial role in modeling and representing the relationships, transitions, and probabilities involved in speech recognition using tree-structured HMMs. They enable efficient modeling, adaptation, and recognition of speech signals in real- world noisy environments.

Design Considerations in Developing an Augmented Reality Learning Environment for Engaging Students in Covariational Reasoning

This study reports on findings of two design cycles of augmented reality environment intended to engage high school students in covariational reasoning. The study used a designed-based research method to develop and improve the learning environment. In this report, we present the initial design and discuss how it promoted students' engagement at elementary levels of covariation. Following this first cycle, we introduced a redesigned learning environment. We provide evidence of how the new design in the second cycle promoted students' engagement at advanced levels of covariational reasoning. Six groups of three 15- to 17-year-old students participated in the research. Using AR headsets, each group carried out two activities well-suited, in principle, to covariational reasoning. The students' interactions were video-recorded, and the theory of semiotic representation was used to analyze the degree of their engagement in covariational reasoning. The design emphasized multiple representations generally, and the compatibility between the explored phenomenon and its mathematical representations, specifically. Findings show that the design considerations in the second design cycle significantly improved the students' engagement at different levels of covariation, including advanced levels.
 
 Keywords—covariational reasoning, representations, design principles

Head mounted display effect on vestibular rehabilitation exercises performance.

Vestibular rehabilitation clinical guidelines document the additional benefit offered by the Mixed Reality environments in the reduction of symptoms and the improvement of balance in peripheral vestibular hypofunction. The HOLOBalance platform offers vestibular rehabilitation exercises, in an Augmented Reality (AR) environment, projecting them using a low- cost Head Mounted Display. The effect of the AR equipment on the performance in three of the commonest vestibular rehabilitation exercises is investigated in this pilot study. Twenty-five healthy adults (12/25 women) participated, executing the predetermined exercises with or without the use of the AR equipment. Statistically significant difference was obtained only in the frequency of head movements in the yaw plane during the execution of a vestibular adaptation exercise by healthy adults (0.97 Hz; 95% CI=(0.56, 1.39), p<0.001). In terms of difficulty in exercise execution, the use of the equipment led to statistically significant differences at the vestibular-oculomotor adaptation exercise in the pitch plane (OR=3.64, 95% CI (-0.22, 7.50), p=0.049), and in the standing exercise (OR=28.28. 95% CI (23.6, 32.96), p=0.0001). Τhe use of AR equipment in vestibular rehabilitation protocols should be adapted to the clinicians' needs.

Smart glasses for 3D multimodal composition

ABSTRACT Extended reality technologies – mixed, augmented, and virtual reality, and future-related technologies – are rapidly expanding in many fields, with underexplored potentials for multimodal composition in digital media environments. This research generates new knowledge about the novel wearable technology – smart glasses – to support elementary students’ multimodal story authoring with 3D virtual objects or holograms. The researchers and teachers implemented learning experiences with upper elementary students from three classrooms to compose and illustrate written narratives before retelling the story with Microsoft HoloLens 2 smart glasses, selecting 3D holograms to illustrate the settings, characters, and events from the 3D Viewer software. The findings analyse how smart glasses supported students’ multimodal composition, and relatedly, the new modal resources available to students wearing smart glasses to compose 3D stories. The findings have significance for educators and researchers to understand and utilise the multimodal affordances of augmented and mixed reality environments for composing and storytelling.

Effect of Transparency Levels and Real-World Backgrounds on the User Interface in Augmented Reality Environments

With the introduction of the metaverse, augmented reality (AR) is expected to become the next interface between people and computers. Research is conducted to improve the usability of AR applications and devices. Color transparency and background effect are the two critical factors to consider while developing AR applications. Ten user interface conditions (5 color transparency levels × 2 background conditions) were evaluated in an AR environment. The task completion time and mean error were noted along with the subjective scores of button visibility, background visibility, and motion sickness. The results revealed a significant difference in task completion time, button visibility, and background visibility between transparency conditions, but not in the number of errors and total motion sickness. The transparency level of T0.5 and T0.75 is recommended for the interface of AR applications. This study could be helpful when creating augmented reality applications for the metaverse and other platforms.