Neural network-based pose estimation and real-time tracking of ultrasound probes.

The article is devoted to actual problem of using modern ICT tools to increase the level of efficiency of the educational process. The current state and relevance of the use of augmented reality (AR) and virtual reality (VR) technologies as an appropriate means of improving the educational process are considered. In particular, attention is paid to the potential of the combined capabilities of AR and VR technologies with adaptive learning systems. Insufficient elaboration of cross-use opportunities for achieving of efficiency of the educational process in state-of-the-art research has been identified. Based on analysis of latest publications and experience of using of augmented and virtual reality technologies, as well as the concept of adaptive learning, conceptual model of learning based on the combined capabilities of AR and VR technologies with adaptive learning systems has been designed. The use of VR and AR technologies as a special information environment is justified, which is applied in accordance with the identified dominant type of students' thinking. The prospects of using the proposed model in training process at educational institutions for the implementation and support of new teaching and learning strategies, as well as improving learning outcomes are determined by the example of such courses as “Algorithms and data structures”, “Computer graphics and three-dimensional modeling”, “Circuit Engineering”, “Computer Architecture”.

Augmented Reality (AR) technology has emerged as a disruptive force with the potential to redefine human interaction with the digital world. This chapter provides a comprehensive overview of the foundational aspects of AR, focusing on its underlying principles, key components, and transformative applications. At its essence, AR technology seamlessly blends virtual elements with real-world environments, offering users enriched experiences through contextual information and interactive overlays. It also dissects the core components of AR systems, including sensors, displays, tracking mechanisms, and rendering algorithms. Rendering algorithms, such as occlusion handling and real-time object tracking, contribute to creating convincing AR experiences by generating realistic virtual objects and integrating them seamlessly into the real world. Additionally, it scrutinizes the theoretical frameworks supporting AR, including computer vision, spatial computing, and human-computer interaction paradigms, to clarify the cognitive and perceptual mechanisms underlying AR interfaces.

This study examines augmented reality, which imposes on the world around us virtual objects, characters, filters, or other effects through a special camera. Currently, augmented reality is considered potential for pedagogical programs and it is beginning to gain momentum and be actively used. The use of augmented reality technology opens up new opportunities that increase productivity and efficiency in various industries, improve communication and knowledge transfer and make distance learning more comfortable and realistic. However, the factor of reducing the cost of production or the educational process due to the introduction of augmented reality is not yet fully disclosed and requires a detailed analysis, part of which is conducted in this paper. The existing types of augmented, virtual and mixed reality technologies were analyzed, their comparison was made, the current place in the market was determined, as well as their influence and role in modern education. The paper presents examples of the use of augmented reality technology in various fields, including in production, which demonstrates a significant increase in efficiency and confirms the relevance. An overview of the premises and laboratories, which now use virtual and augmented reality technologies for the educational process. The article also describes the shortcomings of the educational process, which can be corrected by introducing augmented reality technology. The economic benefit of using augmented reality in the educational process on a real example was calculated, due to which the expediency of this implementation was proved. Elements of the educational process are considered, the replacement of which with augmented reality will make education cheaper, and this means more accessible. An example of markers used for an augmented reality application in the field of aircraft construction is given. The tendency of the application of augmented reality and use in the educational process for the next years is analyzed, the branches in which it can be applied are considered and the expediency of its use is confirmed.

The development and structuring of an augmented reality (AR) platform integrating image processing, deep learning, and spatial tracking techniques have yielded promising results. AR technology, which enhances real-world objects with computer-generated information, holds vast potential for education, entertainment, and industry. Image processing enables real-time object detection, recognition, and tracking within the user's environment, while deep learning models enhance pattern recognition accuracy. Spatial tracking techniques ensure seamless integration of virtual content with the physical world, providing immersive AR experiences. Ant colony optimization (ACO) algorithms further enhance the AR platform's functionality by optimizing object placement and interaction. ACO mimics ant behavior to find optimal paths through graphs, effectively optimizing spatial layout and user interaction patterns in dynamic environments. The integration of ACO into the AR platform facilitates efficient pathfinding for augmented objects and enhances the system's responsiveness to user inputs. The successful implementation of the AR platform underscores its potential to revolutionize various industries, including healthcare, education, and marketing. By leveraging AI-driven algorithms and optimization techniques, AR systems can deliver personalized and engaging experiences that blur the boundaries between the digital and physical worlds. These results pave the way for future advancements in AR technology, driving innovation and reshaping human-computer interaction paradigms.

Cross-Cultural Education: The Effects of AR Technology and Learning Styles on Learning Achievements of Sculpture Course

AR/VR assisted integrated framework of autonomous disassembly system for industrial products

A wide variety of educational practices are supported through Augmented Reality (AR) technology achieving high level of engagement and motivation that are central concepts in different learning theories. AR is adopted in classroom sessions as well as in outdoor activities using desktop, web-based or mobile applications. It is a suitable supplementary tool extending educational scenarios in blended learning, online learning, formal and informal learning, self-paced learning. AR is seen as a catalyst for knowledge construction and transfer posing the learner in the role of an active participant who explores and experiments in a unique technological environment. Successful learning practices are well described showing the potential of AR to promote creativity, curiosity and discovering approach at gathering new knowledge or applying existing facts. As it can be seen the positive results of AR implementation on learning outcomes are well studied and documented, but this does not reveal the causes of that. On the other hand, the cognitive process, learning and affective circumstances are strongly connected as it is proved in scientific reports of psychologists, neuroscientists and educational experts.The gained results from an experiment with teachers from primary school related to the influence of Augmented Reality (AR) technology on affective states and learning are presented. Positive and negative emotions are important part in teachers' preparation of pedagogical content, curriculum development and relationship creation with children. According to the teacher's pedagogical strategy and presented content different emotions could be induced to pupils. The findings point that AR technology based learning objects play an important role to settle emotions and feelings like concerned, attentive, enthusiastic, excited, activated, with new idea, joyful. Successful learning practices are well described showing the potential of AR to promote creativity, curiosity and discovering approach at gathering new knowledge or applying existing facts. A wide range of research publications demonstrate that the appropriate affective learner's states can lead to the effective learning. The importance of positive emotions on stimulation of creative thinking, efficacy in decision making and in support of problem solving is explored too. The relationship among AR technology usage, resulting emotions and learning achievements are not explored and it is a challenge producing several research questions like: How does AR technology influence on the learners affective states?, How the learners emotions evolve during an AR session?, How the correlation among AR technology and emotions reflect on the learning experience? The research methodology includes three main procedures: (1) literature review about the important emotions for a learning process, (2) creation of exploratory tools for emotions gathering during an AR session, (3) experiment organization and result analysis.

In recent years, with the continuous development of information technology, information-based hybrid teaching method is accelerating into the classroom. As a link between two-dimensional (2D) books and three-dimensional (3D) entities, 3D models and 3D animations, Augmented Reality (AR) technology is playing an unparalleled advantage in the construction of informatization teaching materials. Because of the need for abstract spatial imagination to understand spatial structure and geometry knowledge, graphics course has always been difficult for some students, and some students’ interest in learning is relatively low. The application of AR technology in the creation and compilation of graphics teaching materials can solve this problem. The creation and compilation of Graphics Textbook Based on AR technology needs the cooperation of cartographers, software technicians and publishing editors. The content creation team composed by the teachers of cartography course is the knowledge-based main body of the drawing textbook production based on AR technology; the technology company, as the software support team, is the technical main body of the drawing textbook production based on AR technology; the publishing editor is responsible for the organization and implementation of the new form of teaching material, and is the organizational main body of drawing textbook production based on AR technology. AR technology enhances the 3D presentation of the content of the teaching material, interesting animation demonstration, the deconstruction reappearance and rotation change of the 3D structure. It also strengthens the knowledge of the graphics textbook, improves the ease of learning, enhances the interest of learning, and helps students understand. The technical team develops the supporting app and presents the resources in the terminal equipment. The updating and maintenance of resource data need to be completed in the background database, and the sharing of resources plays an important role in promoting the integration of media, promotion and use of graphics teaching materials.

Рассматриваются особенности применения технологий VR (виртуальной реальности) и AR (дополненной реальности) организациями финансовой сферы. Определяется специфика технологий виртуальной и дополненной реальности. Последовательно представлена история их продвижения на рынки, отмечены наиболее яркие факты, результаты совершенствования в контексте технологического прогресса (Sensorama, head-mounted display, «Кинокарта Аспена», устройство Eye Tap, коммерческая система RB2, VR-консоль компании SEGA Games Co., очки Oculus Rift и др.). Отмечаются области и возможности их применения. Изучена степень проникновения технологий виртуальной и дополненной реальности в деятельность финансовых организаций. Указаны основные направления их применения: приведены конкретные примеры интеграции VR- и AR-технологий в работу финансовых организаций. Систематизированы такие цели применения AR- и VR-технологий в финансовой сфере, как упрощение получения и обработки информации клиентами посредством приема визуализации, сохранение безопасности, маркетинговые коммуникативные цели и др. В результате проведенного исследования обозначены тенденции использования технологий на финансовом рынке, выявлены возможности их развития и перспективы применения, факторы, сдерживающие их развитие, определены и систематизированы преимущества и недостатки как самих технологий, так и функционирования этих технологий в финансовой среде. В заключение сделан вывод о том, что применение VR- и AR-технологий позволит финансовым организациям укрепить свои конкурентные позиции на рынке, а клиентам финансовых организаций — создать собственную безопасную онлайн-среду, в которой они смогут управлять своими деньгами и инвестициями и совершать транзакции. The features of the use of VR (virtual reality) and AR (augmented reality) technologies by financial organizations are considered. The specifics of virtual and augmented reality technologies are determined. The history of their promotion to markets is presented in a coherent manner, highlighting key facts, the results of improvements in the context of technological advances (Sensorama, head-mounted display, Aspen’s Cinema Map, Eye Tap device, RB2 commercial system, VR-console of SEGA Games Co., glasses Oculus Rift and more). Areas and possibilities of their application are noted. The areas and possibilities of their application are highlighted. The degree of penetration of virtual and augmented reality technologies in the activities of financial institutions is explored. The main directions of their application are indicated: specific examples of integration of VR- and AR-technologies in the work of financial institutions are given. The goals of using AR and VR technologies in the financial sector, such as simplifying the receipt and processing of information by clients through the reception of visualization, maintaining security, marketing communication goals, etc., are systematized. As a result of the study, trends in the use of the technologies in the financial market are identified, opportunities for their development and prospects of application, factors that restrain their development are identified, the advantages and disadvantages of both the technologies themselves and the functioning of these technologies in the financial environment are identified and systematized. It is concluded that the use of VR and AR technologies will allow financial institutions to strengthen their competitive positions in the market, and let the clients of financial institutions create their own secure online environment in which they can manage their money and investments and make transactions.

The purposes of this research were 1) to design augmented reality (AR) technology for hostels, especially an information-providing system, and 2) to explore the satisfaction of the hostel operators and hostel guests towards augmented reality (AR) technology for hostels. In this study, the participants were three hostel operators, 52 hostel guests, and three experts in AR technology design. The data collection procedure was divided into two stages: the design stage and the evaluation stage. During the design stage, data were collected from hostel operators, hostel guests, and experts using questionnaires and in-depth interviews. The focus areas of data collection included the needs for AR technology design, specific requirements for AR presentations, and suggestions for information needed to facilitate AR technology use in hostels. In the evaluation stage, experts assessed the application development forms for the AR technology. Furthermore, the satisfaction forms completed by hostel operators and guests were analyzed, focusing on both design and function satisfaction, alongside any suggestions they provided. The data were then analyzed by using mean (x̄), standard deviation (S.D.), and content analysis. Based on the data analysis, it was found that the AR technology for hostels was successfully designed as a facilitator to provide necessary information, and both hostel operators and hostel guests reported highly positive satisfaction. It should be noted that the study’s sample size was limited, and the research primarily relied on TikTok as the delivery platform. Research findings and recommendations for applying the research results and for further research are also discussed. It is hoped that these findings will provide useful information and guidelines for hostels and those who are interested in applying and using AR technology in their businesses and studies.

Academic Librarians' Attitudes towards Augmented Reality

BackgroundSmart-bar device (SBD) is a newly developed device to measure the body range of motion (ROM) by a kinetic sensor and to provide an exercise program with augmented reality (AR) guidance of body-frame image and audio feedback by mobile application.ObjectiveThis study aims to compare the performance of SBD with AR function with a goniometer and to verify the clinical utility of SBD with AR guide function`MethodsTen healthy individuals were enrolled and measured the ROM of body lateral flexion, extension, and rotation using a goniometer and SBD simultaneously. To evaluate the accuracy of an AR-guided exercise, we enrolled three patients with adolescent idiopathic scoliosis and measured the ROM of trunk lateral flexion and rotation during stretching exercises using SBD with or without AR guidance.ResultsConcurrent validity between the goniometer and SBD was statistically significant, with a very high correlation coefficient from r = 0.836–0.988 (p < 0.05). All patients with scoliosis showed higher accuracy when we used SBD with AR guidance than when we used SBD without AR guidance (p < 0.05).ConclusionsThe SBD could be a valid device to measure the joint angle of neck, shoulder, and trunk. AR guidance increased the accuracy of the stretching exercise, and mobile application of AR-guided stretching exercises with SBD should be useful for scoliosis patients to correct their posture.

Study Design Feasibility study.Purpose A phantom model was used to evaluate the accuracy of a novel augmented reality (AR) system for cervical screw placement.Overview of Literature The use of navigation systems is becoming increasingly common in spine procedures. However, numerous factors limit the feasibility of regular and widespread use of navigation tools during spine surgery. AR is a new technology that has already demonstrated utility as a navigation tool during spine surgery. However, advancements in AR technology are needed to increase its adoption by the medical community.Methods AR technology that uses a fiducial-less registration system was tested in a preclinical cervical spine phantom model study for accuracy during spinal screw placement. A three-dimensional reconstruction of the spine along with trajectory lines was superimposed onto the phantom model using an AR headset. Participants used the AR system to guide screw placement, and post-instrumentation scans were compared for accuracy assessment.Results Twelve cervical screws were placed under AR guidance. All screws were placed in an acceptable anatomic position. The average distance error for the insertion point was 2.73±0.55 mm, whereas that for the endpoint was 2.71±0.69 mm. The average trajectory angle error for all insertions was 2.69°±0.59°.Conclusions This feasibility study describes a novel registration approach that superimposes spinal anatomy and trajectories onto the surgeon’s real-world view of the spine. These results demonstrate reasonable accuracy in the preclinical model. The results of this study demonstrate that this technology can assist with accurate screw placement. Further investigation using cadaveric and clinical models is warranted.

Augmented Reality (AR) on mobile devices has picked up great momentum in a host of industries, providing engaging and interactive experiences via the blending of digital overlays with real-world environments. A key enabling technology behind such applications is computer vision, which facilitates real-time object detection and tracking for AR overlays. Yet, implementing effective computer vision models on low-powered handheld devices raises a host of challenges. This work discusses lightweight object detection and tracking techniques optimized for mobile platforms with the focus on such models as MobileNet and YOLO-tiny that are capable of providing real-time performance with very low computational costs. Another major concern in mobile AR systems is balancing the requirements of graphic rendering for AR overlays with machine learning (ML) computations for object detection. This paper reviews methods of dividing resources among these mutually competing processes, i.e., model pruning, adaptive rendering, and hybrid processing methodologies. Methods of reducing latency and optimizing power efficiency are also presented to improve the user experience on mobile devices. Additionally, privacy and security issues are discussed in the realm of AR with edge computing identified as a way to protect sensitive information. The paper concludes by outlining future directions for AR on handheld devices, such as improvements in computer vision models, the development of AR-specific hardware, and new applications taking advantage of this technology in education, healthcare, and entertainment. Through this, we hope to give a holistic view of challenges and opportunities involved in deploying computer vision for augmented reality on mobile platforms. Keywords— augmented reality, computer vision, lightweight object detection, mobile AR, real-time tracking, graphic rendering, machine learning, resource-constrained devices, edge computing, privacy.

A liver surgeon's knowledge of anatomy is critical. Due to the patient's small field of vision, patient specific, complex nerve system, and other factors, even a minor loss can result in irreversible damage. Surgeons could benefit from the use of augmented reality (AR) technology, which would bring three-dimensional image data into the operating room. AR visualization can improve surgical procedures, facilitate intraoperative planning, and enhance surgical guidance for the anatomy of interest, all of which contribute to the application's minimal invasiveness. This literature review on image guidance in liver surgery provides the reader with information about AR techniques. To ascertain the current state of Augmented reality technology's application in liver surgery, a PubMed and Embase search were conducted using the following keywords: < (Augmented reality) AND (liver surgery) > and < 'Augmented reality' AND 'liver surgery' > (publication date from January 1991 until Jun 2022). The query yielded a total of 205 publications-excluded papers in other languages, virtual reality (VR), and reviews leaving 135 studies for review. After removing duplication, the titles and abstracts of those studies were manually reviewed. Finally, 31 pertinent studies were determined to be pertinent to the subject. Generally, augmented reality technology includes preoperative planning and three-dimensional reconstruction, intraoperative three-dimensional navigation, and registration. Visualization may be aided by virtual three-dimensional reconstruction models of the liver from Computed Tomography/Magnetic Resonance Imaging scans. The results demonstrate that by utilizing augmented reality technology, blood vessels and tumor structures in the liver can be visualized during surgery, allowing for precise navigation during complicated surgical procedures. Augmented reality has been demonstrated to be safe and effective in both minimally invasive and invasive liver surgery. With recent advancements and significant effort by liver surgeons, augmented reality technologies have the potential to increase hepatobiliary surgical procedures dramatically. However, further clinical trials will be necessary to evaluate augmented reality as a tool for reducing post-operative morbidity and mortality. The impact of these cutting-edge computerized image guidance techniques on clinically relevant outcome parameters should be assessed in the future.