Augmented Reality Markers Research Articles

Improvement of Active Textbook System (A-txt) on Unity Version and Examination of Usage in Consideration of Copyright

This paper is described on the improvement of the Active Textbook System (A-txt) and the consideration for Copyright Law when the A-txt is used. The A-txt is a next-generation electronic educational material system proposed by the authors that can digitally expand the general paper books with general-purpose terminals. This system is the original system that allows you to easily attach additional digital content to any location by using figures and sentences on paper as augmented reality (AR) markers. Initially, A-txt, which was developed for each type of mobile OS, is provided on a unified platform by using Unity, and it has become possible to concentrate budgets and human resources. This time, we have added new functions to make usability better and improved the screen display by modifying the source code. In addition, as a measure to use figures in books as AR markers without infringing copyright, we experimentally have found the minimum necessary range in which A-txt can be used without inconvenience. In the process, we also have found a method to increase the recognition rate of markers.

Implicaciones pedagógicas de la realidad aumentada para la mejora de la enseñanza de las ciencias en primaria

La realidad aumentada (RA), con su capacidad para tender puentes entre lo real y lo virtual, abre nuevas oportunidades para construir atractivos entornos de aprendizaje en el actual contexto de crisis a consecuencia de la COVID-19. La RA se considera como uno de los medios pedagógicos para promover la calidad de la enseñanza en las próximas generaciones y es, por ello, que en este artículo se presenta una revisión sistemática de literatura de cómo se está implementando la RA en los centros de primaria para el aprendizaje de las ciencias naturales. Se han analizado en profundidad dieciocho artículos de revistas, todos ellos indexados en Web of Science y que han sido publicados en los últimos cinco años. El propósito de esta investigación ha sido conocer cómo influye el uso de la RA en la motivación, rendimiento académico y en la carga cognitiva del alumnado que estudia ciencias en primaria y con esta tecnología. También, se analizan los recursos de RA para la educación científica más citados en las investigaciones consultadas. Los resultados han mostrado que la RA mejora significativamente la motivación y rendimiento académico del alumnado durante su utilización. Con respecto a la carga cognitiva, se ha demostrado que la inclusión de la RA en la educación científica no conlleva una mayor carga mental para el alumnado. Algunos de los materiales basados en la RA que emergen del análisis de esta selección son las aplicaciones de exploración (libros aumentados, marcadores de RA y puntos de interés para activar la información digital), las herramientas de simulación y los juegos. Augmented reality (AR), with its ability to bridge the real and the virtual, opens new opportunities to build attractive learning contexts in the current context of crisis as a result of COVID-19. AR is seen as one of the pedagogical means of promoting the quality of teaching in the coming generations and is therefore that this article presents a systematic literature review of how AR is being implemented in primary schools for science learning. The eighteen selected journal articles, indexed in Web of Science and covering the last five years, have been analysed in depth. The purpose has been to know how the use of AR influences the motivation, academic performance and cognitive burden of students in the study of science. It also analyses the AR resources for scientific education most cited in the research with which they have been worked. The results have shown that AR significantly improves students' motivation and academic performance during use. About cognitive burden, it has been shown that the inclusion of AR in scientific education does not carry a greater mental burden for students. Some of the AR materials emerging from the analysis of this selection are exploration applications (augmented books, AR markers, and points of interest to activate digital information), simulation tools, and games.

OUTDOOR AR-APPLICATION FOR THE DIGITAL MAP TABLE

Abstract. In many fields today, it is necessary that a team has to do operational planning for a precise geographical location. Examples for this are staff work, the preparation of surveillance tasks at major events or state visits and sensor deployment planning for military and civil reconnaissance. For these purposes, Fraunhofer IOSB is developing the Digital Map Table (DigLT). When making important decisions, it is often helpful or even necessary to assess a situation on site. An augmented reality (AR) solution could be useful for this assessment. For the visualization of markers at specific geographical coordinates in augmented reality, a smartphone has to be aware of its position relative to the world. It is using the sensor data of the camera and inertial measurement unit (IMU) for AR while determining its absolute location and direction with the Global Navigation Satellite System (GNSS) and its magnetic compass. To validate the positional accuracy of AR markers, we investigated the current state of the art and existing solutions. A prototype application has been developed and connected to the DigLT. With this application, it is possible to place markers at geographical coordinates that will show up at the correct location in augmented reality at anyplace in the world. Additionally, a function was implemented that lets the user select a point from the environment in augmented reality, whose geographical coordinates are sent to the DigLT. The accuracy and practicality of the placement of markers were examined using geodetic reference points. As a result, we can conclude that it is possible to mark larger objects like a car or a house, but the accuracy mainly depends on the internal compass, which causes a rotational error that increases with the distance to the target.

Upper Limbs Kinematics Estimation Using Affordable Visual-Inertial Sensors

This study aims at developing and evaluating an affordable and user-friendly motion capture system for human upper limbs’ joint kinematics estimation. The objective is to provide quantitative assessments during the clinical evaluation of poststroke patients performing daily living activities. The proposed system is based on the simultaneous use of affordable inertial measurement units, and a set of augmented reality markers tracked with an affordable RGB camera. Two practical calibration processes were developed to calibrate the sensors modules and then to determine their location on body segments. Then, all measured quantities were fused into a constrained extended Kalman filter based on an upper limbs’ biomechanical model. The proposed system was validated with nine healthy volunteers performing five daily living activities. Joint angles estimated using the proposed affordable system were compared with a gold standard stereophotogrammetric system. The results showed a low average rms difference (2.7°) along with a high average correlation (0.87). <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Note to Practitioners</i> —This article was motivated by the problem of assessing human upper limbs’ mobility during a rehabilitation process. Existing systems are often inaccurate and/or not affordable. This article suggests a new approach by combining measurements from inertial measurement units and augmented reality markers into an adaptive filter that is taking into account the kinematics model of the human arm and its limitation to filter out unfeasible solutions. The system is also making use of a new very practical calibration method not requiring any external equipment while remaining very affordable. Experimental results suggest that the proposed system is able to estimate more accurately than state-of-the-art joint angles of the upper limbs.

Research of augmented reality marker recognition systems

Research of augmented reality marker recognition systems

A Real-Time Physical Progress Measurement Method for Schedule Performance Control Using Vision, an AR Marker and Machine Learning in a Ship Block Assembly Process.

Progress control is a key technology for successfully carrying out a project by predicting possible problems, particularly production delays, and establishing measures to avoid them (decision-making). However, shipyard progress management is still dependent on the empirical judgment of the manager, and this has led to delays in delivery, which raises ship production costs. Therefore, this paper proposes a methodology for shipyard ship block assembly plants that enables objective process progress measurement based on real-time work performance data, rather than the empirical judgment of a site manager. In particular, an IoT-based physical progress measurement method that can automatically measure work performance without human intervention is presented for the mounting and welding activities of ship block assembly work. Both an augmented reality (AR) marker-based image analysis system and a welding machine time-series data-based machine learning model are presented for measuring the performances of the mounting and welding activities. In addition, the physical progress measurement method proposed in this study was applied to the ship block assembly plant of shipyard H to verify its validity.

Media Informasi untuk Bank Baterai Berbasis Augmented Reality

Berdasarkan data dari prekuesioner tentang kebutuhan media informasi di PT. Telkom WITEL Bandung, sebanyak 75% karyawan belum mengetahui tentang informasi bank baterai secara mendetail dan lainnya hanya mengetahui dari manual book dan internet. Sulitnya mendapatkan informasi dari suatu perangkat menyebabkan terjadinya berbagai tindakan dan keputusan yang tidak sesuai dengan standar prosedur yang telah ditetapkan. Di sisi lain, manual book menyajikan informasi secara konkret, sehingga menyulitkan para pegawai untuk memahami informasi secara cepat dan tepat yang menyebabkan menurunnya minat baca. Penerapan Augmented Reality (AR) sebagai media informasi bank baterai menjadi salah satu pemanfaatan teknologi yang tepat untuk menyampaikan informasi secara digital. Dengan AR, pengguna akan merasakan informasi muncul secara langsung seperti objek fisik ke dalam dunia nyata, sehingga menjadi lebih realistis, interaktif, dan mudah dipahami secara cepat dan tepat sesuai dengan standar prosedur yang telah ditetapkan. Pada makalah ini, perancangan aplikasi AR menggunakan metodologi Luther-Sutopo berbasis Multimedia Development Life Cycle (MDLC) dengan jenis AR Marker Based Tracking. Hasil pengujian fungsionalitas menunjukkan bahwa aplikasi sudah berjalan dengan baik dan siap untuk digunakan sebagai sistem media informasi bank baterai di PT. Telkom WITEL Bandung yang dapat diunduh di Google Play Store.

Augmented Reality-Marker Detection Measurement on Heroes of Surabaya Mobile Games

— Different arrangement in selling freemium programming application is the In-App Purchase (IAP) technique, where clients can download and enjoy the application for free; however, there are premium highlights that must be paid. We use Augmented Reality (AR) innovation into the IAP framework in the buying system of the game application, Heroes of Surabaya (HOS). The application allows user keeps run and play on the Android mobile system, but it will require AR marker cards to enable the premium feature on it. This investigation plans to test the effectiveness of AR marker cards that proposed as a substitute for computerized cash on the purchasing system of the game application. From the experimental results, the distance of the marker and the light factor are the main factors for the success-rate of the detection of the AR marker.

Motion planning of skillful motions in assembly process through human demonstration

ABSTRACT Skillful motions in the actual assembly process are challenging for the robot to generate with conventional motion planning approaches because some states during the human assembly can be too skillful to realize automatically due to the narrow passage. To deal with this problem, this paper develops a motion planning method using the human demonstration, which can be applied to complete skillful motions in the robotic assembly process. To demonstrate conveniently without redundant third-party devices, we attach augmented reality (AR) markers to the manipulated object to track and capture its poses during the human demonstration. To overcome the problem brought by the coarse resolution of the vision system, we extract the most important key poses from the demonstration data and employ them as clues to execute motion planning to suit the target precise task. As for the selection of key poses, two policies are compared, where the first and the second derivative of the main changing parameter of every key pose serve as criteria to determine the priority of utilizing key poses. Besides, a solution to deal with colliding key poses is also proposed. The effectiveness of the presented method is verified through some simulation examples and actual robot experiments.

Robots for search site monitoring, suspect guarding, and evidence identification

As an initial trial and in response to a lack of technological applications in government agencies, we have developed three multifunctional robots in accordance with the work environment and the nature of our tasks. Search site monitoring robot is fitted with a panoramic camera and large wheels for walk-around search site monitoring. Suspect guarding robot follows and guards a suspect by tracking an augmented reality marker worn by the suspect and identifying the human body through an infrared thermal camera. For the evidence identification robot, &lt;em&gt;You Only Look Once&lt;/em&gt; (YOLO) is utilized to identify some specific evidence on search site and is equipped with a carrier and a high-torque motor for evidence transportation; it is set to issue warnings and emails to relevant personnel on specific emergencies. We have performed multiple experiments and tests to confirm the robots’ effectiveness, verifying their applicability of technological task support in government agencies.

Development of an augmented reality‐based scaffold to improve the learning experience of engineering students in embedded system course

AbstractThe Embedded system is the core unit of every digital device. The design and development of a new digital device or system require a good understanding of the embedded system embed in it. In the context of engineering education, learning embedded systems remains a challenge for the millennial. As, it involves the implementation of mathematics, programming, and working knowledge of electronic and electrical components rooted in it. Traditional teaching pedagogy has become less useful for new‐gen learners to satisfy their demand for knowledge of embedded systems. So, the teaching techniques have to be modified and equipped with the latest technological tools and practices. Augmented reality (AR) is emerging as a new technology in the field of engineering education. With the help of computer‐generated 3D data, animation, visual effects, and immersion, this technology has become more prevalent in the education domain to make complex concepts easier to understand. In this paper, an augmented reality‐based framework designed to teach embedded systems to engineering students. The proposed framework utilizes a tangible user interface comprising of AR markers, a USB camera, a display device, and the processing unit to give AR learning experience to the students. The system so developed tested for its usability with the faculty members of engineering education. Twenty faculty members, as participants, share their system usability experience and feedback using google form. The overall system usability score is 79.5%, which makes it suitable for further deployment on students for exploratory work.

Method of sustainable detection of augmented reality markers by changing deconvolution

Method of sustainable detection of augmented reality markers by changing deconvolution

E-government learning media through augmented reality technology

&#x0D; &#x0D; &#x0D; &#x0D; Augmented reality (AR) is one of the newest learning technologies besides Artificial Intelligent, Virtual Reality, Virtual World, Alternates Reality Games, and Wearable Computing. E-Government is becoming an evolving academic field and transforming to be E-Governance, E-Participation, E-Service, E-Democracy, E-Voting issues. Therefore, some universities have E-Government course in their curriculum. AR can be one of the learning media to learn and teach E-Government effectively and interestingly. This research aims and contributes to develop a novel model of E-Government learning media using AR. Furthermore, this work has three novelties as follows:First, a method to develop e-Government learning media using AR. Second, a novel model of e-government learning media based on augmented reality technology. Third, the material courses are command centre and public service mall materials based in Surabaya, Indonesia. The new model of learning media using AR consists of main components, i.e., user, devices, AR, and course materials. Additionally, this novel model has some sub-components, such as AR object, marker, text, image, audio, video, and 3D animation. The proposed model has some practical and theoretical implications. For the theoretical implication , it adds a model of learning media for e-government course and extends the body of knowledge for e-government and augmented reality fields. For practice, e-Government courses can uilize the augmented reality application.&#x0D; &#x0D; &#x0D; &#x0D;

Developing Augmented Reality Hybrid Marker using Pictorial Quick Response Code for Community Products

Applying augmented reality technology correctly helps businesses grow and attract more consumers, but using the marker that is the QR code does not directly interpret. On the other hand, if using pictorial markers, although they can convey meaning, it still takes time to process to extract the hidden information. This paper proposes to develop the hybrid marker for augmented reality by mixing the community brand image with the QR code for community product entrepreneurs, and develop the mobile application for scanning the hybrid marker then respond to the augmented reality content in several styles. The hybrid marker was generated into two modes. The opacity layer mode was set the opacity value of QR code to 55%. And overlapping mode is designed to invert the pixel color between pictorial band image and QR code. This system was evaluated in black-box testing. As a result, the efficiency of the hybrid marker and mobile application is the highest level of user acceptance while being used in this system.

Measuring hand-pouring motion in casting process using augmented reality marker tracking

Elucidations of workers’ pouring motions and the resultant inflow behavior of molten alloy into the mold are important because the inflow behavior is well known to affect casting quality. Nevertheless, few reports in the relevant literature describe studies of inflow behavior effects on casting quality because of difficulty in measuring the worker’s pouring motion. Therefore, this study was conducted to examine worker’s pouring motions in the actual casting field and to describe the relation between the motion and casting defects. For that, an augmented reality (AR) marker-tracking method was used to conduct contactless measurements of the pouring motion. Validation of the method revealed that the error was less than 0.9° during roll motion from 0° to 90°. Subsequently, measurements of worker’s pouring motions were conducted during actual aluminum alloy casting. Results demonstrated that the method enabled the continuous acquisition of the translation (x, y, and z) and rotation (roll, pitch, and yaw) of the crucible during pouring with a usual pouring device and crucible. Finally, the AR marker-tracking method was capable of revealing the difference of the worker’s pouring motions corresponding to the occurrence or non-occurrence of a misrun defect during the gravity die casting. The obtained results demonstrated that the AR marker-tracking method can be used to measure the worker’s pouring motion. It can reveal relations between its motion and the casting defect.

PalmitoAR: The Last Battle of the U.S. Civil War Reenacted Using Augmented Reality

Various efforts are used to preserve American history including relying on formal education, distributing information (text, video or visual aids) on social channels, displaying artifacts in historical centers or more recently, virtual reality applications posted on a shared medium. However, many of the newly developed applications are designed specifically for dedicated hardware rather than for a broad audience, thus creating a barrier for disseminating cultural values. In this paper, we propose a web-based Augmented Reality (AR) application, namely PalmitoAR, which provides an intuitive way of observing one of the most significant historical Civil War battlefields, Palmito Ranch Battlefield located in Cameron County, Texas. The proposed AR application is designed to resurrect a series of events through (i) a printed map of Palmito Ranch with embedded markers that enables viewers to experience the battle without being present at the site, (ii) a mobile device with a WebGL supported browser that allows 3D contents to be rendered, and (iii) an AR library (A-Frame.io) that enables enthusiasts to recreate similar work. Our methodology strongly relies on the benefits of a simple, robust algorithm for AR marker recognition to position 3D models in a specific context and time. As a result, the proposed AR application is complementary to existing work and provides a seamless experience for a wide range of viewers. We evaluated and improved the application with the help of twenty-six users to gather perspectives on the specific benefits of employing AR in learning about battlefields and reenactment. The technology acceptance model was adapted to access an individual’s acceptance of information technology.

A method for identifying mosaic stochastic augmented reality markers

The subject matter of the article is a method for identifying mosaic stochastic markers of augmented reality. The goal is to develop a method for identifying mosaic stochastic augmented reality markers. The tasks are: analysis of existing augmented reality markers, development of a method for identifying mosaic stochastic augmented reality markers, practical testing of the method for identifying mosaic stochastic augmented reality markers. The methods used are: methods of digital image processing, probability theory, mathematical statistics, cryptography and information protection, the mathematical apparatus of matrix theory. The following results are obtained. The advantages and disadvantages of the main existing types of markers of augmented reality are determined. The block diagram of the method for identifying mosaic stochastic markers of augmented reality is given. The stages of the method for identifying mosaic stochastic markers of augmented reality are considered. Conducted experimental studies to identify mosaic stochastic markers of augmented reality. Conclusions. For the first time, a method for identifying a mosaic stochastic augmented reality marker has been obtained, which, based on the binarization of local dispersion, detects the marker region in the original image and finds bit-container masks by segmenting and subsequent morphological filtering of the masked image region. The directions of further research are the development of a method for determining the parameters of projective transformation, which is necessary to align the image and determine the position of the camera; development of a decoding method for a mosaic stochastic marker of augmented reality.

Inside-reachable and see-through augmented reality Shell for 3D visualization and tangible interaction

Augmented reality (AR) is considered as one of the most essential technologies for providing 3D information visualization superimposed in the physical object. Thus, AR has been applied to various applications such as entertainment, education, and human-computer interaction. In particular, AR cubes have also been widely used since they can provide multi-perspective and immersive 3D visualization. However, an inherent problem in current AR cubes is that they cannot support practical and tangible interactions with both virtual and physical artifacts. Thus, they can only provide simple manipulations with a limited interaction metaphor. In particular, they cannot support internal accessibility and direct manipulation with virtual and physical objects inside the cube. This paper presents a new and innovative form of an AR cube, called inside-reachable and see-through AR shell. The AR shell can support more intuitive and tangible interaction with AR objects than conventional AR cubes. One of the unique characteristics of the AR shell is that the physical tool is accessible inside the shell. To make the AR shell be inside-reachable, each face of the AR shell may have a physical hole. This fabrication of the AR shell supports not only multi-perspective views but also provides tangible and natural interaction through the physical holes. In addition, faces with holes may prevent the AR camera from tracking AR markers consistently and adequately due to the reduced tracking areas. Thus, the proposed AR shell can be made of some faces without holes and the other faces with holes. An occlusion rendering is used for showing depth cues to visualize occlusions, which makes the faces without holes see-through. Therefore, the user can interact with AR objects inside the shell through physical holes while the user views the inside of the shell through physically occluded faces. We have also extended the proposed approach to run in a mobile HMD. We have performed formal quantitative and quantitative analyses by evaluating task performance and questionnaire. Several implementations will be presented to prove the originality and advantage of the proposed AR shell.

A new type of augmented reality markers

The subject matter of the article is the augmented reality markers. The goal is to develop a new type of augmented reality tokens that has the advantages of most existing types of tokens and is free from their disadvantages. The tasks are: analysis of the advantages and disadvantages of existing augmented reality markers, formulation of the basic requirements for a Perspective augmented reality marker, development of the main stages of construction of a new augmented reality marker, practical verification of compliance of a new augmented reality marker with the formulated requirements. The methods used are methods of digital image processing, probability theory, mathematical statics, cryptography and information security, mathematical apparatus of matrix theory. The following results were obtained. The advantages and disadvantages of the main existing types of augmented reality markers are identified. The five requirements that new augmented reality tokens must satisfy are formulated. The technique of constructing a new marker of augmented reality is offered, which satisfies the formulated requirements. The accuracy of marker recognition depending on the correlation between its parameters is theoretically substantiated. Conclusions. The areas of further research are the development of a method for determining the parameters of projective transformation that is necessary to align the image and determine the position of the camera; development of a method of finding the correct offset of the aligned image, which is necessary for the correct decoding of the permuted image.

Mobile Augmented Reality for Learning Traditional Culture Using Marker Based Tracking

The purpose of this research is to design a mobile augmented reality for learning Batavia traditional culture on improving the knowledge of the citizen of Jakarta. Augmented reality is applied as an approach to enhance the interaction of users for improving their level of knowledge. The method used in this research is a marker-based method detection which resulted in a minimum response of less than 2 second, a minimum distance of 10 cm and a maximum distance of 50 cm, a minimum angle of 25 degrees and a maximum 80 degrees performed on the augmented reality marker. The result of this research is the marker-based tracking method applied on a mobile augmented reality has proven to be excellent and giving an increasing knowledge effect of the citizen of Jakarta for learning their traditional arts, architecture and weaponry.