Markerless Augmented Reality Research Articles

An Automated System for Projection of Interior Construction Layouts

Layout of the interior works during building construction is time consuming and error prone. Given the cost involved, both for initial layout and for later rework where errors occur, researchers have sought to automate the layout task. Some have adopted marker-less augmented reality methods using heads-up displays or cameras, and others have proposed robots capable of marking out the works. The former encumber the workers, the latter are expensive to set up and are sensitive to site conditions, and neither has yet achieved the required accuracy. In this paper, we propose a more efficient approach to project relevant information from a building information model (BIM) onto the construction surface, directly augmenting the construction site with the design information. This is done using a portable system consisting of a 2-D laser scanner, an angled adjustable projector, and a camera. The system localizes itself within the already built outer walls using the laser scanner and the BIM model using a method derived from robotic mapping; it calibrates the projection correction parameters (keystone correction) using image analysis; and it projects the information with the angled projector. Testing results showed that the localization was accurate within a few millimeters and less than 3°, and the final projected image’s error was approximately 1 cm. Initial calibration requires less than 1 min and does not require specialist skills. The system automates the layout task, preserves accuracy, and can provide rich model information on any interior surface. Note to Practitioners —Measuring and marking up of the interior works during building construction is time consuming and error prone. Layout must be repeated for each trade: partitions, false ceilings, mechanical, electrical, and plumbing systems, and flooring and furnishings all require accurate marking of locations on floors, walls, and ceiling surfaces. Current automation is limited to the use of robotic total stations, but these only locate specific predetermined points. We propose a simple solution for automated layout, in which images from a building information model are projected directly onto the work surface. The system projects any desired information—drawings and images—onto the work surface (floor, walls, or ceiling) in the correct location, scale, and orientation. The prototype apparatus consists of a laser range scanner, a projector, and a camera. Projection of the work instructions directly onto the work surface is accurate and immediate. It saves the time required for workers to interpret and then mark up the dimensional information and it avoids the human error involved. The prototype is limited to environments in which computer projection is practical and currently requires planar surfaces.

Rancang Bangun Aplikasi Simulasi Dekorasi Ruangan dengan Memanfaatkan Teknologi Markerless Augmented Reality

Markerless Augmented Reality (AR) is a technology that combines two-dimensional or three-dimensional virtual objects into a real environment and then projects these virtual objects in real time without the need for a special marker. In this research, the Markerless AR application will be used to simulate room decoration with 3-dimensional objects. This research was built using the Java programming language and using supporting applications namely Android Studio and Wikitude library. Based on the results of testing with the Black-box method, the overall functionality of the application has run well, besides testing also uses the System Usability Scale (SUS) method by giving questionnaires to 20 application users. The results of the System Usability Scale (SUS) test obtained an average score of 73.13. In grouping the SUS percentile score, the value of 73.13 is in Class C, wherein this assessment the application is acceptable and can be used easily by the user.

Tracking Visualization Of 3 Dimensional Object Natural Science Learning Media In Elementary School With Markerless Augmented Reality Based On Android

Many materials in the Natural Sciences lesson are not understood by students. Teacher-centered learning methods cause students to learn passively. Students barely listen to teachers who giving lectures on natural science subject. There are already many learning media for natural sciences in 2-dimensional forms such as learning videos. Science learning media uses a 3-dimensional animation model, which offers several visualizations of science lessons. Learning media for natural science for elementary schools created to facilitate students to learnn in a fun way. This application uses markerless augmented reality based on Android. In the initial stage, it will be explained how to create an application using the ADDIE method. ADDIE is one method for developing learning media products. This application is created without using a marker but using capture texture so it is necessary to check the tracking and structure from motion(SfM) the camera so that the visualization effect of 3d animation objects will appear. After that, it will be recommended to use the application correctly. This research is still in the early stages of research in the field of computer vision.

Implementation of an inbound corresponding smartphone application using markerless image processing augmented reality technology

We have developed an inbound corresponding smartphone application based on markerless image-processing augmented reality technology for use by zoo visitors and staff. On this application, we implemented an animal quiz distribution function and an animal character hunting function. We also implemented a web system on which the administrator can update the contents handled by these functions in real time. The proposed application negates the need for newly installing multilingual guide boards for foreign zoo visitors. Moreover, the web system enables the real-time updates of the contents used in smartphone applications. Here we confirmed the operability, relevance, readability, applicability, and effectiveness of the mobile application and content management web system in a questionnaire survey of 57 zoo visitors and 14 zoo staff. The survey results of all five measures revealed an overwhelmingly positive response to our mobile application and content management web application.

An Analytics Framework for Augmented Reality Applications

Analytics is a well-known form of capturing information about the user behavior of an application. Augmented reality applications deal with specific data such as the camera pose, not being supported by popular analytics frameworks. To fill such gap, this work proposes an analytics framework solution for augmented reality applications. It supports both markerbased and markerless augmented reality scenarios, collecting data related to camera pose and time spent by the user on each position. Besides the multiplatform capture tool, the framework provides a data analysis visualization tool capable of highlighting the most visited 3D positions, users main areas of interest over the marker plane, the 3D path performed by the camera and also a recovery of the content viewed by the user based on the collected camera pose information. Tests were performed using as case study a promotional campaign scenario and user behavior information was extracted using the proposed visualization tools.

Survey of Neural Network based Marker and Marker-less Augmented Reality

Survey of Neural Network based Marker and Marker-less Augmented Reality

Markerless Augmented Reality Utilizing Gyroscope to Demonstrate the Position of Dewata Nawa Sanga

<p class="0abstract"><em>Dewata Nawa Sanga</em> in Hinduism has an important role as the foundation of the religious concept implemented by Hindus in Bali, Indonesia. It has the meaning of nine deities or manifestations of Ida Sang Hyang Widhi Wasa (God Almighty) that guard or control the nine wind direction. <em>Dewata Nawa Sanga</em> in terms of education in Bali has been learned by the elementary school students. However, in social life the concept of <em>Dewata Nawa Sanga</em> itself has not been attached and understood by all Balinese Hinduism yet. Based on the problem in social life, there is an idea to develop Markerless Augmented Reality Utilizing Gyroscope to Demonstrate the Position of <em>Dewata Nawa Sanga</em>. This application is designed to know, recognize, and understand the characteristics of <em>Dewata Nawa Sanga</em> using gyroscope. This sensor serves to fulfill the object of the deities in the coordinates to be determined. Furthermore, it serves to provide information about <em>Dewata Nawa Sanga</em> along with the innovative and informative 3D animation. The result of usefulness questionnaire of this application percentage value average is 88.4%. It can be concluded that AR <em>Dewata Nawa Sanga</em> is very useful and helpful for learners in exploring the <em>Dewata Nawa Sanga</em> position in a real-world environment. The result of usability and satisfaction questionnaire of this application percentage value average is 84.8%. It shows that the application is very useful for the participants to learn <em>Dewata Nawa Sanga</em> and very satisfied to use.</p>

Marker versus Markerless Augmented Reality. Which Has More Impact on Users?

ABSTRACTAugmented Reality (AR) platforms are being used for an extensive array of applications. One of the critical moments of online shopping is the choice of product. Ideally, consumers should be able to try the product before pressing on “add to cart” button. The experimental design discussed in the article compares two different optical tracking systems of AR—a marker-based AR (MB) and a markerless AR (ML) for two types of interfaces: tangible and multimodal based on gesture recognition, respectively. Both AR technologies allow the consumer to virtually visualize sport shoes’ features. Although the interface systems affect the facial/body expression of participants, the self-reported arousal does not change. In contrast with the literature, the usability of the MB (tangible) AR is considered better than the ML (gesture-based recognition) AR option. The probability of recommending the displayed brand is higher under ML (gesture-based recognition) AR than the MB (tangible) AR. Some covariates and factors such as positive/negative emotional traits, tendency to adopt innovation, and familiarity with the brand interfere with the impact of both AR technologies on the dependent variables.

유니티와 KUDAN 엔진을 활용한 MARKERLESS 방식의 증강현실 게임개발 - '우리동네히어로'의 개발사례 중심으로

포켓몬고 게임이 인기를 끈 후 증강현실 게임의 인기는 기존보다 높아지고 있다. 이에, 게임 엔진중 하나인 유니티엔진을 사용하여 증강현실 게임을 만드는 방법에 대하여 설명한다. 특히 증강현실의 기술 중 MARKER가 필요 없는 MARKERLESS 방식을 선택하여 게임에 최적화된 증강현실을 구현하는 방법을 이용하였다. 본 논문에서는 유니티엔진과 유니티를 지원하는 KUDAN AR엔진을 활용하여 MARKERLESS 방식의 증강현실 게임을 제작하는 기법을 '우리동네히어로' 프로젝트를 통하여 제안한다. 이 제안을 위해 실행 가능한 버전을 제작하여 테스트하였으며, 이 연구를 통해 KUDAN 엔진의 MARKERLESS 방식으로 게임을 제작하는 경우 손쉽게 증강현실의 다양한 기능을 적용할 수 있다는 것을 밝혀냈다. After the Pokemon game became popular, the popularity of the Augmented Reality game is higher than ever. Therefore, it is an important choice to use an engine to create an augmented reality game. It explains how to create an augmented reality game using Unity engine, which is one of the most used game engines in game development. We describe a method for implementing augmented reality optimized for games by selecting a MARKERLESS method that does not require a marker among the augmented reality techniques. In this paper, we propose a technique to create MARKERLESS augmented reality game using KUDAN AR engine which supports Unity engine and unity through 'Our Hero' project.

Augmented reality versus conventional interface: Is there any difference in effectiveness?

The moment immediately before the “add to cart” decision is very critical in online shopping. Drawing on theories of transfer, spreading activation and human-computer interaction, the superiority of markerless Augmented Reality (AR) and Marker-based augmented reality (M) over Conventional Interactive (CI) is hypothesized. Although those multimedia tools are not part of the product/brand motivating the consumer interest they interfere in the interactive performance of the ecommerce. 150 consumers in a lab experiment showed higher emotional response, interactive response and brand evaluation in M and AR than CI. Contrary to what was expected the usability results were the inverse. That is, usability of CI outperforms M and AR. Considering only AR and M interfaces their effect on psychological variables was not statistically significant. A sophisticated or a simple interface had no impact on intention to buy the target brand, but the brand recommendation improved from M to AR. The differing effect of those three interface systems was mediated by brand familiarity, perceived risk, opinion leadership and positive emotional traits.

How augmented reality apps are accepted by consumers: A comparative analysis using scales and opinions

Increasingly, retailers rely on interactive technologies to improve consumers' shopping experiences. On the one side, interactive kiosks and smart mirrors make use of dedicated devices and software to explain, configure, and recommend products. On the other side, computer programs – so-called apps – are installed on the consumer's own device for the same purpose. They can be used at home, or – if installed on a mobile device – in retail outlets or on the move. In all cases, augmented reality (AR) can support these purposes by placing virtual content (e.g. new furniture) in a real environment (the consumer's home). The overall perception and acceptance toward such interactive technologies are discussed in this paper. Users' perceptions and experiences are measured by applying a modified technology acceptance model (TAM). Four experiments, two with marker-based and two with markerless AR apps are presented to support the generalization of the results, the measurement models and the measurement approach. The results are satisfactory with regard to the robustness of the TAM model. However, the relative importance of hedonic (enjoyment, pleasure, fun) and utilitarian (information) aspects varies for different kinds of AR apps and has to be considered for improvement to occur. From a measurement point of view the acquiescence bias has to be dealt with when developing scale items.

3D BUILDING RECONSTRUCTION BY MULTIVIEW IMAGES AND THE INTEGRATED APPLICATION WITH AUGMENTED REALITY

Abstract. This study presents an approach wherein photographs with a high degree of overlap are clicked using a digital camera and used to generate three-dimensional (3D) point clouds via feature point extraction and matching. To reconstruct a building model, an unmanned aerial vehicle (UAV) is used to click photographs from vertical shooting angles above the building. Multiview images are taken from the ground to eliminate the shielding effect on UAV images caused by trees. Point clouds from the UAV and multiview images are generated via Pix4Dmapper. By merging two sets of point clouds via tie points, the complete building model is reconstructed. The 3D models are reconstructed using AutoCAD 2016 to generate vectors from the point clouds; SketchUp Make 2016 is used to rebuild a complete building model with textures. To apply 3D building models in urban planning and design, a modern approach is to rebuild the digital models; however, replacing the landscape design and building distribution in real time is difficult as the frequency of building replacement increases. One potential solution to these problems is augmented reality (AR). Using Unity3D and Vuforia to design and implement the smartphone application service, a markerless AR of the building model can be built. This study is aimed at providing technical and design skills related to urban planning, urban designing, and building information retrieval using AR.

Design and Implementation of Markerless Augmented Reality Application for Cockroach Phobia Therapy Using Adaptive Threshold

Augmented reality (AR) technology is useful for treating several psychological problems, including phobias such as fear of flying, agoraphobia, claustrophobia, and phobia to insects and small animals. However, the currently existing applications for therapy of cockroach phobia that uses AR technology are still very dependent towards the presence of markers, which might lessen the feeling of being in an actual scenario from everyday lives. In this paper, we created a system that is able to use everyday things as a replacement for markers for phobia therapy for cockroach. There are five main processes: getting the live streaming feed from camera, preprocessing, extracting the center point of the objects, tracking the marker-substitute objects, and lastly, instantiating cockroaches randomly after user lifts the objects according to the number and mode of the cockroaches, whether it is moving or not, that are predetermined by the user. The evaluation in this paper includes eight participants that are carefully selected based on their Fear of Spiders Questionnaire (FSQ) score that is translated into Indonesian and modified to accommodate cockroaches instead of spiders. The results is that the system can induce anxiety level on participants with the highest score of 10, which is the highest score in Standard Unit of Discomfort scale (SUDs). While the presence and reality judgment of this paper has the highest score of 7 which is also the highest score in Slater-Usoh-Steed Questionnaire (SUS).

변형물체 시뮬레이션을 활용한 비 마커기반 증강현실 시스템 구현

변형물체 시뮬레이션을 활용한 비 마커기반 증강현실 시스템 구현

A diagrammatic framework for intuitive human robot interaction

This paper presents our framework for human robot interaction. The framework has been designed to allow non- experts to control and program complex robots in an intuitive way that is both reliable and accurate. The principle mechanism behind our model is Augmented Reality (AR), we use this to provide a diagrammatic service to the user, the service uses a range of diagrammatic markers including marker-less AR objects, which can be created and connected together and used to command and control the robot and engage in two way communications. We report on two case studies where our framework is applied to a set of command and control tasks, we measure performance across situation-awareness, task-completion-time and cognitive-load. Our results show that our model leads to greater situational awareness and improved task completion times, when compared to conventional interaction methods, such as a gamepad controller. Future work will integrate our model into multi-modal hybrids and extend the case studies to compare against other interaction methods.

Extended Tracking技術に基づく環境流れ問題のためのマーカーレスAR可視化システムの構築

本論文は，スマートデバイスを用いた環境流れ問題のためのマーカーレスAR可視化システムの構築を行ったものである．マーカーレスAR技術には，トラッキングのロバスト性を向上させたExtended Tracking技術を用いている．本システムの有効性を確認するため，構造物周辺の大気環境流れ問題および海上工事現場における水環境流れ問題を取り上げ，本システムの適用性について検討を行った．その結果，本システムは環境流れ問題のAR可視化ツールとしてロバスト性が高く有効であることが確認された．

Face Detection for Augmented Reality Application Using Boosting-based Techniques

Augmented reality has gained an increasing research interest over the few last years. Customers requirements have become more intense and more demanding, the need of the different industries to re-adapt their products and enhance them by recent advances in the computer vision and more intelligence has become a necessary. In this work we present a marker-less augmented reality application that can be used and expanded in the e-commerce industry. We take benefit of the well known boosting techniques to train and evaluate different face detectors using the multi-block local binary features. The work purpose is to select the more relevant training parameters in order to maximize the classification accuracy. Using the resulted face detector, the position of the face will serve as a marker in the proposed augmented reality.

LecceAR: An Augmented Reality App

This paper discusses a case study on the use of augmented reality (AR) within the context of cultural heritage. We implemented an iOS app for markerless AR that will be exhibited at the MUST museum in Lecce, Italy. The app shows a rich 3D reconstruction of the Roman amphitheater, which is nowadays only partially visible. The use of state-of-the-art algorithms in computer graphics and computer vision allows the viewing and the exploration of the ancient theater in real-time.

Marketing Communication Menggunakan Augmented Reality pada Mobile Platform

Augmented Reality is a technology that can project objects from the virtual world to the real world. Augmented Reality continues to be developed so it can be easy to implement into various devices. However, the device must have a camera, VGA card, and the ability to process data that is high enough to be able to process and projecting graphical data that captured by the camera and displayed to the screen. Marker-based Augmented Reality is still better than Markerless Augmented Reality due to several issues such as disturbances in the geomagnetic sensor that is used to map the Y axis and Z device that belongs to the user.

Object Detection for Markerless Augmentation using Haar Training

Computer Vision is a field that includes methods for acquiring, processing, analyzing, and understanding images and, in general, high-dimensional data from the real world in order to produce numerical or symbolic information etc[1]. As a highly scientific field, computer vision is concerned with the theory behind artificial systems that extract information from images involving image processing and object recognition. In our research we aim to explore this extensive domain of object recognition and image processing in terms of real time environment and deploy its application on various open source environments like Android. For achieving this we have incorporated a recently introduced Viola Jones, rapid object detection scheme based on a boosted cascade of simple features. For the object detection and recognition, we performed Haar Training on a set of positive and negative samples, which result in creation of Haar Cascade Classifier files in xml formats. These files are then used for detection. Post successful completion, the proposed project could also find its application in Markerless Augmented Reality as recent convergence of imaging sensors and general purpose processors on mobile phones creates an opportunity for a new class of augmented reality applications. Keywords: Computer Vision, Object Recognition, Viola Jones, Android, Haar Training, Haar Cascade Classifier, Markerless Augmented Reality