Abstract
Abstract. Mobile Augmented Reality (MAR) attracts significant research and development efforts from both the industry and academia, but rarely integrate massive 3D dataset’s interactions. The emergence of dedicated AR devices and powerful Software Development Kit (ARCore for android and ARKit for iOS) improves performance on mobile devices (Smartphones and tablets). This is aided by new sensor integration and advances in computer vision that fuels the development of MAR. In this paper, we propose a direct integration of massive 3D point clouds with semantics in a web-based marker-less mobile Augmented Reality (AR) application for real-time visualization. We specifically investigate challenges linked to point cloud data structure and semantic injection. Our solution consolidates some of the overarching principles of AR, of which pose estimation, registration and 3D tracking. The developed AR system is tested on mobile phones web-browsers providing clear insights on the performance of the system. Promising results highlight a number of frame per second varying between 27 and 60 for a real-time point budget of 4.3 million points. The point cloud tested is composed of 29 million points and shows how our indexation strategy permits the integration of massive point clouds aiming at the point budget. The results also gives research directions concerning the dependence and delay related to the quality of the network connection, and the battery consumption since portable sensors are used all the time.
Highlights
Mobile augmented reality essentially consists of superimposing virtual elements over real objects on the screen, to give added information and enrich the interaction with reality
Web-based augmented reality remains very dependent on the internet, but it allows outsourcing of the computation that are on a remote server, and of data that is stored on a server
We have reviewed the story of augmented reality and its mechanisms while showing different Web-Augmented Reality (AR) implementation approaches
Summary
Mobile augmented reality essentially consists of superimposing virtual elements over real objects on the screen, to give added information and enrich the interaction with reality. Several AR applications exploiting 3D data are appearing such as the projection of 3D mesh catalogues of furniture in real set ups (Khairnar et al, 2015; Şahin and Togay, 2016). These 3D models are often very constrained (availability, complexity, time for production) to permit an experience that depends on the available resources of the used device. The semantic information - essential to allow pure geometries to be usable by decision-making systems (Poux et al, 2018; Poux and Billen, 2019) - is often inexistent or unused
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callMore From: The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
