3D-Model-Based Augmented Reality for Enhancing Physical Architectural Models

Abstract

In the presentation of architectural projects, physical models are still commonly used as a powerful and effective representation for building design and construction. On the other hand, Augmented Reality (AR) promises a wide range of possibilities in visualizing and interacting with 3D physical models, enhancing the modeling process. To benefit both, we present a novel medium for architectural representation: a marker-less AR powered physical architectural model that employs dynamic digital features. With AR enhancement, physical capabilities of a model could be extended without sacrificing its tangibility. We developed a framework to investigate the potential uses of 3D-model- based AR registration method and its augmentation on physical architectural models. To explore and demonstrate integration of physical and virtual models in AR, we designed this framework providing physical and virtual model interaction: a user can manipulate the physical model parts or control the visibility and dynamics of the virtual parts in AR. The framework consists of a LEGO model and an AR application on a hand-held device which was developed for this framework. The AR application utilizes a marker-less AR registration method and employs a 3D-model-based AR registration. A LEGO model was proposed as the physical 3D model in this registration process and machine learning training using Vuforia was utilized for the AR application to recognize the LEGO model from any point of view to register the virtual models in AR. The AR application also employs a user interface that allows user interaction with the virtual parts augmented on the physical ones. The working application was tested over its registration, physical and virtual interactions. Overall, the adoption of AR and its combination with physical models, and 3D-model-based AR registration allow for many advantages, which are discussed in the paper.