Augmented Reality for 3D House Design Visualization from Floorplan Image

Abstract

Smartphones currently support the augmented reality feature, capable of displaying virtual objects into the real world environment at a specific location designated with a marker. This research develops an augmented reality application on a smartphone to visualize a 3D house design. The floorplan image captured by the smartphone camera is designated as a marker and then sent to the server. The server-side application, built using deep learning and integer programming techniques, detects corner positions on the image and produces a vector containing 2D coordinates. The client application on the smartphone uses the 2D coordinates to draw a 3D house model using Unity 3D. The model is then added over the floor plan image marker using Vuforia. Based on the test results, the 3D house models can be drawn according to the provided floorplan with moderate accuracy. The augmented reality application offers an alternative approach to examine a floorplan so that a user can better understand and engage with the design.