Abstract

Abstract. HoloLens 2 is a state-of-the-art of Mixed Reality device that can augment the natural environment with virtual content in the form of holograms. Spatial mapping is the capability of the device to scan the environment and provide the user with a detailed 3D mesh model representation of its surroundings. The device can place holograms about real-world objects, perform occlusions and simulate physical interactions only having the geometric knowledge of its operating environment. HoloLens 2 mapping capabilities have been extensively tested. Nevertheless, no test was performed on monumental heritage buildings, where dimensions far exceed the typical sensor working range of the device. The authors want to evaluate the capability of the device to map monumental spaces. In these environments, dimensions, repetition of elements and heterogeneity of areas provide a real challenge for out-of-the-box Microsoft localization and mapping algorithms. The test case will be Milan Cathedral, inside the research project to build an MR application to help and enhance the systematic and planned maintenance intervention and inspections. Mapping capabilities have been tested in very different spaces: i) the south nave; ii) the empty volumes between the internal vaults and the external roof ("Sordine"); iii) the narrow spiral staircase connecting the south nave with the roofs lower level.

Highlights

  • HoloLens 2 (Microsoft, 2020) is a state-of-the-art of Mixed Reality (MR) device that can augment the natural environment with virtual content in the form of holograms

  • After carefully scanning all ambiences, 3D mesh models are compared against ground truth point cloud data produced during the survey activities performed inside the monument

  • The instrument proved very effective in building an accurate local spatial map (3D mesh model) in all test areas

Read more

Summary

Introduction

HoloLens 2 (Microsoft, 2020) is a state-of-the-art of Mixed Reality (MR) device that can augment the natural environment with virtual content in the form of holograms. Mixing digital and natural allows increasing knowledge, understanding, and collaboration in long-term, complex and cooperative projects. This type of situation is typical of Cultural Heritage (CH) world that can benefit from mixed reality technology both for dissemination and professional practices. Localizing information and registering referenced operations can be very useful to facilitate collaborations in the maintenance processes creating a 1:1 information system directly connected with the natural object and directly usable in the yard. This is achieved with an acceptable registration between the natural world and the displayed 3D model. This alignment process is possible thanks to different sensors with which the device is provided (Figure 1)

Methods
Discussion
Conclusion

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.