Mixed Reality visualization of sound field using the room impulse responses modeled by room geometry and physical model

Abstract

For room acoustic design and detecting noise problems, the sound field visualization is useful to understand sound propagation in a room. In our previous study, we proposed the Mixed Reality (MR) visualization system for steady sound field with mapping the three-dimensional sound intensities measured by moving a microphone array. To visualize the transient sound field, time-synchronization of multi-point measurements is required. However, the measurement time for the transient sound field becomes significantly larger compared to the stationary sound field. In this study, we proposed the Mixed Reality visualization of sound propagation based on sound field modeling. From smaller measured data, we estimate the transient sound field by spatial interpolation based on the equivalent sound sources and room shape acquired by Simultaneous Localization and Mapping. The estimation results were visualized by MR technology using Microsoft HoloLens2.