Visualizing sound pressure distribution by kinect and microphone array

Abstract

This paper describes a method of visualizing sound pressure distribution by combining microphone array processing with camera image processing. In microphone array signal processing, sound at a desired position can be achieved by the Delay and Sum Beam Forming(DSBF). In camera image processing, Measuring the 3D position of a sound source is achieved by triangulation method with Kinect for Xbox. We calculate sound pressure level based on sound signal by forming direction at measured position by camera image processing. In order to visualize sound pressure distribution, we draw up sound pressure distribution based on calculated sounds level. we conducted to three experiments. first experiment is conducted to confirm forming direction at desired position by DSBF second experiment is conducted to confirm that we correctly measure 3D position of sound sources by Kinect third experiment is conducted to confirm that we correctly measure sound pressure level in environment where there are sound sources for visualizing sound pressure distribution.