Vibration analysis of drum membrane using computer vision

Abstract

The real time experience of what one sees and what one hears is enriching but if one can visualize what is audible will be fascinating. We suggest a simpler approach for sound localization that directly collects motion signals based on visual movements. In this study, frequency has been detected at various location of drum using computer vision method. A smartphone camera set up on a tripod next to the drum has captured these vibrations at approximately 240 frames per second. To determine the frequency, a Fourier analysis was performed on the data collected from the frames. We detected frequency of ~94 Hz at multiple spots by analyzing the motions of a point or region of interest (ROI) at membrane of drum. The frequency of drum membrane detected by a mobile microphone was found to be equivalent to the frequency observed using the proposed computer-vision method. Similar concepts can be employed in understanding the fundamentals of sounds generated by various musical instruments.