Abstract
This paper discusses a method for multiple fundamental frequency (F0) tracking performed on a polyphonic mixture of musical instruments with dissimilar timbres recorded on a single monaural track. For each time frame, given a number of possible F0 candidates, F0 trajectories are extracted using an HMM-like method where observations are the input spectra and each F0 candidate is represented by one of the hidden states. The F0 trajectories are optimized according to a harmonic overlap score for each F0 candidate and a continuity score that is based on a distance between the F0 candidate’s harmonic amplitudes and frequencies calculated for all possible candidate pairs at successive adjacent frames. This step leads to the formation of note tracks. In a second step, instrument identification is performed on harmonic spectra associated with these note tracks to group similar timbres together. The method is demonstrated with an acoustic audio recording of a woodwind quintet. Applications include audio-to-MIDI conversion, instrument/voice separation, and automatic music transcription. F0 tracks can also be used as high level features for music information retrieval systems.
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
