An adaptive time-frequency resolution framework for single channel source separation based on non-negative tensor factorization

Abstract

In this paper, we propose an adaptive time-frequency resolution based single channel sound source separation method using Non-negative Tensor Factorization (NTF). The model aims to alleviate drawbacks of working by fixed length Short Time Fourier Transform (STFT) by minimizing the smearing of signal energy in both time and frequency. A joint optimization scheme has been applied based on KL-divergence where each layer of the tensor represents the mixture at a different resolution. In order to enclose sparseness into factorization, the resynthesis is made through an adaptive weighted fusion procedure which combines the separated sources in a manner that maximizes the energy concentration. Test results reported over a large sound database indicate the introduced NTF based fusion method improves the sound quality both in terms of conventional and perceptual distortion measures.