A Self-Attentional ResNet-LightGBM Model for IoT-Enabled Voice Liveness Detection

Abstract

Voice user interface (VUI) brings high efficiency and convenience for the applications of Internet of Things (IoTs), meanwhile, it can also cause increasingly serious security issues. The word-level voice liveness detection is proved to be the promising solution to thwart spoofing attacks. However, The complex acoustic feature, diversified attacks, and different interaction distance can severely affects the improvement of detection accuracy. To alleviate this issue, we develop a novel pop noise based word-level voice liveness detection framework. Firstly, a new voice frame selection method is proposed for determining optimal frames, including short time Fourier transform, low frequency average energy computation and sequencing. Then, the acoustic features of the selected frames are calculated by Gammatone frequency cepstral coefficient (GFCC). Finally, based on these features, a newly-built joint voice detector, fusing the self-attentional residual network (ResNet) and light gradient boosting machine (LightGBM), can achieve accurate voice classification. On the popular voice spoofing attack datasets, experimental results show that our proposal significantly outperforming the baseline and the state of the arts models, and it is gender dependent. Moreover, our proposal has good generalization ability for far-field replay voice attack, speech synthesis and voice conversion attacks, and partial fake voice attack. Finally, its effectiveness is verified by the ablation study.