Federated Learning based Audio Semantic Communication over Wireless Networks

Abstract

In this paper, the problem of audio based semantic communication is investigated over wireless networks. In the considered model, wireless edge devices must transmit large-sized audio data to a server using semantic communication techniques. The techniques enable the transmission of audio semantic information which captures the contextual features of audio signals. To extract the semantic information from audio signals, a wave to vector (wav2vec) architecture based autoencoder that consists of convolutional neural networks (CNNs) is proposed. The proposed autoencoder enables high-accuracy audio transmission with small amounts of data. To further improve the accuracy of semantic information extraction, federated learning (FL) is implemented over multiple devices and a server. Simulation results show that the proposed algorithm can converge effectively and can reduce the mean square error (MSE) between the recovered audio signals and the source audio signals by nearly 100 times, compared to a traditional coding scheme.