Audio steganography aims to exploit the human auditory redundancy to embed the secret message into cover audio, without raising suspicion when hearing it. However, recent studies have shown that the existing audio steganography can be easily exposed with the deep learning based steganalyzers by extracting high-dimensional features of stego audio for classification. The existing GAN-based steganography approaches mainly studied in images cover, less work is conducted on audio cover. In addition, though a few GAN-based audio steganography methods have been proposed, they still have room for improvements in perceptual quality and undetectability. In this work, we propose an audio steganography framework that could automatically learn to generate superior steganographic cover audio for message embedding. Specifically, the training framework of the proposed framework consists of three components, namely, generator, discriminator and trained deep learning based steganalyzer. Then the traditional message embedding algorithm LSBM, is employed to embed the secret message into the steganographic cover audio to obtain stego audio, which is delivered to the trained steganalyzer for misclassifying as cover audio. Once the adversarial training is completed among these three parties, one can obtain a well-trained generator, which could generate steganographic cover audio for subsequent message embedding. In the practice of our proposed method, the stego audio is produced by embedding the secret message into the steganographic cover audio using a traditional steganography method. Experimental results demonstrate that our proposed audio steganography can yield steganographic cover audio that preserves a quite high perception quality for message embedding. We have compared the detection accuracies with the existing audio steganography schemes as presented in our experiment, the proposed method exhibits lower detection accuracies against the state-of-the-art deep learning based steganalyzers, under various embedding rates. Codes are publicly available at https://github.com/Chenlang2018/Audio-Steganography-using-GAN.