To solve the problems of insufficient samples and weak fault features of audio signals in the fault diagnosis of plunger pump, this paper proposes a fault diagnosis method of plunger pump based on audio signal combined with meta-transfer learning (MTL-PAFD). The method takes the audio signals of the plunger pump as samples, which are acquired by a single sensor. Through the Gammatone filter bank processing, the representation ability of the audio signal under strong noise interference is effectively improved. Then combined with meta-transfer learning, the few-shot fault diagnosis of plunger pump is realized. In addition, according to the actual needs of fault diagnosis of plunger pump, the test method of meta-transfer learning in fault diagnosis application is improved, which can process unknown fault classes adaptively. Experimental results show that MTL-PAFD has a fault diagnosis accuracy of 91.41% for seen classes. After fast adaptive learning, it can achieve an accuracy of 89.64% when identifying unseen fault classes.