This study has proposed a fault diagnosis system based on vibration detection. The system mainly includes four modules: signal acquisition module, signal processing module, state identification module, fault diagnosis and alarm module. The system uses CMSS 2200 acceleration sensor to collect vibration signals, processing spectrum with FFT (Fast Fourier Transform) which is used effectively in current industry and finally achieve fault diagnosis and prediction for diaphragm pump. Through collection and analysis of the history signal data, set threshold value in the fault diagnosis system. According to the characteristics of different types, set the corresponding effective threshold value. The simulation results show that, the spectrum after FFT transformation processing, can really and effectively reflect equipment operating condition of the diaphragm. This system is not only simple and stable, but also can predict pump failure effectively, so that it reduces equipment downtime, plan maintenance time and unplanned maintenance time.