This paper focuses on electromagnetic vibration analysis of the permanent magnet vernier machine (PMVM) and aims to reduce electromagnetic vibration of the PMVM. Firstly, we analyze the magnetic field and radial force of the PMVM by FEM and analytical method. The results show that the 2 <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">nd</sup> radial force at 2 <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">f</i> <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">e</sub> can generate serious electromagnetic vibration. Then, an unequal stator modulated teeth structure is proposed to reduce the 2 <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">nd</sup> radial force to reduce the electromagnetic vibration. And we compare the electromagnetic performance of the proposed PMVM with that of the original PMVM. The results show that the electromagnetic performance of the proposed PMVM is not influenced. What is more, we adopt the modal and the electromagnetic vibration analysis of the original PMVM and the proposed PMVM. The results indicate that the proposed PMVM can reduce electromagnetic vibration. Finally, we manufacture the prototype to verify the previous analysis results, the results of theoretical analysis and finite-element method are verified by the prototype test.