Weak magnetic detection based on force-magnetic coupling effect is widely used in nondestructive testing of ferromagnetic materials, but the weak magnetic signals caused by the deformation of ferromagnetic materials under the action of external load show nonlinear changes, and the existing theories can not make a unified conclusion on the mechanism of nonlinear changes of magnetic signals, which limits the further application of weak magnetic detection. In this paper, a microscopic model of ferromagnetic material is established with the strain of the material as the independent variable. Firstly, the reasonableness of the established model is verified by the stress–strain relationship, and the stress concentration phenomenon generated by the change of the microscopic structure of the model is studied in depth by using the XRD diffraction method, so as to put forward the idea of characterizing the macroscopic stress with microscopic dislocations; secondly, the mechanism of the change of the magnetic signals of the ferromagnetic material caused by strain is analyzed by using the atomic magnetic moments and the density of states. The model explains the mechanism of strain-induced magnetic signal change in ferromagnetic materials, and has a guiding role in the further application and promotion of the weak magnetic method.