As a kind of novel magneto-sensitive smart soft material, magnetorheological plastomers (MPPs) have great application potential in the areas of absorber, damper and sensor. In this work, the mechanical behaviors of MRPs under several different varying magnetic fields were studied. The viscoelastic characteristic of the MRPs was seriously depended on the type of external magnetic field. A linearly changed magnetic field would cause the increase of zero field storage modulus ΔG0′ of MPRs for about 1 MPa, which would severely reduce the magnetorheological effect of MRPs (from 500% to 50%). The direction of the external magnetic field had no influence on the variation of G0′. While under the square wave magnetic field, no variation of the magnetic storage modulus was found when the external magnetic field was removed. A particle-level dynamics simulation was performed to observe the microstructure evolution of the MRP sample under different magnetic loading model. And a possible mechanism was proposed to explain the different residual storage modulus of the MRPs sample under different magnetic loading mode. The discovery would contribute to enhance the regulatory capacity of the MRP material in the application of the smart device.