An improved model based on the Chaboche constitutive model is proposed for cyclic plastic behavior of metal and low cycle fatigue of notched specimens under cyclic loading, considering the effect of strain gradient on nonlinear kinematic hardening and hysteresis behavior. The new model is imported into the user material subroutine (UMAT) of the finite element computing software ABAQUS, and the strain gradient parameters required for model calculation are obtained by calling the user element subroutine (UEL). The effectiveness of the new model is tested by the torsion test of thin copper wire. Furthermore, the calibration method of strain gradient influence parameters of constitutive model is discussed by taking the notch specimen of Q235 steel as an example. The hysteresis behavior, strain distribution and fatigue failure of notched specimens under cyclic loading were simulated and analyzed with the new model. The results prove the rationality of the new model.