Abstract The effect of fine-grained surface layers on the fatigue behavior of plain C–Mn steel plates is investigated. The plain C–Mn steel plates have been manufactured by a special thermo-mechanical controlled process (TMCP). For plates rolled by the special TMCP (designated special plates), the ferrite grain size approaches 5.5 μm in the surface layers and reaches 6.5 μm on average in the whole thickness of the plates, while for usually rolled plates (designated usual plates), the grain size is 15 μm on average in the whole thickness of the plates, without obvious difference between surface and central layers. Significant improvements of fatigue properties have been achieved by the ferrite grain refinement. Under the similar stress condition, the fatigue lifetime of the special plate is more than 10 times as long as that of the usual plate, and the first stage of fatigue crack propagation can be prolonged. With a similar lifetime of the usual plate under a load ratio R (σmin/σmax) approaching zero, the special plate can sustain a load 40 MPa higher than that of the usual plate. Furthermore, fatigue fractographs have been observed and analyzed by a scanning electron microscope (SEM).