Controlled cooling of H-beam after rolling, can change the microstructure consituent,improve the strength and improve the general mechanical property and service performance. According to actual product, the rational thermal boundary condition adopted, three dimensional FEM model is established. Spray cooling is used. Transient temperature field and stress field is simulated by the FEM software ANSYS/Multiphysics when H-beam is cooled. The four kinds of cooling scheme are designed. Through analysis of the relation of temperature field with stress field, the main reason of producing residual thermal stress is the section temperature difference in the cooling process of H-beam after rolling.