AbstractMany forward gradient schemes have been proposed for the time‐integration of the stiff constitutive equations of rate sensitive solids. It is shown here that one of these methods can be interpreted as a hybrid ordinary differential equation integrator which combines explicit and semi‐implicit Runge‐Kutta methods. This observation permits development of higher order schemes, illustrated here by one of second order. An embedded first order estimate provides a reliable step‐size control. The method is applied to an overstress model and to an internal variable model, and is used in a finite element analysis of hydrostatic bulging of sheet metal.