We investigate a physical characterization of the gradient flow structure of variational fracture models for brittle materials: a Griffith-type fracture model and an irreversible fracture phase field model. We derive the Griffith-type fracture model by assuming that the fracture energy in Griffith's theory is an increasing function of the crack tip velocity. Such a velocity dependence of the fracture energy is typically observed in polymers. We also prove an energy dissipation identity of the Griffith-type fracture model, in other words, its gradient flow structure. On the other hand, the irreversible fracture phase field model is derived as a unidirectional gradient flow of a regularized total energy. We have considered the time relaxation parameter a mathematical approximation parameter, which we should choose as small as possible. In this research, however, we reveal the physical origin of the gradient flow structure of the fracture phase field model (F-PFM) and show that the small time relaxation parameter is characterized as the rate of velocity dependence of the fracture energy. It is verified by comparing the energy dissipation properties of those two models and by analysing a travelling wave solution of the irreversible F-PFM. This article is part of the theme issue 'Non-smooth variational problems with applications in mechanics'.