This study evaluates the impact of hydrated lime (HL) on the cracking performance at intermediate temperature of asphalt-filler mastics, specifically as a partial replacement for limestone filler (LF). HL, is an active filler known for its multiple benefits in asphalt applications. The Double Edge Notched Tension (DENT) test was used to assess fracture properties, including specific total work of fracture, plastic work of failure, essential work of fracture, and average critical tip opening displacement. The results revealed several key findings: a notable loss of ductility and toughness with increasing HL dosages, a stiffening effect evidenced by increased peak loads and reduced failure deformation, and a decrease in the specific total work of fracture, indicating a loss of fracture energy. However, an enhancement in fracture resistance to plastic deformation is observed with HL addition, although identifying trends at high dosages remains challenging due to complex interactions between HL and LF. Furthermore, using low volumetric concentrations of HL minimizes the adverse impact on fracture performance while leveraging its other beneficial active filler properties. These findings suggest that while HL can improve certain fracture properties, optimal dosages are crucial to avoid adverse effects. Overall, this paper provides an updated and comprehensive study of the fracture of mastics at intermediate temperatures, which adds up to the understanding of asphalt-filler interactions, which can potentially lead to further investigations, such as how the partial replacement of LF with HL affects asphalt mixtures’ performance-related characteristics, particularly the fatigue cracking resistance.