The fatigue performance evaluation indices of Buton rock asphalt (BRA) modified asphalt mixture struggles to accurately characterize damage evolution process under repeated loads of the traffic. This study employs digital image correlation (DIC) technology to assess the fatigue behavior of BRA modified asphalt mixture, quantify the correlation between macroscopic response and local deformation, and verify the accuracy of evaluation indices. By capturing strain and displacement fields, the fatigue damage evolution of BRA modified asphalt is analyzed. Based on fracture mechanics theory, BRA’ s improvement of fatigue performance is quantified. Results show that vertical displacement captured by DIC can divide the three stages of fatigue cracking. The global horizontal strain(GExx)and cumulative horizontal strain(CExx) proposed in this study better characterize the nonlinear fatigue damage evolution compared to horizontal strain(Exx). Adding BRA delays crack initiation, reduces propagation rate, and enhances fatigue performance. Strain field evolution was quantitatively analyzed, and horizontal strain density(DE) and global horizontal strain density(GDE) were proposed as fatigue damage indicators. At the same load level, these indicators in BRA modified asphalt mixture, both pre- and post-aging, exceeded those of neat asphalt mixture. These findings provide a novel and accurate approach for evaluating the fatigue damage behavior of BRA modified asphalt mixture, laying the foundation for future performance-based designs.