Phosphogypsum-based materials have gained much attention in the field of road infrastructure from the economic and sustainable perspectives. The Three-point bending test, the Four-point bending test and the Semi-circular bending test are three typical test methods applied for fracture energy measurement. However, the optimal test method for fracture energy evaluation has not been determined for phosphogypsum-based materials. To contribute to the gap, this study aims to analyze and compare the three test methods for fracture energy evaluation of phosphogypsum materials based on the peridynamic theory. For this purpose, the load–displacement, vertical displacement–Crack Mouth Opening Displacement (CMOD) and fracture energy of the phosphogypsum-based materials were measured and calculated from the three test methods. The simulated load–displacement and vertical displacement–CMOD by PD numerical models, with different fracture energy as inputs, were compared to the corresponding tested values according to simulation error results. The results showed that the Four-point bending test led to minimized errors lower than 0.189 and indicators lower than 0.124, demonstrating the most optimal test method for the fracture energy measurement of phosphogypsum-based material. The results of this study can provide new methodological references for the selection of material fracture energy measurement tests.