Various reliability surrogate measures have emerged over the last three decades to design water distribution systems. However, existing comparative studies cannot assess surrogate measures from the resilience perspective considering the dynamic absorption–recovery process imposed by pipe failures. In this work, we propose a novel benchmark framework based on the global resilience analysis to examine surrogate measures’ performance. Surrogate measures were compared via the stress–strain curve derived from the global resilience analysis under extended period simulation. In particular, we identify the comparable stress range to articulate the differences among surrogate measures and significantly reduce the computational burden. Then, we develop the normalized resilience score (NRS) to evaluate the quality of solutions to network design. Five well-known measures are compared for the multiobjective design of two benchmark networks. Results show that the Network Resilience Index achieves 2.5% to 10.1% better NRSs than the mean NRSs over five surrogate measures, implying that both nodal surplus energy and pipe diameter uniformity greatly impact the network system’s resilience. The uniformity of pipe diameters is more significant than the uniformity of flow rate. Our findings contribute to the design of new and better surrogate measures for network resilience evaluation.