Hydronic thermal barriers with ultra-low carbon emission attributes are progressively gaining prominence in the competition of thermal insulation solutions for opaque envelopes of low-energy buildings due to their excellent thermal performance and low-grade energy utilization potential. This paper introduces a novel approach involving a modular hydronic thermal barrier wall (MHTB) that incorporates preset pipe cavities and replaceable filling material. This proposition seeks to address the challenges confronted by conventional hydronic thermal barrier walls (CHTBs), specifically in terms of internal heat transfer enhancement and rapid assembly/dismantling. On-site thermal performance tests and energy-saving evaluations were conducted in summer conditions based on three scaled-down rooms with MHTB, CHTB and a conventional external insulation wall as the south walls. The results showed that the MHTB could significantly reduce heat passing through the south wall in summer, resulting in a decreased cooling load attributed to the wall and subsequently lowering indoor temperatures. At a charging temperature of 17.0 °C, the MHTB exhibited a reduction of 11.3 °C in interior surface temperature compared to the conventional external insulation wall, accompanied by a corresponding increase of 2.76 kWh·m−2 in cumulative heat flux. In addition, the MHTB could effectively mitigate inhomogeneous heat transfer within the wall, enhancing the overall heat transfer effect. Across the four investigated conditions, the MHTB with a steel grit-sand mixture as the filling material demonstrated an approximate 4.7% increase in cumulative heat flux and a 12.2% enhancement in cumulative cooling quantity compared to the CHTB. Overall, the findings substantiated the efficacy of the MHTB system and offered a crucial point of reference for advancing research in optimizing the performance and modular construction of hydronic thermal barrier walls.