The challenges posed by electromagnetic waves (EMW) cause significant interference in electronic device operation, jeopardizing information security and disturbing normal biological functions, which necessitate attention. Multi-scale carbon/cement-based composites were developed for EMW absorption by integrating multi-dimensional carbon materials, including carbon nanotubes (1D), graphene (2D), and modified carbon microspheres (3D). These composites demonstrate exceptional EMW absorption capabilities, with a minimum reflection loss (RLmin) of −44.32 dB and an effective absorption bandwidth (EAB) of 3.644 GHz at X band, merely having a thickness of 1.90 mm. Furthermore, the superior EMW absorption properties of these composites are confirmed through radar cross-section (RCS) simulation and electric field distribution analysis. A small house is constructed of designed three-layer multi-scale carbon/cement-based composites in which the actual EMW reflection losses are less than –10 dB within the whole test frequency range, and these composites can effectively obstruct 5 G mobile phone signals. Therefore, multi-scale carbon/cement-based composites could be promising candidates for effectively solving the increasingly serious problem of electromagnetic radiation pollution.