The goal of this research is to improve the mechanical characteristics and durability of concrete while adhering to green and sustainable development principles. Portland cement (PC) was replaced with ceramic waste powder (CWP), glass powder (GP), and granite waste powder (GWP) to create the low-carbon, high-strength concrete (HSC). These materials were incorporated at 0–50% as a partial replacement of PC. The short alkali-resistant (AR-) glass fiber content was added by 1.0% of the PC content. The changes in strength, microstructure, pore structure, as well as ecological assessment of HSCs was investigated. Various experiments on the durability properties and elevated temperature resistance of HSC were performed. The experimental results show that mechanical properties of HSC with 10%GP and 20%GWP were maximally enhanced at 28d, while the mechanical properties of HSC with 50% of all wastes are decreased. It was found also that HSC containing CWP showed significant reductions in carbonation depth (up to 65.89% lower than the control mixture), especially at higher replacement levels. Furthermore, the increment in substitution level of CWP has found an increment in pore volume, resulting in a reduction in preliminary strength performance. It was observed that a 50% substitution level of GP and GWP reduced the water penetration depth by 47.71% and 65.7% compared to the control mixture, respectively. The residual strength after 600 °C exposure for 10%CWP, 10% GP, and 20% GWP retained about 34.10%, 32.32%, and 43.29%, respectively, from their original strength. XRD tests and SEM micrographs showed that adding 10%GP and 20%GWP improve the hydration reactions. Finally, environmental assessments revealed that incorporating CWP, GP, and GWP into HSC led to reduced costs, energy consumption, and carbon footprint.