Although the dumping of waste generated by industries in the environment poses a hazard, it is feasible to use waste and unused materials to manufacture high-performance concrete. By recycling these wastes in binary and ternary blends, sustainable and durable concrete mixtures can be created, resulting in the development of sustainable concrete structures. Therefore, a research project was undertaken to develop high-performance concrete (HPC) using available supplementary and waste materials, such as fly ash (FA), silica fume (SF), Quartz filler (QF), and limestone powder (LSP), as partial replacements for cement in binary and ternary blends under various curing conditions. Different percentages (5, 8, 10, 15, 20%) of the supplementary materials were mixed in binary and ternary combinations to determine the optimal dosage for high-performance concrete. The fresh and hardened properties of the concrete were evaluated using various tests, including slump, compressive strength, rapid chloride ion permeability, porosity, and drying shrinkage tests. The prepared concrete specimens were tested using various concentrations of binder replacement in binary, ternary, and quaternary combinations. The results showed that incorporating quartz filler as a partial replacement of cement up to 8% yielded positive results regarding mechanical properties. However, all mixtures containing different dosages of SF, QF, FA, and LSP demonstrated significant improvement in durability-related properties under normal and high-temperature curing conditions. Interestingly, the porosity of mixtures incorporating fly ash and LSP showed a slight increase compared to identical specimens under normal curing conditions. Moreover, the drying shrinkage behavior of ultrafine fillers (QF, SF, LSP, FA) indicated that their incorporation led to an increase in the shrinkage of high-performance mixtures under normal and high-temperature curing conditions. Binary and ternary blends incorporating QF, LSP, and SF showed an increase of around 5–8% in shrinkage under high-temperature curing compared to identical specimens under normal curing conditions. Therefore, it can be concluded that QF, LSP, SF, and FA can be efficiently used to produce high-performance cementitious composites, leading to sustainable concrete material.