Silica fume (SF) is an essential component in ultra-high-performance concrete (UHPC) to compact the matrix, but the nucleus effect also causes rapid hydration, which results in high heat release and large shrinkage. In this paper, the carboxylic agents, including polyacrylic acid and polycarboxylate superplasticizer, were used to surface modify SF to adjust the activity to mitigate hydration at an early time and to promote continuous hydration for a long period. The surface and dispersion properties of modified SF (MSF), as well as the strength and pore structure of UHPC, were studied, and the stability of the modification was also investigated. The results demonstrated that, after treatment, the carboxylic groups were grafted on the SF surface, the dispersion of SF was improved due to the increased negative pentanal of the particle surface and the steric hindrance effect, the early hydration was delayed about 3-5 h, and the hydration heat release was also mitigated. The compressive strength of UHPC with MSF reached a maximum of 138.7 MPa at 3 days, which decreased about 3.7% more than the plain group, while flexural strength varied insignificantly. More pores and cracks were observed in the matrix with MSF, and the hydration degree was promoted with MSF addition. The grafted group on SF fell off under an alkali environment after 1 h.