In this study, a one-pot aryl diazonium reaction was used as a simple and mild method to graft graphene onto the smooth and inert surface of T1100-grade carbon fiber (CF) through covalent bonding without any damage on CF, to refine the interface performance of CF/bismaleimide (BMI) composites. XPS, SEM, AFM, and dynamic contact angle testing (DCAT) were used to characterize chemical activity, morphologies, and wettability on untreated and grafted CF surfaces. Meanwhile, the impact of the graft method on the tensile strength of CF was also examined using the monofilament tensile test. IFSS between CF grafted with graphene and BMI resin achieved 104.2 MPa after modification, increasing from 85.5 MPa by 21.8%, while the tensile strength did not decrease compared to the pristine CF. The mechanism of this interface enhancement might be better chemical bonding and mechanical interlock between CF grafted with graphene and BMI resin, which is generated from the high surface chemical activity and rough structure of graphene. This study may propose a simple and mild method to functionalize the CF surface and enhance the interface performance of composites without compromising the tensile properties of T1100-grade CF.