Carbon fibers (Cf) materials with excellent dielectric loss are increasingly attracting attention in the field of microwave absorption. However, the inherent high conductivity of carbon materials usually causes impedance mismatch, which seriously limits their widespread applications in the field of electromagnetic wave (EMW) absorption. To solve this problem, a highly ordered SiC nanofiber@C fiber (SiCnf@Cf) heterojunction hybrid with a fuzzy grass-like structure was fabricated through a simple chemical vapor deposition (CVD) method. Providing a heterogeneous interface on the surface of carbon fibers not only improves their impedance matching capability but also enhances their interfacial loss capability. As a result, a minimum reflection loss (RLmin) for SiCnf@Cf heterojunction hybrid is −44.04 dB at 13.6 GHz with a thickness of 1.2 mm, and a maximum effective absorption bandwidth (EABmax) is 3.44 GHz with a thin thickness of 1.1 mm. Furthermore, it also exhibits outstanding thermal insulation performance, which make it a potential candidate for heat-insulating applications. And due to its lightweight and soft characteristics, it perfectly meets the needs of wearable flexible absorbing materials. Therefore, this study not only provides a straightforward for preparing EMW-absorbing materials with exceptional performance, but also offers a solution for improving the thermal stability of the carbon-based material.