In order to enhance the survivability of fighter aircraft, it is crucial to develop microwave absorbing (MA) materials with a low dielectric-temperature dependence. Reduced graphene oxide (RGO) has potential for military stealth applications, but its wave absorbing properties are highly sensitive to temperature fluctuations due to significant conductivity loss. In this work, conductivity and polarization loss are balanced through microstructural design to disrupt the conductive pathways by creating holes on the graphene surface. The holey RGO aerogel/phenolic resin (HRGA/PF) composites with a hierarchical pore structure were synthesized through combining freeze-drying and PF infiltration. The results show that the HRGA/PF composites possess excellent X-band full frequency absorption performance in the temperature range of 25 °C–250 °C, and the reflection loss (RL) is optimized to −62.78 dB. This work expands feasible thoughts for the design of stable MA materials with wide temperature range.