Microwave-absorbing materials are very important to reduce electromagnetic interference and pollution. Combining multi-component materials with multiple loss mechanisms is a practical strategy for enhancing microwave absorption performance. In this work, we synthesize a magnetic poly(ionic liquid) (PVim[FeCl4]) with crosslinkable groups and prepare PVim[FeCl4]/graphene oxide (GO)/Fe3O4 composites by incorporating GO and Fe3O4 to enhance the microwave absorption property of the composites. The synergistic effect of GO and Fe3O4 is studied at different feeding ratios, the PVim[FeCl4]/10%GO/20%Fe3O4 composite shows better microwave absorption performance, with a minimum reflection loss (RLmin) of −49.54 dB at 17.31 GHz and 7.1 mm thickness, along with an effective absorption bandwidth (EAB) of 2.52 GHz. This enhancement can be attributed to the quarter-wavelength matching model, well-matched characteristic impedance, and multiple loss mechanisms originating from PVim[FeCl4], GO, and Fe3O4. The magnetic poly(ionic liquid) composites show promising prospects in microwave absorbing materials.