Abstract Acoustic metamaterials are capable of generating vibration bandgaps at specific frequency ranges, which makes them have good applications in the field of vibration isolation. To further broaden the vibration bandgaps, both magnetorheological elastomer (MRE) and graded stiffness are employed to enhance the bandgap properties. However, lowering the vibration bandgap is usually accompanied with excessive reduction of the structure stiffness. Except for reducing the stiffness, increasing the mass of the acoustic metamaterial can also lower the bandgap. In this research, a novel inerter-based acoustic metamaterial MRE isolator (IAM-MREI) was designed and prototyped. Inerters not only can generate large equivalent mass, but also are discovered to be able to greatly lower and broaden the vibration bandgap of the IAM-MREI with a brand-new mechanism, which cannot be achieved only with extra equivalent mass. The effects of the inerters on the overall performance of the IAM-MREI was thoroughly investigated and validated both theoretically and experimentally. The evaluation experiments confirmed that the IAM-MREI possesses a low frequency vibration bandgap and can provide great vibration isolation performance.