Vibration isolators with quasi-zero stiffness (QZS) perform well for low- or ultra-low-frequency vibration isolation. This paper proposes a novel dual-parallelogram passive rocking vibration isolator with QZS that could effectively attenuate in-plane disturbances with low-frequency vibration. First, a kinematic model of the proposed vibration isolator was established and four linear spring configuration schemes were developed to implement the QZS. Next, an optimal scheme with good high-static-low-dynamic stiffness (HSLDS) performance was obtained through comparison and analysis, and used as a focus for the QZS model. Subsequently, a dynamic model-based Lagrangian equation that considered the spring stiffness and damping and the influence of the payload gravity center on the vibration isolation system was developed, and an average approach was used to analyze the vibration transmissibility. Finally, the prototype and test system were constructed. A comparison of the simulation and experimental results showed that this novel passive rocking vibration isolator could bolster a heavy payload. Experimentally, the vibration amplitude decreased by 53% and 86% under harmonic disturbances of 0.08 Hz and 0.35 Hz, respectively, suggesting the great practical applicability of this presented vibration isolator.