To assess the associations of ambient specific-size PM with brachial-ankle pulse wave velocity (baPWV) and the progression of arterial stiffness. Participants were included from the Kailuan study, the cross-sectional study involved 36,486 participants, while the longitudinal study enrolled 16,871 participants. PM exposures was assessed through satellite-based random forest approaches at a 1 km resolution. Initial observations indicated a link between baseline baPWV and heightened levels of PM1, PM2.5, and PM10 exposure, and greater effects were observed for PM1 (β: 22.52, 95% CI: 18.14–26.89), followed by PM2.5 (β: 9.76, 95% CI: 7.52–12.00), and PM10 (β: 8.88, 95% CI: 7.32–10.45). Furthermore, the growth rate of baPWV was higher in participants exposed to high levels of PM1 exposure (β: 2.77, 95% CI: 1.19–4.35), succeeded by PM2.5 and PM10. Throughout a median follow-up period of 4.04 years, arterial stiffness was diagnosed in 1709 subjects. Long-term exposure to PM was linked with an increased risk of incident arterial stiffness, estimated HR for fixed 10 µg/m3 increments in annual average PM1 was 2.20 (95% CI: 2.01–2.42), PM2.5 was 1.48 (95% CI: 1.41–1.55), and PM10 1.32 (95% CI: 1.27–1.36). PM had a greater impact on men and older individuals (P for interaction <0.001). Long-term exposures to ambient PM1, PM2.5, and PM10 were positively associated with baPWV and an increased risk of arterial stiffness. Higher estimated effects were observed for PM1 than PM2.5 and PM10.