Fine particulate matter (PM2.5) is a risk factor of cardiovascular disease. Associations between PM2.5 compositions and cardiovascular disease are a point of special interest but inconsistent. This study aimed to explore the cardiovascular effects of heavy metal(loid) compositions in PM2.5. Data for mortality, air pollutants and meteorological factors in Anyang, China from 2017 to 2021 were collected. Heavy metal(loid) in PM2.5 were monitored and examined monthly. A Case-crossover design was applied to the estimated data set. The interquartile range increase in cadmium (Cd), antimony (Sb) and arsenic (As) at lag 1 was associated with increment of 8.1% (95% CI: 3.3, 13.2), 4.8% (95% CI: 0.2, 9.5) and 3.5% (95% CI: 1.1, 6.0) cardiovascular mortality. Selenium in lag 2 was inversely associated with cerebrovascular mortality (RR = 0.920 95% CI: 0.862, 0.983). Current-day exposure of aluminum was positively associated with mortality from ischemic heart disease (RR = 1.083 95% CI: 1.001, 1.172). Stratified analysis indicated sex, age and season modified the cardiovascular effects of As (P < 0.05). Our study reveals that heavy metal(loid) play key roles in adverse effects of PM2.5. Cd, Sb and As were significant risk factors of cardiovascular mortality. These findings have potential implications for accurate air pollutants control and management to improve public health benefits.