To explore aortic stiffness measured by carotid femoral-pulse wave velocity (cf-PWV) at different stages of normal glucose, prediabetes, and diabetes mellitus (DM). The literature comparing aortic stiffness (AS) with cf-PWV between DM and non-DM samples was systematically retrieved from Pubmed, Ovid Medline, Web of Science, Embase, Scopus, CNKI, and Wanfang databases. The Newcastle-Ottawa Scale was used to assess the quality of the literature. The primary endpoint was the mean difference (MD) of cf-PWV between the normal glucose and DM samples and normal glucose and prediabetes samples. The secondary endpoints were the MD of carotid intima-media thickness (cIMT) and carotid-radial pulse wave velocity (cr-PWV). Aggregated MD and 95% confidence intervals were calculated. When the I2 value was >50% or p < 0.01, the heterogeneity was considered large, and the random-effect model was used; otherwise, the fixed-effect model was used. A sensitivity analysis was conducted to identify the source of heterogeneity, and a funnel plot and the regression Egger test was utilized to assess the publication bias. A total of 37 studies were finally enrolled. Samples with DM had a higher cf-PWV value and cIMT value than those without DM, and the differences were statistically significant. The cr-PWV measurements tended to be higher in the DM group than in the non-DM group, but the difference was not significant. Samples with prediabetes also had a significantly higher cf-PWV value than samples with normal glucose. Samples with DM and prediabetes were associated with a higher cf-PWV value, indicating that DM patients had a higher central AS. Central AS progresses at the prediabetes stage. These data provide insight into understanding the mechanism of adverse effects of DM and prediabetes on artery stiffness.