This study aimed to compare the association between fasting plasma glucose (FPG) and glycosylated hemoglobin A1c (HbA1c) levels using the second derivative of photoplethysmogram (SDPTG) index and the cardio-ankle vascular index (CAVI). Electronic medical records of 276 participants (160 men, 116 women) who visited the health promotion center of a university hospital were examined. Age, sex, body mass index (BMI), blood pressure, and lipid profile were considered as risk factors for arterial stiffness, together with the FPG, HbA1c, CAVI, and SDPTG indices. Hierarchical regression models were constructed, and all participants were divided into low-normal, high-normal, prediabetic, and diabetic groups to examine the group-based differences in CAVI and SDPTG indices. FPG and HbA1c were independently predictive of increased CAVI, and their predictive powers for CAVI were equivalent (β = 0.214 and 0.200, respectively). Risk factors, including age, BMI, and male sex, were also predictive of CAVI (β= 0.593-0.630, -0.256 - -0.280, and 0.142-0.178, respectively). None of the FPG and HbA1c values were predictive of the SDPTG indices. The CAVI was higher in the diabetes group than in the other three groups according to HbA1c level, while the d/a index of the SDPTG decreased in the prediabetes group and increased in the diabetes group. CAVI may not be substituted for SDPTG indices when evaluating arterial stiffness based on the glucose level. Moreover, the progression rate of arterial stiffness may differ between the diabetic and nondiabetic stages.