Abstract Introduction Many older adults fail to maintain glycemic control even though reasonable glucose control can prevent the onset of macro- and microvascular complications. This present study aimed to determine the independent association of demographic characteristics, clinical factors, treatment modalities, and lifestyle behaviors with glycated hemoglobin levels (HbA1c) among Korean older adults, a group at a very high risk of diabetes. Methods We analyzed data from a representative sample of participants (N = 707) aged > 65 years in the Korea National Health and Nutrition Examination Survey (KNHANES), 2016-2018. Participants were classified into two groups according to their age [group 1 (ages 65 to 74) and group 2 (age ≥75)]. Data were analyzed using t-test, analysis of variance, Pearson’s correlation, and hierarchical multiple regression. Results Age (p=0.003), place of residence (p=0.01), treatment modality (p< 0.001), sedentary behavior (p=0.04), and moderate activity (p=0.002) significantly affected HbA1c levels. In comparison to the factors in two age groups, duration of diabetes was the variable more strongly associated with HbA1c levels (p< 0.001, β=0.283) in group 1, whereas treatment modality was the one strongly associated with HbA1c levels (p< 0.001, β=0.249) in group 2. Conclusion It is essential to consider the age duration of diabetes, and biochemical factors to manage HbA1c levels in older adults. Furthermore, our findings suggest including physical activity in the educational program to provide information for diabetes management. In the clinical setting, more close attention should be taken among healthcare providers to control the glucose level for older adults with diabetes.