Cognitive decline is one of the most widespread chronic complications of diabetes, which occurs in more than half of the patients with type 2 diabetes (T2DM). Emerging evidences have suggested that glucose variability (GV) is associated with the pathogenesis of diabetic complications. However, the influence of acute GV on cognitive dysfunction in T2DM is still controversial. The aim of the study was to evaluate the association between acute GV and cognitive defect in T2DM, and provide a most recent and comprehensive summary of the evidences in this research field. PubMed, Cochrane library, EMBASE, Web of science, Sinomed, China National Knowledge Infrastructure (CNKI), and Wanfang were searched for articles that reported on the association between acute GV and cognitive impairment in T2DM. 9 eligible studies were included, with a total of 1263 patients with T2DM involved. Results showed that summary Fisher's z value was -0.23 [95%CI (-0.39, -0.06)], suggesting statistical significance (P = 0.006). Summary r value was -0.22 [95%CI (-0.37, -0.06)]. A lower cognitive performance was found in the subjects with greater glucose variation, which has statistical significance. Mean amplitude of glycemic excursions (MAGE) was associated with a higher risk of poor functional outcomes. Fisher's z value was -0.35 [95%CI (-0.43, -0.25)], indicating statistical significance (P = 0.011). Sensitivity analyses by omitting individual studies showed stability of the results. Overall, higher acute GV is associated with an increased risk of cognitive impairment in patients with T2DM. Further studies should be required to determine whether targeted intervention of reducing acute GV could prevent cognitive decline.