In this study, we aimed to investigate the association between handgrip strength (HGS) and cognitive performance in stage 3-5 chronic kidney disease (CKD) patients aged ≥ 60 years. This cross-sectional study analyzed data from National Health and Nutrition Examination Survey (NHANES) database 2011–2014. Three tests were used to assess the cognitive performance, including consortium to establish a registry for Alzheimer’s disease (CERAD), animal fluency test (AFT), and digit symbol substitution test (DSST). The multivariate linear regression analyses adjusting for confounding factors were utilized to evaluate the association of HGS with cognitive performance. A total of 678 older stage 3-5 CKD patients were included in this study. After adjusting for multiple factors, a higher HGS was positively associated with a higher CERAD-delayed recall and DSST score. In addition, our analysis indicated that HGS probably correlated with better performance of immediate learning ability in male, while working memory, sustained attention, and processing speed in female. HGS may be an important indicator for cognitive deficits in stage 3-5 CKD patients, especially for learning ability and executive function. Further research to explore the sex-specific and domain-specific and possible mechanisms are required.