Previous research has examined how fruit and vegetable consumption may affect cognitive impairment among older adults. However, knowledge regarding the behavioral change in fruit and vegetable consumption remains limited in the Chinese older adult population. This research aimed to fill the literature gap. We used data from five waves of the Chinese Longitudinal Healthy Longevity Study (2005-2018, observations = 18,856 from 11,388 participants) and selected older adult participants (65 years old or above). A behavioral change was defined as a consumption change in the study sample. Cognitive impairment was measured based on the mini-mental state examination. We used the Cox multi-state model as the major statistical analysis. Chinese older adults who transitioned from non-daily to daily consumption of vegetables had lower odds of reporting cognitive impairment deteriorating from normal cognitive function to severe, compared with those who did not change their consumption behavior (HR [hazard ratio] = 0.88, 95% CI 0.80, 0.97; p < 0.05). All transitions in fruit consumption were negatively associated with cognitive changes from normal cognitive function to mild-moderate cognitive impairment. In our additional stratified analysis examining rural-urban disparity, we observed similar significant findings among rural older adults (Vegetable consumption change:HR = 0.83, 95% CI 0.75, 0.93; p < 0.01) but not urban older adults. Behavioral change in consumption of vegetables may affect Chinese older adults' cognitive health. Future interventions should focus on the critical role of behavioral change in vegetable consumption in reducing older adults' cognitive impairment. However, the contradictory findings of fruit consumption warrant further investigation to draw a conclusive claim regarding its benefits for cognitive health.