Increasing evidence shows early vascular dysregulation in the pathophysiology of Alzheimer's disease (AD) in elderly population. We wondered about the relationship between vascular health and cognitive performance in middle-aged adults. The present study aims to evaluate whether and which brain vascular hemodynamic parameters are associated with cognitive functions in a middle-aged, non-demented population. We recruited 490 middle-aged community-based participants (30-60 years). Transcranial color-coded sonography was used to measure cerebral vascular hemodynamics, including mean flow velocity, pulsatility index, and breath-holding index (BHI) in the middle cerebral arteries (MCAs). Cognitive functions were assessed using the Montreal Cognitive Assessment (MoCA). A multivariate linear regression model was used to determine the association between the MoCA scores and each intracranial hemodynamic parameter. In 369 participants (median age 52 years [IQR 47-56], 48.8% men) with robust acoustic windows, the factors related to poorer MoCA scores were older age, less education extent, and the habitats of cigarette smoking or alcohol consumption. Multivariate analyses did not show a significant association between any intracranial hemodynamic parameters in both MCAs and MoCA scores in the total study population. Left MCA BHI was found to be significantly and independently correlated with the MoCA scores only in people aged 55-60 years (n = 111, B = 0.70, 95% confidence interval, 0.13-1.26, p = 0.017), however, not in people younger than 55 years. Our results emphasize the role of neurovascular abnormalities in the early pathophysiology of cognitive impairment and suggest cerebral vasoreactivity as the earliest detectable cognition-associated hemodynamic parameter.