Excess adipose tissue increases other cardiovascular risk factors, which may be associated with vascular brain injury and cognitive impairment. However, the extent to which the amount and distribution of adipose tissue may be associated with lower cognitive scores, independent of its association with cardiovascular risk factors, is not well characterized. To investigate the association of adiposity on vascular brain injury and cognitive scores. A total of 9189 participants from the Canadian Alliance for Healthy Hearts and Minds (CAHHM) and the Prospective Urban Rural Epidemiological-Mind (PURE-MIND) cohort studies were included in this cross-sectional analysis. Of these adults, 9166 underwent bioelectrical impedance analysis to assess body fat (BF) percentage, and 6773 underwent magnetic resonance imaging to assess vascular brain injury and measure visceral adipose tissue (VAT) volume. Participants from CAHHM were recruited from January 1, 2014, to December 31, 2018, and PURE-MIND participants were recruited from January 1, 2010, to December 31, 2018. Both CAHHM and PURE-MIND comprise multisite, population-based cohorts. Participants from CAHHM are from Canada, and PURE-MIND participants are from Canada or Poland. Data analysis was performed from May 3 to November 24, 2021. The percentage of BF and VAT were modeled as sex-specific quartiles. Vascular brain injury was defined as high white matter hyperintensities or silent brain infarction. Multivariable mixed models were used to examine factors associated with reduced cognitive scores. Cognitive function was assessed using the Digital Symbol Substitution Test (DSST; scores range from 0 to 133, with lower scores indicating lower cognitive function) and Montreal Cognitive Assessment (scores range from 0 to 30, with a score of ≥26 denoting normal cognitive function). Reduced cognition was defined as a DSST score less than 1 SD below the mean. Cardiovascular risk was assessed using the INTERHEART Risk Score (IHRS; scores range from 0 to 48; low risk is defined as a score of 0 to 9, moderate risk as 10 to 16, and high risk as 17 or higher). A total of 9189 adults (mean [SD] age, 57.8 [8.8] years; 5179 [56.4%] women; and 1013 [11.0%] East and Southeast Asian; 295 [3.2%] South Asian; 7702 [83.8%] White European; and 179 [1.9%] other, including Black, Indigenous, mixed, and unknown ethnicity) participated in the study. Visceral adipose tissue was highly correlated with body adiposity measured by BF percentage (r = 0.76 in women; r = 0.70 in men). Cardiovascular risk factors increased with increasing BF percentage with the fourth quartile IHRS at 13.8 (95% CI, 13.5-14.0; P < .001 for trend) and with VAT with the fourth quartile IHRS at 13.3 (95% CI, 13.0-13.5; P < .001 for trend). Vascular brain injury increased with increasing BF percentage with the fourth quartile value at 8.6% (95% CI, 7.5%-9.8%; P = .007 for trend) and with increasing VAT with fourth quartile value at 7.2% (95% CI, 6.0-8.4; P = .05 for trend). Cognitive scores were lower with increasing BF percentage with the fourth quartile score of 70.9 (95% CI, 70.4-71.5; P < .001 for trend) and for VAT with the fourth quartile score of 72.8 (95% CI, 72.1-73.4; P < .001 for trend). For every 1-SD increase in BF percentage (9.2%) or VAT (36 mL), the DSST score was lower by 0.8 points (95% CI, 0.4-1.1; P < .001) for BF percentage and lower by 0.8 points (95% CI, 0.4-1.2; P < .001) for VAT, adjusted for cardiovascular risk factors and vascular brain injury. The population attributable risk for reduced DSST score for higher BF percentage was 20.5% (95% CI, 7.0%-33.2%) and for VAT was 19.6% (95% CI, 2.0%-36.0%). Higher BF percentage and VAT were not associated with Montreal Cognitive Assessment scores. In this cross-sectional study, generalized and visceral adiposity were associated with reduced cognitive scores, after adjustment for cardiovascular risk factors, educational level, and vascular brain injury. These results suggest that strategies to prevent or reduce adiposity may preserve cognitive function.