Objectives: To investigate the influence of wine, beer, and spirits consumption, respectively, on non-pathological, age-related cognitive decline from young adulthood to late midlife in a large follow-up study of Danish men. Methods: The study includes 2456 middle-aged Danish men from the Lifestyle and Cognition Follow-up study 2015, with information on adult-life consumption (from age 26) of wine, beer, and spirits self-reported in late midlife and age-related cognitive decline assessed using the same validated intelligence test administered in young adulthood and late midlife. Associations were adjusted for consumption of other alcoholic beverages, year of birth, age at follow-up, retest interval, education, young adulthood intelligence, and personality. Results: Most of the men had wine (48%) or beer (42%) as their preferred beverage type. For all three alcoholic beverages, consumption of more than 14 units weekly was associated with a greater decline in unadjusted analyses, but this trend was only significant for wine. In contrast, adjusted models showed that moderate wine and spirits consumption was associated with less decline than abstention for these alcohol types (p = 0.03 for 8–14 units/week of wine and p = 0.03 for 1–7 units/week of spirits). Statistical tests suggested a difference between the estimated effects of consumption of 8–14 units/week of wine and beer on cognitive decline. Conclusions: While patterns of associations were similar across beverages, moderate wine and spirits consumption may mitigate cognitive decline, in contrast with beer. However, the results should be interpreted with caution due to inherent differences between men with different alcoholic beverage preferences.