Background: Benign prostate hyperplasia (BPH) occurs in elder men globally with high prevalence. Human diet and lifestyle aroused great attention in the prevalence of BPH. Prostate enlargement (PE) is a major symptom of BPH. Objectives: To elaborate the effect of total diet quality for adults from the United States, we investigated the association between Health Eating Index (HEI)-2015 and the risk of PE in adults from the National Health and Nutrition Examination Survey (NHANES). Methods: This cross-sectional study was conducted based on NHANES 2001–2008. Participants who reported a PE history were included. We conducted a logistic regression analysis to investigate the association between HEI-2015 and PE. Results: A total of 4,866 male participants aged 40 and above were enrolled. Compared with Q1 of HEI-2015, no significant differences were found in adjusted models. Higher vegetables intake (Odds ratio [OR] = 1.073; 95% confidence interval [95%CI] 1.015 to 1.134, P = 0.02) and higher total dairy intake (OR = 1.034; 95%CI 1.009 to 1.061, P = 0.01) were significantly related with higher risk of PE. Conclusions: There was no significant difference between HEI-2015 and PE after full adjustment. Total vegetables and dairy product might be associated with higher risk of PE and needed further validation.