Polygenic risk scores (PRS) for breast cancer may help guide screening decisions. However, few studies have examined whether PRS are associated with risk of short-term or poor prognosis breast cancers. The study purpose was to evaluate the association of the 313 SNP breast cancer PRS with 2-year risk of poor prognosis breast cancer. We evaluated the association of breast cancer PRS with breast cancer overall, ER + and ER- breast cancer, and poor prognosis breast cancer diagnosed within 2years of a negative mammogram among a cohort of 3657 women using logistic regression adjusted for age, breast density, race/ethnicity, year of screening, and genetic ancestry principal components. Breast cancers were considered poor prognosis if they were metastatic, positive lymph nodes, ER/PR + HER2- and > 2cm, ER/PR/HER2-, or HER2 + and > 1cm. Of the 308 breast cancers, 137 (44%) were poor prognosis. The overall breast cancer PRS was significantly associated with breast cancer diagnosis within 2years (OR 1.39, 95% CI 1.23-1.57, p < 0.001). The breast cancer PRS was also associated specifically with diagnosis of poor prognosis disease (OR 1.24, 95% CI 1.03-1.49, p = 0.018), but was more strongly associated with good prognosis cancer (OR 1.52 95% CI 1.29-1.80 p = 3.60 × 10-7) The ER + PRS was significantly associated with ER/PR + breast cancer (OR 1.41, 95% CI 1.24-1.61, p < 0.001) and the ER-PRS was significantly associated with ER-breast cancer (OR 1.48, 95% CI 1.08-2.02, p = 0.015). Breast cancer PRS was independently and significantly associated with diagnosis of both breast cancer overall and poor prognosis breast cancer within 2years of a negative mammogram, suggesting PRS may help guide decisions about screening intervals and supplemental screening.