Background: Breast density impacts upon breast cancer risk and recurrence, but its influence on breast cancer-specific survival is unclear. This study examines the influence of mammographic breast density (MBD) at diagnosis on breast cancer-specific survival. Methods: The data of 224 patients diagnosed with breast cancer were analyzed. Two area-based MBD measurement tools—AutoDensity and LIBRA—were used to measure MBD via a mammogram of the contralateral breast acquired at the time of diagnosis. These patients were split into two groups based on their percent breast density (PBD): high (PBD ≥ 20%) versus low (PBD < 20%). Breast cancer-specific survival in each of these PBD groups was assessed at a median follow-up of 34 months using Kaplan–Meier analysis and the Cox proportional hazards model. Results: The proportion of women with low PBD who died from breast cancer was significantly higher than that seen with high PBD (p = 0.01). The 5-year breast cancer-specific survival was poorer among women with low PBD than those with high PBD (0.348; 95% CI: 0.13–0.94) vs. 0.87; 95% CI: (0.8–0.96); p < 0.001)]. Women with higher breast density demonstrated longer survival regardless of the method of PBD measurement: LIBRA [log-rank test (Mantel–Cox): 9.4; p = 0.002)]; AutoDensity [log-rank test (Mantel–Cox) 7.6; p = 0.006]. Multivariate analysis also demonstrated that there was a higher risk of breast cancer-related deaths in women with low PBD (adjusted HR: 5.167; 95% CI: 1.974–13.521; p = 0.001). Conclusion: Women with <20% breast density at breast cancer diagnosis demonstrate poor survival regarding the disease. The impact of breast density on survival is not influenced by the method of measurement.