To assess cancer-specific mortality (CSM) and other-cause mortality (OCM) rates in patients with rare histological prostate cancer subtypes. Using the Surveillance, Epidemiology, and End Results database (2004-2020), we applied smoothed cumulative incidence plots and competing risks regression (CRR) models. Of 827,549 patients, 1510 (0.18%) harbored ductal, 952 (0.12%) neuroendocrine, 462 (0.06%) mucinous, and 95 (0.01%) signet ring cell carcinoma. In the localized stage, five-year CSM vs. OCM rates ranged from 2 vs. 10% in acinar and 3 vs. 8% in mucinous, to 55 vs. 19% in neuroendocrine carcinoma patients. In the locally advanced stage, five-year CSM vs. OCM rates ranged from 5 vs. 6% in acinar, to 14 vs. 16% in ductal, and to 71 vs. 15% in neuroendocrine carcinoma patients. In the metastatic stage, five-year CSM vs. OCM rates ranged from 49 vs. 15% in signet ring cell and 56 vs. 16% in mucinous, to 63 vs. 9% in ductal and 85 vs. 12% in neuroendocrine carcinoma. In multivariable CRR, localized neuroendocrine (HR 3.09), locally advanced neuroendocrine (HR 9.66), locally advanced ductal (HR 2.26), and finally metastatic neuroendocrine carcinoma patients (HR 3.57; all p < 0.001) exhibited higher CSM rates relative to acinar adenocarcinoma patients. Compared to acinar adenocarcinoma, patients with neuroendocrine carcinoma of all stages and locally advanced ductal carcinoma exhibit higher CSM rates. Conversely, CSM rates of mucinous and signet ring cell adenocarcinoma do not differ from those of acinar adenocarcinoma.