BackgroundMagnetic resonance imaging (MRI) is considered the gold standard for prostate segmentation. Computed tomography (CT)-based segmentation is prone to observer bias, potentially overestimating the prostate volume by ∼ 30 % compared to MRI. However, MRI accessibility is challenging for patients with contraindications or in rural areas globally with limited clinical resources. PurposeThis study investigates the possibility of achieving MRI-level prostate auto-segmentation accuracy using CT-only input via a deep learning (DL) model trained with CT-MRI registered segmentation. Methods and MaterialsA cohort of 111 definitive prostate radiotherapy patients with both CT and MRI images was retrospectively grouped into training (n = 37) and validation (n = 20) (where reference contours were derived from CT-MRI registration), and testing (n = 54) sets. Two commercial DL models were benchmarked against the reference contours in the training and validation sets. A custom DL model was incrementally retrained using the training dataset, quantitatively evaluated on the validation dataset, and qualitatively assessed by two different physician groups on the validation and testing datasets. A contour quality assurance (QA) model, established from the proposed model on the validation dataset, was applied to the test group to identify potential errors, confirmed by human visual inspection. ResultsTwo commercial models exhibited large deviations in the prostate apex with CT-only input (median: 0.77/0.78 for Dice similarity coefficient (DSC), and 0.80 cm/0.83 cm for 95 % directed Hausdorff Distance (HD95), respectively). The proposed model demonstrated superior geometric similarity compared to commercial models, particularly in the apex region, with improvements of 0.05/0.17 cm and 0.06/0.25 cm in median DSC/HD95, respectively. Physician evaluation on MRI-CT registration data rated 69 %-78 % of the proposed model’s contours as clinically acceptable without modifications. Additionally, 73 % of cases flagged by the contour quality assurance (QA) model were confirmed via visual inspection. ConclusionsThe proposed incremental learning strategy based on CT-MRI registration information enhances prostate segmentation accuracy when MRI availability is limited clinically.