Prostate cancer is the most common noncutaneous cancer in men in the United States. The current paradigm for screening and diagnosis is imperfect, with relatively low specificity, high cost, and high morbidity. This study aims to generate new image contrasts by learning a distribution of unique image signatures associated with prostate cancer. In total, 48 patients were prospectively recruited for this institutional review board–approved study. Patients underwent multiparametric magnetic resonance imaging 2 weeks before surgery. Postsurgical tissues were annotated by a pathologist and aligned to the in vivo imaging. Radiomic profiles were generated by linearly combining 4 image contrasts (T2, apparent diffusion coefficient [ADC] 0-1000, ADC 50-2000, and dynamic contrast-enhanced) segmented using global thresholds. The distribution of radiomic profiles in high-grade cancer, low-grade cancer, and normal tissues was recorded, and the generated probability values were applied to a naive test set. The resulting Gleason probability maps were stable regardless of training cohort, functioned independent of prostate zone, and outperformed conventional clinical imaging (area under the curve [AUC] = 0.79). Extensive overlap was seen in the most common image signatures associated with high- and low-grade cancer, indicating that low- and high-grade tumors present similarly on conventional imaging.