Inter-reader agreement of the prostate imaging quality (PI-QUAL) score for basic readers in prostate MRI: A multi-center study

Abstract

BackgroundThe Prostate Imaging Quality (PI-QUAL) score is the first step toward image quality assessment in multi-parametric prostate MRI (mpMRI). Previous studies have demonstrated moderate to excellent inter-rater agreement among expert readers; however, there is a need for studies to assess the inter-reader agreement of PI-QUAL scoring in basic prostate readers. ObjectivesTo assess the inter-reader agreement of the PI-QUAL score amongst basic prostate readers on multi-center prostate mpMRI. MethodsFive basic prostate readers from different centers assessed the PI-QUAL scores independently using T2-weighted images, diffusion-weighted imaging (DWI) including apparent diffusion coefficient (ADC) maps, and dynamic-contrast-enhanced (DCE) images on mpMRI data obtained from five different centers following Prostate Imaging-Reporting and Data System Version 2.1. The inter-reader agreements amongst radiologists for PI-QUAL were evaluated using weighted Cohen’s kappa. Further, the absolute agreements in assessing the diagnostic adequacy of each mpMRI sequence were calculated. ResultsA total of 355 men with a median age of 71 years (IQR, 60–78) were enrolled in the study. The pair-wise kappa scores ranged from 0.656 to 0.786 for the PI-QUAL scores, indicating good inter-reader agreements between the readers. The pair-wise absolute agreements ranged from 0.75 to 0.88 for T2W imaging, from 0.74 to 0.83 for the ADC maps, and from 0.77 to 0.86 for DCE images. ConclusionsBasic prostate radiologists from different institutions provided good inter-reader agreements on multi-center data for the PI-QUAL scores.