Moderate Inter-reader Agreement Research Articles

Clinical utility, reproducibility, and radiologist acceptance of ILD-RADS

PurposeTo investigate the clinical utility, reproducibility, and radiologists’ acceptance of the Interstitial Lung Disease Imaging-Reporting and Data System (ILD-RADS). MethodIn this single-institutional retrospective study, three radiologists independently reviewed the chest high-resolution CT (HRCT) scans of 111 consecutive patients diagnosed with ILDs. They assessed the HRCT pulmonary features using the ILD-RADS template and assigned an ILD-RADS category (1–4) to each scan based on the identified imaging pattern. Patients were classified into idiopathic pulmonary fibrosis (IPF) (n = 14) and non-IPF ILD (n = 97) groups based on clinical diagnoses determined by multidisciplinary discussion. Association between ILD-RADS categories and clinical diagnoses was assessed using the Chi-square test for trend. Reproducibility was evaluated using kappa (k) scores, and radiologists’ acceptance of the ILD-RADS was evaluated with a questionnaire. ResultsWe found a significant association between the ILD-RADS categories and patients’ clinical diagnoses (P ≤ 0.0001) for the three readers, with a trend toward increased assignment of ILD-RADS-1 to IPF patients (50 %-57.1 %), and ILD-RADS-4 to non-IPF patients (46.4 %-49.5 %). The ILD-RADS categories showed excellent intra-reader agreement (k = 0.873) and moderate inter-reader agreement (k = 0.440). ILD-RADS-1 and −4 categories showed the highest inter-reader agreement (k = 0.681 and 0.481, respectively). Radiologists gave a positive response to using the ILD-RADS in daily practice. ConclusionsThe clinical utility of the ILD-RADS was demonstrated by the significant association between the ILD-RADS categories and patients’ clinical diagnoses, particularly the ILD-RADS-1 and −4 categories. Excellent intra-reader and moderate inter-reader reproducibility was observed. ILD-RADS has the potential to be widely accepted for standardized HRCT reporting among radiologists.

Performance of VI-RADS in predicting muscle-invasive bladder cancer after transurethral resection: a single center retrospective analysis.

To assess VIRADS performance and inter-reader agreement for detecting muscle-invasive bladder cancer (MIBC) following transurethral resection of bladder tumor (TURBT). An IRB-approved, HIPAA-compliant, retrospective study from 2016 to 2020 included patients with bladder urothelial carcinoma who underwent MRI after TURBT, and cystectomy within 3months without post-MRI treatments. Three radiologists blinded to pathology results independently reviewed MR images and assigned a VI-RADS score. Sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV) and accuracy of VI-RADS were assessed for diagnosing MIBC using VI-RADS scores ≥ 3 and ≥ 4. Inter-reader agreement was assessed using Gwet's agreement coefficient (AC) and percent agreement. The cohort consisted of 70 patients (mean age, 68years ± 11 [SD]; range 39-85; 58 men) and included 32/70 (46%) with MIBC at cystectomy. ROC analysis revealed an AUC ranging from 0.67 to 0.77 and no pairwise statistical difference between readers (p-values, 0.06, 0.08, 0.97). Percent sensitivity, specificity, PPV, NPV and accuracy for diagnosing MIBC for the three readers ranged from 81.3-93.8, 36.8-55.3, 55.6-60.5, 77.3-87.5, and 62.9-67.1 respectively for VI-RADS score ≥ 3, and 78.1-81.3, 47.4-68.4, 55.6-67.6, 72.0-78.8 and 61.4-72.9 respectively for VI-RADS score ≥ 4. Gwet's AC was 0.63 [95% confidence interval (CI): 0.49,0.78] for VI-RADS score ≥ 3 with 79% agreement [95% CI 72,87] and 0.54 [95%CI 0.38,0.70] for VI-RADS score ≥ 4 with 76% agreement [95% CI 69,84]. VIRADS performance was not statistically different among 31/70 (44%) patients who received treatments prior to MRI (p ≥ 0.16). VI-RADS had moderate sensitivity and accuracy but low specificity for detection of MIBC following TURBT, with moderate inter-reader agreement.

Side-specific, Microultrasound-based Nomogram for the Prediction of Extracapsular Extension in Prostate Cancer

BackgroundPrediction of extracapsular extension (ECE) is essential to achieve a balance between oncologic resection and neural tissue preservation. Microultrasound (MUS) is an attractive alternative to multiparametric magnetic resonance imaging (mpMRI) in the staging scenario. ObjectiveTo create a side-specific nomogram integrating clinicopathologic parameters and MUS findings to predict ipsilateral ECE and guide nerve sparing. Design, setting, and participantsProspective data were collected from consecutive patients who underwent robotic-assisted radical prostatectomy from June 2021 to May 2022 and had preoperative MUS and mpMRI. A total of 391 patients and 612 lobes were included in the analysis. Outcome measurements and statistical analysisECE on surgical pathology was the primary outcome. Multivariate regression analyses were carried out to identify predictors for ECE. The resultant multivariable model's performance was visualized using the receiver-operating characteristic curve. A nomogram was developed based on the coefficients of the logit function for the MUS-based model. A decision curve analysis (DCA) was performed to assess clinical utility. Results and limitationsThe areas under the receiver-operating characteristic curve (AUCs) of the MUS-based model were 81.4% and 80.9% (95% confidence interval [CI] 75.6, 84.6) after internal validation. The AUC of the mpMRI-model was also 80.9% (95% CI 77.2, 85.7). The DCA demonstrated the net clinical benefit of the MUS-based nomogram and its superiority compared with MUS and MRI alone for detecting ECE. Limitations of our study included its sample size and moderate inter-reader agreement. ConclusionsWe developed a side-specific nomogram to predict ECE based on clinicopathologic variables and MUS findings. Its performance was comparable with that of a mpMRI-based model. External validation and prospective trials are required to corroborate our results. Patient summaryThe integration of clinical parameters and microultrasound can predict extracapsular extension with similar results to models based on magnetic resonance imaging findings. This can be useful for tailoring the preservation of nerves during surgery.

HCC screening with ultrasound: assessment of quality using ultrasound LI-RADS score.

To describe ultrasound (US) quality for hepatocellular carcinoma (HCC) screening/surveillance using the US LI-RADS scoring system, and to assess predictive factors of worse US quality scores. This retrospective study included adult patients (n = 470; M/F 264/206, median age 59y) at risk for HCC that underwent US for HCC screening/surveillance. US examinations were independently reviewed by 2 radiologists that assigned a visualization score (A: no/minimal, B: moderate, C: severe limitation) and US diagnostic category (US LI-RADS 1: negative, US LI-RADS 2: subthreshold, US LI-RADS 3: positive) to each study. A generalized linear mixed model was used to assess the predictive factors of worse visualization score using OR (odds ratio) statistics. Simple Kappa coefficient (K) assessed inter-reader agreement. For readers 1 and 2, 295/320 (62.8%/68.1%) cases were scored A, 153/134 (32.6%/28.5%) were scored B, and 22/16 (4.6%/3.4%) were scored C, respectively. There was moderate inter-reader agreement for US LI-RADS visualization score (K = 0.478) and 100% concordance for US diagnostic category (K = 1), with 30 (6.4%) cases scored as positive (US LI-RADS 3). Cirrhosis and obesity were significant independent predictors of worse visualization scores (B/C) (cirrhosis: OR 10.4 confidence intervals: [4.25-25.48], p < 0.001; obesity: OR 3.61 [2.11-6.20], p < 0.001). Of the 30 lesions scored as US LI-RADS 3, 9 were characterized as probable or definite HCC on confirmatory CT/MRI, yielding a PPV of 30% (9/30) and a false-positive rate of 70% (21/30). Moderate to severe limitations in quality of US performed for HCC screening/surveillance was observed in approximately one-third of patients. Patients with cirrhosis and/or elevated BMI have poorer quality US studies and may benefit from other screening modalities such as CT or MRI.

Role of CT and MR imaging in the assessment of suspected spondylodiscitis and planning of needle biopsy

Our aim was to assess the role of computed tomography (CT) or magnetic resonance imaging (MRI) in the assessment of spondylodiscitis, identifying the best target structures for biopsy to increase the likelihood of positive cultures. This study was approved by our Institutional Review Board, and requirement for specific consent form was waived. In this retrospective single Institution study, we evaluated clinical and imaging records of 60 patients who underwent spine biopsy for suspected spondylodiscitis from January 2016 to May 2021. CT and MRI sensitivity and inter-reader agreement were assessed according to the phase of spondylodiscitis, defined as acute, subacute or chronic. Inter-reader agreement for the diagnosis and identification of spondylodiscitis phase was assessed using K statistics. Univariate logistic regression analysis was performed to assess any relationship between MRI/CT findings, spondylodiscitis phase and positive cultures. Sixty patients (48 males) with mean age 59, 2 ± 29 were enrolled in this study. MRI showed higher sensitivity (96% vs 65% of CT) in the diagnosis and good inter-reader agreement (k = 0.8) in the identification of the acute and subacute phase of spondylodiscitis, and moderate inter-reader agreement (k = 0.7) and lower sensitivity (80% vs 95% of CT) for the chronic phase. Univariate analysis showed as MRI-specific findings such as extensive hyperintensity of vertebral body and/or disc on Short Tau Inversion Recovery-T2w images, paravertebral collections, preserved or augmented disc height and presence of a vertebral fractures were mainly found in the acute/subacute phase and was a predictor for positive cultures (p < 0.05). MRI and CT are both able to identify the different phases of spondylodiscitis, although MRI is more sensitive in the acute phase. Findings such as extensive hyperintensity of the disc/vertebral body, fractures and paravertebral collections, represent the main targets for biopsy related to a positive culture.

Diagnostic Accuracy of Centrally Restricted Diffusion Sign in Cerebral Metastatic Disease: Differentiating Radiation Necrosis from Tumor Recurrence.

Purpose: The centrally restricted diffusion sign of diffusion-weighted imaging (DWI) is associated with radiation necrosis (RN) in treated gliomas. Our goal was to evaluate its diagnostic accuracy to distinguish RN from tumor recurrence (TR) in treated brain metastases. Methods: Retrospective study of consecutive patients with brain metastases who developed a newly centrally necrotic lesion after radiotherapy (RT). One reader placed regions of interest (ROI) in the enhancing solid lesion and the non-enhancing central necrosis on the apparent diffusion coefficient (ADC) map. Two readers qualitatively assessed the presence of the centrally restricted diffusion sign. The final diagnosis was made by histopathology (n = 39) or imaging follow-up (n = 2). Differences between groups were assessed by Fisher's exact or Mann-Whitney U tests. Diagnostic accuracy and inter-reader agreement were evaluated using receiver operating characteristic (ROC) curve analysis and kappa scores. Results: Forty-one lesions (32 predominant RN; 9 predominant TR) were analyzed. An ADC value ≤ 1220 × 10-6 mm2/s (sensitivity 74%, specificity 89%, area under the curve [AUC] .85 [95% confidence interval {CI}, .70-.94] P < .0001) from the necrosis and an ADC necrosis/enhancement ratio ≤1.37 (sensitivity 74%, specificity 89%, AUC .82 [95% CI, .67-.93] P < .0001) provided the highest performance for RN diagnosis. The qualitative centrally restricted diffusion sign had a sensitivity of 69% (95% CI, .50-.83), specificity of 77% (95% CI, .40-.96), and a moderate (k = .49) inter-reader agreement for RN diagnosis. Conclusions: Radiation necrosis is associated with lower ADC values in the central necrosis than TR. A moderate interobserver agreement might limit the qualitative assessment of the centrally restricted diffusion sign.

Crohn's disease active inflammation assessment with iodine density from dual-energy CT enterography: comparison with endoscopy and conventional interpretation.

To compare terminal ileum (TI) mucosal iodine density obtained at dual-energy CT enterography (DECTE) with conventional CT interpretation and endoscopy in patients with Crohn's disease (CD). Twenty-three CD patients (14 men; mean[SD] age:48.1[16.7] years) with endoscopy within 30days of DECTE were retrospectively identified. An inflammatory bowel disease gastroenterologist reviewed endoscopic images. Two radiologists qualitatively assessed the presence of active TI inflammation. Mean iodine density normalized to the aorta (I%), mean absolute iodine density (I), and iodine density standard deviation (ISD) from the distal 2cm ileum (TI) mucosa obtained using semiautomatic prototype software were compared with endoscopic assessment using Mann Whitney tests. The optimal threshold I% and I were determined from receiver operating curves (ROC). Sensitivity and specificity of conventional interpretation and determined iodine thresholds were compared using McNemar's test. Inter-reader agreement was assessed using kappa. A p < 0.05 indicated statistical significance. Twelve (52.1%) patients had endoscopic active inflammation. I% was 37.9[13.3]% for patients with and 21.7[7.5]% for patients without endoscopic active inflammation (p = 0.001). The optimal ROC threshold 24.6% had 100% sensitivity and 81.8% specificity (AUC = 0.909, 95% CI 0.777-1). I was 2.44[0.73]mg/mL for patients with and 1.77[1.00]mg/mL for patients without active endoscopic inflammation (p =0.0455). The optimal ROC threshold 1.78mg/mL I had 91.7% sensitivity and 63.6% specificity (AUC = 0.75, 95% CI 0.532-0.968). ISD was similar for patients with and without endoscopic active inflammation (0.82[0.33]mg/mL and 0.77[0.28]mg/mL, respectively, p = 0.37). Conventional interpretation sensitivity and specificity (R1/R2) were 83.3%/91.7% and 72.7%/54.5%, respectively (all p > 0.05) with moderate inter-reader agreement (Κ = 0.542[95% CI 0.0202-0.088]). Mean normalized iodine density is highly sensitive and specific for endoscopic active inflammation. DECTE could be considered as a surrogate to endoscopy in CD patients. Despite trends towards improved sensitivity and specificity compared with conventional interpretation, future larger studies are needed.

Prostate MRI quality: clinical impact of the PI-QUAL score in prostate cancer diagnostic work-up.

To assess the reproducibility and impact of prostate imaging quality (PI-QUAL) scores in a clinical cohort undergoing prostate multiparametric MRI. PI-QUAL scores were independently recorded by three radiologists (two senior, one junior). Readers also recorded whether MRI was sufficient to rule-in/out cancer and if repeat imaging was required. Inter-reader agreement was assessed using Cohen's κ. PI-QUAL scores were further correlated to PI-RADS score, number of biopsy procedures, and need for repeat imaging. Image quality was sufficient (≥PI-QUAL-3) in 237/247 (96%) and optimal (≥PI-QUAL-4) in 206/247 (83%) of males undergoing 3T-MRI. Overall PI-QUAL scores showed moderate inter-reader agreement for senior (K = 0.51) and junior-senior readers (K = 0.47), with DCE showing highest agreement (K = 0.47). With PI-QUAL-5 studies, the negative MRI calls increased from 50 to 87% and indeterminate PI-RADS-3 rates decreased from 31.8. to 10.4% compared to lower quality PI-QUAL-3 studies. More patients with PI-QUAL scores 1-3 underwent biopsy for negative (47%) and indeterminate probability (100%) MRIs compared to PI-QUAL score 4-5 (30 and 75%, respectively). Ability to rule-in cancer increased with PI-QUAL score, from 50% at PI-QUAL 1-2 to 90% for PI-QUAL 4-5, with a similarly, but greater effect for ruling-out cancer and at a lower threshold, from 0% for scans of PI-QUAL 1-2 to 67.1% for PI-QUAL 4 and 100% for PI-QUAL-5. Higher PI-QUAL scores for image quality are associated with decreased uncertainty in MRI decision-making and improved efficiency of diagnostic pathway delivery. This study demonstrates moderate inter-reader agreement for PI-QUAL scoring and validates the score in a clinical setting, showing correlation of image quality to certainty of decision making and clinical outcomes of repeat imaging and biopsy of low-to-intermediate risk cases.

The Diagnostic Accuracy of Chest Radiographic Features for Pediatric Intrathoracic Tuberculosis.

The chest radiograph (CR) remains a key tool in the diagnosis of pediatric tuberculosis (TB). In children with presumptive intrathoracic TB, we aimed to identify CR features that had high specificity for, and were strongly associated with, bacteriologically confirmed TB. We analyzed CR data from children with presumptive intrathoracic TB prospectively enrolled in a cohort study in a high-TB burden setting and who were classified using standard clinical case definitions as "confirmed," "unconfirmed," or "unlikely" TB. We report the CR features and inter-reader agreement between expert readers who interpreted the CRs. We calculated the sensitivity and specificity of the CR features with at least moderate inter-reader agreement and analyzed the relationship between these CR features and the classification of TB in a multivariable regression model. Of features with at least moderate inter-reader agreement, enlargement of perihilar and/or paratracheal lymph nodes, bronchial deviation/compression, cavities, expansile pneumonia, and pleural effusion had a specificity of > 90% for confirmed TB, compared with unlikely TB. Enlargement of perihilar (adjusted odds ratio [aOR]: 6.6; 95% confidence interval [CI], 3.80-11.72) and/or paratracheal lymph nodes (aOR: 5.14; 95% CI, 2.25-12.58), bronchial deviation/compression (aOR: 6.22; 95% CI, 2.70-15.69), pleural effusion (aOR: 2.27; 95% CI, 1.04-4.78), and cavities (aOR: 7.45; 95% CI, 3.38-17.45) were associated with confirmed TB in the multivariate regression model, whereas alveolar opacification (aOR: 1.16; 95% CI, .76-1.77) and expansile pneumonia (aOR: 4.16; 95% CI, .93-22.34) were not. In children investigated for intrathoracic TB enlargement of perihilar or paratracheal lymph nodes, bronchial compression/deviation, pleural effusion, or cavities on CR strongly support the diagnosis.

Validation of computed tomography angiography as a complementary test in the assessment of renal artery stenosis: a comparison with digital subtraction angiography.

Renal artery stenosis is an important cause of hypertension in children, accounting for 5-10% of cases. When suspected, noninvasive imaging options include ultrasound (US), computed tomography (CT) angiography and magnetic resonance (MR) angiography. However, digital subtraction angiography (DSA) remains the gold standard. To investigate the accuracy and inter-reader reliability of CT angiography in children with suspected renal artery stenosis. This is a retrospective study of patients suspected of having renal artery stenosis evaluated by both CT angiography and DSA between 2008 and 2019 at a tertiary pediatric hospital. Only children who underwent CT angiography within 6months before DSA were included. CT angiography studies were individually reviewed by two pediatric radiologists, blinded to clinical data, other studies and each other's evaluation, to determine the presence of stenosis at the main renal artery and 2nd- and 3rd-order branches. The sensitivity, specificity and accuracy were calculated using DSA as the reference. The effective radiation dose for CT angiography and DSA was also calculated. Kappa statistics were used to assess inter-reader agreement. Seventy-four renal units were evaluated (18 girls, 19 boys). The patients' median age was 8years (range: 1-21years). Overall, CT angiography was effective in detecting renal artery stenosis with a sensitivity of 85.7%, specificity of 91.5% and accuracy of 88.9%. There was moderate inter-reader agreement at the main renal artery level (k=0.73) and almost perfect inter-reader agreement at the 2nd/3rd order (k=0.98). However, the sensitivity at the 2nd- and 3rd-order level was lower (14.3%). CT angiography provided excellent negative predictive value for evaluating renal artery stenosis at the main renal artery level (90.1%) and at the 2nd- or 3rd-order branches (82.7%). The median effective dose of CT angiography studies was 2.2mSv (range: 0.6-6.3) while the effective dose of DSA was 13.7mSv. CT angiography has high sensitivity and specificity at the main renal artery level with a lower radiation dose than previously assumed. Therefore, it can be used as a diagnostic tool in patients with low to medium risk of renal artery stenosis, and as a screening and treatment planning tool in patients at high risk.

MRI features of the normal prostatic peripheral zone: the relationship between age and signal heterogeneity on T2WI, DWI, and DCE sequences

ObjectivesTo assess the multiparametric MRI (mpMRI) appearances of normal peripheral zone (PZ) across age groups in a biopsy-naïve population, where prostate cancer (PCa) was subsequently excluded, and propose a scoring system for background PZ changes.MethodsThis retrospective study included 175 consecutive biopsy-naïve patients (40–74 years) referred with a suspicion of PCa, but with subsequent negative investigations. Patients were grouped by age into categories ≤ 54, 55–59, 60–64, and ≥ 65 years. MpMRI sequences (T2-weighted imaging [T2WI], diffusion-weighted imaging [DWI]/apparent diffusion coefficient [ADC], and dynamic contrast-enhanced imaging [DCE]) were independently evaluated by two uro-radiologists on a proposed 4-point grading scale for background change on each sequence, wherein score 1 mirrored PIRADS-1 change and score 4 represented diffuse background change. Peripheral zone T2WI signal intensity and ADC values were also analyzed for trends relating to age.ResultsThere was a negative correlation between age and assigned background PZ scores for each mpMRI sequence: T2WI: r = − 0.52, DWI: r = − 0.49, DCE: r = − 0.45, p < 0.001. Patients aged ≤ 54 years had mean scores of 3.0 (T2WI), 2.7 (DWI), and 3.1 (DCE), whilst patients ≥ 65 years had significantly lower mean scores of 1.7, 1.4, and 1.9, respectively. There was moderate inter-reader agreement for all scores (range κ = 0.43–0.58). Statistically significant positive correlations were found for age versus normalized T2WI signal intensity (r = 0.2, p = 0.009) and age versus ADC values (r = 0.33, p = 0.001).ConclusionThe normal PZ in younger patients (≤ 54 years) demonstrates significantly lower T2WI signal intensity, lower ADC values, and diffuse enhancement on DCE, which may hinder diagnostic interpretation in these patients. The proposed standardized PZ background scoring system may help convey the potential for diagnostic uncertainty to clinicians.Key Points• Significant, positive correlations were found between increasing age and higher normalized T2-weighted signal intensity and mean ADC values of the prostatic peripheral zone.• Younger men exhibit lower T2-weighted imaging signal intensity, lower ADC values, and diffuse enhancement on dynamic contrast-enhanced imaging, which may hinder MRI interpretation.• A scoring system is proposed which aims towards a standardized assessment of the normal background PZ. This may help convey the potential for diagnostic uncertainty to clinicians.

Use of ring-enhancement and focal necrosis to differentiate pancreatic adenosquamous carcinoma from pancreatic ductal adenocarcinoma on CT and MRI

PurposeTo assess the ability of the ring-enhancing sign and focal necrosis to diagnose adenosquamous carcinoma (ASqC), a variant of pancreatic ductal adenocarcinoma (PDAC), on MRI and CT. MethodsThe following features of ASqC and conventional PDAC were evaluated on CT and MRI: tumor size, location, margins, borders (non-exophytic, exophytic), and T1 signal intensity. Two readers, blinded to histopathology results, rated their confidence in detecting ring-enhancement and focal necrosis (FN) on a 5-point Likert scale on both MRI and CT. Inter-reader agreement was assessed with Cohen's kappa (k). ResultsA total of 24 patients were included: eight patients with treatment naïve and histologically proven ASqC (six women, mean age: 63, range: 40–75) and 16 patients with PDAC (eight women, mean age: 67, range: 47–83). Statistically significant differences between ASqC and PDAC were seen in tumor size, location, presence of FN, and ring enhancement (p = 0.01–0.037). The readers were more confident in depicting the key differentiating feature ring-enhancement in ASqC on MRI compared to CT (confidence 1.71 ± 0.49 vs. 0.88 ± 0.35, p = 0.017) with moderate inter-reader agreement (k = 0.46 and 0.5, respectively). FN showed substantial inter-reader agreement on MR and moderate agreement on CT (k = 0.67 and 0.5, respectively). ConclusionsCompared to CT, MRI depicts ring-enhancement in ASqC with greater reader confidence and FN in ASqC with higher inter-reader agreement. The concurrent presence of these two imaging features should raise high suspicion for ASqC.

Characterizing T2 iso- and hypo-intense renal masses on MRI: Can templated algorithms improve accuracy?

PurposeTo assess if a templated algorithm can improve the diagnostic performance of MRI for characterization of T2 isointense and hypointense renal masses. MethodsIn this retrospective study, 60 renal masses with histopathologic diagnoses that were also confirmed as T2 iso- or hypointense on MRI were identified (mean ± standard deviation, range: 3.9 ± 2.5, 1.0–13.7 cm). Two semi-quantitative diagnostic algorithms were created based on MRI features of renal masses reported in the literature. Three body-MRI trained radiologists provided clinical diagnoses based on their experience and separately provided semiquantitative data for each components of the two algorithms. The algorithms were applied separately by a radiology trainee without additional interpretive input. Logistic regression was used to compare the accuracy of the three methods in distinguishing malignant versus benign lesions and in diagnosing the exact histopathology. Inter-reader agreement for each method was calculated using Fleiss' kappa statistics. ResultsThe accuracy of the two algorithms and clinical experience were similar (70%, 69%, and 64%, respectively, p = 0.22–0.32), with fair to moderate inter-reader agreement (Fleiss's kappa: r = 0.375, r = 0.308, r = 0.375, respectively, all p < 0.0001). The accuracy of the two algorithms and clinical experience in diagnosing specific histopathology were also no different from each other (34%, 29%, and 32%, respectively, p = 0.49–0.74), with fair to moderate inter-reader agreement (Fleiss's kappa: r = 0.20, r = 0.28, r = 0.375, respectively, all p < 0.0001). ConclusionSemi-quantitative templated algorithms based on MRI features of renal masses did not improve the ability to diagnose T2 iso- and hypointense renal masses when compared to unassisted interpretation by body MR trained subspecialists.

Response assessment of hepatocellular carcinoma treated with yttrium-90 radioembolization: inter-reader variability, comparison with 3D quantitative approach, and role in the prediction of clinical outcomes

ObjectivesTo assess the inter-reader variability in response assessment for HCC treated with radioembolization (TARE) compared with 3D quantitative criteria (qEASL); and to evaluate their role in prediction of pathological necrosis and clinical outcomes. Materials and Methods57 patients with 77 HCCs who underwent TARE were included. Five radiologists recorded multiple imaging features and assigned mRECIST/LIRADS Treatment Response (TR) categories on post-treatment MRI at 4-6 weeks and 6-9 months after TARE. qEASL categories were assigned by a separate reader. Inter-reader variability between LIRADS TR/mRECIST/qEASL were evaluated and hazards regression was used in predicting clinical outcomes. ResultsInter-reader agreement was fair for mRECIST (K = 0.43 and 0.34 at first and second follow-up respectively); moderate for LIRADS TR (K = 0.48 and 0.53 at first and second follow-up respectively). Inter-criterion agreement was moderate to substantial (r = 0.41-0.65 and r = 0.54-0.60 at first and second follow-up) for mRECIST-qEASL. LIRADS TR correlated well with qEASL for all readers at both follow-ups (K = 0.45-0.78; K = 0.39-0.77 for first and second follow-up). qEASL was the most accurate in predicting Tumor-Free Survival (TFS) on first (HR 2.23 [1.44-3.46], p < 0.001) and second (HR 1.69 [1.15-2.48], p = 0.008) follow-up. LIRADS TR was the most accurate in predicting histopathological necrosis (8 patients underwent liver transplantation and 1 patient underwent tumor resection during the period of the study). ConclusionsHCC response assessment following TARE is challenging, resulting in poor to moderate inter-reader agreement for mRECIST, and moderate inter-reader agreement for LIRADS TR response assessment criteria. qEASL outperformed mRECIST criteria for early identification of responders and predicting TFS, suggesting an advantage in volumetric tumor response assessment. LIRADS TR outperformed other criteria in predicting pathological necrosis.

Dixon Imaging of Bone stress injury of knee- comparison to conventional Intermediate-weighted MR imaging

Objectives: Dixon sequence is a chemical shift-based MR sequence that produces four sets of images (water only, fat only, in-phase, and out-of-phase) images and is currently being used in various musculoskeletal applications. The aim of this study was to test the sensitivity of detection and determine the extent of the lesion on the Dixon imaging versus conventional proton density weighted (PDW) imaging in the domain of bone stress injury (BSI) and obtain inter-reader performance. Methods: In this retrospective cross-sectional study, 32 consecutive BSI were compared on conventional imaging versus different Dixon images in terms of area of bone marrow edema, inter-trabecular fracture detection and fracture conspicuity. Inter-reader reliability was also evaluated. p&lt;0.05 was considered statistically significant. Results: The Dixon imaging showed excellent quality except two cases with some motion degradation. BSI detection on Dixon water image is equivalent to the routine fat suppressed fluid sensitive intermediate weighted sequence. BSI area on water image is not significantly different from the intertrabecular lesion area on opposed-phase imaging (p=0.9531). The opposed-phase images detected more number of fractures than the water, PDW, &amp; in-phase images (p&lt;0.0001, =0.0008, and &lt;0.0001, respectively) with superior fracture conspicuity than the water, PDW, &amp; in-phase images (p value &lt;0.0001, =0.0085, and =0.0035, respectively). Fair to moderate inter-reader agreement was seen. Conclusions: Dixon imaging is as sensitive as conventional fat suppressed fluid sensitive imaging of the knee for the identification of bone bruise with superior detection and improved characterization of the intertrabecular fractures. Advances in knowledge: In the domain of bone stress injury (BSI), Dixon opposed-phase MR images detect more number of fractures with better conspicuity than water-only, PDW, and in-phase images.

The use of lung ultrasound compared to chest X-ray to diagnose pneumothorax following the Nuss procedure for pectus excavatum repair in children.

Pectus Excavatum is the most common deformation of the skeletal chest wall, and the Nuss procedure is used to correct this deformation. Residual pneumothorax is a frequent postoperative complication after thoracoscopy. Primary aim of this prospective observational study was to compare the level of agreement among readers using lung ultrasound and chest X-ray. This was an inter-reader single-center prospective observational agreement study for lung ultrasound and chest X-ray. Three lung ultrasound evaluations were performed at the end of surgery in the operating room by two Consultant Anesthesiologist (A1 and A2) and by a medical student (A3). Chest X-ray was interpreted by a consultant Radiologist (R1) and a pool of 11 radiologists (collectively named R2). Cohen's kappa was used to evaluate the level of agreement between the two imaging techniques. Sixty-eight pediatric patients were included in the study. The overall agreement among (A = Anesthesiologist) A1, A2, A3, (R = Radiologist) R1, and R2 in assessing pneumothorax was fair (k=0.32; 95% CI 0.21-0.40). The stratified analysis showed moderate inter-reader agreement among lung ultrasound readers A1, A2, and A3 (k 0.58; 95% CI 0.44-0.71), as opposed to the fair agreement found among chest X-ray readers R1 and R2 (k=0.39; 95% CI 0.18-0.60). Our results support the use of lung ultrasound to diagnose pneumothorax after Nuss procedure. We found that the inter-reader accuracy was better with ultrasound compared to X-ray at our institution.

Multicenter Multireader Evaluation of an Artificial Intelligence-Based Attention Mapping System for the Detection of Prostate Cancer With Multiparametric MRI.

OBJECTIVE. The purpose of this study was to evaluate in a multicenter dataset the performance of an artificial intelligence (AI) detection system with attention mapping compared with multiparametric MRI (mpMRI) interpretation in the detection of prostate cancer. MATERIALS AND METHODS. MRI examinations from five institutions were included in this study and were evaluated by nine readers. In the first round, readers evaluated mpMRI studies using the Prostate Imaging Reporting and Data System version 2. After 4 weeks, images were again presented to readers along with the AI-based detection system output. Readers accepted or rejected lesions within four AI-generated attention map boxes. Additional lesions outside of boxes were excluded from detection and categorization. The performances of readers using the mpMRI-only and AI-assisted approaches were compared. RESULTS. The study population included 152 case patients and 84 control patients with 274 pathologically proven cancer lesions. The lesion-based AUC was 74.9% for MRI and 77.5% for AI with no significant difference (p = 0.095). The sensitivity for overall detection of cancer lesions was higher for AI than for mpMRI but did not reach statistical significance (57.4% vs 53.6%, p = 0.073). However, for transition zone lesions, sensitivity was higher for AI than for MRI (61.8% vs 50.8%, p = 0.001). Reading time was longer for AI than for MRI (4.66 vs 4.03 minutes, p < 0.001). There was moderate interreader agreement for AI and MRI with no significant difference (58.7% vs 58.5%, p = 0.966). CONCLUSION. Overall sensitivity was only minimally improved by use of the AI system. Significant improvement was achieved, however, in the detection of transition zone lesions with use of the AI system at the cost of a mean of 40 seconds of additional reading time.

Contrast-Enhanced Ultrasound Liver Imaging Reporting and Data System in Diagnosing Hepatocellular Carcinoma: Diagnostic Performance and Interobserver Agreement.

To determine the diagnostic performance and inter-reader agreement of the contrast-enhanced ultrasound liver imaging reporting and data system (CEUS-LI-RADS) for diagnosing hepatocellular carcinoma (HCC) in high-risk patients. In this prospective study, CEUS-LI-RADS categories (LR-5 for predicting HCC) were assigned by six blinded readers and compared to the definitive HCC diagnosis in patients with liver cirrhosis per the 2017 China Liver Cancer Guidelines (CLCG). CEUS features were recorded in 96 patients with 96histology-proven lesions. The diagnostic performance of LR-5 was described by the sensitivity, specificity and accuracy. Multi-reader agreement was assessed by using intraclass correlation coefficients (ICC). In cirrhotic patients, the specificity of LR-5 (range: 92.7-100.0 %) was statistically higher than that of CLCG for each reader (range: 28.6-64.3 %). However, the sensitivity (range: 38.6-63.6 %) and accuracy (range: 53.4-70.7 %) were statistically lower in CEUS-LIRADS than in CLCG (sensitivity range: 88.6-100.0 %; accuracy range: 77.6-86.2 %). Only fair to moderate inter-reader agreement was achieved for the CEUS-LI-RADS category (ICC = 0.595) and washout appearance (ICC range: 0.338 to 0.555). Neither nodule-in-nodule nor mosaic architecture was observed more often in HCC (all P > 0.05), with poor inter-reader consistency for both (both ICC < 0.20). CEUS-LI-RADS category 5 has a high specificity but a low accuracy for identifying HCC in high-risk patients. Inter-reader agreement is not satisfactory concerning CEUS-LIRADS category and washout appearance. Moreover, the clinical value of ancillary features favoring HCC is quite limited.

Manual prostate cancer segmentation in MRI: interreader agreement and volumetric correlation with transperineal template core needle biopsy.

To assess interreader agreement of manual prostate cancer lesion segmentation on multiparametric MR images (mpMRI). The secondary aim was to compare tumor volume estimates between MRI segmentation and transperineal template saturation core needle biopsy (TTSB). We retrospectively reviewed patients who had undergone mpMRI of the prostate at our institution and who had received TTSB within 190days of the examination. Seventy-eight cancer lesions with Gleason score of at least 3 + 4 = 7 were manually segmented in T2-weighted images by 3 radiologists and 1 medical student. Twenty lesions were also segmented in apparent diffusion coefficient (ADC) and dynamic contrast enhanced (DCE) series. First, 20 volumetric similarity scores were computed to quantify interreader agreement. Second, manually segmented cancer lesion volumes were compared with TTSB-derived estimates by Bland-Altman analysis and Wilcoxon testing. Interreader agreement across all readers was only moderate with mean T2 Dice score of 0.57 (95%CI 0.39-0.70), volumetric similarity coefficient of 0.74 (0.48-0.89), and Hausdorff distance of 5.23mm (3.17-9.32mm). Discrepancy of volume estimate between MRI and TTSB was increasing with tumor size. Discrepancy was significantly different between tumors with a Gleason score 3 + 4 vs. higher grade tumors (0.66ml vs. 0.78ml; p = 0.007). There were no significant differences between T2, ADC, and DCE segmentations. We found at best moderate interreader agreement of manual prostate cancer segmentation in mpMRI. Additionally, our study suggests a systematic discrepancy between the tumor volume estimate by MRI segmentation and TTSB core length, especially for large and high-grade tumors. • Manual prostate cancer segmentation in mpMRI shows moderate interreader agreement. • There are no significant differences between T2, ADC, and DCE segmentation agreements. • There is a systematic difference between volume estimates derived from biopsy and MRI.

Interreader Concordance of the TI-RADS: Impact of Radiologist Experience.

OBJECTIVE. The objective of this article is to assess radiologist concordance in characterizing thyroid nodules using the American College of Radiology Thyroid Imaging Reporting and Data System (TI-RADS), focusing on the effect of radiologist experience on reader concordance. MATERIALS AND METHODS. Three experienced and three less experienced radiologists assessed 150 thyroid nodules using the TI-RADS lexicon. Percent concordance was determined for various endpoints. RESULTS. Interreader concordance for the five TI-RADS categories was 87.2% for shape, 81.2% for composition, 76.1% for echogenicity, 72.9% for margins, and 69.8% for echogenic foci. Concordance for individual features was 96.3% for rim calcifications, 90.8% for macrocalcifications, 90.1% for spongiform, 83.5% for comet tail artifact, and 77.7% for punctate echogenic foci. Concordance for the TI-RADS level and recommendation for fine-needle aspiration (FNA) were 50.4% and 78.9%, respectively. Concordance was significantly (p < 0.05) higher for less experienced readers in identifying margins (84.3% vs 67.4%), echogenic foci (76.9% vs 69.3%), comet tail artifact (89.6% vs 79.2%), and punctate echogenic foci (85.3% vs 75.5%), and lower for peripheral rim calcifications (95.0% vs 97.8 %), but was not different (p > 0.05) for the remaining categories and features. CONCLUSION. A range of TI-RADS categories, features, and recommendations for FNA had generally moderate interreader agreement among six radiologists. Our results show that concordance for numerous characteristics was significantly higher for the less experienced versus the more experienced readers. These results suggest that less experienced readers relied more on the explicit TI-RADS criteria, whereas the experienced radiologists partially relied on their accumulated experience when forming impressions. However, the overall TI-RADS level and recommendation for FNA were unaffected, supporting the robustness of the TI-RADS lexicon and its continued use in practice.