Interobserver Variability of Ultrasound Features Based on American College of Radiology Thyroid Imaging Reporting and Data System Lexicon in American College of Radiology Thyroid Imaging Reporting and Data System System: A Single-Center Study With Radiologists and Radiology Residents.

Abstract

The aim of this study is to evaluate the variability of selecting the ultrasound features used in American College of Radiology Thyroid Imaging Reporting and Data System (ACR-TIRADS) and in assigning the ACR-TIRADS level in a single center among radiologists and radiology residents. The study cohort consisted of 108 thyroid nodules in 102 patients who had definite cytology results after thyroid fine needle aspiration biopsy (Bethesda category II, VI) or surgery. Seven observers including 3 radiologists and 4 radiology residents evaluated the nodules according to 5 ultrasound feature categories. The evaluation process was performed after a joint meeting session, in which the "white papers" of the ACR-TIRADS committee were discussed regarding the thyroid ultrasound reporting lexicon, and final TIRADS system. Variability of ultrasound features and assigning ACR-TIRADS level was measured using Fleiss kappa statistics. Agreement for ultrasound features was "substantial" to "almost perfect" among all observers, with composition (κ = 0.86), macrocalcification (κ = 0.89) and peripheral calcification (κ = 0.92) at the highest level of agreement. The level of agreement for large comet tail artifacts and punctate echogenic foci was "moderate" in residents, whereas in radiologists, that level was "substantial." The agreement for assigning ACR-TIRADS level was moderate in resident as well as in radiologist subgroup. Agreement of thyroid ultrasound features was "substantial to almost perfect" among all observers. Although the level of agreement among resident group decreased to "moderate" level, ACR-TIRADS is a useful system in thyroid nodule management.