Interobserver Agreement after Pipeline Embolization Device Implantation

Abstract

Although flow diversion devices are popular in treatment of aneurysms, angiographic assessment with these devices has rarely been verified by interobserver variability study. The purpose of this study was to determine the interobserver agreement of a 3-point grading system for assessing the angiographic outcome after flow diversion therapy of intracranial, saccular aneurysms and to determine factors affecting such agreement. After approval by the institutional review board, 5 independent readers assessed pretreatment and follow-up digital subtraction angiograms from 96 patients treated with the Pipeline embolization device by using a 3-point grading system (complete, near-complete, and incomplete occlusion). "Minor discrepancy" was defined as a difference between any 2 readers of 1 grade, that is, complete vs near-complete or near-complete vs incomplete. "Major discrepancy" was defined as a difference between any 2 readers in which 1 reader noted complete occlusion and the other reader noted incomplete occlusion. We performed statistical analysis for the interobserver agreement by using the intraclass correlation coefficient. Subgroup analyses for discrepancy rate and ICC were performed for previously coiled aneurysms. The interobserver agreement was excellent (ICC, 0.76; 95% CI, 0.69-0.92). Among 96 cases, there was absolute agreement in 74 (77%), of which 67 had unanimous consensus of "complete" occlusion, 2 "near-complete" occlusion, and 5 "incomplete" occlusion. Discordance between any 2 readers was noted in 22 cases (23%), of which 7 (7.3%) revealed a major discrepancy. Subgroup analysis showed that minor discrepancies were more common among patients previously treated with coils vs those not previously treated with coils (37.5% vs 11.2%; P < .05). The observer agreement regarding occlusion after PED therapy is excellent. Only a minority of cases demonstrated discrepancy considered as major in this study.