Interrater Reliability in Pediatric Urodynamic Tracings: A Pilot Study

Abstract

Urodynamic studies are crucial to neuropathic bladder management and they often determine surgical intervention. However, current evidence indicates that interpretations show poor agreement across physicians. We sought to determine the interrater reliability of urodynamic interpretation in our practice. We hypothesized that there would be strong correlation among pediatric urologists of similar training in a single academic practice. We retrospectively identified patients with neuropathic bladder who underwent urodynamics at our institution between 2014 and 2015. An anonymous electronic survey (phase I) was developed with 20 clinical scenarios, each containing a brief history, a single urodynamic tracing and an accompanying fluoroscopic image. Faculty members assessed each tracing by an online instrument developed using urodynamic reports and published literature. The primary outcome was statistical correlation across raters as measured by the Spearman correlation coefficient. In a followup study (phase II) we investigated the sources of variability in urodynamic interpretations. Six faculty members completed the study with a response rate of 100%. In comparing urodynamic interpretation across raters, the faculty demonstrated a weak to strong correlation (rs 0.39-0.61, p <0.001). A strong correlation was found for fluoroscopic and clinical decision making variables, while electromyography synergy and detrusor overactivity demonstrated weaker correlation across physicians. Faculty interpretations of urodynamic tracings showed only moderate agreement despite a close working relationship and similar training at a single institution. Variability in interpretation can strongly impact patient treatment. Therefore, further work is needed to standardize the reporting and interpretation of urodynamic studies to optimize patient care.