Interrater Reliability in Interpretation of Neuropathic Pediatric Urodynamic Tracings: An Expanded Multicenter Study

Abstract

Urodynamic findings often guide treatment for neuropathic bladder and are reported as objective data points in multi-institutional trials. However, urodynamic interpretation can be variable. In a pilot study pediatric urologists interpreting videourodynamics exhibited only moderate agreement despite similar training and practice patterns. We hypothesized the pilot study variability would be replicated in a multi-institutional study. We developed an anonymous electronic survey that contained 20 scenarios, each with a brief patient history, 1 urodynamic tracing and fluoroscopic imagery. All videourodynamics were completed during routine care of patients with neuropathic bladder at a single institution. Pediatric urologists from Centers for Disease Control and Prevention Urologic Protocol sites were invited to complete an interpretation instrument for each scenario. Fleiss kappa and 95% confidence limits were reported, with Fleiss kappa 1.00 corresponding to perfect agreement. The survey was completed by 14 pediatric urologists at 7 institutions. Substantial agreement was seen for assessment of fluoroscopic bladder shape (Fleiss kappa 0.73), while moderate agreement was observed for assessment of bladder safety, end filling detrusor pressure and bladder capacity (Fleiss kappa 0.50, 0.56 and 0.54, respectively). Fair agreement was seen for electromyographic synergy and presence of detrusor overactivity (Fleiss kappa 0.21 and 0.35, respectively). Experienced pediatric urologists demonstrate variability during interpretation of videourodynamic tracings. Subjectivity of assessment of electromyographic activity and detrusor overactivity was confirmed in this expanded study. Future work to improve the reliability of videourodynamic interpretation would improve the quality of clinical care and the quality of multi-institutional studies that use urodynamic data points as outcomes.