Low Methodological and Reporting Quality of Randomized, Controlled Trials of Devices to Treat Urolithiasis

Abstract

We assessed the methodological and reporting quality of randomized, controlled trials of stone disease management and determined whether the reporting quality of randomized, controlled trials improved with time. We systematically searched the literature for randomized, controlled trials of urolithiasis treatment. We developed and pilot tested a data extraction checklist based on CONSORT (Consolidated Standards of Reporting Trials) criteria as well as a clinical checklist relevant to urolithiasis, each scored as 0 to 25. Our primary outcome measures were the mean differences in CONSORT and clinical summary scores with time. We performed statistical hypothesis testing using the Student t-test with 2-sided α = 0.05 to compare scores between 2002 to 2006 and 2007 to 2011. A total of 104 randomized, controlled trials met study inclusion criteria. The most common procedure types studied were percutaneous nephrolithotomy (41.3%), ureteral stenting (28.8%) and shock wave lithotripsy (25.0%). Mean ± SE CONSORT summary scores were 11.4 ± 0.4 and 12.1 ± 0.3 in 2002 to 2006 and 2007 to 2011, respectively, with a mean difference of 0.7 (95% CI -0.3-1.6, p = 0.167). Mean clinical summary scores were 7.4 ± 0.5 and 9.3 ± 0.4 in 2002 to 2006 and 2007 to 2011, respectively, with a mean difference of 1.8 (95% CI 0.6-3.1, p = 0.004). While the number of randomized, controlled trials of urological devices used to treat stone disease substantially increased with time, methodological and clinical reporting quality remains suboptimal. This compromises their credibility and warrants efforts to promote appropriate performance of future endourological studies.