Abstract
11079 Background: Phase 3 randomized clinical trials (RCTs) inform the standard of care in cancer treatment yet have a mixed track record of success. In this study, we sought to 1) determine the overall success rate of phase 3 RCTs; 2) assess whether authorship patterns differ between successful (positive) and unsuccessful (negative) trials; and 3) explore if individual authors have distinct track records of success. Methods: The HemOnc knowledgebase (KB) was queried for initial publications of phase 3 RCTs of systemic anticancer therapy; those without primary outcome described were excluded. RCTs were labeled positive if the primary endpoint was met per HemOnc standard criteria (P value ≤ 0.05 or hazard ratio upper bound ≤ 1 for any experimental arm[s]) and negative if they did not meet these criteria or if the experimental arm was statistically inferior. Trial metadata and author information were extracted from the HemOnc KB. Author positive publication rate (PPR) was defined as % of publications reporting a positive result divided by total number of eligible publications. Prolific authors were defined as those with 6+ eligible publications. Author count for manuscripts reporting positive vs negative results was evaluated with the Mann-Whitney U test; other statistics were descriptive. Results: 3328 studies met criteria as of February 5, 2024; these were associated with 3305 initial publications between 1960-2023, involving 25,412 unique authors. 1474 (44.3%) of the studies were positive. Publications reporting positive trial results had, on average, 3 more authors, median (interquartile range) of 18 (12-23) vs 15 (11-20), p<0.0001. The mean (±SD) PPR for n=1967 prolific authors was 47.7% (±22.3%). The PPR was not related to individual author output; mean PPR for non-prolific authors was 48.0% (SD not reported). Differences in PPR were apparent by the disease under study and the years of publication (Table). Among the 46 prolific authors who had a PPR 2+ SD above the mean, 26 (55%) were from China followed by Italy with 3 (6%). Conclusions: Despite known positive publication bias, the success rate of published phase 3 RCTs remains <50%. Publications reporting positive results had significantly more authors; this finding requires further study including adjustment for trial sample size. Significant variation in PPR amongst fields could be due to watershed therapeutic advances, differential selection of primary endpoints, and/or selective reporting of results. Finally, a signal for geographic association of outlier PPRs suggests the need for further investigation. [Table: see text]
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have