Abstract

Systematic reviewers are increasingly trying to obtain regulatory clinical study reports (CSRs) to correct for publication bias. For instance, our organization, the Institute for Quality and Efficiency in Health Care, routinely asks drug manufacturers to provide full CSRs of studies considered in health technology assessments. However, since cooperation is voluntary, CSRs are available only for a subset of studies analysed. In the case of the inhaled insulin Exubera, the manufacturer refused to cooperate and in 2007 we asked the European Medicines Agency (EMA) to provide the relevant CSRs, but EMA denied access. Other researchers have reported similar experiences.In 2010 EMA introduced a new policy on access to regulatory documents, including CSRs, and has also undertaken further steps. The new policy has already borne fruit: in 2011, by providing additional sections of relevant CSRs, EMA made an important contribution to a review of oseltamivir (Tamiflu).Unfortunately, speedy implementation of the new policy may be endangered. We define a CSR following the International Conference on Harmonisation (ICH) E3 guideline. Although this guideline requires individual patient data listings, it does not necessarily require that these listings be made available in a computer-readable format, as proposed by some regulators from EMA and other agencies. However, access to raw data in a computer-readable format poses additional problems; merging this issue with that of access to CSRs could hamper the relatively simple implementation of the EMA policy. Moreover, EMA plans to release CSRs only on request; we suggest making these documents routinely available on the EMA website.Public access to regulatory data also carries potential risks. In our view, the issue of patient confidentiality has been largely resolved by current European legislation. The risk of other problems, such as conflicts of interest (CoIs) of independent researchers or quality issues can be reduced by transparency measures, such as the implementation of processes to evaluate CoIs and the publication of methods and protocols.In conclusion, regulatory data are an indispensable source for systematic reviews. Because of EMA’s policy change, a milestone for data transparency in clinical research is within reach; let’s hope it is not unnecessarily delayed.

Highlights

  • Non-inclusion of clinical study reports leads to biased evidence syntheses Previous research has shown that the non-inclusion of CSRs in systematic reviews and health technology assessment (HTA) results in an incomplete evidence base and potentially biased conclusions about the effects of an intervention [3,5,6]

  • In an analysis of primary studies and corresponding documents from 16 HTAs of drugs conducted by IQWiG between 2006 and February 2011, we investigated to what extent these three types of documents deliver sufficient information for trial evaluation

  • According to International Conference on Harmonisation (ICH) E3, a CSR, in addition to containing the full protocol, a statistical analysis plan, and summarized efficacy and safety data on all outcomes, contains individual patient data in the format of tabulations or listings, but not necessarily in the format of an electronic database ready for computer-based analysis. (This type of format is only intended to be made available by sponsors on request but is not a regular component of the CSR [13])

Read more

Summary

Background

The effects of publication bias, i.e. the tendency to overestimate benefits and underestimate harms of health care interventions, are well known [1,2]. Health Care (IQWiG), which prepares HTA reports for the German statutory health care system, routinely asks the drug manufacturer to provide an overview of sponsored published and unpublished studies on the drug of interest. From this list we select the studies deemed relevant to the assessment and ask the manufacturer to submit the full CSRs. since submission of study overviews and CSRs by the manufacturer is voluntary, these documents are available only for a subset of the studies assessed (less than 40% [3]). After a struggle of more than 3 years, including a complaint to the European ombudsman (who publicly criticized EMA’s behaviour), the data were provided in February 2011

Main text
Findings
Discussion
Conclusion
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call