The importance of the design of observational studies in comparative effectiveness research: Lessons from the GARFIELD-AF and ORBIT-AF registries

Abstract

Randomized controlled trials (RCTs) are considered the gold standard for estimating the effectiveness of a treatment. However, in many instances they are impractical to conduct because of time limitations, cost restrictions, or ethical reasons. As a consequence, non-randomized observational studies have an important role in comparative effectiveness and safety research since they can address issues that would not be possible using conventional RCT methodology. Observational studies can be strategically designed to reduce the risk of potential sources of bias by emulating the design principles of an equivalent but ideal randomized trial - the target trial - that would answer the research question of interest. In this article, we review some of the necessary components of observational studies required for valid causal inference within the framework of target trial emulation, so as to avoid common methodological pitfalls of study design. We discuss the assumptions of consistency, time-zero specification, exchangeability and positivity. To illustrate these concepts in a context where existing knowledge is well-established through clinical trials, we evaluate and compare the treatment effects of vitamin K antagonists (VKA) against no VKA (No VKA) on the treatment of atrial fibrillation from two real-world observational studies, namely the GARFIELD-AF and ORBIT-AF registries. Results are compared with those of published RCTs.