Evidence from Nonrandomized Studies: A Case Study on the Estimation of Causal Effects

Abstract

Although randomized controlled trials are regarded as the gold standard for comparison of treatments, evidence from observational studies is still relevant. To cope with the problem of possible confounding in these studies, investigators need methods for analyzing their results which adjust for confounders and lead to unbiased estimation of the treatment effect. In this paper, the authors describe the main principles of three statistical methods for doing this. The first method is the classical approach of a multiple regression model including the effects of treatment and covariates. This considers the relation between prognostic factors and the outcome variable as a relevant criterion for adjustment. The second method is based on the propensity score, focusing on the relation between prognostic factors and treatment assignment. The third method is an ecologic approach using a grouped treatment variable, which may aid in avoiding confounding by indication. These approaches are applied to a partially randomized trial conducted in 720 German breast cancer patients between 1984 and 1997. The study had a comprehensive cohort study design that included recruitment of patients who had consented to participation but not to randomization because of a preference for one of the treatments. This design offers a unique opportunity to contrast results from the nonrandomized portion of a study with those for a randomized subcohort as a reference.