Using Transportability to Understand Differences in Mediation Mechanisms Across Trial Sites of a Housing Voucher Experiment.

Abstract

Randomized trials may have different effects in different settings. Moving to Opportunity (MTO), a housing experiment, is one such example. Previously, we examined the extent to which MTO's overall effects on adolescent substance use and mental health outcomes were transportable across the sites to disentangle the contributions of differences in population composition versus differences in contextual factors to site differences. However, to further understand reasons for different site effects, it may be beneficial to examine mediation mechanisms and the degree to which they too are transportable across sites. We used longitudinal data from MTO youth. We examined mediators summarizing aspects of the school environment over the 10-15 year follow-up. Outcomes of past-year substance use, mental health, and risk behavior were assessed at the final timepoint when participants were 10-20 years old. We used doubly robust and efficient substitution estimators to estimate (1) indirect effects by MTO site and (2) transported indirect effects from one site to another. Differences in indirect effect estimates were most pronounced between Chicago and Los Angeles. Using transport estimators to account for differences in baseline covariates, likelihood of using the voucher to move, and mediator distributions partially to fully accounted for site differences in indirect effect estimates in 10 of the 12 pathways examined. Using transport estimators can provide an evidence-based approach for understanding the extent to which differences in compositional factors contribute to differences in indirect effect estimates across sites, and ultimately, to understanding why interventions may have different effects when applied to new populations.