Engaging military couples in marital research: does requesting referrals from service members to recruit their spouses introduce sample bias?

Hope Seib Mcmaster,Lauren M Bauer,Kelly A Woodall,Evelyn P Davila,Christopher A O’Malley,Christianna S Williams,Valerie A Stander

doi:10.1186/s12874-018-0575-x

Abstract

BackgroundWhile enrolling dyads in research studies is not uncommon, there is limited literature on the utility of different recruitment strategies and the resulting selection biases. This paper examined two recruitment strategies used to enroll military couples in a longitudinal study, assessing the impact of both strategies on the representativeness of the final study sample.MethodDescriptive and bivariate analyses were conducted to 1) identify characteristics associated with spouse referral, 2) compare response rates based on recruitment strategy and assess whether recruitment strategy modified correlates of response propensity among spouses, and 3) assess whether referred spouse characteristics differed from non-referred spouses in the final sample. The study sample consisted of married US service members with 2–5 years of military service as of October 2011 and their spouses.ResultsService members who referred their spouses to participate in the Millennium Cohort Family Study were more likely to be male, have children, serve in the Army, and have combat deployment experience than those who did not refer their spouse. Nearly two-thirds (n = 5331, 64.9%) of referred spouses participated in the Family Study, compared with less than one-third (n = 3458, 29.5%) of directly contacted spouses. Spouse characteristics also differed significantly between recruitment groups.ConclusionsOverall results suggest that minimal bias was introduced by using a referral recruitment methodology. Service members appeared to be more likely to refer their spouses if they perceived the research topic as relevant to their spouse, such that male service members with combat deployment experience were more likely to refer female spouses caring for multiple children. Referred spouses were significantly more likely to respond to the Millennium Cohort Family Study survey than those who were directly contacted; however, the overall success rate of using a referral strategy was less than recruiting spouses through direct contact. Differences between referred spouses and spouses contacted directly mirrored service member referring characteristics.

Highlights

While enrolling dyads in research studies is not uncommon, there is limited literature on the utility of different recruitment strategies and the resulting selection biases
Service members appeared to be more likely to refer their spouses if they perceived the research topic as relevant to their spouse, such that male service members with combat deployment experience were more likely to refer female spouses caring for multiple children
Referred spouses were significantly more likely to respond to the Millennium Cohort Family Study survey than those who were directly contacted; the overall success rate of using a referral strategy was less than recruiting spouses through direct contact

Summary

Introduction

While enrolling dyads in research studies is not uncommon, there is limited literature on the utility of different recruitment strategies and the resulting selection biases. Medical researchers interested in patient outcomes may study patient-caregiver dyads [5, 6] and often conduct studies of twins in order to tease apart genetic and environmental influences on health [7]. Despite their importance, dyadic research designs present a multitude of methodological complexities [5], beginning with the challenge of recruiting a representative sample of participant pairs. It is even less common to have some form of public record available for the entire recruitment population (e.g., marriage license records), so the representativeness of the sample can be empirically determined and reported [8]

Objectives

Methods

Results

Discussion

Conclusion