Non-response bias in a community survey of drinking, alcohol-related experiences and public opinion on alcohol policy

Abstract

BackgroundThe continuing decline in response rates to household surveys is a concern for the health and social sciences as it increases the risk of selective non-response biasing the estimates of interest. MethodsWe analysed non-response bias in a postal survey measuring drinking behaviour, experience of harm and opinion on local government alcohol policies among residents in six New Zealand communities. The Continuum of Resistance model, which suggests that late respondents to a survey are most similar to non-respondents on the measures of interest, was used to guide our investigation. ResultsMen, younger people, those of Māori descent and those living in more deprived areas were less likely to respond to our survey than women, older people, those not of Māori descent and those living in comparatively affluent areas. Late respondents more closely resembled non-respondents demographically than early respondents. The prevalence of binge drinking and experience of assault was higher, and support for restrictive local government alcohol policies lower, among late respondents. Assuming the drinking behaviour and alcohol-related experiences of non-respondents were the same as those of late respondents, prevalence was under-estimated by 3.4% (relative difference: 13%) and 2.1% (relative difference: 21%) for monthly binge drinking and assault respectively. Policy support was not over-estimated. ConclusionThe findings add to a growing body of evidence suggesting that surveys under-estimate risk behaviour because of selective non-response and this bias increases as response rates fall. Notably, public opinion may not be subject to such misestimation.