Do middle-aged and older people underreport loneliness? experimental evidence from the Netherlands

Abstract

Despite the growing acknowledgment of the importance of loneliness among older individuals, questionnaire length constraints may hinder the inclusion of common multi-item loneliness scales in surveys. Direct, single-item loneliness measures are a practical alternative, but scholars have expressed concerns that such measures may lead to underreporting. Our aim was to test whether such reservations are justified. We conducted a preregistered list experiment among 2,553 people aged 50 + who participated in the Dutch Longitudinal Internet studies for the Social Sciences (LISS) panel. The list experiment method has been developed to unobtrusively gather sensitive information. We compared the list experiment estimate of the prevalence of frequent loneliness with the corresponding direct question estimate to assess downward bias in the latter. Next to pooled models, we estimated models stratified by gender to assess whether loneliness underreporting differed between women and men. Relying on the direct question, we estimated that 5.9% of respondents frequently felt lonely. Our list experiment indicated that the prevalence of frequent loneliness was 13.1%. Although substantial in magnitude, the difference between both estimates was only marginally significant (Δb: 0.072, 95% CI: − 0.003;0.148, p = .06). No evidence of gender differences was found. Although we cannot be conclusive that loneliness estimates are biased downward when a direct question is used, our results call for caution with direct, single-item measures of loneliness if researchers want to avoid underreporting. Replications are needed to gain more precise insights into the extent to which direct, single-item loneliness measures are prone to downward reporting bias.