Can Social Desirability Be Detected Statistically at the Macro-Sociological Level?

Abstract

While a few have argued that social science has been subject to progressive biases, others have discounted such ideas. However, no one has yet performed empirical tests over a large range of studies for such possible bias, which we label macro-level social desirability (MLSD). Combining the results from fifty-nine empirical studies that assessed rates of nonheterosexuality among children of same-sex parents, we found that the higher the maximum rates reported, the less likely those reports were to have been cited in Google Scholar by counts or by annual rate, which may reflect MLSD. However, after several statistical controls, the association for counts became non-significant, while the association for rates became stronger, although the effect sizes were in a moderate (d = .28 or higher) to large range (d, up to .68) by either analysis. Generally, research quality acted as a suppressor variable for MLSD but was significantly related to both counts and rates of citations, indicating that higher quality articles were more likely to have been cited, even controlling for the number of years since first publication. Higher quality articles were slightly more likely to report higher rates of nonheterosexuality among children of same-sex parents. We discuss implications of our findings and suggest future directions of research.