Cross-Validating Measures of Global Religious Intolerance: Comparing Coded State Department Reports with Survey Data and Expert Opinion

Abstract

AbstractWe address a pressing substantive issue as well as evaluate several methodologies in this article. Substantively, we ask whether the U.S. State Department has a clear understanding of the level of cross-national religious intolerance that triggers daily headlines around the globe. Methodologically, we ask whether data on social attitudes coded from systematic qualitative reports can reliably represent cross-national public opinion. We empirically address these questions by comparing cross-national levels of religious intolerance coded from the State Department's annual international religious freedom reports with relevant population survey data from the World Values Survey and the Pew Research Center, as well as with data from written interviews of country experts conducted by the Hudson Institute. The results indicate that the understanding of social religious intolerance embodied in the State Department reports is comparable with the results of population surveys and individual expert opinion. Methodologically, this suggests that cross-national public opinion survey data can be cross-validated with coded data from systematic qualitative analysis as well as with expert opinion.