Challenges in Cross‐National Data Collection

Abstract

Beth-Ellen Pennell Janet Harkness Rachel Levenstein Martine Quaglia X.1 Introduction This chapter discusses issues and considerations in data collection in cross-national and cross-cultural surveys. Although the extensive literature on the goals of comparative research frequently discusses challenges to equivalence and problems which may arise in such research (Mohler and Johnson, this volume), there appears to be little detailed investigation of the role that data collection plays in this process, particularly with regard to how to approach the design and implementation of data collection efforts in order to achieve greater equivalence. This chapter explores the various aspects of data collection and alerts the reader to issues especially relevant to cross-national or cross-cultural survey research. The material that follows is organized into seven sections, including this introduction. Section X.2 sets the stage for later discussion by addressing the complexity of cross-national survey research and the central role quality monitoring and documentation play in data collection. Section X.3 discusses organizational structures in large-scale projects, the importance of achieving standardization at the appropriate level of implementation, and the impact and relevance of country-specific variations in research infrastructure and traditions. Section X.4 focuses on data collection modes, considering the options and constraints in cross-national data collection efforts. Section X.5 deals with the numerous considerations directly related to fielding a survey: 5.1 addresses field staffing, the languages to be accommodated, and interviewer recruitment, training and remuneration; in 5.2, study protocols and procedures relevant for the data collection phase are considered; topics covered include ethics reviews, community engagement models, household contact protocols, privacy issues, nonresponse bias reduction; and collecting biomarker and other physical measures. Section 5.3 deals with field structures, and interviewer supervision and management during fielding. In section 6, testing, quality monitoring and control are discussed, illustrating the importance of monitoring and evaluating survey outcomes . Issues particular to natural disaster and longitudinal studies are also noted . The final section, Section 7 highlights areas of future research and visits the role that documentation of procedures and survey outcomes can play in developing best practices for cross-national or cross-cultural survey data collection. x.2 Background Potential challenges to comparability are myriad in cross-national data collection. Examples include collecting data in multiple languages and dialects (some possibly without a standard