An evaluation method for the designing quality of language item questions in censuses

Abstract

ABSTRACT Globally, countries or regions across from east to west like Hong Kong, Macao, Taiwan, Singapore, the United Kingdom, and the United States have incorporated language item questions in their censuses. The assessment of such design advantages and disadvantages is crucial for academic investigation. Despite ongoing discussions, there is a noticeable lack of comprehensive references offering a full set of evaluation methods for assessing these question designs. Current literature often focuses on specific aspects, underscoring the need for a holistic evaluation. This research employs literature and induction methodologies to assess the design quality of language item questions in censuses. After reviewing past references and analysing 74 questionnaires collected from nine countries and regions over three centuries, we have identified 37 specific criteria. These criteria, categorised into economy, comprehensiveness, and rationality, form a comprehensive evaluation framework. This new framework offers a systematic approach for assessing census language question design, with significant implications for policy-making and academia. It provides a valuable tool for policymakers to make informed decisions about language question design, and serves as a guide for future academic research in this field.