Validity Of Survey Questions Research Articles

The measurement of gender expression in survey research

Previous research on the survey measurement of sexual orientation, gender identity, and gender expression (SOGIE) often focuses on the measurement of identity, with comparably little research focused on gender expression as a key feature of how gender is lived and experienced. This study examines the reliability and validity of survey questions about gender expression in a 2-by-5-by-2 factorial experiment that varies the question order, type of response scale, and the order of gender presentation in the response scale.The results indicate that the effect of which (side of the) scale is presented first on gender expression varies by gender for each of the unipolar items and one of the bipolar items (behavior). In addition, the unipolar items also show distinctions among the gender minority population in ratings of gender expression as well as more nuance with respect to concurrent validity in predicting health outcomes among cisgender respondents. The results of this study have implications for researchers who are interested in accounting for gender holistically in survey and health disparities research.

A Multidimensional Analysis of Teacher Preparation in Texas

Despite a healthy production of teachers, teacher attrition is a significant concern facing school administrators across the state of Texas. This study sought to determine the extent to which questions on the Exit and Principal Surveys reflect three sets of standards which guide educator preparation in Texas: Association of Teacher Educators (ATE) Standards for Teacher Educators, Texas Administrative Code (TAC) Educator Preparation Program Curriculum Standards, and Pedagogy and Professional Responsibilities (PPR) Exam Standards. This analysis provides important information about the validity of survey questions as a measure of standards compliance for educator preparation in Texas and also sought to determine if there is a difference between teacher candidates’ Exit Survey evaluation of preparation and principals’ Principal Survey evaluation of first-year teachers’ preparation. Findings indicated a clear disconnect. Recommendations are provided as contributions for future discussion on much needed educator preparation program standards reform.

The relative size of measurement error and attrition error in a panel survey. Comparing them with a new multi-trait multi-method model

This paper proposes a method to simultaneously estimate both measurement and nonresponse errors for attitudinal and behavioural questions. The method uses a Multi-Trait Multi-Method (MTMM) approach, which is commonly used to estimate the reliability and validity of survey questions. The classic MTMM model is in this paper extended to include the effects of measurement bias and longitudinal nonresponse. Measurement and nonresponse errors are expressed on a common metric in this model, so that their relative sizes can be assessed over the course of a panel study. Using an example about political trust from the Dutch LISS panel, we show that measurement problems lead to both small errors and small biases, that dropout in the panel study does not lead to errors or bias, and that therefore, measurement is a more important source of both error and bias than nonresponse.

The Effect of Active Transport, Transport Systems, and Urban Design on Population Health

The Effect of Active Transport, Transport Systems, and Urban Design on Population Health

The Validity and Reliability of Survey Questions

Inspired by the research of Frank Andrews on the reliability and validity of survey questions, a large-scale research project was conducted in the Netherlands. The project was comprised of two different stages. For this project, more than 600 survey questions were included in different surveys according to a multitrait-multimethod design. The resulting data were analyzed in two steps. In the first step, estimates of validity and reliability were obtained for each question. The second step was a meta-analysis of the variation in data quality found in the first step. This variation was related to question-specific characteristics, response scale characteristics, context characteristics, and design characteristics. The article describes how the results of this study can be of practical use. In addition, the authors compare them to results of similar studies in the United States, Austria, and other Western, Central, and Eastern European countries.