Acquiescence Response Research Articles

Response bias is genetically biased: Another argument for Kagan's philippic against questionnaires in developmental psychology.

One of the concerns of Jerome Kagan (2007) in his article "A Trio of Concerns" was the frequent use of questionnaires in developmental psychology and related disciplines. His main reasons were the minimal overlap between (self-)reported and observed phenotypes, the ambiguity of items, and systematic socioeconomic status (SES) disparities in responding. We wondered whether genetic differences would also influence response bias in cases of ambiguous or even absurd items triggering an acquiescence bias to agree with even impossible question content. We examined the genetic predisposition for the acquiescence response bias in 257 families with twins. Both parents and twins completed a modified Wildman Symptoms Questionnaire and provided salivary DNA samples. From published genome-wide association studies (GWAS), we derived polygenic score (PGS) algorithms for indicators of SES (educational attainment [EA] and income) and for general intelligence (IQ), which were applied to the GWAS results of our participants' DNA. The twins (N = 514 children, 55% monozygotic pairs) were on average 7.92 years old (SD = 0.66), and 51.6% were female. The primary parents were on average 40.48 years old (SD = 4.66), and 91% were female. In 90% of the families, both parents were born in the Netherlands and 91% were from a middle or higher socioeconomic background. Higher PGSs for EA and income but not for IQ predicted less acquiescence response bias in parents and children. In addition to Kagan's reasons for his concerns about questionnaires, we found a genetic predisposition to response bias triggered by the ambiguous form of questions and answers. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Courage Measure (CM) – Cross-Cultural Adaptation and Psychometric Properties for Brazilian Adolescents

Abstract: The objective of the study was to adapt the Courage Scale and estimate validity evidence based on content and internal structure. The study included 510 young people, between 14 and 19 years old. The results of the content validity coefficient suggested the adequacy of the content. Confirmatory factor analysis (CFA) was used to test three factor models, namely one-factor, two-factor, and the random intercept model. The results indicated that it is possible to measure courage through a factor, when the acquiescent response style is controlled, corroborating the theoretical perspective, given that the random intercept model adjusted well to the sample data. In other words, the findings indicate that the scale is capable of measuring courage in the Brazilian context and that acquiescence control is an important method in evaluating the construct.

Exploring the Influence of Response Styles on Continuous Scale Assessments: Insights From a Novel Modeling Approach.

The use of discrete categorical formats to assess psychological traits has a long-standing tradition that is deeply embedded in item response theory models. The increasing prevalence and endorsement of computer- or web-based testing has led to greater focus on continuous response formats, which offer numerous advantages in both respondent experience and methodological considerations. Response styles, which are frequently observed in self-reported data, reflect a propensity to answer questionnaire items in a consistent manner, regardless of the item content. These response styles have been identified as causes of skewed scale scores and biased trait inferences. In this study, we investigate the impact of response styles on individuals' responses within a continuous scale context, with a specific emphasis on extreme response style (ERS) and acquiescence response style (ARS). Building upon the established continuous response model (CRM), we propose extensions known as the CRM-ERS and CRM-ARS. These extensions are employed to quantitatively capture individual variations in these distinct response styles. The effectiveness of the proposed models was evaluated through a series of simulation studies. Bayesian methods were employed to effectively calibrate the model parameters. The results demonstrate that both models achieve satisfactory parameter recovery. Neglecting the effects of response styles led to biased estimation, underscoring the importance of accounting for these effects. Moreover, the estimation accuracy improved with increasing test length and sample size. An empirical analysis is presented to elucidate the practical applications and implications of the proposed models.

Cognitive Functioning and the Quality of Survey Responses: An Individual Participant Data Meta-Analysis of 10 Epidemiological Studies of Aging.

Self-reported survey data are essential for monitoring the health and well-being of the population as it ages. For studies of aging to provide precise and unbiased results, it is necessary that the self-reported information meets high psychometric standards. In this study, we examined whether the quality of survey responses in panel studies of aging depends on respondents' cognitive abilities. Over 17 million survey responses from 157,844 participants aged 50 years and older in 10 epidemiological studies of aging were analyzed. We derived 6 common statistical indicators of response quality from each participant's data and estimated the correlations with participants' cognitive test scores at each study wave. Effect sizes (correlations) were synthesized across studies, cognitive tests, and waves using individual participant data meta-analysis methods. Respondents with lower cognitive scores showed significantly more missing item responses (overall effect size ρ^ = -0.144), random measurement error (ρ^ = -0.192), Guttman errors (ρ^ = -0.233), multivariate outliers (ρ^ = -0.254), and acquiescent responses (ρ^ = -0.078); the overall effect for extreme responses (ρ^ = -0.045) was not significant. Effect sizes were consistent across studies, modes of survey administsration, and different cognitive functioning domains, although some cognitive domain specificity was also observed. Lower-quality responses among respondents with lower cognitive abilities add random and systematic errors to survey measures, reducing the reliability, validity, and reproducibility of survey study results in aging research.

Does Acquiescence Disagree with Measurement Invariance Testing?

Measurement invariance (MI) is required for validly comparing latent constructs measured by multiple ordinal self-report items. Non-invariances may occur when disregarding (group differences in) an acquiescence response style (ARS; an agreeing tendency regardless of item content). If non-invariance results solely from neglecting ARS, one should not worry about scale inequivalences but model the ARS instead. In a simulation study, we investigated the effect of ARS on MI testing, both when including ARS as a factor in the measurement model or not. For (semi-) balanced scales, disregarding a large ARS resulted in non-invariance already at the configural level. This was resolved by including an ARS factor for all groups. For unbalanced scales, disregarding ARS did not affect MI testing, and including an ARS factor often resulted in non-convergence. Implications and recommendations for applied research are discussed.

A Systematic Review of Response Styles Among Latinx Populations.

Culture influences responses to psychological measurements in ways unrelated to target constructs, thus biasing test scores and potentially contributing to under- and over-diagnosis of mental health problems in populations for which measures have not yet been normed. We conducted a systematic review of publications addressing response style among Latinx population groups in North and South America. In a final corpus of 24 studies, Latinx/Latin American populations were generally found to exhibit higher levels of extreme response style (n = 17), acquiescent response style (n = 10), and socially desirable responding (n = 5). The few publications (n = 3) that investigated midpoint responding reported no differences. Seven publications (29%) attempted to adjust scores to mitigate response style bias, using both scale design and statistical techniques. Findings suggest that researchers and clinicians should directly assess culturally patterned response style as a construct, rather than inferring style indirectly using other measures. For clinicians, knowledge of response style represents another facet of case conceptualization.

The Effect of Response Formats on Response Style Strength

Abstract: Many researchers use self-report data to examine abilities, personalities, or attitudes. At the same time, there is a widespread concern that response styles, such as the tendency to give extreme, midscale, or acquiescent responses, may threaten data quality. As an alternative to post hoc control of response styles using psychometric models, a priori control using specific response formats may be a means to reduce biasing response style effects in self-report data in day-to-day research practice. Previous research has suggested that response styles were less influential in a Drag-and-Drop (DnD) format compared to the traditional Likert-type format. In this article, we further examine the advantage of the DnD format, test its generalizability, and investigate its underlying mechanisms. In two between-participants experiments, we tested different versions of the DnD format against the Likert format. We found no evidence for reduced response style influence in any of the DnD conditions, nor did we find any difference between the conditions in terms of the validity of the measures to external criteria. We conclude that adaptations of response formats, such as the DnD format, may be promising, but require more thorough examination before recommending them as a means to reduce response style influence in psychological measurement.

Identifying the structure of within‐team variance in ratings of team constructs

AbstractResearchers frequently assume some degree of consensus among team members' perceptions when aggregating individual survey responses to the team level. Literature reviews have routinely found, however, substantial within‐team variance in referent‐shift consensus measures of team constructs and that team member agreement is often lower than desired. To enhance our understanding of the structure of within‐team variance, using a sample of 20,183 individuals in 4,313 teams, we explored the proportion of variance attributable to different sources (response acquiescence, positivity bias, and rater variance specific to each construct) for five team constructs. We also examined the extent to which within‐team variance changed over time with a subsample of 3,720 individuals in 731 teams. The results indicated that constructs thought to be more observable, including role clarity and monitoring goal progress, appeared to be less prone to idiosyncratic perceiver effects and that the processes were widely experienced by all team members. Conversely, relationship conflict showed higher levels of within‐team variance and team consensus actually decreased over time. These findings indicate that perceptions of relationship conflict are influenced by the individual differences of team members and that conflict may be restricted to dyads or subgroups within teams. Overall, the findings indicate that stable perceiver effects and processes that are limited to a small proportion of team members may have a stronger influence on ratings of some team constructs than previously thought. We conclude with suggestions for theory development, team construct measurement, and advice to understand processes that lead to consensus in perceptions of team constructs.

A Tree-Based Approach to Identifying Response Styles with Anchoring Vignettes

ABSTRACT Survey score interpretations are often plagued by sources of construct-irrelevant variation, such as response styles. In this study, we propose the use of an IRTree Model to account for response styles by making use of self-report items and anchoring vignettes. Specifically, we investigate how the IRTree approach with anchoring vignettes compares to traditional approaches that either do not include anchoring vignettes or do not account for response styles. We analyze secondary data using four different models: 1) total score; 2) graded response model; 3) IRTree without the consideration of anchoring vignettes, and 4) IRTree considering anchoring vignettes. We found significant differences in trait estimates from models that account for response styles compared to those that do not. Additionally, we found differences in trait estimates between the IRTree Models when considering anchoring vignettes and when not. Model comparisons suggest that trait differences are due to adjusting for acquiescence response style.

Individual-Level Cultural Factors and Use of Survey Response Styles Among Latino Survey Respondents

Acquiescent (ARS) and extreme response styles (ERS) can have detrimental effects on survey data and, for unknown reasons, are more frequently used by Latino than non-Latino white respondents. This exploratory study examined the influence of culture on these response styles by investigating their associations with individual-level cultural factors and ARS and ERS among 1,296 Mexican American, Puerto Rican, and Cuban American telephone survey respondents. Principal components representing stronger endorsement of marianismo/ machismo and social attentiveness ( simpatía, personalismo, respect for elders, value for sincerity, collectivism, individualism) were associated with higher ARS and ERS, while higher trust in strangers and more limited health literacy were associated with lower ERS. Findings from this study will enable survey designers to better anticipate ARS and ERS in surveys with Latino populations and, in turn, guide the selection of data collection and analysis methods to mitigate measurement error in the presence of these response styles.

Promotion of on-line pharmacies in social media - frequency and content

Acquiescent response style (ARS) refers to survey respondents’ tendency to choose response categories agreeing to questions regardless of their content and is hypothesized as a stable respondent trait. While what underlies acquiescence is debatable, the effect of ARS on measurement is clear: bias through artificially increased agreement ratings. With certain population subgroups (e.g., racial/ethnic minorities in the U.S.) are associated with systemically higher ARS, it causes concerns for research involving those groups. For this reason, it may be necessary to classify respondents as acquiescers or a nonacquiescers, which allows independent analysis or accounting for this stylistic artifact. However, this classification is challenging, because ARS is latent, observed only as a by-product of collected data.To propose a screener that identifies respondents as acquiescers.With survey data collected for ARS research, various ARS classification methods were compared for validity as well as implementation practicality.The majority of respondents was classified consistently into acquiescers or nonacquiescers under various classification methods.We propose a method based on illogical responses given to two balanced, theoretically distant multi-item measurement scales as a screener.

Awareness Is Bliss: How Acquiescence Affects Exploratory Factor Analysis.

Assessing the measurement model (MM) of self-report scales is crucial to obtain valid measurements of individuals' latent psychological constructs. This entails evaluating the number of measured constructs and determining which construct is measured by which item. Exploratory factor analysis (EFA) is the most-used method to evaluate these psychometric properties, where the number of measured constructs (i.e., factors) is assessed, and, afterward, rotational freedom is resolved to interpret these factors. This study assessed the effects of an acquiescence response style (ARS) on EFA for unidimensional and multidimensional (un)balanced scales. Specifically, we evaluated (a) whether ARS is captured as an additional factor, (b) the effect of different rotation approaches on the content and ARS factors recovery, and (c) the effect of extracting the additional ARS factor on the recovery of factor loadings. ARS was often captured as an additional factor in balanced scales when it was strong. For these scales, ignoring extracting this additional ARS factor, or rotating to simple structure when extracting it, harmed the recovery of the original MM by introducing bias in loadings and cross-loadings. These issues were avoided by using informed rotation approaches (i.e., target rotation), where (part of) the rotation target is specified according to a priori expectations on the MM. Not extracting the additional ARS factor did not affect the loading recovery in unbalanced scales. Researchers should consider the potential presence of ARS when assessing the psychometric properties of balanced scales and use informed rotation approaches when suspecting that an additional factor is an ARS factor.

Four-dimensional hierarchical structure of love constructs in a cross-cultural perspective

This article reports new methodology for cross-cultural exploration of psychometric properties of a four-dimensional hierarchical love scale. We collected data from 2831 participants from nine regional locations from six countries and assessed their responses to the love scale as well as several other love feelings. We applied a new methodological approach using recently advanced statistical methods to the comparison of forty love attitudes underscoring four distinct latent attitudes associated with love to another person in romantic relationships across these samples. The results demonstrate the importance of measurement invariance tests for cross-cultural comparison of scores on love scales. To properly assess measurement invariance, we suggest five statistical procedures, which we investigated in this study: (1) making corrections for acquiescence and extreme response biases; (2) taking into consideration cultural uniqueness in how participants respond to the measures, which may contribute to poor model fit; (3) accounting for such cultural uniqueness to make cross-cultural comparisons more valid; (4) removing items, which substantially contribute to poor model fit; and (5) shortening the subscales when scoring and analyzing the data. The results of the studies propose two shortened versions (33 and 30 items) of the love scale as two cross-culturally valid and invariant alternatives to the original 40-item scale.

Developing a short screener for acquiescent respondents.

Acquiescent response style (ARS) refers to survey respondents' tendency to choose response categories agreeing to questions regardless of their content and is hypothesized as a stable respondent trait. While what underlies acquiescence is debatable, the effect of ARS on measurement is clear: bias through artificially increased agreement ratings. With certain population subgroups (e.g., racial/ethnic minorities in the U.S.) are associated with systemically higher ARS, it causes concerns for research involving those groups. For this reason, it may be necessary to classify respondents as acquiescers or a nonacquiescers, which allows independent analysis or accounting for this stylistic artifact. However, this classification is challenging, because ARS is latent, observed only as a by-product of collected data. To propose a screener that identifies respondents as acquiescers. With survey data collected for ARS research, various ARS classification methods were compared for validity as well as implementation practicality. The majority of respondents was classified consistently into acquiescers or nonacquiescers under various classification methods. We propose a method based on illogical responses given to two balanced, theoretically distant multi-item measurement scales as a screener.

Who's a yea‐sayer? Habitual trust and affirmative response behaviour

AbstractWe test the hypothesis that people who habitually trust others respond more affirmatively to questions (i.e. acquiescence). Six studies explore whether people's habitual tendency to trust others translates into a general acquiescent response bias. By re‐analysing large‐scale cross‐country data, Study 1 shows that participants’ level of habitual trust predicts agreement across multiple and diverse concepts. Studies 2a and 2b show that habitual trust predicts acquiescent responding in classic psychological questionnaires. Habitual trust likewise predicts behavioural acquiescence, such as an agreement to assign monetary awards to others (Study 3) and staying with the suggested default option in a real choice paradigm (Study 4). Furthermore, the relation between habitual trust and acquiescent responding holds across different communication contexts (Study 5). These results imply that habitual trust predicts how individuals respond to questionnaire items that are used across a variety of research domains.

The Scoring Challenge of Emotional Intelligence Ability Tests: A Confirmatory Factor Analysis Approach to Model Substantive and Method Effects Using Raw Item Scores.

The internal structure of ability emotional intelligence (EI) tests at item level has been hardly studied, and if studied often the predicted structure did not show. In the present study, an a priori model for responses to EI ability items using Likert response scales with a Situational Judgement Test (SJT) format is investigated with confirmatory factor analysis. The model consists of (1) a target EI ability factor, (2) an acquiescence factor, which is a method factor induced by the Likert response scales, and (3) design-based error covariances, which are induced by the SJT format. It is investigated whether this a priori model can account for the observed associations between the raw item responses of the Components of Emotion Understanding Test-24 (CEUT-24). The CEUT-24 is a new test developed to assess emotion understanding, a key aspect of the EI ability construct, based on the componential emotion framework. The sample consisted of 1184 participants (15–22 years old) from four European countries (United Kingdom, Belgium, Germany, and Spain) speaking four different languages (English, Dutch, German and Spanish). Findings showed that the a priori model fitted the data well in all four languages. Furthermore, measurement invariance testing gave evidence for a well-fitting configural, metric, and partial scalar invariance model. The conclusion is that within a regular CFA framework using raw observed items responses, method factors (acquiescence response style and scenario induced variance) can be disentangled from the targeted EI ability factor.

Experiences of using the Edinburgh Postnatal Depression Scale in the context of antenatal care for Aboriginal mothers: Women and midwives’ perspectives

ProblemRoutine administration of the Edinburgh Postnatal Depression Scale (EPDS) is intended to promote early detection and preventative support for those who may be at risk of perinatal depression and anxiety. The cultural suitability of the EPDS has not been validated in the Aboriginal Australian context. BackgroundMarked differences in health outcomes and service access between Australian Aboriginal and non-Aboriginal women and infants continue to exist. AimThis study aimed to explore the cultural validity of the EPDS through understanding the experiences of Aboriginal women and midwives. MethodsQualitative data was drawn from semi-structured interviews/yarns with 13 Perth-based Aboriginal antenatal women and 10 non-Aboriginal midwives. FindingsUtilising a grounded theory approach, thematic analysis of verbatim transcripts revealed that, surprisingly, women expressed generally favourable views of the EPDS, especially when the relationships between women and midwives were focused on. Midwives, however, expressed reservations about administering the EPDS and used the EPDS as a conversation-starter rather than as a standardised, standalone tool. DiscussionIn attempt to reconcile conflicting perspectives, analysis of recordings extended to evaluate micro-processes in the interviews. At the process level, it was clear that demand characteristics operated in some interviews, including socially desirable response biases, demand biases and acquiescent response styles. ConclusionThis highlights the need for researchers and clinicians to be trained in non-leading interview questioning techniques and in yarning methodology. Researchers and clinicians should also be aware of the cognitive biases and demand characteristics that may influence responding, likely perpetuated by dominant forces of a colonised society.

Validating Indigenous Versions of the South African Personality Inventory.

Personality assessments are frequently used to make decisions and predictions, creating a demand for assessments that are non-discriminatory. South African legislation requires psychological tests to be scientifically proven to be valid, reliable, fair and non-biased. In response to the necessity for a measure sensitive to indigenous differences, South African and Dutch researchers developed the South African Personality Inventory (SAPI). The SAPI represents a theoretical model of personality that uses an indigenous (emic) and universal (etic) approach to capture South Africa’s rich multicultural and multilingual view of personhood. The development of SAPI items and its simultaneous translation from English into all official languages necessitated the investigation of all the translated language versions’ psychometric properties. This study used Exploratory Structural Equation Modelling to examine the factor structure and model fit of two indigenous language versions of the SAPI, targeting the Tshivenda and the Southern Sotho languages. To accomplish this objective, Study 1 (N = 290) was done in South Africa among the Tshivenda ethnic group, while Study 2 (N = 293) was conducted in South Africa among the Sesotho ethnic group. An acquiescence response pattern was noticed in both studies, possibly to adhere to group consensus and emphasizing harmony within relationships. The ESEM solutions generated an excellent fit for both language versions, and most facets loaded acceptably on their expected factors. The Neuroticism factor proved to be problematic in both language versions. Within the Tshivenda version, the Emotional Stability facet did not generate adequate loadings on any SAPI factors. In contrast, neither Emotional Stability nor Negative Emotionality loaded sufficiently on the Neuroticism factor for the Southern Sotho version. While the overall fit of the six-factor model was excellent, the language in which a person completes a personality questionnaire seems to influence such an assessment’s factor structure. The Tshivenda and Sesotho versions of the SAPI cannot yet be positioned as equitable alternatives when using an indigenous version of the SAPI is needed. The implications of the results and proposals for future studies are discussed.

Comparing Traumatic Brain Injury Symptoms Reported via Questionnaires Versus a Novel Structured Interview.

Mild traumatic brain injury (mTBI) symptoms are typically assessed via questionnaires in research, yet questionnaires may be more prone to biases than direct clinical interviews. We compared mTBI symptoms reported on two widely used self-report inventories and the novel Structured Interview of TBI Symptoms (SITS). Second, we explored the association between acquiescence response bias and symptom reporting across modes of assessment. Level 1 trauma center patients with mTBI (N = 73) were recruited within 2 weeks of injury, assessed at 3 months post-TBI, and produced nonacquiescent profiles. Assessments collected included the SITS (comprising open-ended and closed-ended questions), Rivermead Post Concussion Symptoms Questionnaire (RPQ), Sport Concussion Assessment Tool-3 (SCAT-3) symptom checklist, and Minnesota Multiphasic Personality Inventory-2 Restructured Form True Response Inconsistency (TRIN-r) scale. Current mTBI symptom burden and individual symptom endorsement were highly concordant between SITS closed-ended questions, the RPQ, and the SCAT-3. Within the SITS, participants reported significantly fewer mTBI symptoms to open-ended as compared to later closed-ended questions, and this difference was weakly correlated with TRIN-r. Symptom scales were weakly associated with TRIN-r. mTBI symptom reporting varies primarily by whether questioning is open- vs. closed-ended but not by mode of assessment (interview, questionnaire). Acquiescence response bias appears to play a measurable but small role in mTBI symptom reporting overall and the degree to which participants report more symptoms to closed- than open-ended questioning. These findings have important implications for mTBI research and support the validity of widely used TBI symptom inventories.

Ask me, I (Dis)agree! Acquiescence in student ratings of teaching quality in German vocational schools

Student ratings are frequently used to assess teaching quality even though they might be influenced by an acquiescent response style. Acquiescence is considered particularly common among young respondents and has been recognized as a source of systematic response error. Within a structural equation modeling framework, we examined whether student ratings of teaching quality provided by two age cohorts (fifth- and eighth-grade students) were affected by acquiescence, while additionally controlling for an extreme response style. Across both age cohorts, acquiescence had the highest and most consistent effects on student ratings of teaching quality, whereas extreme responding affected only ratings by fifth-grade students and to a smaller degree. Mean differences in teaching quality ratings between fifth- and eighth- grade students were partly explained by age-related differences in acquiescence. Overall, the effects of acquiescence on student ratings were rather small and primarily affected the ratings provided by younger students (i.e., fifth graders).