Acquiescence Response Style Research Articles

Courage Measure (CM) – Cross-Cultural Adaptation and Psychometric Properties for Brazilian Adolescents

Abstract: The objective of the study was to adapt the Courage Scale and estimate validity evidence based on content and internal structure. The study included 510 young people, between 14 and 19 years old. The results of the content validity coefficient suggested the adequacy of the content. Confirmatory factor analysis (CFA) was used to test three factor models, namely one-factor, two-factor, and the random intercept model. The results indicated that it is possible to measure courage through a factor, when the acquiescent response style is controlled, corroborating the theoretical perspective, given that the random intercept model adjusted well to the sample data. In other words, the findings indicate that the scale is capable of measuring courage in the Brazilian context and that acquiescence control is an important method in evaluating the construct.

Exploring the Influence of Response Styles on Continuous Scale Assessments: Insights From a Novel Modeling Approach

The use of discrete categorical formats to assess psychological traits has a long-standing tradition that is deeply embedded in item response theory models. The increasing prevalence and endorsement of computer- or web-based testing has led to greater focus on continuous response formats, which offer numerous advantages in both respondent experience and methodological considerations. Response styles, which are frequently observed in self-reported data, reflect a propensity to answer questionnaire items in a consistent manner, regardless of the item content. These response styles have been identified as causes of skewed scale scores and biased trait inferences. In this study, we investigate the impact of response styles on individuals’ responses within a continuous scale context, with a specific emphasis on extreme response style (ERS) and acquiescence response style (ARS). Building upon the established continuous response model (CRM), we propose extensions known as the CRM-ERS and CRM-ARS. These extensions are employed to quantitatively capture individual variations in these distinct response styles. The effectiveness of the proposed models was evaluated through a series of simulation studies. Bayesian methods were employed to effectively calibrate the model parameters. The results demonstrate that both models achieve satisfactory parameter recovery. Neglecting the effects of response styles led to biased estimation, underscoring the importance of accounting for these effects. Moreover, the estimation accuracy improved with increasing test length and sample size. An empirical analysis is presented to elucidate the practical applications and implications of the proposed models.

Answering tendencies on questionnaires: Comparing Mandarin and Bahasa Malaysia versus English

Aims Conducting psychological research in different countries and cultures necessitates measures in different languages. However, the language of a measure might influence responses, even within the same multilingual individual. The cultural accommodation theory proposes that one’s association with a language influences their responses. Moreover, response styles (RSs), such as an extreme or acquiescence RS, might systematically affect responses regardless of the content of the measure. These effects were reported on culture-related measures but are unclear on culture-free measures. Methodology and analyses We aimed to investigate the effects of language on psychological measures that do not explicitly examine cultural factors. Multilingual Malaysians ( n = 111) filled in the Adult Executive Functioning Inventory (ADEXI), the Depression, Anxiety, and Stress Scale—21 items (DASS-21), the Brief Coping Orientation to Problems Experienced Inventory (Brief COPE), the Pediatric Quality of Life Inventory (PedsQL), and the Traditional Masculinity-Femininity Scale (TMF) in Bahasa Malaysia and English, or in Mandarin and English Findings. There were no language differences on the ADEXI and TMF. However, several subscales of the Brief COPE, the Stress subscale of the DASS, and the PedsQL scores were higher in Mandarin than in English. On the Brief COPE and the PedsQL, there were also differences in RS between Mandarin and English, which might explain (part of) these differences. There were no differences between Bahasa Malaysia and English in scores. However, there was a more extreme RS in English than in Bahasa Malaysia and a more acquiescence RS in Bahasa Malaysia than in English on the Brief COPE. These differences suggest that the measures are not culture-free or that previously reported language differences did not result from culture alone. The language of a measure might be an additional important factor. When using different translations of the same measure, it is important to take cultural accommodation and RS into account.

Does Acquiescence Disagree with Measurement Invariance Testing?

Measurement invariance (MI) is required for validly comparing latent constructs measured by multiple ordinal self-report items. Non-invariances may occur when disregarding (group differences in) an acquiescence response style (ARS; an agreeing tendency regardless of item content). If non-invariance results solely from neglecting ARS, one should not worry about scale inequivalences but model the ARS instead. In a simulation study, we investigated the effect of ARS on MI testing, both when including ARS as a factor in the measurement model or not. For (semi-) balanced scales, disregarding a large ARS resulted in non-invariance already at the configural level. This was resolved by including an ARS factor for all groups. For unbalanced scales, disregarding ARS did not affect MI testing, and including an ARS factor often resulted in non-convergence. Implications and recommendations for applied research are discussed.

A Systematic Review of Response Styles Among Latinx Populations.

Culture influences responses to psychological measurements in ways unrelated to target constructs, thus biasing test scores and potentially contributing to under- and over-diagnosis of mental health problems in populations for which measures have not yet been normed. We conducted a systematic review of publications addressing response style among Latinx population groups in North and South America. In a final corpus of 24 studies, Latinx/Latin American populations were generally found to exhibit higher levels of extreme response style (n = 17), acquiescent response style (n = 10), and socially desirable responding (n = 5). The few publications (n = 3) that investigated midpoint responding reported no differences. Seven publications (29%) attempted to adjust scores to mitigate response style bias, using both scale design and statistical techniques. Findings suggest that researchers and clinicians should directly assess culturally patterned response style as a construct, rather than inferring style indirectly using other measures. For clinicians, knowledge of response style represents another facet of case conceptualization.

A Tree-Based Approach to Identifying Response Styles with Anchoring Vignettes

ABSTRACT Survey score interpretations are often plagued by sources of construct-irrelevant variation, such as response styles. In this study, we propose the use of an IRTree Model to account for response styles by making use of self-report items and anchoring vignettes. Specifically, we investigate how the IRTree approach with anchoring vignettes compares to traditional approaches that either do not include anchoring vignettes or do not account for response styles. We analyze secondary data using four different models: 1) total score; 2) graded response model; 3) IRTree without the consideration of anchoring vignettes, and 4) IRTree considering anchoring vignettes. We found significant differences in trait estimates from models that account for response styles compared to those that do not. Additionally, we found differences in trait estimates between the IRTree Models when considering anchoring vignettes and when not. Model comparisons suggest that trait differences are due to adjusting for acquiescence response style.

The Impact of Different Methods to Correct for Response Styles on the External Validity of Self-Reports

Abstract: Response styles (RSs) such as acquiescence represent systematic respondent behaviors in self-report questionnaires beyond the actual item content. They distort trait estimates and contribute to measurement bias in questionnaire-based research. Although various approaches were proposed to correct the influence of RSs, little is known about their relative performance. Because different correction methods formalize the latent traits differently, it is unclear how model choice affects the external validity of the corrected measures. Therefore, the present study on N = 1,000 Dutch respondents investigated the impact of correcting responses to measures of self-esteem and the need for cognition using structural equation models with structured residuals, multidimensional generalized partial credit models, and multinomial processing trees. The study considered three RSs: extreme, midpoint, and acquiescence RS. The results showed homogeneous correlation patterns among the modeled latent and external variables, especially if they were not themselves subject to RSs. In that case, the IRT-based models, including an uncorrected model, still yielded consistent results. Nevertheless, the strength of the effect sizes showed variation.

Individual-Level Cultural Factors and Use of Survey Response Styles Among Latino Survey Respondents

Acquiescent (ARS) and extreme response styles (ERS) can have detrimental effects on survey data and, for unknown reasons, are more frequently used by Latino than non-Latino white respondents. This exploratory study examined the influence of culture on these response styles by investigating their associations with individual-level cultural factors and ARS and ERS among 1,296 Mexican American, Puerto Rican, and Cuban American telephone survey respondents. Principal components representing stronger endorsement of marianismo/ machismo and social attentiveness ( simpatía, personalismo, respect for elders, value for sincerity, collectivism, individualism) were associated with higher ARS and ERS, while higher trust in strangers and more limited health literacy were associated with lower ERS. Findings from this study will enable survey designers to better anticipate ARS and ERS in surveys with Latino populations and, in turn, guide the selection of data collection and analysis methods to mitigate measurement error in the presence of these response styles.

Promotion of on-line pharmacies in social media - frequency and content

Acquiescent response style (ARS) refers to survey respondents’ tendency to choose response categories agreeing to questions regardless of their content and is hypothesized as a stable respondent trait. While what underlies acquiescence is debatable, the effect of ARS on measurement is clear: bias through artificially increased agreement ratings. With certain population subgroups (e.g., racial/ethnic minorities in the U.S.) are associated with systemically higher ARS, it causes concerns for research involving those groups. For this reason, it may be necessary to classify respondents as acquiescers or a nonacquiescers, which allows independent analysis or accounting for this stylistic artifact. However, this classification is challenging, because ARS is latent, observed only as a by-product of collected data.To propose a screener that identifies respondents as acquiescers.With survey data collected for ARS research, various ARS classification methods were compared for validity as well as implementation practicality.The majority of respondents was classified consistently into acquiescers or nonacquiescers under various classification methods.We propose a method based on illogical responses given to two balanced, theoretically distant multi-item measurement scales as a screener.

Awareness Is Bliss: How Acquiescence Affects Exploratory Factor Analysis.

Assessing the measurement model (MM) of self-report scales is crucial to obtain valid measurements of individuals' latent psychological constructs. This entails evaluating the number of measured constructs and determining which construct is measured by which item. Exploratory factor analysis (EFA) is the most-used method to evaluate these psychometric properties, where the number of measured constructs (i.e., factors) is assessed, and, afterward, rotational freedom is resolved to interpret these factors. This study assessed the effects of an acquiescence response style (ARS) on EFA for unidimensional and multidimensional (un)balanced scales. Specifically, we evaluated (a) whether ARS is captured as an additional factor, (b) the effect of different rotation approaches on the content and ARS factors recovery, and (c) the effect of extracting the additional ARS factor on the recovery of factor loadings. ARS was often captured as an additional factor in balanced scales when it was strong. For these scales, ignoring extracting this additional ARS factor, or rotating to simple structure when extracting it, harmed the recovery of the original MM by introducing bias in loadings and cross-loadings. These issues were avoided by using informed rotation approaches (i.e., target rotation), where (part of) the rotation target is specified according to a priori expectations on the MM. Not extracting the additional ARS factor did not affect the loading recovery in unbalanced scales. Researchers should consider the potential presence of ARS when assessing the psychometric properties of balanced scales and use informed rotation approaches when suspecting that an additional factor is an ARS factor.

Developing a short screener for acquiescent respondents.

Acquiescent response style (ARS) refers to survey respondents' tendency to choose response categories agreeing to questions regardless of their content and is hypothesized as a stable respondent trait. While what underlies acquiescence is debatable, the effect of ARS on measurement is clear: bias through artificially increased agreement ratings. With certain population subgroups (e.g., racial/ethnic minorities in the U.S.) are associated with systemically higher ARS, it causes concerns for research involving those groups. For this reason, it may be necessary to classify respondents as acquiescers or a nonacquiescers, which allows independent analysis or accounting for this stylistic artifact. However, this classification is challenging, because ARS is latent, observed only as a by-product of collected data. To propose a screener that identifies respondents as acquiescers. With survey data collected for ARS research, various ARS classification methods were compared for validity as well as implementation practicality. The majority of respondents was classified consistently into acquiescers or nonacquiescers under various classification methods. We propose a method based on illogical responses given to two balanced, theoretically distant multi-item measurement scales as a screener.

The Scoring Challenge of Emotional Intelligence Ability Tests: A Confirmatory Factor Analysis Approach to Model Substantive and Method Effects Using Raw Item Scores.

The internal structure of ability emotional intelligence (EI) tests at item level has been hardly studied, and if studied often the predicted structure did not show. In the present study, an a priori model for responses to EI ability items using Likert response scales with a Situational Judgement Test (SJT) format is investigated with confirmatory factor analysis. The model consists of (1) a target EI ability factor, (2) an acquiescence factor, which is a method factor induced by the Likert response scales, and (3) design-based error covariances, which are induced by the SJT format. It is investigated whether this a priori model can account for the observed associations between the raw item responses of the Components of Emotion Understanding Test-24 (CEUT-24). The CEUT-24 is a new test developed to assess emotion understanding, a key aspect of the EI ability construct, based on the componential emotion framework. The sample consisted of 1184 participants (15–22 years old) from four European countries (United Kingdom, Belgium, Germany, and Spain) speaking four different languages (English, Dutch, German and Spanish). Findings showed that the a priori model fitted the data well in all four languages. Furthermore, measurement invariance testing gave evidence for a well-fitting configural, metric, and partial scalar invariance model. The conclusion is that within a regular CFA framework using raw observed items responses, method factors (acquiescence response style and scenario induced variance) can be disentangled from the targeted EI ability factor.

Experiences of using the Edinburgh Postnatal Depression Scale in the context of antenatal care for Aboriginal mothers: Women and midwives’ perspectives

ProblemRoutine administration of the Edinburgh Postnatal Depression Scale (EPDS) is intended to promote early detection and preventative support for those who may be at risk of perinatal depression and anxiety. The cultural suitability of the EPDS has not been validated in the Aboriginal Australian context. BackgroundMarked differences in health outcomes and service access between Australian Aboriginal and non-Aboriginal women and infants continue to exist. AimThis study aimed to explore the cultural validity of the EPDS through understanding the experiences of Aboriginal women and midwives. MethodsQualitative data was drawn from semi-structured interviews/yarns with 13 Perth-based Aboriginal antenatal women and 10 non-Aboriginal midwives. FindingsUtilising a grounded theory approach, thematic analysis of verbatim transcripts revealed that, surprisingly, women expressed generally favourable views of the EPDS, especially when the relationships between women and midwives were focused on. Midwives, however, expressed reservations about administering the EPDS and used the EPDS as a conversation-starter rather than as a standardised, standalone tool. DiscussionIn attempt to reconcile conflicting perspectives, analysis of recordings extended to evaluate micro-processes in the interviews. At the process level, it was clear that demand characteristics operated in some interviews, including socially desirable response biases, demand biases and acquiescent response styles. ConclusionThis highlights the need for researchers and clinicians to be trained in non-leading interview questioning techniques and in yarning methodology. Researchers and clinicians should also be aware of the cognitive biases and demand characteristics that may influence responding, likely perpetuated by dominant forces of a colonised society.

Ask me, I (Dis)agree! Acquiescence in student ratings of teaching quality in German vocational schools

Student ratings are frequently used to assess teaching quality even though they might be influenced by an acquiescent response style. Acquiescence is considered particularly common among young respondents and has been recognized as a source of systematic response error. Within a structural equation modeling framework, we examined whether student ratings of teaching quality provided by two age cohorts (fifth- and eighth-grade students) were affected by acquiescence, while additionally controlling for an extreme response style. Across both age cohorts, acquiescence had the highest and most consistent effects on student ratings of teaching quality, whereas extreme responding affected only ratings by fifth-grade students and to a smaller degree. Mean differences in teaching quality ratings between fifth- and eighth- grade students were partly explained by age-related differences in acquiescence. Overall, the effects of acquiescence on student ratings were rather small and primarily affected the ratings provided by younger students (i.e., fifth graders).

Using Balanced Scales to Address Acquiescent Response Style

Using Balanced Scales to Address Acquiescent Response Style

Effect of Extreme and Acquiescence Response Style in TIMSS 2015

Effect of Extreme and Acquiescence Response Style in TIMSS 2015

(Un)expected exception: validating acquiescent response style factor in the Czech Republic

ABSTRACT This study explores the acquiescent response style (ARS) among respondents in the Czech Republic. To analyse ARS, confirmatory factor analysis (CFA) was employed and the response style (RS) was modelled as a latent variable. The RS factor in the CFA model must be validated by its relationship to education and age, i.e. proxies of cognitive ability. The two studies presented in this article use large amount of data as all available balanced batteries of items were analysed. In Study 1, the RS factor showed no correlation with age/education in most of the models. Study 2 employed additional measures of cognitive ability and education and confirmed the overall absence of the relationship. Author concludes that the modelled RS factor then cannot be considered the ARS and deduces that the most likely explanation of the identified systematic error variance is the respondents’ carelessness manifested by automatically choosing the extreme agreement, or choosing the first presented answer as a result of memory effect.

Intelligence, consistency, and Emerson's dilemma

In a large representative sample of Swedish male conscripts (N = 49,246), we demonstrate a positive association between measured intelligence and response consistency on items measuring endorsement of a strong military defense. This association is accentuated, to some degree, by an apparent difficulty to handle reversed items among those with low measured intelligence. Consequently, due to regression toward the mean, reversed items in measurement instruments would tend to have a negative effect on statistical power when analyzing the asso-ciation between whatever the instrument is measuring and intelligence. On the other hand, the presence of reversed items could mitigate bias in the measurement due to an acquiescent response style among those with low measured intelligence. Lack of motivation/carelessness and inadequate reading ability among some subjects are two possible confounders for the found association in the present study.

Different Styles, Different Times: How Response Times Can Inform Our Knowledge About the Response Process in Rating Scale Measurement

When respondents use different ways to answer rating scale items, they employ so-called response styles that can bias inferences drawn from measurement. To describe the influence of such response styles on the response process, we investigated relations between extreme, acquiescent, and mid response style and response times in three studies using multilevel modeling. On the response level, agreement and midpoint, but not extreme responses were slower. On the person level, response times increased for extreme, but not for acquiescence or mid response style traits. For all three response styles, we found negative cross-level interaction effects, indicating that a response matching the response style trait is faster. The results demonstrate that response styles facilitate the choice of specific category combinations in terms of response speed across a wide range of response style trait levels.

Item Response Tree Models to Investigate Acquiescence and Extreme Response Styles in Likert-Type Rating Scales.

Item response tree (IRTree) models are recently introduced as an approach to modeling response data from Likert-type rating scales. IRTree models are particularly useful to capture a variety of individuals' behaviors involving in item responding. This study employed IRTree models to investigate response styles, which are individuals' tendencies to prefer or avoid certain response categories in a rating scale. Specifically, we introduced two types of IRTree models, descriptive and explanatory models, perceived under a larger modeling framework, called explanatory item response models, proposed by De Boeck and Wilson. This extends the typical application of IRTree models for studying response styles. As a demonstration, we applied the descriptive and explanatory IRTree models to examine acquiescence and extreme response styles in Rosenberg's Self-Esteem Scale. Our findings suggested the presence of two distinct extreme response styles and acquiescence response style in the scale.