Implicit Association Test Measures Research Articles

Individual Differences in Implicit Bias Can Be Measured Reliably by Administering the Same Implicit Association Test Multiple Times.

The use of the Implicit Association Test (IAT) as a measure of individual differences is stymied by insufficient test-retest reliability for assessing trait-level constructs. We assess the degree to which the IAT measures individual differences and test a method to improve its validity as a "trait" measure: aggregating across IATs. Across three studies, participants (total n = 960) completed multiple IATs in the same session or across multiple sessions. Using latent-variable models, we found that half of the variance in IAT scores reflects individual differences. Aggregating across multiple IATs approximately doubled the variance explained with explicit measures compared with a single IAT D-score. These findings show that IAT scores contain considerable noise and that a single IAT is inadequate to estimate trait bias. However, aggregation across multiple administrations can correct this and better estimate individual differences in implicit attitudes.

Whether implicit attitudes exist is one question, and whether we can measure individual differences effectively is another.

Questions about measurement of individual differences in implicit attitudes, which have been the focus so far in this exchange, should be distinguished from more general questions about whether implicit attitudes exist and operate in our minds. Theorists frequently move too quickly from pessimistic results regarding the first set of questions to pessimistic conclusions about the second. That is, they take evidence that indirect measures such as the implicit association test (IAT) disappoint as individual difference measures and use it to (mistakenly) suggest that people do not in fact have implicit attitudes directed at stigmatized groups. In this commentary, I dissect this mistake in detail, drawing key lessons from a parallel debate that has unfolded in cognitive science about “conflict tasks” such as the Stroop task. I argue that the evidence overall supports a nuanced conclusion: Indirect measures such as the IAT measure individual differences in implicit attitudes poorly, but they—via distinct lines of evidence—still support the view that implicit attitudes exist.This article is categorized under:Psychology > Theory and Methods

What underlies death/suicide implicit association test measures and how it contributes to suicidal action

ABSTRACT Recently, psychologists have developed indirect measurement procedures to predict suicidal behavior. A prominent example is the Death/Suicide Implicit Association Test (DS-IAT). In this paper, I argue that there is something special about the DS-IAT which distinguishes it from different IAT measures. I argue that the DS-IAT does not measure weak or strong associations between the implicit self-concept and the abstract concept of death. In contrast, assuming a goal-system approach, I suggest that sorting death-related to self-related words takes effort because death-related words trigger avoidance-impulses, which suicide ideation weakens. The DS-IAT taps into weakened automatic responses from the self-preservation system. Additionally, the suggested cognitive structure, illuminated with the selfish-goal theory, explains predictable suicidal behavior.

Best research practices for using the Implicit Association Test

Interest in unintended discrimination that can result from implicit attitudes and stereotypes (implicit biases) has stimulated many research investigations. Much of this research has used the Implicit Association Test (IAT) to measure association strengths that are presumed to underlie implicit biases. It had been more than a decade since the last published treatment of recommended best practices for research using IAT measures. After an initial draft by the first author, and continuing through three subsequent drafts, the 22 authors and 14 commenters contributed extensively to refining the selection and description of recommendation-worthy research practices. Individual judgments of agreement or disagreement were provided by 29 of the 36 authors and commenters. Of the 21 recommended practices for conducting research with IAT measures presented in this article, all but two were endorsed by 90% or more of those who felt knowledgeable enough to express agreement or disagreement; only 4% of the totality of judgments expressed disagreement. For two practices that were retained despite more than two judgments of disagreement (four for one, five for the other), the bases for those disagreements are described in presenting the recommendations. The article additionally provides recommendations for how to report procedures of IAT measures in empirical articles.

Implicit racial bias among medical graduates and students by an IAT measure: a systematic review and meta-analysis.

Racial implicit bias is an unconscious response and behavior that affects interpersonal interactions and clinical decision-making. We attempted to meta-analyze the scores of implicit association test (IAT) to estimate pooled quantity of implicit racial bias among medical graduates and students METHODS: As far as we know, our study is the first systematic-based meta-analysis estimating the pooled score of implicit racial bias among physicians and medical students. Keywords were searched in Scopus, Web of Science, Google Scholar, PubMed, Science Direct, Cochrane, MEDLINE, Wiley online library, and ProQuest databases from 2011 since 2021. The IAT's pooled score estimates through a fixed-effect meta-analysis using STATA 15. Also, I2 statistic was used to determine heterogeneity across the articles. Out of 1177 articles, 29 studies entered to analysis. The pooled score of IAT among physicians and medical students was 0.28 (95% CI 0.13 to 0.43) and 0.35 (95% CI 0.03 to 0.67), respectively. The racial bias score of physician ranged from -0.12 to 0.62. While score of implicit association test for medical student ranged from -0.01 to 1.29. Our meta-analysis revealed that there was an implicit anti-black attitude among physicians and medical students, but the size of this implicit racial bias was small. Although the level of racial bias in physicians and medical students was low, it could be reduced to the lowest level through informative programs and training in ways to control implicit attitudes.

Reducing Implicit Cognitive Biases Through the Performing Arts

The aim of the present research was to test whether involvement in a 14-days training program in the performing arts could reduce implicit biases. We asked healthy participants to complete an Implicit Association Test (IAT) to assess biased attitudes to physical illness in two separate sessions, before and after the training program. Two separate control groups matched by age, gender and educational level completed the two IAT sessions, separated by same number of days, without being involved in the training program. Results showed that participants who were involved in the training program reduced their implicit bias toward illness measured through IAT in the second session. This reduction in IAT measures was not observed in the control samples, despite the two IAT measures being matched in temporal delay with the experimental group. These findings suggest that an interventional program based on the performing arts could be effective in reducing levels of implicit biases among the general population.

The self-esteem implicit association test is valid: Evidence from brain activity.

A distinct challenge of implicit self-esteem research is the dubious validity of measures for implicit self-esteem. We conducted two event-related potential (ERP) studies to examine whether implicit self-esteem measured by the Implicit Association Test (IAT) actually reflects the automatic self-evaluation. We adopted the regular IAT and the Go/No-go Association Task (GNAT), respectively, to measure implicit self-esteem in two studies. We focused on the P300 that reflects the stimulus evaluation process. Study 1 revealed that participants responded faster to self pairing with good than to self pairing with bad whereas self pairing with bad elicited a delayed P300 compared with self pairing with good. Study 2 replicated these findings and further highlighted that the index of implicit self-esteem based on reaction time is correlated with that based on P300 latency. Our results suggest that implicit self-esteem assessed by the IAT measures automatic self-evaluation, thus providing neural evidence for the validity of implicit self-esteem.

Why Does the IAT Reveal a Preference for Stimuli Said to Be Paired With an Unpleasant Sound? Stalking the Unexpected

The Implicit Association Test (IAT) is the most widely used measure to assess automatic evaluations. One classic phenomenon that has been well established both using the IAT and self-report measures of liking is evaluative conditioning (EC), which refers to a change in the evaluation of a stimulus due to its pairing with another stimulus. Research has documented that EC can also occur when participants are merely informed about upcoming stimulus pairings. In a recent study, participants reported a more negative evaluation of non-words that were instructed to be followed by an unpleasant sound compared to non-words that would not to be followed by this sound (De Houwer, Mattavelli, & Van Dessel, 2019). Interestingly, however, an unexpected pattern was observed on an IAT, that is, a preference for the stimulus said to be followed by the sound. We report three pre-registered experiments (N = 650) in which we manipulated different aspects of the procedure such as the stimuli, instructions, and the measure, but that still revealed the same dissociation. Based on three pilot experiments (N = 92), we then conducted a registered report study (Experiment 4) testing whether the unexpected effect depends on how the USs are labelled in the instructions. Although describing the aversive sound as negative eliminated the unexpected IAT effect, the type of instruction only had a weak impact on IAT effects. These results are in line with prior evidence showing that IAT scores are malleable.

Implicit measure of suicidal ideation in patients with depression

The death/suicide implicit association test (IAT) may be more resilient to accurately assess suicide risk than self-reports. We examined the IAT in 130 patients with depression and 125 healthy controls, along with self-reported suicidal ideation. IAT could differentiate patients with suicide attempts from patients without suicide attempts and controls. IAT measures were significantly correlated to explicit suicidal ideation and clinical symptoms in patients. Moreover, the IAT-symptom correlations were significant in female but not male patients. The IAT showed promise as a valid tool to estimate suicide risk in patients with depression and may be particularly useful in female patients.

Can the Implicit Association Test Serve as a Valid Measure of Automatic Cognition? A Response to Schimmack (2021)

Much of human thought, feeling, and behavior unfolds automatically. Indirect measures of cognition capture such processes by observing responding under corresponding conditions (e.g., lack of intention or control). The Implicit Association Test (IAT) is one such measure. The IAT indexes the strength of association between categories such as “planes” and “trains” and attributes such as “fast” and “slow” by comparing response latencies across two sorting tasks (planes–fast/trains–slow vs. trains–fast/planes–slow). Relying on a reanalysis of multitrait–multimethod (MTMM) studies, Schimmack (this issue, p. 396) argues that the IAT and direct measures of cognition, for example, Likert scales, can serve as indicators of the same latent construct, thereby purportedly undermining the validity of the IAT as a measure of individual differences in automatic cognition. Here we note the compatibility of Schimmack’s empirical findings with a range of existing theoretical perspectives and the importance of considering evidence beyond MTMM approaches to establishing construct validity. Depending on the nature of the study, different standards of validity may apply to each use of the IAT; however, the evidence presented by Schimmack is easily reconcilable with the potential of the IAT to serve as a valid measure of automatic processes in human cognition, including in individual-difference contexts.

Can the Implicit Association Test Measure Automatic Judgment? The Validation Continues

In this commentary, we welcome Schimmack’s reanalysis of Bar-Anan and Vianello’s multitrait multimethod (MTMM) data set, and we highlight some limitations of both the original and the secondary analyses. We note that when testing the fit of a confirmatory model to a data set, theoretical justifications for the choices of the measures to include in the model and how to construct the model improve the informational value of the results. We show that making different, theory-driven specification choices leads to different results and conclusions than those reported by Schimmack (this issue, p. 396). Therefore, Schimmack’s reanalyses of our data are insufficient to cast doubt on the Implicit Association Test (IAT) as a measure of automatic judgment. We note other reasons why the validation of the IAT is still incomplete but conclude that, currently, the IAT is the best available candidate for measuring automatic judgment at the person level.

The Reliability of the I-Quad and Its Predictive Utility in a Modified Dictator Game

Author(s): Miscione, Breanna | Abstract: Implicit cognition refers to experiences and beliefs that influence one’s behaviors but are not readily available for conscious awareness. Since it is not a conscious process, assessing implicit cognition requires indirect measures such as the Implicit Association Test (IAT) developed by Greenwald, McGhee, and Schwartz. The classic IAT measures two distinct associations, but the current scoring algorithm produces a single statistic based on reaction times. This statistic merges information from both associations such that we cannot tell which association is driving the effect. The Quadruple Process Model (Quad), devised by Conrey, Sherman, Gawronski, Hugenberg, and Groom, provides more informative statistics regarding implicit associations at the group level. In the current study, we aimed to apply the Quad at an individual level and evaluate its effectiveness through employing a test of reliability and predictive utility through a modified dictator game. We provided evidence that the i-Quad is reliable in a test-retest scenario. We also provided support for further research of the i-Quad parameters and their role in predicting prosocial behavior. Our findings add to the growing body of literature that suggests implicit biases can have a significant but subtle effect on how individuals treat one another, especially for members of minority and stigmatized groups. Moreover, the use of the i-Quad may provide deeper insights into the ways in which implicit biases affect those around us in subtle ways that we may not be aware of.

Measure what you are trying to predict: Applying the correspondence principle to the Implicit Association Test

The Implicit Association Test (IAT) is nearly synonymous with the implicit attitude construct. At the same time, correlations between the IAT and criterion measures are often remarkably low. Developed within research using explicit measures of attitudes, the correspondence principle posits that measures should better predict criteria when there is a match in terms of the level of generality or specificity at which both are conceptualized (Ajzen & Fishbein, 1977). As such, weak implicit-criterion correlations are to be expected when broad general implicit measures are used to predict highly specific criteria. Research using explicit measures of attitudes consistently supports the correspondence principle, but conceptual correspondence is rarely considered by researchers using implicit measures to predict behavior and other relevant criterion measures. In five experiments (total N = 4650), we provide the first direct evidence demonstrating the relevance of the correspondence principle to the predictive validity of the IAT and Single-Target IAT. That said, it is not the case that the IAT always predicts criteria better when correspondence is high. Inconsistency across the pattern of results suggests there is much more that remains to be understood about the relevance of the correspondence principle to the implicit-criterion relationship. Taken together, however, our findings suggest that conceptual correspondence often increases (and never decreases) the magnitude of implicit-criterion and implicit-explicit relationships. We provide a framework for future research necessary to establish when correspondence is more likely to increase the predictive validity of measures such as the IAT.

On the Malleability of Implicit Attitudes Towards Women Empowerment: Evidence from Tunisia

We use an implicit association test (IAT) to measure implicit gender attitudes and examine the malleability of these attitudes using a randomized field experiment and quasi-experimental data from Tunisia. Women that appear most conservative respond to a randomized video treatment by reducing their implicit gender bias. Also, female interviewers invite more conservative responses to the IAT, especially among the male subsample. Perceived religiosity of the interviewer affects self-reported gender attitudes, but not IAT measures, suggesting social desirability may be at work. We discuss the implications of our findings for the use of implicit measures in development research.

Does Conventional Implicit Association Test of Shyness Measure “Self‐Shyness” or “Others‐Shyness”?

AbstractThe Implicit Association Test (IAT) measures implicit associations between attitude targets and attributes. Its structure and procedure facilitate investigation of the strength of associations between one target and attributes relative to that between the other target and the same attributes when two targets are contradictory (e.g., black/white and comfortable/uncomfortable). This structure can cause conceptual complexity about what the IAT measures, particularly when a counter category is not needed. Thus, using the Single‐Target Implicit Association Test (ST‐IAT), which allowed only one target category for pairing with attributes, this paper delineated the association measured in the conventional IAT for shyness: “self‐shy” or “others‐shy.” Seventy‐seven Japanese university students completed the self‐report shyness scale, the conventional IAT, and two ST‐IATs (i.e., self/others as target). Results showed that implicit shyness produced in the conventional IAT significantly and positively correlated with that in the self‐targeted ST‐IAT. Moreover, implicit shyness in the conventional IAT was significantly accounted for by those produced by the ST‐IAT with self as target and those calculated in the ST‐IAT with others as target in opposite directions.

Feature Integration in Visual Working Memory

This article reviews studies on feature integration in visual working memory, which is critical for various cognitive activities using visual information. Studies involving change detection and multiple object tracking tasks reported that feature-integrated object representations are successfully maintained, and that the parietal cortex plays a major role. Subsequent studies that involved explicit tasks on feature combination, such as feature swap detection and multiple object permanence tracking, revealed the role of the prefrontal cortex, but it remains equivocal whether visual working memory holds feature-integrated object representations. In addition, recent studies using an implicit-association test measure, the redundant feature reviewing task, combining object reviewing and redundancy gain paradigms, provided evidence on feature-integrated object representations in visual working memory. Electroencephalography data analysis showed prefrontal activities reflecting the integration of the color and shape of an object, which is consistent with the result of studies measuring explicit tasks. Altogether, these findings are consistent with a recently proposed "feature confirmation" model, claiming that object features can be integrated in bottom-up visual processing and the limitation in feature binding occurs in the top-down mechanism which confirms the presence of features and their combination.

Field-Identification IAT predicts students’ academic persistence over and above Theory of Planned Behavior constructs

Ajzen and Dasgupta (2015) recently invited complementing Theory of Planned Behavior (TPB) measures with measures borrowed from implicit cognition research. In this study, we examined for the first time such combination, and we did so to predict academic persistence. Specifically, 169 first-year college students answered a TPB questionnaire and completed a field-identification Implicit Association Test (IAT). The IAT measure largely predicted academic persistence 6 months later over and above TPB constructs, including behavioral intention. We discuss interpretations of this finding and its relevance to educational research.

Pre-service teachers' implicit and explicit beliefs about English language learners: An implicit association test study

Pre-service teachers' attitudes and beliefs about English Learners (ELs) are especially critical as they enter their professions among an increasingly diverse student population. This study uses an Implicit Association Test to explore implicit and explicit beliefs and attitudes of pre-service teachers about ELs. Pre-service teachers from a Southeastern U.S. university hold generally positive implicit beliefs about ELs and express positive expectations for working with ELs and school support. Implicit association test measures have potential as tools for preparing pre-service teachers and evaluating the impact of interventions that seek to improve teachers’ readiness to serve this population.

The validation of Implicit Association Test measures for smartphone and Internet addiction in at-risk children and adolescents.

BackgroundPotential concerns are increasing that smartphone and Internet addictions may have deleterious effects on the mental health. Despite the recognition of the important role that implicit associations may have over explicit processes in addiction, such implicit associations have not been comprehensively investigated with respect to Internet addiction. Therefore, we modified the Implicit Association Test (IAT) for smartphone and Internet addictions and investigated its validity in children and adolescents.MethodsIn this experimental study, 78 at-risk children and adolescents ranging in age from 7 to 17 years completed an IAT modified with pictures captured from the most popular Internet games among youth. Furthermore, measures of Internet and smartphone addictions, mental health and problem behaviors, impulsive tendencies, self-esteem, daily stress, and quality of life were assessed simultaneously.ResultsSignificant correlations were found between IAT D2SD scores and standardized scales for Internet (r = .28, p < .05) and smartphone (r = .33, p < .01) addictions. There were no significant correlations between IAT parameters and other scales measuring the constructs that are less relevant to the features of addiction, such as daily stress levels, impulsivity, and quality of life. Multiple regression analysis revealed that the IAT D2SD was independently and positively associated with smartphone addiction (p = .03) after controlling for other clinical correlates.ConclusionsThis study demonstrated good convergent and discriminant validity of this IAT as a novel measurement relating to Internet and smartphone addictions. Further longitudinal and prospective studies are needed to evaluate its potential utility in clinical and community settings.

Conceptual clarification and implicit-association tests: psychometric evidence for racist attitudes

Critics of the Implicit Association Test (IAT)—a measure of the strength of a person’s automatic, memory-based association between two concepts, such as “black” and “threatening” or “white” and “caring”—have at least three main objections. Their symmetry argument (SA) is that the IAT should but does not give equally valid results for black-on-white and white-on-black racism. Their cultural-awareness argument (AA) is that the IAT illegitimately presupposes that use of racial stereotypes presupposes no stereotype acceptance, only stereotype awareness. Their completeness argument (CA) is that at best the IAT measures only questionable or implicit, not explicit, bias because IAT ignores the fact that subjects’ conscious desires to avoid bias often enable them to check their biased behavior. Examining each of these anti-IAT stances, the paper summarizes the IAT and then argues for 6 main claims. (1) Clarifying concepts like racism is important for progress in social science. (2) IAT critics’ SA presupposes an ahistorical/acultural concept of racism. (3) IAT critics’ AA presupposes a linguistically-insensitive concept of racism, one presupposing that the language we use provides no behavioral evidence for racism. (4) IAT critics’ CA presupposes a concept of racism subject to conscious, deliberate control. (5) IAT proponents endorse a more plausible concept of racism, one that is contextual, linguistically sensitive, and often not susceptible to conscious control. (6) Although the IAT debate is unsettled, IAT critics’ use of a questionable concept of racism gives grounds for doubting their claims.