Black Americans in the United States are disproportionately exposed to childhood adversity compared with White Americans. Such disparities may contribute to race-related differences in brain structures involved in regulating the emotional response to stress, such as the amygdala, hippocampus, and prefrontal cortex (PFC). The authors investigated neuroanatomical consequences of racial disparities in adversity. The sample included 7,350 White American and 1,786 Black American children (ages 9-10) from the Adolescent Brain Cognitive Development Study (public data release 2.0). Structural MRI data, parent and child self-reports of adversity-related measures, and U.S. Census neighborhood data were used to investigate the relationship between racial disparities in adversity exposure and race-related differences in brain structure. Black children experienced more traumatic events, family conflict, and material hardship on average compared with White children, and their parents or caregivers had lower educational attainment, lower income, and more unemployment compared with those of White children. Black children showed lower amygdala, hippocampus, and PFC gray matter volumes compared with White children. The volumes of the PFC and amygdala, but not the hippocampus, also varied with metrics of childhood adversity, with income being the most common predictor of brain volume differences. Accounting for differences in childhood adversity attenuated the magnitude of some race-related differences in gray matter volume. The results suggest that disparities in childhood adversity contribute to race-related differences in gray matter volume in key brain regions associated with threat-related processes. Structural alterations of these regions are linked to cognitive-affective dysfunction observed in disorders such as posttraumatic stress disorder. More granular assessments of structural inequities across racial/ethnic identities are needed for a thorough understanding of their impact on the brain. Together, the present findings may provide insight into potential systemic contributors to disparate rates of psychiatric disease among Black and White individuals in the United States.