Abstract Objective History of adverse childhood experiences (ACEs) has been linked with poorer cognitive performance in young adulthood and cognitive decline in older adults; however, few studies have examined these relationships during childhood and adolescence, which are key periods for neurocognitive development. The current study investigated the longitudinal relationships between ACEs and cognitive performance during late childhood/adolescence. Method 10,827 participants (ages = 9–15.5 years old; 48% female) were included from the Adolescent Brain Cognitive Development Study. Cumulative ACE scores were created using annual parent and child reports of youth’s exposure to ACEs from baseline (ages 9–10) to Year 4 follow-up (ages 13–15). Cognitive performance was assessed using the NIH Toolbox (completed at baseline, Year 2, and Year 4). Separate linear mixed-effects models examined associations between ACEs and cognitive performance while accounting for time, age, sex assigned at birth, caregiver education, household income, pubertal status, internalizing and externalizing symptoms, and random effects of subject and family/twin status. Additional analyses tested for interactions with time. Results Greater ACEs were associated with poorer cognitive performance on tasks measuring verbal (p’s < 0.001) and visual (p < 0.001) memory, working memory (p = 0.01), cognitive flexibility (p = 0.004), processing speed (p < 0.001), and language (p’s < 0.001), above and beyond covariates. ACEs were not associated with attention (p = 0.09). Cognitive performance improved over time; however, compared to baseline, youth with greater ACE history at Year 4 demonstrated poorer attentional performance (p = 0.008). Conclusions Findings suggest that ACEs influence cognitive performance during key neurodevelopmental periods, and future work should assess clinical utility of targeted cognitive remediation in youth with adversity history.