This study explored the interactions among prenatal stress, child sex, and polygenic risk scores (PGS) for attention-deficit/hyperactivity disorder (ADHD) on structural developmental changes of brain regions implicated in ADHD. We used data from two population-based birth cohorts: Growing Up in Singapore Towards healthy Outcomes (GUSTO) from Singapore (n=113) and Generation R from Rotterdam, the Netherlands (n=433). Prenatal stress was assessed using questionnaires. We obtained latent constructs of prenatal adversity and prenatal mood problems using confirmatory factor analyses. The participants were genotyped using genome-wide single nucleotide polymorphism arrays, and ADHD PGSs were computed. Magnetic resonance imaging scans were acquired at 4.5 and 6 years (GUSTO), and at 10 and 14 years (Generation R). We estimated the age-related rate of change for brain outcomes related to ADHD and performed (1) prenatal stress by sex interaction models, (2) prenatal stress by ADHD PGS interaction models, and (3) 3-way interaction models, including prenatal stress, sex, and ADHD PGS. We observed an interaction between prenatal stress and ADHD PGS on mean cortical thickness annual rate of change in Generation R (i.e., in individuals with higher ADHD PGS, higher prenatal stress was associated with a lower rate of cortical thinning, whereas in individuals with lower ADHD PGS, higher prenatal stress was associated with a higher rate of cortical thinning). None of the other tested interactions were statistically significant. Higher prenatal stress may promote a slower brain developmental rate during adolescence in individuals with higher ADHD genetic vulnerability, whereas it may promote a faster brain developmental rate in individuals with lower ADHD genetic vulnerability.