US veterans report more adverse childhood experiences (ACEs) than nonveterans, and a greater number of ACEs has been linked to substance use disorders (SUDs). To date, however, no study has examined whether specific ACEs may be linked to SUDs in this population in a sex-related fashion. We analyzed data from the National Health and Resilience in Veterans Study, a nationally representative survey of 4069 US veterans. ACEs, current alcohol use disorder (AUD), and current drug use disorder (DUD) were assessed using validated self-report measures. Being raised in a household with people with SUDs was independently associated with current AUD. Childhood sexual abuse and having an incarcerated family member were independently associated with current DUD. Sex moderated associations with specific ACEs. Specifically, female veterans who had experienced physical neglect in childhood or were raised with a mentally ill family member in the home were more likely to endorse current AUD and DUD, whereas male veterans who experienced sexual abuse in childhood or who were raised in a home with someone who used substances were more likely to endorse current AUD and DUD. Results underscore the importance of targeted and sex-sensitive interventions in addressing potentially unresolved childhood traumas as part of treatment efforts for SUDs in veterans.