A range of rare mutations involving micro-deletion or -duplication of genetic material (copy number variants (CNVs)) have been associated with high neurodevelopmental and psychiatric risk (ND-CNVs). Irritability is frequently observed in childhood neurodevelopmental conditions, yet its aetiology is largely unknown. Genetic variation may play a role, but there is a sparsity of studies investigating the presentation of irritability in young people with ND-CNVs. This study aimed to investigate whether there is a difference in irritability in young people with rare ND-CNVs compared to those without ND-CNVs, and to what extent irritability is associated with psychiatric diagnoses and cognitive ability (IQ). Irritability and broader psychopathology were assessed in 485 young people with ND-CNVs and 164 sibling controls, using the child and adolescent psychiatric assessment. Autism was assessed using the social communication questionnaire, and intelligence quotient (IQ) by the Wechsler abbreviated scale of intelligence. Fifty four percent of young people with ND-CNVs met the threshold for irritability; significantly more than controls (OR = 3.77, CI = 3.07–7.90, p = 5.31 × 10−11). When controlling for the presence of other psychiatric comorbidities, ND-CNV status was still associated with irritability. There was no evidence for a relationship between irritability and IQ. Irritability is an important aspect of the clinical picture in young people with ND-CNVs. This work shows that genetic variation is associated with irritability in young people with ND-CNVs, independent of psychiatric comorbidities or IQ impairment. Clinicians should be aware of this increased risk to inform management and interventions.