Autism spectrum disorder (ASD) is a neurodevelopmental condition frequently associated with structural cerebellar abnormalities. Whether cerebellar grey matter volumes (GMV) are linked to verbal impairments remains controversial. Here, the association between cerebellar GMV and verbal abilities in ASD was examined across the lifespan. Lobular segmentation of the cerebellum was performed on structural MRI scans from the ABIDE I dataset in male individuals with ASD (N=144, age: 8.5–64.0 years) and neurotypical controls (N=188; age: 8.0–56.2 years). Stepwise linear mixed effects modeling including group (ASD vs. neurotypical controls), lobule-wise GMV, and age was performed to identify cerebellar lobules which best predicted verbal abilities as measured by verbal IQ (VIQ). An age-specific association between VIQ and GMV of bilateral Crus II was found in ASD relative to neurotypical controls. In children with ASD, higher VIQ was associated with larger GMV of left Crus II but smaller GMV of right Crus II. By contrast, in adults with ASD, higher VIQ was associated with smaller GMV of left Crus II and larger GMV of right Crus II. These findings indicate that relative to the contralateral hemisphere, an initial reliance on the language-nonspecific left cerebellar hemisphere is offset by more typical right-lateralization in adulthood.