There is considerable debate about whether additional fMRI-measured activity in the right prefrontal cortex readily observed in older adults represents compensatory activation that enhances cognition or whether maintenance of youthful brain activity best supports cognitive function in late adulthood. To investigate this issue, we tested a large lifespan sample of 461 adults (aged 20–89) and treated degree of left-lateralization in ventrolateral and dorsolateral prefrontal cortex during a semantic judgment fMRI task as an individual differences variable to predict cognition. We found that younger adults were highly left-lateralized, but lateralization did not predict better cognition, whereas higher left-lateralization of prefrontal cortex predicted better cognitive performance in middle-aged adults, providing evidence that left-lateralized, youth-like patterns are optimal in middle age. This relationship was reversed in older adults, with lower laterality scores associated with better cognition. The findings suggest that bilaterality in older adults facilitates cognition, but early manifestation of this pattern during middle age is characteristic of low performers. Implications of these findings for current theories of neurocognitive aging are discussed.