It remains unknown how language production processes decline with age. Using a picture-word interference task, the aim of this study was to investigate the influence of aging on lexical access, and the contributions of language-specific and domain-general factors to semantic, phonological, and orthographic effects in Chinese spoken word production. After controlling for years of education, language comprehension, and domain-general cognitive abilities, we found a larger semantic interference effect for older speakers than for younger speakers, while the phonological effect and orthographic effect were comparable for the two age groups, supporting the transmission deficit hypothesis. Furthermore, discourse comprehension and general cognitive abilities were found to contribute to the phonological effect in older adults, but not in younger adults. Our findings indicate that both language-specific factors and domain-general factors contribute to the aging of spoken word production together.