Face recognition is a highly developed and specialized human ability, distinct from other cognitive abilities. Previous studies examining individual differences in face recognition have focused on face perception and specialized perceptual mechanisms such as holistic face processing. However, the contribution of specific face memory processes to face recognition ability remains unclear. In 99 neurotypical individuals, we administered validated face perception assessments, three face memory tasks (Old/New task, Face-Scene task, Face-Name/Occupation task), and the Cambridge Face Memory Test (CFMT) to assess face recognition ability. We found that after accounting for face perception ability (which significantly predicted face recognition ability), Face-Name recall and recollection of faces in the Face-Scene task predicted unique variance in face recognition ability, with Face-Name recall being the strongest predictor. This highlights that associative memory mechanisms contribute to face recognition abilities and suggest that the ability to learn and recall proper names is particularly important to face recognition.