Faces are special to infants from birth, and experiences with faces in infancy are critical to developing brain circuits that support face processing skills through adulthood. Infants learn to extract rich information from faces, including recognizing people, tracking their gaze and expressions, and lip-reading. As infants learn to interact with the people around them, their responses to and understanding of these communicative facial cues become more connected to their social understanding and reflect their developmental context. Infants’ face perception is particularly responsive to experience, with some degree of plasticity present through middle childhood. Opportunities to interact with people from diverse racial backgrounds in infancy may help prevent perceptual and social biases toward different groups. Variations in experience with faces beyond face race and gender, such as the use of face coverings, may impact how and what infants learn from faces.