Learning how others perceive us helps us tune our behavior to form adaptive relationships. But which perceptions stick with us? And when in the learning process are they codified in memory? We leveraged a popular television series-The Office-to answer these questions. Prior to their functional magnetic resonance imaging (fMRI) session, viewers of The Office reported which characters they identified with, as well as which characters they perceived another person (i.e. counterpart) was similar to. During their fMRI scan, participants found out which characters other people thought they and the counterpart were like, and also completed rest scans. Participants remembered more feedback inconsistent with their self-views (vs. views of the counterpart). Although neural activity while encoding self-inconsistent feedback did not meaningfully predict memory, returning to the inconsistent self feedback during subsequent rest did. During rest, participants reinstated neural patterns engaged while receiving self-inconsistent feedback in the dorsomedial prefrontal cortex (DMPFC). DMPFC reinstatement also quadratically predicted self-inconsistent memory, with too few or too many reinstatements compromising memory performance. Processing social feedback during rest may impact how we remember and integrate the feedback, especially when it contradicts our self-views.