Affect and cognitive control processes are closely related, however, most studies have assessed state affect or affective disorders. The current study investigates the relationship between individual differences in trait affectivity and flexibility in spatial navigation and stimulus discrimination tasks. Beck Depression Inventory-II (BDI-II), Beck Anxiety Inventory (BAI), and the Positive and Negative Affectivity Scale (PANAS) were given to 82 participants followed by an intradimensional/extradimensional (ID/ED) set-shifting task in which navigation was reinforced based on visual stimuli colocalized with a goal or based on the spatial location of the goal. Higher BDI and NA predicted greater trials-to-criteria during ED shift, but not initial learning or ID shifting. Participants who failed to meet criteria during either ID or ED set-shifting (N = 16) had significantly higher scores for NA, BDI, and BAI compared to individuals who successfully met criterion (N = 56) with this relationship being primarily observed in males. The current findings indicate that negative affectivity is associated with poor performance in behavioral flexibility.