There is an ongoing controversy regarding the role of gender in modulating components of the human visual-evoked potential (VEP) and event-related potentials (ERPs). Our aim was to further characterize the role of gender on VEPs, ERPs and response performance in an object recognition task. We recorded VEPs and reaction time (RT) in a paradigm wherein subjects responded to a randomly presented “Relevant” stimulus, and did not respond when presented with “Irrelevant” or “Standard” visual stimuli. There was no effect of gender on early components of the VEP or RT to Relevant stimuli. Relevant and Irrelevant stimuli evoked distinct VEP components including the P300, N400 and late-positive (LP) ERPs that were well-discriminated from those of the Standard stimulus. Females were characterized by greater P300 and N400 responses than males for the Relevant stimulus, but exclusively greater N400 responses for the Irrelevant stimulus. There were no significant gender differences for the LP, or for the latency of any ERP component. Gender differences were not attributed to hemispheric asymmetry, as there were no significant differences in P300 and N400 VEP amplitudes between lateral occipital or parietal electrode positions. These results indicate that the N400 can be elicited in a task requiring the processing of irrelevant, but not unexpected, stimuli and that females process visual information differently than males, perhaps by increased allocation of attentional resources to distracting stimuli.