Prospective memory (PM) is the ability to remember future intentions, and PM function is closely related to independence in daily life, particularly in patients with temporal lobe epilepsy (TLE). As PM involves various cognitive components of attention, working memory, inhibition and other executive functions, this study investigated how TLE may affect PM components and the underlying neural mechanisms. Sixty-four subjects were recruited, including 20 refractory TLE patients, 18 well-controlled TLE patients and 26 age-matched healthy controls. A set of neuropsychological tests was administered to assess specific brain functions. An event-related potential (ERP) task was used to further explore how PM and its components would be differentially affected in the two TLE types. Our findings revealed that: (1) refractory TLE patients scored lower than the healthy controls in the digit span, Verbal Fluency Test and Symbol Digit Modalities Test; (2) refractory TLE patients exhibited impaired PM performance and reduced prospective positivity amplitudes over the frontal, central and parietal regions in ERP experiments when compared to the healthy controls; and (3) decreased P3 amplitudes in the nogo trials were observed over the frontal-central sites in refractory but not in well-controlled TLE patients. To our knowledge, this is the first ERP study on PM that has specifically identified PM impairment in refractory but not in well-controlled TLE patients. Our finding of double dissociation in PM components suggests that inhibition dysfunction may be the main reason for PM deficit in refractory TLE patients. The present results have clinical implications for neuropsychological rehabilitation in TLE patients.