The present study was concerned with whether there are separate, modality-specific processing “streams” in verbal working memory for information that is heard or read. We used event-related brain potentials (ERPs) recorded from scalp of normal humans to show between-modality differences in spatio-temporal patterns of brain activity during retention in working memory of aurally or visually presented verbal information. The ERP patterns suggested that a sustained, automatically maintained auditory store was activated by auditory presentation and a transient, visual-verbal store was activated by visual presentation. In addition to these modality-specific differences, the ERPs indicated that the phonological loop was activated in both modalities and further suggested that the onset of phonological loop activation was earlier for auditory presentation.