Visuo-verbal interactions in working memory: Evidence from event-related potentials

Abstract

Working memory is thought to involve separate modality-specific storage systems. Interactions between these storage systems were investigated using a novel cross-modal 2-back paradigm. 2-back, 1-back and target items were presented either visually as a verbalizable linedrawing or auditorily as a digitized spoken word. ERPs for auditory targets were primarily modulated by the presentation modality of the 2-back item, whereas ERPs for visual targets were largely modulated by presentation modality of the 1-back item. Results indicate that verbalizable pictures are only partially transformed into a phonological code for rehearsal in working memory. Furthermore, results support the idea of a more stable and persistent auditory short-term store as opposed to a more transiently activated visual store for verbalizable material.