Selective visual processing across competition episodes: a theory of task-driven visual attention and working memory

Werner X Schneider

doi:10.1098/rstb.2013.0060

Abstract

The goal of this review is to introduce a theory of task-driven visual attention and working memory (TRAM). Based on a specific biased competition model, the ‘theory of visual attention’ (TVA) and its neural interpretation (NTVA), TRAM introduces the following assumption. First, selective visual processing over time is structured in competition episodes. Within an episode, that is, during its first two phases, a limited number of proto-objects are competitively encoded—modulated by the current task—in activation-based visual working memory (VWM). In processing phase 3, relevant VWM objects are transferred via a short-term consolidation into passive VWM. Second, each time attentional priorities change (e.g. after an eye movement), a new competition episode is initiated. Third, if a phase 3 VWM process (e.g. short-term consolidation) is not finished, whereas a new episode is called, a protective maintenance process allows its completion. After a VWM object change, its protective maintenance process is followed by an encapsulation of the VWM object causing attentional resource costs in trailing competition episodes. Viewed from this perspective, a new explanation of key findings of the attentional blink will be offered. Finally, a new suggestion will be made as to how VWM items might interact with visual search processes.

Highlights

The goal of this review is to introduce a theory of task-driven visual attention and working memory (TRAM)
The existence of such a priority map for attentional control—sometimes called saliency map—is implied by non-biased competition theories of visual attention that assume the serial allocation of attentional resources in space [10,11]
Encapsulation of visual working memory objects and attentional resource costs Given our definition of competition episodes, the key question of §3 can be tackled: what happens if phase 3 processing of a competition episode is still going on and is not finished while a new competition episode is triggered by changes of attentional priorities? Is VWM cleared completely so that new competition winners can be encoded? An advantage of this solution would be to have no attentional resource costs

Summary

Introduction

The goal of this review is to introduce a theory of task-driven visual attention and working memory (TRAM). That is, during its first two phases, a limited number of proto-objects are competitively encoded—modulated by the current task—in activation-based visual working memory (VWM). A covert attentional weight-guided biased competition process should modulate access of proto-objects to perceptual VWM, but should determine— mediated by the same priority map regions—the target location of the saccade.

Objectives

Results

Conclusion