Task-relevant Representations Research Articles

Enhancing links between visual short term memory, visual attention and cognitive control processes through practice: An electrophysiological insight

The operation of attention on visible objects involves a sequence of cognitive processes. The current study firstly aimed to elucidate the effects of practice on neural mechanisms underlying attentional processes as measured with both behavioural and electrophysiological measures. Secondly, it aimed to identify any pattern in the relationship between Event-Related Potential (ERP) components which play a role in the operation of attention in vision. Twenty-seven participants took part in two recording sessions one week apart, performing an experimental paradigm which combined a match-to-sample task with a memory-guided efficient visual-search task within one trial sequence. Overall, practice decreased behavioural response times, increased accuracy, and modulated several ERP components that represent cognitive and neural processing stages. This neuromodulation through practice was also associated with an enhanced link between behavioural measures and ERP components and with an enhanced cortico-cortical interaction of functionally interconnected ERP components. Principal component analysis (PCA) of the ERP amplitude data revealed three components, having different rostro-caudal topographic representations. The first component included both the centro-parietal and parieto-occipital mismatch triggered negativity – involved in integration of visual representations of the target with current task-relevant representations stored in visual working memory – loaded with second negative posterior-bilateral (N2pb) component, involved in categorising specific pop-out target features. The second component comprised the amplitude of bilateral anterior P2 – related to detection of a specific pop-out feature – loaded with bilateral anterior N2, related to detection of conflicting features, and fronto-central mismatch triggered negativity. The third component included the parieto-occipital N1 – related to early neural responses to the stimulus array – which loaded with the second negative posterior-contralateral (N2pc) component, mediating the process of orienting and focusing covert attention on peripheral target features. We discussed these three components as representing different neurocognitive systems modulated with practice within which the input selection process operates.

Increased experience amplifies the activation of task-irrelevant category representations.

Prior research has demonstrated the benefits (i.e., task-relevant attentional selection) and costs (i.e., task-irrelevant attentional capture) of prior knowledge on search for an individual target or multiple targets from a category. This study investigated whether the level of experience with particular categories predicts the degree of task-relevant and task-irrelevant activation of item and category representations. Adults with varying levels of dieting experience (measured via 3 subscales of Disinhibition, Restraint, Hunger; Stunkard & Messick, Journal of Psychosomatic Research, 29(1), 71-83, 1985) searched for targets defined as either a specific food item (e.g., carrots), or a category (i.e., any healthy or unhealthy food item). Apart from the target-present trials, in the target-absent "foil" trials, when searching for a specific item (e.g., carrots), irrelevant items from the target's category (e.g., squash) were presented. The ERP (N2pc) results revealed that the activation of task-relevant representations (measured via Exemplar and Category N2pc amplitudes) did not differ based on the degree of experience. Critically, however, increased dieting experience, as revealed by lower Disinhibition scores, predicted activation of task-irrelevant representations (i.e., attentional capture of foils from the target item category). Our results suggest that increased experience with particular categories encourages the rapid activation of category representations even when category information is task irrelevant, and that the N2pc in foil trials could potentially serve as an indication of experience level in future studies on categorization.

TPJ-M1 interaction in the control of shared representations: New insights from tDCS and TMS combined

There is extensive evidence that perceived and internally planned actions have a common representational basis: action observation can induce an automatic tendency to imitate others. If perceived and executed action, however, are based on shared representations, the question arises how we can distinguish self-related and other-related representations. It has been suggested that the control of shared representations involves a neural network centered on the temporo-parietal junction (TPJ). However, the specific role of the TPJ in controlling shared representations is still not clear. In a conflict situation where participants have to execute action A while observing action B, the TPJ might either facilitate the relevant action A or inhibit the irrelevant action B (mirror response). In the present study, we used transcranial Direct Current Stimulation (tDCS) to condition neural activity in the right temporo-parietal junction (TPJ). We then analyzed the corticospinal output as indexed by motor-evoked potentials (MEPs) induced by single-pulse TMS (spTMS) of the left primary motor cortex (M1) during action observation in the context of a conflict task. Results showed that tDCS-mediated increased control did not entail the attenuation of the task-irrelevant response activation: the effect of motor mirroring was not suppressed or reduced. Rather, facilitating TPJ activity via anodal tDCS selectively enhanced the instructed motor plan (self-related representation). This outcome supports the idea that TPJ plays a critical role in detecting the mismatch between self-related and other-related representations and is at work to enhance task-relevant representations.

Changes in task-irrelevant context invoke updating of task-relevant representations in working memory

Changes in task-irrelevant context invoke updating of task-relevant representations in working memory

Of Huge Mice and Tiny Elephants: Exploring the Relationship Between Inhibitory Processes and Preschool Math Skills.

The cognitive mechanisms underpinning the well-established relationship between inhibitory control and early maths skills remain unclear. We hypothesized that a specific aspect of inhibitory control drives its association with distinct math skills in very young children: the ability to ignore stimulus dimensions that are in conflict with task-relevant representations. We used an Animal Size Stroop task in which 3- to 6-year-olds were required to ignore the physical size of animal pictures to compare their real-life dimensions. In Experiment 1 (N = 58), performance on this task correlated with standardized early mathematics achievement. In Experiment 2 (N = 48), performance on the Animal Size Stroop task related to the accuracy of magnitude comparison, specifically for trials on which the physical size of dot arrays was incongruent with their numerosity. This highlights a process-oriented relationship between interference control and resolving conflict between discrete and continuous quantity, and in turn calls for further detailed empirical investigations of whether, how and why inhibitory processes matter to emerging numerical cognition.

Discovering relevant task spaces using inverse feedback control

Learning complex skills by repeating and generalizing expert behavior is a fundamental problem in robotics. However, the usual approaches do not answer the question of what are appropriate representations to generate motion for a specific task. Since it is time-consuming for a human expert to manually design the motion control representation for a task, we propose to uncover such structure from data-observed motion trajectories. Inspired by Inverse Optimal Control, we present a novel method to learn a latent value function, imitate and generalize demonstrated behavior, and discover a task relevant motion representation. We test our method, called Task Space Retrieval Using Inverse Feedback Control (TRIC), on several challenging high-dimensional tasks. TRIC learns the important control dimensions for the tasks from a few example movements and is able to robustly generalize to new situations.

Momentary interruptions can derail the train of thought.

We investigated the effect of short interruptions on performance of a task that required participants to maintain their place in a sequence of steps each with their own performance requirements. Interruptions averaging 4.4 s long tripled the rate of sequence errors on post-interruption trials relative to baseline trials. Interruptions averaging 2.8 s long--about the time to perform a step in the interrupted task--doubled the rate of sequence errors. Nonsequence errors showed no interruption effects, suggesting that global attentional processes were not disrupted. Response latencies showed smaller interruption effects than sequence errors, a difference we interpret in terms of high levels of interference generated by the primary task. The results are consistent with an account in which activation spreading from the focus of attention allows control processes to navigate task-relevant representations and in which momentary interruptions are disruptive because they shift the focus and thereby cut off the flow.

Selective Attentional Enhancement and Inhibition of Fronto-Posterior Connectivity by the Basal Ganglia During Attention Switching

The prefrontal cortex and the basal ganglia interact to selectively gate a desired action. Recent studies have shown that this selective gating mechanism of the basal ganglia extends to the domain of attention. Here, we investigate the nature of this action-like gating mechanism for attention using a spatial attention-switching paradigm in combination with functional neuroimaging and dynamic causal modeling. We show that the basal ganglia guide attention by focally releasing inhibition of task-relevant representations, while simultaneously inhibiting task-irrelevant representations by selectively modulating prefrontal top-down connections. These results strengthen and specify the role of the basal ganglia in attention. Moreover, our findings have implications for psychological theorizing by suggesting that inhibition of unattended sensory regions is not only a consequence of mutual suppression, but is an active process, subserved by the basal ganglia.

A unifying model of concurrent spatial and temporal modularity in muscle activity

Modularity in the central nervous system (CNS), i.e., the brain capability to generate a wide repertoire of movements by combining a small number of building blocks ("modules"), is thought to underlie the control of movement. Numerous studies reported evidence for such a modular organization by identifying invariant muscle activation patterns across various tasks. However, previous studies relied on decompositions differing in both the nature and dimensionality of the identified modules. Here, we derive a single framework that encompasses all influential models of muscle activation modularity. We introduce a new model (named space-by-time decomposition) that factorizes muscle activations into concurrent spatial and temporal modules. To infer these modules, we develop an algorithm, referred to as sample-based nonnegative matrix trifactorization (sNM3F). We test the space-by-time decomposition on a comprehensive electromyographic dataset recorded during execution of arm pointing movements and show that it provides a low-dimensional yet accurate, highly flexible and task-relevant representation of muscle patterns. The extracted modules have a well characterized functional meaning and implement an efficient trade-off between replication of the original muscle patterns and task discriminability. Furthermore, they are compatible with the modules extracted from existing models, such as synchronous synergies and temporal primitives, and generalize time-varying synergies. Our results indicate the effectiveness of a simultaneous but separate condensation of spatial and temporal dimensions of muscle patterns. The space-by-time decomposition accommodates a unified view of the hierarchical mapping from task parameters to coordinated muscle activations, which could be employed as a reference framework for studying compositional motor control.

Learning potential functions and their representations for multi-task reinforcement learning

In multi-task learning, there are roughly two approaches to discovering representations. The first is to discover task relevant representations, i.e., those that compactly represent solutions to particular tasks. The second is to discover domain relevant representations, i.e., those that compactly represent knowledge that remains invariant across many tasks. In this article, we propose a new approach to multi-task learning that captures domain-relevant knowledge by learning potential-based shaping functions, which augment a task’s reward function with artificial rewards. We address two key issues that arise when deriving potential functions. The first is what kind of target function the potential function should approximate; we propose three such targets and show empirically that which one is best depends critically on the domain and learning parameters. The second issue is the representation for the potential function. This article introduces the notion of \(k\)-relevance, the expected relevance of a representation on a sample sequence of \(k\) tasks, and argues that this is a unifying definition of relevance of which both task and domain relevance are special cases. We prove formally that, under certain assumptions, \(k\)-relevance converges monotonically to a fixed point as \(k\) increases, and use this property to derive Feature Selection Through Extrapolation of k-relevance (FS-TEK), a novel feature-selection algorithm. We demonstrate empirically the benefit of FS-TEK on artificial domains.

Imaging Fatigue of Interference Control Reveals the Neural Basis of Executive Resource Depletion

Executive control coordinates, prioritizes, and selects task-relevant representations under conditions of conflict. Behavioral evidence has documented that executive resources are separable, finite, and can be temporarily depleted; however, the neural basis for such resource limits are largely unknown. Here, we investigate the neural correlates underlying the fatigue or depletion of interference control, an executive process hypothesized to mediate competition among candidate memory representations. Using a pre/post continuous acquisition fMRI design, we demonstrate that, compared with a nondepletion control group, the depletion group showed a fatigue-induced performance deficit that was specific to interference control and accompanied by a left-to-right shift in the network of active regions. Specifically, we observed decreased BOLD signal in the left inferior frontal gyrus (IFG), striatum, and the cerebellum, along with a corresponding increase in right hemisphere regions including the IFG, insular, and temporal cortex. Depletion-related changes in activation magnitude correlated with behavioral changes, suggesting that decreased recruitment of task-relevant regions, including left IFG, contributes to impaired interference control. These results provide new evidence about the brain dynamics of "process-specific" fatigue and suggest that depletion may pose a significant limitation on the cognitive and neural resources available for executive control.

What is the Functional Relevance of Prefrontal Cortex Entrainment to Hippocampal Theta Rhythms?

There has been considerable interest in the importance of oscillations in the brain and in how these oscillations relate to the firing of single neurons. Recently a number of studies have shown that the spiking of individual neurons in the medial prefrontal cortex (mPFC) become entrained to the hippocampal (HPC) theta rhythm. We recently showed that theta-entrained mPFC cells lost theta-entrainment specifically on error trials even though the firing rates of these cells did not change (Hyman et al., 2010). This implied that the level of HPC theta-entrainment of mPFC units was more predictive of trial outcome than differences in firing rates and that there is more information encoded by the mPFC on working memory tasks than can be accounted for by a simple rate code. Nevertheless, the functional meaning of mPFC entrainment to HPC theta remains a mystery. It is also unclear as to whether there are any differences in the nature of the information encoded by theta-entrained and non-entrained mPFC cells. In this review we discuss mPFC entrainment to HPC theta within the context of previous results as well as provide a more detailed analysis of the Hyman et al. (2010) data set. This re-analysis revealed that theta-entrained mPFC cells selectively encoded a variety of task-relevant behaviors and stimuli while never theta-entrained mPFC cells were most strongly attuned to errors or the lack of expected rewards. In fact, these error responsive neurons were responsible for the error representations exhibited by the entire ensemble of mPFC neurons. A theta reset was also detected in the post-error period. While it is becoming increasingly evident that mPFC neurons exhibit correlates to virtually all cues and behaviors, perhaps phase-locking directs attention to the task-relevant representations required to solve a spatially based working memory task while the loss of theta-entrainment at the start of error trials may represent a shift of attention away from these representations. The subsequent theta reset following error commission, when coupled with the robust responses of never theta-entrained cells, could produce a potent error-evoked signal used to alert the rat to changes in the relationship between task-relevant cues and reward expectations.

Cardiorespiratory Fitness and Attentional Control in the Aging Brain

A growing body of literature provides evidence for the prophylactic influence of cardiorespiratory fitness on cognitive decline in older adults. This study examined the association between cardiorespiratory fitness and recruitment of the neural circuits involved in an attentional control task in a group of healthy older adults. Employing a version of the Stroop task, we examined whether higher levels of cardiorespiratory fitness were associated with an increase in activation in cortical regions responsible for imposing attentional control along with an up-regulation of activity in sensory brain regions that process task-relevant representations. Higher fitness levels were associated with better behavioral performance and an increase in the recruitment of prefrontal and parietal cortices in the most challenging condition, thus providing evidence that cardiorespiratory fitness is associated with an increase in the recruitment of the anterior processing regions. There was a top-down modulation of extrastriate visual areas that process both task-relevant and task-irrelevant attributes relative to the baseline. However, fitness was not associated with differential activation in the posterior processing regions, suggesting that fitness enhances attentional function by primarily influencing the neural circuitry of anterior cortical regions. This study provides novel evidence of a differential association of fitness with anterior and posterior brain regions, shedding further light onto the neural changes accompanying cardiorespiratory fitness.

The Human Basal Ganglia Modulate Frontal-Posterior Connectivity during Attention Shifting

Current models of flexible cognitive control emphasize the role of the prefrontal cortex. This region has been shown to control attention by biasing information processing in favor of task-relevant representations. However, the prefrontal cortex does not act in isolation. We used functional magnetic resonance imaging combined with nonlinear dynamic causal modeling to demonstrate that the basal ganglia play a role in modulating the top-down influence of the prefrontal cortex on visual processing in humans. Specifically, our results reveal that connectivity between the prefrontal cortex and stimulus-specific visual association areas depends on activity in the ventral striatopallidum, elicited by salient events leading to shifts in attention. These data integrate disparate literatures on top-down control by the prefrontal cortex and selective gating by the basal ganglia and highlight the importance of the basal ganglia for high-level cognitive control.

A multinomial processing tree model of change blindness and change detection

In most change blindness studies, the failure to report changes is attributed to either a representational failure (the pre-change scene is not represented in memory) or to a comparison failure (pre- and post-change scenes are not compared). Here, I propose a multinomial processing-tree (MPT) model, which determines the relative contributions of representational and comparison failures to change blindness, as well as the level of detail of the scene representation. MPT models are statistical models used to measure latent cognitive processes from observable raw data. Cognitive processes are represented as model's parameters, their respective weights can be assessed, and the fit of the model to the empirical data can be evaluated via goodness-of-fit tests (Batchelder & Riefer, 1999). The MPT model I propose assumes that visual information is either represented in memory or non-represented, and, if represented, that visual representation can be compared to the currently-displayed view or not. Here, I ran one change blindness experiment to test the model's predictions. Observers (N=144) were shown a map of a virtual village and had to perform a 7-stage route in the map. Changes occurred on task-relevant or task-irrelevant objects. Observers were instructed to complete the route as quickly as possible, and to report perceived changes. Results show that differences in change detection performances are due to the quality of representation in memory, which depends on object's relevance for the task, and not to a comparison process (the model's weighting of the memory representation parameter varies from 19% to 82%, whereas the weighting of the memory comparison parameters remains stable in the range from 28% to 38%). Moreover, the model showed that only a task-relevant representation theory could fit the data. Implications for several theories of scene representation (Hollinworth, 2004; Irwin & Zelinski, 2002; Rensink, 2000; Triesch et al, 2003) are discussed.

Shape-specific preparatory activity mediates attention to targets in human visual cortex

The mechanisms of attention prioritize sensory input for efficient perceptual processing. Influential theories suggest that attentional biases are mediated via preparatory activation of task-relevant perceptual representations in visual cortex, but the neural evidence for a preparatory coding model of attention remains incomplete. In this experiment, we tested core assumptions underlying a preparatory coding model for attentional bias. Exploiting multivoxel pattern analysis of functional neuroimaging data obtained during a non-spatial attention task, we examined the locus, time-course, and functional significance of shape-specific preparatory attention in the human brain. Following an attentional cue, yet before the onset of a visual target, we observed selective activation of target-specific neural subpopulations within shape-processing visual cortex (lateral occipital complex). Target-specific modulation of baseline activity was sustained throughout the duration of the attention trial and the degree of target specificity that characterized preparatory activation patterns correlated with perceptual performance. We conclude that top-down attention selectively activates target-specific neural codes, providing a competitive bias favoring task-relevant representations over competing representations distributed within the same subregion of visual cortex.

Parallel perceptual enhancement and hierarchic relevance evaluation in an audio-visual conjunction task

Attention directs limited-capacity information processing resources to a subset of available perceptual representations. The mechanisms by which attention selects task-relevant representations for preferential processing are not fully known. Triesman and Gelade's [Triesman, A., Gelade, G., 1980. A feature integration theory of attention. Cognit. Psychol. 12 , 97–136.] influential attention model posits that simple features are processed preattentively, in parallel, but that attention is required to serially conjoin multiple features into an object representation. Event-related potentials have provided evidence for this model showing parallel processing of perceptual features in the posterior Selection Negativity (SN) and serial, hierarchic processing of feature conjunctions in the Frontal Selection Positivity (FSP). Most prior studies have been done on conjunctions within one sensory modality while many real-world objects have multimodal features. It is not known if the same neural systems of posterior parallel processing of simple features and frontal serial processing of feature conjunctions seen within a sensory modality also operate on conjunctions between modalities. The current study used ERPs and simultaneously presented auditory and visual stimuli in three task conditions: Attend Auditory (auditory feature determines the target, visual features are irrelevant), Attend Visual (visual features relevant, auditory irrelevant), and Attend Conjunction (target defined by the co-occurrence of an auditory and a visual feature). In the Attend Conjunction condition when the auditory but not the visual feature was a target there was an SN over auditory cortex, when the visual but not auditory stimulus was a target there was an SN over visual cortex, and when both auditory and visual stimuli were targets (i.e. conjunction target) there were SNs over both auditory and visual cortex, indicating parallel processing of the simple features within each modality. In contrast, an FSP was present when either the visual only or both auditory and visual features were targets, but not when only the auditory stimulus was a target, indicating that the conjunction target determination was evaluated serially and hierarchically with visual information taking precedence. This indicates that the detection of a target defined by audio-visual conjunction is achieved via the same mechanism as within a single perceptual modality, through separate, parallel processing of the auditory and visual features and serial processing of the feature conjunction elements, rather than by evaluation of a fused multimodal percept.

Nonperiodic Synchronization in Heterogeneous Networks of Spiking Neurons

Neural synchronization is of wide interest in neuroscience and has been argued to form the substrate for conscious attention to stimuli, movement preparation, and the maintenance of task-relevant representations in active memory. Despite a wealth of possible functions, the mechanisms underlying synchrony are still poorly understood. In particular, in vitro preparations have demonstrated synchronization with no apparent periodicity, which cannot be explained by simple oscillatory mechanisms. Here, we investigate the possible origins of nonperiodic synchronization through biophysical simulations. We show that such aperiodic synchronization arises naturally under a simple set of plausible assumptions, depending crucially on heterogeneous cell properties. In addition, nonperiodicity occurs even in the absence of stochastic fluctuation in membrane potential, suggesting that it may represent an intrinsic property of interconnected networks. Simulations capture some of the key aspects of population-level synchronization in spontaneous network spikes (NSs) and suggest that the intrinsic nonperiodicity of NSs observed in reduced cell preparations is a phenomenon that is highly robust and can be reproduced in simulations that involve a minimal set of realistic assumptions. In addition, a model with spike timing-dependent plasticity can overcome a natural tendency to exhibit nonperiodic behavior. After rhythmic stimulation, the model does not automatically fall back to a state of nonperiodic behavior, but keeps replaying the pattern of evoked NSs for a few cycles. A cluster analysis of synaptic strengths highlights the importance of population-wide interactions in generating this result and describes a possible route for encoding temporal patterns in networks of neurons.

Biased emotional attention in post-traumatic stress disorder: a help as well as a hindrance?

From a cognitive neuroscience perspective, the emotional attentional bias in post-traumatic stress disorder (PTSD) could be conceptualized either as emotional hyper-responsiveness or as reduced priming of task-relevant representations due to dysfunction in 'top-down' regulatory systems. We investigated these possibilities both with respect to threatening and positive stimuli among traumatized individuals with and without PTSD. Twenty-two patients with PTSD, 21 trauma controls and 20 non-traumatized healthy participants were evaluated on two tasks. For one of these tasks, the affective Stroop task (aST), the emotional stimuli act as distracters and interfere with task performance. For the other, the emotional lexical decision task (eLDT), emotional information facilitates task performance. Compared to trauma controls and healthy participants, patients with PTSD showed increased interference for negative but not positive distracters on the aST and increased emotional facilitation for negative words on the eLDT. These findings document that hyper-responsiveness to threat but not to positive stimuli is specific for patients with PTSD.

Cognitive fatigue of executive processes: Interaction between interference resolution tasks

A resource depletion framework motivated a novel strategy for investigating whether the central executive is unitary or separable into relatively independent subprocesses. The idea that tasks with overlapping neural representations may involve similar executive components was also critical to our approach. Of particular interest were tasks requiring resolution of interference among competing representations. Within a single experimental session intensive training reduced the ability to resolve interference on a transfer task if the training task placed high demands on interference resolution. Negative transfer was absent when interference resolution was minimally required by the task, or when the training and transfer tasks did not rely on overlapping neural representations. These results suggest a nonunitary central executive composed of separable subcomponents, at least one of which mediates interference resolution. Our results are consistent with an executive control process specialized for the selection of task-relevant representations from competitors. The results also agree with the view that higher cognitive processes are resource limited and can be temporarily depleted.