Computational Cognitive Neuroscience Research Articles

Model Virtues in Computational Cognitive Neuroscience.

There is an abundance of computational models in cognitive neuroscience. A framework for what is desirable in a model, what justifies the introduction of a new one, or what makes one better than another is lacking, however. In this article, we examine key qualities ("virtues") that are desirable in computational models, and how these are interrelated. To keep the scope of the article manageable, we focus on the field of cognitive control, where we identified six "model virtues": empirical accuracy, empirical scope, functional analysis, causal detail, biological plausibility, and psychological plausibility. We first illustrate their use in published work on Stroop modeling and then discuss what expert modelers in the field of cognitive control said about them in a series of qualitative interviews. We found that virtues are interrelated and that their value depends on the modeler's goals, in ways that are not typically acknowledged in the literature. We recommend that researchers make the reasons for their modeling choices more explicit in published work. Our work is meant as a first step. Although our focus here is on cognitive control, we hope that our findings will spark discussion of virtues in other fields as well.

Model-Based Approaches to Investigating Mismatch Responses in Schizophrenia.

Alterations of mismatch responses (ie, neural activity evoked by unexpected stimuli) are often considered a potential biomarker of schizophrenia. Going beyond establishing the type of observed alterations found in diagnosed patients and related cohorts, computational methods can yield valuable insights into the underlying disruptions of neural mechanisms and cognitive function. Here, we adopt a typology of model-based approaches from computational cognitive neuroscience, providing an overview of the study of mismatch responses and their alterations in schizophrenia from four complementary perspectives: (a) connectivity models, (b) decoding models, (c) neural network models, and (d) cognitive models. Connectivity models aim at inferring the effective connectivity patterns between brain regions that may underlie mismatch responses measured at the sensor level. Decoding models use multivariate spatiotemporal mismatch response patterns to infer the type of sensory violations or to classify participants based on their diagnosis. Neural network models such as deep convolutional neural networks can be used for improved classification performance as well as for a systematic study of various aspects of empirical data. Finally, cognitive models quantify mismatch responses in terms of signaling and updating perceptual predictions over time. In addition to describing the available methodology and reviewing the results of recent computational psychiatry studies, we offer suggestions for future work applying model-based techniques to advance the study of mismatch responses in schizophrenia.

Computational Language Modeling and the Promise of In Silico Experimentation.

Language neuroscience currently relies on two major experimental paradigms: controlled experiments using carefully hand-designed stimuli, and natural stimulus experiments. These approaches have complementary advantages which allow them to address distinct aspects of the neurobiology of language, but each approach also comes with drawbacks. Here we discuss a third paradigm-in silico experimentation using deep learning-based encoding models-that has been enabled by recent advances in cognitive computational neuroscience. This paradigm promises to combine the interpretability of controlled experiments with the generalizability and broad scope of natural stimulus experiments. We show four examples of simulating language neuroscience experiments in silico and then discuss both the advantages and caveats of this approach.

Deep latent variable joint cognitive modeling of neural signals and human behavior

As the field of computational cognitive neuroscience continues to expand and generate new theories, there is a growing need for more advanced methods to test the hypothesis of brain-behavior relationships. Recent progress in Bayesian cognitive modeling has enabled the combination of neural and behavioral models into a single unifying framework. However, these approaches require manual feature extraction, and lack the capability to discover previously unknown neural features in more complex data. Consequently, this would hinder the expressiveness of the models. To address these challenges, we propose a Neurocognitive Variational Autoencoder (NCVA) to conjoin high-dimensional EEG with a cognitive model in both generative and predictive modeling analyses. Importantly, our NCVA enables both the prediction of EEG signals given behavioral data and the estimation of cognitive model parameters from EEG signals. This novel approach can allow for a more comprehensive understanding of the triplet relationship between behavior, brain activity, and cognitive processes.

Quantifying computational mechanisms in psychotherapy

AbstractDespite extensive research, the cognitive processes mediating the impact of psychotherapeutic interventions remain poorly understood, and as a result difficult to quantify. Identifying such mechanisms is likely to be extremely helpful: it could help target interventions better, could support dosing therapy through monitoring, and could heighten the speed at which new interventions can be developed. Mechanisms research in psychotherapy has described a number of key difficulties to achieving this. In this and the next talk, we ask whether advances in cognitive computational neuroscience might provide some support. Specifically, the question is whether precise cognitive probes might identify specific mechanisms of interventions. In support of this, I will first describe a pilot study in participants undergoing an adapted behavioural activation therapy. I will then move to present results from two strands of experiments examining whether interventions derived from components of cognitive-behavioural therapy (CBT) are able to shift computationally-derived measures of their proposed psychological substrates. Findings from both strands will be discussed with respect to challenges in developing brief, reliable, engaging, and user-acceptable measures of cognition. Overall, this outlines some early new results in using computational methods to understand therapeutic processes in the psychotherapy for depression.Disclosure of InterestQ. Huys Grant / Research support from: Koa Health, Consultant of: Aya Technologies and Alto Neuroscience

Current State and Future Directions for Learning in Biological Recurrent Neural Networks: A Perspective Piece

This perspective piece came about through the Generative Adversarial Collaboration (GAC) series of workshops organized by the Computational Cognitive Neuroscience (CCN) conference in 2020. We brought together a number of experts from the field of theoretical neuroscience to debate emerging issues in our understanding of how learning is implemented in biological recurrent neural networks. Here, we will give a brief review of the common assumptions about biological learning and the corresponding findings from experimental neuroscience and contrast them with the efficiency of gradient-based learning in recurrent neural networks commonly used in artificial intelligence. We will then outline the key issues discussed in the workshop: synaptic plasticity, neural circuits, theory-experiment divide, and objective functions. Finally, we conclude with recommendations for both theoretical and experimental neuroscientists when designing new studies that could help to bring clarity to these issues.

Invited Session IV: Top-down vs. bottom-up approaches to computational modeling of vision: Limits of prediction accuracy on randomly selected natural images for model evaluation

Prediction accuracy on held-out data has become a critical analysis for quantitative model evaluation and hypothesis testing in computational cognitive neuroscience. In this talk, I will discuss the limits of prediction accuracy as a standalone metric, and highlight other considerations for model evaluation and interpretation. First, comparing two models on prediction accuracy alone does not reveal the degree to which the models have common underlying factors. I will advocate addressing this issue with variance partitioning, a form of commonality analysis, to reveal shared and unique variance explained by different models. Concretely, I will show how variance partitioning reveals representation of body parts and object boundaries in responses to multiple data sets of movie stimuli. Second, prediction accuracy is a metric for the variance explained by a given model. But for any experiment, the stimulus constrains the variance in the measured brain responses. Any given stimulus set runs the risk of excluding important sources of variation. A popular way to address this issue is to use photographs or movie clips as stimuli. Such naturalistic stimuli are typically sampled broadly from the world and thus have increased ecological validity, but random selection of natural stimuli often results in correlated features both within and between models. This often leads to ambiguous results, e.g. shared variance between models intended to capture different types of features. Furthermore, I will show that the same models (again of body parts and object boundaries) can yield quantitatively and in some cases qualitatively different results when applied to different data sets. This raises a critical question: if results for the same model vary across stimulus sets, which result provides a more solid basis for future work? Just as two clocks telling different times need a reference clock to be set, I will argue that we need broadly sampled sets of natural stimuli to use as a baseline for what, in various feature domains, constitutes "natural" variation and covariation. I will describe our collaboration to create just such a dataset of human visual experience, in the form of hundreds of hours of first-person video.

Cognition Without Neural Representation: Dynamics of a Complex System.

This paper proposes an account of neurocognitive activity without leveraging the notion of neural representation. Neural representation is a concept that results from assuming that the properties of the models used in computational cognitive neuroscience (e.g., information, representation, etc.) must literally exist the system being modelled (e.g., the brain). Computational models are important tools to test a theory about how the collected data (e.g., behavioural or neuroimaging) has been generated. While the usefulness of computational models is unquestionable, it does not follow that neurocognitive activity should literally entail the properties construed in the model (e.g., information, representation). While this is an assumption present in computationalist accounts, it is not held across the board in neuroscience. In the last section, the paper offers a dynamical account of neurocognitive activity with Dynamical Causal Modelling (DCM) that combines dynamical systems theory (DST) mathematical formalisms with the theoretical contextualisation provided by Embodied and Enactive Cognitive Science (EECS).

Overfitting the Literature to One Set of Stimuli and Data.

A large number of papers in Computational Cognitive Neuroscience are developing and testing novel analysis methods using one specific neuroimaging dataset and problematic experimental stimuli. Publication bias and confirmatory exploration will result in overfitting to the limited available data. We highlight the problems with this specific dataset and argue for the need to collect more good quality open neuroimaging data using a variety of experimental stimuli, in order to test the generalisability of current published results, and allow for more robust results in future work.

Individualized cognitive neuroscience needs 7T: Comparing numerosity maps at 3T and 7T MRI

The field of cognitive neuroscience is weighing evidence about whether to move from the current standard field strength of 3 Tesla (3T) to ultra-high field (UHF) of 7T and above. The present study contributes to the evidence by comparing a computational cognitive neuroscience paradigm at 3T and 7T. The goal was to evaluate the practical effects, i.e. model predictive power, of field strength on a numerosity task using accessible pre-processing and analysis tools. Previously, using 7T functional magnetic resonance imaging and biologically-inspired analyses, i.e. population receptive field modelling, we discovered topographical organization of numerosity-selective neural populations in human parietal cortex. Here we show that these topographic maps are also detectable at 3T. However, averaging of many more functional runs was required at 3T to reliably reconstruct numerosity maps. On average, one 7T run had about four times the model predictive power of one 3T run. We believe that this amount of scanning would have made the initial discovery of the numerosity maps on 3T highly infeasible in practice. Therefore, we suggest that the higher signal-to-noise ratio and signal sensitivity of UHF MRI is necessary to build mechanistic models of the organization and function of our cognitive abilities in individual participants.

Enhancing Psychosis Risk Prediction Through Computational Cognitive Neuroscience.

Research suggests that early identification and intervention with individuals at clinical high risk (CHR) for psychosis may be able to improve the course of illness. The first generation of studies suggested that the identification of CHR through the use of specialized interviews evaluating attenuated psychosis symptoms is a promising strategy for exploring mechanisms associated with illness progression, etiology, and identifying new treatment targets. The next generation of research on psychosis risk must address two major limitations: (1) interview methods have limited specificity, as recent estimates indicate that only 15%–30% of individuals identified as CHR convert to psychosis and (2) the expertise needed to make CHR diagnosis is only accessible in a handful of academic centers. Here, we introduce a new approach to CHR assessment that has the potential to increase accessibility and positive predictive value. Recent advances in clinical and computational cognitive neuroscience have generated new behavioral measures that assay the cognitive mechanisms and neural systems that underlie the positive, negative, and disorganization symptoms that are characteristic of psychotic disorders. We hypothesize that measures tied to symptom generation will lead to enhanced sensitivity and specificity relative to interview methods and the cognitive intermediate phenotype measures that have been studied to date that are typically indicators of trait vulnerability and, therefore, have a high false positive rate for conversion to psychosis. These new behavioral measures have the potential to be implemented on the internet and at minimal expense, thereby increasing accessibility of assessments.

Looking into the future: The Journal of Neurophysiology

Looking into the future: The <i>Journal of Neurophysiology</i>

Auditory Perceptual History Is Propagated through Alpha Oscillations.

SummaryPerception is a proactive, “predictive” process, in which the brain relies, at least in part, on accumulated experience to make best guesses about the world to test against sensory data, updating the guesses as new experience is acquired. Using novel behavioral methods, the present study demonstrates the role of alpha rhythms in communicating past perceptual experience. Participants were required to discriminate the ear of origin of brief sinusoidal tones that were presented monaurally at random times within a burst of uncorrelated dichotic white noise masks. Performance was not constant but varied with delay after noise onset in an oscillatory manner at about 9 Hz (alpha rhythm). Importantly, oscillations occurred only for trials preceded by a target tone to the same ear, either on the previous trial or two trials back. These results suggest that communication of perceptual history generates neural oscillations within specific perceptual circuits, strongly implicating behavioral oscillations in predictive perception and with formation of working memory.

Salience Models: A Computational Cognitive Neuroscience Review.

The seminal model by Laurent Itti and Cristoph Koch demonstrated that we can compute the entire flow of visual processing from input to resulting fixations. Despite many replications and follow-ups, few have matched the impact of the original model—so what made this model so groundbreaking? We have selected five key contributions that distinguish the original salience model by Itti and Koch; namely, its contribution to our theoretical, neural, and computational understanding of visual processing, as well as the spatial and temporal predictions for fixation distributions. During the last 20 years, advances in the field have brought up various techniques and approaches to salience modelling, many of which tried to improve or add to the initial Itti and Koch model. One of the most recent trends has been to adopt the computational power of deep learning neural networks; however, this has also shifted their primary focus to spatial classification. We present a review of recent approaches to modelling salience, starting from direct variations of the Itti and Koch salience model to sophisticated deep-learning architectures, and discuss the models from the point of view of their contribution to computational cognitive neuroscience.

Modelling Autobiographical Memory Loss across Life Span

Neurocomputational modelling of long-term memory is a core topic in computational cognitive neuroscience, which is essential towards self-regulating brain-like AI systems. In this paper, we study how people generally lose their memories and emulate various memory loss phenomena using a neurocomputational autobiographical memory model. Specifically, based on prior neurocognitive and neuropsychology studies, we identify three neural processes, namely overload, decay and inhibition, which lead to memory loss in memory formation, storage and retrieval, respectively. For model validation, we collect a memory dataset comprising more than one thousand life events and emulate the three key memory loss processes with model parameters learnt from memory recall behavioural patterns found in human subjects of different age groups. The emulation results show high correlation with human memory recall performance across their life span, even with another population not being used for learning. To the best of our knowledge, this paper is the first research work on quantitative evaluations of autobiographical memory loss using a neurocomputational model.

Parameters as Trait Indicators: Exploring a Complementary Neurocomputational Approach to Conceptualizing and Measuring Trait Differences in Emotional Intelligence.

Current assessments of trait emotional intelligence (EI) rely on self-report inventories. While this approach has seen considerable success, a complementary approach allowing objective assessment of EI-relevant traits would provide some potential advantages. Among others, one potential advantage is that it would aid in emerging efforts to assess the brain basis of trait EI, where self-reported competency levels do not always match real-world behavior. In this paper, we review recent experimental paradigms in computational cognitive neuroscience (CCN), which allow behavioral estimates of individual differences in range of parameter values within computational models of neurocognitive processes. Based on this review, we illustrate how several of these parameters appear to correspond well to EI-relevant traits (i.e., differences in mood stability, stress vulnerability, self-control, and flexibility, among others). In contrast, although estimated objectively, these parameters do not correspond well to the optimal performance abilities assessed within competing “ability models” of EI. We suggest that adapting this approach from CCN—by treating parameter value estimates as objective trait EI measures—could (1) provide novel research directions, (2) aid in characterizing the neural basis of trait EI, and (3) offer a promising complementary assessment method.

Cognitive Computational Neuroscience: A New Conference for an Emerging Discipline

Understanding the computational principles that underlie complex behavior is a central goal in cognitive science, artificial intelligence, and neuroscience. In an attempt to unify these disconnected communities, we created a new conference called Cognitive Computational Neuroscience (CCN). The inaugural meeting revealed considerable enthusiasm but significant obstacles remain.

Data quality over data quantity in computational cognitive neuroscience

We analyzed factors that may hamper the advancement of computational cognitive neuroscience (CCN). These factors include a particular statistical mindset, which paves the way for the dominance of statistical power theory and a preoccupation with statistical replicability in the behavioral and neural sciences. Exclusive statistical concerns about sampling error occur at the cost of an inadequate representation of the problem of measurement error. We contrasted the manipulation of data quantity (sampling error, by varying the number of subjects) against the manipulation of data quality (measurement error, by varying the number of data per subject) in a simulated Bayesian model identifiability study. The results were clear-cut in showing that - across all levels of signal-to-noise ratios - varying the number of subjects was completely inconsequential, whereas the number of data per subject exerted massive effects on model identifiability. These results emphasize data quality over data quantity, and they call for the integration of statistics and measurement theory.

Outlook on deep neural networks in computational cognitive neuroscience

Outlook on deep neural networks in computational cognitive neuroscience

Perceptual category learning and visual processing: An exercise in computational cognitive neuroscience

The field of computational cognitive neuroscience (CCN) builds and tests neurobiologically detailed computational models that account for both behavioral and neuroscience data. This article leverages a key advantage of CCN–namely, that it should be possible to interface different CCN models in a plug-and-play fashion–to produce a new and biologically detailed model of perceptual category learning. The new model was created from two existing CCN models: the HMAX model of visual object processing and the COVIS model of category learning. Using bitmap images as inputs and by adjusting only a couple of learning-rate parameters, the new HMAX/COVIS model provides impressively good fits to human category-learning data from two qualitatively different experiments that used different types of category structures and different types of visual stimuli. Overall, the model provides a comprehensive neural and behavioral account of basal ganglia-mediated learning.