Representations In Brain Research Articles

Neural computations in prosopagnosia.

We report an investigation of the neural processes involved in the processing of faces and objects of brain-lesioned patient PS, a well-documented case of pure acquired prosopagnosia. We gathered a substantial dataset of high-density electrophysiological recordings from both PS and neurotypicals. Using representational similarity analysis, we produced time-resolved brain representations in a format that facilitates direct comparisons across time points, different individuals, and computational models. To understand how the lesions in PS's ventral stream affect the temporal evolution of her brain representations, we computed the temporal generalization of her brain representations. We uncovered that PS's early brain representations exhibit an unusual similarity to later representations, implying an excessive generalization of early visual patterns. To reveal the underlying computational deficits, we correlated PS' brain representations with those of deep neural networks (DNN). We found that the computations underlying PS' brain activity bore a closer resemblance to early layers of a visual DNN than those of controls. However, the brain representations in neurotypicals became more akin to those of the later layers of the model compared to PS. We confirmed PS's deficits in high-level brain representations by demonstrating that her brain representations exhibited less similarity with those of a DNN of semantics.

Automated individual cortical parcellation via consensus graph representation learning

Cortical parcellation plays a pivotal role in elucidating the brain organization. Despite the growing efforts to develop parcellation algorithms using functional magnetic resonance imaging, achieving a balance between intra-individual specificity and inter-individual consistency proves challenging, making the generation of high-quality, subject-consistent cortical parcellations particularly elusive. To solve this problem, our paper proposes a fully automated individual cortical parcellation method based on consensus graph representation learning. The method integrates spectral embedding with low-rank tensor learning into a unified optimization model, which uses group-common connectivity patterns captured by low-rank tensor learning to optimize subjects’ functional networks. This not only ensures consistency in brain representations across different subjects but also enhances the quality of each subject’s representation matrix by eliminating spurious connections. More importantly, it achieves an adaptive balance between intra-individual specificity and inter-individual consistency during this process. Experiments conducted on a test–retest dataset from the Human Connectome Project (HCP) demonstrate that our method outperforms existing methods in terms of reproducibility, functional homogeneity, and alignment with task activation. Extensive network-based comparisons on the HCP S900 dataset reveal that the functional network derived from our cortical parcellation method exhibits greater capabilities in gender identification and behavior prediction than other approaches.

Using unsupervised capsule neural network reveal spatial representations in the human brain.

Humans can extract high-level spatial features from visual signals, but spatial representations in the brain are complex and remain unclear. The unsupervised capsule neural network (U-CapsNet) is sensitive to the spatial location and relationship of the object, contains a special recurrent mechanism and uses a self-supervised generation strategy to represent images, which is similar to the computational principle in the human brain. Therefore, we hypothesized that U-CapsNet can help us understand how the human brain processes spatial information. First, brain activities were studied using functional magnetic resonance imaging during spatial working memory in which participants had to remember the locations of circles for a short time. Then, U-CapsNet served as a computational model of the brain to perform tasks that are identical to those performed by humans. Finally, the representational models were used to compare the U-CapsNet with the brain. The results showed that some human-defined spatial features naturally emerged in the latent space of U-CapsNet. Moreover, representations in U-CapsNet captured the response structure of two types of brain regions during different activity patterns, as well as important factors associated with human behavior. Together, our study not only provides a computationally feasible framework for modeling how the human brain encodes spatial features but also provides insights into the representational format and goals of the human brain.

The memory trace of an intrusive trauma-analog episode

Intrusive memories are a core symptom of posttraumatic stress disorder. Compared with memories of everyday events, they are characterized by several seemingly contradictory features: intrusive memories contain distinct sensory and emotional details of the traumatic event and can be triggered by various perceptually similar cues, but they are poorly integrated into conceptual memory. Here, we conduct exploratory whole-brain analyses to investigate the neural representations of trauma-analog experiences and how they are reactivated during memory intrusions. We show that trauma-analog movies induce excessive processing and generalized representations in sensory areas but decreased blood-oxygen-level-dependent (BOLD) responses and highly distinct representations in conceptual/semantic areas. Intrusive memories activate generalized representations in sensory areas and reactivate memory traces specific to trauma-analog events in the anterior cingulate cortex. These findings provide the first evidence of how traumatic events could distort memory representations in the human brain, which may form the basis for future confirmatory research on the neural representations of traumatic experiences.

Brain Organoids, the Path Forward?

Brain Organoids, the Path Forward?

Speech-induced suppression during natural dialogues

When engaged in a conversation, one receives auditory information from the other’s speech but also from their own speech. However, this information is processed differently by an effect called Speech-Induced Suppression. Here, we studied brain representation of acoustic properties of speech in natural unscripted dialogues, using electroencephalography (EEG) and high-quality speech recordings from both participants. Using encoding techniques, we were able to reproduce a broad range of previous findings on listening to another’s speech, and achieving even better performances when predicting EEG signal in this complex scenario. Furthermore, we found no response when listening to oneself, using different acoustic features (spectrogram, envelope, etc.) and frequency bands, evidencing a strong effect of SIS. The present work shows that this mechanism is present, and even stronger, during natural dialogues. Moreover, the methodology presented here opens the possibility of a deeper understanding of the related mechanisms in a wider range of contexts.

The cortical representation of language timescales is shared between reading and listening

Language comprehension involves integrating low-level sensory inputs into a hierarchy of increasingly high-level features. Prior work studied brain representations of different levels of the language hierarchy, but has not determined whether these brain representations are shared between written and spoken language. To address this issue, we analyze fMRI BOLD data that were recorded while participants read and listened to the same narratives in each modality. Levels of the language hierarchy are operationalized as timescales, where each timescale refers to a set of spectral components of a language stimulus. Voxelwise encoding models are used to determine where different timescales are represented across the cerebral cortex, for each modality separately. These models reveal that between the two modalities timescale representations are organized similarly across the cortical surface. Our results suggest that, after low-level sensory processing, language integration proceeds similarly regardless of stimulus modality.

Decoding face recognition abilities in the human brain.

Why are some individuals better at recognizing faces? Uncovering the neural mechanisms supporting face recognition ability has proven elusive. To tackle this challenge, we used a multimodal data-driven approach combining neuroimaging, computational modeling, and behavioral tests. We recorded the high-density electroencephalographic brain activity of individuals with extraordinary face recognition abilities-super-recognizers-and typical recognizers in response to diverse visual stimuli. Using multivariate pattern analyses, we decoded face recognition abilities from 1 s of brain activity with up to 80% accuracy. To better understand the mechanisms subtending this decoding, we compared representations in the brains of our participants with those in artificial neural network models of vision and semantics, as well as with those involved in human judgments of shape and meaning similarity. Compared to typical recognizers, we found stronger associations between early brain representations of super-recognizers and midlevel representations of vision models as well as shape similarity judgments. Moreover, we found stronger associations between late brain representations of super-recognizers and representations of the artificial semantic model as well as meaning similarity judgments. Overall, these results indicate that important individual variations in brain processing, including neural computations extending beyond purely visual processes, support differences in face recognition abilities. They provide the first empirical evidence for an association between semantic computations and face recognition abilities. We believe that such multimodal data-driven approaches will likely play a critical role in further revealing the complex nature of idiosyncratic face recognition in the human brain.

Identification and Verification of Error-Related Potentials Based on Cerebellar Targets.

The error-related potential (ErrP) is a weak explicit representation of the human brain for individual wrong behaviors. Previously, ErrP-related research usually focused on the design of automatic correction and the error correction mechanisms of high-risk pipeline-type judgment systems. Mounting evidence suggests that the cerebellum plays an important role in various cognitive processes. Thus, this study introduced cerebellar information to enhance the online classification effect of error-related potentials. We introduced cerebellar regional characteristics and improved discriminative canonical pattern matching (DCPM) in terms of data training and model building. In addition, this study focused on the application value and significance of cerebellar error-related potential characterization in the selection of excellent ErrP-BCI subjects (brain-computer interface). Here, we studied a specific ErrP, the so-called feedback ErrP. Thirty participants participated in this study. The comparative experiments showed that the improved DCPM classification algorithm proposed in this paper improved the balance accuracy by approximately 5-10% compared with the original algorithm. In addition, a correlation analysis was conducted between the error-related potential indicators of each brain region and the classification effect of feedback ErrP-BCI data, and the Fisher coefficient of the cerebellar region was determined as the quantitative screening index of the subjects. The screened subjects were superior to other subjects in the performance of the classification algorithm, and the performance of the classification algorithm was improved by up to 10%.

A new perspective on positive symptoms: expression of damage or self-defence mechanism of the brain?

Usually, positive neurological symptoms are considered as the consequence of a mere, afinalistic and abnormal increase in function of specific brain areas. However, according to the Theory of Active Inference, which argues that action and perception constitute a loop that updates expectations according to a Bayesian model, the brain is rather an explorer that formulates hypotheses and tests them to assess the correspondence between internal models and reality. Moreover, the cerebral cortex is characterised by a continuous “conflict” between different brain areas, which constantly attempt to expand in order to acquire more of the limited available computational resources, by means of their dopamine-induced neuroplasticity. Thus, it has recently been suggested that dreams, during rapid eye movement sleep (REMS), protect visual brain areas (deprived of their stimuli during rest) from being conquered by other normally stimulated ones. It is therefore conceivable that positive symptoms also have a functional importance for the brain. We evaluate supporting literature data of a ‘defensive’ role of positive symptoms and the relevance of dopamine-induced neuroplasticity in the context of neurodegenerative and psychiatric diseases. Furthermore, the possible functional significance of idiopathic REMS-related behavioural disorder as well as phantom limb syndrome is examined. We suggest that positive neurological symptoms are not merely a passive expression of a damage, but active efforts, related to dopamine-induced plasticity, to maintain a correct relationship between the external world and its brain representation, thus preventing healthy cortical areas from ousting injured ones.

Comprehensive mapping of the exterior architecture of the dromedary camel brain

The morphological perspective of the camel brain remains largely unexplored. Therefore, studying the topography of the camel brain is of crucial importance. This study aimed to provide a detailed color-coded topographic representation of the camel brain's gross anatomy and nomenclature, showing its various gyri and sulci and their borders. We compared them to previously known information to develop a detailed description of camel brain exterior architecture. Our research identified distinctive gyri and sulci with discrete positions and surrounding structures, allowing us to define sulci boundaries and establish logical gyri nomenclature. This study uncovered previously overlooked gyri and sulci and improved descriptions of specific sulci. The ectomarginal sulcus, splenial sulcus, splenial gyrus, and ectogenual gyrus are a few examples. These findings highlight several unique anatomical features of the dromedary brain, which can guide future research. By providing a comprehensive examination of the distinctive exterior anatomical features of the camel brain, this study may serve as a point of convergence for all researchers, providing more accurate identification of the gyri and sulci.

Human brain representations of internally generated outcomes of approximate calculation revealed by ultra-high-field brain imaging

Much of human culture’s advanced technology owes its existence to the ability to mentally manipulate quantities. Neuroscience has described the brain regions overall recruited by numerical tasks and the neuronal codes representing individual quantities during perceptual tasks. Nevertheless, it remains unknown how quantity representations are combined or transformed during mental computations and how specific quantities are coded in the brain when generated as the result of internal computations rather than evoked by a stimulus. Here, we imaged the brains of adult human subjects at 7 Tesla during an approximate calculation task designed to disentangle in- and outputs of the computation from the operation itself. While physically presented sample numerosities were distinguished in activity patterns along the dorsal visual pathway and within frontal and occipito-temporal regions, a representation of the internally generated result was most prominently detected in higher order regions such as angular gyrus and lateral prefrontal cortex. Behavioral precision in the task was related to cross-decoding performance between sample and result representations in medial IPS regions. This suggests the transformation of sample into result may be carried out within dorsal stream sensory-motor integration regions, and resulting outputs maintained for task purposes in higher-level regions in a format possibly detached from sensory-evoked inputs.

HoloBrain: 3D low-cost mobile augmented reality rendering of brain tumour using the GVF snake model segmentation

ABSTRACT Augmented reality (AR) is a dynamic field intersecting various disciplines, with applications spanning medicine and diagnostics. Our focus on advancing medical imaging has led to groundbreaking progress in brain tumor diagnosis, fostering optimism in treatment. In this pursuit, we introduce HoloBrain, an accessible AR application designed to transform medical education. Utilizing smartphones, HoloBrain enables automatic segmentation, AR visualization, and 3D interaction without the need for head-mounted devices. Emphasizing practicality over hyper-realism, our innovation allows medical students to seamlessly integrate a virtual brain tumor model into their surroundings. This immersive approach facilitates exploration of the 3D representation of an afflicted brain, enhancing educational experiences. Tests in a controlled environment using a phantom head yielded promising results, with our solution demonstrating average errors of 2 mm to 4.5 mm on smartphone displays. These outcomes highlight the precision and effectiveness of our contribution, underlining its potential in transforming medical education and training. HoloBrain represents a step forward in making AR accessible and impactful for aspiring medical professionals, offering a valuable tool for enhancing their understanding of complex medical scenarios.

Improved Video Emotion Recognition with Alignment of CNN and Human Brain Representations

Improved Video Emotion Recognition with Alignment of CNN and Human Brain Representations

Performance Evaluation of Matrix Factorization for fMRI Data.

A hypothesis in the study of the brain is that sparse coding is realized in information representation of external stimuli, which has been experimentally confirmed for visual stimulus recently. However, unlike the specific functional region in the brain, sparse coding in information processing in the whole brain has not been clarified sufficiently. In this study, we investigate the validity of sparse coding in the whole human brain by applying various matrix factorization methods to functional magnetic resonance imaging data of neural activities in the brain. The result suggests the sparse coding hypothesis in information representation in the whole human brain, because extracted features from the sparse matrix factorization (MF) method, sparse principal component analysis (SparsePCA), or method of optimal directions (MOD) under a high sparsity setting or an approximate sparse MF method, fast independent component analysis (FastICA), can classify external visual stimuli more accurately than the nonsparse MF method or sparse MF method under a low sparsity setting.

Modeling Brain Representations of Words' Concreteness in Context Using GPT-2 and Human Ratings.

The meaning of most words in language depends on their context. Understanding how the human brain extracts contextualized meaning, and identifying where in the brain this takes place, remain important scientific challenges. But technological and computational advances in neuroscience and artificial intelligence now provide unprecedented opportunities to study the human brain in action as language is read and understood. Recent contextualized language models seem to be able to capture homonymic meaning variation ("bat", in a baseball vs. a vampire context), as well as more nuanced differences of meaning-for example, polysemous words such as "book", which can be interpreted in distinct but related senses ("explain a book", information, vs. "open a book", object) whose differences are fine-grained. We study these subtle differences in lexical meaning along the concrete/abstract dimension, as they are triggered by verb-noun semantic composition. We analyze functional magnetic resonance imaging (fMRI) activations elicited by Italian verb phrases containing nouns whose interpretation is affected by the verb to different degrees. By using a contextualized language model and human concreteness ratings, we shed light on where in the brain such fine-grained meaning variation takes place and how it is coded. Our results show that phrase concreteness judgments and the contextualized model can predict BOLD activation associated with semantic composition within the language network. Importantly, representations derived from a complex, nonlinear composition process consistently outperform simpler composition approaches. This is compatible with a holistic view of semantic composition in the brain, where semantic representations are modified by the process of composition itself. When looking at individual brain areas, we find that encoding performance is statistically significant, although with differing patterns of results, suggesting differential involvement, in the posterior superior temporal sulcus, inferior frontal gyrus and anterior temporal lobe, and in motor areas previously associated with processing of concreteness/abstractness.

Detailed high quality surface-based mouse CAD model suitable for electromagnetic simulations

Transcranial magnetic stimulation (TMS) studies with small animals can provide useful knowledge of activating regions and mechanisms. Along with this, functional magnetic resonance imaging (fMRI) in mice and rats is increasingly often used to draw important conclusions about brain connectivity and functionality. For cases of both low- and high-frequency TMS studies, a high-quality computational surface-based rodent model may be useful as a tool for performing supporting modeling and optimization tasks. This work presents the development and usage of an accurate CAD model of a mouse that has been optimized for use in computational electromagnetic modeling in any frequency range. It is based on the labeled atlas data of the Digimouse archive. The model includes a relatively accurate four-compartment brain representation (the ‘whole brain’ according to the original terminology, external cerebrum, cerebellum, and striatum [9]) and contains 21 distinct compartments in total. Four examples of low- and high frequency modeling have been considered to demonstrate the utility and applicability of the model.

Corrigendum: Learning the heterogeneous representation of brain's structure from serial SEM images using a masked autoencoder

Corrigendum: Learning the heterogeneous representation of brain's structure from serial SEM images using a masked autoencoder

Still an Ineffective Method With supertrials/ERPs-Comments on "decoding Brain Representations by Multimodal Learning of Neural Activity and Visual Features".

A recent paper claims that a newly proposed method classifies EEG data recorded from subjects viewing ImageNet stimuli better than two prior methods. However, the analysis used to support that claim is based on confounded data. We repeat the analysis on a large new dataset that is free from that confound. Training and testing on aggregated supertrials derived by summing trials demonstrates that the two prior methods achieve statistically significant above-chance accuracy while the newly proposed method does not.

Brain Representation of Animal and Non-Animal Images in Patients with Mild Cognitive Impairment and Alzheimer's Disease.

In early Alzheimer's disease (AD), high-level visual functions and processing speed are impacted. Few functional magnetic resonance imaging (fMRI) studies have investigated high-level visual deficits in AD, yet none have explored brain activity patterns during rapid animal/non-animal categorization tasks. To address this, we utilized the previously known Integrated Cognitive Assessment (ICA) to collect fMRI data and compare healthy controls (HC) to individuals with mild cognitive impairment (MCI) and mild AD. The ICA encompasses a rapid visual categorization task that involves distinguishing between animals and non-animals within natural scenes. To comprehensively explore variations in brain activity levels and patterns, we conducted both univariate and multivariate analyses of fMRI data. The ICA task elicited activation across a range of brain regions, encompassing the temporal, parietal, occipital, and frontal lobes. Univariate analysis, which compared responses to animal versus non-animal stimuli, showed no significant differences in the regions of interest (ROIs) across all groups, with the exception of the left anterior supramarginal gyrus in the HC group. In contrast, multivariate analysis revealed that in both HC and MCI groups, several regions could differentiate between animals and non-animals based on distinct patterns of activity. Notably, such differentiation was absent within the mild AD group. Our study highlights the ICA task's potential as a valuable cognitive assessment tool designed for MCI and AD. Additionally, our use of fMRI pattern analysis provides valuable insights into the complex changes in brain function associated with AD. This approach holds promise for enhancing our understanding of the disease's progression.