Cognitive Neuroscience Research Research Articles

Approximate planning in spatial search

How people plan is an active area of research in cognitive science, neuroscience, and artificial intelligence. However, tasks traditionally used to study planning in the laboratory tend to be constrained to artificial environments, such as Chess and bandit problems. To date there is still no agreed-on model of how people plan in realistic contexts, such as navigation and search, where values intuitively derive from interactions between perception and cognition. To address this gap and move towards a more naturalistic study of planning, we present a novel spatial Maze Search Task (MST) where the costs and rewards are physically situated as distances and locations. We used this task in two behavioral experiments to evaluate and contrast multiple distinct computational models of planning, including optimal expected utility planning, several one-step heuristics inspired by studies of information search, and a family of planners that deviate from optimal planning, in which action values are estimated by the interactions between perception and cognition. We found that people’s deviations from optimal expected utility are best explained by planners with a limited horizon, however our results do not exclude the possibility that in human planning action values may be also affected by cognitive mechanisms of numerosity and probability perception. This result makes a novel theoretical contribution in showing that limited planning horizon generalizes to spatial planning, and demonstrates the value of our multi-model approach for understanding cognition.

A combined DTI-fMRI approach for optimizing the delineation of posteromedial versus anterolateral entorhinal cortex.

In the entorhinal cortex (EC), attempts have been made to identify the human homologue regions of the medial (MEC) and lateral (LEC) subregions using either functional magnetic resonance imaging (fMRI) or diffusion tensor imaging (DTI). However, there are still discrepancies between entorhinal subdivisions depending on the choice of connectivity seed regions and the imaging modality used. While DTI can be used to follow the white matter tracts of the brain, fMRI can identify functionally connected brain regions. In this study, we used both DTI and resting-state fMRI in 103 healthy adults to investigate both structural and functional connectivity between the EC and associated cortical brain regions. Differential connectivity with these regions was then used to predict the locations of the human homologues of MEC and LEC. Our results from combining DTI and fMRI support a subdivision into posteromedial (pmEC) and anterolateral (alEC) EC and reveal a confined border between the pmEC and alEC. Furthermore, the EC subregions obtained by either imaging modality showed similar distinct whole-brain connectivity profiles. Optimizing the delineation of the human homologues of MEC and LEC with a combined, cross-validated DTI-fMRI approach allows to define a likely border between the two subdivisions and has implications for both cognitive and translational neuroscience research.

Development of a Marmoset Apparatus for Automated Pulling to study cooperative behaviors

In recent years, the field of neuroscience has increasingly recognized the importance of studying animal behaviors in naturalistic environments to gain deeper insights into ethologically relevant behavioral processes and neural mechanisms. The common marmoset (Callithrix jacchus), due to its small size, prosocial nature, and genetic proximity to humans, has emerged as a pivotal model toward this effort. However, traditional research methodologies often fail to fully capture the nuances of marmoset social interactions and cooperative behaviors. To address this critical gap, we developed the Marmoset Apparatus for Automated Pulling (MarmoAAP), a novel behavioral apparatus designed for studying cooperative behaviors in common marmosets. MarmoAAP addresses the limitations of traditional behavioral research methods by enabling high-throughput, detailed behavior outputs that can be integrated with video and audio recordings, allowing for more nuanced and comprehensive analyses even in a naturalistic setting. We also highlight the flexibility of MarmoAAP in task parameter manipulation which accommodates a wide range of behaviors and individual animal capabilities. Furthermore, MarmoAAP provides a platform to perform investigations of neural activity underlying naturalistic social behaviors. MarmoAAP is a versatile and robust tool for advancing our understanding of primate behavior and related cognitive processes. This new apparatus bridges the gap between ethologically relevant animal behavior studies and neural investigations, paving the way for future research in cognitive and social neuroscience using marmosets as a model organism.

Development of a Marmoset Apparatus for Automated Pulling to study cooperative behaviors.

In recent years, the field of neuroscience has increasingly recognized the importance of studying animal behaviors in naturalistic environments to gain deeper insights into ethologically relevant behavioral processes and neural mechanisms. The common marmoset (Callithrix jacchus), due to its small size, prosocial nature, and genetic proximity to humans, has emerged as a pivotal model toward this effort. However, traditional research methodologies often fail to fully capture the nuances of marmoset social interactions and cooperative behaviors. To address this critical gap, we developed the Marmoset Apparatus for Automated Pulling (MarmoAAP), a novel behavioral apparatus designed for studying cooperative behaviors in common marmosets. MarmoAAP addresses the limitations of traditional behavioral research methods by enabling high-throughput, detailed behavior outputs that can be integrated with video and audio recordings, allowing for more nuanced and comprehensive analyses even in a naturalistic setting. We also highlight the flexibility of MarmoAAP in task parameter manipulation which accommodates a wide range of behaviors and individual animal capabilities. Furthermore, MarmoAAP provides a platform to perform investigations of neural activity underlying naturalistic social behaviors. MarmoAAP is a versatile and robust tool for advancing our understanding of primate behavior and related cognitive processes. This new apparatus bridges the gap between ethologically relevant animal behavior studies and neural investigations, paving the way for future research in cognitive and social neuroscience using marmosets as a model organism.

Differential Hemodynamic Responses to Motor and Tactile Imagery: Insights from Multichannel fNIRS Mapping.

Tactile and motor imagery are crucial components of sensorimotor functioning and cognitive neuroscience research, yet the neural mechanisms of tactile imagery remain underexplored compared to motor imagery. This study employs multichannel functional near-infrared spectroscopy (fNIRS) combined with image reconstruction techniques to investigate the neural hemodynamics associated with tactile (TI) and motor imagery (MI). In a study of 15 healthy participants, we found that MI elicited significantly greater hemodynamic responses (HRs) in the precentral area compared to TI, suggesting the involvement of different cortical areas involved in two different types of sensorimotor mental imagery. Concurrently, the HRs in S1 and parietal areas exhibited comparable patterns in both TI and MI. During MI, both motor and somatosensory areas demonstrated comparable HRs. However, in TI, somatosensory activation was observed to be more pronounced. Our results highlight the distinctive neural profiles of motor versus tactile imagery and indicate fNIRS technique to be sensitive for this. This distinction is significant for fundamental understanding of sensorimotor integration and for developing advanced neurotechnologies, including imagery-based brain-computer interfaces (BCIs) that can differentiate between different types of mental imagery.

In the Mind's Eye: Exploring the Relationship Between Visual Mental Imagery and Stereotyping.

How do social stereotypes shape and reflect images formed in the mind's eye? Visual mental imagery has long been assumed crucial in creating, maintaining, and perpetuating stereotypes and prejudice. Surprisingly, research in social cognition has only recently begun to explore the causal role of mental images in these phenomena. In contrast, cognitive neuroscience research on visual mental imagery (VMI) has explored the pivotal role of imagery in various consequential cognitive and behavioral phenomena. However, cognitive neuroscience has largely neglected how stereotypes influence mental imagery. This article provides a historical overview of the development of these two fields in terms of mental imagery and discusses recent advances at their intersection. Opportunities for additional integration are highlighted, and suggestions for furthering the dual study of stereotyping and mental imagery are provided. How can social stereotypes impact and mirror visual imagination? It has long been assumed that visual mental imagery plays a central role in forming, maintaining, and strengthening stereotypes and prejudice. Yet, until recently, there has been limited exploration within social psychology and cognitive neuroscience on the explicit connection between visual mental images and social stereotypes. We describe the historical progression of these fields concerning visual imagery and explore recent advancements that unite stereotyping and mental imagery research. Furthermore, we propose avenues for future research to deepen our understanding of how individuals utilize mental images in stereotyping and how mental imagery can modify stereotypes.

The cognitive triad network - oscillation - behaviour links individual differences in EEG theta frequency with task performance and effective connectivity

We reconcile two significant lines of Cognitive Neuroscience research: the relationship between the structural and functional architecture of the brain and behaviour on the one hand and the functional significance of oscillatory brain processes to behavioural performance on the other. Network neuroscience proposes that the three elements, behavioural performance, EEG oscillation frequency, and network connectivity should be tightly connected at the individual level. Young and old healthy adults were recruited as a proxy for performance variation. An auditory inhibitory control task was used to demonstrate that task performance correlates with the individual EEG frontal theta frequency. Older adults had a significantly slower theta frequency, and both theta frequency and task performance correlated with the strengths of two network connections that involve the main areas of inhibitory control and speech processing. The results suggest that both the recruited functional network and the oscillation frequency induced by the task are specific to the task, are inseparable, and mark individual differences that directly link structure and function to behaviour in health and disease.

Development of a Marmoset Apparatus for Automated Pulling (MarmoAAP) to Study Cooperative Behaviors.

In recent years, the field of neuroscience has increasingly recognized the importance of studying animal behaviors in naturalistic environments to gain deeper insights into ethologically relevant behavioral processes and neural mechanisms. The common marmoset (Callithrix jacchus), due to its small size, prosocial nature, and genetic proximity to humans, has emerged as a pivotal model toward this effort. However, traditional research methodologies often fail to fully capture the nuances of marmoset social interactions and cooperative behaviors. To address this critical gap, we developed the Marmoset Apparatus for Automated Pulling (MarmoAAP), a novel behavioral apparatus designed for studying cooperative behaviors in common marmosets. MarmoAAP addresses the limitations of traditional behavioral research methods by enabling high-throughput, detailed behavior outputs that can be integrated with video and audio recordings, allowing for more nuanced and comprehensive analyses even in a naturalistic setting. We also highlight the flexibility of MarmoAAP in task parameter manipulation which accommodates a wide range of behaviors and individual animal capabilities. Furthermore, MarmoAAP provides a platform to perform investigations of neural activity underlying naturalistic social behaviors. MarmoAAP is a versatile and robust tool for advancing our understanding of primate behavior and related cognitive processes. This new apparatus bridges the gap between ethologically relevant animal behavior studies and neural investigations, paving the way for future research in cognitive and social neuroscience using marmosets as a model organism.

Bridging auditory perception and natural language processing with semantically informed deep neural networks

Sound recognition is effortless for humans but poses a significant challenge for artificial hearing systems. Deep neural networks (DNNs), especially convolutional neural networks (CNNs), have recently surpassed traditional machine learning in sound classification. However, current DNNs map sounds to labels using binary categorical variables, neglecting the semantic relations between labels. Cognitive neuroscience research suggests that human listeners exploit such semantic information besides acoustic cues. Hence, our hypothesis is that incorporating semantic information improves DNN’s sound recognition performance, emulating human behaviour. In our approach, sound recognition is framed as a regression problem, with CNNs trained to map spectrograms to continuous semantic representations from NLP models (Word2Vec, BERT, and CLAP text encoder). Two DNN types were trained: semDNN with continuous embeddings and catDNN with categorical labels, both with a dataset extracted from a collection of 388,211 sounds enriched with semantic descriptions. Evaluations across four external datasets, confirmed the superiority of semantic labeling from semDNN compared to catDNN, preserving higher-level relations. Importantly, an analysis of human similarity ratings for natural sounds, showed that semDNN approximated human listener behaviour better than catDNN, other DNNs, and NLP models. Our work contributes to understanding the role of semantics in sound recognition, bridging the gap between artificial systems and human auditory perception.

Developing the Attentive Brain: Contribution of Cognitive Neuroscience to a Theory of Attentional Development

Attention is a fundamental cognitive mechanism whose primary function is to regulate and organize the flow of perceptions and actions shaping our mental life. Early cognitive models have highlighted aspects of sustained, selective, and executive control as essential components of attention. These three broad aspects can be further subdivided into subordinate operations, depending on whether the particular function is mostly driven by external stimulation (bottom-up attention) or relies on endogenous processes such as voluntary intentions or expectations (top-down attention). After several decades of cognitive neuroscience research, these different functions have been associated with specific circuits of brain regions. Based on the cognitive neuroscience framework, this paper presents a theory of attention development and discusses behavioral and brain evidence regarding the development of attention function during the first years of life.

Enhancing experimental design through Bayes factor design analysis: insights from multi-armed bandit tasks

Bayesian statistics are popular in human cognitive neuroscience research because they can incorporate prior knowledge. Although well established for retrospective analysis, the application of Bayesian methods to prospective analysis is less well developed, especially when used in combination with computational model-based analysis of behavioural data. It is therefore important to establish effective methods for testing and optimising experimental designs for these purposes. One potential framework for a prospective approach is Bayes factor design analysis (BFDA), which can be used alongside latent variable modelling to evaluate and visualise the distribution of Bayes factors for a given experimental design. This paper provides a tutorial-style analysis combining BFDA with latent variable modelling to evaluate exploration-exploitation trade-offs in the binary multi-armed bandit task (MAB). This is a particularly tricky example of human decision-making with which to investigate the feasibility of differentiating latent variables between groups as a function of different design parameters. We examined how sample size, number of games per participant and effect size affect the strength of evidence supporting a difference in means between two groups. To further assess how these parameters affect experimental results, metrics of error were evaluated. Using simulations, we demonstrated how BFDA can be combined with latent variable modelling to evaluate and optimise parameter estimation of exploration in the MAB task, allowing effective inference of the mean degree of random exploration in a population, as well as between groups. However, BFDA indicated that, even with large samples and effect sizes, there may be some circumstances where there is a high likelihood of errors and a low probability of detecting evidence in favour of a difference when comparing random exploration between two groups performing the bandit task. In summary, we show how BFDA can prospectively inform design and power of human behavioural tasks.

Eye Tracking Post Processing to Detect Visual Artifacts and Quantify Visual Attention under Cognitive Task Activity during fMRI.

Determining visual attention during cognitive tasks using activation MRI remains challenging. This study aimed to develop a new eye-tracking (ET) post-processing platform to enhance data accuracy, validate the feasibility of subsequent ET-fMRI applications, and provide tool support. Sixteen volunteers aged 18 to 20 were exposed to a visual temporal paradigm with changing images of objects and faces in various locations while their eye movements were recorded using an MRI-compatible ET system. The results indicate that the accuracy of the data significantly improved after post-processing. Participants generally maintained their visual attention on the screen, with mean gaze positions ranging from 89.1% to 99.9%. In cognitive tasks, the gaze positions showed adherence to instructions, with means ranging from 46.2% to 50%. Temporal consistency assessments indicated prolonged visual tasks can lead to decreased attention during certain tasks. The proposed methodology effectively identified and quantified visual artifacts and losses, providing a precise measure of visual attention. This study offers a robust framework for future work integrating filtered eye-tracking data with fMRI analyses, supporting cognitive neuroscience research.

Recording Neural Reward Signals in a Naturalistic Operant Task Using Mobile-EEG and Augmented Reality.

The electrophysiological response to rewards recorded during laboratory tasks has been well documented, yet little is known about the neural response patterns in a more naturalistic setting. Here, we combined a mobile-EEG system with an augmented reality headset to record event-related brain potentials (ERPs) while participants engaged in a naturalistic operant task to find rewards. Twenty-five participants were asked to navigate toward a west or east goal location marked by floating orbs, and once participants reached the goal location, the orb would then signify a reward (5 cents) or no-reward (0 cents) outcome. Following the outcome, participants returned to a start location marked by floating purple rings, and once standing in the middle, a 3 s counter signaled the next trial, for a total of 200 trials. Consistent with previous research, reward feedback evoked the reward positivity, an ERP component believed to index the sensitivity of the anterior cingulate cortex to reward prediction error signals. The reward positivity peaked ∼230 ms with a maximal at channel FCz (M = -0.695 μV, ±0.23) and was significantly different than zero (p < 0.01). Participants took ∼3.38 s to reach the goal location and exhibited a general lose-shift (68.3% ±3.5) response strategy and posterror slowing. Overall, these novel findings provide support for the idea that combining mobile-EEG with augmented reality technology is a feasible solution to enhance the ecological validity of human electrophysiological studies of goal-directed behavior and a step toward a new era of human cognitive neuroscience research that blurs the line between laboratory and reality.

Emergence of Confidence with Principles of Curiosity and Information Processing

Researchers in cognitive neuroscience, developmental cognitive neuroscience, educational psychology, educational technology, education theory, and other related fields collaborate in the emerging field of educational neuroscience, also known as neuroeducation. This interdisciplinary approach aims to explore the connections between psychological processes and education. By integrating basic discoveries in cognitive neuroscience with educational technology, researchers in neuroeducation strive to enhance curricula to foster curiosity and boost confidence levels in learners. The ultimate objective of neuroeducation is to generate both theoretical insights and practical applications that offer a fresh perspective on learning across various disciplines. The development of confidence is closely related to the principles of curiosity and information processing. When people are interested in a topic, they are more likely to seek out information and engage in learning experiences that can lead to deeper understanding. This information process allows people to analyze and understand the information they encounter, which in turn can increase their confidence in their knowledge and abilities. By embracing curiosity and honing their information-processing skills, people can develop a strong self-confidence that empowers them to take new challenges and pursue their goals with determination. This review study on curiosity have uncovered a fascinating insight into its mechanisms. Researchers found that curiosity aligns with a confidence function resembling an inverted U-shape, peaking when individuals have moderate confidence in their knowledge. Moreover, heightened curiosity drives individuals to actively seek out new information, showcasing the profound impact of curiosity on knowledge acquisition. This revelation holds immense promise for understanding human behavior and learning processes. This study focuses on boosting confidence in individuals through the application of curiosity and information knowledge processing techniques to elevate the standards of education and training across both traditional and modern methodologies. The integration of these principles is poised to revolutionize the learning experience, fostering a more dynamic and effective approach to knowledge acquisition and skill development. This innovative strategy holds immense potential to empower learners, educators, and trainers alike, paving the way for a more enriched and impactful educational landscape.

Perception-action Dissociations as a Window into Consciousness.

Understanding the neural correlates of unconscious perception stands as a primary goal of experimental research in cognitive psychology and neuroscience. In this Perspectives paper, we explain why experimental protocols probing qualitative dissociations between perception and action provide valuable insights into conscious and unconscious processing, along with their corresponding neural correlates. We present research that utilizes human eye movements as a sensitive indicator of unconscious visual processing. Given the increasing reliance on oculomotor and pupillary responses in consciousness research, these dissociations also provide a cautionary tale about inferring conscious perception solely based on no-report protocols.

인지 신경학 연구를 적용한 언어 기반 디자인 교육 방법에 관한 연구

인지 신경학 연구를 적용한 언어 기반 디자인 교육 방법에 관한 연구

Frequency-tagging of spatial attention using periliminal flickers

Abstract Steady-State Visually Evoked Potentials (SSVEP) manifest as a sustained rhythmic activity that can be observed in surface electroencephalography (EEG) in response to periodic visual stimuli, commonly referred to as flickers. SSVEPs are widely used in fundamental cognitive neuroscience paradigms and Brain-Computer Interfaces (BCI) due to their robust and rapid onset. However, they have drawbacks related to the intrusive saliency of flickering visual stimuli, which may induce eye strain, cognitive fatigue, and biases in visual exploration. Previous findings highlighted the potential of altering features of flicker stimuli to improve user experience. In this study, we propose to reduce the amplitude modulation depth of flickering stimuli down to the individuals’ perceptual visibility threshold (periliminal) and below (subliminal). The stimulus amplitude modulation depth represents the contrast difference between the two alternating states of a flicker. A simple visual attention task where participants responded to the presentation of spatially-cued target stimuli (left and right) was used to assess the validity of such periliminal and subliminal frequency-tagging probes to capture spatial attention. The left and right sides of the screen, where target stimuli were presented, were covered by large flickers (13 and 15 Hz respectively). The amplitude modulation depth of these flickers was manipulated across three conditions: control, periliminal, and subliminal. The latter two levels of flickers amplitude modulation depth were defined through a perceptual visibility threshold protocol on a single- subject basis. Subjective feedback indicated that the use of periliminal and subliminal flickers substantially improved user experience. The present study demonstrates that periliminal and subliminal flickers evoked SSVEP responses that can be used to derive spatial attention in frequency-tagging paradigms. The single-trial classification of attended space (left versus right) based on SSVEP response reached an average accuracy of 81.1% for the periliminal and 58% for the subliminal conditions. These findings reveal the promises held by the application of inconspicuous flickers to both cognitive neuroscience research and BCI development.

Synthesizing PET images from high-field and ultra-high-field MR images using joint diffusion attention model.

Magnetic Resonance Imaging (MRI) and Positron Emission Tomography (PET) stand as pivotal diagnostic tools for brain disorders, offering the potential for mutually enriching disease diagnostic perspectives. However, the costs associated with PET scans and the inherent radioactivity have limited the widespread application of PET. Furthermore, it is noteworthy to highlight the promising potential of high-field and ultra-high-field neuroimaging in cognitive neuroscience research and clinical practice. With the enhancement of MRI resolution, a related question arises: can high-resolution MRI improve the quality of PETimages? This study aims to enhance the quality of synthesized PET images by leveraging the superior resolution capabilities provided by high-field and ultra-high-fieldMRI. From a statistical perspective, the joint probability distribution is considered the most direct and fundamental approach for representing the correlation between PET and MRI. In this study, we proposed a novel model, the joint diffusion attention model, namely, the joint diffusion attention model (JDAM), which primarily focuses on learning information about the joint probability distribution. JDAM consists of two primary processes: the diffusion process and the sampling process. During the diffusion process, PET gradually transforms into a Gaussian noise distribution by adding Gaussian noise, while MRI remains fixed. The central objective of the diffusion process is to learn the gradient of the logarithm of the joint probability distribution between MRI and noise PET. The sampling process operates as a predictor-corrector. The predictor initiates a reverse diffusion process, and the corrector applies Langevindynamics. Experimental results from the publicly available Alzheimer's Disease Neuroimaging Initiative dataset highlight the effectiveness of the proposed model compared to state-of-the-art (SOTA) models such as Pix2pix and CycleGAN. Significantly, synthetic PET images guided by ultra-high-field MRI exhibit marked improvements in signal-to-noise characteristics when contrasted with those generated from high-field MRI data. These results have been endorsed by medical experts, who consider the PET images synthesized through JDAM to possess scientific merit. This endorsement is based on their symmetrical features and precise representation of regions displaying hypometabolism, a hallmark of Alzheimer'sdisease. This study establishes the feasibility of generating PET images from MRI. Synthesis of PET by JDAM significantly enhances image quality compared to SOTAmodels.

Introducing the portable AttentionTrip: An engaging tool for measuring the networks of attention

BackgroundMeasurement of the efficacy of the networks of attention is a frequent component of research in cognitive and clinical neuroscience. Developed in 2002, the Attention Network Test (ANT), has become the most widely used tool for this purpose. New methodIn 2017 a more engaging, game-like tool based on the ANT, called the AttentionTrip was described. The network scores from five studies which used AttentionTrip are shown to be robust. Newer methodThat version of AttentionTrip required a steering wheel and desk-top computer. Here we describe a new, portable version of the AttentionTrip that is administered using a hand-held tablet (iPad) ResultsThree samples of participants (total = 44) completed the portable version of AttentionTrip. The network scores generated using the portable AttentionTrip were also robust. Effect sizes compare favourably with those generated by the ANT and the desktop version. ConclusionsThe findings support the use of the portable AttentionTrip as an alternative to the ANT when user engagement is important, such as when participants are prone to boredom, and when repeated administrations are required.

An easy‐to‐follow handbook for electroencephalogram data analysis with Python

AbstractThis easy‐to‐follow handbook offers a straightforward guide to electroencephalogram (EEG) analysis using Python, aimed at all EEG researchers in cognitive neuroscience and related fields. It spans from single‐subject data preprocessing to advanced multisubject analyses. This handbook contains four chapters: Preprocessing Single‐Subject Data, Basic Python Data Operations, Multiple‐Subject Analysis, and Advanced EEG Analysis. The Preprocessing Single‐Subject Data chapter provides a standardized procedure for single‐subject EEG data preprocessing, primarily using the MNE‐Python package. The Basic Python Data Operations chapter introduces essential Python operations for EEG data handling, including data reading, storage, and statistical analysis. The Multiple‐Subject Analysis chapter guides readers on performing event‐related potential and time‐frequency analyses and visualizing outcomes through examples from a face perception task dataset. The Advanced EEG Analysis chapter explores three advanced analysis methodologies, Classification‐based decoding, Representational Similarity Analysis, and Inverted Encoding Model, through practical examples from a visual working memory task dataset using NeuroRA and other powerful packages. We designed our handbook for easy comprehension to be an essential tool for anyone delving into EEG data analysis with Python (GitHub website: https://github.com/ZitongLu1996/Python‐EEG‐Handbook; For Chinese version: https://github.com/ZitongLu1996/Python‐EEG‐Handbook‐CN).