Neural Response Patterns Research Articles

Graspable foods and tools elicit similar responses in visual cortex.

The extrastriatal visual cortex is known to exhibit distinct response profiles to complex stimuli of varying ecological importance (e.g. faces, scenes, and tools). Although food is primarily distinguished from other objects by its edibility, not its appearance, recent evidence suggests that there is also food selectivity in human visual cortex. Food is also associated with a common behavior, eating, and food consumption typically also involves the manipulation of food, often with hands. In this context, food items share many properties with tools: they are graspable objects that we manipulate in self-directed and stereotyped forms of action. Thus, food items may be preferentially represented in extrastriatal visual cortex in part because of these shared affordance properties, rather than because they reflect a wholly distinct kind of category. We conducted functional MRI and behavioral experiments to test this hypothesis. We found that graspable food items and tools were judged to be similar in their action-related properties and that the location, magnitude, and patterns of neural responses for images of graspable food items were similar in profile to the responses for tool stimuli. Our findings suggest that food selectivity may reflect the behavioral affordances of food items rather than a distinct form of category selectivity.

A Multidimensional Neural Representation of Face Impressions.

From a glimpse of a face, people form trait impressions that operate as facial stereotypes, which are largely inaccurate yet nevertheless drive social behavior. Behavioral studies have long pointed to dimensions of trustworthiness and dominance that are thought to underlie face impressions due to their evolutionarily adaptive nature. Using human neuroimaging (N = 26, 19 female, 7 male), we identify a two-dimensional representation of faces' inferred traits in the middle temporal gyrus (MTG), a region involved in domain-general conceptual processing including the activation of social concepts. The similarity of neural-response patterns for any given pair of faces in the bilateral MTG was predicted by their proximity in trustworthiness-dominance space, an effect that could not be explained by mere visual similarity. This MTG trait-space representation occurred automatically, was relatively invariant across participants, and did not depend on the explicit endorsement of face impressions (i.e., beliefs that face impressions are valid and accurate). In contrast, regions involved in high-level social reasoning (the bilateral temporoparietal junction and posterior superior temporal sulcus; TPJ-pSTS) and entity-specific social knowledge (the left anterior temporal lobe; ATL) also exhibited this trait-space representation but only among participants who explicitly endorsed forming these impressions. Together, the findings identify a two-dimensional neural representation of face impressions and suggest that multiple implicit and explicit mechanisms give rise to biases based on facial appearance. While the MTG implicitly represents a multidimensional trait space for faces, the TPJ-pSTS and ATL are involved in the explicit application of this trait space for social evaluation and behavior.

Multivariate Neural Patterns of Reward and Anxiety in Adolescents with Anorexia Nervosa.

People with anorexia nervosa (AN) commonly exhibit elevated anxiety and atypical reward responsiveness. To examine multivariate neural patterns associated with reward and the impact of anxiety on reward, we analyzed fMRI data from a monetary reward task using representational similarity analysis, a multivariate approach that measures trial-by-trial consistency of neural responses. Twenty-five adolescent girls with AN and 22 mildly anxious controls lacking any history of AN were presented personalized anxiety-provoking or neutral words before receiving a reward, and neural response patterns in reward regions were analyzed. Consistent with our preregistered hypothesis, AN participants showed lower representational similarity than controls during neutral-word rewarded trials. Within groups, controls showed significant representational similarity in reward circuit regions including the left nucleus accumbens, left basolateral amygdala, and left medial orbitofrontal cortex, which were not observed in AN. Further, reward-related prefrontal cognitive control areas - left ventrolateral prefrontal cortex and left dorsolateral prefrontal cortex - showed significant representational similarity in both groups, but a larger spatial extent in controls. Contrary to predictions, there were no significant between-group differences for the effects of anxiety-words on reward representational similarity, and representational similarity did not predict longitudinal symptom change over six months. Overall, the results demonstrate relatively inconsistent trial-by-trial responses to reward receipt in the neutral state in AN compared with controls in both reward circuit and cognitive control regions, but no significant differential effects of anxiety states on reward responses. These results add to dynamic understandings of reward processing in AN that have potential implications for planning and guiding reward-focused interventions.

Recording Neural Reward Signals in a Naturalistic Operant Task Using Mobile-EEG and Augmented Reality.

The electrophysiological response to rewards recorded during laboratory tasks has been well documented, yet little is known about the neural response patterns in a more naturalistic setting. Here, we combined a mobile-EEG system with an augmented reality headset to record event-related brain potentials (ERPs) while participants engaged in a naturalistic operant task to find rewards. Twenty-five participants were asked to navigate toward a west or east goal location marked by floating orbs, and once participants reached the goal location, the orb would then signify a reward (5 cents) or no-reward (0 cents) outcome. Following the outcome, participants returned to a start location marked by floating purple rings, and once standing in the middle, a 3 s counter signaled the next trial, for a total of 200 trials. Consistent with previous research, reward feedback evoked the reward positivity, an ERP component believed to index the sensitivity of the anterior cingulate cortex to reward prediction error signals. The reward positivity peaked ∼230 ms with a maximal at channel FCz (M = -0.695 μV, ±0.23) and was significantly different than zero (p < 0.01). Participants took ∼3.38 s to reach the goal location and exhibited a general lose-shift (68.3% ±3.5) response strategy and posterror slowing. Overall, these novel findings provide support for the idea that combining mobile-EEG with augmented reality technology is a feasible solution to enhance the ecological validity of human electrophysiological studies of goal-directed behavior and a step toward a new era of human cognitive neuroscience research that blurs the line between laboratory and reality.

Reduced early neural processing of faces in children and adolescents with social anxiety disorder

Social anxiety disorder (SAD) is one of the most common mental disorders during childhood and adolescence. Yet, little is known about its maintenance in youth. Cognitive models of SAD indicate that attentional biases play a key role in the dysfunctional processing of social information, such as emotional faces. However, previous research investigating neural correlates of childhood SAD has produced inconsistent findings. The current study aims to investigate neural face processing in children and adolescents with SAD, while taking into consideration methodological limitations of previous studies. We measured event-related potentials (P100, N170, EPN, LPP) in response to happy, neutral, and angry adult faces, and non-social household objects, in a sample of youth (aged 10–15 years) with SAD (n = 57), clinical controls with specific phobias (SP; n = 41), and healthy controls (HC; n = 61). Participants completed an emotion/object identification task while continuous EEG was recorded. Analyses revealed lower N170 amplitudes in the SAD group compared to HCs, irrespective of emotion. In addition, younger children (aged 10–12 years) with SAD showed lower EPN amplitudes and higher early LPP amplitudes (only trend level) in response to neutral and happy faces compared to younger HCs. These effects were specific to faces and were not evident in the neural processing of non-social household objects. Overall, the findings indicate that different neural response patterns are already present in youth with SAD. Group differences, particularly in younger children, suggest age-related differences in neural face processing in childhood SAD and underpin the necessity of developmental approaches.

Reduced temporal and spatial stability of neural activity patterns predict cognitive control deficits in children with ADHD.

This study explores the neural underpinnings of cognitive control deficits in ADHD, focusing on overlooked aspects of trial-level variability of neural coding. We employed a novel computational approach to neural decoding on a single-trial basis alongside a cued stop-signal task which allowed us to distinctly probe both proactive and reactive cognitive control. Typically developing (TD) children exhibited stable neural response patterns for efficient proactive and reactive dual control mechanisms. However, neural coding was compromised in children with ADHD. Children with ADHD showed increased temporal variability and diminished spatial stability in neural responses in salience and frontal-parietal network regions, indicating disrupted neural coding during both proactive and reactive control. Moreover, this variability correlated with fluctuating task performance and with more severe symptoms of ADHD. These findings underscore the significance of modeling single-trial variability and representational similarity in understanding distinct components of cognitive control in ADHD, highlighting new perspectives on neurocognitive dysfunction in psychiatric disorders.

Patterns of neural activity in response to threatening faces are predictive of autistic traits: modulatory effects of oxytocin receptor genotype

Autistic individuals generally demonstrate impaired emotion recognition but it is unclear whether effects are emotion-specific or influenced by oxytocin receptor (OXTR) genotype. Here we implemented a dimensional approach using an implicit emotion recognition task together with functional MRI in a large cohort of neurotypical adult participants (N = 255, male = 131, aged 17–29 years) to establish associations between autistic traits and neural and behavioral responses to specific face emotions, together with modulatory effects of OXTR genotype. A searchlight-based multivariate pattern analysis (MVPA) revealed an extensive network of frontal, basal ganglia, cingulate and limbic regions exhibiting significant predictability for autistic traits from patterns of responses to angry relative to neutral expression faces. Functional connectivity analyses revealed a genotype interaction (OXTR SNPs rs2254298, rs2268491) for coupling between the orbitofrontal cortex and mid-cingulate during angry expression processing, with a negative association between coupling and autistic traits in the risk-allele group and a positive one in the non-risk allele group. Overall, results indicate extensive emotion-specific associations primarily between patterns of neural responses to angry faces and autistic traits in regions processing motivation, reward and salience but not in early visual processing. Functional connections between these identified regions were not only associated with autistic traits but also influenced by OXTR genotype. Thus, altered patterns of neural responses to threatening faces may be a potential biomarker for autistic symptoms although modulatory influences of OXTR genotype need to be taken into account.

Blink reflex changes in patient with long COVID headache

Background: Headache is a common symptom of long COVID. Blink Reflex (BR) may indicate possible brainstem dysfunction or changes in excitability in the headache. In this study, we aimed to reveal whether one of the underlying mechanisms of headache in long COVID is dysfunction in the nociceptive centers in the brainstem. Methods: The study included 29 individuals with confirmed 2019 coronavirus disease (COVID-19) and 17 healthy volunteers. Individuals were divided into 3 groups: post-COVID-19 headache (Group 1), post-COVID-19 headache-free (Group 2) and healthy individuals (Group 3). Individuals in the groups were subjected to BR and the parameters obtained with BR were compared between the 3 groups. Results: Accordingly, when Group 1 and Group 2 were compared, the mean latency of the R1 component of the BR and the mean latency of the ipsilateral R2 component obtained via right-sided electrical stimulation were found to be longer in Group 1. When Group 1 and Group 3 were compared, the latency differences of the ipsilateral R2 component and contralateral R2 component of the BRs were found to be longer in Group 3, indicating distinct patterns of neural response between the two groups. Conclusion: In long COVID patients experiencing headache symptoms, the underlying cause of the pain symptom may be brain stem dysfunction.

Amphetamine use disorder is associated with striatum hypoactivation during anticipation of loss and reward.

Dysregulated ventral striatum function has been proposed as one important process occurring in individuals with substance use disorder. This study investigates the role of altered reward and loss anticipation, which is an important component of impaired decision-making, impulsivity, and vulnerability to relapse in individuals with amphetamine use disorder (AMP). To determine whether AMP is associated with blunted striatum, prefrontal cortex, and insula signals during win and loss anticipation. Participants with and without AMP (AMP+ n = 46, AMP- n = 90) from the Tulsa 1000 study completed a monetary incentive delay (MID) task during functional magnetic resonance imaging. Group main effects indicated that: (1) AMP+ exhibited lower bilateral caudate/putamen and left nucleus accumbens signal than AMP- across anticipation of wins and losses; and (2) AMP+ showed slower reaction times than AMP- during loss anticipation. Group*condition interactions demonstrated that AMP+ exhibited greater right amygdala signal than AMP- while anticipating large wins, a pattern that reversed when anticipating small losses. Left caudate/putamen attenuations in AMP+ during small loss anticipation were also evident. Groups did not differ in prefrontal or insula signals. AMP+ individuals have altered neural processing and response patterns during reward and loss anticipation, potentially reflecting impairments in dopamine function, which may influence their decision-making and reactions to different win/loss scenarios. These findings help to explain why AMP+ have difficulty with decision-making and exhibit a heightened focus on immediate rewards or punishments.

A neural network underlying cognitive strategies related to eating, weight and body image concerns.

Concerns about food intake, weight and body shape can trigger negatively loaded emotions, which may prompt the use of cognitive strategies to regulate these emotional states. A novel fMRI task was developed to assess the neurobehavioral correlates of cognitive strategies related to eating, weight and body image concerns, such as self-criticism, avoidance, rumination, and self-reassurance. Fourteen healthy females were presented audio sentences referring to these conditions and instructed to repeat these internally while engaging their thoughts with the content of food or body images. Participants were asked to report the elicited emotion and rate their performance. All cognitive strategies recruited a network including the inferior and superior frontal gyri, orbitofrontal and anterior cingulate cortex, insula, and dorsal striatum. These brain regions are involved in emotional, reward and inhibitory control processing. Representational similarity analysis revealed distinct patterns of neural responses for each cognitive strategy. Additionally, self-report measures showed that self-criticism was positively associated with superior frontal gyrus (SFG) activation. Self-compassion scores were negatively correlated with activations in the insula and right putamen, while self-reassurance scores were negatively associated with activity in the orbitofrontal cortex. These findings identify a neural network underlying cognitive strategies related to eating, weight and body image concerns, where neurobehavioral correlation patterns depend on the cognitive strategy.

The behavioral and neural response patterns of growth mindset affecting learning process: A perspective from self-regulation learning theory

The behavioral and neural response patterns of growth mindset affecting learning process: A perspective from self-regulation learning theory

Uncomfortable staring? Gaze to other people in social situations is inhibited in both infants and adults.

People attract infants' and adults' gaze when presented on a computer screen. However, in live social situations, adults inhibit their gaze at strangers to avoid sending inappropriate social signals. Such inhibition of gaze has never been directly investigated in infants. The current preregistered study measured gaze and neural responses (EEG alpha power) to a confederate in a live social situation compared to a video of this confederate. Adults looked less at the live confederate than at the video of the confederate, although their neural responses suggest that they were overall equally attentive in both situations. Infants also looked less at the live confederate than at the video of the confederate, with similar neural response patterns. The gaze difference between live social and video situations increased with age. The study shows that young infants are already sensitive to social context and show decreased gaze to strangers in social situations. RESEARCH HIGHLIGHTS: This study shows that infants and adults look more at a video of a stranger than at a stranger that is present live in a social situation. Neural responses suggest that adults are equally attentive in both live and video situations but inhibit their gaze at the stranger in live social situations. Infants show a similar pattern of shorter gaze at a stranger who is present in person than at a video of this stranger. The study shows that gaze in infants and adults may diverge from cognitive processes measured through EEG, highlighting the importance of combining behavioural and neural measures in natural interactions.

Age-related differences in the interhemispheric asymmetry of local cortical responses to abstract and concrete verbs in children: a magnetic mismatch negativity study

BACKGROUND: The development of brain neural networks that support lexico-semantic processing in children remains a poorly understood topic in neuroscience. Meanwhile, investigations in adults have provided ample evidence regarding the brain circuits underpinning the processing of abstract and concrete semantics. These studies have shown that interhemispheric asymmetry in neural responses across modal and amodal cortical areas might be an important marker that helps in distinguishing these two types of semantics, with more left-lateralized activity patterns for abstract than concrete word comprehension. However, little is known about such distinctions in children; thus, addressing this gap was the goal of this study. AIM: This study aimed to investigate age-related differences in the lateralization of neural response patterns associated with the processing of abstract and concrete semantics in children. METHODS: This study employed magnetoencephalography and a mismatch negativity (MMN) paradigm in a group of 41 healthy children aged 5–13 years. The participants were passively exposed to the auditory series of abstract and concrete Russian verbs presented outside the focus of attention. Spatiotemporal patterns of the dynamics of neuromagnetic sources activity were reconstructed using minimum-norm estimate within predefined regions of interest: primary auditory cortex, primary motor cortex, and inferior frontal gyrus of both hemispheres. The magnitudes of MMN responses were further compared statistically between the two hemispheres within two age groups: younger (aged 5–9 years) and older (aged 10–13 years) children. RESULTS: Regionally specific differences were found in the lateralization of event-related MMN responses to concrete compared with abstract words in motor and inferior frontal cortical areas (paired permutation tests, p 0.05). Moreover, in the younger group (aged 5–9 years), responses to the abstract and pseudoword stimulus were left-lateralized, and this effect was most pronounced in the inferior frontal regions (45 and 47 Brodmann fields) of the left hemisphere. In the older group (aged 10–13 years), no pronounced left-lateralized response was observed in these areas. However, for the concrete hand action verb stimulus, different patterns of the interhemispheric asymmetry of the hand motor area responses were observed: the response in the younger group was right-lateralized, whereas in the older group, the response was bilateral. CONCLUSION: The present area- and hemisphere-specific dynamics of neuromagnetic responses in the motor cortex and Broca’s area might correlate with the age-related changes in neurocognitive strategies for the comprehension of abstract and concrete language.

Patterns of Neural Network Functional Connectivity Associated With Mania/Hypomania and Depression Risk in 3 Independent Young Adult Samples

Mania/hypomania is the pathognomonic feature of bipolar disorder (BD). Established, reliable neural markers denoting mania/hypomania risk to help with early risk detection and diagnosis and guide the targeting of pathophysiologically informed interventions are lacking. To identify patterns of neural responses associated with lifetime mania/hypomania risk, the specificity of such neural responses to mania/hypomania risk vs depression risk, and the extent of replication of findings in 2 independent test samples. This cross-sectional study included 3 independent samples of young adults aged 18 to 30 years without BD or active substance use disorder within the past 3 months who were recruited from the community through advertising. Of 603 approached, 299 were ultimately included and underwent functional magnetic resonance imaging at the University of Pittsburgh, Pittsburgh, Pennsylvania, from July 2014 to May 2023. Activity and functional connectivity to approach-related emotions were examined using a region-of-interest mask supporting emotion processing and emotional regulation. The Mood Spectrum Self-Report assessed lifetime mania/hypomania risk and depression risk. In the discovery sample, elastic net regression models identified neural variables associated with mania/hypomania and depression risk; multivariable regression models identified the extent to which selected variables were significantly associated with each risk measure. Multivariable regression models then determined whether associations in the discovery sample replicated in both test samples. A total of 299 participants were included. The discovery sample included 114 individuals (mean [SD] age, 21.60 [1.91] years; 80 female and 34 male); test sample 1, 103 individuals (mean [SD] age, 21.57 [2.09] years; 30 male and 73 female); and test sample 2, 82 individuals (mean [SD] age, 23.43 [2.86] years; 48 female, 29 male, and 5 nonbinary). Associations between neuroimaging variables and Mood Spectrum Self-Report measures were consistent across all 3 samples. Bilateral amygdala-left amygdala functional connectivity and bilateral ventrolateral prefrontal cortex-right dorsolateral prefrontal cortex functional connectivity were positively associated with mania/hypomania risk: discovery omnibus χ2 = 1671.7 (P < .001); test sample 1 omnibus χ2 = 1790.6 (P < .001); test sample 2 omnibus χ2 = 632.7 (P < .001). Bilateral amygdala-left amygdala functional connectivity and right caudate activity were positively associated and negatively associated with depression risk, respectively: discovery omnibus χ2 = 2566.2 (P < .001); test sample 1 omnibus χ2 = 2935.9 (P < .001); test sample 2 omnibus χ2 = 1004.5 (P < .001). In this study of young adults, greater interamygdala functional connectivity was associated with greater risk of both mania/hypomania and depression. By contrast, greater functional connectivity between ventral attention or salience and central executive networks and greater caudate deactivation were reliably associated with greater risk of mania/hypomania and depression, respectively. These replicated findings indicate promising neural markers distinguishing mania/hypomania-specific risk from depression-specific risk and may provide neural targets to guide and monitor interventions for mania/hypomania and depression in at-risk individuals.

Individual differences in neural markers of beat processing relate to spoken grammar skills in six-year-old children

Based on the idea that neural entrainment establishes regular attentional fluctuations that facilitate hierarchical processing in both music and language, we hypothesized that individual differences in syntactic (grammatical) skills will be partly explained by patterns of neural responses to musical rhythm. To test this hypothesis, we recorded neural activity using electroencephalography (EEG) while children (N = 25) listened passively to rhythmic patterns that induced different beat percepts. Analysis of evoked beta and gamma activity revealed that individual differences in the magnitude of neural responses to rhythm explained variance in six-year-olds’ expressive grammar abilities, beyond and complementarily to their performance in a behavioral rhythm perception task. These results reinforce the idea that mechanisms of neural beat entrainment may be a shared neural resource supporting hierarchical processing across music and language and suggest a relevant marker of the relationship between rhythm processing and grammar abilities in elementary-school-age children, previously observed only behaviorally.

The Relationship Between Emotion Dysregulation and Error Monitoring in Adolescents with ADHD.

Attention-deficit/hyperactivity disorder (ADHD) is emblematic of the limitations of existing diagnostic categories. One potential solution, consistent with the Research Domain Criteria (RDoC) initiative, is to interrogate psychological mechanisms at the behavioral and physiological level together to try and identify meaningful subgroups within existing categories. Such approaches provide a way to revise diagnostic boundaries and clarify individual variation in mechanisms. Here, we illustrate this approach to help resolve heterogeneity in ADHD using a combination of behaviorally-rated temperament measures from the Early Adolescent Temperament Questionnaire; cognitive performance on three difference conditions of an emotional go/no-go task; and electroencephalogram (EEG)-measured variation in multiple stages of error processing, including the error-related negativity (ERN) and positivity (Pe). In a large (N = 342), well-characterized sample of adolescents with ADHD, latent profile analysis identified two ADHD temperament subgroups: 1) emotionally regulated and 2) emotionally dysregulated (with high negative affect). Cognitive and EEG assessment in a subset of 272 adolescents (nADHD = 151) found that the emotionally dysregulated group showed distinct patterns of change in early neural response to errors (ERN) across emotional task conditions as compared to emotionally-regulated ADHD adolescents and typically-developing controls. Both ADHD groups showed blunted later response to errors (Pe) that was stable across emotional task conditions. Overall, neural response patterns identified important differences in how trait and state emotion interact to affect cognitive processing. Results highlight important temperament variation within ADHD that helps clarify its relationship to the ERN, one of the most prominent putative neural biomarkers for psychopathology.

Different roles of response covariability and its attentional modulation in the sensory cortex and posterior parietal cortex

The covariability of neural responses in the neuron population is highly relevant to the information encoding. Cognitive processes, such as attention, are found to modulate the covariability in the visual cortex to improve information encoding, suggesting the computational advantage of covariability modulation in the neural system. However, is the covariability modulation a general mechanism for enhanced information encoding throughout the information processing pathway, or only adopted in certain processing stages, depending on the property of neural representation? Here, with ultrahigh-field MRI, we examined the covariability, which was estimated by noise correlation, in different attention states in the early visual cortex and posterior parietal cortex (PPC) of the human brain, and its relationship to the quality of information encoding. Our results showed that while attention decreased the covariability to improve the stimulus encoding in the early visual cortex, covariability modulation was not observed in the PPC, where covariability had little impact on information encoding. Further, attention promoted the information flow between the early visual cortex and PPC, with an apparent emphasis on a flow from high- to low-dimensional representations, suggesting the existence of a reduction in the dimensionality of neural representation from the early visual cortex to PPC. Finally, the neural response patterns in the PPC could predict the amplitudes of covariability change in the early visual cortex, indicating a top-down control from the PPC to early visual cortex. Our findings reveal the specific roles of the sensory cortex and PPC during attentional modulation of covariability, determined by the complexity and fidelity of the neural representation in each cortical region.

Cortical activity in patients with high-functioning ischemic stroke during the Purdue Pegboard Test: insights into bimanual coordinated fine motor skills with functional near-infrared spectroscopy.

After stroke, even high-functioning individuals may experience compromised bimanual coordination and fine motor dexterity, leading to reduced functional independence. Bilateral arm training has been proposed as a promising intervention to address these deficits. However, the neural basis of the impairment of functional fine motor skills and their relationship to bimanual coordination performance in stroke patients remains unclear, limiting the development of more targeted interventions. To address this gap, our study employed functional near-infrared spectroscopy to investigate cortical responses in patients after stroke as they perform functional tasks that engage fine motor control and coordination. Twenty-four high-functioning patients with ischemic stroke (7 women, 17 men; mean age 64.75 ± 10.84 years) participated in this cross-sectional observational study and completed four subtasks from the Purdue Pegboard Test, which measures unimanual and bimanual finger and hand dexterity. We found significant bilateral activation of the sensorimotor cortices during all Purdue Pegboard Test subtasks, with bimanual tasks inducing higher cortical activation than the assembly subtask. Importantly, patients with better bimanual coordination exhibited lower cortical activation during the other three Purdue Pegboard Test subtasks. Notably, the observed neural response patterns varied depending on the specific subtask. In the unaffected hand task, the differences were primarily observed in the ipsilesional hemisphere. In contrast, the bilateral sensorimotor cortices and the contralesional hemisphere played a more prominent role in the bimanual task and assembly task, respectively. While significant correlations were found between cortical activation and unimanual tasks, no significant correlations were observed with bimanual tasks. This study provides insights into the neural basis of bimanual coordination and fine motor skills in high-functioning patients after stroke, highlighting task-dependent neural responses. The findings also suggest that patients who exhibit better bimanual performance demonstrate more efficient cortical activation. Therefore, incorporating bilateral arm training in post-stroke rehabilitation is important for better outcomes. The combination of functional near-infrared spectroscopy with functional motor paradigms is valuable for assessing skills and developing targeted interventions in stroke rehabilitation.

Long-term phonemic representations become audiovisual by mid-childhood

In earlier work with adults, we showed that long-term phonemic representations are audiovisual, meaning that they contain information on typical mouth shape during articulation. Many aspects of audiovisual processing have a prolonged developmental course, often not reaching maturity until late adolescence. In this study, we examined the status of phonemic representations in two groups of children – 8-9-year-olds and 11-12-year-olds. We used the same audiovisual oddball paradigm as in the earlier study with adults (Kaganovich and Christ, 2021). On each trial, participants saw a face and heard one of two vowels. One vowel occurred frequently (standard), while another occurred rarely (deviant). In one condition (neutral), the face had a closed, non-articulating mouth. In the other condition (audiovisual violation), the mouth shape matched the frequent vowel. Although stimuli were audiovisual in both conditions, we hypothesized that identical auditory changes would be perceived differently by participants. Namely, in the neutral condition, deviants violated only the audiovisual pattern specific to each experimental block. By contrast, in the audiovisual violation condition, deviants additionally violated long-term representations for how a speaker's mouth looks during articulation. We compared the amplitude of MMN and P3 components elicited by deviants in the two conditions. In the 11-12-year-old group, the pattern of neural responses was similar to that in adults – namely, they had a larger MMN component in the audiovisual compared to neutral condition, with no major difference in the P3 amplitude. In contrast, in the 8-9-year-old group, we saw a posterior MMN in the neutral condition only and a larger P3 in the audiovisual violation compared to the neutral condition. The larger P3 in the audiovisual violation condition suggests that younger children did perceive deviants as being more attention-grabbing when they violated the typical combination of sound and mouth shape. Yet, at this age, the earlier, more automatic stages of phonemic processing indexed by the MMN component may not yet encode visual speech elements the same way they do in older children and adults. We conclude that phonemic representations do not become audiovisual until 11–12 years of age.

Gabor and Non-Gabor Neural Representations Are Shared between Visual Perception and Mental Imagery.

Visual perception and mental imagery have been shown to share a hierarchical topological visual structure of neural representation, despite the existence of dissociation of neural substrate between them in function and structure. However, we have limited knowledge about how the visual hierarchical cortex is involved in visual perception and visual imagery in a unique and shared fashion. In this study, a data set including a visual perception and an imagery experiment with human participants was used to train 2 types of voxel-wise encoding models. These models were based on Gabor features and voxel activity patterns of high-level visual cortex (i.e., fusiform face area, parahippocampal place area, and lateral occipital complex) to predict activity in the early visual cortex (EVC, i.e., V1, V2, V3) during perception, and then tested with respect to the generalization of these models to mental imagery. Our results showed that during perception and imagery, activities in the EVC could be independently predicted by the Gabor features and activity of high-level visual cortex via voxel-wise encoding models, which suggested that perception and imagery might share neural representation in the EVC. We further found Gabor-specific and non-Gabor-specific patterns of neural response to stimuli in the EVC, which were shared by perception and imagery. These findings provide insight into the mechanisms of how visual perception and imagery share representation in the EVC.