Ventral Pathway Research Articles

Independence, not interactions: What simulations suggest about ventral and dorsal pathways.

Independence, not interactions: What simulations suggest about ventral and dorsal pathways.

A "Bandwidth" in cortical representations of multiple faces.

The human ability to process multiple items simultaneously can be constrained by the extent to which those items are represented by distinct neural populations. In the current study, we used fMRI to investigate the cortical representation of multiple faces. We found that the addition of a second face to occupy both visual hemifields led to an increased response, whereas a further addition of faces within the same visual hemifield resulted in a decreased response. This pattern was widely observed in the occipital visual cortex, the intraparietal sulcus, and extended to the posterior inferotemporal cortex. A parallel trend was found in a behavioral change-detection task, revealing a perceptual "bandwidth" of multiface processing. The sensitivity to face clutter gradually decreased along the ventral pathway, supporting the notion of a buildup of clutter-tolerance representation. These cortical response patterns to face clutters suggest that adding signals with nonoverlapping cortical representation enhanced perception, while adding signals that competed for representation resources impaired perception.

Similar object shape representation encoded in the inferolateral occipitotemporal cortex of sighted and early blind people.

We can sense an object's shape by vision or touch. Previous studies suggested that the inferolateral occipitotemporal cortex (ILOTC) implements supramodal shape representations as it responds more to seeing or touching objects than shapeless textures. However, such activation in the anterior portion of the ventral visual pathway could be due to the conceptual representation of an object or visual imagery triggered by touching an object. We addressed these possibilities by directly comparing shape and conceptual representations of objects in early blind (who lack visual experience/imagery) and sighted participants. We found that bilateral ILOTC in both groups showed stronger activation during a shape verification task than during a conceptual verification task made on the names of the same manmade objects. Moreover, the distributed activity in the ILOTC encoded shape similarity but not conceptual association among objects. Besides the ILOTC, we also found shape representation in both groups' bilateral ventral premotor cortices and intraparietal sulcus (IPS), a frontoparietal circuit relating to object grasping and haptic processing. In contrast, the conceptual verification task activated both groups' left perisylvian brain network relating to language processing and, interestingly, the cuneus in early blind participants only. The ILOTC had stronger functional connectivity to the frontoparietal circuit than to the left perisylvian network, forming a modular structure specialized in shape representation. Our results conclusively support that the ILOTC selectively implements shape representation independently of visual experience, and this unique functionality likely comes from its privileged connection to the frontoparietal haptic circuit.

A bio-inspired positional embedding network for transformer-based models

Owing to the progress of transformer-based networks, there have been significant improvements in the performance of vision models in recent years. However, there is further potential for improvement in positional embeddings that play a crucial role in distinguishing information across different positions. Based on the biological mechanisms of human visual pathways, we propose a positional embedding network that adaptively captures position information by modeling the dorsal pathway, which is responsible for spatial perception in human vision. Our proposed double-stream architecture leverages large zero-padding convolutions to learn local positional features and utilizes transformers to learn global features, effectively capturing the interaction between dorsal and ventral pathways. To evaluate the effectiveness of our method, we implemented experiments on various datasets, employing differentiated designs. Our statistical analysis demonstrates that the simple implementation significantly enhances image classification performance, and the observed trends demonstrate its biological plausibility.

Analysis of convolutional neural networks reveals the computational properties essential for subcortical processing of facial expression

Perception of facial expression is crucial for primate social interactions. This visual information is processed through the ventral cortical pathway and the subcortical pathway. However, the subcortical pathway exhibits inaccurate processing, and the responsible architectural and physiological properties remain unclear. To investigate this, we constructed and examined convolutional neural networks with three key properties of the subcortical pathway: a shallow layer architecture, concentric receptive fields at the initial processing stage, and a greater degree of spatial pooling. These neural networks achieved modest accuracy in classifying facial expressions. By replacing these properties, individually or in combination, with corresponding cortical features, performance gradually improved. Similar to amygdala neurons, some units in the final processing layer exhibited sensitivity to retina-based spatial frequencies (SFs), while others were sensitive to object-based SFs. Replacement of any of these properties affected the coordinates of the SF encoding. Therefore, all three properties limit the accuracy of facial expression information and are essential for determining the SF representation coordinate. These findings characterize the role of the subcortical computational processes in facial expression recognition.

The Emergence of Tuning to Global Shape Properties of Radial Frequency Patterns in the Ventral Visual Pathway.

Radial frequency (RF) patterns, created by sinusoidal modulations of a circle's radius, are processed globally when RF is low. These closed shapes therefore offer a useful way to interrogate the human visual system for global processing of curvature. RF patterns elicit greater responses than those to radial gratings in V4 and more anterior face-selective regions of the ventral visual pathway. This is largely consistent with work on nonhuman primates showing curvature processing emerges in V4, but is evident also higher up the ventral visual stream. Rather than contrasting RF patterns with other stimuli, we presented them at varied frequencies in a regimen that allowed tunings to RF to be derived from 8 human participants (3 female). We found tuning to low RF in lateral occipital areas and to some extent in V4. In a control experiment, we added a high-frequency ripple to the stimuli disrupting the local contour. Low-frequency tuning to these stimuli remained in the ventral visual stream, underscoring its role in global processing of shape curvature. We then used representational similarity analysis to show that, in lateral occipital areas, the neural representation was related to stimulus similarity, when it was computed with a model that captured how stimuli are perceived. We therefore show that global processing of shape curvature emerges in the ventral visual stream as early as V4, but is found more strongly in lateral occipital regions, which exhibit responses and representations that relate well to perception.SIGNIFICANCE STATEMENT We show that tuning to low radial frequencies, known to engage global shape processing mechanisms, was localized to lateral occipital regions. When low-level stimulus properties were accounted for such tuning emerged in V4 and LO2 in addition to the object-selective region LO. We also documented representations of global shape properties in lateral occipital regions, and these representations were predicted well by a proxy of the perceptual difference between the stimuli.

Bio-Inspired Network for Diagnosing Liver Steatosis in Ultrasound Images.

Using ultrasound imaging to diagnose liver steatosis is of great significance for preventing diseases such as cirrhosis and liver cancer. Accurate diagnosis under conditions of low quality, noise and poor resolutions is still a challenging task. Physiological studies have shown that the visual cortex of the biological visual system has selective attention neural mechanisms and feedback regulation of high features to low features. When processing visual information, these cortical regions selectively focus on more sensitive information and ignore unimportant details, which can effectively extract important features from visual information. Inspired by this, we propose a new diagnostic network for hepatic steatosis. In order to simulate the selection mechanism and feedback regulation of the visual cortex in the ventral pathway, it consists of a receptive field feature extraction module, parallel attention module and feedback connection. The receptive field feature extraction module corresponds to the inhibition of the non-classical receptive field of V1 neurons on the classical receptive field. It processes the input image to suppress the unimportant background texture. Two types of attention are adopted in the parallel attention module to process the same visual information and extract different important features for fusion, which improves the overall performance of the model. In addition, we construct a new dataset of fatty liver ultrasound images and validate the proposed model on this dataset. The experimental results show that the network has good performance in terms of sensitivity, specificity and accuracy for the diagnosis of fatty liver disease.

Understanding the concept of a novel tool requires interaction of the dorsal and ventral streams.

The left hemisphere tool-use network consists of the dorso-dorsal, ventro-dorsal, and ventral streams, each with distinct computational abilities. In the dual-loop model, the ventral pathway through the extreme capsule is associated with conceptual understanding. We performed a learning experiment with fMRI to investigate how these streams interact when confronted with novel tools. In session one, subjects observed pictures and video sequences in real world action of known and unknown tools and were asked whether they knew the tools and whether they understood their function. In session two, video sequences of unknown tools were presented again, followed again by the question of understanding their function. Different conditions were compared to each other and effective connectivity (EC) in the tool-use network was examined. During concept acquisition of an unknown tool, EC between dorsal and ventral streams was found posterior in fusiform gyrus and anterior in inferior frontal gyrus, with a functional interaction between BA44d and BA45. When previously unknown tools were presented for a second time, EC was prominent only between dorsal stream areas. Understanding the concept of a novel tool requires an interaction of the ventral stream with the dorsal streams. Once the concept is acquired, dorsal stream areas are sufficient.

BIFRNet: A Brain-Inspired Feature Restoration DNN for Partially Occluded Image Recognition

The partially occluded image recognition (POIR) problem has been a challenge for artificial intelligence for a long time. A common strategy to handle the POIR problem is using the non-occluded features for classification. Unfortunately, this strategy will lose effectiveness when the image is severely occluded, since the visible parts can only provide limited information. Several studies in neuroscience reveal that feature restoration which fills in the occluded information and is called amodal completion is essential for human brains to recognize partially occluded images. However, feature restoration is commonly ignored by CNNs, which may be the reason why CNNs are ineffective for the POIR problem. Inspired by this, we propose a novel brain-inspired feature restoration network (BIFRNet) to solve the POIR problem. It mimics a ventral visual pathway to extract image features and a dorsal visual pathway to distinguish occluded and visible image regions. In addition, it also uses a knowledge module to store classification prior knowledge and uses a completion module to restore occluded features based on visible features and prior knowledge. Thorough experiments on synthetic and real-world occluded image datasets show that BIFRNet outperforms the existing methods in solving the POIR problem. Especially for severely occluded images, BIRFRNet surpasses other methods by a large margin and is close to the human brain performance. Furthermore, the brain-inspired design makes BIFRNet more interpretable.

Cerebellar functional connectivity change is associated with motor and neuropsychological function in early stage drug-naïve patients with Parkinson's disease.

Parkinson's Disease (PD) is a progressive neurodegenerative disorder affecting both motor and cognitive function. Previous neuroimaging studies have reported altered functional connectivity (FC) in distributed functional networks. However, most neuroimaging studies focused on patients at an advanced stage and with antiparkinsonian medication. This study aims to conduct a cross-sectional study on cerebellar FC changes in early-stage drug-naïve PD patients and its association with motor and cognitive function. Twenty-nine early-stage drug-naïve PD patients and 20 healthy controls (HCs) with resting-state fMRI data and motor UPDRS and neuropsychological cognitive data were extracted from the Parkinson's Progression Markers Initiative (PPMI) archives. We used seed-based resting-state fMRI (rs-fMRI) FC analysis and the cerebellar seeds were defined based on the hierarchical parcellation of the cerebellum (AAL atlas) and its topological function mapping (motor cerebellum and non-motor cerebellum). The early stage drug-naïve PD patients had significant differences in cerebellar FC when compared with HCs. Our findings include: (1) Increased intra-cerebellar FC within motor cerebellum, (2) increase motor cerebellar FC in inferior temporal gyrus and lateral occipital gyrus within ventral visual pathway and decreased motor-cerebellar FC in cuneus and dorsal posterior precuneus within dorsal visual pathway, (3) increased non-motor cerebellar FC in attention, language, and visual cortical networks, (4) increased vermal FC in somatomotor cortical network, and (5) decreased non-motor and vermal FC within brainstem, thalamus and hippocampus. Enhanced FC within motor cerebellum is positively associated with the MDS-UPDRS motor score and enhanced non-motor FC and vermal FC is negatively associated with cognitive function test scores of SDM and SFT. These findings provide support for the involvement of cerebellum at an early stage and prior to clinical presentation of non-motor features of the disease in PD patients.

Information processing in the dorsal pathway: from "where" to "what we do with it".

Visual processing in the brain has been understood as the ventral and dorsal pathways processing "what" and "where" information, respectively. Mocz et al. (Mocz V, Vaziri-Pashkam M, Chun M, Xu Y. J Cogn Neurosci 34: 2406-2435, 2022), however, report that the two pathways code object features in a parallel manner. These results support that information processing in the dorsal pathway is not strictly limited to "where" and that the two pathways work in parallel to process task-relevant information ("what we do with it").

Simple shape feature computation across modalities: convergence and divergence between the ventral and dorsal visual streams.

Shape processing, whether by seeing or touching, is pivotal to object recognition and manipulation. Although the low-level signals are initially processed by different modality-specific neural circuits, multimodal responses to object shapes have been reported along both ventral and dorsal visual pathways. To understand this transitional process, we conducted visual and haptic shape perception fMRI experiments to test basic shape features (i.e. curvature and rectilinear) across the visual pathways. Using a combination of region-of-interest-based support vector machine decoding analysis and voxel selection method, we found that the top visual-discriminative voxels in the left occipital cortex (OC) could also classify haptic shape features, and the top haptic-discriminative voxels in the left posterior parietal cortex (PPC) could also classify visual shape features. Furthermore, these voxels could decode shape features in a cross-modal manner, suggesting shared neural computation across visual and haptic modalities. In the univariate analysis, the top haptic-discriminative voxels in the left PPC showed haptic rectilinear feature preference, whereas the top visual-discriminative voxels in the left OC showed no significant shape feature preference in either of the two modalities. Together, these results suggest that mid-level shape features are represented in a modality-independent manner in both the ventral and dorsal streams.

Brain structural and functional correlates of the heterogenous progression of mixed transcortical aphasia

Mixed transcortical aphasia (MTCA) is characterized by non-fluent speech and comprehension deficits coexisting with preserved repetition. MTCA may evolve to less severe variants of aphasias or even to full language recovery. Mechanistically, MCTA has traditionally been attributed to a disconnection between the spared left perisylvian language network (PSLN) responsible for preserved verbal repetition, and damaged left extrasylvian networks, which are responsible for language production and comprehension impairments. However, despite significant advances in in vivo neuroimaging, the structural and functional status of the PSLN network in MTCA and its evolution has not been investigated. Thus, the aim of the present study is to examine the status of the PSLN, both in terms of its functional activity and structural integrity, in four cases who developed acute post-stroke MTCA and progressed to different types of aphasia. For it, we conducted a neuroimaging-behavioral study performed in the chronic stage of four patients. The behavioral profile of MTCA persisted in one patient, whereas the other three patients progressed to less severe types of aphasias. Neuroimaging findings suggest that preserved verbal repetition in MTCA does not always depend on the optimal status of the PSLN and its dorsal connections. Instead, the right hemisphere or the left ventral pathway may also play a role in supporting verbal repetition. The variability in the clinical evolution of MTCA may be explained by the varying degree of PSLN alteration and individual premorbid neuroanatomical language substrates. This study offers a fresh perspective of MTCA through the lens of modern neuroscience and unveils novel insights into the neural underpinnings of repetition.

Using HVS Dual-Pathway and Contrast Sensitivity to Blindly Assess Image Quality

Blind image quality assessment (BIQA) aims to evaluate image quality in a way that closely matches human perception. To achieve this goal, the strengths of deep learning and the characteristics of the human visual system (HVS) can be combined. In this paper, inspired by the ventral pathway and the dorsal pathway of the HVS, a dual-pathway convolutional neural network is proposed for BIQA tasks. The proposed method consists of two pathways: the “what” pathway, which mimics the ventral pathway of the HVS to extract the content features of distorted images, and the “where” pathway, which mimics the dorsal pathway of the HVS to extract the global shape features of distorted images. Then, the features from the two pathways are fused and mapped to an image quality score. Additionally, gradient images weighted by contrast sensitivity are used as the input to the “where” pathway, allowing it to extract global shape features that are more sensitive to human perception. Moreover, a dual-pathway multi-scale feature fusion module is designed to fuse the multi-scale features of the two pathways, enabling the model to capture both global features and local details, thus improving the overall performance of the model. Experiments conducted on six databases show that the proposed method achieves state-of-the-art performance.

Modeling the development of cortical responses in primate dorsal ("where") pathway to optic flow using hierarchical neural field models.

Although there is a plethora of modeling literature dedicated to the object recognition processes of the ventral ("what") pathway of primate visual systems, modeling studies on the motion-sensitive regions like the Medial superior temporal area (MST) of the dorsal ("where") pathway are relatively scarce. Neurons in the MST area of the macaque monkey respond selectively to different types of optic flow sequences such as radial and rotational flows. We present three models that are designed to simulate the computation of optic flow performed by the MST neurons. Model-1 and model-2 each composed of three stages: Direction Selective Mosaic Network (DSMN), Cell Plane Network (CPNW) or the Hebbian Network (HBNW), and the Optic flow network (OF). The three stages roughly correspond to V1-MT-MST areas, respectively, in the primate motion pathway. Both these models are trained stage by stage using a biologically plausible variation of Hebbian rule. The simulation results show that, neurons in model-1 and model-2 (that are trained on translational, radial, and rotational sequences) develop responses that could account for MSTd cell properties found neurobiologically. On the other hand, model-3 consists of the Velocity Selective Mosaic Network (VSMN) followed by a convolutional neural network (CNN) which is trained on radial and rotational sequences using a supervised backpropagation algorithm. The quantitative comparison of response similarity matrices (RSMs), made out of convolution layer and last hidden layer responses, show that model-3 neuron responses are consistent with the idea of functional hierarchy in the macaque motion pathway. These results also suggest that the deep learning models could offer a computationally elegant and biologically plausible solution to simulate the development of cortical responses of the primate motion pathway.

Long-term outcomes of deep brain stimulation for treatment-resistant schizophrenia: Exploring potential targets

BackgroundSchizophrenia is a complex and disabling disorder. Around 30% of patients have treatment-resistant schizophrenia (TRS). ObjectiveThis study summarizes the outcomes after three years follow-up of the first series of patients with TRS treated with deep brain stimulation (DBS) and discuss surgical, clinical and imaging analysis. MethodsEight patients with TRS treated with DBS in the nucleus accumbens (NAcc) or the subgenual cingulate gyrus (SCG) were included. Symptoms were rated with the PANSS scale and normalized using the illness density index (IDI). A reduction in IDI-PANSS of ≥25% compared to baseline was the criterion of good response. The volume of activated tissue was calculated to perform a connectomic analysis for each patient. An estimation of the tracts and cortical areas modulated was generated. ResultsFive women and three men were analyzed. After 3 years’ follow-up, positive symptoms improved in 50% of the SCG group and 75% of the NAcc group (p = 0.06), and general symptoms improved in 25% and 50% respectively (p = 0.06). The SCG group showed activation of the cingulate bundle and modulation of orbitofrontal and frontomesial regions; in contrast, the NAcc group showed activation of the ventral tegmental area projections pathway and modulation of regions associated with the “default mode network” (precuneus) and Brodmann areas 19 and 20. ConclusionsThese results showed a trend toward improvement for positive and general symptoms in patients with TRS treated with DBS. The connectomic analysis will help us understand the interaction of this treatment with the disease to pursue future trial designs.

Disrupted dynamic amplitude of low-frequency fluctuations in patients with active thyroid-associated ophthalmopathy.

Purpose: Thyroid-associated ophthalmopathy (TAO) is an autoimmune disease that affects the orbit and is the most prevalent extra-thyroidal complication of Graves' disease. Previous neuroimaging studies have focused on abnormal static regional activity and functional connectivity in patients with TAO. However, the characteristics of local brain activity over time are poorly understood. This study aimed to investigate alterations in the dynamic amplitude of low-frequency fluctuation (dALFF) in patients with active TAO and to distinguish patients with TAO from healthy controls (HCs) using a support vector machine (SVM) classifier. Methods: A total of 21 patients with TAO and 21 HCs underwent resting-state functional magnetic resonance imaging scans. dALFFs were calculated in conjunction with sliding window approaches to assess dynamic regional brain activity and to compare the groups. Then, we used SVM, a machine learning algorithm, to determine whether dALFF maps may be used as diagnostic indicators for TAO. Results: Compared with HCs, patients with active TAO showed decreased dALFF in the right calcarine, lingual gyrus, superior parietal lobule, and precuneus. The SVM model showed an accuracy of 45.24%-47.62% and area under the curve of 0.35-0.44 in distinguishing TAO from HCs. No correlation was found between clinical variables and regional dALFF. Conclusion: Patients with active TAO showed altered dALFF in the visual cortex and the ventral and dorsal visual pathways, providing further details on the pathogenesis of TAO.

Parsing the heterogeneity of brain-symptom associations in autism spectrum disorder via random forest with homogeneous canonical correlation

BackgroundAutism spectrum disorder (ASD) is a highly heterogeneous developmental disorder, but the neuroimaging substrates of its heterogeneity remain unknown. The difficulty lies mainly on the significant individual variability in the brain-symptom association. MethodsT1-weighted magnetic resonance imaging data from the Autism Brain Imaging Database Exchange (ABIDE) (NTDC = 1146) were used to generate a normative model to map brain structure deviations of cases (NASD = 571). Voxel-based morphometry (VBM) was used to compute gray matter volume (GMV). Singular Value Decomposition (SVD) was employed to perform dimensionality reduction. A tree-based algorithm was proposed to identify the ASD subtypes according to the pattern of brain-symptom association as assessed by a homogeneous canonical correlation. ResultsWe identified 4 ASD subtypes with distinct association patterns between residual volumes and a social symptom score. More severe the social symptom was associated with greater GMVs in both the frontoparietal regions for the subtype1 (r = 0.29–0.44) and the ventral visual pathway for the subtype3 (r = 0.19–0.23), but lower GMVs in both the right anterior cingulate cortex for the subtype4 (r = −0.25) and a few subcortical regions for the subtype2 (r = −0.31 to −0.20). The subtyping significantly improved the classification accuracy between cases and controls from 0.64 to 0.75 (p < 0.05, permutation test), which was also better than the accuracy of 0.68 achieved by the k-means-based subtyping (p < 0.01). LimitationsSample size limited the study due to the missing data. ConclusionsThese findings suggest that the heterogeneity of ASD might reflect changes in different subsystems of the social brain, especially including social attention, motivation, perceiving and evaluation.

Distance-dependent distribution thresholding in probabilistic tractography.

Tractography is widely used in human studies of connectivity with respect to every brain region, function, and is explored developmentally, in adulthood, ageing, and in disease. However, the core issue of how to systematically threshold, taking into account the inherent differences in connectivity values for different track lengths, and to do this in a comparable way across studies has not been solved. By utilising 54 healthy individuals' diffusion-weighted image data taken from HCP, this study adopted Monte Carlo derived distance-dependent distributions (DDDs) to generate distance-dependent thresholds with various levels of alpha for connections of varying lengths. As a test case, we applied the DDD approach to generate a language connectome. The resulting connectome showed both short- and long-distance structural connectivity in the close and distant regions as expected for the dorsal and ventral language pathways, consistent with the literature. The finding demonstrates that the DDD approach is feasible to generate data-driven DDDs for common thresholding and can be used for both individual and group thresholding. Critically, it offers a standard method that can be applied to various probabilistic tracking datasets.

Intracranial Electroencephalography and Deep Neural Networks Reveal Shared Substrates for Representations of Face Identity and Expressions.

According to a classical view of face perception (Bruce and Young, 1986; Haxby et al., 2000), face identity and facial expression recognition are performed by separate neural substrates (ventral and lateral temporal face-selective regions, respectively). However, recent studies challenge this view, showing that expression valence can also be decoded from ventral regions (Skerry and Saxe, 2014; Li et al., 2019), and identity from lateral regions (Anzellotti and Caramazza, 2017). These findings could be reconciled with the classical view if regions specialized for one task (either identity or expression) contain a small amount of information for the other task (that enables above-chance decoding). In this case, we would expect representations in lateral regions to be more similar to representations in deep convolutional neural networks (DCNNs) trained to recognize facial expression than to representations in DCNNs trained to recognize face identity (the converse should hold for ventral regions). We tested this hypothesis by analyzing neural responses to faces varying in identity and expression. Representational dissimilarity matrices (RDMs) computed from human intracranial recordings (n = 11 adults; 7 females) were compared with RDMs from DCNNs trained to label either identity or expression. We found that RDMs from DCNNs trained to recognize identity correlated with intracranial recordings more strongly in all regions tested-even in regions classically hypothesized to be specialized for expression. These results deviate from the classical view, suggesting that face-selective ventral and lateral regions contribute to the representation of both identity and expression.SIGNIFICANCE STATEMENT Previous work proposed that separate brain regions are specialized for the recognition of face identity and facial expression. However, identity and expression recognition mechanisms might share common brain regions instead. We tested these alternatives using deep neural networks and intracranial recordings from face-selective brain regions. Deep neural networks trained to recognize identity and networks trained to recognize expression learned representations that correlate with neural recordings. Identity-trained representations correlated with intracranial recordings more strongly in all regions tested, including regions hypothesized to be expression specialized in the classical hypothesis. These findings support the view that identity and expression recognition rely on common brain regions. This discovery may require reevaluation of the roles that the ventral and lateral neural pathways play in processing socially relevant stimuli.