Visual Motion Processing Research Articles

Top-down modulation of visual cortical processing after transient congenital blindness

Early visual experience has been shown to be critical for the development of visual and multisensory functions; however, its impact on functional brain organization remains largely unexplored. Here, we therefore investigated the effect of early visual deprivation on top-down attentional modulation of visual cortical processing within the occipito-temporal cortex. Furthermore, we explored whether early visual deprivation may affect the extent to which typically visual, motion-selective area hMT responds to moving visual stimuli. Using functional magnetic resonance imaging, we compared cortical responses in area hMT and in the fusiform face area (FFA) to moving face stimuli – which were either task relevant or task irrelevant – relative to stationary face stimuli between cataract-reversal participants and normally sighted controls. Although both groups exhibited significantly stronger visual cortical responses in area hMT to moving stimuli than during the stationary baseline, the magnitude of this effect was significantly lower in the cataract-reversal group. In contrast, both groups exhibited significantly enhanced visual cortical responses in area hMT and in the FFA when moving face stimuli were task relevant compared to when they were task irrelevant, with no significant differences between groups in the magnitude of these effects. These results indicate that top-down attentional modulation of visual cortical processing in area hMT and FFA does not depend on early visual experience. Furthermore, the present results suggest that the functional specialization of area hMT for visual motion processing may be partially disrupted by early visual deprivation.

Motion vision: Drosophila neural pathways that go with the visual flow

Processing visual motion cues to interpret self-motion, the movement of others, and the environment's structure is vital to all animals, whether prey or predator. A new study in Drosophila identifies multiple pathways likely contributing to visual motion-dependent computations and behaviors.

Developmental changes in gaze patterns in response to radial optic flow in toddlerhood and childhood

A large field visual motion pattern (optic flow) with a radial pattern provides a compelling perception of self-motion; a radially expanding/contracting optic flow generates the perception of forward/backward locomotion. Moreover, the focus of a radial optic flow, particularly an expansive flow, is an important visual cue to perceive and control the heading direction during human locomotion. Previous research has shown that human gaze patterns have an “expansion bias”: a tendency to be more attracted to the focus of expansive flow than to the focus of contractive flow. We investigated the development of the expansion bias in children (N = 240, 1–12 years) and adults (N = 20). Most children aged ≥ 5 years and adults showed a significant tendency to shift their gaze to the focus of an expansive flow, whereas the youngest group (1-year-old children) showed a significant but opposing tendency; their gaze was more attracted to the focus of contractive flow than to the focus of expansive flow. The relationship between the developmental change from the “contraction bias” in early toddlerhood to the expansion bias in the later developmental stages and possible factors (e.g., global visual motion processing abilities and locomotor experiences) are discussed.

Increasing the spatial extent of attention strengthens surround suppression

Here we investigate how the extent of spatial attention affects center-surround interaction in visual motion processing. To do so, we measured motion direction discrimination thresholds in humans using drifting gratings and two attention conditions. Participants were instructed to limit their attention to the central part of the stimulus under the narrow attention condition, and to both central and surround parts under the wide attention condition. We found stronger surround suppression under the wide attention condition. The magnitude of the attention effect increased with the size of the surround when the stimulus had low contrast, but did not change when it had high contrast. Results also showed that attention had a weaker effect when the center and surround gratings drifted in opposite directions. Next, to establish a link between the behavioral results and the neuronal response characteristics, we performed computer simulations using the divisive normalization model. Our simulations showed that using smaller versus larger multiplicative attentional gain and parameters derived from the medial temporal (MT) area of the cortex, the model can successfully predict the observed behavioral results. These findings reveal the critical role of spatial attention on surround suppression and establish a link between neuronal activity and behavior. Further, these results also suggest that the reduced surround suppression found in certain clinical disorders (e.g., schizophrenia and autism spectrum disorder) may be caused by abnormal attention mechanisms.

Longitudinal study of infants receiving extra motor stimulation, full-term control infants, and infants born preterm: High-density EEG analyses of cortical activity in response to visual motion.

Electroencephalography was used to investigate the effects of extrastimulation and preterm birth on the development of visual motion perception during early infancy. Infants receiving extra motor stimulation in the form of baby swimming, a traditionally raised control group, and preterm born infants were presented with an optic flow pattern simulating forward and reversed self‐motion and unstructured random visual motion before and after they achieved self‐produced locomotion. Extrastimulated infants started crawling earlier and displayed significantly shorter N2 latencies in response to visual motion than their full‐term and preterm peers. Preterm infants could not differentiate between visual motion conditions, nor did they significantly decrease their latencies with age and locomotor experience. Differences in induced activities were also observed with desynchronized theta‐band activity in all infants, but with more mature synchronized alpha–beta band activity only in extrastimulated infants after they had become mobile. Compared with the other infants, preterm infants showed more widespread desynchronized oscillatory activities at lower frequencies at the age of 1 year (corrected for prematurity). The overall advanced performance of extrastimulated infants was attributed to their enriched motor stimulation. The poorer responses in the preterm infants could be related to impairment of the dorsal visual stream that is specialized in the processing of visual motion.

Anatomical distribution and functional roles of electrical synapses in Drosophila

Electrical synapses are present in almost all organisms that have a nervous system. However, their brain-wide expression patterns and the full range of contributions to neural function are unknown in most species. Here, we first provide a light-microscopic, immunohistochemistry-based anatomical map of all innexin gap junction proteins-the building blocks of electrical synapses-in the central nervous system of Drosophila melanogaster. Of those innexin types that are expressed in the nervous system, some localize to glial cells, whereas others are predominantly expressed in neurons, with shakB being the most widely expressed neuronal innexin. We then focus on the function of shakB in VS/HS cells-a class of visual projection neurons-thereby uncovering an unexpected role for electrical synapses. Removing shakB from these neurons leads to spontaneous, cell-autonomous voltage and calcium oscillations, demonstrating that electrical synapses are required for these cells' intrinsic stability. Furthermore, we investigate the role of shakB-type electrical synapses in early visual processing. We find that the loss of shakB from the visual circuits upstream of VS/HS cells differentially impairs ON and OFF visual motion processing pathways but is not required for the computation of direction selectivity per se. Taken together, our study demonstrates that electrical synapses are widespread across the Drosophila nervous system and that they play essential roles in neuronal function and visual information processing.

Dorsal visual stream activity during coherent motion processing is not related to math ability or dyscalculia

Math disability (MD) or developmental dyscalculia is a highly prevalent learning disability involving deficits in computation and arithmetic fact retrieval and is associated with dysfunction of parietal and prefrontal cortices. It has been suggested that dyscalculia (and other learning disabilities and developmental disorders) can be viewed in terms of a broader ‘dorsal stream vulnerability,’ which could explain a range of dorsal visual stream function deficits, including poor coherent visual motion perception. Behavioral evidence from two studies in typical children has linked performance on visual motion perception to math ability, and a third behavioral study reported poorer visual motion perception in a small group of children with MD compared to controls. Visual motion perception relies on the magnocellular-dominated dorsal stream, particularly its constituent area V5/MT. Here we used functional MRI to measure brain activity in area V5/MT during coherent visual motion processing to test its relationship with math ability. While we found bilateral activation in V5/MT in 66 children/adolescents with varied math abilities, we found no relationships between V5/MT activity and standardized math measures. Next, we selected a group of children/adolescents with MD (n = 23) and compared them to typically developing controls (n = 18), but found no differences in activity in V5/MT or elsewhere in the brain. We followed these frequentist statistics with Bayesian analyses, which favored null models in both studies. We conclude that dorsal stream function subserving visual motion processing in area V5/MT is not related to math ability, nor is it altered in those with the math disability dyscalculia.

Pathway and Directional Specificity of Hebbian Plasticity in the Cortical Visual Motion Processing Network

Pathway and Directional Specificity of Hebbian Plasticity in the Cortical Visual Motion Processing Network

Visual Motion and Decision-Making in Dyslexia: Reduced Accumulation of Sensory Evidence and Related Neural Dynamics.

Children with and without dyslexia differ in their behavioral responses to visual information, particularly when required to pool dynamic signals over space and time. Importantly, multiple processes contribute to behavioral responses. Here we investigated which processing stages are affected in children with dyslexia when performing visual motion processing tasks, by combining two methods that are sensitive to the dynamic processes leading to responses. We used a diffusion model which decomposes response time and accuracy into distinct cognitive constructs, and high-density EEG. Fifty children with dyslexia (24 male) and 50 typically developing children (28 male) 6-14 years of age judged the direction of motion as quickly and accurately as possible in two global motion tasks (motion coherence and direction integration), which varied in their requirements for noise exclusion. Following our preregistered analyses, we fitted hierarchical Bayesian diffusion models to the data, blinded to group membership. Unblinding revealed reduced evidence accumulation in children with dyslexia compared with typical children for both tasks. Additionally, we identified a response-locked EEG component which was maximal over centro-parietal electrodes which indicated a neural correlate of reduced drift rate in dyslexia in the motion coherence task, thereby linking brain and behavior. We suggest that children with dyslexia tend to be slower to extract sensory evidence from global motion displays, regardless of whether noise exclusion is required, thus furthering our understanding of atypical perceptual decision-making processes in dyslexia.SIGNIFICANCE STATEMENT Reduced sensitivity to visual information has been reported in dyslexia, with a lively debate about whether these differences causally contribute to reading difficulties. In this large preregistered study with a blind modeling approach, we combine state-of-the art methods in both computational modeling and EEG analysis to pinpoint the stages of processing that are atypical in children with dyslexia in two visual motion tasks that vary in their requirement for noise exclusion. We find reduced evidence accumulation in children with dyslexia across both tasks, and identify a neural marker, allowing us to link brain and behavior. We show that children with dyslexia exhibit general difficulties with extracting sensory evidence from global motion displays, not just in tasks that require noise exclusion.

Children’s perceptual sensitivity to optic flow-like visual motion differs from adults.

Observers experience complex patterns of visual motion in daily life due to their own movements through space, the movement of objects, and the geometry of surfaces in the visible world. Motion information shapes behavior and brain activity beginning in infancy. And yet most prior behavioral research has focused on how children process only one type, linear motion, leaving largely unexplored how children respond to radial or rotational motion patterns that co-occur with linear motion in everyday visual experience. This study examined how children and adults detect linear and radial motion patterns corrupted by a range of noise levels. Five to eight-year-old children (n = 25, 16 females; 76% White, 4% Asian, 16% more than one, 4% unknown) and young adults (n = 29, 15 females; 83.33% White, 16.67% Asian) viewed pairs of radial and linear motion displays mixed with random noise at one of two speeds (2 deg/s or 8 deg/s). Participants selected the display with coherent motion. Children and adults showed higher accuracy (percent correct) to radial versus linear motion patterns. Children had higher accuracy to the faster speed, while adults showed the opposite pattern. Adults showed better performance than children in all conditions. Exploratory analyses showed that male children had higher accuracy than their female peers. We conclude that motion processing develops in childhood with separable developmental trajectories for the processing of slow and fast visual motion, and that while further investigation is warranted, sex differences in motion processing found in young and older adults may begin in middle childhood. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Pupil responses to implied motion in figurative and abstract paintings.

Motion can be perceived in static images, such as photos and figurative paintings, representing realistic subjects in motion, with or without directional information (e.g., motion blur or speed lines). Motion impression can be achieved even in non-realistic static images such as motion illusions and abstract paintings. It has been shown that visual motion processing affects the diameter of the pupil, responding differently to real, illusory, and implied motion in photographs (IM). It has been suggested that these different effects might be due to top-down modulations from different cortical areas underlying their processing. It is worthwhile to investigate pupillary response to figurative paintings, since they require an even higher level of interpretation than photos representing the same kind of subjects, given the complexity of cognitive processes involved in the aesthetic experience. Also, pupil responses to abstract paintings allows to study the effect of IM perception in representations devoid of real-life motion cues. We measured pupil responses to IM in figurative and abstract artworks depicting static and dynamic scenes, as rated by a large group of individuals not participating in the following experiment. Since the pupillary response is modulated by the subjective image interpretation, a motion rating test has been used to correct individual pupil data according to whether participants actually perceived the presence of motion in the paintings. Pupil responses to movies showing figurative and abstract subjects, and to motion illusions were also measured, to compare real and illusory motion with painted IM. Movies, both figurative and abstract, elicit the largest pupillary dilation of all static stimuli, whereas motion illusions cause the smallest pupil size, as previously shown. Interestingly, pupil responses to IM depend on the paintings’ style. Figurative paintings depicting moving subjects cause more dilation than those representing static figures, and pupil size increases with the strength of IM, as already found with realistic photos. The opposite effect is obtained with abstract artworks. paintings depicting motion produce less dilation than those depicting stillness. In any case, these results reflect the individual subjective perception of dynamism, as the very same paintings can induce opposite responses in observer which interpreted it as static or dynamic. Overall, our data show that pupil size depends on high-level interpretation of motion in paintings, even when they do not represent real-world scenes. Our findings further suggest that the pupil is modulated by multiple top-down cortical mechanisms, involving the processing of motion, attention, memory, imagination, and other cognitive functions necessary for enjoying a complete aesthetic experience.

Disrupting Short-Term Memory Maintenance in Premotor Cortex Affects Serial Dependence in Visuomotor Integration.

Human behavior is biased by past experience. For example, when intercepting a moving target, the speed of previous targets will bias responses in future trials. Neural mechanisms underlying this so-called serial dependence are still under debate. Here, we tested the hypothesis that the previous trial leaves a neural trace in brain regions associated with encoding task-relevant information in visual and/or motor regions. We reasoned that injecting noise by means of transcranial magnetic stimulation (TMS) over premotor and visual areas would degrade such memory traces and hence reduce serial dependence. To test this hypothesis, we applied bursts of TMS pulses to right visual motion processing region hV5/MT+ and to left dorsal premotor cortex (PMd) during intertrial intervals of a coincident timing task performed by twenty healthy human participants (15 female). Without TMS, participants presented a bias toward the speed of the previous trial when intercepting moving targets. TMS over PMd decreased serial dependence in comparison to the control Vertex stimulation, whereas TMS applied over hV5/MT+ did not. In addition, TMS seems to have specifically affected the memory trace that leads to serial dependence, as we found no evidence that participants' behavior worsened after applying TMS. These results provide causal evidence that an implicit short-term memory mechanism in premotor cortex keeps information from one trial to the next, and that this information is blended with current trial information so that it biases behavior in a visuomotor integration task with moving objects.SIGNIFICANCE STATEMENT Human perception and action are biased by the recent past. The origin of such serial bias is still not fully understood, but a few components seem to be fundamental for its emergence: the brain needs to keep previous trial information in short-term memory and blend it with incoming information. Here, we present evidence that a premotor area has a potential role in storing previous trial information in short-term memory in a visuomotor task and that this information is responsible for biasing ongoing behavior. These results corroborate the perspective that areas associated with processing information of a stimulus or task also participate in maintaining that information in short-term memory even when this information is no longer relevant for current behavior.

White matter deficits correlate with visual motion perception impairments in dyslexic carriers of the DCDC2 genetic risk variant

Motion perception deficits in dyslexia show a large intersubjective variability, partly reflecting genetic factors influencing brain architecture development. In previous work, we have demonstrated that dyslexic carriers of a mutation of the DCDC2 gene have a very strong impairment in motion perception. In the present study, we investigated structural white matter alterations associated with the poor motion perception in a cohort of twenty dyslexics with a subgroup carrying the DCDC2 gene deletion (DCDC2d+) and a subgroup without the risk variant (DCDC2d–). We observed significant deficits in motion contrast sensitivity and in motion direction discrimination accuracy at high contrast, stronger in the DCDC2d+ group. Both motion perception impairments correlated significantly with the fractional anisotropy in posterior ventral and dorsal tracts, including early visual pathways both along the optic radiation and in proximity of occipital cortex, MT and VWFA. However, the DCDC2d+ group showed stronger correlations between FA and motion perception impairments than the DCDC2d– group in early visual white matter bundles, including the optic radiations, and in ventral pathways located in the left inferior temporal cortex. Our results suggest that the DCDC2d+ group experiences higher vulnerability in visual motion processing even at early stages of visual analysis, which might represent a specific feature associated with the genotype and provide further neurobiological support to the visual-motion deficit account of dyslexia in a specific subpopulation.

133 The Effects of Chronic Sleep Restriction on Human Oculomotor Behavior

Abstract Introduction Oculomotor behavioral metrics change according to time awake and circadian phase following a distinct pattern of impairment. Acute sleep deprivation (ASD) causes large decreases in pursuit initiation and steady-state gain, and a compensatory increase in saccadic rate without any systematic change in saccadic size. It also causes large deficits in visual processing of direction and speed, and impaired saccade dynamics. Such deterioration likely reflects changes in both higher cortical and brainstem function, explaining in-part how sleep loss and circadian misalignment affect cognition. It is unclear how oculomotor behavior might change according to chronic sleep restriction (CSR). Here, we measured the same eye-movement metrics during CSR. Methods Twelve healthy participants (6 females) kept a fixed wake-time sleep-wake schedule, at home for four weeks (weeks 1 and 3 = 9h time in bed (TIB); weeks 2 and 4 randomized to 5h or 9h TIB; actigraphy confirmed). Following weeks two and four, participants completed a 13-hour laboratory visit under dim light (<15 lux), where they maintained a semi-recumbent posture and were provided with hourly isocaloric snacks. A visual tracking task was performed hourly to assess pursuit and saccadic responses and visual motion processing. Performance metrics were computed using MATLAB, including pursuit gain (eye speed/target speed), the rate and amplitude of catch-up saccades, and the accuracy and precision of direction and speed processing. Results As expected, we found a small but significant (t(11)=-2.17, p<0.03) reduction in pursuit gain (mean+/-SEM: -0.028 +/-0.013 with a large (t(11)=2.96, p<0.01) increase in saccadic rate (0.37 +/-0.13 Hz). However, surprisingly, we found a significant (t(11)=-2.52, p<0.03) decrease in the amplitude of catch-up saccades (-0.15 +/-0.06 deg). The only systematic alteration to visual motion processing was a small reduction in horizontal-vertical asymmetry, which was previously observed with ASD. Conclusion A week of CSR to 5h is associated with only mild impairment in smooth pursuit eye movements with little impact on visual motion processing. However, CSR caused a maladaptive decrease in saccade amplitude that was not observed during ASD. Eye-movement metrics reveal differential neurological effects of CSR versus ASD. Support (if any) Force Health Protection Program, ONR (SAA2402925-1), NASA Human Research Program, and agreement NNX17AE07A

Effects of Audiovisual Presentations on Visual Localization Errors: One or Several MultisensoryMechanisms?

The present study examines the extent to which temporal and spatial properties of sound modulate visual motion processing in spatial localization tasks. Participants were asked to locate the place at which a moving visual target unexpectedly vanished. Across different tasks, accompanying sounds were factorially varied within subjects as to their onset and offset times and/or positions relative to visual motion. Sound onset had no effect on the localization error. Sound offset was shown to modulate the perceived visual offset location, both for temporal and spatial disparities. This modulation did not conform to attraction toward the timing or location of the sounds but, demonstrably in the case of temporal disparities, to bimodal enhancement instead. Favorable indications to a contextual effect of audiovisual presentations on interspersed visual-only trials were also found. The short sound-leading offset asynchrony had equivalent benefits to audiovisual offset synchrony, suggestive of the involvement of early-level mechanisms, constrained by a temporal window, at these conditions. Yet, we tentatively hypothesize that the whole of the results and how they compare with previous studies requires the contribution of additional mechanisms, including learning-detection of auditory-visual associations and cross-sensory spread of endogenous attention.

Look where you go: Characterizing eye movements toward optic flow.

When we move through our environment, objects in the visual scene create optic flow patterns on the retina. Even though optic flow is ubiquitous in everyday life, it is not well understood how our eyes naturally respond to it. In small groups of human and non-human primates, optic flow triggers intuitive, uninstructed eye movements to the focus of expansion of the pattern (Knöll, Pillow, & Huk, 2018). Here, we investigate whether such intuitive oculomotor responses to optic flow are generalizable to a larger group of human observers and how eye movements are affected by motion signal strength and task instructions. Observers (N = 43) viewed expanding or contracting optic flow constructed by a cloud of moving dots radiating from or converging toward a focus of expansion that could randomly shift. Results show that 84% of observers tracked the focus of expansion with their eyes without being explicitly instructed to track. Intuitive tracking was tuned to motion signal strength: Saccades landed closer to the focus of expansion, and smooth tracking was more accurate when dot contrast, motion coherence, and translational speed were high. Under explicit tracking instruction, the eyes aligned with the focus of expansion more closely than without instruction. Our results highlight the sensitivity of intuitive eye movements as indicators of visual motion processing in dynamic contexts.

Monocular and binocular opto-locomotor reflex biases for random dot motion in mice.

We investigated the relationship between eyes receiving visual input of large field translating random dot motion and subsequent reflexive changes in running direction in mice. The animals were head-fixed running on a Styrofoam ball and the opto-locomotor reflex (OLR) was measured in response to 2 s of dots patterns moving horizontally to the left or right. We measured the OLR in conditions with both eyes open (binocular) and one eye closed (monocular). When we covered the right or left eye in the monocular condition, we found reflexive behavior to be delayed for a few hundred milliseconds to leftward or rightward motion, respectively. After this delay, the bias disappeared and reflexive behavior was similar to responses to motion under binocular conditions. These results might be explained by different contributions of subcortical and cortical visual motion processing pathways to the OLR. Furthermore, we found no evidence for nonlinear interactions between the two eyes, because the sum of the OLR of the two monocular conditions was equal in amplitude and temporal characteristics to the OLR under binocular conditions.

The time-course of prediction formation and revision in human visual motion processing

Establishing the real-time position of a moving object poses a challenge to the visual system due to neural processing delays. While sensory information is travelling through the visual hierarchy, the object continues moving and information about its position becomes outdated. By extrapolating the position of a moving object along its trajectory, predictive mechanisms might effectively decrease the processing time associated with these objects. Here, we use time-resolved decoding of electroencephalographic (EEG) data from an apparent motion paradigm to demonstrate the interaction of two separate predictive mechanisms. First, we reveal predictive latency advantages for position representations as soon as the second object in an apparent motion sequence – even before the stimulus contains any physical motion energy. This is consistent with the existence of omni-directional, within-layer waves of sub-threshold activity that bring neurons coding for adjacent positions closer to their firing threshold, thereby reducing the processing time of the second stimulus in one of those positions. Second, we show that an additional direction-specific latency advantage emerges from the third sequence position onward, once the direction of the apparent motion stimulus is uniquely determined. Because the receptive fields of early visual areas are too small to encompass sequential apparent motion positions (as evidenced by the lack of latency modulation for the second stimulus position), this latency advantage most likely arises from descending predictions from higher to lower visual areas through feedback connections. Finally, we reveal that the same predictive activation that facilitates the processing of the object in its expected position needs to be overcome when the object's trajectory unexpectedly reverses, causing an additional latency disadvantage for stimuli that violate predictions. Altogether, our results suggest that two complementary mechanisms interact to form and revise predictions in visual motion processing, modulating the latencies of neural position representations at different levels of visual processing.

Direct Structural Connections between Auditory and Visual Motion-Selective Regions in Humans.

In humans, the occipital middle-temporal region (hMT+/V5) specializes in the processing of visual motion, while the planum temporale (hPT) specializes in auditory motion processing. It has been hypothesized that these regions might communicate directly to achieve fast and optimal exchange of multisensory motion information. Here we investigated, for the first time in humans (male and female), the presence of direct white matter connections between visual and auditory motion-selective regions using a combined fMRI and diffusion MRI approach. We found evidence supporting the potential existence of direct white matter connections between individually and functionally defined hMT+/V5 and hPT. We show that projections between hMT+/V5 and hPT do not overlap with large white matter bundles, such as the inferior longitudinal fasciculus and the inferior frontal occipital fasciculus. Moreover, we did not find evidence suggesting the presence of projections between the fusiform face area and hPT, supporting the functional specificity of hMT+/V5-hPT connections. Finally, the potential presence of hMT+/V5-hPT connections was corroborated in a large sample of participants (n = 114) from the human connectome project. Together, this study provides a first indication for potential direct occipitotemporal projections between hMT+/V5 and hPT, which may support the exchange of motion information between functionally specialized auditory and visual regions.SIGNIFICANCE STATEMENT Perceiving and integrating moving signal across the senses is arguably one of the most important perceptual skills for the survival of living organisms. In order to create a unified representation of movement, the brain must therefore integrate motion information from separate senses. Our study provides support for the potential existence of direct connections between motion-selective regions in the occipital/visual (hMT+/V5) and temporal/auditory (hPT) cortices in humans. This connection could represent the structural scaffolding for the rapid and optimal exchange and integration of multisensory motion information. These findings suggest the existence of computationally specific pathways that allow information flow between areas that share a similar computational goal.

Visual motion processing recruits regions selective for auditory motion in early deaf individuals

In early deaf individuals, the auditory deprived temporal brain regions become engaged in visual processing. In our study we tested further the hypothesis that intrinsic functional specialization guides the expression of cross-modal responses in the deprived auditory cortex. We used functional MRI to characterize the brain response to horizontal, radial and stochastic visual motion in early deaf and hearing individuals matched for the use of oral or sign language. Visual motion showed enhanced response in the ‘deaf’ mid-lateral planum temporale, a region selective to auditory motion as demonstrated by a separate auditory motion localizer in hearing people. Moreover, multivariate pattern analysis revealed that this reorganized temporal region showed enhanced decoding of motion categories in the deaf group, while visual motion-selective region hMT+/V5 showed reduced decoding when compared to hearing people. Dynamic Causal Modelling revealed that the ‘deaf’ motion-selective temporal region shows a specific increase of its functional interactions with hMT+/V5 and is now part of a large-scale visual motion selective network. In addition, we observed preferential responses to radial, compared to horizontal, visual motion in the ‘deaf’ right superior temporal cortex region that also show preferential response to approaching/receding sounds in the hearing brain. Overall, our results suggest that the early experience of auditory deprivation interacts with intrinsic constraints and triggers a large-scale reallocation of computational load between auditory and visual brain regions that typically support the multisensory processing of motion information.