Visual Motion Perception Research Articles

Relationships Among Visual–Perceptual–Motor Skills, Sensory Processing Behaviors, and Handwriting in School-Age Children With Autism

Abstract Date Presented 4/21/2018 Research suggests that challenges in handwriting could be related to sensory processing skills. This study investigated whether a relationship exists between sensory processing and visual–perceptual–motor skills in handwriting in children with autism. Primary Author and Speaker: Rachel Diamant Additional Authors and Speakers: Brynn Nealon Contributing Authors: Hannah Brennan, Samantha Cao, Melinda Holder, Elena Stone, Deborah Walker, Fonta Wenger

Auditory and Visual Motion Processing and Integration in the Primate Cerebral Cortex.

The ability of animals to detect motion is critical for survival, and errors or even delays in motion perception may prove costly. In the natural world, moving objects in the visual field often produce concurrent sounds. Thus, it can highly advantageous to detect motion elicited from sensory signals of either modality, and to integrate them to produce more reliable motion perception. A great deal of progress has been made in understanding how visual motion perception is governed by the activity of single neurons in the primate cerebral cortex, but far less progress has been made in understanding both auditory motion and audiovisual motion integration. Here we, review the key cortical regions for motion processing, focussing on translational motion. We compare the representations of space and motion in the visual and auditory systems, and examine how single neurons in these two sensory systems encode the direction of motion. We also discuss the way in which humans integrate of audio and visual motion cues, and the regions of the cortex that may mediate this process.

Bayesian Modeling of Motion Perception Using Dynamical Stochastic Textures.

A common practice to account for psychophysical biases in vision is to frame them as consequences of a dynamic process relying on optimal inference with respect to a generative model. The study presented here details the complete formulation of such a generative model intended to probe visual motion perception with a dynamic texture model. It is derived in a set of axiomatic steps constrained by biological plausibility. We extend previous contributions by detailing three equivalent formulations of this texture model. First, the composite dynamic textures are constructed by the random aggregation of warped patterns, which can be viewed as three-dimensional gaussian fields. Second, these textures are cast as solutions to a stochastic partial differential equation (sPDE). This essential step enables real-time, on-the-fly texture synthesis using time-discretized autoregressive processes. It also allows for the derivation of a local motion-energy model, which corresponds to the log likelihood of the probability density. The log likelihoods are essential for the construction of a Bayesian inference framework. We use the dynamic texture model to psychophysically probe speed perception in humans using zoom-like changes in the spatial frequency content of the stimulus. The human data replicate previous findings showing perceived speed to be positively biased by spatial frequency increments. A Bayesian observer who combines a gaussian likelihood centered at the true speed and a spatial frequency dependent width with a "slow-speed prior" successfully accounts for the perceptual bias. More precisely, the bias arises from a decrease in the observer's likelihood width estimated from the experiments as the spatial frequency increases. Such a trend is compatible with the trend of the dynamic texture likelihood width.

Visual motion perception is aberrant in children with cerebral palsy

Visual motion perception is aberrant in children with cerebral palsy

Visual Motion Processing in Macaque V2

In the primate visual system, direction-selective (DS) neurons are critical for visual motion perception. While DS neurons in the dorsal visual pathway have been well characterized, the response properties of DS neurons in other major visual areas are largely unexplored. Recent optical imaging studies in monkey visual cortex area 2 (V2) revealed clusters of DS neurons. This imaging method facilitates targeted recordings from these neurons. Using optical imaging and single-cell recording, we characterized detailed response properties of DS neurons in macaque V2. Compared with DS neurons in the dorsal areas (e.g., middle temporal area [MT]), V2 DS neurons have a smaller receptive field and a stronger antagonistic surround. They do not code speed or plaid motion but are sensitive to motion contrast. Our results suggest that V2 DS neurons play an important role in figure-ground segregation. The clusters of V2 DS neurons are likely specialized functional systems for detecting motion contrast.

Neural Correlates of Conscious Motion Perception.

The nature of the proper neural signature of conscious perception remains a topic of active debate. Theoretical support from integrative theories of consciousness is consistent with such signature being P3b, one of the main candidates in the literature. Recent work has also put forward a mid-latency and more localized component, the Visual Awareness Negativity (VAN), as a proper Neural Correlate of Consciousness (NCC). Early local components like P1 have also been proposed. However, experiments exploring visual NCCs are conducted almost exclusively using static images as the content to be consciously perceived, favoring ventral stream processing, therefore limiting the scope of the NCCs that have been identified. Here we explored the visual NCCs isolating local motion, a dorsally processed feature, as the primary feature being consciously perceived. Physical equality between Seen and Unseen conditions in addition to a minimal contrast difference between target and no-target displays was employed. In agreement with previous literature, we found a P3b with a wide centro-parietal distribution that strongly correlated with the detection of the stimuli. P3b magnitude was larger for Seen vs. Unseen conditions, a result that was consistently observed at the single subject level. In contrast, we were unable to detect VAN in our data, regardless of whether the subject perceived or not the stimuli. In the 200–300 ms time window we found a N2pc component, consistent with the high attentional demands of our task. Early components like P1 were not observed in our data, in agreement with their proposed role in the processing of visual features, but not as proper NCCs. Our results extend the role of P3b as a content independent NCC to conscious visual motion perception.

A virtual reality approach identifies flexible inhibition of motion aftereffects induced by head rotation.

As we move in space, our retinae receive motion signals from two causes: those resulting from motion in the world and those resulting from self-motion. Mounting evidence has shown that vestibular self-motion signals interact with visual motion processing profoundly. However, most contemporary methods arguably lack portability and generality and are incapable of providing measurements during locomotion. Here we developed a virtual reality approach, combining a three-space sensor with a head-mounted display, to quantitatively manipulate the causality between retinal motion and head rotations in the yaw plane. Using this system, we explored how self-motion affected visual motion perception, particularly the motion aftereffect (MAE). Subjects watched gratings presented on a head-mounted display. The gratings drifted at the same velocity as head rotations, with the drifting direction being identical, opposite, or perpendicular to the direction of head rotations. We found that MAE lasted a significantly shorter time when subjects' heads rotated than when their heads were kept still. This effect was present regardless of the drifting direction of the gratings, and was also observed during passive head rotations. These findings suggest that the adaptation to retinal motion is suppressed by head rotations. Because the suppression was also found during passive head movements, it should result from visual-vestibular interaction rather than from efference copy signals. Such visual-vestibular interaction is more flexible than has previously been thought, since the suppression could be observed even when the retinal motion direction was perpendicular to head rotations. Our work suggests that a virtual reality approach can be applied to various studies of multisensory integration and interaction.

Visual motion perception is influenced by sound pitch and location

Visual motion perception is influenced by sound pitch and location

Sex Differences in Visual Motion Processing

The importance of sex as a biological variable has recently been emphasized by major funding organizations [1] and within the neuroscience community [2]. Critical sex-based neural differences are indicated by, for example, conditions such as autism spectrum disorder (ASD) that have a strong sex bias with a higher prevalence among males [51, 3]. Motivated by this broader context, we report a marked sex difference in a visual motion perception task among neurotypical adults. Motion duration thresholds [4, 5]-the minimum duration needed to accurately perceive motion direction-were considerably shorter for males than females. We replicated this result across three laboratories and 263 total participants. This type of enhanced performance has previously been observed only in special populations including ASD, depression, and senescence [6-8]. The observed sex difference cannot be explained by general differences in speed of visual processing, overall visual discrimination abilities, or potential motor-related differences. We also show that while individual differences in motion duration thresholds are associated with differences in fMRI responsiveness of human MT+, surprisingly, MT+response magnitudes did not differ between males and females. Thus, we reason that sex differences in motion perception are not captured by an MT+ fMRI measure that predicts within-sex individual differences in perception. Overall, these results show how sex differences can manifest unexpectedly, highlighting the importance of sex as a factor in the design and analysis of perceptual and cognitive studies.

Cardiophenomenology: a refinement of neurophenomenology

Cardiophenomenology aims at refining the neuro-phenomenological approach created by F. Varela as a new paradigm, jointly based on Husserl’s a priori dynamics of the living present and an experiment on anticipatory time-dynamics of visual motor perception. In order to do so, we will situate the paradigm of neurophenomenology at the cardio-vascular level, focusing on the emotional dynamics of lived experience and thus refining the dialogue, more precisely, the generative mutual constraints between first- and third-person analysis. In this article we present the theoretical hypothesis of cardiophenomenology, which places the bodily-emotional heartsystem at its core, as an intrinsic part of the cognitive system. The latter therefore needs to be enlarged in order to include an enactive embodied cardiac-affective dimension. Here we present five main arguments for the necessary inclusion of the bodily-emotional heartsystem in the cognitive system: first, two pragmatic operational arguments (experiential and methodological), then three theoretical ones (cognitive, homological and ontological-laden). A direct methodological-pragmatic consequence is the actual operativity of the generative mutual constraints based on an experiential (lived)-experimental (organic) continuity of the embodied cardiac-affective fold inherent in the subject.

Auditory motion does not modulate spiking activity in the middle temporal and medial superior temporal visual areas.

The integration of multiple sensory modalities is a key aspect of brain function, allowing animals to take advantage of concurrent sources of information to make more accurate perceptual judgments. For many years, multisensory integration in the cerebral cortex was deemed to occur only in high-level "polysensory" association areas. However, more recent studies have suggested that cross-modal stimulation can also influence neural activity in areas traditionally considered to be unimodal. In particular, several human neuroimaging studies have reported that extrastriate areas involved in visual motion perception are also activated by auditory motion, and may integrate audiovisual motion cues. However, the exact nature and extent of the effects of auditory motion on the visual cortex have not been studied at the single neuron level. We recorded the spiking activity of neurons in the middle temporal (MT) and medial superior temporal (MST) areas of anesthetized marmoset monkeys upon presentation of unimodal stimuli (moving auditory or visual patterns), as well as bimodal stimuli (concurrent audiovisual motion). Despite robust, direction selective responses to visual motion, none of the sampled neurons responded to auditory motion stimuli. Moreover, concurrent moving auditory stimuli had no significant effect on the ability of single MT and MST neurons, or populations of simultaneously recorded neurons, to discriminate the direction of motion of visual stimuli (moving random dot patterns with varying levels of motion noise). Our findings do not support the hypothesis that direct interactions between MT, MST and areas low in the hierarchy of auditory areas underlie audiovisual motion integration.

Coding of self-motion-induced and self-independent visual motion in the rat dorsomedial striatum.

Evolutionary development of vision has provided us with the capacity to detect moving objects. Concordant shifts of visual features suggest movements of the observer, whereas discordant changes are more likely to be indicating independently moving objects, such as predators or prey. Such distinction helps us to focus attention, adapt our behavior, and adjust our motor patterns to meet behavioral challenges. However, the neural basis of distinguishing self-induced and self-independent visual motions is not clarified in unrestrained animals yet. In this study, we investigated the presence and origin of motion-related visual information in the striatum of rats, a hub of action selection and procedural memory. We found that while almost half of the neurons in the dorsomedial striatum are sensitive to visual motion congruent with locomotion (and that many of them also code for spatial location), only a small subset of them are composed of fast-firing interneurons that could also perceive self-independent visual stimuli. These latter cells receive their visual input at least partially from the secondary visual cortex (V2). This differential visual sensitivity may be an important support in adjusting behavior to salient environmental events. It emphasizes the importance of investigating visual motion perception in unrestrained animals.

Temporal Reference, Attentional Modulation, and Crossmodal Assimilation.

Crossmodal assimilation effect refers to the prominent phenomenon by which ensemble mean extracted from a sequence of task-irrelevant distractor events, such as auditory intervals, assimilates/biases the perception (such as visual interval) of the subsequent task-relevant target events in another sensory modality. In current experiments, using visual Ternus display, we examined the roles of temporal reference, materialized as the time information accumulated before the onset of target event, as well as the attentional modulation in crossmodal temporal interaction. Specifically, we examined how the global time interval, the mean auditory inter-intervals and the last interval in the auditory sequence assimilate and bias the subsequent percept of visual Ternus motion (element motion vs. group motion). We demonstrated that both the ensemble (geometric) mean and the last interval in the auditory sequence contribute to bias the percept of visual motion. Longer mean (or last) interval elicited more reports of group motion, whereas the shorter mean (or last) auditory intervals gave rise to more dominant percept of element motion. Importantly, observers have shown dynamic adaptation to the temporal reference of crossmodal assimilation: when the target visual Ternus stimuli were separated by a long gap interval after the preceding sound sequence, the assimilation effect by ensemble mean was reduced. Our findings suggested that crossmodal assimilation relies on a suitable temporal reference on adaptation level, and revealed a general temporal perceptual grouping principle underlying complex audio-visual interactions in everyday dynamic situations.

Phosphorylated α-synuclein in the retina is a biomarker of Parkinson's disease pathology severity.

PD patients often have visual alterations, for example, loss of visual acuity, contrast sensitivity or motion perception, and diminished electroretinogram responses. PD pathology is mainly characterized by the accumulation of pathological α-synuclein deposits in the brain, but little is known about how synucleinopathy affects the retina. To study the correlation between α-synuclein deposits in the retina and brain of autopsied subjects with PD and incidental Lewy body disease. We evaluated the presence of phosphorylated α-synuclein in the retina of autopsied subjects with PD (9 subjects), incidental Lewy body disease (4 subjects), and controls (6 subjects) by immunohistochemistry and compared the retinal synucleinopathy with brain disease severity indicators. Whereas controls did not show any phosphorylated α-synuclein immunoreactivity in their retina, all PD subjects and 3 of 4 incidental Lewy body disease subjects had phosphorylated α-synuclein deposits in ganglion cell perikarya, dendrites, and axons, some of them resembling brain Lewy bodies and Lewy neurites. The Lewy-type synucleinopathy density in the retina significantly correlated with Lewy-type synucleinopathy density in the brain, with the Unified Parkinson's disease pathology stage and with the motor UPDRS. These data suggest that phosphorylated α-synuclein accumulates in the retina in parallel with that in the brain, including in early stages preceding development of clinical signs of parkinsonism or dementia. Therefore, the retina may provide an in vivo indicator of brain pathology severity, and its detection could help in the diagnosis and monitoring of disease progression. © 2018 International Parkinson and Movement Disorder Society.

An fMRI study of coherent visual motion processing in children and adults

There is a large corpus of brain imaging studies examining the dorsal visual pathway, especially area V5/MT during visual motion perception. However, despite evidence suggesting a protracted development of the dorsal visual stream, and a role of this pathway in neurodevelopmental disorders, V5/MT has not been characterized developmentally. Further, experiential factors such as reading acquisition may play a modulating role in any age-dependent changes. Here we used a coherent visual motion detection task to examine V5/MT activity and connectivity in typical participants in two studies: a Cross- Sectional Study comparing adults and children; and a Longitudinal Study of 2nd graders followed into 3rd grade. In the Cross-Sectional Study, a whole-brain analysis revealed no differences between the two groups, whereas a region of interest (ROI) approach identified greater activation in left (right trending) V5/MT in adults compared to children. However, when we measured V5/MT activation individually for each participant, children and adults showed no difference in the location or intensity of activation, although children did exhibit relatively larger extent of V5/MT activation bilaterally. There was also relatively greater functional connectivity in the children between left and right occipitotemporal cortex, including V5/MT. The Longitudinal Study revealed no changes in V5/MT activation for any measures of activation or functional connectivity from 2nd to 3rd grade. Finally, there was no evidence of an association between reading and V5/MT over time, nor predictive power of V5/MT activity for later reading. Together, our results indicate similar V5/MT activity across age groups, with relatively greater extent of V5/MT activation and functional connectivity in children relative to adults, bilaterally. These differences were not apparent over the time course of one year, suggesting that these developmental changes occur over a more protracted period.

Illusory Motion Reproduced by Deep Neural Networks Trained for Prediction.

The cerebral cortex predicts visual motion to adapt human behavior to surrounding objects moving in real time. Although the underlying mechanisms are still unknown, predictive coding is one of the leading theories. Predictive coding assumes that the brain's internal models (which are acquired through learning) predict the visual world at all times and that errors between the prediction and the actual sensory input further refine the internal models. In the past year, deep neural networks based on predictive coding were reported for a video prediction machine called PredNet. If the theory substantially reproduces the visual information processing of the cerebral cortex, then PredNet can be expected to represent the human visual perception of motion. In this study, PredNet was trained with natural scene videos of the self-motion of the viewer, and the motion prediction ability of the obtained computer model was verified using unlearned videos. We found that the computer model accurately predicted the magnitude and direction of motion of a rotating propeller in unlearned videos. Surprisingly, it also represented the rotational motion for illusion images that were not moving physically, much like human visual perception. While the trained network accurately reproduced the direction of illusory rotation, it did not detect motion components in negative control pictures wherein people do not perceive illusory motion. This research supports the exciting idea that the mechanism assumed by the predictive coding theory is one of basis of motion illusion generation. Using sensory illusions as indicators of human perception, deep neural networks are expected to contribute significantly to the development of brain research.

Investigation of distinctive characteristics of children with specific learning disorder and borderline intellectual functioning

Background Borderline intelligence function (BIF) and specific learning disorder (SLD) are common diagnoses in children who are brought up for learning problems and school failure. Objective The aim of our study was to determine whether there were distinctive aspects of cognitive testing routinely used in evaluating SLD and BIF and investigate emotion regulation skills and minor neurologic symptoms. Method Sixty children (30 SLD and 30 BIF) who are currently attending primary school are selected for study. Visual Aural Digit Span Test – Form B, Gessel Figure Drawing Test, Bender Gestalt Visual Motor Perception Test, WISC-R, Emotion Regulation Scale (ERS) and Neurological Evaluation Scale (NES) was administered. Results There was no statistically significant difference between groups in cognitive tests. The emotional regulation ability measured by the emotional regulation subscale was better in the SLD group than the BIF group (p = 0.014). In the NES, sensory integration (p = 0.008), motor coordination (p = 0.047) and other (p < 0.001) subscales showed higher scores in the BIF group. Discussion It has been shown that cognitive tests don’t have distinguishing features in the evaluation of SLD and BIF. Emotion regulation subscale score of ERS and sensory integration, motor coordination, and total scores of NES can be used in both discrimination of groups.

Evaluation of visual motion perception ability in mice with knockout of the dyslexia candidate susceptibility gene Dcdc2.

Developmental dyslexia is a heritable disability characterized by difficulties in learning to read and write. The neurobiological and genetic mechanisms underlying dyslexia remain poorly understood; however, several dyslexia candidate risk genes have been identified. One of these candidate risk genes-doublecortin domain containing 2 (DCDC2)-has been shown to play a role in neuronal migration and cilia function. At a behavioral level, variants of DCDC2 have been associated with impairments in phonological processing, working memory and reading speed. Additionally, a specific mutation in DCDC2 has been strongly linked to deficits in motion perception-a skill subserving reading abilities. To further explore the relationship between DCDC2 and dyslexia, a genetic knockout (KO) of the rodent homolog of DCDC2 (Dcdc2) was created. Initial studies showed that Dcdc2 KOs display deficits in auditory processing and working memory. The current study was designed to evaluate the association between DCDC2 and motion perception, as these skills have not yet been assessed in the Dcdc2 KO mouse model. We developed a novel motion perception task, utilizing touchscreen technology and operant conditioning. Dcdc2 KOs displayed deficits on the Pairwise Discrimination task specifically as motion was added to visual stimuli. Following behavioral assessment, brains were histologically prepared for neuroanatomical analysis of the lateral geniculate nucleus (LGN). The cumulative distribution showed that Dcdc2 KOs exhibited more small neurons and fewer larger neurons in the LGN. Results compliment findings that DCDC2 genetic alteration results in anomalies in visual motion pathways in a subpopulation of dyslexic patients.

Recognizing visual speech: Reduced responses in visual-movement regions, but not other speech regions in autism.

Speech information inherent in face movements is important for understanding what is said in face-to-face communication. Individuals with autism spectrum disorders (ASD) have difficulties in extracting speech information from face movements, a process called visual-speech recognition. Currently, it is unknown what dysfunctional brain regions or networks underlie the visual-speech recognition deficit in ASD.We conducted a functional magnetic resonance imaging (fMRI) study with concurrent eye tracking to investigate visual-speech recognition in adults diagnosed with high-functioning autism and pairwise matched typically developed controls.Compared to the control group (n = 17), the ASD group (n = 17) showed decreased Blood Oxygenation Level Dependent (BOLD) response during visual-speech recognition in the right visual area 5 (V5/MT) and left temporal visual speech area (TVSA) – brain regions implicated in visual-movement perception. The right V5/MT showed positive correlation with visual-speech task performance in the ASD group, but not in the control group. Psychophysiological interaction analysis (PPI) revealed that functional connectivity between the left TVSA and the bilateral V5/MT and between the right V5/MT and the left IFG was lower in the ASD than in the control group. In contrast, responses in other speech-motor regions and their connectivity were on the neurotypical level.Reduced responses and network connectivity of the visual-movement regions in conjunction with intact speech-related mechanisms indicate that perceptual mechanisms might be at the core of the visual-speech recognition deficit in ASD. Communication deficits in ASD might at least partly stem from atypical sensory processing and not higher-order cognitive processing of socially relevant information.

Visual Perception Based Rate Control Algorithm for HEVC

For HEVC, rate control is an indispensably important video coding technology to alleviate the contradiction between video quality and the limited encoding resources during video communication. However, the rate control benchmark algorithm of HEVC ignores subjective visual perception. For key focus regions, bit allocation of LCU is not ideal and subjective quality is unsatisfied. In this paper, a visual perception based rate control algorithm for HEVC is proposed. First bit allocation weight of LCU level is optimized based on the visual perception of luminance and motion to ameliorate video subjective quality. Then λ and QP are adjusted in combination with the bit allocation weight to improve rate distortion performance. Experimental results show that the proposed algorithm reduces average 0.5% BD-BR and maximum 1.09% BD-BR at no cost in bitrate accuracy compared with HEVC (HM15.0). The proposed algorithm devotes to improving video subjective quality under various video applications.