Visual Motion Information Research Articles

Overweighting of Initial Motion Information Correlates With Severity of Positive Symptoms in Schizophrenia

Recent predictive coding accounts suggest that alterations in how prior knowledge and new sensory inputs are integrated in perception and inference may be implicated in the emergence of delusions and hallucinations. We tested this model by manipulating the precision of sequentially-presented visual motion information, hypothesizing that the severity of positive symptoms would correlate with a bias towards the direction of initial motion.

Theory of the perceived motion direction of equal-spatial-frequency plaid stimuli.

At an early stage, 3 different systems independently extract visual motion information from visual inputs. At later stages, these systems combine their outputs. Here, we consider a much studied (>650 publications) class of visual stimuli, plaids, which are combinations of 2 sine waves. Currently, there is no quantitative theory that can account for the perceived motion of plaids. We consider only perceived plaid direction, not speed, and obtain a large set of data exploring the various dimensions in which same-spatial-frequency plaids differ. We find that only 2 of the 3 motion systems are active in plaid processing, and that plaids with temporal frequencies 10 Hz or greater typically stimulate only the first-order motion system, which combines the plaid components by vector summation: Each plaid component is represented by a contrast-strength vector whose length is contrast-squared times a factor representing the relative effectiveness of that component's temporal frequency. The third-order system, which becomes primary at low temporal frequencies, also represents a plaid as 2 vectors that sum according to their contrast strength: a pure plaid in which both components have equal contrast and a residual sine wave. Second-order motion is irrelevant for these plaids. These principles enable a contrast-strength-vector summation theory for the responses of the first-order and third-order motion systems. With zero parameters estimated from the data, the theory captures the essence of the full range of the plaid data and supports the counterintuitive hypothesis that motion direction is processed independently of speed at early stages of visual processing. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Resource-efficient bio-inspired visual processing on the hexapod walking robot HECTOR.

Emulating the highly resource-efficient processing of visual motion information in the brain of flying insects, a bio-inspired controller for collision avoidance and navigation was implemented on a novel, integrated System-on-Chip-based hardware module. The hardware module is used to control visually-guided navigation behavior of the stick insect-like hexapod robot HECTOR. By leveraging highly parallelized bio-inspired algorithms to extract nearness information from visual motion in dynamically reconfigurable logic, HECTOR is able to navigate to predefined goal positions without colliding with obstacles. The system drastically outperforms CPU- and graphics card-based implementations in terms of speed and resource efficiency, making it suitable to be also placed on fast moving robots, such as flying drones.

Representational momentum in vision and touch: Visual motion information biases tactile spatial localization

After an object disappears, the vanishing point is shifted in the direction of motion, a phenomenon known as representational momentum. The present study focused on the relationship between motion information and spatial location in a crossmodal setting. In two visuotactile experiments, we studied how motion information in one sensory modality affects the perceived final location of a motion signal (congruent vs. incongruent left-right motion direction) in another modality. The results revealed a unidirectional crossmodal influence of motion information on spatial localization performance. While visual motion information influenced the perceived final location of the tactile stimulus, tactile motion information had no influence on visual localization. These results therefore extend the existing literature on crossmodal influences on spatial location and are discussed in relation to current theories of multisensory perception.

Vection induced by low-level motion extracted from complex animation films.

This study examined the contributions of low-, mid- and high-level visual motion information to vection. We compared the vection experiences induced by hand-drawn and computer-generated animation clips to those induced by versions of these movies that contained only their pure optic flow. While the original movies were found to induce longer and stronger vection experiences than the pure optic flow, vection onsets were not significantly altered by removing the mid- and high-level information. We conclude that low-level visual motion information appears to be important for vection induction, whereas mid- and higher-level display information appears to be important for sustaining and strengthening this vection after its initial induction.

Self-reported navigation ability is associated with optic flow-sensitive regions' functional connectivity patterns during visual path integration.

IntroductionSpatial navigation is a complex cognitive skill that varies between individuals, and the mechanisms underlying this variability are not clear. Studying simpler components of spatial navigation may help illuminate factors that contribute to variation in this complex skill; path integration is one such component. Optic flow provides self‐motion information while moving through an environment and is sufficient for path integration. This study aims to investigate whether self‐reported navigation ability is related to information transfer between optic flow‐sensitive (OF‐sensitive) cortical regions and regions important to navigation during environmental spatial tasks.MethodsFunctional magnetic resonance imaging was used to define OF‐sensitive regions and map their functional connectivity (FC) with the retrosplenial cortex and hippocampus during visual path integration (VPI) and turn counting (TC) tasks. Both tasks presented visual self‐motion through a real‐world environment. Correlations predicting a positive association between self‐reported navigation ability (measured with the Santa Barbara Sense of Direction scale) and FC strength between OF‐sensitive regions and retrosplenial cortex and OF‐sensitive regions and the hippocampus were performed.ResultsDuring VPI, FC strength between left cingulate sulcus visual area (L CSv) and right retrosplenial cortex and L CSv and right hippocampus was positively associated with self‐reported navigation ability. FC strength between right cingulate sulcus visual area (R CSv) and right retrosplenial cortex during VPI was also positively associated with self‐reported navigation ability. These relationships were specific to VPI, and whole‐brain exploratory analyses corroborated these results.ConclusionsThese findings support the hypothesis that perceived spatial navigation ability is associated with communication strength between OF‐sensitive and navigationally relevant regions during visual path integration, which may represent the transformation accuracy of visual motion information into internal spatial representations. More broadly, these results illuminate underlying mechanisms that may explain some variability in spatial navigation ability.

Predictors of visually induced motion sickness in women

BackgroundVisually induced motion sickness (VIMS) is commonly experienced when visual motion information is in conflict with motion information provided by the vestibular system and/or tactile and kinesthetic senses. According to some studies, women experience higher levels of VIMS than men, whereas other studies do not find this to be the case. HypothesisThis study investigated whether gender differences can be attributed to changes in VIMS-susceptibility due to the menstrual cycle and perceived menstrual pain. We hypothesized that higher perceived menstrual pain correlates positively with VIMS susceptibility. MethodsWe measured the influence of estimated concentrations of four sex hormones and menstrual pain, on the magnitude of self-reported VIMS levels and on measured postural stability in 56 participants. They were confronted with a continuous ten-minute recording of a bike ride across mountainous terrain. Subjective VIMS was measured at one-minute intervals during stimulus presentation using the Fast Motion Sickness (FMS) Scale; postural sway was recorded immediately before and after stimulus presentation. ResultsCorrelation between peak FMS scores and perceived menstrual pain was high. Furthermore, significant differences between women with severe menstrual pain on the one hand and women with low pain and men on the other hand were found. ConclusionsOur findings suggest a shared link between VIMS and menstrual pain. Further research should investigate pain sensitivity as a general predictor for VIMS.

The evolutionary roots of human imitation, action understanding and symbols

AbstractThis paper focuses on how human complex imitation and its developmental processes are related to the abilities for action representation, acquisition of symbols, and language. After overviewing the characteristics of imitation in chimpanzees and humans, I propose a model of imitation emphasizing how these two species differ in the ways they process visual-motor information. These differences may in turn contribute to core interspecies differences in higher-order cognitive functions, not only for bodily imitation but for action understanding through complex referential information from faces, sharing symbols, and language. This ‘developmental-comparative’ approach reveals the development of species-specific intelligences, and shows what is shared and not shared between humans and other primates. In doing so, we can obtain a more complete understanding of the emergence of the ‘language-ready brain’ in relation to its biological and evolutionary foundations.

Case Report: Management of a Patient with mTBI and Vestibular Hypofunction with the Binasal Occlusion Technique

Background: Binasal Occlusion (BNO) is a clinical technique used by many neurorehabilitative optometrists in patients with mild traumatic brain injury (mTBI) and increased visual motion sensitivity (VMS) or visual vertigo. BNO is a technique in which partial occluders are added to the spectacle lenses to suppress the abnormal peripheral visual motion information. This technique helps in reducing VMS symptoms (i.e., nausea, dizziness, balance difficulty, visual confusion). Case Report: A 44-year-old AA female presented for a routine eye exam with a history of mTBI approximately 33 years ago. She was suffering from severe dizziness for the last two years that was adversely impacting her ADLs. The dizziness occurred in all body positions and all environments throughout the day. She was diagnosed with vestibular hypofunction and had undergone vestibular therapy but reported little improvement. Neurological exam revealed dizziness with both OKN drum and hand movement, especially in the left visual field. BNO technique resulted in immediate relief of her dizziness symptoms. Conclusion: To our knowledge, this is the first case that illustrates how the BNO technique in isolation can be beneficial for patients with mTBI and vestibular hypofunction. It demonstrates the success that BNO has in filtering abnormal peripheral visual motion in these patients.

Bio-plausible visual neural network for spatio-temporally spiral motion perception

Abstract Neurophysiological studies validate that the primate cerebral cortex includes spiral neurons whose visual properties respond preferentially to spiral motion patterns. However, the biological mechanism of which a vision system perceives spiral motion is unclear, while few computational models are reported to discuss the problem of spiral motion perception. In order to fill this gap, this work develops a spiral motion perception neural network in terms of the recent achievements in neurophysiology and simulates the visual response characteristics of spiral neurons. One such network, inspired by two stages of biological visual information processing includes two subnetworks- presynaptic and postsynaptic neural networks. The former comprises multiple lateral inhibition neural sub-networks for the capture of visual motion information, whereas the latter extracts different rotational and radial motion cues and synthesizes them to detect the process of the spiral motion of an object. Experimentally, the proposed neural network is sufficiently examined by different types of spiral motion patterns in non-interference or interference environments. Numerically comparative experiments show that it can effectively detect spiral motion patterns of the object and also does not respond to any non-spiral motion, which is consistent with the metaphor of spiral neurons’ performance perception.

Visual-Cerebellar Pathways and Their Roles in the Control of Avian Flight.

In this paper, we review the connections and physiology of visual pathways to the cerebellum in birds and consider their role in flight. We emphasize that there are two visual pathways to the cerebellum. One is to the vestibulocerebellum (folia IXcd and X) that originates from two retinal-recipient nuclei that process optic flow: the nucleus of the basal optic root (nBOR) and the pretectal nucleus lentiformis mesencephali (LM). The second is to the oculomotor cerebellum (folia VI-VIII), which receives optic flow information, mainly from LM, but also local visual motion information from the optic tectum, and other visual information from the ventral lateral geniculate nucleus (Glv). The tectum, LM and Glv are all intimately connected with the pontine nuclei, which also project to the oculomotor cerebellum. We believe this rich integration of visual information in the cerebellum is important for analyzing motion parallax that occurs during flight. Finally, we extend upon a suggestion by Ibbotson (2017) that the hypertrophy that is observed in LM in hummingbirds might be due to an increase in the processing demands associated with the pathway to the oculomotor cerebellum as they fly through a cluttered environment while feeding.

Behavioral state modulates the ON visual motion pathway of Drosophila

The behavioral state of an animal can dynamically modulate visual processing. In flies, the behavioral state is known to alter the temporal tuning of neurons that carry visual motion information into the central brain. However, where this modulation occurs and how it tunes the properties of this neural circuit are not well understood. Here, we show that the behavioral state alters the baseline activity levels and the temporal tuning of the first directionally selective neuron in the ON motion pathway (T4) as well as its primary input neurons (Mi1, Tm3, Mi4, Mi9). These effects are especially prominent in the inhibitory neuron Mi4, and we show that central octopaminergic neurons provide input to Mi4 and increase its excitability. We further show that octopamine neurons are required for sustained behavioral responses to fast-moving, but not slow-moving, visual stimuli in walking flies. These results indicate that behavioral-state modulation acts directly on the inputs to the directionally selective neurons and supports efficient neural coding of motion stimuli.

Bilateral dorsal fronto-parietal areas are associated with integration of visual motion information and timed motor action

Interaction with the environment often involves situations requiring visuomotor integration. For instance, in fast interceptive actions, the brain must integrate visual information of motion with the appropriate motor action. In such dynamic situation, the brain may control movement based on predictions of where the object will be in the future and when it will arrive there. Although previous studies have analyzed brain regions associated with processing visual information of motion, motor control and visuomotor integration with static objects, less is known about visuomotor integration with moving objects. In the present study we used an event-related fMRI experiment to investigate brain areas integrating visual information of motion with motor action in response to moving objects. Twenty healthy volunteers performed an interceptive task where they had to press a button in synchrony with the arrival of a horizontally moving target at a predefined location. They also performed two control tasks—simple reaction and attention to visual motion—in order to identify and exclude brain areas that would be involved in motor or visual motion processing components that are inherent to interceptive tasks. Through a conjunction analysis, we show greater BOLD signal in a bilateral dorsal fronto-parietal network, as well as the intraparietal sulcus, angular gyrus, and human visual motion area hV5+. We discuss these results with respect to their previously identified functions, and suggest they play a role in visuomotor integration with moving objects.

The reference frame for encoding and retention of motion depends on stimulus set size.

The goal of this study was to investigate the reference frames used in perceptual encoding and storage of visual motion information. In our experiments, observers viewed multiple moving objects and reported the direction of motion of a randomly selected item. Using a vector-decomposition technique, we computed performance during smooth pursuit with respect to a spatiotopic (nonretinotopic) and to a retinotopic component and compared them with performance during fixation, which served as the baseline. For the stimulus encoding stage, which precedes memory, we found that the reference frame depends on the stimulus set size. For a single moving target, the spatiotopic reference frame had the most significant contribution with some additional contribution from the retinotopic reference frame. When the number of items increased (Set Sizes 3 to 7), the spatiotopic reference frame was able to account for the performance. Finally, when the number of items became larger than 7, the distinction between reference frames vanished. We interpret this finding as a switch to a more abstract nonmetric encoding of motion direction. We found that the retinotopic reference frame was not used in memory. Taken together with other studies, our results suggest that, whereas a retinotopic reference frame may be employed for controlling eye movements, perception and memory use primarily nonretinotopic reference frames. Furthermore, the use of nonretinotopic reference frames appears to be capacity limited. In the case of complex stimuli, the visual system may use perceptual grouping in order to simplify the complexity of stimuli or resort to a nonmetric abstract coding of motion information.

Robust segmentation of moving objects in video based on spatiotemporal visual saliency and active contour model

This paper presents an algorithm for automatic segmentation of moving objects in video based on spatiotemporal visual saliency and an active contour model. Our algorithm exploits the visual saliency and motion information to build a spatiotemporal visual saliency map used to extract a moving region of interest. This region is used to automatically provide the seeds for the convex active contour (CAC) model to segment the moving object accurately. The experiments show a good performance of our algorithm for moving object segmentation in video without user interaction, especially on the SegTrack dataset.

Encoding of global visual motion in the nidopallium caudolaterale of behaving crows.

Songbirds possess acute vision. How higher brain centres represent basic and parameterised visual stimuli to process sensory signals according to their behavioural importance has not been studied in a systematic way. We therefore examined how carrion crows (Corvus corone) and their nidopallial visual neurons process global visual motion information in dynamic random-dot displays during a delayed match-to-sample (DMS) task. The behavioural data show that moderately fast motion speeds (16° of visual angle/s) result in superior direction discrimination performance. To characterise how neurons encode and maintain task-relevant visual motion information, we recorded the single-unit activity in the telencephalic association area 'nidopallium caudolaterale' (NCL) of behaving crows. The NCL is considered to be the avian analogue of the mammalian prefrontal cortex. Almost a third (28%) of randomly selected NCL neurons responded selectively to the motion direction of the sample stimulus, mostly to downward motions. Only few NCL neurons (7.5%) responded consistently to specific motion directions during the delay period. In error trials, when the crows chose the wrong motion direction, the encoding of motion direction was significantly reduced. This indicates that sensory representations of NCL neurons are relevant to the birds' behaviour. These data suggest that the corvid NCL, even though operating at the apex of the telencephalic processing hierarchy, constitutes a telencephalic site for global motion integration.

Development of sit-to-stand and stand-to-sit training system for hemiplegic patients.

As one of the several characteristics of hemiplegic patients after stroke, the patients conduct sit-to-stand and stand-to-sit (STS) motion using their unaffected leg. The purpose of this study is to develop a STS motion support system for helping the patients decrease the difference of the usage ratio between the affected side and the unaffected side, and increase the usage of the affected leg. The developed system supports the STS motions by moving the seat linearly. The system also provides the user visual motor information for each leg by measuring the floor reaction force (FRF) during STS motions. With the motion support and the visual feedback, the user can lean how to increase the usage ratio of the affected leg and equalize the usage ratio of the unaffected leg with the affected leg. The STS experiments were carried out in two hemiplegic patients and a quadriplegic patient to confirm the effectiveness of the system. All the participants increased the FRF of the affected leg and decreased that of the unaffected leg by using the system. Even if the system wasn't used, two participants decreased the difference of the usage ratio between the both sides and increase the FRF of the affected leg. We confirmed not only the immediate effect but also the longitudinal effect of the system. These results suggest that the developed system is effective in helping hemiplegic patients to improve STS motions.

Thematic knowledge, artifact concepts, and the left posterior temporal lobe: Where action and object semantics converge

Converging evidence supports the existence of functionally and neuroanatomically distinct taxonomic (similarity-based; e.g., hammer-screwdriver) and thematic (event-based; e.g., hammer-nail) semantic systems. Processing of thematic relations between objects has been shown to selectively recruit the left posterior temporoparietal cortex. Similar posterior regions have also been shown to be critical for knowledge of relationships between actions and manipulable human-made objects (artifacts). Based on the hypothesis that thematic relationships for artifacts rely, at least in part, on action relationships, we assessed the prediction that the same regions of the left posterior temporoparietal cortex would be critical for conceptual processing of artifact-related actions and thematic relations for artifacts. To test this hypothesis, we evaluated processing of taxonomic and thematic relations for artifacts and natural objects as well as artifact action knowledge (gesture recognition) abilities in a large sample of 48 stroke patients with a range of lesion foci in the left hemisphere. Like control participants, patients identified thematic relations faster than taxonomic relations for artifacts, whereas they identified taxonomic relations faster than thematic relations for natural objects. Moreover, response times (RTs) for identifying thematic relations for artifacts selectively predicted performance in gesture recognition. Whole brain Voxel-based Lesion-Symptom Mapping (VLSM) analyses and Region of Interest (ROI) regression analyses further demonstrated that lesions to the left posterior temporal cortex, overlapping with LTO and visual motion area hMT+, were associated both with relatively slower RTs in identifying thematic relations for artifacts and poorer artifact action knowledge in patients. These findings provide novel insights into the functional role of left posterior temporal cortex in thematic knowledge, and suggest that the close association between thematic relations for artifacts and action representations may reflect their common dependence on visual motion and manipulation information.

Analogous Convergence of Sustained and Transient Inputs in Parallel On and Off Pathways for Retinal Motion Computation.

SUMMARYVisual motion information is computed by parallel On and Off pathways in the retina, which lead to On and Off types of starburst amacrine cells (SACs). The approximate mirror symmetry between this pair of cell types suggests that On and Off pathways might compute motion using analogous mechanisms. To test this idea, we reconstructed On SACs and On bipolar cells (BCs) from serial electron microscopic images of a mouse retina. We defined a new On BC type in the course of classifying On BCs. Through quantitative contact analysis, we found evidence that sustained and transient On BC types are wired to On SAC dendrites at different distances from the SAC soma, mirroring our previous wiring diagram for the Off BC-SAC circuit. Our finding is consistent with the hypothesis that On and Off pathways contain parallel correlation-type motion detectors.

Visual and non-visual motion information processing during pursuit eye tracking in schizophrenia and bipolar disorder.

Despite many reports on visual processing deficits in psychotic disorders, studies are needed on the integration of visual and non-visual components of eye movement control to improve the understanding of sensorimotor information processing in these disorders. Non-visual inputs to eye movement control include prediction of future target velocity from extrapolation of past visual target movement and anticipation of future target movements. It is unclear whether non-visual input is impaired in patients with schizophrenia. We recorded smooth pursuit eye movements in 21 patients with schizophrenia spectrum disorder, 22 patients with bipolar disorder, and 24 controls. In a foveo-fugal ramp task, the target was either continuously visible or was blanked during movement. We determined peak gain (measuring overall performance), initial eye acceleration (measuring visually driven pursuit), deceleration after target extinction (measuring prediction), eye velocity drifts before onset of target visibility (measuring anticipation), and residual gain during blanking intervals (measuring anticipation and prediction). In both patient groups, initial eye acceleration was decreased and the ability to adjust eye acceleration to increasing target acceleration was impaired. In contrast, neither deceleration nor eye drift velocity was reduced in patients, implying unimpaired non-visual contributions to pursuit drive. Disturbances of eye movement control in psychotic disorders appear to be a consequence of deficits in sensorimotor transformation rather than a pure failure in adding cognitive contributions to pursuit drive in higher-order cortical circuits. More generally, this deficit might reflect a fundamental imbalance between processing external input and acting according to internal preferences.