Visual Motion Cues Research Articles

Sensory Basis of Food Detection in Wild Microcebus murinus

Very little is known about how nocturnal primates find their food. Here we studied the sensory basis of food perception in wild-caught gray mouse lemurs (Microcebus murinus) in Madagascar. Mouse lemurs feed primarily on fruit and arthropods. We established a set of behavioral experiments to assess food detection in wild-born, field-experienced mouse lemurs in short-term captivity. Specifically, we investigated whether they use visual, auditory, and motion cues to find and to localize prey arthropods and further whether olfactory cues are sufficient for finding fruit. Visual cues from motionless arthropod dummies were not sufficient to allow reliable detection of prey in choice experiments, nor did they trigger prey capture behavior when presented on the feeding platform. In contrast, visual motion cues from moving prey dummies attracted their attention. Behavioral observations and experiments with live and recorded insect rustling sounds indicated that the lemurs make use of prey-generated acoustic cues for foraging. Both visual motion cues and acoustic prey stimuli on their own were sufficient to trigger approach and capture behavior in the mouse lemurs. For the detection of fruit, choice experiments showed that olfactory information was sufficient for mouse lemurs to find a piece of banana. Our study provides the first experimental data on the sensory ecology of food detection in mouse lemurs. Further research is necessary to address the role of sensory ecology for food selection and possibly for niche differentiation between sympatric Microcebus species.

Early stages of audiovisual speech processing—a magnetoencephalography study

Speech is a multimodal process integrating auditory and visual information. It is still unsettled at which stage of processing visual and auditory data structures merge into a common percept. This study investigates the time domain of auditory M50 and M100 fields in response to audiovisual speech (whole-head MEG, 25 subjects). As in the original video recordings (/pa/ and /ta/), the visual articulatory cues preceded the acoustic signal (synthetic syllable) by ca. 150 ms. Visual nonspeech, acoustic nonspeech, visual-only, and acoustic-only stimuli served as control conditions. In accordance with previous studies, the M50 was consistently attenuated by visual motion cues, and a similar visual ‘‘negativation’’ effect could be observed even when no acoustic signal was played. As concerns the M100 field, visual nonspeech stimuli had an attenuating effect (only in the presence of an acoustic signal) whereas visual speech gave rise to hypoadditive M100 enhancement. Application of a six-dipole model showed a categorical-like visual /p/ versus /t/ effect. Since the source of this effect was located within insular cortex rather than the auditory system, we may assume that at the time of M100 the visual phonetic information has not yet been integrated into a common auditory/phonetic representation.

A Bio-Inspired Flying Robot Sheds Light on Insect Piloting Abilities

When insects are flying forward, the image of the ground sweeps backward across their ventral viewfield and forms an "optic flow," which depends on both the groundspeed and the groundheight. To explain how these animals manage to avoid the ground by using this visual motion cue, we suggest that insect navigation hinges on a visual-feedback loop we have called the optic-flow regulator, which controls the vertical lift. To test this idea, we built a micro-helicopter equipped with an optic-flow regulator and a bio-inspired optic-flow sensor. This fly-by-sight micro-robot can perform exacting tasks such as take-off, level flight, and landing. Our control scheme accounts for many hitherto unexplained findings published during the last 70 years on insects' visually guided performances; for example, it accounts for the fact that honeybees descend in a headwind, land with a constant slope, and drown when travelling over mirror-smooth water. Our control scheme explains how insects manage to fly safely without any of the instruments used onboard aircraft to measure the groundheight, groundspeed, and descent speed. An optic-flow regulator is quite simple in terms of its neural implementation and just as appropriate for insects as it would be for aircraft.

Complex motion selectivity in PMLS cortex following early lesions of primary visual cortex in the cat

In the cat, the analysis of visual motion cues has generally been attributed to the posteromedial lateral suprasylvian cortex (PMLS) (Toyama et al., 1985; Rauschecker et al., 1987; Rauschecker, 1988; Kim et al., 1997). The responses of neurons in this area are not critically dependent on inputs from the primary visual cortex (VC), as lesions of VC leave neuronal response properties in PMLS relatively unchanged (Spear & Baumann, 1979; Spear, 1988; Guido et al., 1990b). However, previous studies have used a limited range of visual stimuli. In this study, we assessed whether neurons in PMLS cortex remained direction-selective to complex motion stimuli following a lesion of VC, particularly to complex random dot kinematograms (RDKs). Unilateral aspiration of VC was performed on post-natal days 7-9. Single unit extracellular recordings were performed one year later in the ipsilateral PMLS cortex. As in previous studies, a reduction in the percentage of direction selective neurons was observed with drifting sinewave gratings. We report a previously unobserved phenomenon with sinewave gratings, in which there is a greater modulation of firing rate at the temporal frequency of the stimulus in animals with a lesion of VC, suggesting an increased segregation of ON and OFF sub-regions. A significant portion of neurons in PMLS cortex were direction selective to simple (16/18) and complex (11/16) RDKs. However, the strength of direction selectivity to both stimuli was reduced as compared to normals. The data suggest that complex motion processing is still present, albeit reduced, in PMLS cortex despite the removal of VC input. The complex RDK motion selectivity is consistent with both geniculo-cortical and extra-geniculate thalamo-cortical pathways in residual direction encoding.

Sequential audiovisual interactions during speech perception: A whole-head MEG study

Using whole-head magnetoencephalography (MEG), audiovisual (AV) interactions during speech perception (/ta/- and /pa/-syllables) were investigated in 20 subjects. Congruent AV events served as the ‘standards’ of an oddball design. The deviants encompassed incongruent /ta/–/pa/ configurations differing from the standards either in the acoustic or the visual domain. As an auditory non-speech control condition, the same video signals were synchronized with either one of two complex tones. As in natural speech, visual movement onset preceded acoustic signals by about 150 ms. First, the impact of visual information on auditorily evoked fields to non-speech sounds was determined. Larger facial movements (/pa/ versus /ta/) yielded enhanced early responses such as the M100 component, indicating, most presumably, anticipatory pre-activation of auditory cortex by visual motion cues. As a second step of analysis, mismatch fields (MMF) were calculated. Acoustic deviants elicited a typical MMF, peaking ca. 180 ms after stimulus onset, whereas visual deviants gave rise to later responses (220 ms) of a more posterior-medial source location. Finally, a late (275 ms), left-lateralized visually-induced MMF component, resembling the acoustic mismatch response, emerged during the speech condition, presumably reflecting phonetic/linguistic operations. There is mounting functional imaging evidence for an early impact of visual information on auditory cortical regions during speech perception. The present study suggests at least two successive AV interactions in association with syllable recognition tasks: early activation of auditory areas depending upon visual motion cues and a later speech-specific left-lateralized response mediated, conceivably, by backward-projections from multisensory areas.

On robustness and localization accuracy of optical flow computation for underwater color images

Color-image optical flow processing may offer little merit in terrestrial imagery, mainly due to high correlation among the color channels. However, spectral-dependent environmental factors reduce the degree of correlation in underwater imagery, enriching visual motion cues. Additionally, use of multiple motion constraints can increase estimation robustness and noise immunity, which is significant for overcoming higher underwater image noise from various sources. Despite high variability in the conditions of various bodies of water, a simplified image model allows us to draw general conclusions on the computation of visual motion from color channels, based on average common medium characteristics. In particular, the model offers insight into: (1) information encoded in various color channels; (2) advantages in the use of a certain color representation over others; (3) consistency between conclusions from the theoretical study and from experiments with data sets recoded in various types of ocean waters and locations. The study concludes that optical flow computation based on the HSV representation typically provides more improved localization and motion estimation precision relative to other color presentations. Results of various experiments with underwater data are given to assess the accuracy.

Visual motion pattern extraction and fusion for collision detection in complex dynamic scenes

Detecting colliding objects in complex dynamic scenes is a difficult task for conventional computer vision techniques. However, visual processing mechanisms in animals such as insects may provide very simple and effective solutions for detecting colliding objects in complex dynamic scenes. In this paper, we propose a robust collision detecting system, which consists of a lobula giant movement detector (LGMD) based neural network and a translating sensitive neural network (TSNN), to recognise objects on a direct collision course in complex dynamic scenes. The LGMD based neural network is specialized for recognizing looming objects that are on a direct collision course. The TSNN, which fuses the extracted visual motion cues from several whole field direction selective neural networks, is only sensitive to translating movements in the dynamic scenes. The looming cue and translating cue revealed by the two specialized visual motion detectors are fused in the present system via a decision making mechanism. In the system, the LGMD plays a key role in detecting imminent collision; the decision from TSNN becomes useful only when a collision alarm has been issued by the LGMD network. Using driving scenarios as an example, we showed that the bio-inspired system can reliably detect imminent colliding objects in complex driving scenes.

Perceptual-motor deficits in children with Down syndrome: Implications for intervention

Early intervention approaches for facilitating motor development in infants and children with Down syndrome have traditionally emphasised the acquisition of motor milestones. As increasing evidence suggests that motor milestones have limited predictive power for long-term motor outcomes, researchers have shifted their focus to understanding the underlying perceptual-motor competencies that influence motor behaviour in Down syndrome. This paper outlines a series of studies designed to evaluate the nature and extent of perceptual-motor impairments present in children with Down syndrome. 12 children with Down syndrome between the ages of 8-15 years with adaptive ages between 3-7 years (mean age = 5.6 years +/- 1.45 years) and a group of 12 typically developing children between the ages of 4-8 years (mean age = 5.4 +/- 1.31 years) were tested on their ability to make increasingly complex perceptual discriminations of motor behaviours. The results indicate that children with Down syndrome are able to make basic perceptual discriminations but show impairments in the perception of complex visual motion cues. The implications of these results for early intervention are discussed.

Effect of Contrast on the Active Control of a Moving Line

In many passive visual tasks, human perceptual judgments are contrast dependent. To explore whether these contrast dependencies of visual perception also affect closed-loop manual control tasks, we examined visuomotor performance as humans actively controlled a moving luminance-defined line over a range of contrasts. Four subjects were asked to use a joystick to keep a horizontal line centered on a display as its vertical position was perturbed by a sum of sinusoids under two control regimes. The total root mean square (RMS) position error decreased quasi-linearly with increasing log contrast across the tested range (mean slope across subjects: -8.0 and -7.7% per log2 contrast, for the two control regimes, respectively). Frequency-response (Bode) plots showed a systematic increase in open-loop gain (mean slope: 1.44 and 1.30 dB per log2 contrast, respectively), and decrease in phase lag with increasing contrast, which can be accounted for by a decrease in response time delay (mean slope: 32 and 40 ms per log2 contrast, respectively). The performance data are well fit by a Crossover Model proposed by McRuer and Krendel, which allowed us to identify both visual position and motion cues driving performance. This analysis revealed that the position and motion cues used to support manual control under both control regimes appear equally sensitive to changes in stimulus contrast. In conclusion, our data show that active control of a moving visual stimulus is as dependent on contrast as passive perception and suggest that this effect is attributed to a shared contrast sensitivity early in the visual pathway, before any specialization for motion processing.

Perception of static eye gaze direction facilitates subsequent early visual processing.

Using event-related potentials (ERPs), it has been recently shown that a reflexive shift of attention following the observation of a dynamic eye gaze cue enhances and speeds up early visual processing of a target presented at the gazed-at location. Here we investigate whether similar early sensory modulations are also elicited by static gaze cues, or if previously described attentional effects were caused mainly by visual motion cues and not by eye gaze direction per se. Furthermore, we explore if these possible attentional orienting effects reflect facilitation of the processing of cued stimuli, inhibition of the unattended stimuli, or both. Subjects were presented with a face looking to the right or left visual field (VF), or straight away, before the occurrence of a lateralized target to detect. There were 3 conditions in this nonpredictive cueing task: (1) target presented in the VF indicated by the eye gaze direction (congruent); (2) opposite to the eye gaze direction (incongruent); or (3) preceded by a straight gazing face (neutral). Subjects were faster at detecting congruently than incongruently and neutrally cued targets. Facilitation effects were observed on early ERP components: the occipital P1 and occipito-temporal N1 components were speeded up as early as approximately 100 ms following stimulus onset (P1), and enhanced (P1 and N1) in response to congruent trials, particularly in the right hemisphere. Spatial attention triggered by static eye gaze direction produces response facilitations - predominantly lateralized to the right hemisphere - from the early sensory stages of visual processing. This study provides the first evidence of a speeding up and amplification of early visual processing following attention triggered by static eye gaze perception.

航空機における横揺れ補償操舵への時間進みビジュアル・キューの効果(人間機械システム・HMI(3),OS3 人間機械システム,ヒューマンインターフェース)

When a human pilot controls aircraft, he relies on visual cues and motion cues. Especially visual cues are great part of information required for control. We thought of modifying the movement of the outside visual field. That is, pilot observes a virtual visual cue which is added a first-order lead compensation to the real roll response of aircraft. In this study we prepared two tasks, roll compensatory control task and holding flight path task. We investigate the effect of virtual visual cue using a fixed-based flight simulator. As a result, in a roll compensatory control task, pilot controls aircraft easier without getting task performance worse. But in a holding flight path task, pilot didn't control aircraft easier. Although only roll response is important cue in roll compensatory control task. In holding flight path task, not only roll response but also yaw response plays a great role. That shows that it is necessary to modify the dutch-roll oscillation component in the yaw response.

Input Organization of Multifunctional Motion-Sensitive Neurons in the Blowfly

Flies rely heavily on visual motion cues for course control. This is mediated by a small set of motion-sensitive neurons called lobula plate tangential cells. A single class of these, the centrifugal horizontal (CH) neurons, play an important role in two pathways: figure-ground discrimination and flow-field selectivity. As was recently found, the dendrites of CH cells are electrically coupled with the dendritic tree of another class of neurons sensitive to horizontal image motion, the horizontal system (HS) cells. However, whether motion information arrives independently at both of these cells or is passed from one to the other is not known. Here, we examine the ipsilateral input circuitry to HS and CH neurons by selective laser ablation of individual interneurons. We find that the response of CH neurons to motion presented in front of the ipsilateral eye is entirely abolished after ablation of HS cells. In contrast, the motion response of HS cells persists after the ablation of CH cells. We conclude that HS cells receive direct motion input from local motion elements, whereas CH cells do not; their motion response is driven by HS cells. This connection scheme is discussed with reference to how the dendritic networks involved in figure-ground detection and flow-field selectivity might operate.

Discrimination of travel distances from ‘situated’ optic flow

Effective navigation requires knowledge of the direction of motion and of the distance traveled. Humans can use visual motion cues from optic flow to estimate direction of self-motion. Can they also estimate travel distance from visual motion? Optic flow is ambiguous with regard to travel distance. But when the depth structure of the environment is known or can be inferred, i.e., when the flow can be calibrated to the environmental situation, distance estimation may become possible. Previous work had shown that humans can discriminate and reproduce travel distances of two visually simulated self-motions under the assumption that the environmental situation and the depth structure of the scene is the same in both motions. Here we ask which visual cues are used for distance estimation when this assumption is fulfilled. Observers discriminated distances of visually simulated self-motions in four different environments with various depth cues. Discrimination was possible in all cases, even when motion parallax was the only depth cue available. In further experiments we ask whether distance estimation is based directly on image velocity or on an estimate of observer velocity derived from image velocity and the structure of the environment. By varying the simulated height above ground, the visibility range, or the simulated gaze angle we modify visual information about the structure of the environment and alter the image velocity distribution in the optic flow. Discrimination ability remained good. We conclude that the judgment of travel distance is based on an estimate of observer speed within the simulated environment.

Experience-dependent visual cue integration based on consistencies between visual and haptic percepts

We study the hypothesis that observers can use haptic percepts as a standard against which the relative reliabilities of visual cues can be judged, and that these reliabilities determine how observers combine depth information provided by these cues. Using a novel visuo-haptic virtual reality environment, subjects viewed and grasped virtual objects. In Experiment 1, subjects were trained under motion relevant conditions, during which haptic and visual motion cues were consistent whereas haptic and visual texture cues were uncorrelated, and texture relevant conditions, during which haptic and texture cues were consistent whereas haptic and motion cues were uncorrelated. Subjects relied more on the motion cue after motion relevant training than after texture relevant training, and more on the texture cue after texture relevant training than after motion relevant training. Experiment 2 studied whether or not subjects could adapt their visual cue combination strategies in a context-dependent manner based on context-dependent consistencies between haptic and visual cues. Subjects successfully learned two cue combination strategies in parallel, and correctly applied each strategy in its appropriate context. Experiment 3, which was similar to Experiment 1 except that it used a more naturalistic experimental task, yielded the same pattern of results as Experiment 1 indicating that the findings do not depend on the precise nature of the experimental task. Overall, the results suggest that observers can involuntarily compare visual and haptic percepts in order to evaluate the relative reliabilities of visual cues, and that these reliabilities determine how cues are combined during three-dimensional visual perception.

Simulated car crashes at intersections in drivers with Alzheimer disease.

Current evidence suggests that car crashes in cognitively impaired older drivers often occur because of failure to notice other drivers at intersections. We tested whether licensed drivers with mild to moderate cognitive impairment due to Alzheimer disease (AD) are at greater risk for intersection crashes. In this experiment, 30 participants drove on a virtual highway in a simulator scenario where the approach to within 3.6 seconds of an intersection triggered an illegal incursion by another vehicle. To avoid collision with the incurring vehicle, the driver had to perceive, attend to, and interpret the roadway situation; formulate an evasive plan; and then exert appropriate action on the accelerator, brake, or steering controls, all under pressure of time. The results showed that 6 of 18 drivers with AD (33%) experienced crashes versus none of 12 nondemented drivers of similar age. Use of a visual tool that plots control over steering wheel position, brake and accelerator pedals, vehicle speed, and vehicle position during the 5 seconds preceding a crash event showed inattention and control responses that were either inappropriate or too slow. The findings were combined with those in another recent study of collision avoidance in drivers with AD that focused on potential rear end collisions. Predictors of crashes in the combined studies included visuospatial impairment, disordered attention, reduced processing of visual motion cues, and overall cognitive decline. The results help to specify the linkage between decline in certain cognitive domains and increased crash risk in AD and also support the use of high-fidelity simulation and neuropsychologic assessment in an effort to standardize the assessment of fitness to drive in persons with medical impairments.

Active vision-based control schemes for autonomous navigation tasks

This paper deals with active-vision-based practical control schemes for collision avoidance as well as maintenance of clearance in a-priori unknown textured environments. These control schemes employ a visual motion cue, called the visual threat cue (VTC) as a sensory feedback signal to accomplish the desired tasks. The VTC provides some measure for a relative change in range as well as clearance between a 3D surface and a moving observer. It is a collective measure obtained directly from the raw data of gray level images, is independent of the type of 3D surface texture. It is measured in [time −1] units and needs no 3D reconstruction. The control schemes are based on a set of If–Then fuzzy rules with almost no knowledge about the vehicle dynamics, speed, heading direction, etc. They were implemented in real-time using a 486-based Personal Computer and a camera capable of undergoing 6-DOF motion.

Spatial performance of unilateral vestibular defective patients in nonvisual versus visual navigation

The purpose of this study was to investigate the effects of unilateral vestibular neurotomy on humans ability to perform navigation tasks. These tasks provided self-motion feedback by way of either locomotor activity only (nonvisual navigation or "locomotor task") or visual motion cues only (visually simulated navigation or "visual task"). After exploration of an environment in which 4 locations were marked by different objects, subjects attempted to navigate to those locations either by reproducing the same paths as those followed during exploration, by reversing routes, or by making spatial inferences (shortcuts). Vestibular defective patients were tested one day before surgical treatment and during the recovery time course following unilateral vestibular nerve lesion (1 week, 1 month, and 3 month later). Their performance was assessed by measuring turn error and distance error in both navigation tasks and was compared to that of control subjects tested 4 times at similar time intervals. Turn error in the reproduction of previously explored routes in the locomotor task was lower in patients before surgery than in controls, suggesting the existence of compensatory processes. In the acute stage (1 week) after unilateral vestibular lesion, turn error was greater in patients than in controls for the highest level of mental representation (spatial inferences or reversing routes); impairment at making accurate rotations had disappeared by 1 month after vestibular lesion in both navigation tasks. These results point to the role of vestibular cues, in interaction with other sensory modalities, in the elaboration of an accurate internal representation of the environment. In addition, they suggest that unilateral suppression of vestibular information would induce transitory spatial memory disorganization at a high level of information processing.

A VISION-BASED PRAGMATIC STRATEGY FOR AUTONOMOUS NAVIGATION

This paper presents a novel approach based on active-vision paradigm, for generating local collision-free paths for mobile robot navigation, in indoor as well as outdoor environments. Two measurable visual motion cues that provide some measure for a relative change in range as well clearance between a 3D surface and a visually fixating observer in motion are described. The visual fields associated with the cues can be used to demarcate regions around a moving observer into safe and danger zones of varying degree, which is suitable for making local decisions about the steering as well as speed commands to the vehicle.

Estimation of self-motion by optic flow processing in single visual interneurons.

Humans, animals and some mobile robots use visual motion cues for object detection and navigation in structured surroundings. Motion is commonly sensed by large arrays of small field movement detectors, each preferring motion in a particular direction. Self-motion generates distinct 'optic flow fields' in the eyes that depend on the type and direction of the momentary locomotion (rotation, translation). To investigate how the optic flow is processed at the neuronal level, we recorded intracellularly from identified interneurons in the third visual neuropile of the blowfly. The distribution of local motion tuning over their huge receptive fields was mapped in detail. The global structure of the resulting 'motion response fields' is remarkably similar to optic flow fields. Thus, the organization of the receptive fields of the so-called VS neurons strongly suggests that each of these neurons specifically extracts the rotatory component of the optic flow around a particular horizontal axis. Other neurons are probably adapted to extract translatory flow components. This study shows how complex visual discrimination can be achieved by task-oriented preprocessing in single neurons.

Vestibular compensation: role of visual motion cues in the recovery of posturo-kinetic functions in the cat

Vision has long been recognized as a sensorimotor system which plays a major role in substitution for functional deficits induced by unilateral or bilateral exclusion of primary vestibular afferents. Little is known, however, about the post-lesion influence of visual inputs on the recovery of posturo-kinetic balance in a situation where fine, well-coordinated locomotr adjustments are required. The present study was carried out in order to gain some insight into the role played by motion vision in the restoration of fine posturo-kinetic balance in adult cats subjected to unilateral vestibular neurectomy. Prior to the lesion, 15 adult animals were trained to cross a beam rotatin at various speeds. Their best global balance performance (highest beam rotation speed that did not provoke falling) and their average locomotion speed were evaluated. After the lesion, the cats were separated into three groups: (1) five animals were placed in a normal environment (animal house) (NV cats); (2) four animals were exposed to stroboscopic illumination which eliminated visual motion cues (SV cats) for 2 weeks following the lesion; and (3) three animals were placed in a normal environment and their training was interrupted for the same period as in the SV cats (NVI cats). The possible influence of the 2-week deprivation of visual motion cues on posturo-kinetic balance was also examined in three intact cats. The present behavioral study showed that: (1) early sensory deprivation caused suspension of the posturo-kinetic balance recovery process as long as it was maintained; (2) complete restoration of global balance capacities developed following the vestibular neurectomy after a significant delay in half of the SV cats; (3) the lack of motion cues resulted in severe alterations of fine posturo-kinetic balance (inappropriate dynamic motor adjustments and irregular locomotion speed regulation) in all SV cats; and (4) the visual deprivation induced a 2-week delay in the restoration of fine locomotor balance. These findings provide evidence for a defect in the visual sensory substitution processes that normally take place within the first few weeks following exclusion of primary vestibular afferents.