Optic Flow Patterns Research Articles

Inferior olivary neurons innervate multiple zones of the flocculus in pigeons (Columba livia)

Complex spike activity of floccular Purkinje cells responds to patterns of rotational optic flow about the vertical axis (rVA neurons) or a horizontal axis 45 degrees to the midline (rH45 neurons). The pigeon flocculus is organized into four parasagittal zones: two rVA zones (zones 0 and 2) interdigitated with two rH45 zones (zones 1 and 3). Climbing fiber input to the rVA and rH45 zones arises in the caudal and rostral regions of the medial column of the inferior olive (mcIO), respectively. To determine whether the two rVA zones and the two rH45 zones receive input from different areas of the caudal and rostral mcIO and whether individual neurons project to both zones of the same rotational preference, different colors of fluorescent retrograde tracer were injected into the two rVA or two rH45 zones. For the rVA injections, retrogradely labeled cells from the two zones were intermingled in the caudal mcIO, but the distribution of cells labeled from zone 0 was slightly caudal to that from zone 2. On average, 18% of neurons were double labeled. For the rH45 injections, cells retrogradely labeled from the two zones were intermingled in the rostral mcIO, but the distribution of cells labeled from zone 1 was slightly rostral to that from zone 3. On average, 22% of neurons were double labeled. In sum, each of the two rVA zones and the two rH45 zones receives input from slightly different regions of the mcIO, and about 20% of the neurons project to both zones.

Selectivity for speed gradients in human area MT/V5

Cortical area MT/V5 in the human occipito-temporal cortex is activated by visual motion. In this study, we use functional imaging to demonstrate that a subregion of MT/V5 is more strongly activated by unidirectional motion with speed gradients than by other motion patterns. Our results suggest that like the monkey homolog middle temporal area (MT), human MT/V5 contains neurons selective for the processing of speed gradients. Such neurons may constitute an intermediate stage of processing between neurons selective for the average speed of unidirectional motion and neurons selective for different combinations of speed gradient and different motion directions such as expanding optical flow patterns.

Impaired perception of self-motion (heading) in abstinent ecstasy and marijuana users

Illicit drug use can increase driver crash risk due to loss of control over vehicle trajectory. This study asks, does recreational use of +/-3,4-Methylenedioxymethamphetamine (MDMA; ecstasy) and tetrahydrocannabinol (THC; marijuana) impair cognitive processes that help direct our safe movement through the world? This study assesses the residual effects of combined MDMA/THC use, and of THC use alone, upon perceived trajectory of travel. Perception of self-motion, or heading, from optical flow patterns was assessed using stimuli comprising random dot ground planes presented at three different densities and eight heading angles (1, 2, 4 and 8 degrees to the left or right). On each trial, subjects reported if direction of travel was to the left or the right. Results showed impairments in both drug groups, with the MDMA/THC group performing the worst. The finding that these psychoactive agents adversely affect heading perception, even in recently abstinent users, raises potential concerns about MDMA use and driving ability.

A Biomimetic VLSI Sensor for Visual Tracking of Small Moving Targets

Taking inspiration from the visual system of the fly, we describe and characterize a monolithic analog very large-scale integration sensor, which produces control signals appropriate for the guidance of an autonomous robot to visually track a small moving target. This sensor is specifically designed to allow such tracking even from a moving imaging platform which experiences complex background optical flow patterns. Based on relative visual motion of the target and background, the computational model implemented by this sensor emphasizes any small-field motion which is inconsistent with the wide-field background motion.

Insect-inspired estimation of egomotion.

Tangential neurons in the fly brain are sensitive to the typical optic flow patterns generated during egomotion. In this study, we examine whether a simplified linear model based on the organization principles in tangential neurons can be used to estimate egomotion from the optic flow. We present a theory for the construction of an estimator consisting of a linear combination of optic flow vectors that incorporates prior knowledge about the distance distribution of the environment and about the noise and egomotion statistics of the sensor. The estimator is tested on a gantry carrying an omnidirectional vision sensor. The experiments show that the proposed approach leads to accurate and robust estimates of rotation rates, whereas translation estimates are of reasonable quality, albeit less reliable.

The visual control of stability in children and adults: postural readjustments in a ground optical flow

The aim of this research was to analyse the development of postural reactions to approaching (AOF) and receding (ROF) ground rectilinear optical flows. Optical flows were shaped by a pattern of circular spots of light projected on the ground surface by a texture flow generator. The geometrical structure of the projected scenes corresponded to the spatial organisation of visual flows encountered in open outdoor settings. Postural readjustments of 56 children, ranging from 7 to 11 years old, and 12 adults were recorded by the changes of the centre of foot pressure (CoP) on a force platform during 44-s exposures to the moving texture. Before and after the optical flows exposure, a 24-s motionless texture served as a reference condition. Effect of ground rectilinear optical flows on postural control development was assessed by analysing sway latencies (SL), stability performances and postural orientation. The main results that emerge from this experiment show that postural responses are directionally specific to optical flow pattern and that they vary as a function of the motion onset and offset. Results showed that greater developmental changes in postural control occurred in an AOF (both at the onset and offset of the optical flow) than in an ROF. Onset of an approaching flow induced postural instability, canonical shifts in postural orientation and long latencies in children which were stronger than in the receding flow. This pattern of responses evolved with age towards an improvement in stability performances and shorter SL. The backward decreasing shift of the CoP in children evolved in adults towards forward postural tilt, i.show $132#e. in the opposite direction of the texture's motion. Offset of an AOF motion induced very short SL in children (which became longer in adult subjects), strong postural instability, but weaker shift of orientation compared to the receding one. Postural stability improved and orientation shift evolved to forward inclinations with age. SL remained almost constant across age at both onset and offset of the receding flow. Critical developmental periods seem to occur by the age of 8 and 10 years, as suggested by the transient 'neglect' of the children to optical flows. Linear vection was felt by 90% of the 7 year olds and decreased with age to reach 55% in adult subjects. The mature sensorimotor coordination subserving the postural organisation shown in adult subjects is an example aiming at reducing the postural effects induced by optical flows. The data are discussed in relation to the perceptual importance of mobile visual references on a ground support.

Perception of expanding optic flow patterns across the visual field

Purpose: To investigate the sensitivity to the direction of heading in expanding optic flow fields as a function of retinal location, with a view to determine the likely functional deficit in low vision patients with visual field loss. The results reported here are from a preliminary study investigating three normal vision observers. Methods: Sensitivity to the focus of expansion (FoE) was measured with 0.5 second expanding random Gaussian dot patterns as a function of retinal location. Accuracy was measured by positioning a cursor on the perceived FoE. Observers also discriminated whether the FoE was left or right of centre in an equivalent noise paradigm in which positional variance was applied to the FoE for each dot. Finally to determine FoE resolution, observers discriminated an interval containing two FoEs from an interval containing only one. Results: The accuracy of locating the FoE was independent of eccentricity and location of the expanding optic flow in the visual field. This was confirmed by the equivalent noise measurements which showed that internal noise did not vary with eccentricity but efficiency decreased somewhat. The separation between two FoEs had to increase with eccentricity before an observer could resolve them. Conclusions: Sensitivity to expanding optic flow patterns is generally invariant across the field for both identifying the position of the FoE and for integrating the motions of the dots defining it. The results suggest that mechanisms with large receptive fields pool directional information across the visual field. The loss in efficiency indicates that the number of elements integrated increases with eccentricity and this also accounts for the loss of resolution. The Wellcome Trust

Visual motor computations in insects.

With their relatively simple nervous systems and purpose-designed behaviors and reflexes, insects are an excellent organism in which to investigate how visual information is acquired and processed to guide locomotion and navigation. Flies maintain a straight course and monitor their motion through the environment by sensing the patterns of optic flow induced in the eyes. Bees negotiate narrow gaps by balancing the speeds of the images in their two eyes, and they control flight speed by holding constant the average image velocity as seen with their two eyes. Bees achieve a smooth landing on a horizontal surface by holding the image velocity of the surface constant during approach, thus ensuring that flight speed is automatically close to zero at touchdown. Foraging bees estimate the distance that they have traveled to reach a food source by integrating the optic flow experienced en route; this integration gives them a visually driven "odometer." Insects have also evolved sophisticated visuomotor mechanisms for pursuing prey or mates and possibly for concealing their own motion while shadowing objects of interest.

Parietal Area VIP Neuronal Responses to Heading Stimuli Are Encoded in Head-Centered Coordinates

The ventral intraparietal area (VIP) is a multimodal parietal area, where visual responses are brisk, directional, and typically selective for complex optic flow patterns. VIP thus could provide signals useful for visual estimation of heading (self-motion direction). A central problem in heading estimation is how observers compensate for eye velocity, which distorts the retinal motion cues upon which perception depends. To find out if VIP could be useful for heading, we measured its responses to simulated trajectories, both with and without eye movements. Our results showed that most VIP neurons very strongly signal heading direction. Furthermore, the tuning of most VIP neurons was remarkably stable in the presence of eye movements. This stability was such that the population of VIP neurons represented heading very nearly in head-centered coordinates. This makes VIP the most robust source of such signals yet described, with properties ideal for supporting perception.

Convergent evidence for the visual analysis of optic flow through anisotropic attenuation of high spatial frequencies.

Photoreceptors strongly attenuate high temporal frequencies. Hence when an image moves, high spatial frequency components are lost if their direction of modulation coincides with the direction of movement, but not if it is orthogonal. The power spectra of natural images are remarkably consistent in having a 1/f 2 falloff in power in all directions. For moving images, the spatial power spectra will be distorted by becoming steeper in the direction corresponding to modulation in the direction of motion, and the contours of equal power will tend to become elliptical. This study demonstrates that the mammalian visual system is specifically sensitive to such anisotropic changes of the local power spectrum, and it is suggested that these distortions are used to determine patterns of optic flow. Convergent evidence from work on Glass figures, motion streaks, and sensitivity to non-Cartesian gratings is called on in support of this interpretation, which has been foreshadowed in several recent publications.

Stability in young infants' discrimination of optic flow.

Although considerable progress has been made in understanding how adults perceive their direction of self-motion, or heading, from optic flow, little is known about how these perceptual processes develop in infants. In 3 experiments, the authors explored how well 3- to 6-month-old infants could discriminate between optic flow patterns that simulated changes in heading direction. The results suggest that (a) prior to the onset of locomotion, the majority of infants discriminate between optic flow displays that simulate only large (> 22 deg.) changes in heading, (b) there is minimal development in sensitivity between 3 and 6 months, and (c) optic flow alone is sufficient for infants to discriminate heading. These data suggest that spatial abilities associated with the dorsal visual stream undergo prolonged postnatal development and may depend on locomotor experience.

Cell responsiveness in macaque superior temporal polysensory area measured by temporal discriminants.

The firing-rate data from 341 cells from two macaques' superion temporal polysensory area (STPa) were subjected to three different analyses to determine the temporal firing-rate patterns in response to visual optic flow patterns. The data were collected while the monkey viewed four types of optic flow and responded to the change in the display. The mean firing rate (MFR) analysis considered the mean change in firing rate for 500 ms after stimulus onset; the discriminant (DIS) analysis and the principal components (PCA+DIS) analysis considered the change in time-binned firing rate over 1000 ms after stimulus presentation, using bin sizes of 30 to 500 ms. The DIS analysis used a step-down discriminant analysis to find temporal windows in which the cell's firing rate could discriminate among the stimuli; the PCA+DIS analysis extracted the principal components of the cell's firing rates without regard for the stimulus type and then applied a step-down discriminant analysis to the PCA scores to determine whether any of the principal components could discriminate among the stimuli. The two temporal analyses found cells sensitive to the optic flows that the MFR analysis missed. A small proportion of cells showed multiple selectivities under the temporal analyses. Thus, the temporal analyses give a more complete representation of the information encoded by the firing properties of STPa neurons. Finally, this approach incorporates temporal approaches with classical statistical techniques in order to select tuned neurons from a population in an unbiased manner.

Response properties of cat striate neurons to simulated optic flow stimuli

AbstractOptic flow analysis has been extensively investigated in several extrastriate visual areas of the primate, but it remains unclear whether and how the striate cortex is involved in the processing. In the present study 156 striate neurons in anaesthetized cats were tested with simulated optic flow patterns. More than 80% of the cells responded to the stimuli, about 30% significantly preferred translation to radiation and rotation, but few, if any, displayed clear preference for radial or circular motion. Most responsive neurons had fairly good direction sensitivity for their optimal stimuli. Generally, the differences between simple and complex cells were small and insignificant. Although translation obviously prevailed over radiation and rotation in driving more cells and eliciting stronger responses, the responsivity to complex flow fields was not predictable with the direction preference to planar motion. These results suggest that the striate contribution to optic flow analysis may go beyond the direction selectivity to local translation and there might be some kind of specific mechanism to complex motion features.

Four‐Month‐Olds' Discrimination of Optic Flow Patterns Depicting Different Directions of Observer Motion

One of the most powerful sources of information about spatial relationships available to mobile organisms is the pattern of visual motion called optic flow. Despite its importance for spatial perception and for guiding locomotion, very little is known about how the ability to perceive one's direction of motion, or heading, from optic flow develops early in life. In this article, we report the results of 3 experiments that tested the abilities of 4‐month‐old infants to discriminate optic flow patterns simulating different directions of self‐motion. The combined results from 2 different experimental paradigms suggest that 4‐month‐olds discriminate optic flow patterns that simulate only large (> 32°) changes in the direction of the observer's motion through space. This suggests that prior to the onset of locomotion, there are limitations on infants' abilities to process patterns of optic flow related to self‐motion.

Influence of prolonged optic flow stimuli on spontaneous activities of cat PMLS neurons

Changes in neuronal spontaneous activities after prolonged optic flow stimulation (using the three basic flow modes: translation, radiation and rotation) were investigated by extracellular single-unit recording in cortical area PMLS of the cat. The results showed that the evoked responses decreased with the prolongation of visual stimuli, and the spontaneous activities usually dropped to a lower level after the stimuli were withdrawn. Generally, the reduction in spontaneous activities was larger after adaptation in the preferred direction than in the non-preferred direction. This difference was much pronounced to translation stimuli, but relatively insignificant to radiation and rotation. These points suggest that non-specific fatigue may act as the key factor in adaptation to simple translation, while some kinds of more complicated, direction-specific mechanism may be involved in adaptation to the complex optic flow patterns. In addition, PMLS may play an important role in perception and adaptation to complex motion and the relevant motion after-effects.

The role of vision in maintaining heading direction: effects of changing gaze and optic flow on human gait.

How is heading direction maintained in human gait? This question was investigated with respect to the role of optic flow and in the context of different movement strategies. While walking on a treadmill the deviation from the ideal straight path was measured in terms of lateral sway induced by a lateral gaze shift (by looking at a moving visual target). The role of the focus of expansion (FOE) within a radially expanding optic flow pattern was investigated by varying its relative velocity of expansion from 0- to 4-fold (the equivalent of walking speed), thus increasing the perceptibility of FOE. If FOE was a relevant cue for maintaining heading direction, a reduction of lateral sway amplitude was expected with increasing flow velocity. The presence of a radially expanding flow pattern did not reduce lateral sway. Lateral sway was least when the visual background remained stable without any flow pattern. Increasing the velocity of the flow pattern resulted in an increase in lateral sway. If the relative velocity of the flow pattern was raised beyond that corresponding to walking speed, lateral sway amplitude approached the maximal values observed in the dark. In all experiments, sway amplitude increased linearly with the increasing excursion of the visual target. Different strategies to perform the gaze shift (eye or head turns) only resulted in minor differences in lateral sway amplitude. The results show that gaze shifts during locomotion induce lateral sway, which depends upon the presence, and characteristics, of background optic flow. Under the present conditions, the FOE within the flow field seems not to be a dominant cue to control heading. However, the systematic increase in lateral sway induced by high flow velocities indicates that motion parallax has an effect on heading during locomotion.

Zonal organization of the vestibulocerebellum in pigeons (Columba livia): I. Climbing fiber input to the flocculus.

Previous studies in pigeons have shown that the neurons in the medial column of the inferior olive respond best to patterns of optic flow resulting from self-rotation. With respect to the axis of rotation, there are two functional groups: rVA neurons prefer rotation about the vertical axis, whereas rH45 neurons respond best to rotation about an horizontal axis oriented at 45 degrees ipsilateral azimuth. The rVA and rH45 neurons are located in the caudal and rostral margins of the medial column, respectively. These olivary neurons project as climbing fibers to the contralateral flocculus. In this study, injections of anterograde tracers into the medial column were used to investigate the zonal organization of the climbing fiber input to the flocculus of pigeons. Iontophoretic injections of either cholera toxin subunit-B or biotinylated dextrin amine were made into the medial column of the inferior olive at locations responsive to rVA or rH45 rotational optic flow. Anterogradely labeled climbing fibers in the flocculus showed a clear zonal organization. There were four parasagittal bands spanning both folia IXcd and X consisting of two rVA zones interdigitated with two rH45 zones. These findings are compared with the zonal organization of the flocculus in mammalian species.

Tracking of a bronchoscope using epipolar geometry analysis and intensity-based image registration of real and virtual endoscopic images

This paper describes a method for tracking the camera motion of a flexible endoscope, in particular a bronchoscope, using epipolar geometry analysis and intensity-based image registration. The method proposed here does not use a positional sensor attached to the endoscope. Instead, it tracks camera motion using real endoscopic (RE) video images obtained at the time of the procedure and X-ray CT images acquired before the endoscopic examination. A virtual endoscope system (VES) is used for generating virtual endoscopic (VE) images. The basic idea of this tracking method is to find the viewpoint and view direction of the VES that maximizes a similarity measure between the VE and RE images. To assist the parameter search process, camera motion is also computed directly from epipolar geometry analysis of the RE video images. The complete method consists of two steps: (a) rough estimation using epipolar geometry analysis and (b) precise estimation using intensity-based image registration. In the rough registration process, the method computes camera motion from optical flow patterns between two consecutive RE video image frames using epipolar geometry analysis. In the image registration stage, we search for the VES viewing parameters that generate the VE image that is most similar to the current RE image. The correlation coefficient and the mean square intensity difference are used for measuring image similarity. The result obtained in the rough estimation process is used for restricting the parameter search area. We applied the method to bronchoscopic video image data from three patients who had chest CT images. The method successfully tracked camera motion for about 600 consecutive frames in the best case. Visual inspection suggests that the tracking is sufficiently accurate for clinical use. Tracking results obtained by performing the method without the epipolar geometry analysis step were substantially worse. Although the method required about 20 s to process one frame, the results demonstrate the potential of image-based tracking for use in an endoscope navigation system.

Responses in extrastriate cortex to optic flow during simulated turns.

An observer locomoting along a straight path sees a pattern of optic flow in which images move approximately radially outward from his heading point. If the observer turns, the optic flow field changes markedly because each object's image now has a component of horizontal motion added to its "optic flow" motion. We tested the responses of 326 cells in the cat's extrastriate area LS (lateral suprasylvian visual area) to movies simulating the optic flow seen during locomotion in a straight line, and during various simulated turns to the left and right. About 60% of 326 cells tested responded to optic flow simulating turns. Of most interest was a subset of cells, 15% of the total, that had "turn-selective" responses. They responded significantly better to turns in a particular direction (usually to the contralateral side) than to turns in the opposite direction or to optic flow simulating straight-ahead locomotion. For each cell, we generated a display of fronto-parallel motion with a direction and speed that matched the image motion in the preferred turn movie, as seen at the receptive-field center. Most turn-selective cells responded significantly better to their preferred turn movie than to this fronto-parallel stimulus. We examined the role of cells' selectivity for stimulus direction, speed, and acceleration in determining cell preference for particular turns. Direction preference played some role for most cells, but about a third of the cells preferred turn movies that did not reflect their direction selectivity. Other factors, including the presence of opposing motion, only rarely appeared to determine cell preferences for particular turn movies.

Temporal properties of optic flow responses in the ventral intraparietal area.

The ventral intraparietal area (VIP) is located at the end of the dorsal stream. Its neurons are known to have receptive-field characteristics similar to those of MT and MST neurons, but little is known about the temporal characteristics of VIP cells' responses. How fast are directionally selective responses evoked in the ventral intraparietal area after viewing optic flow patterns, and what are the temporal properties of these neuronal responses? To examine these questions, we recorded the activity of 37 directionally selective ventral intraparietal area (VIP) neurons in two awake macaque monkeys in response to optic flow stimuli with presentation times ranging from 17 ms to 2000 ms. We found a minimum response latency of 45 ms, and a median latency of 152 ms. Of all neurons, 10% showed early response components only (response latency < 150 ms and no activity in 500-2000 ms interval after stimulus onset), 55% only late response components (response latency >150 ms and sustained activity in 500-2000 ms interval), and 35% both early and late response components. Early responses appeared to very brief stimulus presentations (33-ms duration), while the late responses required longer stimulus durations. The directional selectivity was independent of optic flow duration in all cells. These results suggest that only a subset of neurons in area VIP may contribute to the fast processing of optic flow, while showing that the temporal properties of VIP responses clearly differ from the temporal characteristics of neurons in areas MT and MST.