Second-order Motion Research Articles

Second-order motion-compensated spin echo diffusion tensor imaging of the human heart.

Myocardial microstructure has been challenging to probe in vivo. Spin echo-based diffusion-weighted sequences allow for single-shot acquisitions but are highly sensitive to cardiac motion. In this study, the use of second-order motion-compensated diffusion encoding was compared with first-order motion-compensated diffusion-weighted imaging during systolic contraction of the heart. First- and second-order motion-compensated diffusion encoding gradients were incorporated into a triggered single-shot spin echo sequence. The effect of contractile motion on the apparent diffusion coefficients and tensor orientations was investigated in vivo from basal to apical level of the heart. Second-order motion compensation was found to increase the range of systolic trigger delays from 30%-55% to 15%-77% peak systole at the apex and from 25%-50% to 15%-79% peak systole at the base. Diffusion tensor analysis yielded more physiological transmural distributions when using second-order motion-compensated diffusion tensor imaging. Higher-order motion-compensated diffusion encoding decreases the sensitivity to cardiac motion, thereby enabling cardiac DTI over a wider range of time points during systolic contraction of the heart.

Simplified Real‐Time Imaging Flow for High‐Resolution FMCW SAR

This letter considers the feasibility of a simplified real-time imaging flow theoretically for frequency-modulated continuous-wave synthetic aperture radar (FMCW SAR). The simplified imaging flow is based on the range-Doppler algorithm, whereas the simplifications contain absolving the residual-video-phase correction and performing the second-order motion compensation ahead of the range cell migration correction (RCMC). During the analysis, the platform movement within the transmission of a sweep is considered. Moreover, the hardware technique, i.e., the enhanced direct memory access, is used to improve the efficiency of the bulk RCMC. Eventually, the simplified imaging flow is evaluated in terms of quality and efficiency by using real Ku-band FMCW SAR data. The results indicate that the simplified method could produce SAR imagery of high resolution (0.25 m × 0.25 m) in real time, with a speed-up factor of 2.77 comparing with the frequency scaling algorithm.

A Kinect-based real-time compressive tracking prototype system for amphibious spherical robots.

A visual tracking system is essential as a basis for visual servoing, autonomous navigation, path planning, robot-human interaction and other robotic functions. To execute various tasks in diverse and ever-changing environments, a mobile robot requires high levels of robustness, precision, environmental adaptability and real-time performance of the visual tracking system. In keeping with the application characteristics of our amphibious spherical robot, which was proposed for flexible and economical underwater exploration in 2012, an improved RGB-D visual tracking algorithm is proposed and implemented. Given the limited power source and computational capabilities of mobile robots, compressive tracking (CT), which is the effective and efficient algorithm that was proposed in 2012, was selected as the basis of the proposed algorithm to process colour images. A Kalman filter with a second-order motion model was implemented to predict the state of the target and select candidate patches or samples for the CT tracker. In addition, a variance ratio features shift (VR-V) tracker with a Kalman estimation mechanism was used to process depth images. Using a feedback strategy, the depth tracking results were used to assist the CT tracker in updating classifier parameters at an adaptive rate. In this way, most of the deficiencies of CT, including drift and poor robustness to occlusion and high-speed target motion, were partly solved. To evaluate the proposed algorithm, a Microsoft Kinect sensor, which combines colour and infrared depth cameras, was adopted for use in a prototype of the robotic tracking system. The experimental results with various image sequences demonstrated the effectiveness, robustness and real-time performance of the tracking system.

Adaptive backstepping control of wheeled inverted pendulum with velocity estimator

In this paper, we introduce a backstepping control design of a wheeled inverted pendulum. Based on a second-order motion equation of the body angle, an adaptive integral backstepping controller is designed to stabilize the body angle. It is shown that the σ-modification rule in the adaptive update law guarantees the boundedness of the errors in estimating the time-varying signal that is an output of a linear system with every bounded input signal. Then, the stabilizing controller for the wheel angle is constructed by a PD-type positive feedback. The derived controller requires the full-state measurements. In the output feedback case, the K filter or the observer backstepping is needed. However, the structure of the controller becomes complicated. We propose a non-model-based differentiator based on the adaptive update law. Since the non-model-based differentiator does not require any knowledge of the dynamic structure of the signal, we can use it as a velocity estimator for unknown nonlinear systems. Therefore, we replaced the velocity measurement with the estimates by the non-model-based differentiator. Finally, simulation results for the proposed controller are presented.

Modelling fast forms of visual neural plasticity using a modified second-order motion energy model.

The Adelson-Bergen motion energy sensor is well established as the leading model of low-level visual motion sensing in human vision. However, the standard model cannot predict adaptation effects in motion perception. A previous paper Pavan et al.(Journal of Vision 10:1-17, 2013) presented an extension to the model which uses a first-order RC gain-control circuit (leaky integrator) to implement adaptation effects which can span many seconds, and showed that the extended model's output is consistent with psychophysical data on the classic motion after-effect. Recent psychophysical research has reported adaptation over much shorter time periods, spanning just a few hundred milliseconds. The present paper further extends the sensor model to implement rapid adaptation, by adding a second-order RC circuit which causes the sensor to require a finite amount of time to react to a sudden change in stimulation. The output of the new sensor accounts accurately for psychophysical data on rapid forms of facilitation (rapid visual motion priming, rVMP) and suppression (rapid motion after-effect, rMAE). Changes in natural scene content occur over multiple time scales, and multi-stage leaky integrators of the kind proposed here offer a computational scheme for modelling adaptation over multiple time scales.

Visual motion processing deficits in infants with the fragile X premutation.

BackgroundFragile X syndrome (FXS) results from a trinucleotide repeat expansion (full mutation >200 cytosine-guanine-guanine (CGG) repeats) in the FMR1 gene, leading to a reduction or absence of the gene’s protein product, fragile X mental retardation protein (FMRP), ultimately causing cognitive and behavioral impairments that are characteristic of the syndrome. In our previous work with infants and toddlers with FXS, we have been able to describe much about their cognitive and visual processing abilities. In light of recent work on the mild cognitive deficits and functional and structural brain differences that are present in adults with the fragile X (FX) premutation, in the present study we examined whether some of the low-level visual processing deficits we have observed in infants with FXS would also be present in infants with the FX premutation (55–200 CGG repeats).MethodsWe chose a contrast detection task using second-order motion stimuli on which infants with FXS previously showed significantly increased detection thresholds (Vision Res 48:1471–1478, 2008). Critically, we also included a developmental delay comparison group of infants with Down syndrome (DS), who were matched to infants with FXS on both chronological and mental age, to speak to the question of whether this second-order motion processing deficit is a FX-specific phenomenon.ResultsAs reported previously, infants with the FX full mutation showed motion contrast detection threshold levels that were significantly higher than age-matched typically developing control infants. Strikingly, the motion detection contrast levels of FX premutation infants were also significantly higher than typically developing (TD) infants and not significantly different from the group of infants with FXS or with DS.ConclusionsThese results, which are in keeping with a growing body of evidence on the mild cognitive and perceptual processing deficits and functional and structural brain differences that are present in adults and older children with the FX premutation, underscore the pressing need to study and describe the processing capabilities of infants and toddlers with the FX premutation.

Age-related changes in perception of movement in driving scenes.

Age-related changes in motion sensitivity have been found to relate to reductions in various indices of driving performance and safety. The aim of this study was to investigate the basis of this relationship in terms of determining which aspects of motion perception are most relevant to driving. Participants included 61 regular drivers (age range 22-87years). Visual performance was measured binocularly. Measures included visual acuity, contrast sensitivity and motion sensitivity assessed using four different approaches: (1) threshold minimum drift rate for a drifting Gabor patch, (2) Dmin from a random dot display, (3) threshold coherence from a random dot display, and (4) threshold drift rate for a second-order (contrast modulated) sinusoidal grating. Participants then completed the Hazard Perception Test (HPT) in which they were required to identify moving hazards in videos of real driving scenes, and also a Direction of Heading task (DOH) in which they identified deviations from normal lane keeping in brief videos of driving filmed from the interior of a vehicle. In bivariate correlation analyses, all motion sensitivity measures significantly declined with age. Motion coherence thresholds, and minimum drift rate threshold for the first-order stimulus (Gabor patch) both significantly predicted HPT performance even after controlling for age, visual acuity and contrast sensitivity. Bootstrap mediation analysis showed that individual differences in DOH accuracy partly explained these relationships, where those individuals with poorer motion sensitivity on the coherence and Gabor tests showed decreased ability to perceive deviations in motion in the driving videos, which related in turn to their ability to detect the moving hazards. The ability to detect subtle movements in the driving environment (as determined by the DOH task) may be an important contributor to effective hazard perception, and is associated with age, and an individuals' performance on tests of motion sensitivity. The locus of the processing deficits appears to lie in first-order, rather than second-order motion pathways.

No dedicated second-order motion system

The existence of a second-order motion system distinct from both the first-order and feature tracking motion systems remains controversial even though many consider it well established. In the present study, the texture contribution to motion was measured within and beyond the spatial acuity of attention by presenting the stimuli in the near periphery where the spatial resolution of attention is low. The logic was that when moving elements are too close one to another for attention to individually select them (i.e., crowding), it is not possible to track them. To test the existence of a dedicated second-order motion system, the texture contribution to motion was measured when neutralizing both the feature tracking motion system and the contribution of the first-order motion system due to preprocessing nonlinearities introducing residual distortion products. When the contribution of distortion products was not neutralized, texture substantially contributed to motion for spatial frequencies within and beyond the spatial acuity of attention. When neutralizing the contribution of distortion products, texture substantially contributed to motion for spatial frequencies within the spatial acuity of attention, but not for spatial frequencies beyond the spatial acuity of attention. We conclude that there is no dedicated second-order motion system; the texture contribution to motion is mediated solely by the first-order (due to residual distortion products) and feature tracking (at frequencies within spatiotemporal acuity of attention) motion systems.

No dedicated second-order motion system in the periphery

No dedicated second-order motion system in the periphery

Form and motion processing of second-order stimuli in color vision

We investigate whether there are second-order form and motion mechanisms in human color vision. Second-order stimuli are contrast modulations of a noise carrier. The contrast envelopes are static Gabors of different spatial frequencies (0.125-1 cycles/°) or drifting Gabors of different temporal frequencies (0.25 cycles/°, 0.5-4 Hz). Stimuli are isoluminant red-green or achromatic. Second-order form processing is measured using a simultaneous 2IFC (two-interval forced-choice) detection and orientation identification task, and direction identification is used for second-order motion processing. We find that for simple detection thresholds, chromatic performance is as good or better than achromatic performance, whereas for both motion and form tasks, chromatic performance is poorer than achromatic. Chromatic second-order form perception is very poor across all spatial and temporal frequencies measured and has a lowpass contrast modulation sensitivity function with a spatial cutoff of 1 cycle/° and temporal cutoff of 4 Hz. Chromatic second-order motion sensitivity is even poorer than for form and typically is limited to 1-2 Hz. To determine whether this residual motion processing might be based on feature tracking, we used the pedestal paradigm of Lu and Sperling (1995). We find that adding a static pedestal of the same spatial frequency as the drifting Gabor envelope, with its contrast set to 1-2 times its detection threshold, impairs motion direction performance for the chromatic stimuli but not the achromatic. This suggests that the motion of second-order chromatic stimuli is not processed by a second-order system but by a third-order, feature-tracking system, although a genuine second-order motion system exists for achromatic stimuli.

No second-order motion system sensitive to high temporal frequencies

It has been shown that the perception of contrast-defined motion (i.e., a second-order stimulus) at high temporal frequencies cannot be explained solely by global distortion products (i.e., luminance artifacts due to preprocessing nonlinearities) processed by the first-order system. However, previous studies rejecting the first-order pathway hypothesis have assumed that the preprocessing nonlinearities are identical for all first-order motion units. If this is not the case, then introducing a nonlinearity within the stimulus could neutralize the global (i.e., mean) distortion product but would leave residual distortion products. We neutralized either global only or both global and residual distortion products by superimposing a luminance modulation onto the contrast modulation. At a temporal frequency too high for features to be tracked (15 Hz), we found a substantial texture (i.e., contrast-modulated) contribution to motion when neutralizing only global distortion products but not when neutralizing both global and residual distortion products. Furthermore, we found that the texture contribution to motion at this high temporal frequency, when it was not completely neutralized, depended on the phase difference between luminance and contrast modulations, which implied some common processing before the motion extraction stage. We concluded that the texture contribution to motion at high temporal frequencies was due to nonuniform preprocessing nonlinearities within the visual system, enabling first-order motion units to process distortion products, and not due to a dedicated second-order motion system.

Binocular summation of second-order global motion signals in human vision

Although many studies have examined the principles governing first-order global motion perception, the mechanisms that mediate second-order global motion perception remain unresolved. This study investigated the existence, nature and extent of the binocular advantage for encoding second-order (contrast-defined) global motion. Motion coherence thresholds (79.4% correct) were assessed for determining the direction of radial, rotational and translational second-order motion trajectories as a function of local element modulation depth (contrast) under monocular and binocular viewing conditions. We found a binocular advantage for second-order global motion processing for all motion types. This advantage was mainly one of enhanced modulation sensitivity, rather than of motion-integration. However, compared to findings for first-order motion where the binocular advantage was in the region of a factor of around 1.7 (Hess et al., 2007), the binocular advantage for second-order global motion was marginal, being in the region of around 1.2. This weak enhancement in sensitivity with binocular viewing is considerably less than would be predicted by conventional models of either probability summation or neural summation.

Feature tracking and aging

There are conflicting results regarding the effect of aging on second-order motion processing (i.e., motion defined by attributes other than luminance, such as contrast). Two studies (Habak and Faubert, 2000; Tang and Zhou, 2009) found that second-order motion processing was more vulnerable to aging than first-order motion processing. Conversely, Billino et al. (2011) recently found that aging affected first- and second-order motion processing by similar proportions. These three studies used contrast-defined motion as a second-order stimulus, but there can be at least two potential issues when using such a stimulus to evaluate age-related sensitivity losses. First, it has been shown that the motion system processing contrast-defined motion varies depending on the stimulus parameters. Thus, although all these three studies assumed that their contrast-defined motion was processed by a low-level second-order motion system, this was not necessarily the case. The second potential issue is that contrast-defined motion consists in a contrast modulation of a texture rich in high spatial frequencies and aging mainly affects contrast sensitivity at high spatial frequencies. Consequently, some age-related sensitivity loss to second-order motion could be due to a lower sensitivity to the texture rather than to motion processing per se. To avoid these two potential issues, we used a second-order motion stimulus void of high spatial frequencies and which has been shown to be processed by a high-level feature tracking motion system, namely fractal rotation (Lagacé-Nadon et al., 2009). We found an age-related deficit on second-order motion processing at all temporal frequencies including the ones for which no age-related effect on first-order motion processing was observed. We conclude that aging affects the ability to track features. Previous age-related results on second-order and global motion processing are discussed in light of these findings.

P1-17: Pseudo-Haptics Using Motion-in-Depth Stimulus and Second-Order Motion Stimulus

Modification of motion of the computer cursor during the manipulation by the observer evokes illusory haptic sensation (Lecuyer et al., 2004 ACM SIGCHI '04 239–246). This study investigates the pseudo-haptics using motion-in-depth and second-order motion. A stereoscopic display and a PHANTOM were used in the first experiment. A subject was asked to move a visual target at a constant speed in horizontal, vertical, or front-back direction. During the manipulation, the speed was reduced to 50% for 500 msec. The haptic sensation was measured using the magnitude estimation method. The result indicates that perceived haptic sensation from motion-in-depth was about 30% of that from horizontal or vertical motion. A 2D display and the PHANTOM were used in the second experiment. The motion cue was second order—in each frame, dots in a square patch reverses in contrast (i.e., all black dots become white and all white dots become black). The patch was moved in a horizontal direction. The result indicates that perceiv...

No second-order motion system sensitive to high temporal frequencies

The existence of a second-order motion pathway, distinct from both the first-order luminance pathway and the high-level feature tracking motion system, remains controversial. Two key arguments support its existence: second-order motion is perceived at temporal frequencies too high to be tracked and sensitivity is independent of the relative phase between superimposed luminance- and contrast-modulated gratings. The later argument is typically used to reject the hypothesis that the contrast-modulation contribution to motion is due to early nonlinearities introducing luminance artifacts. But this argument is only valid if the nonlinearities are homogenous across luminance motion detectors; it does exclude the possibility that compressive nonlinearities precede some luminance motion detectors and expansive nonlinearities precede others. In the current study, to neutralize the impact of such opposing nonlinearities, we superimpose a luminance-modulated grating with a high contrast contrast-modulated grating so that some luminance artifacts would sum with the luminance-modulated grating and others would subtract resulting in no net gain. The gratings were drifting in the same direction at a temporal frequency too high to be tracked (15Hz) and their relative phase was systematically varied. Observers were asked to null the net perceived motion by adjusting the contrast of another luminance-modulated grating drifting in the opposite direction. The contrast-modulation contribution to motion was estimated as the contrast difference between the two opposing luminance gratings when no net motion was perceived. Results showed no effect of phase and the contrast-modulation significantly contributed to motion when the contrast of the superimposed grating was low, but not when it was high (i.e. no net motion was perceived when both luminance gratings had the same contrast). We conclude that our sensitivity to contrast-modulated motion at temporal frequencies too high to be tracked is due to early opposing nonlinearities differing across luminance motion detectors, not to a second-order motion pathway. Meeting abstract presented at VSS 2012

Interaction of first- and second-order signals in the extraction of global-motion and optic-flow

The intention of this series of experiments was to determine the extent to which the pathways sensitive to first-order and second-order motion are independent of one another at, and above, the level of global motion integration. We used translational, radial and rotational motion stimuli containing luminance-modulated dots, contrast-modulated dots, or a mixture of both. Our results show that the two classes of motion stimuli interact perceptually in a global motion coherence task, and the extent of this interaction is governed by whether the two varieties of local motion signal produce an equivalent response in the pathways that encode each type of motion. This provides strong psychophysical evidence that global motion and optic flow processing are cue-invariant. The fidelity of the first-order motion signal was moderated by either reducing the luminance of the dots or by increasing the displacement of the dots on each positional update. The experiments were carried out with two different types of second-order elements (contrast-modulated dots and flicker-modulated dots) and the results were comparable, suggesting that these findings are generalisable to a variety of second-order stimuli. In addition, the interaction between the two different types of second-order stimuli was investigated and we found that the relative modulation depth was also crucial to whether the two populations interacted. We conclude that the relative output of local motion sensors sensitive to either first-order or second-order motion dictates their weight in subsequent cue-invariant global motion computations.

Dissociation of first- and second-order motion systems by perceptual learning

Previous studies investigating transfer of perceptual learning between luminance-defined (LD) motion and texture-contrast-defined (CD) motion tasks have found little or no transfer from LD to CD motion tasks but nearly perfect transfer from CD to LD motion tasks. Here, we introduce a paradigm that yields a clean double dissociation: LD training yields no transfer to the CD task, but more interestingly, CD training yields no transfer to the LD task. Participants were trained in two variants of a global motion task. In one (LD) variant, motion was defined by tokens that differed from the background in mean luminance. In the other (CD) variant, motion was defined by tokens that had mean luminance equal to the background but differed from the background in texture contrast. The task was to judge whether the signal tokens were moving to the right or to the left. Task difficulty was varied by manipulating the proportion of tokens that moved coherently across the four frames of the stimulus display. Performance in each of the LD and CD variants of the task was measured as training proceeded. In each task, training produced substantial improvement in performance in the trained task; however, in neither case did this improvement show any significant transfer to the nontrained task.

Lobula-specific visual projection neurons are involved in perception of motion-defined second-order motion in Drosophila

A wide variety of animal species including humans and fruit flies see second-order motion although they lack coherent spatiotemporal correlations in luminance. Recent electrophysiological recordings, together with intensive psychophysical studies, are bringing to light the neural underpinnings of second-order motion perception in mammals. However, where and how the higher-order motion signals are processed in the fly brain is poorly understood. Using the rich genetic tools available in Drosophila and examining optomotor responses in fruit flies to several stimuli, we revealed that two lobula-specific visual projection neurons, specifically connecting the lobula and the central brain, are involved in the perception of motion-defined second-order motion, independent of whether the second-order feature is moving perpendicular or opposite to the local first-order motion. By contrast, blocking these neurons has no effect on first-order and flicker-defined second-order stimuli in terms of response delay. Our results suggest that visual neuropils deep in the optic lobe and the central brain, whose functional roles in motion processing were previously unclear, may be specifically required for motion-defined motion processing.

Second-Order Motion is Less Efficient at Modulating Vection Strength

Visually induced illusions of self-motion (vection) are often induced using constant velocity optic flow. However, adding simulated viewpoint jitter and oscillation to these displayscan significantly improve the vection experience (especially when this jitter/oscillation is orthogonal to the constant flow component - Nakamura, 2010; Palmisano et al., 2008). In the present experiment, we found that vection was only facilitated when luminance-, but not contrast-, defined vertical oscillatory motion was added to the constant horizontal display motion (even though observers clearly reported seeing both the oscillatory and constant display motions in both conditions). These findings demonstrate that the vection enhancement provided by simulated viewpoint oscillation is not simply based on the perceived display motion.

Advancement of motion psychophysics: Review 2001-2010

This is a survey of psychophysical studies of motion perception carried out mainly in the last 10 years. It covers a wide range of topics, including the detection and interactions of local motion signals, motion integration across various dimensions for vector computation and global motion perception, second-order motion and feature tracking, motion aftereffects, motion-induced mislocalizations, timing of motion processing, cross-attribute interactions for object motion, motion-induced blindness, and biological motion. While traditional motion research has benefited from the notion of the independent "motion processing module," recent research efforts have been also directed to aspects of motion processing in which interactions with other visual attributes play critical roles. This review tries to highlight the richness and diversity of this large research field and to clarify what has been done and what questions have been left unanswered.