Visual Self-motion Perception Research Articles

Examination of the Effect of the Real-Life Meaning of the Stimulus on the Self-Motion Illusion

Abstract Vection refers to the illusory self-motion perception mainly induced by the motion of a visual stimulus. This phenomenon concerns presence and immersion in the illusion of self-motion, especially in virtual reality. In the present study, we investigated how the real-life meaning of stimuli contributes to vection by using animations of objects that can move by themselves. In two psychophysical experiments, we first employed animated cars presented with or without wheel rotation as the visual inducer, using various motion directions and postures; then we added the road scenery, which was either moving (in the same or opposite direction to the cars) or still, as a contextual background in the visual stimulus. The results of Experiment 1 showed that in conditions with forward- and backward-moving cars, vection was stronger than in conditions with upward-moving and inverted cars. The results of Experiment 2 showed that vection was weakest in the still road scenery condition and that the cars’ wheel rotation could facilitate vection. This suggests that the more natural the stimulus meanings, the stronger the vection. It is a feasible and effective application prospect to enhance the vection experience by changing the naturalness of the stimulus to further increase the sense of presence and immersion. Therefore, the perceived naturalness and the assumed immobility of the visual inducer are two important cognitive factors in visual self-motion perception and presence in the virtual world.

Modality-specific effects of threat on self-motion perception

BackgroundThreat and individual differences in threat-processing bias perception of stimuli in the environment. Yet, their effect on perception of one’s own (body-based) self-motion in space is unknown. Here, we tested the effects of threat on self-motion perception using a multisensory motion simulator with concurrent threatening or neutral auditory stimuli.ResultsStrikingly, threat had opposite effects on vestibular and visual self-motion perception, leading to overestimation of vestibular, but underestimation of visual self-motions. Trait anxiety tended to be associated with an enhanced effect of threat on estimates of self-motion for both modalities.ConclusionsEnhanced vestibular perception under threat might stem from shared neural substrates with emotional processing, whereas diminished visual self-motion perception may indicate that a threatening stimulus diverts attention away from optic flow integration. Thus, threat induces modality-specific biases in everyday experiences of self-motion.

Four-Stroke Apparent Motion Can Effectively Induce Visual Self-Motion Perception: an Examination Using Expanding, Rotating, and Translating Motion.

The current investigation examined whether visual motion without continuous visual displacement could effectively induce self-motion perception (vection). Four-stroke apparent motions (4SAM) were employed in the experiments as visual inducers. The 4SAM pattern contained luminance-defined motion energy equivalent to the real motion pattern, and the participants perceived unidirectional motion according to the motion energy but without displacements (the visual elements flickered on the spot). The experiments revealed that the 4SAM stimulus could effectively induce vection in the horizontal, expanding, or rotational directions, although its strength was significantly weaker than that induced by the real-motion stimulus. This result suggests that visual displacement is not essential, and the luminance-defined motion energy and/or the resulting perceived motion of the visual inducer would be sufficient for inducing visual self-motion perception. Conversely, when the 4SAM and real-motion patterns were presented simultaneously, self-motion perception was mainly determined in accordance with real motion, suggesting that the real-motion stimulus is a predominant determinant of vection. These research outcomes may be worthy of considering the perceptual and neurological mechanisms underlying self-motion perception.

Self-motion illusions from distorted optic flow in multifocal glasses

SummaryProgressive addition lenses (PALs) are ophthalmic lenses to correct presbyopia by providing improvements of near and far vision in different areas of the lens, but distorting the periphery of the wearer's field of view. Distortion-related difficulties reported by PAL wearers include unnatural self-motion perception. Visual self-motion perception is guided by optic flow, the pattern of retinal motion produced by self-motion. We tested the influence of PAL distortions on optic flow-based heading estimation using a model of heading perception and a virtual reality-based psychophysical experiment. The model predicted changes of heading estimation along a vertical axis, depending on visual field size and gaze direction. Consistent with this prediction, participants experienced upwards deviations of self-motion when gaze through the periphery of the lens was simulated, but not for gaze through the center. We conclude that PALs may lead to illusions of self-motion which could be remedied by a careful gaze strategy.

Perceptual Awareness of Optic Flows Paced Optimally and Non-optimally to Walking Speed

Previous research suggests that visual processing depends strongly on locomotor activity and is tuned to optic flows consistent with self-motion speed. Here, we used a binocular rivalry paradigm to investigate whether perceptual access to optic flows depends on their optimality in relation to walking velocity. Participants walked at two different speeds on a treadmill while viewing discrepant visualizations of a virtual tunnel in each eye. We hypothesized that visualizations paced appropriately to the walking speeds will be perceived longer than non optimal (too fast/slow) ones. The presented optic flow speeds were predetermined individually in a task based on matching visual speed to both walking velocities. In addition, perceptual preference for optimal optic flows was expected to increase with proprioceptive ability to detect threshold-level changes in walking speed. Whereas faster (more familiar) optic flows showed enhanced access to awareness during faster compared with slower walking conditions, for slower visual flows, only a nonsignificant tendency for the analogous effect was observed. These effects were not dependent on individual proprioceptive sensitivity. Our findings concur with the emerging view that the velocity of one's locomotion is used to calibrate visual perception of self-motion and extend the scope of reported action effects on visual awareness.

Effects of stereopsis on vection, presence and cybersickness in head-mounted display (HMD) virtual reality

Stereopsis provides critical information for the spatial visual perception of object form and motion. We used virtual reality as a tool to understand the role of global stereopsis in the visual perception of self-motion and spatial presence using virtual environments experienced through head-mounted displays (HMDs). Participants viewed radially expanding optic flow simulating different speeds of self-motion in depth, which generated the illusion of self-motion in depth (i.e., linear vection). Displays were viewed with the head either stationary (passive radial flow) or laterally swaying to the beat of a metronome (active conditions). Multisensory conflict was imposed in active conditions by presenting displays that either: (i) compensated for head movement (active compensation condition), or (ii) presented pure radial flow with no compensation during head movement (active no compensation condition). In Experiment 1, impairing stereopsis by anisometropic suppression in healthy participants generated declines in reported vection strength, spatial presence and severity of cybersickness. In Experiment 2, vection and presence ratings were compared between participants with and without clinically-defined global stereopsis. Participants without global stereopsis generated impaired vection and presence similarly to those found in Experiment 1 by subjects with induced stereopsis impairment. We find that reducing global stereopsis can have benefits of reducing cybersickness, but has adverse effects on aspects of self-motion perception in HMD VR.

Orientation-defined visual rotation significantly affects observer's perceived self-motion

It is believed that visual self-motion perception (vection) can be effectively induced only in the case where the inducer's motion is defined by luminance modulation. In this study, psychophysical experiments examining the potential effects of visual motion defined by features other than luminance on visual self-motion perception (vection) were conducted, employing orientation-defined rotation (so-called fractal rotation) as a visual inducer. The experiments clearly indicate that orientation-defined visual rotation can strongly induce an observer's perceived self-rotation (roll vection), although it was significantly weaker than that induced by luminance-defined rotation. In the case where the orientation and luminance rotations were combined and presented simultaneously, perceived self-rotation was mainly determined by the luminance rotation when both factors were set to rotate in consistent or inconsistent directions. These results suggest that feature-defined visual motion containing no luminance modulation has the potential to contribute to visual self-motion perception.

Different EEG brain activity in right and left handers during visually induced self-motion perception

Visually induced self-motion perception (vection) relies on visual–vestibular interaction. Imaging studies using vestibular stimulation have revealed a vestibular thalamo-cortical dominance in the right hemisphere in right handers and the left hemisphere in left handers. We investigated if the behavioural characteristics and neural correlates of vection differ between healthy left and right-handed individuals. 64-channel EEG was recorded while 25 right handers and 25 left handers were exposed to vection-compatible roll motion (coherent motion) and a matched, control condition (incoherent motion). Behavioural characteristics, i.e. vection presence, onset latency, duration and subjective strength, were also recorded. The behavioural characteristics of vection did not differ between left and right handers (all p > 0.05). Fast Fourier Transform (FFT) analysis revealed significant decreases in alpha power during vection–compatible roll motion (p < 0.05). The topography of this decrease was handedness-dependent, with left handers showing a left lateralized centro-parietal decrease and right handers showing a bilateral midline centro-parietal decrease. Further time–frequency analysis, time locked to vection onset, revealed a comparable decrease in alpha power around vection onset and a relative increase in alpha power during ongoing vection, for left and right handers. No effects were observed in theta and beta bands. Left and right-handed individuals show vection-related alpha power decreases at different topographical regions, possibly related to the influence of handedness-dependent vestibular dominance in the visual–vestibular interaction that facilitates visual self-motion perception. Despite this difference in where vection-related activity is observed, left and right handers demonstrate comparable perception and underlying alpha band changes during vection.

Visual self-motion cues are impaired yet overweighted during visual-vestibular integration in Parkinson's disease.

Parkinson’s disease is prototypically a movement disorder. Although perceptual and motor functions are highly interdependent, much less is known about perceptual deficits in Parkinson’s disease, which are less observable by nature, and might go unnoticed if not tested directly. It is therefore imperative to seek and identify these, to fully understand the challenges facing patients with Parkinson’s disease. Also, perceptual deficits may be related to motor symptoms. Posture, gait and balance, affected in Parkinson’s disease, rely on veridical perception of one’s own motion (self-motion) in space. Yet it is not known whether self-motion perception is impaired in Parkinson’s disease. Using a well-established multisensory paradigm of heading discrimination (that has not been previously applied to Parkinson’s disease), we tested unisensory visual and vestibular self-motion perception, as well as multisensory integration of visual and vestibular cues, in 19 Parkinson’s disease, 23 healthy age-matched and 20 healthy young-adult participants. After experiencing vestibular (on a motion platform), visual (optic flow) or multisensory (combined visual–vestibular) self-motion stimuli at various headings, participants reported whether their perceived heading was to the right or left of straight ahead. Parkinson’s disease participants and age-matched controls were tested twice (Parkinson’s disease participants on and off medication). Parkinson’s disease participants demonstrated significantly impaired visual self-motion perception compared with age-matched controls on both visits, irrespective of medication status. Young controls performed slightly (but not significantly) better than age-matched controls and significantly better than the Parkinson’s disease group. The visual self-motion perception impairment in Parkinson’s disease correlated significantly with clinical disease severity. By contrast, vestibular performance was unimpaired in Parkinson’s disease. Remarkably, despite impaired visual self-motion perception, Parkinson’s disease participants significantly overweighted the visual cues during multisensory (visual–vestibular ) integration (compared with Bayesian predictions of optimal integration) and significantly more than controls. These findings indicate that self-motion perception in Parkinson’s disease is affected by impaired visual cues and by suboptimal visual–vestibular integration (overweighting of visual cues). Notably, vestibular self-motion perception was unimpaired. Thus, visual self-motion perception is specifically impaired in early-stage Parkinson’s disease. This can impact Parkinson’s disease diagnosis and subtyping. Overweighting of visual cues could reflect a general multisensory integration deficit in Parkinson’s disease, or specific overestimation of visual cue reliability. Finally, impaired self-motion perception in Parkinson’s disease may contribute to impaired balance and gait control. Future investigation into this connection might open up new avenues of alternative therapies to better treat these difficult symptoms.

Perceived Rigidity Significantly Affects Visually Induced Self-Motion Perception (Vection).

When an observer sees a uniformly moving visual stimulus, he or she typically perceives an illusory motion of his or her body in the opposite direction (vection). In this study, the effects of the visual inducer's perceived rigidity were examined using a horizontal sine wave-like line stimulus moving horizontally. Lowering the sine wave amplitude resulted in the perception of a less rigid visual stimulus motion, although the stimulus was always set to move completely rigidly. The psychophysical experiment revealed that visual self-motion perception was weaker in the lower amplitude condition where the visual stimulus was perceived as less rigid. The follow-up experiments showed that the effects of sine wave amplitude manipulation were unrelated to the modulation of the perceived speed. Furthermore, small gaps inserted into the sine waves effectively increased the perceived rigidity and resulted in a strong self-motion perception even in the lower amplitude condition. The current investigation, together with previous studies, clearly demonstrated that perceived features, in addition to the physical ones, play a key role in visual self-motion perception. Visual stimuli, perceived as more rigid, provide a more reliable frame of reference in the observers' spatial orientation, determining their self-motion perception.

The contribution of viewpoint oscillations to the perception of distance travelled from optic flow

When exploring their environment, humans and other animals have the ability to use many sources of information to estimate the distance they travel. Several studies have shown that optic flow is a significant cue to perceive distance travelled. Furthermore, it was found that adding various viewpoint oscillations to a purely translational optic flow, simulating forward self-motion, modulated this perception. In a series of experiments, we tested whether the perception of distance travelled was also affected by viewpoint oscillation, similar to head motion during natural walking. A first series of experiments, participants were exposed to an immersive optic flow simulating forward self-motion and they were asked to indicate when they thought they had reached the remembered position of a previously seen target. The main conclusion from these experiments is that viewpoint oscillations improve the perception of distance travelled. Moreover, this effect appears to be linked to an increase in global retinal motion. However, the contribution cannot be ruled out. Manipulating different viewpoint oscillation frequencies showed that the optimal performance was observed for a range of frequencies close to that observed for the head motion during natural walking. Two further experiments aimed to test whether the idiosyncrasy of viewpoint oscillations affects the perception of distance travelled in stationary observers and whether the absence of their own viewpoint oscillation played an important role in subjects' estimates, while they were walking on a treadmill. And finally, in a last experiment we tried to develop a dynamic measure of distance travelled to a previously seen target, with a continuous pointing task method. Overall, our results show that viewpoint oscillations play an important role in visual self-motion perception and that several parameters (including visual information, proprioceptive information and ecological aspects of natural walking) seem to be involved in this process.

Visual perception of self-motion: the contribution of viewpoint oscillations to the perception of distance travelled

Visual perception of self-motion: the contribution of viewpoint oscillations to the perception of distance travelled

An Illusory Contour Can Facilitate Visually Induced Self-Motion Perception.

Uniform motion of a visual stimulus induces an illusory perception of the observer's self-body moving in the opposite direction (vection). The present study investigated whether vertical illusory contours can affect horizontal translational vection using abutting-line stimulus. The stimulus consisted of a number of horizontal line segments that moved horizontally at a constant speed. A group of vertically aligned segments created a 'striped column', while line segments in adjoining columns were shifted vertically to make a slight gap between them. In the illusory contour condition, the end points of the segments within the column were horizontally aligned to generate vertical illusory contours. In the condition with no illusory contour, these end points were not aligned within the column so that the illusory contour was not perceived. In the current study, 11 participants performed this experiment, and it was shown that stronger vection was induced in the illusory contour condition than in the condition with no illusory contour. The results of the current experiment provide novel evidence suggesting that non-luminance-defined visual features have a facilitative effect on visual self-motion perception.

Stereoscopic advantages for vection induced by radial, circular, and spiral optic flows.

Although observer motions project different patterns of optic flow to our left and right eyes, there has been surprisingly little research into potential stereoscopic contributions to self-motion perception. This study investigated whether visually induced illusory self-motion (i.e., vection) is influenced by the addition of consistent stereoscopic information to radial, circular, and spiral (i.e., combined radial + circular) patterns of optic flow. Stereoscopic vection advantages were found for radial and spiral (but not circular) flows when monocular motion signals were strong. Under these conditions, stereoscopic benefits were greater for spiral flow than for radial flow. These effects can be explained by differences in the motion aftereffects generated by these displays, which suggest that the circular motion component in spiral flow selectively reduced adaptation to stereoscopic motion-in-depth. Stereoscopic vection advantages were not observed for circular flow when monocular motion signals were strong, but emerged when monocular motion signals were weakened. These findings show that stereoscopic information can contribute to visual self-motion perception in multiple ways.

Display Lag and Gain Effects on Vection Experienced by Active Observers

This study examined the effects of display lag and gain on visual self-motion perception (i.e., vection) in active observers. Our subjects viewed displays simulating self-motion in depth while physically oscillating their heads from side to side at approximately 1 Hz. Their horizontal head movements were recorded and incorporated into self-motion displays with four levels of added lag (0, 50, 100,and 200 ms; baseline system lag was 113 ms) and three levels of gain (i.e., subjects' head movements were either not incorporated into the display or were incorporated at either the same or twice the amplitude). At the end of each trial, subjects rated the strength of their perceived self-motion in depth. While increasing display lag above baseline by an additional 50 ms impaired vection strength ratings, increasing display lag beyond this level eventually improved vection. For example, 200 ms added display lag produced vection strength ratings that were similar to those found with the baseline lag. As expected, larger simulated display gains were shown to improve vection strength ratings regardless of the level of added display lag. We conclude that increasing display lag during active head oscillation only impairs vection until the resulting sensory conflict becomes too great to tolerate. Beyond this critical level of lag, the visual system appears to override or downplay such sensory conflicts.

The Influence of Visual Perception of Self-Motion on Locomotor Adaptation to Unilateral Limb Loading

ABSTRACT Self-perception of motion through visual stimulation may be important for adapting to locomotor conditions. Unilateral limb loading is a locomotor condition that can improve stability and reduce abnormal limb movement. In the present study, the authors investigated the effect of self-perception of motion through virtual reality (VR) on adaptation to unilateral limb loading. Healthy young adults, assigned to either a VR or a non-VR group, walked on a treadmill in the following 3 locomotor task periods—no load, loaded, and load removed. Subjects in the VR group viewed a virtual corridor during treadmill walking. Exposure to VR reduced cadence and muscle activity. During the loaded period, the swing time of the unloaded limb showed a larger increase in the VR group. When the load was removed, the swing time of the previously loaded limb and the stance time of the previously unloaded limb showed larger decrease and the swing time of the previously unloaded limb showed a smaller increase in the VR group. Lack of visual cues may cause the adoption of cautious strategies (higher muscle activity, shorter and more frequent steps, changes in the swing and stance times) when faced with situations that require adaptations. VR technology, providing such perceptual cues, has an important role in enhancing locomotor adaptation.

Vection in Depth during Consistent and Inconsistent Multisensory Stimulation

We examined vection induced during physical or simulated head oscillation along either the horizontal or depth axis. In the first two experiments, during active conditions, subjects viewed radial-flow displays which simulated viewpoint oscillation that was either in-phase or out-of-phase with their own tracked head movements. In passive conditions, stationary subjects viewed playbacks of displays generated in earlier active conditions. A third control, experiment was also conducted where physical and simulated fore-aft oscillation was added to a lamellar flow display. Consistent with ecology, when active in-phase horizontal oscillation was added to a radial-flow display it modestly improved vection compared to active out-of-phase and passive conditions. However, when active fore-aft head movements were added to either a radial-flow or a lamellar-flow display, both in-phase and out-of-phase conditions produced very similar vection. Our research shows that consistent multisensory input can enhance the visual perception of self-motion in some situations. However, it is clear that multisensory stimulation does not have to be consistent (i.e., ecological) to generate compelling vection in depth.

Multimodal representation of optic flow in area PEc of macaque monkey

The visual perception of self-motion is mainly provided by optic flow. Eyes usually scan the environment during locomotion, and the gaze is not always directed to the focus of expansion (FOE) of the flow field. Such eye movements change the retinal FOE position with respect to the fovea. Here, we assess if optic flow selective neurons in parietal area PEc are modulated by eye position. We recorded single neuron activity during radial optic flow stimulation in two monkeys, varying eye and retinal FOE positions. We found that the majority of PEc neurons are modulated by the FOE retinotopic position with different tuning for expansion and contraction. Although many neurons did not show any gaze field without visual stimulation, the eye position modulated optic flow responses in about half of the cells. These novel results suggest that PEc neurons integrate both visual and eye position signals, and allow us to hypothesize their role in guiding locomotion as a part of a cortical network involved in FOE representation during self-motion. Visual and eye position interaction in this area could be seen as a contribution to the building of the invariant space representation necessary to motor planning.

Vertical Display Oscillation Effects on Forward Vection and Simulator Sickness

The current study investigated the effects that vertical display oscillation had on the development of both vection and simulator sickness. There were 16 subjects who were exposed to optic flow displays which simulated either: 1) constant velocity forward self-motion (pure radial flow); or 2) combined constant velocity forward and vertically oscillating self-motion (radial flow with vertical oscillation at one of three frequencies: 1.8, 3.7, or 7.4 Hz). During each 10-min display exposure, subjects rated the strength of their vection and eight symptoms listed on the Subjective Symptoms of Motion Sickness (SSMS) scale at 2-min intervals. Subjects also completed the Simulator Sickness Questionnaire (SSQ) designed by Kennedy and colleagues before and after each trial, which generated a total SSQ score and three SSQ subscores (nausea, oculomotor symptoms, and disorientation). Vertically oscillating displays (mean = 5.51; SD = 2.5) were found to produce significantly stronger vection ratings than non-oscillating displays (mean = 3.56; SD = 2.1). Vertically oscillating displays (mean = 58.18; SD = 32.2) were also found to produce significantly more severe sickness (as rated by total SSQ scores) than non-oscillating displays (mean = 29.67; SD = 24.7). Both vection and sickness symptoms increased in magnitude with prolonged exposure to optic flow. Our findings appear to represent a special case in visual self-motion perception where high-frequency vertical oscillation both enhances vection and increases simulator sickness when it is incorporated into an optic flow display simulating constant velocity self-motion in depth.

Cerebral Correlates of the Activation of the Cardiovascular Autonomic Nervous System – An FDG-PET Study

Background: Visual self-motion perception is induced by large-field visual motion stimulation (circular vection, CV). The stationary observer perceives the surroundings as being stable and himself as being moved. This stimulus provides profound activation, in particular, of the sympathetic nervous system (arousal reaction) Our fluorodeoxyglucose (FDG)-PET study focused on those brain areas that are involved in the processing of autonomic changes during CV. Correlation analyses were performed between metabolic effects and autonomic parameters during visual motion stimulation. Methods: FDG-PET (Siemens, Germany) was performed in 14 healthy subjects (8 male, 7 female; mean age 29.5 years) during CV induced by a computer-animated coherent dot pattern moving clockwise, or a random dot pattern of the same size. Correlation analyses with different parameters for autonomic cardiovascular control (blood pressure, heart rate variability, blood pressure and plasma catecholamines) were performed with the SPM99b software (threshold for significant activation was set at p<0.001, uncorrected). Results: Significant positive correlations were found between the high frequency spectrum of heart rate variability and activations in the anterior cingulate gyrus (BA 6) and nucleus caudatus.. Low frequency heart rate variability correlates either with activations in the anterior cingulate and the amygdala bilaterally. Deactivation in the caudate nucleus significantly correlated to frequency changes of heart rate and levels of plasma catecholamines. Conclusion: Our study showed that arousal reaction activates and deactivates a network of „autonomic“ brain areas. Obviously the limbic cortex and the basal ganglia are the most important to control cardiovascular function.