Stationary Visual Scene Research Articles

Influence of Visual Feedback on Roll Tilt Perceptual Training.

We hypothesized that the addition of visual feedback during roll tilt perceptual training would yield a significant reduction in vestibular perceptual thresholds relative to a control group. We previously showed that roll tilt vestibular thresholds could be improved through a perceptual training protocol that used a simple auditory cue. Variability in training outcomes within the treatment group suggested that an auditory cue alone may be suboptimal for improving self-motion perception. In 10 healthy adults, roll tilt vestibular thresholds, quantifying the smallest motion that can be reliably perceived, were measured before ("pretraining") and after ("posttraining") a training protocol designed to improve roll tilt perception. The protocol included 1,300 trials of 0.5 Hz whole-body roll tilt over 5 days, with participants being given both an auditory cue ("correct' vs. "incorrect') and visual feedback (viewing a stationary visual scene) after indicating their perceived direction of tilt. A control group (N = 10) underwent only the "pretraining" and "posttraining" assessments. The training group showed an average decrease in roll tilt vestibular thresholds of 1.7% ± 56%, with training outcomes varying widely. Three individuals showed an average increase in roll tilt thresholds of 69.7%, whereas the remaining seven adults showed an average decrease in thresholds of 32.3%. These data show that visual feedback during roll tilt perceptual training leads to heterogenous outcomes, but in a subset of individuals, it may lead to improvements in perceptual precision. Additional work is needed to define the optimal training parameters, including feedback schema, before investigating potential clinical applications.

Categorical encoding of moving colors during location tracking.

Categorical perception (CP) describes our tendency to perceive the visual world in a categorical manner, suggesting that high-level cognition may affect perception. While most studies are conducted in static visual scenes, Sun and colleagues found CP effects of color in multiple object tracking (MOT). This study used functional magnetic resonance imaging to investigate the neural mechanism behind the categorical effects of color in MOT. Categorical effects were associated with activities in a broad range of brain regions, including both the ventral (V4, middle temporal gyrus) and dorsal pathways (MT + /V5, inferior parietal lobule) of feature processing, as well as frontal regions (middle frontal gyrus, medial superior frontal gyrus). We proposed that these regions are hierarchically organized and responsible for distinct functions. The color-selective V4 encodes color categories, making cross-category colors more discriminable than within-category colors. Meanwhile, the language and/or semantic regions encode the verbal information of the colors. Both visual and nonvisual codes of color categories then modulate the activities of motion-sensitive MT + areas and frontal areas responsible for attentional processes.

Visual Modulation of Human Responses to Support Surface Translation.

Vision is known to improve human postural responses to external perturbations. This study investigates the role of vision for the responses to continuous pseudorandom support surface translations in the body sagittal plane in three visual conditions: with the eyes closed (EC), in stroboscopic illumination (EO/SI; only visual position information) and with eyes open in continuous illumination (EO/CI; position and velocity information) with the room as static visual scene (or the interior of a moving cabin, in some of the trials). In the frequency spectrum of the translation stimulus we distinguished on the basis of the response patterns between a low-frequency, mid-frequency, and high-frequency range (LFR: 0.0165-0.14 Hz; MFR: 0.15–0.57 Hz; HFR: 0.58–2.46 Hz). With EC, subjects’ mean sway response gain was very low in the LFR. On average it increased with EO/SI (although not to a significant degree p = 0.078) and more so with EO/CI (p < 10−6). In contrast, the average gain in the MFR decreased from EC to EO/SI (although not to a significant degree, p = 0.548) and further to EO/CI (p = 0.0002). In the HFR, all three visual conditions produced, similarly, high gain levels. A single inverted pendulum (SIP) model controlling center of mass (COM) balancing about the ankle joints formally described the EC response as being strongly shaped by a resonance phenomenon arising primarily from the control’s proprioceptive feedback loop. The effect of adding visual information in these simulations lies in a reduction of the resonance, similar as in the experiments. Extending the model to a double inverted pendulum (DIP) suggested in addition a biomechanical damping effective from trunk sway in the hip joints on the resonance.

Intensified visual clutter induces increased sympathetic signalling, poorer postural control, and faster torsional eye movements during visual rotation

Many dizzy patients express a hypersensitivity to visual motion and clutter. This study aims to investigate how exposure to rotating visual clutter affects ocular torsion, vertical skewing, body-sway, the autonomic pupillary response, and the subjective feeling of discomfort to the stimulation. Sixteen healthy subjects were exposed to 20 seconds rotational visual stimulation (72 deg/s; 50 deg visual field). Visual stimuli were comprised of black lines on a white background, presented at low and high intensity levels of visual clutter, holding 19 lines and 38 lines respectively. Ocular torsion and vertical skewing were recorded using the Chronos Eye Tracker, which also measured pupil size as a reflection of the autonomic response. Postural control was evaluated by measuring body-sway area on the Wii Balance Board. Values were compared to data retrieved 20 seconds before and after the optokinetic stimulation, as subjects viewed the stationary visual scene. The high intensity stimulus resulted in significantly higher torsional velocities. Subjects who were exposed to low intensity first exhibited higher velocities for both intensities. Both pupil size and body sway increased for the higher intensity to both the moving and stationary visual scene, and were positively correlated to torsional velocity. In conclusion, exposure to visual clutter was reflected in the eye movement response, changes in postural control, and the autonomic response. This response may hold clinical utility when assessing patients suffering from visual motion hypersensitivity, while also providing some context as to why some healthy people feel discomfort in visually cluttered surroundings.

Tracking within-category colors is easier: Color categories modulate location processing in a dynamic visual task

The categorical perception (CP) of color describes the phenomenon that colors across categories (e.g., blue and green) are more discriminable than within-category colors (e.g., green) even when the perceptual distance is controlled. While most studies are conducted in a static visual scene, the current study investigated the effect of color categories when tracking multiple colored objects within two experiments. The targets or distractors were either from the same color category or from two different categories, and the perceptual distance was controlled across all conditions. We found that location tracking was facilitated when the targets or the distractors shared the same color category in the tracking task, which required location tracking and color memorization at the same time, compared with when they were from two different categories (Experiment 1). By contrast, when location tracking was the sole demand and no explicit color processing was required, the target CP effects, but not the distractor CP effects, persisted (Experiment 2). We conclude that color categories can dynamically modulate preattention visual processing when color working memory is involved, but that attention is necessary to produce CP effects when color is irrelevant to the task.

Modeling the Triggering of Saccades, Microsaccades, and Saccadic Intrusions.

When we explore a static visual scene, our eyes move in a sequence of fast eye movements called saccades, which are separated by fixation periods of relative eye stability. Based on uncertain sensory and cognitive inputs, the oculomotor system must decide, at every moment, whether to initiate a saccade or to remain in the fixation state. Even when we attempt to maintain our gaze on a small spot, small saccades, called microsaccades, intrude on fixation once or twice per second. Because microsaccades occur at the boundary of the decision to maintain fixation versus starting a saccade, they offer a unique opportunity to study the mechanisms that control saccadic triggering. Abnormal saccadic intrusions can occur during attempted fixation in patients with neurodegenerative disorders. We have implemented a model of the triggering mechanism of saccades, based on known anatomy and physiology, that successfully simulates the generation of saccades of any size—including microsaccades in healthy observers, and the saccadic intrusions that interrupt attempted fixation in parkinsonian patients. The model suggests that noisy neuronal activity in the superior colliculus controls the state of a mutually inhibitory network in the brain stem formed by burst neurons and omnipause neurons. When the neuronal activity is centered at the rostral pole, the system remains at a state of fixation. When activity is perturbed away from this center, a saccade is triggered. This perturbation can be produced either by the intent to move one’s gaze or by random fluctuations in activity.

Head-Eye Coordination at a Microscopic Scale

Humans explore static visual scenes by alternating rapid eye movements (saccades) with periods of slow and incessant eye drifts [1-3]. These drifts are commonly believed to be the consequence of physiological limits in maintaining steady gaze, resulting in Brownian-like trajectories [4-7], which are almost independent in the two eyes [8-10]. However, because of the technical difficulty of recording minute eye movements, most knowledge on ocular drift comes from artificial laboratory conditions, in which the head of the observer is strictly immobilized. Little is known about eye drift during natural head-free fixation, when microscopic head movements are also continually present [11-13]. We have recently observed that the power spectrum of the visual input to the retina during ocular drift is largely unaffected by fixational head movements [14]. Here we elucidate the mechanism responsible for this invariance. We show that, contrary to common assumption, ocular drift does not move the eyes randomly, but compensates for microscopic head movements, thereby yielding highly correlated movements in the two eyes. This compensatory behavior is extremely fast, persists with one eye patched, and results in image motion trajectories that are only partially correlated on the two retinas. These findings challenge established views of how humans acquire visual information. They show that ocular drift is precisely controlled, as long speculated [15], and imply the existence of neural mechanisms that integrate minute multimodal signals.

Effects of visual focus and gait speed on walking balance in the frontal plane

We investigated how head position and gait speed influenced frontal plane balance responses to external perturbations during gait. Thirteen healthy participants walked on a treadmill at three different gait speeds. Visual conditions included either focus downward on lower extremities and walking surface only or focus forward on a stationary scene with horizontal and vertical lines. The treadmill was positioned on a platform that was stationary (non-perturbed) or moving in a pattern that appeared random to the subjects (perturbed). In non-perturbed walking, medial–lateral upper body motion was very similar between visual conditions. However, in perturbed walking, there was significantly less body motion when focus was on the stationary visual scene, suggesting visual feedback of stationary vertical and horizontal cues are particularly important when balance is challenged. Sensitivity of body motion to perturbations was significantly decreased by increasing gait speed, suggesting that faster walking was less sensitive to frontal plane perturbations. Finally, our use of external perturbations supported the idea that certain differences in balance control mechanisms can only be detected in more challenging situations, which is an important consideration for approaches to investigating sensory contribution to balance during gait.

Thresholds for Human Perception of Roll Tilt Motion

Visual and vestibular cues provide complementary information about spatial orientation. A previous study we performed showed that visual and vestibular cues are fused when the brain judges the roll-tilt direction. However, it was unclear if the motion perception threshold measured in visual-vestibular conditions will be better than visual or vestibular thresholds at high frequencies. An innovative method of vestibular evaluation, the measurement of vestibular thresholds, was used. We used a Moog mobile platform with dedicated software. Four subjects were tested at 1, 2, 3, 4, and 5 Hz with adaptively decreasing amplitude. Subjects were asked to indicate the direction of motion in three conditions: vestibular only, subjects roll tilted in the dark; visual only, a visual scene was tilted in front of the subjects; and combined visual + vestibular, subjects rotated while watching a stationary visual scene. For each subject, we calculated the percentage difference between the threshold for combined visual/vestibular stimuli and the best of either the vestibular or visual threshold. Visual and vestibular thresholds significantly differed in function of frequency. Vestibular and visual thresholds at different frequencies are significantly different, which support the fact that they use different perception pathways. The brain may determine the body motion in space during roll tilt motion by integration of vestibular and visual inputs: the combined estimate of motion is better than the vestibular input and is not significantly better than the visual cues alone. This research may be useful in the workup of vertiginous disorders with impaired integration of vestibular and visual cues (motion sickness and migraine dizziness).

Eye movements reveal the dynamic simulation of speed in language.

This study investigates how speed of motion is processed in language. In three eye-tracking experiments, participants were presented with visual scenes and spoken sentences describing fast or slow events (e.g., The lion ambled/dashed to the balloon). Results showed that looking time to relevant objects in the visual scene was affected by the speed of verb of the sentence, speaking rate, and configuration of a supporting visual scene. The results provide novel evidence for the mental simulation of speed in language and show that internal dynamic simulations can be played out via eye movements toward a static visual scene.

Contribution of visual velocity and displacement cues to human balancing of support surface tilt

Vision helps humans in controlling bipedal stance, interacting mainly with vestibular and proprioceptive cues. This study investigates how postural compensation of support surface tilt is compromised by selectively reducing visual velocity cues by stroboscopic illumination of a stationary visual scene. Healthy adult subjects were presented with pseudorandom tilt sequences in the sagittal plane (tilt frequency range 0.017-2.2Hz; velocity amplitude spectrum constant up to a frequency of 0.6Hz, angular displacement amplitude spectrum increasing with decreasing frequencies). Center of mass (COM) sway responses were recorded for stroboscopic illuminations at 48, 32, 16, 8, and 4Hz, as well as under continuous illumination and with eyes closed. With strobe duration (5ms) and mean luminance (1lx) kept constant, visual acuity and perceived brightness remained constant and the visual scene was perceived as stationary. Yet, tilt-evoked COM excursions increased with decreasing strobe frequency in a graded way, with largest effects occurring at tilt frequencies where large tilt velocities coincided with small displacements. In addition, COM excursions were reduced at the lowest strobe frequency compared to eyes closed, with the largest effect occurring at tilt frequencies where tilt displacements were large. We conclude that two mechanisms exist, a velocity mechanism that deals with tilt compensation and is foremost affected by the stroboscopic illumination and a displacement mechanism. This compares favorably to previous findings that, transferred to a stance control model, suggest a velocity mechanism for tilt compensation and a position mechanism for gravity compensation.

Visual search in hunting archerfish shares all hallmarks of human performance

Archerfish are renowned for shooting down aerial prey with water jets, but nothing is known about how they spot prey items in their richly structured mangrove habitats. We trained archerfish to stably assign the categories 'target' and 'background' to objects solely on the basis of non-motion cues. Unlike many other hunters, archerfish are able to discriminate a target from its background in the complete absence of either self-motion or relative motion parallax cues and without using stored information about the structure of the background. This allowed us to perform matched tests to compare the ways fish and humans scan stationary visual scenes. In humans, visual search is seen as a doorway to cortical mechanisms of how attention is allocated. Fish lack a cortex and we therefore wondered whether archerfish would differ from humans in how they scan a stationary visual scene. Our matched tests failed to disclose any differences in the dependence of response time distributions, a most sensitive indicator of the search mechanism, on number and complexity of background objects. Median and range of response times depended linearly on the number of background objects and the corresponding effective processing time per item increased similarly - approximately fourfold - in both humans and fish when the task was harder. Archerfish, like humans, also systematically scanned the scenery, starting with the closest object. Taken together, benchmark visual search tasks failed to disclose any difference between archerfish - who lack a cortex - and humans.

Supporting Change Detection in Complex Dynamic Situations: Does the CHEX Serve its Purpose?

Change detection is required in monitoring and managing complex situations such as air traffic control. Considering that change blindness—the incapacity to detect changes in a visual scene—is a considerable source of human errors and that most studies on change detection have involved static visual scenes, it is crucial to evaluate existing tools designed to help this cognitive function in complex dynamic situations. The goal of the present study was to determine the efficacy of the Change History Explicit (CHEX)—a tool already proven effective when explicit change detection is the only task to execute—when change detection is implicit and intrinsic to a more complex task. Results revealed that the CHEX failed to improve implicit change detection when this task was embedded in a threat-evaluation and weapon-assignment (TEWA) task. Moreover, TEWA performance was hindered and mental workload was perceived as higher when the CHEX was available. Even when the information load imposed by the CHEX was reduced, the tool remained ineffective. This suggests that the nature of the change detection task should be taken into account when designing a decision support system.

Comparison of different protocols for the quantification of trunk kinematics and dynamics in controlled conditions

We investigated how head position and gait speed influenced frontal plane balance responses to external perturbations during gait. Thirteen healthy participants walked on a treadmill at three different gait speeds. Visual conditions included either focus downward on lower extremities and walking surface only or focus forward on a stationary scene with horizontal and vertical lines. The treadmill was positioned on a platform that was stationary (non-perturbed) or moving in a pattern that appeared random to the subjects (perturbed). In non-perturbed walking, medial–lateral upper body motion was very similar between visual conditions. However, in perturbed walking, there was significantly less body motion when focus was on the stationary visual scene, suggesting visual feedback of stationary vertical and horizontal cues are particularly important when balance is challenged. Sensitivity of body motion to perturbations was significantly decreased by increasing gait speed, suggesting that faster walking was less sensitive to frontal plane perturbations. Finally, our use of external perturbations supported the idea that certain differences in balance control mechanisms can only be detected in more challenging situations, which is an important consideration for approaches to investigating sensory contribution to balance during gait.

Distance modulated neuronal activity in the cortical visual areas of cats

During previous studies in cats and monkeys, it was found that in some neurons, responses to visual stimuli of the same angular size were dependent on the absolute distance to these stimuli. To study how widely this peculiarity of visual responses is distributed among cortical visual areas, we recorded activity of neurons in areas V4A, V2, V1, and frontal visual area on the lower bank of the cruciate sulcus. Neuronal activity was recorded at near (20cm) or far (3m) distances from a 3D stationary visual scene. Visual scenes were vertically corrugated light gray screens. Angular dimensions of the screens were the same at short and far distances. Eye movements were free during the test procedure. It was found that about 20% of neurons in areas V4A, V1, and frontal visual area had significantly different levels of activity, while animals were looking at the visual scenes located near or far from the eyes. No neurons with depth modulated activity were found in area V2.

Neuronal Responses during and after the Presentation of Static Visual Stimuli in Macaque Primary Visual Cortex

Viewing static visual scenes for several seconds or longer can induce a wide variety of striking percepts, including negative afterimages, fading, and motion aftereffects. To characterize the neuronal bases of such phenomena and elucidate functional circuitry in the visual system, we recorded responses of neurons in primary visual cortex (V1) of anesthetized macaques during and after the presentation of prolonged static visual stimuli. We found that 72% of cells generated significant after-responses (ARs) that outlasted classical off-transients after the cessation of stimuli, and AR amplitude grew with stimulus duration. After the longest stimuli tested (32 s), the amplitude and the time course of the AR were on average comparable to, and correlated with, those of the maintained response evoked while stimuli were present. These observations generally held regardless of cell class: simple, complex, direction selective (DS) or non-DS. The average decay time constant of the AR for orientation-tuned cells was 0.65 s. This is strikingly shorter than time constants observed in the lateral geniculate nucleus, which were on the order of tens of seconds. Cells in V1 that lacked orientation tuning displayed an intermediate time course, with a mean time constant of 4.3 s. These results are consistent with a multistage model in which cells at successive stages adapt to their inputs with progressively shorter time constants. Our findings suggest that the perceptual phenomena of fading and afterimages are shaped by both cortical and subcortical dynamics and provide a physiological framework for the interpretation of recent and long-standing psychophysical observations.

Hypothesis test for synchronization: Twin surrogates revisited

The method of twin surrogates has been introduced to test for phase synchronization of complex systems in the case of passive experiments. In this paper we derive new analytical expressions for the number of twins depending on the size of the neighborhood, as well as on the length of the trajectory. This allows us to determine the optimal parameters for the generation of twin surrogates. Furthermore, we determine the quality of the twin surrogates with respect to several linear and nonlinear statistics depending on the parameters of the method. In the second part of the paper we perform a hypothesis test for phase synchronization in the case of experimental data from fixational eye movements. These miniature eye movements have been shown to play a central role in neural information processing underlying the perception of static visual scenes. The high number of data sets (21 subjects and 30 trials per person) allows us to compare the generated twin surrogates with the "natural" surrogates that correspond to the different trials. We show that the generated twin surrogates reproduce very well all linear and nonlinear characteristics of the underlying experimental system. The synchronization analysis of fixational eye movements by means of twin surrogates reveals that the synchronization between the left and right eye is significant, indicating that either the centers in the brain stem generating fixational eye movements are closely linked, or, alternatively that there is only one center controlling both eyes.

Effects of Simulated Viewpoint Jitter on Visually Induced Postural Sway

In this study we examined the effects of simulated horizontal and vertical viewpoint jitter on the vection and postural sway induced by radial patterns of optic flow. During each trial, observers were exposed sequentially to 20 s periods of radially expanding flow, radially contracting flow, and static visual scenes. For half the trials, simulated viewpoint jitter was added to the radially expanding/contracting optic flow patterns. In experiment 1, we found that, while this jitter increased the backward postural sway induced by radial expansion, it actually decreased forward postural sway induced by radial contraction. However, in experiment 2 we found that jitter increased both the forward and backward vection induced by radially expanding and contracting flow patterns. We conclude that the processes involved in postural control are more sensitive to the sensory conflicts generated by viewpoint jitter than those involved in the perception of self-motion, and that the observed asymmetries in forward and backward sway are ecological in origin.

Effects of Sensorimotor Adaptation Training on Functional Mobility in Older Adults

The goal of this study was to determine if prolonged exposure to perceptual-motor mismatch increased adaptability and retention of balance in older adults. Sixteen adults, aged 66 to 81 years, were randomized to one of two groups: either the control group (n=8) or the experimental group (n=8). Both groups first completed six trials of walking an obstacle course. Participants then trained twice a week for 4 weeks. In the training, the control group walked on a treadmill for 20 minutes while viewing a static visual scene and the experimental group walked on a treadmill for 20 minutes while viewing a rotating visual scene that provided a perceptual-motor mismatch. Following training, both groups were post-tested on the obstacle course. The experimental group moved faster through the obstacle course with fewer penalties. This training effect was retained for 4 weeks. Exposure to perceptual-motor mismatch induced an adaptive training effect that improved balance and locomotor control in older adults.

Describing visual scenes: Towards a neurolinguistics based on construction grammar

The present paper is part of a larger effort to locate the production and perception of language within the broader context of brain mechanisms for action and perception more generally. Here we model function in terms of the competition and cooperation of schemas. We use the task of describing visual scenes to explore the suitability of Construction Grammar as an appropriate framework for a schema-based linguistics. We recall the early VISIONS model of schema-based computer analysis of static visual scenes and then introduce SemRep as a graphical representation of dynamic visual scenes designed to support the generation of varied descriptions of episodes. We report preliminary results on implementing the production of sentences using Template Construction Grammar (TCG), a new form of construction grammar distinguished by its use of SemRep to express semantics. We summarize data on neural correlates relevant to future work on TCG within the context of neurolinguistics, and show how the relation between SemRep and TCG can serve as the basis for modeling language comprehension.