Dynamic Visual Stimuli Research Articles

Effect of optokinetic stimulation on visual–manual tracking under the conditions of support-proprioceptive deprivation

The effects of additional dynamic visual stimuli (retinal optokinetic stimulation (ROKS)) on the visual–manual tracking (VMT) indicators in the absence of support afferentation and with a reduced level of proprioceptive afferentation were determined using a model of horizontal “dry” immersion. The accuracy of the VMT of jerky and smooth (linear, pendular, and circular) movements represented by visual dot stimuli was evaluated in all 18 participants aged 19–31 before, during and after their exposure to a five- to seven-day immersion bath. The eye movements were recorded by electrooculography, while the hand movements were recorded by a joystick with a biological visual feedback (the current angle of the joystick handle was imaged on the screen). Computerized visual stimulation tests were presented, through virtual reality glasses, to subjects in the absence and against the background ROKS. We analyzed the temporal and the amplitude- and velocity-related visual and manual tracking (VT and MT) characteristics, including the efficiency (e) and gain (g) coefficients as the ratios between the amplitudes and velocities of eye/hand movements and the amplitude of stimulus movements. The efficiency and gain coefficients of both VT and MT without ROKS were significantly decreased against the baseline during the entire period including three days of immersion and 3 post-immersion days. The most pronounced worsening was observed in the VT parameters. Whereas the VT and MT parameters remained unchanged against the threshold ROKS before the immersion, they were improved during and after the immersion (the improvement was significant on the fifth to seventh day of immersion and on the thirdthird post-immersion day, compared to the test indicators on the clean screen). The most pronounced impact of ROKS was observed in the VT parameters. The vestibular function (VF) was evaluated by videooculography before and after immersion. We analyzed the static torsional otolith-cervicalocular reflex (OCOR), dynamic vestibular-cervical-ocular reactions (VCOR), vestibular reactivity (VR), and spontaneous eye movements (SpEM). A significant decrease in OCOR (gOCOR was 0.1, compared to the background gOCOR value of 0.25) was detected alongside a simultaneous significant increase in the VCOR/VR parameters in 28% of subjects on day R + 1 after immersion. Correlational has been found between the parameters of VT and MT, as well as between those of VF and VT, but no correlation has been found between the VF and MT characteristics. The results have shown that the removal of support afferentation and the minimization of proprioceptive afferentation more affected the accuracy of VT rather than that of MT. The correlational links between the studied parameters against the background of ROKS were not only preserved, but also intensified. The obtained results confirm the development of sensory deprivation (and afferent deficit) under the exposure to an immersion bath and indicate the approach to correcting the sensory deprivation through additional ROKS.

The role of cortical beta oscillations in time estimation.

Estimation of time is central to perception, action, and cognition. Human functional magnetic resonance imaging (fMRI) and positron emission topography (PET) have revealed a positive correlation between the estimation of multi-second temporal durations and neuronal activity in a circuit of sensory and motor areas, prefrontal and temporal cortices, basal ganglia, and cerebellum. The systems-level mechanisms coordinating the collective neuronal activity in these areas have remained poorly understood. Synchronized oscillations regulate communication in neuronal networks and could hence serve such coordination, but their role in the estimation and maintenance of multi-second time intervals has remained largely unknown. We used source-reconstructed magnetoencephalography (MEG) to address the functional significance of local neuronal synchronization, as indexed by the amplitudes of cortical oscillations, in time-estimation. MEG was acquired during a working memory (WM) task where the subjects first estimated and then memorized the durations, or in the contrast condition, the colors of dynamic visual stimuli. Time estimation was associated with stronger beta (β, 14 - 30 Hz) band oscillations than color estimation in sensory regions and attentional cortical structures that earlier have been associated with time processing. In addition, the encoding of duration information was associated with strengthened gamma- (γ, 30 - 120 Hz), and the retrieval and maintenance with alpha- (α, 8 - 14 Hz) band oscillations. These data suggest that β oscillations may provide a mechanism for estimating short temporal durations, while γ and α oscillations support their encoding, retrieval, and maintenance in memory. Hum Brain Mapp 37:3262-3281, 2016. © 2016 Wiley Periodicals, Inc.

Integrative Processing of Touch and Affect in Social Perception: An fMRI Study.

Social perception commonly employs multiple sources of information. The present study aimed at investigating the integrative processing of affective social signals. Task-related and task-free functional magnetic resonance imaging was performed in 26 healthy adult participants during a social perception task concerning dynamic visual stimuli simultaneously depicting facial expressions of emotion and tactile sensations that could be either congruent or incongruent. Confounding effects due to affective valence, inhibitory top–down influences, cross-modal integration, and conflict processing were minimized. The results showed that the perception of congruent, compared to incongruent stimuli, elicited enhanced neural activity in a set of brain regions including left amygdala, bilateral posterior cingulate cortex (PCC), and left superior parietal cortex. These congruency effects did not differ as a function of emotion or sensation. A complementary task-related functional interaction analysis preliminarily suggested that amygdala activity depended on previous processing stages in fusiform gyrus and PCC. The findings provide support for the integrative processing of social information about others’ feelings from manifold bodily sources (sensory-affective information) in amygdala and PCC. Given that the congruent stimuli were also judged as being more self-related and more familiar in terms of personal experience in an independent sample of participants, we speculate that such integrative processing might be mediated by the linking of external stimuli with self-experience. Finally, the prediction of task-related responses in amygdala by intrinsic functional connectivity between amygdala and PCC during a task-free state implies a neuro-functional basis for an individual predisposition for the integrative processing of social stimulus content.

Fine and distributed subcellular retinotopy of excitatory inputs to the dendritic tree of a collision-detecting neuron.

Individual neurons in several sensory systems receive synaptic inputs organized according to subcellular topographic maps, yet the fine structure of this topographic organization and its relation to dendritic morphology have not been studied in detail. Subcellular topography is expected to play a role in dendritic integration, particularly when dendrites are extended and active. The lobula giant movement detector (LGMD) neuron in the locust visual system is known to receive topographic excitatory inputs on part of its dendritic tree. The LGMD responds preferentially to objects approaching on a collision course and is thought to implement several interesting dendritic computations. To study the fine retinotopic mapping of visual inputs onto the excitatory dendrites of the LGMD, we designed a custom microscope allowing visual stimulation at the native sampling resolution of the locust compound eye while simultaneously performing two-photon calcium imaging on excitatory dendrites. We show that the LGMD receives a distributed, fine retinotopic projection from the eye facets and that adjacent facets activate overlapping portions of the same dendritic branches. We also demonstrate that adjacent retinal inputs most likely make independent synapses on the excitatory dendrites of the LGMD. Finally, we show that the fine topographic mapping can be studied using dynamic visual stimuli. Our results reveal the detailed structure of the dendritic input originating from individual facets on the eye and their relation to that of adjacent facets. The mapping of visual space onto the LGMD's dendrites is expected to have implications for dendritic computation.

Bayesian-based integration of multisensory naturalistic perithreshold stimuli

Most studies exploring multisensory integration have used clearly perceivable stimuli. According to the principle of inverse effectiveness, the added neural and behavioral benefit of integrating clear stimuli is reduced in comparison to stimuli with degraded and less salient unisensory information. Traditionally, speed and accuracy measures have been analyzed separately with few studies merging these to gain an understanding of speed-accuracy trade-offs in multisensory integration.In two separate experiments, we assessed multisensory integration of naturalistic audio-visual objects consisting of individually-tailored perithreshold dynamic visual and auditory stimuli, presented within a multiple-choice task, using a Bayesian Hierarchical Drift Diffusion Model that combines response time and accuracy. For both experiments, unisensory stimuli were degraded to reach a 75% identification accuracy level for all individuals and stimuli to promote multisensory binding. In Experiment 1, we subsequently presented uni- and their respective bimodal stimuli followed by a 5-alternative-forced-choice task. In Experiment 2, we controlled for low-level integration and attentional differences.Both experiments demonstrated significant superadditive multisensory integration of bimodal perithreshold dynamic information. We present evidence that the use of degraded sensory stimuli may provide a link between previous findings of inverse effectiveness on a single neuron level and overt behavior. We further suggest that a combined measure of accuracy and reaction time may be a more valid and holistic approach of studying multisensory integration and propose the application of drift diffusion models for studying behavioral correlates as well as brain-behavior relationships of multisensory integration.

Single-Trial Event-Related Potential Correlates of Belief Updating(1,2,3).

Belief updating—the process by which an agent alters an internal model of its environment—is a core function of the CNS. Recent theory has proposed broad principles by which belief updating might operate, but more precise details of its implementation in the human brain remain unclear. In order to address this question, we studied how two components of the human event-related potential encoded different aspects of belief updating. Participants completed a novel perceptual learning task while electroencephalography was recorded. Participants learned the mapping between the contrast of a dynamic visual stimulus and a monetary reward and updated their beliefs about a target contrast on each trial. A Bayesian computational model was formulated to estimate belief states at each trial and was used to quantify the following two variables: belief update size and belief uncertainty. Robust single-trial regression was used to assess how these model-derived variables were related to the amplitudes of the P3 and the stimulus-preceding negativity (SPN), respectively. Results showed a positive relationship between belief update size and P3 amplitude at one fronto-central electrode, and a negative relationship between SPN amplitude and belief uncertainty at a left central and a right parietal electrode. These results provide evidence that belief update size and belief uncertainty have distinct neural signatures that can be tracked in single trials in specific ERP components. This, in turn, provides evidence that the cognitive mechanisms underlying belief updating in humans can be described well within a Bayesian framework.

Duration estimates within a modality are integrated sub-optimally.

Perceived duration can be influenced by various properties of sensory stimuli. For example, visual stimuli of higher temporal frequency are perceived to last longer than those of lower temporal frequency. How does the brain form a representation of duration when each of two simultaneously presented stimuli influences perceived duration in different way? To answer this question, we investigated the perceived duration of a pair of dynamic visual stimuli of different temporal frequencies in comparison to that of a single visual stimulus of either low or high temporal frequency. We found that the duration representation of simultaneously occurring visual stimuli is best described by weighting the estimates of duration based on each individual stimulus. However, the weighting performance deviates from the prediction of statistically optimal integration. In addition, we provided a Bayesian account to explain a difference in the apparent sensitivity of the psychometric curves introduced by the order in which the two stimuli are displayed in a two-alternative forced-choice task.

Neural networks underlying implicit and explicit moral evaluations in psychopathy.

Psychopathy, characterized by symptoms of emotional detachment, reduced guilt and empathy and a callous disregard for the rights and welfare of others, is a strong risk factor for immoral behavior. Psychopathy is also marked by abnormal attention with downstream consequences on emotional processing. To examine the influence of task demands on moral evaluation in psychopathy, functional magnetic resonance imaging was used to measure neural response and functional connectivity in 88 incarcerated male subjects (28 with Psychopathy Checklist Revised (PCL-R) scores ⩾30) while they viewed dynamic visual stimuli depicting interpersonal harm and interpersonal assistance in two contexts, implicit and explicit. During the implicit task, high psychopathy was associated with reduced activity in the dorsolateral prefrontal cortex and caudate when viewing harmful compared with helpful social interactions. Functional connectivity seeded in the right amygdala and right temporoparietal junction revealed decreased coupling with the anterior cingulate cortex (ACC), anterior insula, striatum and ventromedial prefrontal cortex. In the explicit task, higher trait psychopathy predicted reduced signal change in ACC and amygdala, accompanied by decreased functional connectivity to temporal pole, insula and striatum, but increased connectivity with dorsal ACC. Psychopathy did not influence behavioral performance in either task, despite differences in neural activity and functional connectivity. These findings provide the first direct evidence that hemodynamic activity and neural coupling within the salience network are disrupted in psychopathy, and that the effects of psychopathy on moral evaluation are influenced by attentional demands.

The "social" and "interpersonal" body in spatial cognition. The role of agency and interagency.

In order to interact effectively, we need to represent our action as produced by human beings. According to direct access theories, the first steps of visual information processing offer us an informed direct grasp of the situation, especially when social and interpersonal components are implicated. Biological system detection may be the gateway of such smart processes and then may influence initial stages of perception fostering adaptive social behaviour. To investigate early neural correlates of human agency detection in ecological situations with more high or low social impact, we compared scenes showing a human versus artificial agent interacting with a human agent. Twenty volunteers participated in the study. They were asked to observe dynamic visual stimuli showing realistic interactions. ERP (event-related potentials) were recorded. Each stimulus depicted an arm executing a gesture addressed to a human agent. Visual features of the arm were manipulated: in half of trials, it was real; in other trials, it was deprived of some details and transformed in a statue-like arm. EEG morphological analysis revealed an early negative deflection peaking at about 155ms. Peak amplitude data have been statistically analysed by repeated-measures ANOVAs. It was found that the peak was ampler in the left inferior posterior region when the gesturing arm was human. The early negative deflection, N150, which we found to be different between the human and artificial conditions, is presumably associated with human agency detection in high interpersonal context.

The Effect of Visual Information on Young Children’s Perceptual Sensitivity to Musical Beat Alignment

Recent work examined five-year-old children’s perceptual sensitivity to musical beat alignment. In this work, children watched pairs of videos of puppets drumming to music with simple or complex metre, where one puppet’s drumming sounds (and movements) were synchronized with the beat of the music and the other drummed with incorrect tempo or phase. The videos were used to maintain children’s interest in the task. Five-year-olds were better able to detect beat misalignments in simple than complex metre music. However, adults can perform poorly when attempting to detect misalignment of sound and movement in audiovisual tasks, so it is possible that the moving stimuli actually hindered children’s performance. Here we compared children’s sensitivity to beat misalignment in conditions with dynamic visual movement versus still (static) visual images. Eighty-four five-year-old children performed either the same task as described above or a task that employed identical auditory stimuli accompanied by a motionless picture of the puppet with the drum. There was a significant main effect of metre type, replicating the finding that five-year-olds are better able to detect beat misalignment in simple metre music. There was no main effect of visual condition. These results suggest that, given identical auditory information, children’s ability to judge beat misalignment in this task is not affected by the presence or absence of dynamic visual stimuli. We conclude that at five years of age, children can tell if drumming is aligned to the musical beat when the music has simple metric structure.

Evaluation of Postural Control in Patients with Glaucoma Using a Virtual Reality Environment

To evaluate postural control using a dynamic virtual reality environment and the relationship between postural metrics and history of falls in patients with glaucoma. Cross-sectional study. The study involved 42 patients with glaucoma with repeatable visual field defects on standard automated perimetry (SAP) and 38 control healthy subjects. Patients underwent evaluation of postural stability by a force platform during presentation of static and dynamic visual stimuli on stereoscopic head-mounted goggles. The dynamic visual stimuli presented rotational and translational ecologically valid peripheral background perturbations. Postural stability was also tested in a completely dark field to assess somatosensory and vestibular contributions to postural control. History of falls was evaluated by a standard questionnaire. Torque moments around the center of foot pressure on the force platform were measured, and the standard deviations of the torque moments (STD) were calculated as a measurement of postural stability and reported in Newton meters (Nm). The association with history of falls was investigated using Poisson regression models. Age, gender, body mass index, severity of visual field defect, best-corrected visual acuity, and STD on dark field condition were included as confounding factors. Patients with glaucoma had larger overall STD than controls during both translational (5.12 ± 2.39 Nm vs. 3.85 ± 1.82 Nm, respectively; P = 0.005) and rotational stimuli (5.60 ± 3.82 Nm vs. 3.93 ± 2.07 Nm, respectively; P = 0.022). Postural metrics obtained during dynamic visual stimuli performed better in explaining history of falls compared with those obtained in static and dark field condition. In the multivariable model, STD values in the mediolateral direction during translational stimulus were significantly associated with a history of falls in patients with glaucoma (incidence rate ratio, 1.85; 95% confidence interval, 1.30-2.63; P = 0.001). The study presented and validated a novel paradigm for evaluation of balance control in patients with glaucoma on the basis of the assessment of postural reactivity to dynamic visual stimuli using a virtual reality environment. The newly developed metrics were associated with a history of falls and may help to provide a better understanding of balance control in patients with glaucoma.

Eighteen-month-olds' memory for short movies of simple stories.

This study investigated twenty four 18-month-olds' memory for dynamic visual stimuli. During the first visit participants saw one of two brief movies (30 seconds) with a simple storyline displayed in four iterations. After 2 weeks, memory was tested in the visual paired comparison paradigm in which the familiar and the novel movie were contrasted simultaneously and displayed in two iterations for a total of 60 seconds. Eye-tracking revealed that participants fixated the familiar movie significantly more than the novel movie, thus indicating memory for the familiar movie. Furthermore, time-dependent analysis of the data revealed that individual differences in the looking-patterns for the first and second iteration of the movies were related to individual differences in productive vocabulary. We suggest that infants' vocabulary may be indicative of their ability to understand and remember the storyline of the movies, thereby affecting their subsequent memory.

17. The contribution of intracranial eeg to research on the empathy for pain

In the last decade, a number of functional neuroimaging studies have identified a set of neural structures that are involved in empathy for another person’s pain. Bilateral anterior insular cortex and medial/anterior cingulate cortex seem to play a crucial role, but several other brain regions are also co-activated; this includes structures associated mostly with “Theory of Mind” or “mentalizing”, including precuneus, ventral prefrontal cortex, superior temporal cortex, and temporo-parietal junction. Electrophysiological pain-empathy responses have been analyzed to investigate the temporal dynamics of neural activity underlying this process. To the best of our knowledge, however, this has been performed with scalp recordings only; pain empathy-related brain potentials have not recorded using intracranial electrodes until now. In the present study, we investigated intracranial event-related brain potentials (ERPs) from three intractable epileptic patients who underwent preoperatively diagnostic invasive video-EEG monitoring. During the experiment, patients watched 3-second dynamic visual stimuli depicting needle injections into a left hand (N = 42), or the same left hand touched by a cue tip (N = 42). Intracranial EEGs were recorded using intracerebral and subdural electrodes, investigating in total more than 300 brain sites. The ERPs in each condition (needle and cue tip) were averaged separately off-line, and statistical differences in response amplitudes after painful vs. non-painful stimuli were detected. In all three subjects, significantly different event-related responses to painful vs. non-painful stimuli were observed in some investigated neural structures, including left-hemispheric temporo-parietal junction, right-sided temporo-occipital junction, and right-sided lateral occipital cortex. In these brain sites, painful needle stimuli evoked more prominent ERPs compared to cue-tip touch. The latency of these intracranial ERPs can be used for direct measurement of local activation with millisecond temporal resolution, and can be compared across different brain structures as well as with the scalp ERPs. Our pilot data demonstrate the ability of intracranial ERP recordings to contribute to our understanding of pain empathy. More generally, these data provide important insights into more complex social phenomena, and complement widely available functional neuroimaging data which are limited by their reliance on hemodynamic rather than direct neural measurements.

Abstract W MP54: Increased Collisions and Errors at Intersections During Simulated Driving in Patients after Aneurysmal Subarachnoid Hemorrhage

Introduction: It is well established that cognitive and functional impairments persist despite good clinical outcomes in patients who suffer aneurysmal subarachnoid hemorrhage (aSAH). The impact of these impairments on real-world tasks such as driving a motor vehicle is currently unclear. This study aimed to investigate driving ability of aSAH patients using a driving simulator. We hypothesized that patients would exhibit more driving errors during the most cognitively demanding aspects, particularly while executing left turns at busy intersections, where the driver must quickly integrate many complex and dynamic visual stimuli to make a rapid decision and turn safely. Methods: Nine functionally independent aSAH patients (>3 months post-ictus) and nine healthy control participants matched for age (patients: 58±13; controls: 59±14, p > 0.05) completed two driving scenarios (STISIM). The total number of errors committed and errors associated with intersections were compared between groups. Errors included collisions, speeding, centerline crossings, road edge excursions, stop signs missed and traffic light tickets. Results: The mean number of total errors did not differ between the patient and control groups (28 versus 22, p > 0.05); however, patients committed a greater number of hazardous errors, including collisions (2.4 versus 0.1, p < 0.05) and road edge excursions (3.7 versus 0.3, p < 0.01), than controls. Total errors at intersection turns were greater for patients (7.7 versus 3.2, p < 0.05). When stratified by type of turn, patients experienced more errors than controls during left turns (1.6 versus 0.2, p < 0.01) and left turns with oncoming traffic (2.3 versus 0.8, p < 0.05) but not during right turns (3.8 versus 2.2, p > 0.05). Conclusion: Our results suggest probable driving impairment in some aSAH patients during more difficult aspects of driving, such as making left turns at a busy intersection, which is where most real-world accidents occur. This analysis was limited by a small sample, and further research should explore the clinical and cognitive correlates of driving ability in a large sample of aSAH patients.

Lower Pitch Is Larger, Yet Falling Pitches Shrink

Experiments using diverse paradigms, including speeded discrimination, indicate that pitch and visually-perceived size interact perceptually, and that higher pitch is congruent with smaller size. While nearly all of these studies used static stimuli, here we examine the interaction of dynamic pitch and dynamic size, using Garner's speeded discrimination paradigm. Experiment 1 examined the interaction of continuous rise/fall in pitch and increase/decrease in object size. Experiment 2 examined the interaction of static pitch and size (steady high/low pitches and large/small visual objects), using an identical procedure. Results indicate that static and dynamic auditory and visual stimuli interact in opposite ways. While for static stimuli (Experiment 2), higher pitch is congruent with smaller size (as suggested by earlier work), for dynamic stimuli (Experiment 1), ascending pitch is congruent with growing size, and descending pitch with shrinking size. In addition, while static stimuli (Experiment 2) exhibit both congruence and Garner effects, dynamic stimuli (Experiment 1) present congruence effects without Garner interference, a pattern that is not consistent with prevalent interpretations of Garner's paradigm. Our interpretation of these results focuses on effects of within-trial changes on processing in dynamic tasks and on the association of changes in apparent size with implied changes in distance. Results suggest that static and dynamic stimuli can differ substantially in their cross-modal mappings, and may rely on different processing mechanisms.

Biometric Recognition via Probabilistic Spatial Projection of Eye Movement Trajectories in Dynamic Visual Environments

This paper proposes a method for the extraction of biometric features from the spatial patterns formed by eye movements during an inspection of dynamic visual stimulus. In the suggested framework, each eye movement signal is transformed into a time-constrained decomposition by using a probabilistic representation of spatial and temporal features related to eye fixations and called fixation density map (FDM). The results for a large collection of eye movements recorded from 200 individuals indicate the best equal error rate of 10.8% and Rank-1 identification rate as high as 51%, which is a significant improvement over existing eye movement-driven biometric methods. In addition, our experiments reveal that a person recognition approach based on the FDM performs well even in cases when eye movement data are captured at lower than optimum sampling frequencies. This property is very important for the future ocular biometric systems where existing iris recognition devices could be employed to combine eye movement traits with iris information for increased security and accuracy. Considering that commercial iris recognition devices are able to implement eye image sampling usually at a relatively low rate, the ability to perform eye movement-driven biometrics at such rates is of great significance.

Changes in ongoing EEG rhythms in response to dynamic visual stimuli with different emotional valence and arousal levels

Changes in ongoing EEG rhythms in response to dynamic visual stimuli with different emotional valence and arousal levels

Stereoscopic depth increases intersubject correlations of brain networks

Three-dimensional movies presented via stereoscopic displays have become more popular in recent years aiming at a more engaging viewing experience. However, neurocognitive processes associated with the perception of stereoscopic depth in complex and dynamic visual stimuli remain understudied. Here, we investigate the influence of stereoscopic depth on both neurophysiology and subjective experience. Using multivariate statistical learning methods, we compare the brain activity of subjects when freely watching the same movies in 2D and in 3D. Subjective reports indicate that 3D movies are more strongly experienced than 2D movies. On the neural level, we observe significantly higher intersubject correlations of cortical networks when subjects are watching 3D movies relative to the same movies in 2D. We demonstrate that increases in intersubject correlations of brain networks can serve as neurophysiological marker for stereoscopic depth and for the strength of the viewing experience.

Inattentional deafness in music

While inattentional blindness is a modern classic in attention and perception research, analogous phenomena of inattentional deafness have been widely neglected. We here present the first investigation of inattentional deafness in and with music under controlled experimental conditions. Inattentional deafness in music is defined as the inability to consciously perceive an unexpected musical stimulus when attention is focused on a certain facet of the piece. Participants listened to a modification of the first 1'50″ of Richard Strauss' Thus Spake Zarathustra; while the control group just listened, the experimental group had to count the number of timpani beats. An e-guitar solo served as the unexpected event. In Study 1, experimental data from n=115 participants were analyzed. Non-musicians were compared with musicians to investigate the impact of expertise. In Study 2 (n=47), the scope of the inattentional deafness effect was investigated with a more salient unexpected stimulus. Results demonstrate an inattentional deafness effect under dynamic musical conditions. Quite unexpectedly, the effect was structurally equivalent even for musicians. Our findings clearly show that sustained inattentional deafness exists in the musical realm, in close correspondence to inattentional blindness with dynamic visual stimuli.

Real and implied motion at the center of gaze

Even though the dynamicity of our environment is a given, much of what we know on fixation selection comes from studies of static scene viewing. We performed a direct comparison of fixation selection on static and dynamic visual stimuli and investigated how far identical mechanisms drive these. We recorded eye movements while participants viewed movie clips of natural scenery and static frames taken from the same movies. Both were presented in the same high spatial resolution (1080 × 1920 pixels). The static condition allowed us to check whether local movement features computed from movies are salient even when presented as single frames. We observed that during the first second of viewing, movement and static features are equally salient in both conditions. Furthermore, predictability of fixations based on movement features decreased faster when viewing static frames as compared with viewing movie clips. Yet even during the later portion of static-frame viewing, the predictive value of movement features was still high above chance. Moreover, we demonstrated that, whereas the sets of movement and static features were statistically dependent within these sets, respectively, no dependence was observed between the two sets. Based on these results, we argue that implied motion is predictive of fixation similarly to real movement and that the onset of motion in natural stimuli is more salient than ongoing movement is. The present results allow us to address to what extent and when static image viewing is similar to the perception of a dynamic environment.