Stages Of Visual Processing Research Articles

Distinct brain oscillatory responses for the perception and identification of one's own body from other's body.

The body recognition process includes complex visual processing, the sensation, perception, and distinction stages of the stimulus. This study examined this process by using the time-frequency analysis of EEG signals and analyzed the obtained data by using the event-related oscillations method. This study aimed to examine the oscillatory brain responses and distinguish one's own body from other's body. In the present study, 17 young adults were included and the EEGs were recorded with 32 electrodes placed in different locations. Event-related power spectrum and phase-locking analyzes were performed. ITC and ERSP data were analyzed using 2 (condition) × 11 (location) × 2 (hemisphere) ANOVA Design. As we observed a prolonged response in the theta band in the grand averages, we included the time variable in the overall model. As a result, we found that the phase-locking and the event-related power spectrum of the theta response in recognizing one's own body were higher when compared to the phase-locking and the event-related power spectrum of the theta response in recognizing others' body (p < 0.05). When the time variable was included, the early theta response was more phase-locked and had a higher power spectrum compared to the late theta response (p < 0.05). As a result of the power spectrum analysis, the condition × hemisphere interaction effect in the beta band was higher in the left hemisphere regarding increased responses in recognizing one's own body (p < 0.05). As a result of ITC, the main effect of the condition was higher in the recognition of the stimulus of one's own body (p < 0.05). Finally, the theta oscillator response stood out in distinguishing one's own body from other's body. Similarly, the power spectrum in the beta response was higher in the left hemisphere, and this finding is consistent with the literature.

Morpheme Transposition of Two-Character Chinese Words in Vertical Visual Fields.

The present study explored the morpheme transposition process of two-character Chinese words in the upper and lower visual fields by adopting a dual-target rapid serial visual presentation paradigm. The results showed that the identification accuracy of canonical words was better in the lower visual field, whereas the accuracy of transposed words was almost identical in the upper and lower visual fields. Furthermore, there was no significant difference between canonical and transposed words at 0°, 2°, 4°, and 6° eccentricities in the upper visual field. However, the accuracy of canonical words was markedly higher than that of transposed words at 2°, 4°, and 6° eccentricities in the lower visual field. Finally, the character order errors mainly occurred at 0°eccentricity with a duration of 100ms in vertical visual fields. These findings, taken together, indicated that the character transposition affected the lexical process of two-character Chinese words in the lower visual field but not in the upper visual field, and the character order of words was more likely to be reversed at 0° eccentricity and the initial stage of visual word processing in vertical reading.

Neurophysiology: The Three-Dimensional Building Blocks of Object Vision

A new study of the macaque visual cortex has revealed that visual area V4 performs substantial analysis of solid shape structure. The findings draw new attention to the embedding of local three-dimensional shape analysis into the early cortical stages of visual processing.

Neural Basis of Semantically Dependent and Independent Cross-Modal Boosts on the Attentional Blink.

The present study recorded event-related potentials (ERPs) in a visual object-recognition task under the attentional blink paradigm to explore the temporal dynamics of the cross-modal boost on attentional blink and whether this auditory benefit would be modulated by semantic congruency between T2 and the simultaneous sound. Behaviorally, the present study showed that not only a semantically congruent but also a semantically incongruent sound improved T2 discrimination during the attentional blink interval, whereas the enhancement was larger for the congruent sound. The ERP results revealed that the behavioral improvements induced by both the semantically congruent and incongruent sounds were closely associated with an early cross-modal interaction on the occipital N195 (192-228ms). In contrast, the lower T2 accuracy for the incongruent than congruent condition was accompanied by a larger late occurring cento-parietal N440 (424-448ms). These findings suggest that the cross-modal boost on attentional blink is hierarchical: the task-irrelevant but simultaneous sound, irrespective of its semantic relevance, firstly enables T2 to escape the attentional blink via cross-modally strengthening the early stage of visual object-recognition processing, whereas the semantic conflict of the sound begins to interfere with visual awareness only at a later stage when the representation of visual object is extracted.

Impact of mind‐wandering on visual information processing while driving: An electrophysiological study

SummaryMind‐wandering (MW) has a negative impact on tasks requiring sustained and divided attention like driving. During MW, drivers experience perceptual decoupling. As driving is mainly a visual activity, it would seem to be appropriate to evaluate stages of visual information processing impaired during MW, using event‐related potential techniques. The aim of the present study was to investigate how the level of attention devoted to driving impacted visual information processing and reaction time. The findings showed reductions in visual N1 and P3 amplitudes while driving and longer reaction times during periods of self‐reported MW. This suggests that drivers can become detached from their environment by redirecting their attention to their personal thoughts and some of their cognitive resources may be consumed to feed internal trains of thought. In the future, investigating off‐task characteristics might be useful in better understanding the impact of MW in car crashes.

Low rank mechanisms underlying flexible visual representations

Neuronal population responses to sensory stimuli are remarkably flexible. The responses of neurons in visual cortex have heterogeneous dependence on stimulus properties (e.g., contrast), processes that affect all stages of visual processing (e.g., adaptation), and cognitive processes (e.g., attention or task switching). Understanding whether these processes affect similar neuronal populations and whether they have similar effects on entire populations can provide insight into whether they utilize analogous mechanisms. In particular, it has recently been demonstrated that attention has low rank effects on the covariability of populations of visual neurons, which impacts perception and strongly constrains mechanistic models. We hypothesized that measuring changes in population covariability associated with other sensory and cognitive processes could clarify whether they utilize similar mechanisms or computations. Our experimental design included measurements in multiple visual areas using four distinct sensory and cognitive processes. We found that contrast, adaptation, attention, and task switching affect the variability of responses of populations of neurons in primate visual cortex in a similarly low rank way. These results suggest that a given circuit may use similar mechanisms to perform many forms of modulation and likely reflects a general principle that applies to a wide range of brain areas and sensory, cognitive, and motor processes.

Task-related activity in human visual cortex.

The brain exhibits widespread endogenous responses in the absence of visual stimuli, even at the earliest stages of visual cortical processing. Such responses have been studied in monkeys using optical imaging with a limited field of view over visual cortex. Here, we used functional MRI (fMRI) in human participants to study the link between arousal and endogenous responses in visual cortex. The response that we observed was tightly entrained to task timing, was spatially extensive, and was independent of visual stimulation. We found that this response follows dynamics similar to that of pupil size and heart rate, suggesting that task-related activity is related to arousal. Finally, we found that higher reward increased response amplitude while decreasing its trial-to-trial variability (i.e., the noise). Computational simulations suggest that increased temporal precision underlies both of these observations. Our findings are consistent with optical imaging studies in monkeys and support the notion that arousal increases precision of neural activity.

Visual and Semantic Representations Predict Subsequent Memory in Perceptual and Conceptual Memory Tests.

It is generally assumed that the encoding of a single event generates multiple memory representations, which contribute differently to subsequent episodic memory. We used functional magnetic resonance imaging (fMRI) and representational similarity analysis to examine how visual and semantic representations predicted subsequent memory for single item encoding (e.g., seeing an orange). Three levels of visual representations corresponding to early, middle, and late visual processing stages were based on a deep neural network. Three levels of semantic representations were based on normative observed ("is round"), taxonomic ("is a fruit"), and encyclopedic features ("is sweet"). We identified brain regions where each representation type predicted later perceptual memory, conceptual memory, or both (general memory). Participants encoded objects during fMRI, and then completed both a word-based conceptual and picture-based perceptual memory test. Visual representations predicted subsequent perceptual memory in visual cortices, but also facilitated conceptual and general memory in more anterior regions. Semantic representations, in turn, predicted perceptual memory in visual cortex, conceptual memory in the perirhinal and inferior prefrontal cortex, and general memory in the angular gyrus. These results suggest that the contribution of visual and semantic representations to subsequent memory effects depends on a complex interaction between representation, test type, and storage location.

Hemifield-specific control of spatial attention and working memory: Evidence from hemifield crossover costs.

Attentional tracking and working memory tasks are often performed better when targets are divided evenly between the left and right visual hemifields, rather than contained within a single hemifield (Alvarez & Cavanagh, 2005; Delvenne, 2005). However, this bilateral field advantage does not provide conclusive evidence of hemifield-specific control of attention and working memory, because it can be explained solely from hemifield-limited spatial interference at early stages of visual processing. If control of attention and working memory is specific to each hemifield, maintaining target information should become more difficult as targets move between the two hemifields. Observers in the present study maintained targets that moved either within or between the left and right hemifields, using either attention (Experiment 1) or working memory (Experiment 2). Maintaining spatial information was more difficult when target items moved between the hemifields compared with when target items moved within their original hemifields, consistent with hemifield-specific control of spatial attention and working memory. However, this pattern was not found for maintaining identity information (e.g., color) in working memory (Experiment 3). Together, these results provide evidence that control of spatial attention and working memory is specific to each hemifield, and that hemifield-specific control is a unique signature of spatial processing.

Face-Specific Perceptual Distortions Reveal A View- and Orientation-Independent Face Template

The spatial coordinate system in which a stimulus representation is embedded is known as its reference frame. Every visual representation has a reference frame [1], and the visual system uses a variety of reference frames to efficiently code visual information [e.g., 1-5]. The representation of faces in early stages of visual processing depends on retino-centered reference frames, but little is known about the reference frames that code the high-level representations used to make judgements about faces. Here, we focus on a rare and striking disorder of face perception-hemi-prosopometamorphopsia (hemi-PMO)-to investigate these reference frames. After a left splenium lesion, Patient A.D. perceives features on the right side of faces as if they had melted. The same features were distorted when faces were presented in either visual field, at different in-depth rotations, and at different picture-plane orientations including upside-down. A.D.'s results indicate faces are aligned to a view- and orientation-independent face template encoded in a face-centered reference frame, that these face-centered representations are present in both the left and right hemisphere, and that the representations of the left and right halves of a face are dissociable.

Retinal Inputs to the Thalamus Are Selectively Gated by Arousal

The brain can flexibly filter out sensory information in a manner that depends on behavioral state. In the visual thalamus and cortex, arousal and locomotion are associated with changes in the magnitude of responses to visual stimuli. Here, we asked whether such modulation of visual responses might already occur at an earlier stage in this visual pathway. We measured neural activity of retinal axons using wide-field and two-photon calcium imaging in awake mouse thalamus across arousal states associated with different pupil sizes. Surprisingly, visual responses to drifting gratings in retinal axonal boutons were robustly modulated by arousal level in a manner that varied across stimulus dimensions and across functionally distinct subsets of boutons. At low and intermediate spatial frequencies, the majority of boutons were suppressed by arousal. In contrast, at high spatial frequencies, boutons tuned to regions of visual space ahead of the mouse showed enhancement of responses. Arousal-related modulation also varied with a bouton's preference for luminance changes and direction or axis of motion, with greater response suppression in boutons tuned to luminance decrements versus increments, and in boutons preferring motion along directions or axes of optic flow. Together, our results suggest that differential modulation of distinct visual information channels by arousal state occurs at very early stages of visual processing, before the information is transmitted to neurons in visual thalamus. Such early filtering may provide an efficient means of optimizing central visual processing and perception across behavioral contexts.

Method for Calculating Detection Probability of Objects Images by a Human

The article presents the results of research on the development of a method for calculating detection probability of noisy objects images by a human. The proposed calculation method are based on the visual system models, which take into account the features of images pre-processing carried out in the human eyes, as well as at the stages of primary and secondary processing performed in the visual cortex of the brain. Currently two approaches for describing these stages of visual image processing are known. They are based on single-channel and multi-channel models, the mathematical description of which is given in the article. Based on theoretical and experimental studies it is shown that a single-channel model is more appropriate for quantitative evaluation of human detection of binary objects images and a multi-channel model is more appropriate for detection of halftone objects images.

The zebrafish visual system transmits dimming information via multiple segregated pathways.

Vertebrate retinas contain circuits specialized to encode light level decrements. This information is transmitted to the brain by dimming-sensitive OFF retinal ganglion cells (OFF-RGCs) that respond to light decrements with increased firing. It is known that OFF-RGCs with distinct photosensitivity profiles form parallel visual channels to the vertebrate brain, yet how these channels are processed by first- and higher order brain areas has not been well characterized in any species. To address this question in the larval zebrafish visual system, we examined the visual response properties of a genetically identified population of tectal neurons with a defined axonal projection to a second-order visual area: id2b:gal4-positive torus longitudinalis projection neurons (TLPNs). TLPNs responded consistently to whole-field dimming stimuli and exhibited the strongest responses when dimming was preceded by low light levels. Functional characterization of OFF-RGC terminals in tectum revealed responses that varied in their photosensitivities: (a) low-sensitivity OFF-RGCs that selectively respond to large light decrements, (b) high-sensitivity OFF-RGCs that selectively encode small decrements, and (c) broad sensitivity OFF-RGCs that respond to a wide range of light decrements. Diverse photosensitivity profiles were also observed using pan-neuronal calcium imaging to identify dimming-responsive neurons in both tectum and torus longitudinalis. Together, these data support a model in which parallel OFF channels generated in the retina remain segregated across three stages of visual processing. Segregated OFF channels with different sensitivities may allow specific aspects of dimming-evoked behaviors to be modulated by ambient light levels.

Mechanisms of Feature Selectivity and Invariance in Primary Visual Cortex.

Visual object identification requires both selectivity for specific visual features that are important to the object's identity and invariance to feature manipulations. For example, a hand can be shifted in position, rotated, or contracted but still be recognized as a hand. How are the competing requirements of selectivity and invariance built into the early stages of visual processing? Typically, cells in the primary visual cortex are classified as either simple or complex. They both show selectivity for edge-orientation but complex cells develop invariance to edge position within the receptive field (spatial phase). Using a data-driven model that extracts the spatial structures and nonlinearities associated with neuronal computation, we quantitatively describe the balance between selectivity and invariance in complex cells. Phase invariance is frequently partial, while invariance to orientation and spatial frequency are more extensive than expected. The invariance arises due to two independent factors: (1) the structure and number of filters and (2) the form of nonlinearities that act upon the filter outputs. Both vary more than previously considered, so primary visual cortex forms an elaborate set of generic feature sensitivities, providing the foundation for more sophisticated object processing.

Affective Bias without Hemispheric Competition: Evidence for Independent Processing Resources in Each Cortical Hemisphere

We assessed the extent of neural competition for attentional processing resources in early visual cortex between foveally presented task stimuli and peripheral emotional distracter images. Task-relevant and distracting stimuli were shown in rapid serial visual presentation (RSVP) streams to elicit the steady-state visual evoked potential, which serves as an electrophysiological marker of attentional resource allocation in early visual cortex. A task-related RSVP stream of symbolic letters was presented centrally at 15 Hz while distracting RSVP streams were displayed at 4 or 6 Hz in the left and right visual hemifields. These image streams always had neutral content in one visual field and would unpredictably switch from neutral to unpleasant content in the opposite visual field. We found that the steady-state visual evoked potential amplitude was consistently modulated as a function of change in emotional valence in peripheral RSVPs, indicating sensory gain in response to distracting affective content. Importantly, the facilitated processing for emotional content shown in one visual hemifield was not paralleled by any perceptual costs in response to the task-related processing in the center or the neutral image stream in the other visual hemifield. Together, our data provide further evidence for sustained sensory facilitation in favor of emotional distracters. Furthermore, these results are in line with previous reports of a "different hemifield advantage" with low-level visual stimuli and are suggestive of independent processing resources in each cortical hemisphere that operate beyond low-level visual cues, that is, with complex images that impact early stages of visual processing via reentrant feedback loops from higher order processing areas.

Intra-saccadic motion streaks as cues to linking object locations across saccades.

When visual objects shift rapidly across the retina, they produce motion blur. Intra-saccadic visual signals, caused incessantly by our own saccades, are thought to be eliminated at early stages of visual processing. Here we investigate whether they are still available to the visual system and could—in principle—be used as cues for localizing objects as they change locations on the retina. Using a high-speed projection system, we developed a trans-saccadic identification task in which brief but continuous intra-saccadic object motion was key to successful performance. Observers made a saccade to a target stimulus that moved rapidly either up or down, strictly during the eye movement. Just as the target reached its final position, an identical distractor stimulus appeared on the opposite side, resulting in a display of two identical stimuli upon saccade landing. Observers had to identify the original target using the only available clue: the target's intra-saccadic movement. In an additional replay condition, we presented the observers’ own intra-saccadic retinal stimulus trajectories during fixation. Compared to the replay condition, task performance was impaired during saccades but recovered fully when a post-saccadic blank was introduced. Reverse regression analyses and confirmatory experiments showed that performance increased markedly when targets had long movement durations, low spatial frequencies, and orientations parallel to their retinal trajectory—features that promote intra-saccadic motion streaks. Although the potential functional role of intra-saccadic visual signals is still unclear, our results suggest that they could provide cues to tracking objects that rapidly change locations across saccades.

Perceptual saccadic suppression starts in the retina

Visual sensitivity, probed through perceptual detectability of very brief visual stimuli, is strongly impaired around the time of rapid eye movements. This robust perceptual phenomenon, called saccadic suppression, is frequently attributed to active suppressive signals that are directly derived from eye movement commands. Here we show instead that visual-only mechanisms, activated by saccade-induced image shifts, can account for all perceptual properties of saccadic suppression that we have investigated. Such mechanisms start at, but are not necessarily exclusive to, the very first stage of visual processing in the brain, the retina. Critically, neural suppression originating in the retina outlasts perceptual suppression around the time of saccades, suggesting that extra-retinal movement-related signals, rather than causing suppression, may instead act to shorten it. Our results demonstrate a far-reaching contribution of visual processing mechanisms to perceptual saccadic suppression, starting in the retina, without the need to invoke explicit motor-based suppression commands.

Neural Correlates of Own- and Other-Face Perception in Body Dysmorphic Disorder.

BackgroundBody dysmorphic disorder (BDD) is characterized by an excessive preoccupation with one or more perceived flaws in one’s own appearance. Previous studies provided evidence for deficits in configural and holistic processing in BDD. Preliminary evidence suggests abnormalities at an early stage of visual processing. The present study is the first examining early neurocognitive perception of the own face in BDD by using electroencephalography (EEG). We investigated the face inversion effect, in which inverted (upside-down) faces are disproportionately poorly processed compared to upright faces. This effect reflects a disruption of configural and holistic processing, and in consequence a preponderance of featural face processing.MethodsWe recorded face-sensitive event-related potentials (ERPs) in 16 BDD patients and 16 healthy controls, all unmedicated. Participants viewed upright and inverted (upside-down) images of their own face and an unfamiliar other face, each in two facial emotional expressions (neutral vs. smiling). We calculated the early ERP components P100, N170, P200, N250, and the late positive component (LPC), and compared amplitudes among both groups.ResultsIn the early P100, no face inversion effects were found in both groups. In the N170, both groups exhibited the common face inversion effects, with significantly larger N170 amplitudes for inverted than upright faces. In the P200, both groups exhibited larger inversion effects to other (relative to own) faces, with larger P200 amplitudes for other upright than inverted faces. In the N250, no significant group differences were found in face processing. In the LPC, both groups exhibited larger inversion effects to other (relative to own) faces, with larger LPC amplitudes for other inverted than upright faces. These overall patterns appeared to be comparable for both groups. Smaller inversion effects to own (relative to other) faces were observed in none of these components in BDD, relative to controls.ConclusionsThe findings suggest no evidence for abnormalities at all levels of early face processing in our observed sample of BDD patients. Further research should investigate the neural substrates underlying BDD symptomatology.

Nonretinocentric localization of successively presented flashes during smooth pursuit eye movements.

Keeping track of objects in our environment across body and eye movements is essential for perceptual stability and localization of external objects. As of yet, it is largely unknown how this perceptual stability is achieved. A common behavioral approach to investigate potential neuronal mechanisms underlying spatial vision has been the presentation of one brief visual stimulus across eye movements. Here, we adopted this approach and aimed to determine the reference frame of the perceptual localization of two successively presented flashes during fixation and smooth pursuit eye movements (SPEMs). To this end, eccentric flashes with a stimulus onset asynchrony of zero or ± 200 ms had to be localized with respect to each other during fixation and SPEMs. The results were used to evaluate different models predicting the reference frame in which the spatial information is represented. First, we were able to reproduce the well-known effect of relative mislocalization during fixation. Second, smooth pursuit led to a characteristic relative mislocalization, different from that during fixation. A model assuming that relative localization takes place in a nonretinocentric reference frame described our data best. This suggests that the relative localization judgment is performed at a stage of visual processing in which retinal and nonretinal information is available.

Eugenia Chiappe

Eugenia Chiappe