Early Visual Processing Research Articles

Active search signatures in a free-viewing task exploiting concurrent EEG and eye movements recordings.

Tasks we often perform in our everyday lives, such as reading or looking for a friend in the crowd, are seemingly straightforward but they actually require the orchestrated activity of several cognitive processes. Free-viewing visual search requires a plan to move our gaze on the different items, identifying them, and deciding on whether to continue with the search. Little is known about the electrophysiological signatures of these processes in free-viewing because there are technical challenges associated with eye movement artefacts. Here, we aimed to study how category information, as well as ecologically relevant variables such as the task performed, influence brain activity in a free-viewing paradigm. Participants were asked to observe/search from an array of faces and objects embedded in random noise. We concurrently recorded electroencephalogram and eye movements and applied a deconvolution analysis approach to estimate the contribution of the different elements embedded in the task. Consistent with classical fixed-gaze experiments and a handful of free-viewing studies, we found a robust categorical effect around 150 ms in occipital and occipitotemporal electrodes. We also report a task effect, more negative in posterior central electrodes in visual search compared with exploration, starting at around 80 ms. We also found significant effects of trial progression and an interaction with the task effect. Overall, these results generalise the characterisation of early visual face processing to a wider range of experiments and show how a suitable analysis approach allows to discern among multiple neural contributions to the signal, preserving key attributes of real-world tasks.

Thalamic and primary visual cortex contributions to early visual processing revealed by the N40 and C1 ERP components

Thalamic and primary visual cortex contributions to early visual processing revealed by the N40 and C1 ERP components

Association between retinal and cortical visual electrophysiological impairments in schizophrenia.

Electrophysiological impairments in the magnocellular visual system have been reported among patients with schizophrenia, but previous theories proposed that these deficits may begin in the retina. We therefore sought to evaluate the potential contribution of the retina by comparing retinal and cortical visual electrophysiological impairments between patients with schizophrenia and healthy controls. We recruited patients with schizophrenia and age- and sex-matched healthy controls. We recorded the P100 amplitude and latency using electroencephalography (EEG) while projecting low (0.5 cycles/degree) or high (15 cycles/degree) spatial frequency gratings at a temporal frequency of 0 Hz or 8 Hz. We compared the P100 results with previous results for retinal ganglion cell activity (N95) in these participants. We analyzed data using repeated-measures analysis of variance and correlation analyses. We recruited 21 patients with schizophrenia and 29 age- and sex-matched healthy controls. Results showed decreased P100 amplitude and increased P100 latency among patients with schizophrenia compared with healthy controls (p < 0.05). Analyses reported the main effects of spatial and temporal frequency but no interaction effects of spatial or temporal frequency by group. Moreover, correlation analysis indicated a positive association between P100 latency and previous retinal results for N95 latency in the schizophrenia group (p < 0.05). Alterations in the P100 wave among patients with schizophrenia are consistent with the deficits in early visual cortical processing shown in the literature. These deficits do not seem to correspond to an isolated magnocellular deficit but appear to be associated with previous retinal measurements. Such an association emphasizes the role of the retina in the occurrence of visual cortical abnormalities in schizophrenia. Studies with coupled electroretinography-EEG measurements are now required to further explore these findings. https://clinicaltrials.gov/ct2/show/NCT02864680.

Hierarchical status is rapidly assessed from behaviourally dominant faces

Recognition of social hierarchy is a key feature that helps us navigate through our complex social environment. Neuroimaging studies have identified brain structures involved in the processing of hierarchical stimuli, but the precise temporal dynamics of brain activity associated with such processing remains largely unknown. In this investigation, we used event-related potentials (ERPs) to examine the effect of social hierarchy on the neural responses elicited by dominant and nondominant faces. Participants played a game where they were led to believe that they were middle-rank players, responding alongside other alleged players, whom they perceived as higher or lower-ranking. ERPs were examined in response to dominant and nondominant faces, and low-resolution electromagnetic tomography (LORETA) was used to identify the implicated brain areas. The results revealed that the amplitude of the N170 component was enhanced for faces of dominant individuals, showing that hierarchy influences the early stages of face processing. A later component, the late positive potential (LPP) appearing between 350–700 ms, also was enhanced for faces of higher-ranking players. Source localisation suggested that the early modulation was due to an enhanced response in limbic regions. These findings provide electrophysiological evidence for enhanced early visual processing of socially dominant faces.

Emotional stimuli similarly disrupt attention in both visual fields

ABSTRACT People often need to filter relevant from irrelevant information. Irrelevant emotional distractors interrupt this process. But does the degree to which emotional distractors disrupt attention depend on which visual field they appear in? We thought it might for two reasons: (1) people pay slightly more attention to the left than the right visual field, and (2) some research suggests the right-hemisphere (which, in early visual processing, receives left visual field input) has areas specialised for processing emotion. Participants viewed a rapid image-stream in each visual field and reported the rotation of an embedded neutral target preceded by a negative or neutral distractor. We predicted that the degree to which negative (vs. neutral) distractors impaired target detection would be larger when targets appeared in the left than the right stream. This hypothesis was supported, but only when the distractor and target could appear in the same or opposite stream as each other (Experiments 2a–b), not when they always appeared in the same stream as each other (Experiments 1a–1b). However, this effect was driven by superior left-stream accuracy following neutral distractors, and similar left- and right-stream accuracy following negative distractors. Emotional distractors therefore override visuospatial asymmetries and disrupt attention, regardless of visual field.

Early visual perceptual processing is altered in obsessive–compulsive disorder

ObjectiveExisting studies have shown changes in attention and emotion processing of disorder-relevant visual stimuli in those with obsessive compulsive disorder (OCD). However, early visual processing in OCD has not been assessed, as previous studies did not examine the entire time course of visual processing but instead assessed potential differences in pre-determined visual evoked potentials (VEPs). This study investigates the entire visual processing stream in OCD compared to healthy age-matched controls (HC) using emotionally-neutral visual stimuli and a data-driven rather than hypothesis-driven approach. Methods35 HC and 26 participants with OCD underwent EEG recording while completing a modified Eriksen flanker task. Permutation-controlled t-tests were used to identify group differences in the data’s full time course of visual evoked potentials. Baseline-corrected amplitudes at time points where the groups were significantly different were analyzed using ANCOVAs with BDI, BAI, and SNAP-inattentiveness scores included as covariates. ResultsThis analysis identified enhanced P1 amplitudes to two visual stimuli (the initial flanker and the stimulus), corresponding to time windows of 65–93 ms and 157–187 ms post-flanker presentation in the OCD group compared to controls. Group (OCD vs. HC) was the strongest predictor of VEP amplitude during both time windows, with no significant influences of any covariates. ConclusionsThis study showed an enhanced P1 component in people with OCD to neutral visual stimuli, potentially reflecting either inefficient or excessive early visual processing in this population. Additional inquiry is necessary to determine whether altered visual processing is associated with the sensory hypervigilance observed in those with OCD. SignificanceThis work identifies early visual processing alterations in OCD using neutral stimuli and a data-driven approach.

Oxytocin has sex-specific effects on trust and underlying neurophysiological processes

The neuropeptide oxytocin (OT) regulates mammalian social approach behavior across sexes. Yet most OT studies in humans exclusively investigated men. Here, we studied sex differences in OT’s effects on human trust behavior in 144 heterosexual participants (73 women, 71 men). Participants received 24 international units of intranasal OT or placebo treatment and played a trust game in the role of the investor while undergoing electroencephalography. Trustees were represented by photos of the other sex gradually varying in their pre-rated intensities of facial features signaling attractiveness and threat. On a behavioral level, we observed that OT increased trust in men and reduced it in women when trustees showed weak signals of attractiveness and threat. Correspondingly, on the neurophysiological level, we noted that OT intensified the P100 in male participants, but dampened it in female ones. Our findings demonstrate OT’s sex- and context-specific effects on social approach behavior and an underlying early visual attention-related brain process. This evidence demonstrates the need to consider psychobiological mechanisms of sexual dimorphism in human OT research.

Serotonin has an eye for detail

In this issue of Neuron, Reggiani etal.1 show that serotonin and arousal suppress retinal inputs to the thalamus with opposing feature sensitivity, providing an elegant means for neuromodulation to selectively filter early visual processing.

Disruption of early visual processing in amyloid-positive healthy individuals and mild cognitive impairment

BackgroundAmyloid deposition is a primary predictor of Alzheimer’s disease (AD) and related neurodegenerative disorders. Retinal changes involving the structure and function of the ganglion cell layer are increasingly documented in both established and prodromal AD. Visual event-related potentials (vERP) are sensitive to dysfunction in the magno- and parvocellular visual systems, which originate within the retinal ganglion cell layer. The present study evaluates vERP as a function of amyloid deposition in aging, and in mild cognitive impairment (MCI).MethodsvERP to stimulus-onset, motion-onset, and alpha-frequency steady-state (ssVEP) stimuli were obtained from 16 amyloid-positive and 41 amyloid-negative healthy elders and 15 MCI individuals and analyzed using time–frequency approaches. Social cognition was assessed in a subset of individuals using The Awareness of Social Inference Test (TASIT).ResultsNeurocognitively intact but amyloid-positive participants and MCI individuals showed significant deficits in stimulus-onset (theta) and motion-onset (delta) vERP generation relative to amyloid-negative participants (all p < .01). Across healthy elders, a composite index of these measures correlated highly (r = − .52, p < .001) with amyloid standardized uptake value ratios (SUVR) and TASIT performance. A composite index composed of vERP measures significant differentiated amyloid-positive and amyloid-negative groups with an overall classification accuracy of > 70%.DiscussionvERP may assist in the early detection of amyloid deposition among older individuals without observable neurocognitive impairments and in linking previously documented retinal deficits in both prodromal AD and MCI to behavioral impairments in social cognition.

Visual-spatial processing impairment in the occipital-frontal connectivity network at early stages of Alzheimer's disease.

Alzheimer's disease (AD) is the leading cause of dementia worldwide, but its pathophysiological phenomena are not fully elucidated. Many neurophysiological markers have been suggested to identify early cognitive impairments of AD. However, the diagnosis of this disease remains a challenge for specialists. In the present cross-sectional study, our objective was to evaluate the manifestations and mechanisms underlying visual-spatial deficits at the early stages of AD. We combined behavioral, electroencephalography (EEG), and eye movement recordings during the performance of a spatial navigation task (a virtual version of the Morris Water Maze adapted to humans). Participants (69-88 years old) with amnesic mild cognitive impairment-Clinical Dementia Rating scale (aMCI-CDR 0.5) were selected as probable early AD (eAD) by a neurologist specialized in dementia. All patients included in this study were evaluated at the CDR 0.5 stage but progressed to probable AD during clinical follow-up. An equal number of matching healthy controls (HCs) were evaluated while performing the navigation task. Data were collected at the Department of Neurology of the Clinical Hospital of the Universidad de Chile and the Department of Neuroscience of the Faculty of Universidad de Chile. Participants with aMCI preceding AD (eAD) showed impaired spatial learning and their visual exploration differed from the control group. eAD group did not clearly prefer regions of interest that could guide solving the task, while controls did. The eAD group showed decreased visual occipital evoked potentials associated with eye fixations, recorded at occipital electrodes. They also showed an alteration of the spatial spread of activity to parietal and frontal regions at the end of the task. The control group presented marked occipital activity in the beta band (15-20 Hz) at early visual processing time. The eAD group showed a reduction in beta band functional connectivity in the prefrontal cortices reflecting poor planning of navigation strategies. We found that EEG signals combined with visual-spatial navigation analysis, yielded early and specific features that may underlie the basis for understanding the loss of functional connectivity in AD. Still, our results are clinically promising for early diagnosis required to improve quality of life and decrease healthcare costs.

Temporal dynamics of cognitive flexibility in adolescents with anorexia nervosa: A high-density EEG study.

Impairment in cognitive flexibility is a core symptom of anorexia nervosa (AN) and is associated with treatment resistance. Nevertheless, studies on the neural basis of cognitive flexibility in adolescent AN are rare. This study aimed to investigate brain networks underlying cognitive flexibility in adolescents with AN. To address this aim, participants performed a Dimensional Change Card Sorting task during high-density electroencephalography (EEG) recording. Anxiety was measured with the State-Trait Anxiety Inventory. Data were collected on 22 girls with AN and 23 controls. Evoked responses were investigated using global-spatial analysis. Adolescents with AN showed greater overall accuracy, fewer switch trial errors and reduced inverse efficiency switch cost relative to controls, although these effects disappeared after adjusting for trait and state anxiety. EEG results indicated augmented early visual orienting processing (P100) and subsequent impaired attentional mechanisms to task switching (P300b) in subjects with AN. During task switching, diminished activations in subjects with AN were identified in the posterior cingulate, calcarine sulcus and cerebellum, and task repetitions induced diminished activations in a network involving the medial prefrontal cortex, and several posterior regions, compared with controls. No significant associations were found between measures of cognitive flexibility and anxiety in the AN group. Findings of this study suggest atypical neural mechanisms underlying cognitive flexibility in adolescents with AN. More importantly, our findings suggest that different behavioural profiles in AN could relate to differences in anxiety levels. Future research should investigate the efficacy of cognitive training to rebalance brain networks of cognitive flexibility in AN.

Classification of objects and scenes by a neural network with pretrained input modules to decode spatial texture inhomogeneities

Subject of study. The study investigated the possibility of using neural network models of second-order visual mechanisms as inputs for neural network classifiers. Second-order visual mechanisms can detect spatial inhomogeneities in the contrast, orientation, and spatial frequency of an image. These mechanisms are traditionally considered one of the stages of early visual processing; their role in the perception of textures has been well studied. Aim of study. The study aimed to investigate whether the use of classifier input modules pretrained to demodulate the spatial modulations of luminance gradients contributed to object and scene classifications. Method. Neural network modeling was used as the main method. At the first stage of the study, a set of texture images was generated to train neural network models of second-order visual mechanisms. At the second stage, the object and scene samples were prepared, based on which classifier networks were trained. Pretrained models of second-order visual mechanisms with fixed weights were applied as these network inputs. Main results. The second-order information presented as a map of instantaneous values of the modulation function of contrast, orientation, and spatial frequency of the image was sufficient for the identification of only some of the scene classes. In general, the use of the values of luminance gradient modulation functions for object classification proved to be ineffective within the proposed neural network architectural framework. Thus, the hypothesis stating that second-order visual filters encode features enabling the identification of objects was not confirmed. This result makes it necessary to test an alternative hypothesis stating that the role of second-order filters is limited to the construction of saliency maps, and filters are windows through which information is received from the first-order filter outputs. Practical significance. The possibility of using second-order models of visual mechanisms in computer vision systems was assessed.

Exploring the Distinctiveness of Early Visual Processing in Human and Illusory Faces: An ERP Study of Spatial Frequency Effects

Exploring the Distinctiveness of Early Visual Processing in Human and Illusory Faces: An ERP Study of Spatial Frequency Effects

The influence of spatial frequency and luminance on early visual processing: A fixation-related potentials approach

The influence of spatial frequency and luminance on early visual processing: A fixation-related potentials approach

Attentional capture mediates the emergence and suppression of intrusive memories.

Intrusive memories hijack consciousness and their control may lead to forgetting. However, the contribution of reflexive attention to qualifying a memory signal as interfering is unknown. We used machine learning to decode the brain's electrical activity and pinpoint the otherwise hidden emergence of intrusive memories reported during a memory suppression task. Importantly, the algorithm was trained on an independent attentional model of visual activity, mimicking either the abrupt and interfering appearance of visual scenes into conscious awareness or their deliberate exploration. Intrusion of memories into conscious awareness were decoded above chance. The decoding accuracy increased when the algorithm was trained using a model of reflexive attention. Conscious detection of intrusive activity decoded from the brain signal was central to the future silencing of suppressed memories and laterforgetting. Unwanted memories require the reflexive orienting of attention and access to consciousness to be suppressed effectively by inhibitory control.

Voluntary self-initiation of the stimuli onset improves working memory and accelerates visual and attentional processing

The ability of an organism to voluntarily control the stimuli onset modulates perceptual and attentional functions. Since stimulus encoding is an essential component of working memory (WM), we conjectured that controlling the initiation of the perceptual process would positively modulate WM. To corroborate this proposition, we tested twenty-five healthy subjects in a modified-Sternberg WM task under three stimuli presentation conditions: an automatic presentation of the stimuli, a self-initiated presentation of the stimuli (through a button press), and a self-initiated presentation with random-delay stimuli onset. Concurrently, we recorded the subjects' electroencephalographic signals during WM encoding. We found that the self-initiated condition was associated with better WM accuracy, and earlier latencies of N1, P2 and P3 evoked potential components representing visual, attentional and mental review of the stimuli processes, respectively. Our work demonstrates that self-initiated stimuli enhance WM performance and accelerate early visual and attentional processes deployed during WM encoding. We also found that self-initiated stimuli correlate with an increased attentional state compared to the other two conditions, suggesting a role for temporal stimuli predictability. Our study remarks on the relevance of self-control of the stimuli onset in sensory, attentional and memory updating processing for WM.

Cerebral achromatopsia

AbstractChromatic sensitivity was assessed in patients with pregeniculate and postgeniculate lesions. We examine changes in central vision along at foveal fixation and in each of the four paracentral quadrants of the visual field using the Colour Assessment and Diagnosis (CAD) test, a dynamic luminance contrast masking technique that isolates the use of Red / Green (RG) and Yellow / Blue (YB) colour signals. Because the extraction of colour signals in early visual processing involves opponent mechanisms, subjects with congenital RG loss of sensitivity exhibit symmetric increase in thresholds towards the long wavelength (“red”) and middle wavelength (“green”) regions of the spectrum locus. This is also frequently the case with acquired loss of chromatic sensitivity as a result of retinal or optic nerve disease. The findings from this study represent an exception to this rule. The patients investigated showed a marked asymmetry in colour thresholds. The study reveals how discrete, localized damage to visual pathways can cause selective loss of visual function and how the latter varies with retinal topography.The 36 pregeniculate patients investigated exhibited impairment in both RG and YB. Loss of colour vision was symmetrical for both RG and YB discrimination. Some pregeniculate patients exhibited substantial loss of colour vision in areas where perimetric loss was largely absent. All quadrants revealed similar symmetric loss of colour sensitivity.In 23 patients with postgeniculate lesions, patients with pre‐striate damage exhibited symmetric loss of chromatic sensitivity which affected either one or both chromatic mechanisms. Striate or extra‐striate lesions tended to exhibit general loss of colour vision within the area identified by visual field testing. More specific chromatic loss was associated with less impaired areas that were often normal on perimetric testing. Some patients with striate or extra‐striate lesions presented with asymmetric chromatic loss for one or more colour categories. When striate or extra‐striate lesions were also accompanied by underlying pre‐striate damage, chromatic sensitivity loss was always symmetric.The findings from this study show that the loss of chromatic sensitivity in cerebral achromatopsia depends strongly on the exact location and extent of the lesion with significant variation over the visual field. The same subject can exhibit loss of chromatic sensitivity that is either RG or YB specific, but also, spatially localized, non‐opponent loss of sensitivity for primary colours.

Concurrent contextual and time-distant mnemonic information co-exist as feedback in the human visual cortex

Efficient processing of the visual environment necessitates the integration of incoming sensory evidence with concurrent contextual inputs and mnemonic content from our past experiences. To examine how this integration takes place in the brain, we isolated different types of feedback signals from the neural patterns of non-stimulated areas of the early visual cortex in humans (i.e., V1 and V2). Using multivariate pattern analysis, we showed that both contextual and time-distant information, coexist in V1 and V2 as feedback signals. In addition, we found that the extent to which mnemonic information is reinstated in V1 and V2 depends on whether the information is retrieved episodically or semantically. Critically, this reinstatement was independent on the retrieval route in the object-selective cortex. These results demonstrate that our early visual processing contains not just direct and indirect information from the visual surrounding, but also memory-based predictions.

Neural processing of lateralised task-irrelevant fearful faces under different awareness conditions

The neural fate of task-irrelevant emotional faces under different awareness conditions is poorly understood. Here, we examined the electrophysiological activity during an experiment where the location of target information (contrast-induced line) was manipulated orthogonally to the location of task-irrelevant fearful faces, under subliminal or supraliminal viewing conditions. We found that only target lines elicited an N2-posterior-contralateral (N2pc), indexing spatial attention shifting, in the supraliminal condition. No N2pc was found for the targets in the subliminal condition or for task-irrelevant fearful faces in either conditions. However, the mere presence of a fearful face enhanced early neural activity between 200 and 300 ms only in the subliminal condition. Additionally, the presence of a target line, but not a fearful face, enhanced the P3. Our results suggest that the N2pc is dependent on visual awareness and task-relevancy of the information and that laterally-presented task-irrelevant fearful expressions can be processed without awareness during early visual processing.

Weighted summation and contrast normalization account for short-latency disparity vergence responses to white noise stimuli in humans.

Natural images are typically broadband, whereas detectors in early visual processing are selective for narrow ranges of spatial frequency. White noise patterns are widely used in laboratory settings to investigate how responses are derived from Fourier components in the image. Here, we report disparity vergence responses (DVRs) to white noise stimuli in human subjects and compare these with responses to white noise patterns filtered with bandpass filters and notch filters and to sinusoidal gratings. Although the contribution of these short-latency eye movements to the overall vergence response to a given stimulus is generally small, they have proven to be a valuable tool for the study of the early mechanisms that process disparity stimuli in human subjects. Removing lower spatial frequency (SF) components reduced DVR amplitude, whereas removing higher SF components led to an increase in DVR amplitude. For larger disparities, the transition occurred at lower SFs. All of these effects were quantitatively well described by a model that combined two factors: (a) an excitatory drive determined by a weighted sum of stimulus Fourier components, which was scaled by (b) a contrast normalization mechanism.