Low-level Visual Processing Research Articles

The effect of covert visual attention on pupil size during perceptual fading

Pupil size is modulated by various cognitive factors such as attention, working memory, mental imagery, and subjective perception. Previous studies examining cognitive effects on pupil size mainly focused on inducing or enhancing a subjective experience of brightness or darkness (for example by asking participants to attend to/ memorize a bright or dark stimulus), and then showing that this affects pupil size. Surprisingly, the inverse has never been done; that is, it is still unknown what happens when a subjective experience of brightness or darkness is eliminated or strongly reduced even though bright or dark stimuli are physically present. Here, we aim to answer this question by using perceptual fading, a phenomenon where a visual stimulus gradually fades from visual awareness despite its continuous presentation. The study contains two blocks: Fading and Non-Fading. In the Fading block, participants were presented with black and white patches with a fuzzy outline that were presented at the same location throughout the block, thus inducing strong perceptual fading. In contrast, in the Non-Fading block, the patches switched sides on each trial, thus preventing perceptual fading. Participants covertly attended to one of the two patches, indicated by a cue, and reported the offset of one of a set of circles that are displayed on top. We hypothesized that pupil size will be modulated by covert visual attention in the Non-Fading block, but that this effect will not (or to a lesser extent) arise in the Fading block. We found that covert visual attention to bright/ dark does modulate pupil size even during perceptual fading (Fading block), but to a lesser extent than when the perceptual experience of brightness/ darkness is preserved (Non-Fading block). This implies that pupil size is always modulated by covert attention, but that the effect decreases as subjective experience of brightness or darkness decreases. In broader terms, this suggests that cognitive modulations of pupil size reflect a mixture of high-level and lower-level visual processing.

Contextual coherence increases perceived numerosity independent of semantic content.

Number perception emerges from multiple stages of visual processing. Understanding how systematic biases in number perception occur within a hierarchy of increasingly complex feature representations helps uncover the multistage processing underlying our visual number sense. Recent work demonstrated that reducing coherence of low-level visual attributes, such as color and orientation, systematically reduces perceived number. Here, we ask when in the visual processing hierarchy coherence affects numerosity perception and specifically whether the coherence effect is exclusive to low-level visual features or instead whether it can be driven by contextual or semantic relationships. We tested adults in an ordinal numerical comparison task with contextual coherence mathematically manipulated using a statistical model of visual object co-occurrence. Across several experiments, we found that arrays with high contextual coherence were perceived as numerically larger than arrays with low contextual coherence. This contextual coherence effect was not attenuated even when we reduced objects to texforms (unrecognizable images that preserve midlevel visual features) or removed semantic content from the images through box scrambling and diffeomorphic warping. Together, these results suggest that visual coherence derived from natural statistics of object co-occurrence systematically alters perceived numerosity at low-level visual processing, even before later stages at which items can be explicitly categorized and identified. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Abnormal basic visual processing functions in binocular fusion disorders

Heterophoria is a common type of binocular fusion disorder that consists of a latent eye misalignment with potential consequences on daily activities such as reading or working on a computer (with CVS). Crowding, a type of contextual modulation, can also impair reading. Our recent studies found an abnormal pattern of low-level visual processing with larger perceptive fields (PF) in heterophoria. The PF is the fundamental processing unit of human vision and both masking and crowding depend on its size. We investigated how heterophoria would impact the PF’s size via a lateral masking experiment and consequently affect the foveal crowding at different letter-spacings (the crowding zone). More specifically, we explored the relationship between crowding, lateral masking, the PF’s size, and the amount of heterophoria. The binocular horizontal PF’s size was larger with heterophoric subjects, in agreement with our previous study. We found a stronger crowding and an extended crowding zone associated with slower response times; this shows that the processing of letter identification under both crowded and uncrowded conditions requires more processing effort in heterophoric individuals. In agreement with previous studies, we found a correlation between the crowding zone and the PF’s size; each was strongly correlated with the amount of phoria. These findings resemble those involving the PF size and the extended crowding found at the fovea in amblyopia and young children. We suggest that these findings could help explain the inter-observers’ variability found in the masking literature, and the reading difficulties often encountered in subjects with high heterophoria.

The Distinctness of Illusory and Non-Illusory Conjunctions in the Perception of Chinese Words: Assessing the Roles of Stimulus Exposure Time.

Previous studies of illusory conjunction (IC) mainly focused on alphabetic languages, while researchers have poorly understood the IC mechanism of Chinese words as an ideographic writing system. In the present study, we aimed to investigate the dynamic changes of IC effects for Chinese words under different stimulus exposure times and spatial arrangements. We conducted two experiments with a 3 (Condition: IC, non-IC-same, non-IC-different) × 3 (Exposure time: 38 ms, 88 ms, 138 ms) within-subject design. The results showed that in the IC condition, the two characters recombined regardless of exposure time as long as they could form an orthographically correct new word, demonstrating the universality of IC. In non-IC conditions, increasing exposure time decreased response time and significantly reduced error rate, indicating that attention played a decisive role in perceptual processing. The spatial arrangement had no impact on IC production. These findings support the feature confirmation account model, suggesting that attention modulates IC through top-down feature confirmation processes. These data expand an understanding of IC mechanisms, validate the role of attention in feature confirmation, and elucidate the inimitable mechanism of the Chinese word IC influenced by both low-level visual processing and high-level cognitive control.

Reduced brain connectivity along the autism spectrum controlled for familial confounding by co-twin design

Previous studies on brain connectivity correlates of autism have often focused on selective connections and yielded inconsistent results. By applying global fiber tracking and utilizing a within-twin pair design, we aimed to contribute to a more unbiased picture of white matter connectivity in association with clinical autism and autistic traits. Eighty-seven twin pairs (n = 174; 55% monozygotic; 24 with clinical autism) underwent diffusion tensor imaging. Linear regressions assessed within-twin pair associations between structural brain connectivity of anatomically defined brain regions and both clinical autism and autistic traits. These were explicitly adjusted for IQ, other neurodevelopmental/psychiatric conditions and multiple testing, and implicitly for biological sex, age, and all genetic and environmental factors shared by twins. Both clinical autism and autistic traits were associated with reductions in structural connectivity. Twins fulfilling diagnostic criteria for clinical autism had decreased brainstem-cuneus connectivity compared to their co-twins without clinical autism. Further, twins with higher autistic traits had decreased connectivity of the left hippocampus with the left fusiform and parahippocampal areas. These associations were also significant in dizygotic twins alone. Reduced brainstem-cuneus connectivity might point towards alterations in low-level visual processing in clinical autism while higher autistic traits seemed to be more associated with reduced connectivity in networks involving the hippocampus and the fusiform gyrus, crucial especially for processing of faces and other (higher order) visual processing. The observed associations were likely influenced by both genes and environment.

Matched or moved? Asymmetry in high- and low-level visual processing of motion events

AbstractConsensus on the extent to which cross-linguistic differences affect event cognition is currently absent. This is partly because cognitive influences of language have rarely been examined within speakers of different languages in tasks that manipulate the level of visual processing. This study presents a novel combination of a high-level approach upregulating the involvement of language, namely self-paced sentence-video verification, and a low-level visual detection method without language use, namely breaking continuous flash suppression (b-CFS) (Yang et al., 2014). The results point to cross-linguistic effects on event cognition by revealing variations in visual processing patterns of manner and path by English versus Mandarin Chinese speakers. Language specificity was found on both levels of processing. An asymmetry in response speed across tasks highlights an important difference between facilitation of detecting contrasts when recruitment of verbal labels is automatic, versus facilitation of verifying correspondences when labels are overt.

Gauging response time distributions to examine the effect of facial expression inversion.

We used images of facial expressions (FEs) of emotion in a speeded Same/Different task to examine (i) distributional characteristics of response times (RTs) in relation to inter-stimulus similarity and (ii) the impact of inversion on FE processing. Stimuli were seven emotion prototypes, posed by one male and one female, and eight intermediate morphs. Image pairs (N = 225) were presented for 500 ms, upright or inverted, in a block design, each 100 times. For both upright and inverted FEs, RTs were a non-monotonic function: median values were longest for stimulus pairs of intermediate similarity, decreasing for both more-dissimilar and more-similar pairs. RTs of "Same" and "Different" judgments followed ex-Gaussian distributions. The non-monotonicity is interpreted within a dual-process decision model framework as reflecting the infrequency of identical pairs, shifting the balance between the Same and Different processes. The effect of stimulus inversion was gauged by comparing RT-based multidimensional scaling solutions for the two presentation modes. Solutions for upright and inverted FEs showed little difference, with both displaying some evidence of categorical perception. The same features appeared in hierarchical clustering solutions. This outcome replicates and reinforces the solutions derived from accuracy of "Different" responses reported in our earlier companion paper. We attribute this lack of inversion effect to the brief exposure time, allowing low-level visual processing to dominate Same/Different decisions while elevating early featural analysis, which is insensitive to face orientation but enables initial positive/negative valence categorization of FEs.

Low-level visual processing of motion events as a window into language-specific effects on perception

Abstract This article brings a new perspective to the currently burgeoning interest in the power of language to influence how speakers from different linguistic backgrounds process motion events. While many studies have targeted high-level decision-based processes, such as Manner-based versus Path-based categorisation or motion event similarity judgments from memory, far less is known about the role of various language systems on low-level automatic processing. The goal of this article is to present an experimental method called breaking continuous flash suppression (b-CFS), critically assess its potential to capture language-induced biases when processing motion through a small-scale feasibility study with English native speakers versus Mandarin native speakers, and to provide practical recommendations with examples of how motion event research can respond to the epistemological challenges that this emerging data elicitation method faces.

Seeing Soft Materials Draped Over Objects: A Case Study of Intuitive Physics in Perception, Attention, and Memory

We typically think of intuitive physics in terms of high-level cognition, but might aspects of physics also be extracted during lower-level visual processing? Might we not only think about physics, but also see it? We explored this using multiple tasks in online adult samples with objects covered by soft materials—as when you see a chair with a blanket draped over it—where you must account for the physical interactions between cloth, gravity, and object. In multiple change-detection experiments (n = 200), observers from an online testing marketplace were better at detecting image changes involving underlying object structure versus those involving only the superficial folds of cloths—even when the latter were more extreme along several dimensions. And in probe-comparison experiments (n = 100), performance was worse when both probes (vs. only one) appeared on image regions reflective of underlying object structure (equating visual properties). This work collectively shows how vision uses intuitive physics to recover the deeper underlying structure of scenes.

Asymmetrical cross-modal influence on neural encoding of auditory and visual features in natural scenes

Natural scenes contain multi-modal information, which is integrated to form a coherent perception. Previous studies have demonstrated that cross-modal information can modulate neural encoding of low-level sensory features. These studies, however, mostly focus on the processing of single sensory events or rhythmic sensory sequences. Here, we investigate how the neural encoding of basic auditory and visual features is modulated by cross-modal information when the participants watch movie clips primarily composed of non-rhythmic events. We presented audiovisual congruent and audiovisual incongruent movie clips, and since attention can modulate cross-modal interactions, we separately analyzed high- and low-arousal movie clips. We recorded neural responses using electroencephalography (EEG), and employed the temporal response function (TRF) to quantify the neural encoding of auditory and visual features. The neural encoding of sound envelope is enhanced in the audiovisual congruent condition than the incongruent condition, but this effect is only significant for high-arousal movie clips. In contrast, audiovisual congruency does not significantly modulate the neural encoding of visual features, e.g., luminance or visual motion. In summary, our findings demonstrate asymmetrical cross-modal interactions during the processing of natural scenes that lack rhythmicity: Congruent visual information enhances low-level auditory processing, while congruent auditory information does not significantly modulate low-level visual processing.

Correlates of clinical variables on early-stage visual processing in schizophrenia and bipolar disorder

The use of noninvasive tools can help understand mental states and changes that are caused by medications, symptom severity, and other clinical variables. We investigated low-level visual processing using the contrast sensitivity function (CSF), a reliable, robust, and widely used approach. Our main purpose was (1) to evaluate visual impairments in schizophrenia (SCZ) and bipolar disorder (BPD) patients and (2) to investigate associations between clinical variables and visual function in both diseases. Fifty-six healthy controls (HCs; mean age = 31.04 years), 42 BPD patients (mean age = 32.84 years) who took only lithium, and 39 SCZ patients who took only olanzapine (mean age = 32.80 years) were recruited for this study. CSF differed between groups. Both groups of patients exhibited lower discrimination at low, mid-, and high spatial frequencies compared with HCs. No differences were observed between patients, with the exception of high spatial frequency. These impairments were also related to clinical variables, revealed by a strong effect in the mediation analyses. These findings may aid investigations of other clinical variables and the role of state- and trait-like effects on visual and cognitive processing in these patient populations. This study underscores the need for visual remediation interventions.

Invited Session V: GABAergic function and dysfunction in visual perception: Sensory processing in autism: Translational markers and circuit-level insights

Atypical sensory experience is estimated to occur in as many as 90% of autistic individuals and to affect every sensory modality: taste, touch, audition, olfaction and vision. Because the neural computations underlying sensory processing are relatively well understood in typically developing individuals and are conserved between humans and other animals, sensory paradigms have considerable potential for shedding light on autistic neurobiology. But are sensory traits, in fact, core phenotypic markers of autism? In this talk, I will argue that the answer is "yes". The evidence I review shows that the autistic cortex is affected by distinct, low-level changes in neural circuitry that is dedicated to perceptual processing (including primary sensory areas). Further, perceptual symptoms in individuals with autism are evident early in development, account for independent variance in diagnostic criteria of the condition, and show a persistent relationship to clinical measures of higher-order social cognition and behavior. Finally, I will present data from a recent line of work in my laboratory using behavioral, neuroimaging, and pharmacological techniques to identify a marker of autism in low-level visual processing, which has provided concrete insight into the neurobiology of autism in humans.

Altered Processing of Visual Stimuli in Vestibular Migraine Patients Between Attacks: A Combined VEP and sLORETA Study.

Objective: Vestibular migraine (VM) is one of the most common causes of recurrent vertigo, but the neural mechanisms that mediate such symptoms remain unknown. Since visual symptoms and photophobia are common clinical features of VM patients, we hypothesized that VM patients have abnormally sensitive low-level visual processing capabilities. This study aimed to investigate cortex abnormalities in VM patients using visual evoked potential (VEP) and standardized low-resolution brain electromagnetic tomography (sLORETA) analysis.Methods: We employed visual stimuli consisting of reversing displays of circular checkerboard patterns to examine “low-level” visual processes. Thirty-three females with VM and 20 healthy control (HC) females underwent VEP testing. VEP components and sLORETA were analyzed.Results: Patients with VM showed significantly lower amplitude and decreased latency of P1 activation compared with HC subjects. Further topographic mapping analysis revealed a group difference in the occipital area around P1 latency. sLORETA analysis was performed in the time frame of the P1 component and showed significantly less activity (deactivation) in VM patients in the frontal, parietal, temporal, limbic, and occipital lobes, as well as sub-lobar regions. The maximum current density difference was in the postcentral gyrus of the parietal lobe. P1 source density differences between HC subjects and VM patients overlapped with the vestibular cortical fields.Conclusion: The significantly abnormal response to visual stimuli indicates altered processing in VM patients. These findings suggest that abnormalities in vestibular cortical fields might be a pathophysiological mechanism of VM.

When a stranger becomes a friend: Measuring the neural correlates of real-world face familiarisation

ABSTRACT Humans can readily and effortlessly learn new faces encountered in the social environment. As a face transitions from unfamiliar to familiar, the ability to generalize across different images of the same person increases substantially. Fast periodic visual stimulation and EEG (FPVS-EEG) was used to isolate identity-specific responses that generalize across different images of the same person from low-level visual processing and face-general processes that aren’t identity-specific. We observed these signals emerge and increase in magnitude as a group of strangers became lab mates (N=9). The neural response to an unfamiliar identity that remained unfamiliar did not change. Comparison of the response to the newly familiarised face to a highly overlearned face (the own-face) showed that this identity-specific signal was modulated by level of familiarity. The study presents the first examination of identity-specific processing changes as they occur in situ from normal, everyday face experience.

Neural mechanisms underlying enhanced visual search performance in action video game players

Individuals who play action video games have demonstrated faster response times on a range of cognitive tasks, but various changes across the chain of processing could contribute to the ultimate quickening in response. Some research has begun to identify neural markers associated with enhanced performance in gamers and has established that there are differences in low-level visual processing, attention allocation and visual working memory. However, gaming-related improvements could also arise from quicker preparation and execution of the motor response, and potential changes in the motor-related LRP have yet to be explored. Additionally, prior work has focused on changes in a limited number of early ERP components in isolation; therefore, further research is required to identify the relative contribution of each stage of processing to the observed behavioural changes. Using similar methodology as Clark et al. (2015), we tested action video-game players and non-video-game players and recorded EEG while participants performed a visual search ‘popout’ task. We assessed amplitudes and latencies of key ERP components, specifically, the N1 (early sensory processing), N2pc (attentional orienting to stimulus), CDA (target processing, discrimination, and manipulation of information in visual short-term memory), and both the stimulus-locked and response-locked LRPs (preparation for motor response). As expected, gamers demonstrated faster response times relative to non-gamers, and EEG analyses revealed the neural mechanisms underlying these behavioural differences. Improved performance in gamers was accompanied by changes across the processing chain from stimulus to response, evidenced by differences from the early sensory-evoked N1 component through to the later motor-related LRP component. Our findings suggest that enhanced visual search performance in action video game players is driven by differences in early sensory processing in combination with changes to later cognitive and motor processes.

Implicit Associations With Nature and Urban Environments: Effects of Lower-Level Processed Image Properties.

Nature experiences usually lead to restorative effects, such as positive affective states and reduced stress. Even watching nature compared to urban images, which are known to differ in several image properties that are processed at early stages, can lead to such effects. One potential pathway explaining how the visual input alone evokes restoration is that image properties processed at early stages in the visual system evoke positive associations. To study these automatic bottom-up processes and the role of lower-level visual processing involved in the restoring effects of nature, we conducted two studies. First, we analyzed nature and urban stimuli for a comprehensive set of image properties. Second, we investigated implicit associations in a dichotomous set of nature and urban images in three domains, namely, valence, mood, and stress restoration. To examine the role of lower-level processing in these associations, we also used stimuli that lacked the spatial information but retained certain image properties of the original photographs (i.e., phase-scrambled images). While original nature images were associated with “good,” “positive mood,” and “restoration,” urban images were associated with “bad” and “stress.” The results also showed that image properties differ between our nature and urban images and that they contribute to the implicit associations with valence, although spatial information and therefore recognition of the environment remained necessary for positive associations. Moreover, lower-level processed image properties seem to play no or only minor roles for associations with mood and stress restoration.

Serial dependence does not originate from low-level visual processing

Perception depends not only on the current sensory input but also on the preceding history of stimuli. In serial dependence (SD), for example, the orientation of a Gabor patch is mistakenly reported as more similar to previous trials than it actually is. This bias is typically observed for moderate orientation differences (<45°) and extends over a few trials in the past. It is hotly debated whether SD originates at perceptual or post-perceptual, e.g., decisional, stages. Here, we provide evidence for the latter hypothesis. We presented Gabor patches with different spatial frequencies or Gabors intermingled with dot patterns. Even though stimuli were perceptually clearly dissimilar, we found robust SD effects arguing against any perceptual account. These findings suggest a re-evaluation of current models and theoretical accounts of SD.

Effects of affective content and motivational context on neural gain functions during naturalistic scene perception.

Visual scene processing is modulated by semantic, motivational, and emotional factors, in addition to physical scene statistics. An open question is to what extent those factors affect low-level visual processing. One index of low-level visual processing is the contrast response function (CRF), representing the change in neural or psychophysical gain with increasing stimulus contrast. Here we aimed to (a) establish the use of an electrophysiological technique for assessing CRFs with complex emotional scenes and (b) examine the effects of motivational context and emotional content on CRFs elicited by naturalistic stimuli, including faces and complex scenes (humans, animals). Motivational context varied by expectancy of threat (a noxious noise) versus safety. CRFs were measured in 18 participants by means of sweep steady-state visual evoked potentials. Results showed a facilitation in visuocortical sensitivity (contrast gain) under threat, compared with safe conditions, across all stimulus categories. Facial stimuli prompted heightened neural response gain, compared with scenes. Within the scenes, response gain was smaller for scenes high in emotional arousal, compared with low-arousing scenes, consistent with interference effects of emotional content. These findings support the notion that motivational context alters the contrast sensitivity of cortical tissue, differing from changes in response gain (activation) when visual cues themselves carry motivational/affective relevance.

Developmental differences in neural connectivity for semantic processing in youths with autism.

Youths with autism spectrum disorder (ASD) rely more on lower-level visual processing as revealed by greater occipital activation, yet less effectively engage higher-level processing of modality-independent semantic knowledge as indicated by reduced frontal activation, compared to typically developing (TD) youths. However, little is known about age-dependent differences in neural connectivity during semantic processing in youths with ASD as compared to TD youths. Four groups were recruited: 31 ASD children (mean age=10.5years old), 33 TD children (mean age=10.4), 30 ASD adolescents (mean age=14.9), and 34 TD adolescents (mean age=15.1). We explored their differences in neural connectivity by using functional magnetic resonance imaging (fMRI) with psychophysiological interaction (PPI) during semantic judgments. In comparison with TD children, children with ASD showed greater activation in the left cuneus and weaker connectivity between the left cuneus and left middle temporal gyrus (MTG). In comparison with TD adolescents, adolescents with ASD showed less activation in the left inferior frontal gyrus (IFG) and weaker functional connectivity between the left IFG and left MTG. Children with ASD may rely more on visual processes in the occipital cortex that are disconnected from modality-independent semantics in the temporal cortex. However, adolescents with ASD may less effectively engage frontal mechanisms involved in the top-down control of modality-independent semantic knowledge in the temporal cortex. Our findings provide evidence of developmental differences in the neural substrates of the alterations in semantic processing in youths with ASD compared to TD youths.

Magnocellular and Parvocellular Mediated Luminance Contrast Discrimination in Severe Alcohol Use Disorder

Severe alcohol use disorder (SAUD) is associated with widespread cognitive impairments, including low-level visual processing deficits that persist after prolonged abstinence. However, the extent and characteristics of these visual deficits remain largely undetermined, impeding the identification of their underlying mechanisms and influence on higher-order processing. In particular, little work has been conducted to assess the integrity of the magnocellular (MC) and parvocellular (PC) visual pathways, namely the 2 main visual streams that convey information from the retina up to striate, extrastriate, and dorsal/ventral cerebral regions. We investigated achromatic luminance contrast processing mediated by inferred MC and PC pathways in 33 patients with SAUD and 32 matched healthy controls using 2 psychophysical pedestal contrast discrimination tasks that promote responses of inferred MC or PC pathways. We relied on a staircase procedure to assess participants' ability to detect small changes in luminance within an array of 4 gray squares that were either continuously presented (steady pedestal, MC-biased) or briefly flashed (pulsed pedestal, PC-biased). We replicated the expected pattern of MC and PC contrast responses in healthy controls. We found preserved dissociation of MC and PC contrast signatures in SAUD but higher MC-mediated mean contrast discrimination thresholds combined with a steeper PC-mediated contrast discrimination slope compared with healthy controls. These findings indicate altered MC-mediated contrast sensitivity and PC-mediated contrast gain, confirming the presence of early sensory disturbances in individuals with SAUD. Such low-level deficits, while usually overlooked, might influence higher-order abilities (e.g., memory, executive functions) in SAUD by disturbing the "coarse-to-fine" tuning of the visual system, which relies on the distinct functional properties of MC and PC pathways and ensures proper and efficient monitoring of the environment.