High-level Visual Processing Research Articles

Detection of distortions in images of natural scenes in mild traumatic brain injury patients

Mild traumatic brain injuries (mTBI) frequently lead to the impairment of visual functions including blurred and/or distorted vision, due to the disruption of visual cortical mechanisms. Previous mTBI studies have focused on specific aspects of visual processing, e.g., stereopsis, using artificial, low-level, stimuli (e.g., Gaussian patches and gratings). In the current study we investigated high-level visual processing by employing images of real world natural scenes as our stimuli. Both an mTBI group and control group composed of healthy observers were tasked with detecting sinusoidal distortions added to the natural scene stimuli as a function of the distorting sinusoid’s spatial frequency. It was found that the mTBI group were equally as sensitive to high frequency distortions as the control group. However, sensitivity decreased more rapidly with decreasing distortion frequency in the mTBI group relative to the controls. These data reflect a deficit in the mTBI group to spatially integrate over larger regions of the scene.

Ferrets as a Model for Higher-Level Visual Motion Processing

Ferrets are a major developmental animal model due to their early parturition. Here we show for the first time that ferrets could be used to study development of higher-level visual processes previously identified in primates. In primates, complex motion processing involves primary visual cortex (V1), which generates local motion signals, and higher-level visual area MT, which integrates these signals over more global spatial regions. Our data show similar transformations in motion signals between ferret V1 and higher-level visual area PSS, located in the posterior bank of the suprasylvian sulcus. We found that PSS neurons, like MT neurons, were tuned for stimulus motion and showed strong suppression between opposing direction inputs. Most strikingly, PSS, like MT, exhibited robust global motion signals when tested with coherent plaids-the classic test for motion integration across multiple moving elements. These PSS responses were described well by computational models developed for MT. Our findings establish the ferret as a strong animal model for development of higher-level visual processing.

Manipulating and decoding subjective gaming experience during active gameplay: a multivariate, whole-brain analysis

A large number of perceptual and cognitive processes are instantiated during active gameplay, culminating in what is termed the overall “gaming experience”, which encapsulates multiple, subjective dimensions of how one feels about the game. Although some research has been conducted into the neural mechanisms underlying the gaming experience, previous studies so far have relied on commercial games that provide little control over key aspects of gameplay and also have focused only on a few individual dimensions of the gaming experience. Here, we used a custom-made, immersive driving car game in four different gameplay versions (baseline, obstacle increase, goal decrease, speed increase) to assess and modulate the subjective gameplay experience while participants underwent a fMRI scan. A multivariate correlation analysis of whole-brain neural activity with behaviorally-identified subjective gaming experience uncovered brain networks associated with different experiences, including higher-level visual processing networks, the default network, and emotional areas. These regions were in addition able to decode the four different game conditions above chance. Our results for the first time describe the full range of cortical networks that become engaged to create the subjective experience during active gameplay.

Are visual processes causally involved in “perceptual simulation” effects in the sentence-picture verification task?

Many studies have shown that sentences implying an object to have a certain shape produce a robust reaction time advantage for shape-matching pictures in the sentence-picture verification task. Typically, this finding has been interpreted as evidence for perceptual simulation, i.e., that access to implicit shape information involves the activation of modality-specific visual processes. It follows from this proposal that disrupting visual processing during sentence comprehension should interfere with perceptual simulation and obliterate the match effect. Here we directly test this hypothesis. Participants listened to sentences while seeing either visual noise that was previously shown to strongly interfere with basic visual processing or a blank screen. Experiments 1 and 2 replicated the match effect but crucially visual noise did not modulate it. When an interference technique was used that targeted high-level semantic processing (Experiment 3) however the match effect vanished. Visual noise specifically targeting high-level visual processes (Experiment 4) only had a minimal effect on the match effect. We conclude that the shape match effect in the sentence-picture verification paradigm is unlikely to rely on perceptual simulation.

Enhancement of letter identification by concurrent auditory stimuli of varying duration

Previously it has been shown that the concurrent presentation of a sound can improve processing of visual information at higher perceptual levels, for example, in letter identification tasks. Moreover, increasing the duration of the concurrent sounds can enhance performance in low-level tasks as contrast detection, which has been attributed to a sustained visual activation corresponding to the duration of the sound. Yet, the role of sound duration has so far not been investigated in higher-level visual processing. In a series of five Experiments, we again demonstrated that the mere presence of a concurrent sound can enhance the identification of a masked, centrally presented letter compared to unimodal presentation, even though this benefit was absent in one experiment for high-contrast letters yielding an especially high level of task-performance. In general, however, the sound-induced benefit was not modulated by a variation of target contrast or by the duration of the target-to-mask interstimulus interval. Taking individual performance differences into account, a further analysis suggested that the sound-induced facilitation effect may nevertheless be most pronounced at specific performance levels. Beyond this general sound-induced facilitation, letter identification performance was not further affected by the duration of the concurrent sounds, even though in a control experiment it could be established that letter identification performance improved with increasing letter duration, and perceived letter duration was prolonged with increasing auditory duration. The results and their interpretation with respect to the large observed interindividual performance differences are discussed in terms of potential underlying mechanisms of multisensory facilitation, as preparedness enhancement, signal enhancement, and object enhancement.

Specific problems in visual cognition of dyslexic readers: Face discrimination deficits predict dyslexia over and above discrimination of scrambled faces and novel objects

Evidence of interdependencies of face and word processing mechanisms suggest possible links between reading problems and abnormal face processing. In two experiments we assessed such high-level visual deficits in people with a history of reading problems. Experiment 1 showed that people who were worse at face matching had greater reading problems. In experiment 2, matched dyslexic and typical readers were tested, and difficulties with face matching were consistently found to predict dyslexia over and above both novel-object matching as well as matching noise patterns that shared low-level visual properties with faces. Furthermore, ADHD measures could not account for face matching problems. We speculate that reading difficulties in dyslexia are partially caused by specific deficits in high-level visual processing, in particular for visual object categories such as faces and words with which people have extensive experience.

Scene and human face recognition in the central vision of patients with glaucoma.

Primary open-angle glaucoma (POAG) firstly mainly affects peripheral vision. Current behavioral studies support the idea that visual defects of patients with POAG extend into parts of the central visual field classified as normal by static automated perimetry analysis. This is particularly true for visual tasks involving processes of a higher level than mere detection. The purpose of this study was to assess visual abilities of POAG patients in central vision. Patients were assigned to two groups following a visual field examination (Humphrey 24–2 SITA-Standard test). Patients with both peripheral and central defects and patients with peripheral but no central defect, as well as age-matched controls, participated in the experiment. All participants had to perform two visual tasks where low-contrast stimuli were presented in the central 6° of the visual field. A categorization task of scene images and human face images assessed high-level visual recognition abilities. In contrast, a detection task using the same stimuli assessed low-level visual function. The difference in performance between detection and categorization revealed the cost of high-level visual processing. Compared to controls, patients with a central visual defect showed a deficit in both detection and categorization of all low-contrast images. This is consistent with the abnormal retinal sensitivity as assessed by perimetry. However, the deficit was greater for categorization than detection. Patients without a central defect showed similar performances to the controls concerning the detection and categorization of faces. However, while the detection of scene images was well-maintained, these patients showed a deficit in their categorization. This suggests that the simple loss of peripheral vision could be detrimental to scene recognition, even when the information is displayed in central vision. This study revealed subtle defects in the central visual field of POAG patients that cannot be predicted by static automated perimetry assessment using Humphrey 24–2 SITA-Standard test.

Encoding of event roles from visual scenes is rapid, spontaneous, and interacts with higher-level visual processing

A crucial component of event recognition is understanding event roles, i.e. who acted on whom: boy hitting girl is different from girl hitting boy. We often categorize Agents (i.e. the actor) and Patients (i.e. the one acted upon) from visual input, but do we rapidly and spontaneously encode such roles even when our attention is otherwise occupied? In three experiments, participants observed a continuous sequence of two-person scenes and had to search for a target actor in each (the male/female or red/blue-shirted actor) by indicating with a button press whether the target appeared on the left or the right. Critically, although role was orthogonal to gender and shirt color, and was never explicitly mentioned, participants responded more slowly when the target’s role switched from trial to trial (e.g., the male went from being the Patient to the Agent). In a final experiment, we demonstrated that this effect cannot be fully explained by differences in posture associated with Agents and Patients. Our results suggest that extraction of event structure from visual scenes is rapid and spontaneous.

Characterization of diplopia in non-demented patients with Parkinson's disease

IntroductionAlthough diplopia is considered a frequent symptom of Parkinson's disease (PD), little is known about its clinical manifestation, associated mechanisms and treatment. Here we characterized binocular diplopia in non-demented PD patients in an interdisciplinary setting. MethodsPD patients were prospectively screened for diplopia, visual hallucinations, problems with spatial perception, contrast sensitivity, presence of blurred vision, and history of ophthalmological comorbidities via interview. Two groups of PD patients, one with and one without diplopia, underwent clinical and ophthalmological assessment to characterize diplopia in these patients. Clinical features were investigated using the Unified Parkinson's Disease Rating Scale and the Non-Motor Symptoms Scale. ResultsThe frequency of binocular diplopia was 29.6% (n = 37) in our cohort of 125 Parkinson's disease patients. Related mechanisms were heterogeneous including convergence insufficiency, strabismus, and motor fluctuations, as well as symptoms related to visual hallucinations. Diplopia was associated with other visual disturbances like visual hallucinations, blurred vision and problems with spatial perception. Beyond that, diplopia was found to be a predictive factor (3.2, odds ratio) for the occurrence of visual hallucinations in PD. ConclusionBinocular diplopia represents a frequent and relevant symptom in PD patients. Different subtypes should be considered due to different associated mechanisms including ophthalmic pathology and motor fluctuation, as well as intermediate to higher level visual processes. Diplopia seems to be part of a continuous spectrum of positive visual symptoms in Parkinson's disease.

Effects of social and non-social stress on social behavior in health and social anxiety disorder

High-level visual object processing is often assumed to be largely position-independent. Here we demonstrate that when faces and non-face objects simultaneously appear in opposite visual hemifields, the face-sensitive N170 component of the event-related brain potential (ERP) is exclusively generated in the contralateral hemisphere. The effects of face inversion on N170 amplitudes and latencies also show strong contralateral biases. These results reveal that retinotopic biases in low-level visual cortex extend well into category-selective high-level vision. We suggest that the contralateral organisation of face-sensitive visual processing results from generic competitive interactions between hemispheres during the simultaneous perception of visual objects.

A lightweight, inexpensive robotic system for insect vision

Designing hardware for miniaturized robotics which mimics the capabilities of flying insects is of interest, because they share similar constraints (i.e. small size, low weight, and low energy consumption). Research in this area aims to enable robots with similarly efficient flight and cognitive abilities. Visual processing is important to flying insects' impressive flight capabilities, but currently, embodiment of insect-like visual systems is limited by the hardware systems available. Suitable hardware is either prohibitively expensive, difficult to reproduce, cannot accurately simulate insect vision characteristics, and/or is too heavy for small robotic platforms. These limitations hamper the development of platforms for embodiment which in turn hampers the progress on understanding of how biological systems fundamentally work. To address this gap, this paper proposes an inexpensive, lightweight robotic system for modelling insect vision. The system is mounted and tested on a robotic platform for mobile applications, and then the camera and insect vision models are evaluated. We analyse the potential of the system for use in embodiment of higher-level visual processes (i.e. motion detection) and also for development of navigation based on vision for robotics in general. Optic flow from sample camera data is calculated and compared to a perfect, simulated bee world showing an excellent resemblance.

High level visual processing is not spared from the attentional blink

High level visual processing is not spared from the attentional blink

Encoding of event roles from visual scenes is rapid, automatic, and interacts with higher-level visual processing

Encoding of event roles from visual scenes is rapid, automatic, and interacts with higher-level visual processing

Visual Field Map Clusters in High-Order Visual Processing: Organization of V3A/V3B and a New Cloverleaf Cluster in the Posterior Superior Temporal Sulcus.

The cortical hierarchy of the human visual system has been shown to be organized around retinal spatial coordinates throughout much of low- and mid-level visual processing. These regions contain visual field maps (VFMs) that each follows the organization of the retina, with neighboring aspects of the visual field processed in neighboring cortical locations. On a larger, macrostructural scale, groups of such sensory cortical field maps (CFMs) in both the visual and auditory systems are organized into roughly circular cloverleaf clusters. CFMs within clusters tend to share properties such as receptive field distribution, cortical magnification, and processing specialization. Here we use fMRI and population receptive field (pRF) modeling to investigate the extent of VFM and cluster organization with an examination of higher-level visual processing in temporal cortex and compare these measurements to mid-level visual processing in dorsal occipital cortex. In human temporal cortex, the posterior superior temporal sulcus (pSTS) has been implicated in various neuroimaging studies as subserving higher-order vision, including face processing, biological motion perception, and multimodal audiovisual integration. In human dorsal occipital cortex, the transverse occipital sulcus (TOS) contains the V3A/B cluster, which comprises two VFMs subserving mid-level motion perception and visuospatial attention. For the first time, we present the organization of VFMs in pSTS in a cloverleaf cluster. This pSTS cluster contains four VFMs bilaterally: pSTS-1:4. We characterize these pSTS VFMs as relatively small at ∼125 mm2 with relatively large pRF sizes of ∼2–8° of visual angle across the central 10° of the visual field. V3A and V3B are ∼230 mm2 in surface area, with pRF sizes here similarly ∼1–8° of visual angle across the same region. In addition, cortical magnification measurements show that a larger extent of the pSTS VFM surface areas are devoted to the peripheral visual field than those in the V3A/B cluster. Reliability measurements of VFMs in pSTS and V3A/B reveal that these cloverleaf clusters are remarkably consistent and functionally differentiable. Our findings add to the growing number of measurements of widespread sensory CFMs organized into cloverleaf clusters, indicating that CFMs and cloverleaf clusters may both be fundamental organizing principles in cortical sensory processing.

Neural activity during production of rorschach responses: An fMRI study

Recently, a lot of effort has been made to ground Rorschach interpretations to their evidence base. To date, however, no studies have yet described, via fMRI, what brain areas get involved when one takes the Rorschach. To fill this gap in the literature, we administered the ten-inkblot stimuli to 26 healthy volunteers during fMRI. Analysis of BOLD signals revealed that, compared to fixating a cross, looking at the Rorschach inkblots while thinking of what they might be associated with higher temporo-occipital and fronto-parietal activations, and with greater activity in some small, sub-cortical regions included in the limbic system. These findings are in line with the traditional conceptualization of the test, as they suggest that taking the Rorschach involves (a) high-level visual processing, (b) top-down as well as bottom-up attentional processes, and (c) perception and processing of emotions and emotional memories.

Sex differences in the human visual system.

This Mini-Review summarizes a wide range of sex differences in the human visual system, with a primary focus on sex differences in visual perception and its neural basis. We highlight sex differences in both basic and high-level visual processing, with evidence from behavioral, neurophysiological, and neuroimaging studies. We argue that sex differences in human visual processing, no matter how small or subtle, support the view that females and males truly see the world differently. We acknowledge some of the controversy regarding sex differences in human vision and propose that such controversy should be interpreted as a source of motivation for continued efforts to assess the validity and reliability of published sex differences and for continued research on sex differences in human vision and the nervous system in general. © 2016 Wiley Periodicals, Inc.

Mapping temporo-parietal and temporo-occipital cortico-cortical connections of the human middle longitudinal fascicle in subject-specific, probabilistic, and stereotaxic Talairach spaces.

Originally, the middle longitudinal fascicle (MdLF) was defined as a long association fiber tract connecting the superior temporal gyrus and temporal pole with the angular gyrus. More recently its description has been expanded to include all long postrolandic cortico-cortical association connections of the superior temporal gyrus and dorsal temporal pole with the parietal and occipital lobes. Despite its location and size, which makes MdLF one of the most prominent cerebral association fiber tracts, its discovery in humans is recent. Given the absence of a gold standard in humans for this fiber tract, its precise and complete connectivity remains to be determined with certainty. In this study using high angular resolution diffusion MRI (HARDI), we delineated for the first time, six major fiber connections of the human MdLF, four of whichare temporo-parietal and two temporo-occipital, by examining morphology, topography, cortical connections, biophysical measures, volume and length in seventy brains. Considering the cortical affiliations of the different connections of MdLF we suggested that this fiber tract may be related to language, attention and integrative higher level visual and auditory processing associated functions. Furthermore, given the extensive connectivity provided to superior temporal gyrus and temporal pole with the parietal and occipital lobes, MdLF may be involved in several neurological and psychiatric conditions such as primary progressive aphasia and other aphasic syndromes, some forms of behavioral variant of frontotemporal dementia, atypical forms of Alzheimer's disease, corticobasal degeneration, schizophrenia as well as attention-deficit/hyperactivity Disorder and neglect disorders.

Is dyslexia due to deficits in high-level visual processing? Face and object recognition problems in dyslexia

Is dyslexia due to deficits in high-level visual processing? Face and object recognition problems in dyslexia

Dyslexics show deficiencies in visual statistical learning: Evidence for a high-level visual processing deficit in dyslexia

Dyslexics show deficiencies in visual statistical learning: Evidence for a high-level visual processing deficit in dyslexia

Uncovering the Social Deficits in the Autistic Brain. A Source-Based Morphometric Study.

Autism is a neurodevelopmental disorder that mainly affects social interaction and communication. Evidence from behavioral and functional MRI studies supports the hypothesis that dysfunctional mechanisms involving social brain structures play a major role in autistic symptomatology. However, the investigation of anatomical abnormalities in the brain of people with autism has led to inconsistent results. We investigated whether specific brain regions, known to display functional abnormalities in autism, may exhibit mutual and peculiar patterns of covariance in their gray-matter concentrations. We analyzed structural MRI images of 32 young men affected by autistic disorder (AD) and 50 healthy controls. Controls were matched for sex, age, handedness. IQ scores were also monitored to avoid confounding. A multivariate Source-Based Morphometry (SBM) was applied for the first time on AD and controls to detect maximally independent networks of gray matter. Group comparison revealed a gray-matter source that showed differences in AD compared to controls. This network includes broad temporal regions involved in social cognition and high-level visual processing, but also motor and executive areas of the frontal lobe. Notably, we found that gray matter differences, as reflected by SBM, significantly correlated with social and behavioral deficits displayed by AD individuals and encoded via the Autism Diagnostic Observation Schedule scores. These findings provide support for current hypotheses about the neural basis of atypical social and mental states information processing in autism.