Stimulus Orientation Research Articles

Modeling visual performance differences 'around' the visual field: A computational observer approach.

Visual performance depends on polar angle, even when eccentricity is held constant; on many psychophysical tasks observers perform best when stimuli are presented on the horizontal meridian, worst on the upper vertical, and intermediate on the lower vertical meridian. This variation in performance ‘around’ the visual field can be as pronounced as that of doubling the stimulus eccentricity. The causes of these asymmetries in performance are largely unknown. Some factors in the eye, e.g. cone density, are positively correlated with the reported variations in visual performance with polar angle. However, the question remains whether these correlations can quantitatively explain the perceptual differences observed ‘around’ the visual field. To investigate the extent to which the earliest stages of vision–optical quality and cone density–contribute to performance differences with polar angle, we created a computational observer model. The model uses the open-source software package ISETBIO to simulate an orientation discrimination task for which visual performance differs with polar angle. The model starts from the photons emitted by a display, which pass through simulated human optics with fixational eye movements, followed by cone isomerizations in the retina. Finally, we classify stimulus orientation using a support vector machine to learn a linear classifier on the photon absorptions. To account for the 30% increase in contrast thresholds for upper vertical compared to horizontal meridian, as observed psychophysically on the same task, our computational observer model would require either an increase of ~7 diopters of defocus or a reduction of 500% in cone density. These values far exceed the actual variations as a function of polar angle observed in human eyes. Therefore, we conclude that these factors in the eye only account for a small fraction of differences in visual performance with polar angle. Substantial additional asymmetries must arise in later retinal and/or cortical processing.

Effect of Complexity on Frontal Event Related Desynchronisation in Mental Rotation Task.

A complexity (orientation and shape of stimuli) in the mental rotation (MR) task often affects reaction time (RT) and response accuracy, but the nature of such reflections in neuroscientific research is commonly undocumented. A number of studies have explored the effect of complexity and subsequently noted down the differences in performance. However, a few studies explored complexity (in the term of angular disparity) and cognitive strategies with respect to correct responses only. In contrast, the present study investigated frontal alpha desynchronization with reference to the complexity and proportions of correct and incorrect responses. Behavioral and neurophysiological responses were investigated to understand the switching between strategies (Analytic vs. Holistic). Results showed longer response time with respect to increased complexity. Frontal alpha desynchronization increased for difficult trials and incorrect responses, suggesting a higher utilization of cognitive resources at the frontal region during the MR task. Higher left frontal desynchronization reflected a trading off between strategies for difficult trials. Taken together, these findings suggest that the effect of stimuli complexity is more nuanced than implied by a simple hemispheric dichotomy for frontal cortex and discuss possible future directions to better understand the multitudinous brain mechanisms involved in MR.

Discrimination of Motion Direction in a Robot Using a Phenomenological Model of Synaptic Plasticity.

Recognizing and tracking the direction of moving stimuli is crucial to the control of much animal behaviour. In this study, we examine whether a bio-inspired model of synaptic plasticity implemented in a robotic agent may allow the discrimination of motion direction of real-world stimuli. Starting with a well-established model of short-term synaptic plasticity (STP), we develop a microcircuit motif of spiking neurons capable of exhibiting preferential and nonpreferential responses to changes in the direction of an orientation stimulus in motion. While the robotic agent processes sensory inputs, the STP mechanism introduces direction-dependent changes in the synaptic connections of the microcircuit, resulting in a population of units that exhibit a typical cortical response property observed in primary visual cortex (V1), namely, direction selectivity. Visually evoked responses from the model are then compared to those observed in multielectrode recordings from V1 in anesthetized macaque monkeys, while sinusoidal gratings are displayed on a screen. Overall, the model highlights the role of STP as a complementary mechanism in explaining the direction selectivity and applies these insights in a physical robot as a method for validating important response characteristics observed in experimental data from V1, namely, direction selectivity.

Adjusting the Aperture of the Mind's Eye: Modulation of the Pupillary Response by the Content of Visual Working Memory

Studies of selective attention during perception have revealed modulation of the pupillary response according to the brightness of task relevant (attended) vs. irrelevant (unattended) stimuli within a visual display. As a strong test of top-down modulation of the pupil response by selective attention, we asked whether changes in pupil diameter follow internal shifts of attention to memoranda of visual stimuli of different brightness maintained in working memory, in the absence of any visual stimulation. Across three studies, we reveal dilation of the pupil when participants orient attention to the memorandum of a dark grating relative to that of a bright grating. The effect occurs even when the attention-orienting cue is independent of stimulus brightness, and even when stimulus brightness is merely incidental and not required for the working-memory task of judging stimulus orientation. Furthermore, relative dilation and constriction of the pupil occurred dynamically and followed the changing temporal expectation that one or the other stimulus would be probed across the retention delay. The results provide surprising and consistent evidence that pupil responses are under top-down control by cognitive factors even when there is no direct adaptive gain for such modulation, since no visual stimuli were presented or anticipated. The results also strengthen the view of sensory recruitment during working memory, suggesting even activation of sensory receptors. The thought-provoking corollary to our findings is that the pupils provide a reliable measure of what is in the focus of mind, thus giving a different meaning to old proverbs about the eyes being a window to the mind.

Pure tones modulate the representation of orientation and direction in the primary visual cortex.

Multimodal sensory integration facilitates the generation of a unified and coherent perception of the environment. It is now well established that unimodal sensory perceptions, such as vision, are improved in multisensory contexts. Whereas multimodal integration is primarily performed by dedicated multisensory brain regions such as the association cortices or the superior colliculus, recent studies have shown that multisensory interactions also occur in primary sensory cortices. In particular, sounds were shown to modulate the responses of neurons located in layers 2/3 (L2/3) of the mouse primary visual cortex (V1). Yet, the net effect of sound modulation at the V1 population level remained unclear. In the present study, we performed two-photon calcium imaging in awake mice to compare the representation of the orientation and the direction of drifting gratings by V1 L2/3 neurons in unimodal (visual only) or multimodal (audiovisual) conditions. We found that sound modulation depended on the tuning properties (orientation and direction selectivity) and response amplitudes of V1 L2/3 neurons. Sounds potentiated the responses of neurons that were highly tuned to the cue's orientation and direction but weakly active in the unimodal context, following the principle of inverse effectiveness of multimodal integration. Moreover, sound suppressed the responses of neurons untuned for the orientation and/or the direction of the visual cue. Altogether, sound modulation improved the representation of the orientation and direction of the visual stimulus in V1 L2/3. Namely, visual stimuli presented with auditory stimuli recruited a neuronal population better tuned to the visual stimulus orientation and direction than when presented alone. NEW & NOTEWORTHY The primary visual cortex (V1) receives direct inputs from the primary auditory cortex. Yet, the impact of sounds on visual processing in V1 remains controverted. We show that the modulation by pure tones of V1 visual responses depends on the orientation selectivity, direction selectivity, and response amplitudes of V1 neurons. Hence, audiovisual stimuli recruit a population of V1 neurons better tuned to the orientation and direction of the visual stimulus than unimodal visual stimuli.

Diversity of Feature Selectivity in Macaque Visual Cortex Arising from a Limited Number of Broadly Tuned Input Channels.

Spike (action potential) responses of most primary visual cortical cells in the macaque are sharply tuned for the orientation of a line or an edge, and neurons preferring similar orientations are clustered together in cortical columns. The preferred stimulus orientation of these columns span the full range of orientations, as observed in recordings of spikes and in classical optical imaging of intrinsic signals. However, when we imaged the putative thalamic input to striate cortical cells that can be seen in imaging of intrinsic signals when they are analyzed on a larger spatial scale, we found that the orientation domain map of the primary visual cortex did not show the same diversity of orientations. This map was dominated by just the one orientation that is most commonly preferred by neurons in the retina and the lateral geniculate nucleus. This supports cortical feature selectivity and columnar architecture being built upon feed-forward signals transmitted from the thalamus in a very limited number of broadly tuned input channels.

The speed of neuronal adaptation: A perspective through the visual cortex.

The speed of neuronal adaptation: A perspective through the visual cortex.

Overlapping and distinct contributions of stimulus location and of spatial context to nonspatial visual short-term memory.

Stimulus location is not always informative during visual short-term memory (VSTM) for nonspatial features. Nevertheless, there is considerable evidence for the automatic encoding and retention of location information, regardless of its task relevance. To explore the functional and neural bases of the representation of spatial context in VSTM for nonspatial information, functional magnetic resonance imaging was performed while subjects performed delayed recall for the orientation of individual stimuli. Stimulus location varied across trials, and although this information was irrelevant for task performance, multivariate pattern analysis decoding of stimulus location sustained across trials, and also the decoding strength, predicted the precision of the recall of orientation. The influence of spatial context on the representation of orientation was operationalized by comparing the orientation reconstructions with multivariate inverted encoding models (IEM) trained in location context-dependent vs. -independent data. Although orientation reconstructions were robust for both location-dependent and location-independent IEMs, they were markedly stronger for the former. Furthermore, the functional relevance of location context was demonstrated by the fact that only the location-dependent neural representations of stimulus orientation predicted recall precision. NEW & NOTEWORTHY Neural representation strength of stimulus location predicts the precision of visual short-term memory (VSTM) recall of nonspatial stimulus, even when this information is task irrelevant. Neural representations of nonspatial stimuli that incorporate location context are stronger than those that do not, and only the former representations are strongly linked to behavior. The contributions to nonspatial VSTM performance of the representation of location context are at least partly distinct from those of the representation of stimulus content.

Modeling accuracy, response time, and bias in continuous orientation judgments.

Despite the prevalence of real-world and laboratory tasks where people select among many options, cognitive models have traditionally focused on choices among small sets of alternatives. This has resulted in theoretical and empirical gaps in understanding the decision processes that go into selections among many alternatives or responses that fall along a continuum. This paper addresses these issues by modeling decisions in a perceptual study where participants produce continuous orientation judgments. The experiments showed that manipulations of stimulus difficulty and time pressure have parallel effects to binary choice, with greater stimulus difficulty yielding slower and less accurate responses and time pressure resulting in faster responses at the expense of accuracy. These effects were well accounted for by the circular diffusion model developed by Smith (2016), with drift magnitude parameters shifting with difficulty and threshold parameters shifting with time pressure. However, a manipulation of bias using a predecision cue resulted in bimodal distributions of responses that cannot be explained by the model in its original formulation. To account for this result, I developed a theory of bias based on split attention and racing 2D diffusion processes. This model suggests that responses are determined by both cue-driven and stimulus-driven evidence accumulation processes, such that the winning process determines responses and response times (RTs). As a result, it predicts critical features of responses and response times in the conditions with predecision cues, including bimodal distributions of responses and the longer RTs observed when there was a discrepancy between cue and stimulus orientations. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Reactivation of Previous Experiences in a Working Memory Task

Recent experiences influence the processing of new information even when those experiences are irrelevant to the current task. Does this reflect the indirect effects of a passively maintained representation of the previous experience, or is this representation reactivated when a new event occurs? To answer this question, we attempted to decode the orientation of the stimulus on the previous trial from the electroencephalogram on the current trial in a working memory task. Behavioral data confirmed that the previous-trial stimulus orientation influenced the reported orientation on the current trial, even though the previous-trial orientation was now task irrelevant. In two independent experiments, we found that the previous-trial orientation could be decoded from the current-trial electroencephalogram, indicating that the current-trial stimulus reactivated or boosted the representation of the previous-trial orientation. These results suggest that the effects of recent experiences on behavior are driven, in part, by a reactivation of those experiences and not solely by the indirect effects of passive memory traces.

Contrast and luminance adaptation alter neuronal coding and perception of stimulus orientation

Sensory systems face a barrage of stimulation that continually changes along multiple dimensions. These simultaneous changes create a formidable problem for the nervous system, as neurons must dynamically encode each stimulus dimension, despite changes in other dimensions. Here, we measured how neurons in visual cortex encode orientation following changes in luminance and contrast, which are critical for visual processing, but nuisance variables in the context of orientation coding. Using information theoretic analysis and population decoding approaches, we find that orientation discriminability is luminance and contrast dependent, changing over time due to firing rate adaptation. We also show that orientation discrimination in human observers changes during adaptation, in a manner consistent with the neuronal data. Our results suggest that adaptation does not maintain information rates per se, but instead acts to keep sensory systems operating within the limited dynamic range afforded by spiking activity, despite a wide range of possible inputs.

Modulation by task-difficulty in the default mode network varies with the complexity of perpetual information during decision making

Modulation by task-difficulty in the default mode network varies with the complexity of perpetual information during decision making

Orientation-invariance of individual differences in three face processing tasks.

Numerous studies have reported impairments in perception and recognition, and, particularly, in part-integration of faces following picture-plane inversion. Whether these findings support the notion that inversion changes face processing qualitatively remains a topic of debate. To examine whether associations and dissociations of the human face processing ability depend on stimulus orientation, we measured face recognition with the Cambridge Face Memory Test (CFMT), along with experimental tests of face perception and selective attention to faces and non-face objects in a sample of 314 participants. Results showed strong inversion effects for all face-related tasks, and modest ones for non-face objects. Individual differences analysis revealed that the CFMT shared common variance with face perception and face-selective attention, however, independent of orientation. Regardless of whether predictor and criterion had same or different orientation, face recognition was best predicted by the same test battery. Principal component decomposition revealed a common factor for face recognition and face perception, a second common factor for face recognition and face-selective attention, and two unique factors. The patterns of factor loadings were nearly identical for upright and inverted presentation. These results indicate orientation-invariance of common variance in three domains of face processing. Since inversion impaired performance, but did not affect domain-related associations and dissociations, the findings suggest process-specific but orientation-general mechanisms. Specific limitations by constraints of individual differences analysis and test selection are discussed.

First impressions on face trustworthiness across ages: Evidence from a cross-sectional study.

The present study aimed to explore how the sense of trustworthiness is influenced by age and gender. Participants were to judge computer-generated faces for trustworthiness in two different experimental conditions according to the orientation of the virtual stimuli: canonical (i.e. upright) and inverted (i.e. upside down). Experimental stimuli were presented very briefly and were specifically selected to look: trustworthy, untrustworthy or neutral. The results showed that the tendency to evaluate faces as trustworthy was modulated by both age and gender. In particular, young participants were more prone to judge faces as trustworthy than adult, elderly and child participants. In turn, males were more prone to evaluate faces as trustworthy than females, but this difference was not found among children.

Accessing knowledge of the ‘here and now’: a new technique for capturing electromagnetic markers of orientation processing

Objective. The ability to orient with respect to the current context (e.g. current time or location) is crucial for daily functioning, and is used to measure overall cognitive health across many frontline clinical assessments. However, these tests are often hampered by their reliance on verbal probes (e.g. ‘What city are we in?’) in evaluating orientation. Objective, physiology-based measures of orientation processing are needed, but no such measures are currently in existence. We report the initial development of potential brainwave-based markers of orientation processing as characterized using electroencephlography (EEG) and magnetoencephalography (MEG). Approach. An auditory stimulus sequence embedded with words corresponding to orientation-relevant (i.e. related to the ‘here and now’) and orientation-irrelevant (i.e. unrelated to the current context) conditions was used to elicit orientation processing responses. EEG/MEG data, in concert with clinical assessments, were collected from 29 healthy adults. Analysis at sensor and source levels identified and characterized neural signals related to orientation processing. Main results. Orientation-irrelevant stimuli elicited increased negative amplitude in EEG-derived event-related potential (ERP) waveforms during the 390–570 ms window (p < 0.05), with cortical activations across the left frontal, temporal, and parietal regions. These effects are consistent with the well-known N400 response to semantic incongruence. In contrast, ERP responses to orientation-relevant stimuli exhibited increased positive amplitude during the same interval (p < 0.05), with activations across the bilateral temporal and parietal regions. Importantly, these differential responses were robust at the individual level, with machine-learning classification showing high accuracy (89%), sensitivity (0.88) and specificity (0.90). Significance. This is the first demonstration of a neurotechnology platform that elicits, captures, and evaluates electrophysiological markers of orientation processing. We demonstrate neural responses to orientation stimuli that are validated across EEG and MEG modalities and robust at the individual level. The extraction of physiology-based markers through this technique may enable improved objective brain functional evaluation in clinical applications.

Spiking Neurons Integrating Visual Stimuli Orientation and Direction Selectivity in a Robotic Context.

Visual motion detection is essential for the survival of many species. The phenomenon includes several spatial properties, not fully understood at the level of a neural circuit. This paper proposes a computational model of a visual motion detector that integrates direction and orientation selectivity features. A recent experiment in the Drosophila model highlights that stimulus orientation influences the neural response of direction cells. However, this interaction and the significance at the behavioral level are currently unknown. As such, another objective of this article is to study the effect of merging these two visual processes when contextualized in a neuro-robotic model and an operant conditioning procedure. In this work, the learning task was solved using an artificial spiking neural network, acting as the brain controller for virtual and physical robots, showing a behavior modulation from the integration of both visual processes.

Detailed Visual Cortical Responses Generated by Retinal Sheet Transplants in Rats with Severe Retinal Degeneration.

To combat retinal degeneration, healthy fetal retinal sheets have been successfully transplanted into both rodent models and humans, with synaptic connectivity between transplant and degenerated host retina having been confirmed. In rodent studies, transplants have been shown to restore responses to flashes of light in a region of the superior colliculus corresponding to the location of the transplant in the host retina. To determine the quality and detail of visual information provided by the transplant, visual responsivity was studied here at the level of visual cortex where higher visual perception is processed. For our model, we used the transgenic Rho-S334ter line-3 rat (both sexes), which loses photoreceptors at an early age and is effectively blind at postnatal day 30. These rats received fetal retinal sheet transplants in one eye between 24 and 40 d of age. Three to 10 months following surgery, visually responsive neurons were found in regions of primary visual cortex matching the transplanted region of the retina that were as highly selective as normal rat to stimulus orientation, size, contrast, and spatial and temporal frequencies. Conversely, we found that selective response properties were largely absent in nontransplanted line-3 rats. Our data show that fetal retinal sheet transplants can result in remarkably normal visual function in visual cortex of rats with a degenerated host retina and represents a critical step toward developing an effective remedy for the visually impaired human population.SIGNIFICANCE STATEMENT Age-related macular degeneration and retinitis pigmentosa lead to profound vision loss in millions of people worldwide. Many patients lose both retinal pigment epithelium and photoreceptors. Hence, there is a great demand for the development of efficient techniques that allow for long-term vision restoration. In this study, we transplanted dissected fetal retinal sheets, which can differentiate into photoreceptors and integrate with the host retina of rats with severe retinal degeneration. Remarkably, we show that transplants generated visual responses in cortex similar in quality to normal rats. Furthermore, transplants preserved connectivity within visual cortex and the retinal relay from the lateral geniculate nucleus to visual cortex, supporting their potential application in curing vision loss associated with retinal degeneration.

Poorer Integration of Local Orientation Information Occurs in Students With High Schizotypal Personality Traits.

Contour integration is impaired in schizophrenia patients, even at the first episode, but little is known about visual integration abilities prior to illness onset. To examine this issue, we compared undergraduate students high and low in schizotypal personality traits, reflecting putative liability to psychosis, on two psychophysical tasks assessing local and global stages of the integration process. The Radial Frequency Jittered Orientation Tolerance (RFJOT) task measures tolerance to orientation noise at the local signal level, when judging global stimulus orientation, whilst the Radial Frequency Integration Task (RFIT) measures the ability to globally integrate the local signals that have been extracted during shape discrimination. Positive schizotypy was assessed with the Perceptual Aberration (PAb) scale from the Wisconsin Schizotypy Scales-Brief. On the RFJOT task, the High PAb group (n = 55) tolerated statistically significantly less noise (d = −0.494) and had a lower proportion of correct responses (d = −0.461) than the Low PAb group (n = 77). For the RFIT there was no statistically significant difference in integration abilities between the High and Low PAb groups. High and Low PAb groups also differed on other positive and disorganized (but not negative) schizotypy traits, hence poorer performance on the RFJOT may not be solely related to unusual perceptual experiences. These findings suggest that difficulties with local noise tolerance but not global integration occur in healthy young adults with high levels of schizotypal personality traits, and may be worth investigating as a marker of risk for schizophrenia.

Brain regions modulated during covert visual attention in the macaque

Neurophysiological studies of covert visual attention in monkeys have emphasized the modulation of sensory neural responses in the visual cortex. At the same time, electrophysiological correlates of attention have been reported in other cortical and subcortical structures, and recent fMRI studies have identified regions across the brain modulated by attention. Here we used fMRI in two monkeys performing covert attention tasks to reproduce and extend these findings in order to help establish a more complete list of brain structures involved in the control of attention. As expected from previous studies, we found attention-related modulation in frontal, parietal and visual cortical areas as well as the superior colliculus and pulvinar. We also found significant attention-related modulation in cortical regions not traditionally linked to attention – mid-STS areas (anterior FST and parts of IPa, PGa, TPO), as well as the caudate nucleus. A control experiment using a second-order orientation stimulus showed that the observed modulation in a subset of these mid-STS areas did not depend on visual motion. These results identify the mid-STS areas (anterior FST and parts of IPa, PGa, TPO) and caudate nucleus as potentially important brain regions in the control of covert visual attention in monkeys.

Internal but not external noise frees working memory resources.

The precision with which visual information can be recalled from working memory declines as the number of items in memory increases. This finding has been explained in terms of the distribution of a limited representational resource between items. Here we investigated how the sensory strength of memoranda affects resource allocation. We manipulated signal strength of an orientation stimulus in two ways: we varied the internal (sensory) noise by adjusting stimulus contrast, and varied the external (stimulus) noise by altering the within-stimulus variability. Both manipulations had similar effects on the precision with which the orientation could be recalled, but differed in their impact on memory for other stimuli. These results indicate that increasing internal noise released resources that could be used to store other stimuli more precisely; increasing external noise had no such effect. We show that these observations can be captured by a simple neural model of working memory encoding, in which spiking activity takes on the role of the limited resource.