V1 Spike Research Articles

Stimulus-dependent differences in cortical versus subcortical contributions to visual detection in mice

The primary visual cortex (V1) and the superior colliculus (SC) both occupy stations early in the processing of visual information. They have long been thought to perform distinct functions, with the V1 supporting the perception of visual features and the SC regulating orienting to visual inputs. However, growing evidence suggests that the SC supports the perception of many of the same visual features traditionally associated with the V1. To distinguish V1 and SC contributions to visual processing, it is critical to determine whether both areas causally contribute to the detection of specific visual stimuli. Here, mice reported changes in visual contrast or luminance near their perceptual threshold while white noise patterns of optogenetic stimulation were delivered to V1 or SC inhibitory neurons. We then performed a reverse correlation analysis on the optogenetic stimuli to estimate a neuronal-behavioral kernel (NBK), a moment-to-moment estimate of the impact of V1 or SC inhibition on stimulus detection. We show that the earliest moments of stimulus-evoked activity in the SC are critical for the detection of both luminance and contrast changes. Strikingly, there was a robust stimulus-aligned modulation in the V1 contrast-detection NBK but no sign of a comparable modulation for luminance detection. The data suggest that behavioral detection of visual contrast depends on both V1 and SC spiking, whereas mice preferentially use SC activity to detect changes in luminance. Electrophysiological recordings showed that neurons in both the SC and V1 responded strongly to both visual stimulus types, while the reverse correlation analysis reveals when these neuronal signals actually contribute to visually guided behaviors.

A role for ocular dominance in binocular integration

Neurons in the primate primary visual cortex (V1) combine left- and right-eye information to form a binocular output. Controversy surrounds whether ocular dominance, the preference of these neurons for one eye over the other, is functionally relevant. Here, we demonstrate that ocular dominance impacts gain control during binocular combination. We recorded V1 spiking activity while monkeys passively viewed grating stimuli. Gratings were either presented to one eye (monocular), both eyes with the same contrasts (binocular balanced), or both eyes with different contrasts (binocular imbalanced). We found that contrast placed in a neuron's dominant eye was weighted more strongly than contrast placed in a neuron's non-dominant eye. This asymmetry covaried with neurons' ocular dominance. We then tested whether accounting for ocular dominance within divisive normalization improves the fit to neural data. We found that ocular dominance significantly improved model performance, with interocular normalization providing the best fits. These findings suggest that V1 ocular dominance is relevant for response normalization during binocular stimulation.

The representation of occluded image regions in area V1 of monkeys and humans

Neuronal activity in the primary visual cortex (V1) is driven by feedforward input from within the neurons' receptive fields (RFs) and modulated by contextual information in regions surrounding the RF. The effect of contextual information on spiking activity occurs rapidly and is therefore challenging to dissociate from feedforward input. To address this challenge, we recorded the spiking activity of V1 neurons in monkeys viewing either natural scenes or scenes where the information in the RF was occluded, effectively removing the feedforward input. We found that V1 neurons responded rapidly and selectively to occluded scenes. V1 responses elicited by occluded stimuli could be used to decode individual scenes and could be predicted from those elicited by non-occluded images, indicating that there is an overlap between visually driven and contextual responses. We used representational similarity analysis to show that the structure of V1 representations of occluded scenes measured with electrophysiology in monkeys correlates strongly with the representations of the same scenes in humans measured with functional magnetic resonance imaging (fMRI). Our results reveal that contextual influences rapidly alter V1 spiking activity in monkeys over distances of several degrees in the visual field, carry information about individual scenes, and resemble those in human V1.

Does V1 response suppression initiate binocular rivalry?

During binocular rivalry (BR) only one eye's view is perceived. Neural underpinnings of BR are debated. Recent studies suggest that primary visual cortex (V1) initiates BR. One trigger might be response suppression across most V1 neurons at the onset of BR. Here, we utilize a variant of BR called binocular rivalry flash suppression (BRFS) to test this hypothesis. BRFS is identical to BR, except stimuli are shown with a ∼1s delay. If V1 response suppression was required to initiate BR, it should occur during BRFS as well. To test this, we compared V1 spiking in two macaques observing BRFS. We found that BRFS resulted in response facilitation rather than response suppression across V1 neurons. However, BRFS still reduces responses in a subset of V1 neurons due to the adaptive effects of asynchronous stimulus presentation. We argue that this selective response suppression could serve as an alternate initiator of BR.

Increments in visual motion coherence are more readily detected than decrements.

Understanding the circuits that access and read out information in the cerebral cortex to guide behavior remains a challenge for systems-level neuroscience. Recent optogenetic experiments targeting specific cell classes in mouse primary visual cortex (V1) have shown that mice are sensitive to optically-induced increases in V1 spiking but are relatively insensitive to decreases in neuronal spiking of similar magnitude and time course. This asymmetry suggests that the readout of signals from cortex depends preferentially on increases in spike rate. We investigated whether humans display a similar asymmetry by measuring thresholds for detecting changes in the motion coherence of dynamic random dot stimuli. The middle temporal visual area (MT) has been shown to play an important role in discriminating random dot stimuli, and the responses of its individual neurons to dynamic random dots are well characterized. Although both increments and decrements in motion coherence have heterogeneous effects on MT responses, increments cause on average more increases in firing rates. Consistent with this, we found that subjects are more sensitive to increments of random dot motion coherence than to decrements of coherence. The magnitude of the difference in detectability was consistent with the expected difference in neuronal signal-to-noise associated with MT spike rate increases driven by coherence increments and decrements. The results add strength to the notion that the circuit mechanisms that read out cortical signals are relatively insensitive to decrements in cortical spiking.

Coordinated multiplexing of information about separate objects in visual cortex.

Sensory receptive fields are large enough that they can contain more than one perceptible stimulus. How, then, can the brain encode information about each of the stimuli that may be present at a given moment? We recently showed that when more than one stimulus is present, single neurons can fluctuate between coding one vs. the other(s) across some time period, suggesting a form of neural multiplexing of different stimuli (Caruso et al., 2018). Here, we investigate (a) whether such coding fluctuations occur in early visual cortical areas; (b) how coding fluctuations are coordinated across the neural population; and (c) how coordinated coding fluctuations depend on the parsing of stimuli into separate vs. fused objects. We found coding fluctuations do occur in macaque V1 but only when the two stimuli form separate objects. Such separate objects evoked a novel pattern of V1 spike count ('noise') correlations involving distinct distributions of positive and negative values. This bimodal correlation pattern was most pronounced among pairs of neurons showing the strongest evidence for coding fluctuations or multiplexing. Whether a given pair of neurons exhibited positive or negative correlations depended on whether the two neurons both responded better to the same object or had different object preferences. Distinct distributions of spike count correlations based on stimulus preferences were also seen in V4 for separate objects but not when two stimuli fused to form one object. These findings suggest multiple objects evoke different response dynamics than those evoked by single stimuli, lending support to the multiplexing hypothesis and suggesting a means by which information about multiple objects can be preserved despite the apparent coarseness of sensory coding.

Perceptual enhancement and suppression correlate with V1 neural activity during active sensing

Perception in multiple sensory modalities is an active process that involves exploratory behaviors. In humans and other primates, vision results from sensory sampling guided by saccadic eye movements. Saccades are known to modulate visual perception, and a corollary discharge signal associated with saccades appears to establish a sense of visual stability. Neural recordings have shown that saccades also modulate activity widely across the brain. To investigate the neural basis of saccadic effects on perception, simultaneous recordings from multiple neurons in area V1 were made as animals performed a contrast detection task. Perceptual and neural measures were compared when the animal made real saccades that brought a stimulus into V1 receptive fields and when simulated saccades were made (identical retinal stimulation but no eye movement). When real saccades were made and low spatial frequency stimuli were presented, we observed a reduction in both perceptual sensitivity and neural activity compared with simulated saccades; conversely, with higher spatial frequency stimuli, saccades increased visual sensitivity and neural activity. The performance of neural decoders, which used the activity of the population of simultaneously recorded neurons, showed saccade effects on sensitivity that mirrored the frequency-dependent perceptual changes, suggesting that the V1 population activity could support the perceptual effects. A minority of V1 neurons had significant choice probabilities, and the saccades decreased both average choice probability and pairwise noise correlations. Taken together, the findings suggest that a signal related to saccadic eye movements alters V1 spiking to increase the independence of spiking neurons and bias the system toward processing higher spatial frequencies, presumably to enhance object recognition. The effects of saccades on visual perception and noise correlations appear to parallel effects observed in other sensory modalities, suggesting a general principle of active sensory processing.

Perceptual Weighting of V1 Spikes Revealed by Optogenetic White Noise Stimulation.

During visually guided behaviors, mere hundreds of milliseconds can elapse between a sensory input and its associated behavioral response. How spikes occurring at different times are integrated to drive perception and action remains poorly understood. We delivered random trains of optogenetic stimulation (white noise) to excite inhibitory interneurons in V1 of mice of both sexes while they performed a visual detection task. We then performed a reverse correlation analysis on the optogenetic stimuli to generate a neuronal-behavioral kernel, an unbiased, temporally precise estimate of how suppression of V1 spiking at different moments around the onset of a visual stimulus affects detection of that stimulus. Electrophysiological recordings enabled us to capture the effects of optogenetic stimuli on V1 responsivity and revealed that the earliest stimulus-evoked spikes are preferentially weighted for guiding behavior. These data demonstrate that white noise optogenetic stimulation is a powerful tool for understanding how patterns of spiking in neuronal populations are decoded in generating perception and action.SIGNIFICANCE STATEMENT During visually guided actions, continuous chains of neurons connect our retinas to our motoneurons. To unravel circuit contributions to behavior, it is crucial to establish the relative functional position(s) that different neural structures occupy in processing and relaying the signals that support rapid, precise responses. To address this question, we randomly inhibited activity in mouse V1 throughout the stimulus-response cycle while the animals did many repetitions of a visual task. The period that led to impaired performance corresponded to the earliest stimulus-driven response in V1, with no effect of inhibition immediately before or during late stages of the stimulus-driven response. This approach offers experimenters a powerful method for uncovering the temporal weighting of spikes from stimulus to response.

Mice Preferentially Use Increases in Cerebral Cortex Spiking to Detect Changes in Visual Stimuli.

Whenever the retinal image changes, some neurons in visual cortex increase their rate of firing whereas others decrease their rate of firing. Linking specific sets of neuronal responses with perception and behavior is essential for understanding mechanisms of neural circuit computation. We trained mice of both sexes to perform visual detection tasks and used optogenetic perturbations to increase or decrease neuronal spiking primary visual cortex (V1). Perceptual reports were always enhanced by increments in V1 spike counts and impaired by decrements, even when increments and decrements in spiking were generated in the same neuronal populations. Moreover, detecting changes in cortical activity depended on spike count integration rather than instantaneous changes in spiking. Recurrent neural networks trained in the task similarly relied on increments in neuronal activity when activity has costs. This work clarifies neuronal decoding strategies used by cerebral cortex to translate cortical spiking into percepts that can be used to guide behavior.SIGNIFICANCE STATEMENT Visual responses in the primary visual cortex (V1) are diverse, in that neurons can be either excited or inhibited by the onset of a visual stimulus. We selectively potentiated or suppressed V1 spiking in mice while they performed contrast change detection tasks. In other experiments, excitation or inhibition was delivered to V1 independent of visual stimuli. Mice readily detected increases in V1 spiking while equivalent reductions in V1 spiking suppressed the probability of detection, even when increases and decreases in V1 spiking were generated in the same neuronal populations. Our data raise the striking possibility that only increments in spiking are used to render information to structures downstream of V1.

Stimulus-Specific Plasticity of Macaque V1 Spike Rates and Gamma

When a visual stimulus is repeated, average neuronal responses typically decrease, yet they might maintain or even increase their impact through increased synchronization. Previous work has found that many repetitions of a grating lead to increasing gamma-band synchronization. Here we show in awake macaque area V1 that both, repetition-related reductions in firing rate and increases in gamma are specific to the repeated stimulus. These effects showed some persistence on the timescale of minutes. Further, gamma increases were specific to the presented stimulus location. Importantly, repetition effects on gamma and on firing rates generalized to natural images. These findings suggest that gamma-band synchronization subserves the adaptive processing of repeated stimulus encounters, both for generating efficient stimulus responses and possibly for memory formation.

Repetitive Stimulation Enhances V1 Encoding Efficiency

Repeated stimulus presentations reduce neuronal responses across many brain areas (repetition suppression) while improving performance in associated tasks (repetition priming). The neuronal mechanisms that enhance performance in the face of reduced brain activity are unknown. Here we demonstrate that stimulus repetition increases encoding efficiency among cortical neurons, which enhances stimulus representations despite reduced spiking activity. Using a repetition priming-evoking stimulus sequence, we recorded laminar responses in monkey primary visual cortex (V1). We found that repetition suppression is most pronounced outside the V1 layers that receive retinogeniculate input and is robust to alternating stimuli between the two eyes, suggesting that repetition suppression is of cortical origin. This V1 spiking suppression is accompanied by sharpened neural tuning as well as increased neuronal synchrony, however not by decreased response latency. These results suggest that repetition priming and repetition suppression arise from modulated cortical neuronal processing that enhances encoding efficiency as stimuli repeat.

Repetitive Stimulation Enhances V1 Encoding Efficiency

Repeated stimulus presentations reduce neuronal responses across many brain areas (repetition suppression) while improving performance in associated tasks (repetition priming). The neuronal mechanisms that enhance performance in the face of reduced brain activity are unknown. Here we demonstrate that stimulus repetition increases encoding efficiency among cortical neurons, which enhances stimulus representations despite reduced spiking activity. Using a repetition priming-evoking stimulus sequence, we recorded laminar responses in monkey primary visual cortex (V1). We found that repetition suppression is most pronounced outside the V1 layers that receive retinogeniculate input and is robust to alternating stimuli between the two eyes, suggesting that repetition suppression is of cortical origin. This V1 spiking suppression is accompanied by sharpened neural tuning as well as increased neuronal synchrony, however not by decreased response latency. These results suggest that repetition priming and repetition suppression arise from modulated cortical neuronal processing that enhances encoding efficiency as stimuli repeat.

Spiking Suppression Precedes Cued Attentional Enhancement of Neural Responses in Primary Visual Cortex.

Attending to a visual stimulus increases its detectability, even if gaze is directed elsewhere. This covert attentional selection is known to enhance spiking across many brain areas, including the primary visual cortex (V1). Here we investigate the temporal dynamics of attention-related spiking changes in V1 of macaques performing a task that separates attentional selection from the onset of visual stimulation. We found that preceding attentional enhancement there was a sharp, transient decline in spiking following presentation of an attention-guiding cue. This disruption of V1 spiking was not observed in a task-naïve subject that passively observed the same stimulus sequence, suggesting that sensory activation is insufficient to cause suppression. Following this suppression, attended stimuli evoked more spiking than unattended stimuli, matching previous reports of attention-related activity in V1. Laminar analyses revealed a distinct pattern of activation in feedback-associated layers during both the cue-induced suppression and subsequent attentional enhancement. These findings suggest that top-down modulation of V1 spiking can be bidirectional and result in either suppression or enhancement of spiking responses.

Activity of primate V1 neurons during the gap saccade task.

When a saccadic eye movement is made toward a visual stimulus, the variability in accompanying primary visual cortex (V1) activity is related to saccade latency in both humans and simians. To understand the nature of this relationship, we examined the functional link between V1 activity and the initiation of visually guided saccades during the gap saccade task, in which a brief temporal gap is inserted between the turning off of a fixation stimulus and the appearance of a saccadic target. The insertion of such a gap robustly reduces saccade latency and facilitates the occurrence of extremely short-latency (express) saccades. Here we recorded single-cell activity from macaque V1 while monkeys performed the gap saccade task. In parallel with the gap effect on saccade latency the neural latency (time of first spike) of V1 response elicited by the saccade target became shorter, and the firing rate increased as the gap duration increased. Similarly, neural latency was shorter and firing rate was higher before express saccades relative to regular-latency saccades. In addition to these posttarget changes, the level of spontaneous spike activity during the pretarget period was negatively correlated with both neural and saccade latencies. These results demonstrate that V1 activity correlates with the gap effect and indicate that trial-to-trial variability in the state of V1 accompanies the variability of neural and behavioral latencies.NEW & NOTEWORTHY The link between neural activity in monkey primary visual cortex (V1) and visually guided behavioral response is confirmed with the gap saccade paradigm. Results indicated that the variability in neural latency of V1 spike activity correlates with the gap effect on saccade latency and that the trial-to-trial variability in the state of V1 before the onset of saccade target correlates with the variability in neural and behavioral latencies.

Dynamic Signal Tracking in a Simple V1 Spiking Model.

This work is part of an effort to understand the neural basis for our visual system's ability, or failure, to accurately track moving visual signals. We consider here a ring model of spiking neurons, intended as a simplified computational model of a single hypercolumn of the primary visual cortex of primates. Signals that consist of edges with time-varying orientations localized in space are considered. Our model is calibrated to produce spontaneous and driven firing rates roughly consistent with experiments, and our two main findings, for which we offer dynamical explanation on the level of neuronal interactions, are the following. First, we have documented consistent transient overshoots in signal perception following signal switches due to emergent interactions of the E- and I-populations. Second, for continuously moving signals, we have found that accuracy is considerably lower at reversals of orientation than when continuing in the same direction (as when the signal is a rotating bar). To measure performance, we use two metrics, called fidelity and reliability, to compare signals reconstructed by the system to the ones presented and assess trial-to-trial variability. We propose that the same population mechanisms responsible for orientation selectivity also impose constraints on dynamic signal tracking that manifest in perception failures consistent with psychophysical observations.

Natural vision effects on contrast sensitivity and their correlation with macaque V1 activity

In a series of physiological and psychophysical experiments, our lab has previously shown that there are significant differences in brain representations and visual perception between natural vision and vision in laboratory experiments. Complex natural scenes and saccadic eye movements alter vision relative to experiments with simple stimuli flashed during prolonged fixation. Here we show that natural vision has significant effects on contrast sensitivity and that these effects are predictable from patterns of activation in macaque V1. Animals were trained to perform a 2AFC contrast discrimination task while recordings from V1 were made with 96 electrode Utah arrays. Conditions in which saccades brought stimuli into receptive fields were compared with other conditions that required fixation before stimuli were flashed. In both conditions the Gabor target stimuli were positioned on a complex natural scene background. We find, with similar visual input, that saccades across a complex scene alter contrast sensitivity relative to sensitivity with flashed stimuli. Specifically, contrast sensitivity is worse at lower spatial frequencies (1-4 cy/deg) but similar at higher spatial frequencies when a saccade brings the Gabor target into view. This effect is comparable to the reduced contrast sensitivity our lab has reported in similar human psychophysics experiments. The differences between "saccade" and "flash" contrast sensitivity functions is consistent with the effects of saccades across complex scenes on V1 spiking and LFP activity and the spatial frequency dependence of neural changes. Importantly, the spatial frequency dependence of the effects appears related to the statistics of natural scenes rather than magno/parvo processing differences. These findings are important for the characterization of V1 responses and perception in natural vision and for the clinical assessment of contrast sensitivity. Meeting abstract presented at VSS 2014

Modulation of V1 Spike Response by Temporal Interval of Spatiotemporal Stimulus Sequence

The spike activity of single neurons of the primary visual cortex (V1) becomes more selective and reliable in response to wide-field natural scenes compared to smaller stimuli confined to the classical receptive field (RF). However, it is largely unknown what aspects of natural scenes increase the selectivity of V1 neurons. One hypothesis is that modulation by surround interaction is highly sensitive to small changes in spatiotemporal aspects of RF surround. Such a fine-tuned modulation would enable single neurons to hold information about spatiotemporal sequences of oriented stimuli, which extends the role of V1 neurons as a simple spatiotemporal filter confined to the RF. In the current study, we examined the hypothesis in the V1 of awake behaving monkeys, by testing whether the spike response of single V1 neurons is modulated by temporal interval of spatiotemporal stimulus sequence encompassing inside and outside the RF. We used two identical Gabor stimuli that were sequentially presented with a variable stimulus onset asynchrony (SOA): the preceding one (S1) outside the RF and the following one (S2) in the RF. This stimulus configuration enabled us to examine the spatiotemporal selectivity of response modulation from a focal surround region. Although S1 alone did not evoke spike responses, visual response to S2 was modulated for SOA in the range of tens of milliseconds. These results suggest that V1 neurons participate in processing spatiotemporal sequences of oriented stimuli extending outside the RF.

Context Matters: The Illusive Simplicity of Macaque V1 Receptive Fields

Even in V1, where neurons have well characterized classical receptive fields (CRFs), it has been difficult to deduce which features of natural scenes stimuli they actually respond to. Forward models based upon CRF stimuli have had limited success in predicting the response of V1 neurons to natural scenes. As natural scenes exhibit complex spatial and temporal correlations, this could be due to surround effects that modulate the sensitivity of the CRF. Here, instead of attempting a forward model, we quantify the importance of the natural scenes surround for awake macaque monkeys by modeling it non-parametrically. We also quantify the influence of two forms of trial to trial variability. The first is related to the neuron’s own spike history. The second is related to ongoing mean field population activity reflected by the local field potential (LFP). We find that the surround produces strong temporal modulations in the firing rate that can be both suppressive and facilitative. Further, the LFP is found to induce a precise timing in spikes, which tend to be temporally localized on sharp LFP transients in the gamma frequency range. Using the pseudo R2 as a measure of model fit, we find that during natural scene viewing the CRF dominates, accounting for 60% of the fit, but that taken collectively the surround, spike history and LFP are almost as important, accounting for 40%. However, overall only a small proportion of V1 spiking statistics could be explained (R2∼5%), even when the full stimulus, spike history and LFP were taken into account. This suggests that under natural scene conditions, the dominant influence on V1 neurons is not the stimulus, nor the mean field dynamics of the LFP, but the complex, incoherent dynamics of the network in which neurons are embedded.

Attentional Modulations Related to Spatial Gating but Not to Allocation of Limited Resources in Primate V1

Attention can modulate neural responses in sensory cortical areas and improve behavioral performance in perceptual tasks. However, the nature and purpose of these modulations remain under debate. Here weused voltage-sensitive dye imaging (VSDI) to measure V1 population responses while monkeys performed a difficult detection task under focal or distributed attention. We found that V1 responses at attended locations are significantly elevated relative to actively ignored or irrelevant locations, consistent with the hypothesis that an important goal of attention in V1 is to highlight task-relevant information. Surprisingly, these modulations were indistinguishable under focal and distributed attention, suggesting a minor or no role for attention as a mechanism for allocating limited representational resources in V1. The response elevation at attended locations is additive, is widespread, and starts shortly before stimulus onset. This elevation could contribute to spatial gating by biasing competition in subsequent processing stages in favor of attended stimuli.

Attention Reduces Stimulus-Driven Gamma Frequency Oscillations and Spike Field Coherence in V1

SummaryRhythmic activity of neuronal ensembles has been proposed to play an important role in cognitive functions such as attention, perception, and memory. Here we investigate whether rhythmic activity in V1 of the macaque monkey (macaca mulatta) is affected by top-down visual attention. We measured the local field potential (LFP) and V1 spiking activity while monkeys performed an attention-demanding detection task. We show that gamma oscillations were strongly modulated by the stimulus and by attention. Stimuli that engaged inhibitory mechanisms induced the largest gamma LFP oscillations and the largest spike field coherence. Directing attention toward a visual stimulus at the receptive field of the recorded neurons decreased LFP gamma power and gamma spike field coherence. This decrease could reflect an attention-mediated reduction of surround inhibition. Changes in synchrony in V1 would thus be a byproduct of reduced inhibitory drive, rather than a mechanism that directly aids perceptual processing.