Sensory Representations Research Articles

Conflicts between short- and long-term experiences affect visual perception through modulating sensory or motor response systems: Evidence from Bayesian inference models

The independent effects of short- and long-term experiences on visual perception have been discussed for decades. However, no study has investigated whether and how these experiences simultaneously affect our visual perception. To address this question, we asked participants to estimate their self-motion directions (i.e., headings) simulated from optic flow, in which a long-term experience learned in everyday life (i.e., straight-forward motion being more common than lateral motion) plays an important role. The headings were selected from three distributions that resembled a peak, a hill, and a flat line, creating different short-term experiences. Importantly, the proportions of headings deviating from the straight-forward motion gradually increased in the peak, hill, and flat distributions, leading to a greater conflict between long- and short-term experiences. The results showed that participants biased their heading estimates towards the straight-ahead direction and previously seen headings, which increased with the growing experience conflict. This suggests that both long- and short-term experiences simultaneously affect visual perception. Finally, we developed two Bayesian models (Model 1 vs. Model 2) based on two assumptions that the experience conflict altered the likelihood distribution of sensory representation or the motor response system. The results showed that both models accurately predicted participants' estimation biases. However, Model 1 predicted a higher variance of serial dependence compared to Model 2, while Model 2 predicted a higher variance of the bias towards the straight-ahead direction compared to Model 1. This suggests that the experience conflict can influence visual perception by affecting both sensory and motor response systems. Taken together, the current study systematically revealed the effects of long- and short-term experiences on visual perception and the underlying Bayesian processing mechanisms.

Bilateral Whisker Representations in the Primary Somatosensory Cortex in Robo3cKO Mice Are Reflected in the Primary Motor Cortex

In Robo3cKO mice, midline crossing defects of the trigeminothalamic projections from the trigeminal principal sensory nucleus result in bilateral whisker maps in the somatosensory thalamus and consequently in the face representation area of the primary somatosensory (S1) cortex (Renier et al., 2017; Tsytsarev et al., 2017). We investigated whether this bilateral sensory representation in the whisker-barrel cortex is also reflected in the downstream projections from the S1 to the primary motor (M1) cortex. To label these projections, we injected anterograde viral axonal tracer in S1 cortex. Corticocortical projections from the S1 distribute to similar areas across the ipsilateral hemisphere in control and Robo3cKO mice. Namely, in both genotypes they extend to the M1, premotor/prefrontal cortex (PMPF), secondary somatosensory (S2) cortex. Next, we performed voltage-sensitive dye imaging (VSDi) in the left hemisphere following ipsilateral and contralateral single whisker stimulation. While controls showed only activation in the contralateral whisker barrel cortex and M1 cortex, the Robo3cKO mouse left hemisphere was activated bilaterally in both the barrel cortex and the M1 cortex. We conclude that the midline crossing defect of the trigeminothalamic projections leads to bilateral whisker representations not only in the thalamus and the S1 cortex but also downstream from the S1, in the M1 cortex.

Sensory perception is a holistic inference process.

Sensory perception is widely considered an inference process that reflects the best guess of a stimulus feature based on uncertain sensory information. Here we challenge this reductionist view and propose that perception is rather a holistic inference process that operates not only at the feature but jointly across all levels of the representational hierarchy. We test this hypothesis in the context of a commonly used psychophysical matching task in which subjects are asked to report their perceived orientation of a test stimulus by adjusting a probe stimulus (method-of-adjustment). We introduce a holistic matching model that assumes that subjects' reports reflect an optimal match between the test and probe stimulus, both in terms of their inferred feature (orientation) and also their higher level representation (orientation category). Validation against several existing data sets demonstrates that the model accurately and comprehensively predicts subjects' response behavior and outperforms previous models both qualitatively and quantitatively. Moreover, the model generalizes to other feature domains and offers an alternative account for categorical color perception. Our results suggest that categorical effects in sensory perception are ubiquitous and can be parsimoniously explained as optimal behavior based on holistic sensory representations. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Electrophysiological (EEG) Correlates of Reward Effects on Early Sensory Perception in Humans

Existing research suggests that reward system and sensory perception networks function in concert and that activation in one may influence the other; however, the dynamics of these influences remains poorly understood. There is general agreement regarding the existence of an interaction between bottom-up and top-down signals in perception and attentional processing. While it’s not absolutely sure what stages of perception are influenced by cognition, it has been assumed that cognitive input influences later categorization stages of visual processing, and that earlier stages are solely involved in the pure bottom up extraction of basic features of sensory signals. Several recent experiments have challenged this idea by showing that top-down modulation by cognition may extend to early visual stages of perception. Recent Electrophysiological studies have begun to probe the neural correlates of the interaction between attention/reward, perception and cognitive control in humans. . We posit that selection of the value of our choices and actions from multiple alternatives may cause suppression of the sensory representations of unselected, low value stimuli while the selected, high value stimuli are enhanced. The present project has been proposed to study the dynamics of this selective process where effects of various reward categories on attention and early sensory perception are tracked using behavioral and electrophysiological (EEG) techniques. Methods from neuroscience, signal processing, psychophysics and EEG tools will be used in the project.

Erotic senses: Powering Brazilian Black queer existence in gynecological spaces.

This paper explores how Brazilian Black queer women's sensorial knowing expresses the ways that anti-Blackness and anti-queerness are experienced within Brazilian gynecological spaces. I show how Black queer forms of sensory representations signal the intimacy of occupying place and time in power relations. What does it mean to feel, touch, and see the mechanisms of prejudice and institutional power? What are the sounds and vibrations of racism and heteronormativity in medicine? What do the senses tell us about Black queer bodies' orientations and adverse reactions within those spaces? I engage the senses to understand how sensorial knowledge is keenly embedded in the evidence and informs how Black queer life is shaped within the quotidian. I discuss how sensorial experiences for the critical possibilities of conceptualizing sensoriality and social meanings of medical space and place and in relation to the material world of gynecology and its technologies.

A system of feed-forward cerebellar circuits that extend and diversify sensory signaling.

Sensory signals are processed by the cerebellum to coordinate movements. Numerous cerebellar functions are thought to require the maintenance of a sensory representation that extends beyond the input signal. Granule cells receive sensory input, but they do not prolong the signal and are thus unlikely to maintain a sensory representation for much longer than the inputs themselves. Unipolar brush cells (UBCs) are excitatory interneurons that project to granule cells and transform sensory input into prolonged increases or decreases in firing, depending on their ON or OFF UBC subtype. Further extension and diversification of the input signal could be produced by UBCs that project to one another, but whether this circuitry exists is unclear. Here we test whether UBCs innervate one another and explore how these small networks of UBCs could transform spiking patterns. We characterized two transgenic mouse lines electrophysiologically and immunohistochemically to confirm that they label ON and OFF UBC subtypes and crossed them together, revealing that ON and OFF UBCs innervate one another. A Brainbow reporter was used to label UBCs of the same ON or OFF subtype with different fluorescent proteins, which showed that UBCs innervate their own subtypes as well. Computational models predict that these feed-forward networks of UBCs extend the length of bursts or pauses and introduce delays-transformations that may be necessary for cerebellar functions from modulation of eye movements to adaptive learning across time scales.

Retinal eccentricity modulates saliency-driven but not relevance-driven visual selection.

Where we move our eyes during visual search is controlled by the relative saliency and relevance of stimuli in the visual field. However, the visual field is not homogeneous, as both sensory representations and attention change with eccentricity. Here we present an experiment investigating how eccentricity differences between competing stimuli affect saliency- and relevance-driven selection. Participants made a single eye movement to a predefined orientation singleton target that was simultaneously presented with an orientation singleton distractor in a background of multiple homogenously oriented other items. The target was either more or less salient than the distractor. Moreover, each of the two singletons could be presented at one of three different retinal eccentricities, such that both were presented at the same eccentricity, one eccentricity value apart, or two eccentricity values apart. The results showed that selection was initially determined by saliency, followed after about 300 ms by relevance. In addition, observers preferred to select the closer over the more distant singleton, and this central selection bias increased with increasing eccentricity difference. Importantly, it largely emerged within the same time window as the saliency effect, thereby resulting in a net reduction of the influence of saliency on the selection outcome. In contrast, the relevance effect remained unaffected by eccentricity. Together, these findings demonstrate that eccentricity is a major determinant of selection behavior, even to the extent that it modifies the relative contribution of saliency in determining where people move their eyes.

A system of feed-forward cerebellar circuits that extend and diversify sensory signaling

Sensory signals are processed by the cerebellum to coordinate movements. Numerous cerebellar functions are thought to require the maintenance of a sensory representation that extends beyond the input signal. Granule cells receive sensory input, but they do not prolong the signal and are thus unlikely to maintain a sensory representation for much longer than the inputs themselves. Unipolar brush cells (UBCs) are excitatory interneurons that project to granule cells and transform sensory input into prolonged increases or decreases in firing, depending on their ON or OFF UBC subtype. Further extension and diversification of the input signal could be produced by UBCs that project to one another, but whether this circuitry exists is unclear. Here we test whether UBCs innervate one another and explore how these small networks of UBCs could transform spiking patterns. We characterized two transgenic mouse lines electrophysiologically and immunohistochemically to confirm that they label ON and OFF UBC subtypes and crossed them together, revealing that ON and OFF UBCs innervate one another. A Brainbow reporter was used to label UBCs of the same ON or OFF subtype with different fluorescent proteins, which showed that UBCs innervate their own subtypes as well. Computational models predict that these feed-forward networks of UBCs extend the length of bursts or pauses and introduce delays—transformations that may be necessary for cerebellar functions from modulation of eye movements to adaptive learning across time scales.

Drawing hearts in the air within new African diaspora spaces: selling Nollywood and consuming nostalgia in London

ABSTRACT Nigerian video films circulate transnationally across various African diaspora communities, including London, England. This article explores conversations concerning the experience of both real and faux nostalgia regarding Blackness and the African diaspora as expressed through Nollywood cinema in London. Within these diaspora communities, Nigerian venders sell Nollywood DVDs as physical commodities from their homeland, triggering sensations of nostalgia and transporting audiences to experience pleasurable and painful emotions. By consuming these cultural products, Nollywood audiences may yearn for an actual African home or experience longing for a village life they have never truly experienced (Krings and Okome 2013, pp. 5–6). Nollywood DVDs serve as modern cultural artefacts containing a ‘record’, both literally and figuratively, transmitting a ‘‘communication’ of black nostalgia’ (Edwards 2009, p. 145) to consumers by providing imaginative sensory spatial representations of Nigeria and Africa. This article explores research from the liminal temporal space of 2013 London, where Nigerian consumption patterns shifted from a thriving market of Nollywood video-film consumers renting or purchasing DVDs – in ‘brick and mortar’ shops – to streaming these cultural commodities online. Viewer responses reveal the importance of physical and online movie distribution platforms as pan-African content providers, connecting virtual homeland spaces of nostalgia to the African diaspora. Thus, from the comfort of their homes, audiences conveniently accessed Black African representations of Nigeria. This investigation captures transnational socio-cultural exchanges in survey research, through questionnaires, and online social media research. Black venders and consumers reveal their experiences with Nollywood as a means to sustain nostalgic homeland bonds, cultural norms, customs, language, religion, and tradition (Krings and Okome, pp. 5–6). The findings elucidate the psychological importance of maintaining homeland connections through buying, selling, and consuming Nollywood experientially. Therefore, a social mechanism of nostalgia allows consumers and venders to retain and sustain Black African cultural identity abroad.

Structural and Functional Organization of Visual Responses in the Inferior Olive of Larval Zebrafish.

The olivo-cerebellar system plays an important role in vertebrate sensorimotor control. Here, we investigate sensory representations in the inferior olive (IO) of larval zebrafish and their spatial organization. Using single-cell labeling of genetically identified IO neurons, we find that they can be divided into at least two distinct groups based on their spatial location, dendritic morphology, and axonal projection patterns. In the same genetically targeted population, we recorded calcium activity in response to a set of visual stimuli using two-photon imaging. We found that most IO neurons showed direction-selective and binocular responses to visual stimuli and that the functional properties were spatially organized within the IO. Light-sheet functional imaging that allowed for simultaneous activity recordings at the soma and axonal level revealed tight coupling between functional properties, soma location, and axonal projection patterns of IO neurons. Taken together, our results suggest that anatomically defined classes of IO neurons correspond to distinct functional types, and that topographic connections between IO and cerebellum contribute to organization of the cerebellum into distinct functional zones.

Activation of M1 cholinergic receptors in mouse somatosensory cortex enhances information processing and detection behaviour

To optimise sensory representations based on environmental demands, the activity of cortical neurons is regulated by neuromodulators such as Acetylcholine (ACh). ACh is implicated in cognitive functions including attention, arousal and sleep cycles. However, it is not clear how specific ACh receptors shape the activity of cortical neurons in response to sensory stimuli. Here, we investigate the role of a densely expressed muscarinic ACh receptor M1 in information processing in the mouse primary somatosensory cortex and its influence on the animal’s sensitivity to detect vibrotactile stimuli. We show that M1 activation results in faster and more reliable neuronal responses, manifested by a significant reduction in response latencies and the trial-to-trial variability. At the population level, M1 activation reduces the network synchrony, and thus enhances the capacity of cortical neurons in conveying sensory information. Consistent with the neuronal findings, we show that M1 activation significantly improves performances in a vibriotactile detection task.

The Interactions of Temporal and Sensory Representations in the Basal Ganglia.

In rodents and primates, interval estimation has been associated with a complex network of cortical and subcortical structures where the dorsal striatum plays a paramount role. Diverse evidence ranging from individual neurons to population activity has demonstrated that this area hosts temporal-related neural representations that may be instrumental for the perception and production of time intervals. However, little is known about how temporal representations interact with other well-known striatal representations, such as kinematic parameters of movements or somatosensory representations. An attractive hypothesis suggests that somatosensory representations may serve as the scaffold for complex representations such as elapsed time. Alternatively, these representations may coexist as independent streams of information that could be integrated into downstream nuclei, such as the substantia nigra or the globus pallidus. In this review, we will revise the available information suggesting an instrumental role of sensory representations in the construction of temporal representations at population and single-neuron levels throughout the basal ganglia.

Analyses of Neural Circuits Governing Behavioral Plasticity in the Nematode Caenorhabditis elegans.

Behavioral plasticity is subjected to various sensory stimuli, experiences, and physiological states, representing the temporal and spatial patterns of neural circuit dynamics. Elucidation of how genes and neural circuits in our brain actuate behavioral plasticity requires functional imaging during behavioral assays to manifest temporal and spatial neural regulation in behaviors. The exploration of the nervous systems of Caenorhabditis elegans has catalyzed substantial scientific advancements in elucidating the mechanistic link between circuit dynamics and behavioral plasticity. The analyses of the nervous system of C. elegans have technologically flourished owing to the development of optogenetic instruments and fluorescent protein-based imaging compatible with its optically transparent body and the understanding of its completely revealed neural connectome and gene expression profiles at single-neuron resolution (The C. elegans Neuronal Gene Expression Map & Network, CeNGEN project). Using examples of the two temperature learning behaviors in C. elegans, this chapter delves into a selection of pivotal imaging tools, including genetically encoded calcium indicators, biosensors for second messenger imaging, and their usage in freely moving worms that have propelled our grasp of sensory representation in C. elegans neural circuits. To further connect the circuit dynamics to behavioral plasticity, this chapter will focus on technological advancements enabling simultaneous imaging and tracking system together with methodologies to quantify multiple behavioral elements of freely behaving C. elegans in a dynamic environment.

Task-related modulation of event-related potentials does not reflect changes to sensory representations

Task-related modulation of event-related potentials does not reflect changes to sensory representations

A power law describes the magnitude of adaptation in neural populations of primary visual cortex

How do neural populations adapt to the time-varying statistics of sensory input? We used two-photon imaging to measure the activity of neurons in mouse primary visual cortex adapted to different sensory environments, each defined by a distinct probability distribution over a stimulus set. We find that two properties of adaptation capture how the population response to a given stimulus, viewed as a vector, changes across environments. First, the ratio between the response magnitudes is a power law of the ratio between the stimulus probabilities. Second, the response direction to a stimulus is largely invariant. These rules could be used to predict how cortical populations adapt to novel, sensory environments. Finally, we show how the power law enables the cortex to preferentially signal unexpected stimuli and to adjust the metabolic cost of its sensory representation to the entropy of the environment.

Cortical reactivations predict future sensory responses.

Many theories of offline memory consolidation posit that the pattern of neurons activated during a salient sensory experience will be faithfully reactivated, thereby stabilizing the pattern1,2. However, sensory-evoked patterns are not stable but, instead, drift across repeated experiences3-6. Here, to investigate the relationship between reactivations and the drift of sensory representations, we imaged the calcium activity of thousands of excitatory neurons in the mouse lateral visual cortex. During the minute after a visual stimulus, we observed transient, stimulus-specific reactivations, often coupled with hippocampal sharp-wave ripples. Stimulus-specific reactivations were abolished by local cortical silencing during the preceding stimulus. Reactivations early in a session systematically differed from the pattern evoked by the previous stimulus-they were more similar to future stimulus response patterns, thereby predicting both within-day and across-day representational drift. In particular, neurons that participated proportionally more or less in early stimulus reactivations than in stimulus response patterns gradually increased or decreased their future stimulus responses, respectively. Indeed, we could accurately predict future changes in stimulus responses and the separation of responses to distinct stimuli using only the rate and content of reactivations. Thus, reactivations may contribute to a gradual drift and separation in sensory cortical response patterns, thereby enhancing sensory discrimination7.

Impact of aversive affect on neural mechanisms of categorization decisions.

Many theories contend that evidence accumulation is a critical component of decision-making. Cognitive accumulation models typically interpret two main parameters: a drift rate and decision threshold. The former is the rate of accumulation, based on the quality of evidence, and the latter is the amount of evidence required for a decision. Some studies have found neural signals that mimic evidence accumulators and can be described by the two parameters. However, few studies have related these neural parameters to experimental manipulations of sensory data or memory representations. Here, we investigated the influence of affective salience on neural accumulation parameters. High affective salience has been repeatedly shown to influence decision-making, yet its effect on neural evidence accumulation has been unexamined. The current study used a two-choice object categorization task of body images (feet or hands). Half the images in each category were high in affective salience because they contained highly aversive features (gore and mutilation). To study such quick categorization decisions with a relatively slow technique like functional magnetic resonance imaging, we used a gradual reveal paradigm to lengthen cognitive processing time through the gradual "unmasking" of stimuli. Because the aversive features were task-irrelevant, high affective salience produced a distractor effect, slowing decision time. In visual accumulation regions of interest, high affective salience produced a longer time to peak activation. Unexpectedly, the later peak appeared to be the product of changes to both drift rate and decision threshold. The drift rate for high affective salience was shallower, and the decision threshold was greater. To our knowledge, this is the first demonstration of an experimental manipulation of sensory data or memory representations that changed the neural decision threshold. These findings advance our knowledge of the neural mechanisms underlying affective responses in general and the influence of high affective salience on object representations and categorization decisions.

Alteration of body representation in typical and atypical motor development.

Developmental coordination disorder (DCD) impacts the quality of life and ability to perform coordinated actions in 5% of school-aged children. The quality of body representations of individuals with DCD has been questioned, but never assessed. We hypothesize that children with DCD have imprecise body representations in the sensory and motor domains. Twenty neurotypical children, seventeen children with DCD (8-12 years old) and twenty neurotypical adults (25-45 years old) performed both sensory and motor body representation tasks: a limb identification and a limb movement task. We observed lower accuracy in the sensory task but not in the motor task. In both tasks, we observe a larger amplitude of errors, or synkinesis, in children with DCD than in neurotypical children. In neurotypical children, accuracy was lower than in neurotypical adults in the motor and sensory task, and the amplitude of sensory errors and synkinesis was higher than in neurotypical adults. Using a linear regression model, we showed that sensory accuracy is a good predictor of synkinesis production, and that synkinesis production is a good predictor of sensory accuracy, as can be expected by the perception-action loop. Results support the hypothesis of an imprecision of body representation in DCD. We suggest that this imprecision arises from noise in the body representation used at the level of internal models of action. Future studies may assess whether slower plasticity of body representations, initial imprecision, or both may account for this observation. At the clinical level, prevention strategies targeting body representation in early childhood are strategically important to limit such impairments. RESEARCH HIGHLIGHTS: Body representation is impaired in children with DCD and has a significant cost in terms of the accuracy of sensory identification of body parts and associated movements. Inaccuracies in the body representation measured in perception and in action (error amplitude and synkinesis) are related in both NT children and adults. In typical development, we provide evidence of a strong link between body schema and body image.

Sampling-based Bayesian inference in recurrent circuits of stochastic spiking neurons

Two facts about cortex are widely accepted: neuronal responses show large spiking variability with near Poisson statistics and cortical circuits feature abundant recurrent connections between neurons. How these spiking and circuit properties combine to support sensory representation and information processing is not well understood. We build a theoretical framework showing that these two ubiquitous features of cortex combine to produce optimal sampling-based Bayesian inference. Recurrent connections store an internal model of the external world, and Poissonian variability of spike responses drives flexible sampling from the posterior stimulus distributions obtained by combining feedforward and recurrent neuronal inputs. We illustrate how this framework for sampling-based inference can be used by cortex to represent latent multivariate stimuli organized either hierarchically or in parallel. A neural signature of such network sampling are internally generated differential correlations whose amplitude is determined by the prior stored in the circuit, which provides an experimentally testable prediction for our framework.

RPM: An open-source Rotation Platform for open- and closed-loop vestibular stimulation in head-fixed Mice

Head fixation allows the recording and presentation of controlled stimuli and is used to study neural processes underlying spatial navigation. However, it disrupts the head direction system because of the lack of vestibular stimulation. To overcome this limitation, we developed a novel rotation platform which can be driven by the experimenter (open-loop) or by animal movement (closed-loop). The platform is modular, affordable, easy to build and open source. Additional modules presented here include cameras for monitoring eye movements, visual virtual reality, and a micro-manipulator for positioning various probes for recording or optical interference. We demonstrate the utility of the platform by recording eye movements and showing the robust activation of head-direction cells. This novel experimental apparatus combines the advantages of head fixation and intact vestibular activity in the horizontal plane. The open-loop mode can be used to study e.g., vestibular sensory representation and processing, while the closed-loop mode allows animals to navigate in rotational space, providing a better substrate for 2-D navigation in virtual environments. The full build documentation is maintained at https://ranczlab.github.io/RPM/.