Sequence Of Stimuli Research Articles

Olfactory coding in the turbulent realm.

Long-distance olfactory search behaviors depend on odor detection dynamics. Due to turbulence, olfactory signals travel as bursts of variable concentration and spacing and are characterized by long-tail distributions of odor/no-odor events, challenging the computing capacities of olfactory systems. How animals encode complex olfactory scenes to track the plume far from the source remains unclear. Here we focus on the coding of the plume temporal dynamics in moths. We compare responses of olfactory receptor neurons (ORNs) and antennal lobe projection neurons (PNs) to sequences of pheromone stimuli either with white-noise patterns or with realistic turbulent temporal structures simulating a large range of distances (8 to 64 m) from the odor source. For the first time, we analyze what information is extracted by the olfactory system at large distances from the source. Neuronal responses are analyzed using linear–nonlinear models fitted with white-noise stimuli and used for predicting responses to turbulent stimuli. We found that neuronal firing rate is less correlated with the dynamic odor time course when distance to the source increases because of improper coding during long odor and no-odor events that characterize large distances. Rapid adaptation during long puffs does not preclude however the detection of puff transitions in PNs. Individual PNs but not individual ORNs encode the onset and offset of odor puffs for any temporal structure of stimuli. A higher spontaneous firing rate coupled to an inhibition phase at the end of PN responses contributes to this coding property. This allows PNs to decode the temporal structure of the odor plume at any distance to the source, an essential piece of information moths can use in their tracking behavior.

Decoding a Decision Process in the Neuronal Population of Dorsal Premotor Cortex

When trained monkeys discriminate the temporal structure of two sequential vibrotactile stimuli, dorsal premotor cortex (DPC) showed high heterogeneity among its neuronal responses. Notably, DPC neurons coded stimulus patterns as broader categories and signaled them during working memory, comparison, and postponed decision periods. Here, we show that such population activity can be condensed into two major coding components: one that persistently represented in working memory both the first stimulus identity and the postponed informed choice and another that transiently coded the initial sensory information and the result of the comparison between the two stimuli. Additionally, we identified relevant signals that coded the timing of task events. These temporal and task-parameter readouts were shown to be strongly linked to the monkeys' behavior when contrasted to those obtained in a non-demanding cognitive control task and during error trials. These signals, hidden in the heterogeneity, were prominently represented by the DPC population response.

Sensory Stream Adaptation in Chaotic Networks

Implicit expectations induced by predictable stimuli sequences affect neuronal response to upcoming stimuli at both single cell and neural population levels. Temporally regular sensory streams also phase entrain ongoing low frequency brain oscillations but how and why this happens is unknown. Here we investigate how random recurrent neural networks without plasticity respond to stimuli streams containing oddballs. We found the neuronal correlates of sensory stream adaptation emerge if networks generate chaotic oscillations which can be phase entrained by stimulus streams. The resultant activity patterns are close to critical and support history dependent response on long timescales. Because critical network entrainment is a slow process stimulus response adapts gradually over multiple repetitions. Repeated stimuli generate suppressed responses but oddball responses are large and distinct. Oscillatory mismatch responses persist in population activity for long periods after stimulus offset while individual cell mismatch responses are strongly phasic. These effects are weakened in temporally irregular sensory streams. Thus we show that network phase entrainment provides a biologically plausible mechanism for neural oddball detection. Our results do not depend on specific network characteristics, are consistent with experimental studies and may be relevant for multiple pathologies demonstrating altered mismatch processing such as schizophrenia and depression.

Temporal Discrimination: Mechanisms and Relevance to Adult-Onset Dystonia.

Temporal discrimination is the ability to determine that two sequential sensory stimuli are separated in time. For any individual, the temporal discrimination threshold (TDT) is the minimum interval at which paired sequential stimuli are perceived as being asynchronous; this can be assessed, with high test–retest and inter-rater reliability, using a simple psychophysical test. Temporal discrimination is disordered in a number of basal ganglia diseases including adult-onset dystonia, of which the two most common phenotypes are cervical dystonia and blepharospasm. The causes of adult-onset focal dystonia are unknown; genetic, epigenetic, and environmental factors are relevant. Abnormal TDTs in adult-onset dystonia are associated with structural and neurophysiological changes considered to reflect defective inhibitory interneuronal processing within a network which includes the superior colliculus, basal ganglia, and primary somatosensory cortex. It is hypothesized that abnormal temporal discrimination is a mediational endophenotype and, when present in unaffected relatives of patients with adult-onset dystonia, indicates non-manifesting gene carriage. Using the mediational endophenotype concept, etiological factors in adult-onset dystonia may be examined including (i) the role of environmental exposures in disease penetrance and expression; (ii) sexual dimorphism in sex ratios at age of onset; (iii) the pathogenesis of non-motor symptoms of adult-onset dystonia; and (iv) subcortical mechanisms in disease pathogenesis.

Auditory-motor coupling affects phonetic encoding

Recent studies have shown that moving in synchrony with auditory stimuli boosts attention allocation and verbal learning. Furthermore rhythmic tones are processed more efficiently than temporally random tones ('timing effect'), and this effect is increased when participants actively synchronize their motor performance with the rhythm of the tones, resulting in auditory-motor synchronization.Here, we investigated whether this applies also to sequences of linguistic stimuli (syllables). We compared temporally irregular syllable sequences with two temporally regular conditions where either the interval between syllable onsets (stimulus onset asynchrony, SOA) or the interval between the syllables’ vowel onsets was kept constant. Entrainment to the stimulus presentation frequency (1 Hz) and event-related potentials were assessed in 24 adults who were instructed to detect pre-defined deviant syllables while they either pedaled or sat still on a stationary exercise bike.We found larger 1 Hz entrainment and P300 amplitudes for the SOA presentation during motor activity. Furthermore, the magnitude of the P300 component correlated with the motor variability in the SOA condition and 1 Hz entrainment, while in turn 1 Hz entrainment correlated with auditory-motor synchronization performance. These findings demonstrate that acute auditory-motor coupling facilitates phonetic encoding.

Spiking Suppression Precedes Cued Attentional Enhancement of Neural Responses in Primary Visual Cortex.

Attending to a visual stimulus increases its detectability, even if gaze is directed elsewhere. This covert attentional selection is known to enhance spiking across many brain areas, including the primary visual cortex (V1). Here we investigate the temporal dynamics of attention-related spiking changes in V1 of macaques performing a task that separates attentional selection from the onset of visual stimulation. We found that preceding attentional enhancement there was a sharp, transient decline in spiking following presentation of an attention-guiding cue. This disruption of V1 spiking was not observed in a task-naïve subject that passively observed the same stimulus sequence, suggesting that sensory activation is insufficient to cause suppression. Following this suppression, attended stimuli evoked more spiking than unattended stimuli, matching previous reports of attention-related activity in V1. Laminar analyses revealed a distinct pattern of activation in feedback-associated layers during both the cue-induced suppression and subsequent attentional enhancement. These findings suggest that top-down modulation of V1 spiking can be bidirectional and result in either suppression or enhancement of spiking responses.

On the influence of informational content and key-response effect mapping on implicit learning and error monitoring in the serial reaction time (SRT) task.

The present experiment was designed to enhance our understanding of how response effects with varying amounts of useful information influence implicit sequence learning. We recorded event-related brain potentials, while participants performed a modified version of the serial reaction time task (SRTT). In this task, participants have to press one of four keys corresponding to four letters on a computer screen. Unknown to participants, in some parts of the experimental blocks, the stimuli appear in a repetitive (structured) deterministic sequence, whereas in other parts, stimuli were determined randomly. Four groups of participants differing in the presentation of tones after each response performed the SRTT. In the no tone group, no tones were presented after a response. The other three groups differed with respect to the melody generated by the key presses: in the unmelodic group, one out of four different tones was chosen randomly and presented immediately after a response. In the consistent melody group, the press of a response key always resulted in the production of the same tone, resulting in a repetitive melody during structured parts of the sequence (consistent redundant effect). In the inconsistent melody group, the "melody" produced in the sequenced parts of the blocks was identical to the consistent melody group, but the same response could produce two different tones depending on the actual position in the stimulus sequence. Thus, during structured sequences, subjects heard the same melody as in the consistent melody group, but every key press could be followed by one out of two different tones. To disentangle effects of sequence awareness from our experimental manipulations, all analyses were restricted to implicit learners. All four groups showed sequence learning, but to a different degree: in general, every kind of tone improved sequence learning relative to the no tone group. However, unmelodic tones were less beneficial for learning than tones forming a melody. Tones mapped consistently to response keys improved learning faster than tones producing the same melody, but not mapped consistently to keys. However, at the end of the learning phase, the two melody groups did not differ in the amount of sequence learning. The error-related negativity (ERN) increased with sequence learning (larger ERN at the end of the experiment for trials following the sequence compared to random trials) and this effect was more pronounced for the groups that showed more learning. These findings indicate that response effects containing useful information foster sequence learning even if the same response can produce different effects. Furthermore, we replicated earlier results showing that the importance of an error with respect to the task at hand modulates the activity of the human performance monitoring system.

Code-modulated visual evoked potentials using fast stimulus presentation and spatiotemporal beamformer decoding

When encoding visual targets using various lagged versions of a pseudorandom binary sequence of luminance changes, the EEG signal recorded over the viewer’s occipital pole exhibits so-called code-modulated visual evoked potentials (cVEPs), the phase lags of which can be tied to these targets. The cVEP paradigm has enjoyed interest in the brain-computer interfacing (BCI) community for the reported high information transfer rates (ITR, in bits/min). In this study, we introduce a novel decoding algorithm based on spatiotemporal beamforming, and show that this algorithm is able to accurately identify the gazed target. Especially for a small number of repetitions of the coding sequence, our beamforming approach significantly outperforms an optimised support vector machine (SVM)-based classifier, which is considered state-of-the-art in cVEP-based BCI. In addition to the traditional 60 Hz stimulus presentation rate for the coding sequence, we also explore the 120 Hz rate, and show that the latter enables faster communication, with a maximal median ITR of 172.87 bits/min. Finally, we also report on a transition effect in the EEG signal following the onset of the stimulus sequence, and recommend to exclude the first 150 ms of the trials from decoding when relying on a single presentation of the stimulus sequence.

Expectation, information processing, and subjective duration.

In research on psychological time, it is important to examine the subjective duration of entire stimulus sequences, such as those produced by music (Teki, Frontiers in Neuroscience, 10, 2016). Yet research on the temporal oddball illusion (according to which oddball stimuli seem longer than standard stimuli of the same duration) has examined only the subjective duration of single events contained within sequences, not the subjective duration of sequences themselves. Does the finding that oddballs seem longer than standards translate to entire sequences, such that entire sequences that contain oddballs seem longer than those that do not? Is this potential translation influenced by the mode of information processing-whether people are engaged in direct or indirect temporal processing? Two experiments aimed to answer both questions using different manipulations of information processing. In both experiments, musical sequences either did or did not contain oddballs (auditory sliding tones). To manipulate information processing, we varied the task (Experiment 1), the sequence event structure (Experiments 1 and 2), and the sequence familiarity (Experiment 2) independently within subjects. Overall, in both experiments, the sequences that contained oddballs seemed shorter than those that did not when people were engaged in direct temporal processing, but longer when people were engaged in indirect temporal processing. These findings support the dual-process contingency model of time estimation (Zakay, Attention, Perception & Psychophysics, 54, 656-664, 1993). Theoretical implications for attention-based and memory-based models of time estimation, the pacemaker accumulator and coding efficiency hypotheses of time perception, and dynamic attending theory are discussed.

Approaching imperial narratives one sense at a time: views and sounds at an Inka settlement in northwest Argentina

ABSTRACTThroughout history, empires have deployed a vast array of strategies to promote their worldview and to control the colonized. Amongst non-violent ones, hosting public ceremonies to show off an empire’s capabilities and to enact and reinforce new desired relations and identities, seemed to be especially effective. This article presents new data and interpretations on how the Inkas employed ritual architecture to manipulate the somatic experiences of the colonized. Specifically, we analyze the public space of an Inka settlement located in the North Calchaquí Valley (Argentina) in order to show how the Inkas used architecture and spatial design to impose certain sensorial modalities and to manage their sequential stimulus and intensity. In an attempt to overcome a reigning visual paradigm among this line of inquiry, we present an analysis that combines visual and acoustical data collected on site, with three-dimensional modeling of terrain, architecture, and sound propagation. Results indicate that through a careful layout design that involved the management of visual and acoustic permeability, the Inkas not only organized groups and practices, but also created different experiences for different people.

Mismatch negativity impairment is associated with deficits in identifying real-world environmental sounds in schizophrenia

BackgroundPatients with schizophrenia (SZ) have impairments in processing auditory information that have been linked to deficits in cognitive and psychosocial functioning. Dysfunction in auditory sensory processing in SZ has been indexed by mismatch negativity (MMN), an event-related potential evoked by a rare, deviant stimulus embedded within a sequence of identical standard stimuli. Although MMN deficits in SZ have been studied extensively, relatively little is known about how these deficits relate to accurately identifying real-world, ecologically-salient sounds. MethodsMMN was assessed in SZ patients (n=21) and non-psychiatric comparison subjects (NCS; n=16). Participants were also assessed in their ability to identify common environmental sounds using a subset of 80 sound clips from the International Affective Digitized Sounds 2nd Ed collection. ResultsSZ patients made significantly more errors in environmental sound identification (p<0.001, d=0.86) and showed significantly reduced MMN amplitude deficits in MMN compared to NCS (p<0.01, d=0.97). In SZ patients, MMN deficits were associated with significantly greater environmental sound identification errors (r=0.61, p<0.01). ConclusionsImpairments in early auditory information processing in schizophrenia account for significant proportions of variance in the ability to identify real-world, functionally relevant environmental sounds. This study supports the view that interventions targeting deficits in low-level auditory sensory processing may also impact more complex cognitive brain processes relevant to psychosocial disability.

Single, but not dual, attention facilitates statistical learning of two concurrent auditory sequences

When we are exposed to a novel stimulus sequence, we can learn the sequence by extracting a statistical structure that is potentially embedded in the sequence. This mechanism is called statistical learning, and is considered a fundamental and domain-general process that is innate in humans. In the real-world environment, humans are inevitably exposed to auditory sequences that often overlap with one another, such as speech sound streams from multiple speakers or entangled melody lines generated by multiple instruments. The present study investigated how single and dual attention modulates brain activity, reflecting statistical learning when two auditory sequences were presented simultaneously. The results demonstrated that the effect of statistical learning had more pronounced neural activity when listeners paid attention to only one sequence and ignored the other, rather than paying attention to both sequences. Biased attention may thus be an essential strategy when learners are exposed to multiple information streams.

Real-time inference of word relevance from electroencephalogram and eye gaze

Objective. Brain-computer interfaces can potentially map the subjective relevance of the visual surroundings, based on neural activity and eye movements, in order to infer the interest of a person in real-time. Approach. Readers looked for words belonging to one out of five semantic categories, while a stream of words passed at different locations on the screen. It was estimated in real-time which words and thus which semantic category interested each reader based on the electroencephalogram (EEG) and the eye gaze. Main results. Words that were subjectively relevant could be decoded online from the signals. The estimation resulted in an average rank of 1.62 for the category of interest among the five categories after a hundred words had been read. Significance. It was demonstrated that the interest of a reader can be inferred online from EEG and eye tracking signals, which can potentially be used in novel types of adaptive software, which enrich the interaction by adding implicit information about the interest of the user to the explicit interaction. The study is characterised by the following novelties. Interpretation with respect to the word meaning was necessary in contrast to the usual practice in brain-computer interfacing where stimulus recognition is sufficient. The typical counting task was avoided because it would not be sensible for implicit relevance detection. Several words were displayed at the same time, in contrast to the typical sequences of single stimuli. Neural activity was related with eye tracking to the words, which were scanned without restrictions on the eye movements.

Immunobiography and the Heterogeneity of Immune Responses in the Elderly: A Focus on Inflammaging and Trained Immunity.

Owing to its memory and plasticity, the immune system (IS) is capable of recording all the immunological experiences and stimuli it was exposed to. The combination of type, dose, intensity, and temporal sequence of antigenic stimuli that each individual is exposed to has been named “immunobiography.” This immunological history induces a lifelong continuous adaptation of the IS, which is responsible for the capability to mount strong, weak or no response to specific antigens, thus determining the large heterogeneity of immunological responses. In the last years, it is becoming clear that memory is not solely a feature of adaptive immunity, as it has been observed that also innate immune cells are provided with a sort of memory, dubbed “trained immunity.” In this review, we discuss the main characteristics of trained immunity as a possible contributor to inflammaging within the perspective of immunobiography, with particular attention to the phenotypic changes of the cell populations known to be involved in trained immunity. In conclusion, immunobiography emerges as a pervasive and comprehensive concept that could help in understanding and interpret the individual heterogeneity of immune responses (to infections and vaccinations) that becomes particularly evident at old age and could affect immunosenescence and inflammaging.

Vibrotactile Coordinated Reset Stimulation for the Treatment of Neurological Diseases: Concepts and Device Specifications.

Coordinated reset stimulation (CRS) consists of spatiotemporal sequences of stimuli delivered to different sites in the brain. Computationally, it was shown that by achieving an unlearning of abnormal synaptic connectivity, CRS can cause a long-lasting reduction of pathological synchronization, a hallmark feature of Parkinson’s disease and other brain disorders. Pre-clinical and proof of concept clinical studies in parkinsonian monkeys and patients showed that CRS applied through deep brain stimulation electrodes implanted in the subthalamic nucleus resulted in cumulative and long-lasting therapeutic effects along with a reduction of beta band oscillations. To apply CRS noninvasively by vibrotactile stimulation delivered to different fingertips, we present three different possible stimulation concepts. These different CRS approaches target different mechanoreceptors and related stimulus mechanisms. The different approaches are based on the diverse physiology of mechanoreceptors and dynamic CRS principles. Required stimulation parameters and specifications provide a guideline for technically implementing vibrotactile CRS during clinical tests.

Visual Perceptual Echo Reflects Learning of Regularities in Rapid Luminance Sequences.

A novel neural signature of active visual processing has recently been described in the form of the "perceptual echo", in which the cross-correlation between a sequence of randomly fluctuating luminance values and occipital electrophysiological signals exhibits a long-lasting periodic (∼100 ms cycle) reverberation of the input stimulus (VanRullen and Macdonald, 2012). As yet, however, the mechanisms underlying the perceptual echo and its function remain unknown. Reasoning that natural visual signals often contain temporally predictable, though nonperiodic features, we hypothesized that the perceptual echo may reflect a periodic process associated with regularity learning. To test this hypothesis, we presented subjects with successive repetitions of a rapid nonperiodic luminance sequence, and examined the effects on the perceptual echo, finding that echo amplitude linearly increased with the number of presentations of a given luminance sequence. These data suggest that the perceptual echo reflects a neural signature of regularity learning.Furthermore, when a set of repeated sequences was followed by a sequence with inverted luminance polarities, the echo amplitude decreased to the same level evoked by a novel stimulus sequence. Crucially, when the original stimulus sequence was re-presented, the echo amplitude returned to a level consistent with the number of presentations of this sequence, indicating that the visual system retained sequence-specific information, for many seconds, even in the presence of intervening visual input. Altogether, our results reveal a previously undiscovered regularity learning mechanism within the human visual system, reflected by the perceptual echo.SIGNIFICANCE STATEMENT How the brain encodes and learns fast-changing but nonperiodic visual input remains unknown, even though such visual input characterizes natural scenes. We investigated whether the phenomenon of "perceptual echo" might index such learning. The perceptual echo is a long-lasting reverberation between a rapidly changing visual input and evoked neural activity, apparent in cross-correlations between occipital EEG and stimulus sequences, peaking in the alpha (∼10 Hz) range. We indeed found that perceptual echo is enhanced by repeatedly presenting the same visual sequence, indicating that the human visual system can rapidly and automatically learn regularities embedded within fast-changing dynamic sequences. These results point to a previously undiscovered regularity learning mechanism, operating at a rate defined by the alpha frequency.

Encoding of Predictable and Unpredictable Stimuli by Inferior Temporal Cortical Neurons.

Animals and humans learn statistical regularities that are embedded in sequences of stimuli. The neural mechanisms of such statistical learning are still poorly understood. Previous work in macaque inferior temporal (IT) cortex demonstrated suppressed spiking activity to visual images of a sequence in which the stimulus order was defined by transitional probabilities (labeled as "standard" sequence), compared with a sequence in which the stimulus order was random ("random" sequence). Here, we asked whether IT neurons encode the images of the standard sequence more accurately compared with images of the random sequence. Previous human fMRI studies in different sensory modalities also found a suppressed response to expected relative to unexpected stimuli but obtained various results regarding the effect of expectation on encoding, with one study reporting an improved classification accuracy of expected stimuli despite the reduced activation level. We employed a linear classifier to decode image identity from the spiking responses of the recorded IT neurons. We found a greater decoding accuracy for images of the standard compared with the random sequence during the early part of the stimulus presentation, but further analyses suggested that this reflected the sustained, stimulus-selective activity from the previous stimulus of the sequence, which is typical for IT neurons. However, the peak decoding accuracy was lower for the standard compared with the random sequence, in line with the reduced response to the former compared with the latter images. These data suggest that macaque IT neurons represent less accurately predictable compared with unpredictable images.

An Active RBSE Framework to Generate Optimal Stimulus Sequences in a BCI for Spelling.

A class of brain computer interfaces (BCIs) employs noninvasive recordings of electroencephalography (EEG) signals to enable users with severe speech and motor impairments to interact with their environment and social network. For example, EEG based BCIs for typing popularly utilize event related potentials (ERPs) for inference. Presentation paradigm design in current ERP-based letter by letter typing BCIs typically query the user with an arbitrary subset characters. However, the typing accuracy and also typing speed can potentially be enhanced with more informed subset selection and flash assignment. In this manuscript, we introduce the active recursive Bayesian state estimation (active-RBSE) framework for inference and sequence optimization. Prior to presentation in each iteration, rather than showing a subset of randomly selected characters, the developed framework optimally selects a subset based on a query function. Selected queries are made adaptively specialized for users during each intent detection. Through a simulation-based study, we assess the effect of active-RBSE on the performance of a language-model assisted typing BCI in terms of typing speed and accuracy. To provide a baseline for comparison, we also utilize standard presentation paradigms namely, row and column matrix presentation paradigm and also random rapid serial visual presentation paradigms. The results show that utilization of active-RBSE can enhance the online performance of the system, both in terms of typing accuracy and speed. Moreover, we conduct real time experiments with human participants to study the human-in-the-loop effect on the performance of the proposed active-RBSE framework and consistent with the simulation results, the results of these experiments show improvement both in typing speed and accuracy.

Associative cueing of attention through implicit feature-location binding

In order to assess associative learning between two task-irrelevant features in cueing spatial attention, we devised a task in which participants have to make an identity comparison between two sequential visual stimuli. Unbeknownst to them, location of the second stimulus could be predicted by the colour of the first or a concurrent sound. Albeit unnecessary to perform the identity-matching judgment the predictive features thus provided an arbitrary association favouring the spatial anticipation of the second stimulus. A significant advantage was found with faster responses at predicted compared to non-predicted locations. Results clearly demonstrated an associative cueing of attention via a second-order arbitrary feature/location association but with a substantial discrepancy depending on the sensory modality of the predictive feature. With colour as predictive feature, significant advantages emerged only after the completion of three blocks of trials. On the contrary, sound affected responses from the first block of trials and significant advantages were manifest from the beginning of the second. The possible mechanisms underlying the associative cueing of attention in both conditions are discussed.

Competitive interactions affect working memory performance for both simultaneous and sequential stimulus presentation

Competition between simultaneously presented visual stimuli lengthens reaction time and reduces both the BOLD response and neural firing. In contrast, conditions of sequential presentation have been assumed to be free from competition. Here we manipulated the spatial proximity of stimuli (Near versus Far conditions) to examine the effects of simultaneous and sequential competition on different measures of working memory (WM) for colour. With simultaneous presentation, the measure of WM precision was significantly lower for Near items, and participants reported the colour of the wrong item more often. These effects were preserved when the second stimulus immediately followed the first, disappeared when they were separated by 500 ms, and were partly recovered (evident for our measure of mis-binding but not WM precision) when the task was altered to encourage participants to maintain the sequentially presented items together in WM. Our results show, for the first time, that competition affects the measure of WM precision, and challenge the assumption that sequential presentation removes competition.