Precise Spike Timing Research Articles

Unsupervised learning of temporal features for word categorization in a spiking neural network model of the auditory brain.

The nature of the code used in the auditory cortex to represent complex auditory stimuli, such as naturally spoken words, remains a matter of debate. Here we argue that such representations are encoded by stable spatio-temporal patterns of firing within cell assemblies known as polychronous groups, or PGs. We develop a physiologically grounded, unsupervised spiking neural network model of the auditory brain with local, biologically realistic, spike-time dependent plasticity (STDP) learning, and show that the plastic cortical layers of the network develop PGs which convey substantially more information about the speaker independent identity of two naturally spoken word stimuli than does rate encoding that ignores the precise spike timings. We furthermore demonstrate that such informative PGs can only develop if the input spatio-temporal spike patterns to the plastic cortical areas of the model are relatively stable.

Precise spike timing dynamics of hippocampal place cell activity sensitive to cholinergic disruption.

New memory formation depends on both the hippocampus and modulatory effects of acetylcholine. The mechanism by which acetylcholine levels in the hippocampus enable new encoding remains poorly understood. Here, we tested the hypothesis that cholinergic modulation supports memory formation by leading to structured spike timing in the hippocampus. Specifically, we tested if phase precession in dorsal CA1 was reduced under the influence of a systemic cholinergic antagonist. Unit and field potential were recorded from the dorsal CA1 of rats as they completed laps on a circular track for food rewards before and during the influence of the systemically administered acetylcholine muscarinic receptor antagonist scopolamine. We found that scopolamine significantly reduced phase precession of spiking relative to the field theta, and that this was due to a decrease in the frequency of the spiking rhythmicity. We also found that the correlation between position and theta phase was significantly reduced. This effect was not due to changes in spatial tuning as tuning remained stable for those cells analyzed. Similarly, it was not due to changes in lap‐to‐lap reliability of spiking onset or offset relative to either position or phase as the reliability did not decrease following scopolamine administration. These findings support the hypothesis that memory impairments that follow muscarinic blockade are the result of degraded spike timing in the hippocampus.

Multiplexed Spike Coding and Adaptation in the Thalamus

High-frequency "burst" clusters of spikes are a generic output pattern of many neurons. While bursting is a ubiquitous computational feature of different nervous systems across animal species, the encoding of synaptic inputs by bursts is not well understood. We find that bursting neurons in the rodent thalamus employ "multiplexing" to differentially encode low- and high-frequency stimulus features associated with either T-type calcium "low-threshold" or fast sodium spiking events, respectively, and these events adapt differently. Thus, thalamic bursts encode disparate information in three channels: (1) burst size, (2) burst onset time, and (3) precise spike timing within bursts. Strikingly, this latter "intraburst" encoding channel shows millisecond-level feature selectivity and adapts across statistical contexts to maintain stable information encoded per spike. Consequently, calcium events both encode low-frequency stimuli and, in parallel, gate a transient window for high-frequency, adaptive stimulus encoding by sodiumspike timing, allowing bursts to efficiently convey fine-scale temporal information.

A Cross-Correlated Delay Shift Supervised Learning Method for Spiking Neurons with Application to Interictal Spike Detection in Epilepsy.

This study introduces a novel learning algorithm for spiking neurons, called CCDS, which is able to learn and reproduce arbitrary spike patterns in a supervised fashion allowing the processing of spatiotemporal information encoded in the precise timing of spikes. Unlike the Remote Supervised Method (ReSuMe), synapse delays and axonal delays in CCDS are variants which are modulated together with weights during learning. The CCDS rule is both biologically plausible and computationally efficient. The properties of this learning rule are investigated extensively through experimental evaluations in terms of reliability, adaptive learning performance, generality to different neuron models, learning in the presence of noise, effects of its learning parameters and classification performance. Results presented show that the CCDS learning method achieves learning accuracy and learning speed comparable with ReSuMe, but improves classification accuracy when compared to both the Spike Pattern Association Neuron (SPAN) learning rule and the Tempotron learning rule. The merit of CCDS rule is further validated on a practical example involving the automated detection of interictal spikes in EEG records of patients with epilepsy. Results again show that with proper encoding, the CCDS rule achieves good recognition performance.

Analysis of Encoding Degradation in Spiking Sensors Due to Spike Delay Variation

Spiking sensors such as the silicon retina and cochlea encode analog signals into massively parallel asynchronous spike train output where the information is contained in the precise spike timing. The variation of the spike timing that arises from spike transmission degrades signal encoding quality. Using the signal-to-distortion ratio (SDR) metric with nonlinear spike train decoding based on frame theory, two particular sources of delay variation including comparison delay $T_{\mathbf {DC}}$ and queueing delay $T_{\mathbf {DQ}}$ are evaluated on two encoding mechanisms which have been used for implementations of silicon array spiking sensors: asynchronous delta modulation and self-timed reset. As specific examples, $T_{\mathbf {DC}}$ is obtained from a 2T current-mode comparator, and $T_{\mathbf {DQ}}$ is obtained from an M/D/1 queue for 1-D sensors like the silicon cochlea and an $\text {M}^{\mathrm {\mathbf {X}}}$ /D/1 queue for 2-D sensors like the silicon retina. Quantitative relations between the SDR and the circuit and system parameters of spiking sensors are established. The analysis method presented in this work will be useful for future specifications-guided designs of spiking sensors.

Implementing Signature Neural Networks with Spiking Neurons.

Spiking Neural Networks constitute the most promising approach to develop realistic Artificial Neural Networks (ANNs). Unlike traditional firing rate-based paradigms, information coding in spiking models is based on the precise timing of individual spikes. It has been demonstrated that spiking ANNs can be successfully and efficiently applied to multiple realistic problems solvable with traditional strategies (e.g., data classification or pattern recognition). In recent years, major breakthroughs in neuroscience research have discovered new relevant computational principles in different living neural systems. Could ANNs benefit from some of these recent findings providing novel elements of inspiration? This is an intriguing question for the research community and the development of spiking ANNs including novel bio-inspired information coding and processing strategies is gaining attention. From this perspective, in this work, we adapt the core concepts of the recently proposed Signature Neural Network paradigm—i.e., neural signatures to identify each unit in the network, local information contextualization during the processing, and multicoding strategies for information propagation regarding the origin and the content of the data—to be employed in a spiking neural network. To the best of our knowledge, none of these mechanisms have been used yet in the context of ANNs of spiking neurons. This paper provides a proof-of-concept for their applicability in such networks. Computer simulations show that a simple network model like the discussed here exhibits complex self-organizing properties. The combination of multiple simultaneous encoding schemes allows the network to generate coexisting spatio-temporal patterns of activity encoding information in different spatio-temporal spaces. As a function of the network and/or intra-unit parameters shaping the corresponding encoding modality, different forms of competition among the evoked patterns can emerge even in the absence of inhibitory connections. These parameters also modulate the memory capabilities of the network. The dynamical modes observed in the different informational dimensions in a given moment are independent and they only depend on the parameters shaping the information processing in this dimension. In view of these results, we argue that plasticity mechanisms inside individual cells and multicoding strategies can provide additional computational properties to spiking neural networks, which could enhance their capacity and performance in a wide variety of real-world tasks.

Natural Firing Patterns Imply Low Sensitivity of Synaptic Plasticity to Spike Timing Compared with Firing Rate.

Synaptic plasticity, the change in efficacy of connections between neurons, is thought to underlie learning and memory. The dominant paradigm posits that the precise timing of neural action potentials (APs) is central for plasticity induction. This concept is based on experiments using highly regular and stereotyped patterns of APs, in stark contrast with natural neuronal activity. Using synaptic plasticity models, we investigated how irregular, in vivo-like activity shapes synaptic plasticity. We found that synaptic changes induced by precise timing of APs are much weaker than suggested by regular stimulation protocols, and can be equivalently induced by modest variations of the AP rate alone. Our results call into question the dominant role of precise AP timing for plasticity in natural conditions.

Self-motion evokes precise spike timing in the primate vestibular system.

The accurate representation of self-motion requires the efficient processing of sensory input by the vestibular system. Conventional wisdom is that vestibular information is exclusively transmitted through changes in firing rate, yet under this assumption vestibular neurons display relatively poor detection and information transmission. Here, we carry out an analysis of the system's coding capabilities by recording neuronal responses to repeated presentations of naturalistic stimuli. We find that afferents with greater intrinsic variability reliably discriminate between different stimulus waveforms through differential patterns of precise (∼6 ms) spike timing, while those with minimal intrinsic variability do not. A simple mathematical model provides an explanation for this result. Postsynaptic central neurons also demonstrate precise spike timing, suggesting that higher brain areas also represent self-motion using temporally precise firing. These findings demonstrate that two distinct sensory channels represent vestibular information: one using rate coding and the other that takes advantage of precise spike timing.

Noisy Juxtacellular Stimulation In Vivo Leads to Reliable Spiking and Reveals High-Frequency Coding in Single Neurons.

Nanostimulation of single identified neurons in vivo can control spike frequency parametrically and, surprisingly, can even bias the animal's behavioral response. Here, we extend this stimulation protocol to time-dependent broadband noise stimulation in sensory and motor cortices of rat. In response to such stimuli, we found increased temporal spike-time reliability. The information transmission properties reveal, both experimentally and theoretically, that the neurons support high-frequency stimulation beyond the inverse membrane time. Generating a stimulus using the neuron's response properties, we could evoke prescribed spike times with high precision. Our work helps to establish a novel method for precise temporal control of single-cell spiking and provides a simplified biophysical description of single-neuron spiking under time-dependent in vivo-like stimulation.

Modeling latency code processing in the electric sense: from the biological template to its VLSI implementation

Understanding the coding of sensory information under the temporal constraints of natural behavior is not yet well resolved. There is a growing consensus that spike timing or latency coding can maximally exploit the timing of neural events to make fast computing elements and that such mechanisms are essential to information processing functions in the brain. The electric sense of mormyrid fish provides a convenient biological model where this coding scheme can be studied. The sensory input is a physically ordered spatial pattern of current densities, which is coded in the precise timing of primary afferent spikes. The neural circuits of the processing pathway are well known and the system exhibits the best known illustration of corollary discharge, which provides the reference to decoding the sensory afferent latency pattern. A theoretical model has been constructed from available electrophysiological and neuroanatomical data to integrate the principal traits of the neural processing structure and to study sensory interaction with motor-command-driven corollary discharge signals. This has been used to explore neural coding strategies at successive stages in the network and to examine the simulated network capacity to reproduce output neuron responses. The model shows that the network has the ability to resolve primary afferent spike timing differences in the sub-millisecond range, and that this depends on the coincidence of sensory and corollary discharge-driven gating signals. In the integrative and output stages of the network, corollary discharge sets up a proactive background filter, providing temporally structured excitation and inhibition within the network whose balance is then modulated locally by sensory input. This complements the initial gating mechanism and contributes to amplification of the input pattern of latencies, conferring network hyperacuity. These mechanisms give the system a robust capacity to extract behaviorally meaningful features of the electric image with high sensitivity over a broad working range. Since the network largely depends on spike timing, we finally discuss its suitability for implementation in robotic applications based on neuromorphic hardware.

Supervised Learning in Spiking Neural Networks for Precise Temporal Encoding.

Precise spike timing as a means to encode information in neural networks is biologically supported, and is advantageous over frequency-based codes by processing input features on a much shorter time-scale. For these reasons, much recent attention has been focused on the development of supervised learning rules for spiking neural networks that utilise a temporal coding scheme. However, despite significant progress in this area, there still lack rules that have a theoretical basis, and yet can be considered biologically relevant. Here we examine the general conditions under which synaptic plasticity most effectively takes place to support the supervised learning of a precise temporal code. As part of our analysis we examine two spike-based learning methods: one of which relies on an instantaneous error signal to modify synaptic weights in a network (INST rule), and the other one relying on a filtered error signal for smoother synaptic weight modifications (FILT rule). We test the accuracy of the solutions provided by each rule with respect to their temporal encoding precision, and then measure the maximum number of input patterns they can learn to memorise using the precise timings of individual spikes as an indication of their storage capacity. Our results demonstrate the high performance of the FILT rule in most cases, underpinned by the rule’s error-filtering mechanism, which is predicted to provide smooth convergence towards a desired solution during learning. We also find the FILT rule to be most efficient at performing input pattern memorisations, and most noticeably when patterns are identified using spikes with sub-millisecond temporal precision. In comparison with existing work, we determine the performance of the FILT rule to be consistent with that of the highly efficient E-learning Chronotron rule, but with the distinct advantage that our FILT rule is also implementable as an online method for increased biological realism.

Prefrontal neuronal assemblies temporally control fear behaviour

Precise spike timing through the coordination and synchronization of neuronal assemblies is an efficient and flexible coding mechanism for sensory and cognitive processing. In cortical and subcortical areas, the formation of cell assemblies critically depends on neuronal oscillations, which can precisely control the timing of spiking activity. Whereas this form of coding has been described for sensory processing and spatial learning, its role in encoding emotional behaviour remains unknown. Fear behaviour relies on the activation of distributed structures, among which the dorsal medial prefrontal cortex (dmPFC) is known to be critical for fear memory expression. In the dmPFC, the phasic activation of neurons to threat-predicting cues, a spike-rate coding mechanism, correlates with conditioned fear responses and supports the discrimination between aversive and neutral stimuli. However, this mechanism does not account for freezing observed outside stimuli presentations, and the contribution of a general spike-time coding mechanism for freezing in the dmPFC remains to be established. Here we use a combination of single-unit and local field potential recordings along with optogenetic manipulations to show that, in the dmPFC, expression of conditioned fear is causally related to the organization of neurons into functional assemblies. During fear behaviour, the development of 4 Hz oscillations coincides with the activation of assemblies nested in the ascending phase of the oscillation. The selective optogenetic inhibition of dmPFC neurons during the ascending or descending phases of this oscillation blocks and promotes conditioned fear responses, respectively. These results identify a novel phase-specific coding mechanism, which dynamically regulates the development of dmPFC assemblies to control the precise timing of fear responses.

Silencing CA3 disrupts temporal coding in the CA1 ensemble.

In addition to the place-cell rate code, hippocampal area CA1 employs a temporal code, both on the single-cell and ensemble level, to accurately represent space. Although there is clear evidence that this precise spike timing is organized by theta and gamma oscillations that are present in hippocampus, the circuit mechanisms underlying these temporal codes remain poorly understood. We found that the loss of CA3 input abolished temporal coding at the ensemble level in CA1 despite the persistence of both rate and temporal coding in individual neurons. Moreover, low gamma oscillations were present in CA1 despite the absence of CA3 input, but spikes associated with these periods carried significantly reduced spatial information. Our findings dissociate temporal coding at the single-cell (phase precession) and population (theta sequences) levels and suggest that CA3 input is crucial for temporal coordination of the CA1 ensemble code for space.

CONE: Convex-Optimized-Synaptic Efficacies for Temporally Precise Spike Mapping.

Spiking neural networks are well suited to perform time-dependent pattern recognition problems by encoding the temporal dimension in precise spike times. With an appropriate set of weights, a spiking neuron can emit precisely timed action potentials in response to spatiotemporal input spikes. However, deriving supervised learning rules for spike mapping is nontrivial due to the increased complexity. Existing methods rely on heuristic approaches that do not guarantee a convex objective function and, therefore, may not converge to a global minimum. In this paper, we present a novel technique to obtain the weights of spiking neurons by formulating the problem in a convex optimization framework, rendering it be compatible with the established methods. We introduce techniques to influence the weight distribution and membrane trajectory, and then study how these factors affect robustness in the presence of noise. In addition, we show how the existence of a solution can be determined and assess memory capacity limits of a neuron model using synthetic examples. The practical utility of our technique is further assessed by its application to gait-event detection using the experimental data.

Selectivity of stimulus induced responses in cultured hippocampal networks on microelectrode arrays.

Sensory information can be encoded using the average firing rate and spike occurrence times in neuronal network responses to external stimuli. Decoding or retrieving stimulus characteristics from the response pattern generally implies that the corresponding neural network has a selective response to various input signals. The role of various spiking activity characteristics (e.g., spike rate and precise spike timing) for basic information processing was widely investigated on the level of neural populations but gave inconsistent evidence for particular mechanisms. Multisite electrophysiology of cultured neural networks grown on microelectrode arrays is a recently developed tool and currently an active research area. In this study, we analyzed the stimulus responses represented by network-wide bursts evoked from various spatial locations (electrodes). We found that the response characteristics, such as the burst initiation time and the spike rate, can be used to retrieve information about the stimulus location. The best selectivity in the response spiking pattern could be found for a small subpopulation of neurones (electrodes) at relatively short post-stimulus intervals. Such intervals were unique for each culture due to the non-uniform organization of the functional connectivity in the network during spontaneous development.Electronic supplementary materialThe online version of this article (doi:10.1007/s11571-016-9380-6) contains supplementary material, which is available to authorized users.

Learning of Precise Spike Times with Homeostatic Membrane Potential Dependent Synaptic Plasticity.

Precise spatio-temporal patterns of neuronal action potentials underly e.g. sensory representations and control of muscle activities. However, it is not known how the synaptic efficacies in the neuronal networks of the brain adapt such that they can reliably generate spikes at specific points in time. Existing activity-dependent plasticity rules like Spike-Timing-Dependent Plasticity are agnostic to the goal of learning spike times. On the other hand, the existing formal and supervised learning algorithms perform a temporally precise comparison of projected activity with the target, but there is no known biologically plausible implementation of this comparison. Here, we propose a simple and local unsupervised synaptic plasticity mechanism that is derived from the requirement of a balanced membrane potential. Since the relevant signal for synaptic change is the postsynaptic voltage rather than spike times, we call the plasticity rule Membrane Potential Dependent Plasticity (MPDP). Combining our plasticity mechanism with spike after-hyperpolarization causes a sensitivity of synaptic change to pre- and postsynaptic spike times which can reproduce Hebbian spike timing dependent plasticity for inhibitory synapses as was found in experiments. In addition, the sensitivity of MPDP to the time course of the voltage when generating a spike allows MPDP to distinguish between weak (spurious) and strong (teacher) spikes, which therefore provides a neuronal basis for the comparison of actual and target activity. For spatio-temporal input spike patterns our conceptually simple plasticity rule achieves a surprisingly high storage capacity for spike associations. The sensitivity of the MPDP to the subthreshold membrane potential during training allows robust memory retrieval after learning even in the presence of activity corrupted by noise. We propose that MPDP represents a biophysically plausible mechanism to learn temporal target activity patterns.

Sharp-Wave Ripples Orchestrate the Induction of Synaptic Plasticity during Reactivation of Place Cell Firing Patterns in the Hippocampus.

SummaryPlace cell firing patterns reactivated during hippocampal sharp-wave ripples (SWRs) in rest or sleep are thought to induce synaptic plasticity and thereby promote the consolidation of recently encoded information. However, the capacity of reactivated spike trains to induce plasticity has not been directly tested. Here, we show that reactivated place cell firing patterns simultaneously recorded from CA3 and CA1 of rat dorsal hippocampus are able to induce long-term potentiation (LTP) at synapses between CA3 and CA1 cells but only if accompanied by SWR-associated synaptic activity and resulting dendritic depolarization. In addition, we show that the precise timing of coincident CA3 and CA1 place cell spikes in relation to SWR onset is critical for the induction of LTP and predictive of plasticity generated by reactivation. Our findings confirm an important role for SWRs in triggering and tuning plasticity processes that underlie memory consolidation in the hippocampus during rest or sleep.

Central Gain Restores Auditory Processing following Near-Complete Cochlear Denervation

Sensory organ damage induces a host of cellular and physiological changes in the periphery and the brain. Here, we show that some aspects of auditory processing recover after profound cochlear denervation due to a progressive, compensatory plasticity at higher stages of the central auditory pathway. Lesioning >95% of cochlear nerve afferent synapses, while sparing hair cells, in adult mice virtually eliminated the auditory brainstem response and acoustic startle reflex, yet tone detection behavior was nearly normal. As sound-evoked responses from the auditory nerve grew progressively weaker following denervation, sound-evoked activity in the cortex-and, to a lesser extent, the midbrain-rebounded or surpassed control levels. Increased central gain supported the recovery of rudimentary sound features encoded by firing rate, but not features encoded by precise spike timing such as modulated noise or speech. These findings underscore the importance of central plasticity in the perceptual sequelae of cochlear hearing impairment.

LEARNING STIMULUS-STIMULUS ASSOCIATION IN SPATIO-TEMPORAL NEURAL NETWORKS

We propose a stimulus-stimulus association learning by coupling firing rate and precise spike timing encoding for spatio-temporal neural networks. We simulate a generic recurrent network with random and sparse connectivity consisting of Izhikevich spiking neurons. The magnitude of weight adjustment in learning is dependent on pre- and postsynaptic spikes based on their spikes count and time correlation. As a result of learning, synchronisation of activity among inter- and intra-subpopulation neurons demonstrates association between two stimuli. The associations show in spill-over of activity between the two stimuli involved.

Learning Spatiotemporally Encoded Pattern Transformations in Structured Spiking Neural Networks.

Information encoding in the nervous system is supported through the precise spike timings of neurons; however, an understanding of the underlying processes by which such representations are formed in the first place remains an open question. Here we examine how multilayered networks of spiking neurons can learn to encode for input patterns using a fully temporal coding scheme. To this end, we introduce a new supervised learning rule, MultilayerSpiker, that can train spiking networks containing hidden layer neurons to perform transformations between spatiotemporal input and output spike patterns. The performance of the proposed learning rule is demonstrated in terms of the number of pattern mappings it can learn, the complexity of network structures it can be used on, and its classification accuracy when using multispike-based encodings. In particular, the learning rule displays robustness against input noise and can generalize well on an example data set. Our approach contributes to both a systematic understanding of how computations might take place in the nervous system and a learning rule that displays strong technical capability.