Plasticity Rules Research Articles

Distinct dopaminergic spike-timing-dependent plasticity rules are suited to different functional roles.

Various mathematical models have been formulated to describe the changes in synaptic strengths resulting from spike-timing-dependent plasticity (STDP). A subset of these models include a third factor, dopamine, which interacts with spike timing to contribute to plasticity at specific synapses, notably those from cortex to striatum at the input layer of the basal ganglia. Theoretical work to analyze these plasticity models has largely focused on abstract issues, such as the conditions under which they may promote synchronization and the weight distributions induced by inputs with simple correlation structures, rather than on scenarios associated with specific tasks, and has generally not considered dopamine-dependent forms of STDP. In this paper we introduce three forms of dopamine-modulated STDP adapted from previously proposed plasticity rules. We then analyze, mathematically and with simulations, their performance in three biologically relevant scenarios. We test the ability of each of the three models to maintain its weights in the face of noise and to complete simple reward prediction and action selection tasks, studying the learned weight distributions and corresponding task performance in each setting. Interestingly, we find that each plasticity rule is well suited to a subset of the scenarios studied but falls short in others. Different tasks may therefore require different forms of synaptic plasticity, yielding the prediction that the precise form of the STDP mechanism present may vary across regions of the striatum, and other brain areas impacted by dopamine, that are involved in distinct computational functions.

Synaptic weight dynamics underlying memory consolidation: Implications for learning rules, circuit organization, and circuit function

Systems consolidation is a common feature of learning and memory systems, in which a long-term memory initially stored in one brain region becomes persistently stored in another region. We studied the dynamics of systems consolidation in simple circuit architectures with two sites of plasticity, one in an early-learning and one in a late-learning brain area. We show that the synaptic dynamics of the circuit during consolidation of an analog memory can be understood as a temporal integration process, by which transient changes in activity driven by plasticity in the early-learning area are accumulated into persistent synaptic changes at the late-learning site. This simple principle naturally leads to a speed-accuracy tradeoff in systems consolidation and provides insight into how the circuit mitigates the stability-plasticity dilemma of storing new memories while preserving core features of older ones. Furthermore, it imposes two constraints on the circuit. First, the plasticity rule at the late-learning site must stably support a continuum of possible outputs for a given input. We show that this is readily achieved by heterosynaptic but not standard Hebbian rules. Second, to turn off the consolidation process and prevent erroneous changes at the late-learning site, neural activity in the early-learning area must be reset to its baseline activity. We provide two biologically plausible implementations for this reset that propose functional roles in stabilizing consolidation for core elements of the cerebellar circuit.

Rate-Based Synaptic Plasticity Rules

Rate-Based Synaptic Plasticity Rules

An Electrolyte‐Gated InGaZnO Phototransistor that Emulates Visual Experience‐Dependent Plasticity

AbstractInspired by neurobiological learning rules, bionic devices that simulate the fundamental functions of synapses and neurons provide a highly effective approach to neuromorphic computing. Among various learning rules, the Bienenstock‐Cooper‐Munro (BCM) learning rule can explain the threshold sliding effect of synaptic weight modification in the visual cortex, which is difficult to explain with the classical Hebb's rule. Existing research mainly focuses on exploiting electrical stimulation to implement the BCM rule, while the optical implementation is still unexplored. In this paper, the light‐history‐dependent BCM learning rule is implemented with electrolyte‐gated InGaZnO (IGZO) transistors. The channel conductance can be modulated through light illumination and electrical stimulation. By utilizing the light‐history‐dependent property of the IGZO electrolyte‐gated transistor and following the triplet‐spike‐timing‐dependent plasticity (STDP) rules, the BCM learning rule is successfully emulated in a single device. Moreover, the light‐history‐dependent property enables a variety of bionic vision functions including image edge detection and associative memory. This work provides a paradigm for the novel implementation of the BCM rule and paves the way for further development of machine vision systems.

Rapid context inference in a thalamocortical model using recurrent neural networks

Cognitive flexibility is a fundamental ability that enables humans and animals to exhibit appropriate behaviors in various contexts. The thalamocortical interactions between the prefrontal cortex (PFC) and the mediodorsal thalamus (MD) have been identified as crucial for inferring temporal context, a critical component of cognitive flexibility. However, the neural mechanism responsible for context inference remains unknown. To address this issue, we propose a PFC-MD neural circuit model that utilizes a Hebbian plasticity rule to support rapid, online context inference. Specifically, the model MD thalamus can infer temporal contexts from prefrontal inputs within a few trials. This is achieved through the use of PFC-to-MD synaptic plasticity with pre-synaptic traces and adaptive thresholding, along with winner-take-all normalization in the MD. Furthermore, our model thalamus gates context-irrelevant neurons in the PFC, thus facilitating continual learning. We evaluate our model performance by having it sequentially learn various cognitive tasks. Incorporating an MD-like component alleviates catastrophic forgetting of previously learned contexts and demonstrates the transfer of knowledge to future contexts. Our work provides insight into how biological properties of thalamocortical circuits can be leveraged to achieve rapid context inference and continual learning.

Inhibitory plasticity supports replay generalization in the hippocampus.

Memory consolidation assimilates recent experiences into long-term memory. This process requires the replay of learned sequences, although the content of these sequences remains controversial. Recent work has shown that the statistics of replay deviate from those of experience: stimuli that are experientially salient may be either recruited or suppressed from sharp-wave ripples. In this study, we found that this phenomenon can be explained parsimoniously and biologically plausibly by a Hebbian spike-time-dependent plasticity rule at inhibitory synapses. Using models at three levels of abstraction-leaky integrate-and-fire, biophysically detailed and abstract binary-we show that this rule enables efficient generalization, and we make specific predictions about the consequences of intact and perturbed inhibitory dynamics for network dynamics and cognition. Finally, we use optogenetics to artificially implant non-generalizable representations into the network in awake behaving mice, and we find that these representations also accumulate inhibition during sharp-wave ripples, experimentally validating a major prediction of our model. Our work outlines a potential direct link between the synaptic and cognitive levels of memory consolidation, with implications for both normal learning and neurological disease.

Dynamic control of sequential retrieval speed in networks with heterogeneous learning rules

Temporal rescaling of sequential neural activity has been observed in multiple brain areas during behaviors involving time estimation and motor execution at variable speeds. Temporally asymmetric Hebbian rules have been used in network models to learn and retrieve sequential activity, with characteristics that are qualitatively consistent with experimental observations. However, in these models sequential activity is retrieved at a fixed speed. Here, we investigate the effects of a heterogeneity of plasticity rules on network dynamics. In a model in which neurons differ by the degree of temporal symmetry of their plasticity rule, we find that retrieval speed can be controlled by varying external inputs to the network. Neurons with temporally symmetric plasticity rules act as brakes and tend to slow down the dynamics, while neurons with temporally asymmetric rules act as accelerators of the dynamics. We also find that such networks can naturally generate separate ‘preparatory’ and ‘execution’ activity patterns with appropriate external inputs.

Spatial sensorimotor mismatch between the motor command and somatosensory feedback decreases motor cortical excitability. A transcranial magnetic stimulation-virtual reality study.

Effective control of movement predominantly depends on the exchange and integration between sensory feedback received by our body and motor command. However, the precise mechanisms governing the adaptation of the motor system's response to altered somatosensory signals (i.e., discrepancies between an action performed and feedback received) following movement execution remain largely unclear. In order to address these questions, we developed a unique paradigm using virtual reality (VR) technology. This paradigm can induce spatial incongruence between the motor commands executed by a body district (i.e., moving the right hand) and the resulting somatosensory feedback received (i.e., feeling touch on the left ankle). We measured functional sensorimotor plasticity in 17 participants by assessing the effector's motor cortical excitability (right hand) before and after a 10-min VR task. The results revealed a decrease in motor cortical excitability of the movement effector following exposure to a 10-min conflict between the motor output and the somatosensory input, in comparison to the control condition where spatial congruence between the moved body part and the area of the body that received the feedback was maintained. This finding provides valuable insights into the functional plasticity resulting from spatial sensorimotor conflict arising from the discrepancy between the anticipated and received somatosensory feedback following movement execution. The cortical reorganization observed can be attributed to functional plasticity mechanisms within the sensorimotor cortex that are related to establishing a new connection between somatosensory input and motor output, guided by temporal binding and the Hebbian plasticity rule.

ETLP: event-based three-factor local plasticity for online learning with neuromorphic hardware

Neuromorphic perception with event-based sensors, asynchronous hardware, and spiking neurons shows promise for real-time, energy-efficient inference in embedded systems. Brain-inspired computing aims to enable adaptation to changes at the edge with online learning. However, the parallel and distributed architectures of neuromorphic hardware based on co-localized compute and memory imposes locality constraints to the on-chip learning rules. We propose the event-based three-factor local plasticity (ETLP) rule that uses the pre-synaptic spike trace, the post-synaptic membrane voltage and a third factor in the form of projected labels with no error calculation, that also serve as update triggers. ETLP is applied to visual and auditory event-based pattern recognition using feedforward and recurrent spiking neural networks. Compared to back-propagation through time, eProp and DECOLLE, ETLP achieves competitive accuracy with lower computational complexity. We also show that when using local plasticity, threshold adaptation in spiking neurons and a recurrent topology are necessary to learn spatio-temporal patterns with a rich temporal structure. Finally, we provide a proof of concept hardware implementation of ETLP on FPGA to highlight the simplicity of its computational primitives and how they can be mapped into neuromorphic hardware for online learning with real-time interaction and low energy consumption.

Hybrid CMOS-Memristor synapse circuits for implementing Ca ion-based plasticity model

Neuromorphic computing research is being actively pursued to address the challenges posed by the need for energy-efficient processing of big data. One of the promising approaches to tackle the challenges is the hardware implementation of spiking neural networks (SNNs) with bio-plausible learning rules. Numerous research works have been done to implement the SNN hardware with different synaptic plasticity rules to emulate human brain operations. While a standard spike-timing-dependent-plasticity (STDP) rule is emulated in many SNN hardware, the various STDP rules found in the biological brain have rarely been implemented in hardware. This study proposes a CMOS-memristor hybrid synapse circuit for the hardware implementation of a Ca ion-based plasticity model to emulate the various STDP curves. The memristor was adopted as a memory device in the CMOS synapse circuit because memristors have been identified as promising candidates for analog non-volatile memory devices in terms of energy efficiency and scalability. The circuit design was divided into four sub-blocks based on biological behavior, exploiting the non-volatile and analog state properties of memristors. The circuit was designed to vary weights using an H-bridge circuit structure and PWM modulation. The various STDP curves have been emulated in one CMOS-memristor hybrid circuit, and furthermore a simple neural network operation was demonstrated for associative learning such as Pavlovian conditioning. The proposed circuit is expected to facilitate large-scale operations for neuromorphic computing through its scale-up.

Recall tempo of Hebbian sequences depends on the interplay of Hebbian kernel with tutor signal timing

Understanding how neural circuits generate sequential activity is a longstanding challenge. While foundational theoretical models have shown how sequences can be stored as memories in neural networks with Hebbian plasticity rules, these models considered only a narrow range of Hebbian rules. Here, we introduce a model for arbitrary Hebbian plasticity rules, capturing the diversity of spike-timing-dependent synaptic plasticity seen in experiments, and show how the choice of these rules and of neural activity patterns influences sequence memory formation and retrieval. In particular, we derive a general theory that predicts the tempo of sequence replay. This theory lays a foundation for explaining how cortical tutor signals might give rise to motor actions that eventually become "automatic." Our theory also captures the impact of changing the tempo of the tutor signal. Beyond shedding light on biological circuits, this theory has relevance in artificial intelligence by laying a foundation for frameworks whereby slow and computationally expensive deliberation can be stored as memories and eventually replaced by inexpensive recall.

Synaptic weight dynamics underlying memory consolidation: implications for learning rules, circuit organization, and circuit function.

How are memories transformed over time? We propose a simple organizing principle for how long term memories are moved from an initial to a final site of storage. We show that successful transfer occurs when the late site of memory storage is endowed with synaptic plasticity rules that stably accumulate changes in activity occurring at the early site of memory storage. We instantiate this principle in a simple computational model that is representative of brain circuits underlying a variety of behaviors. The model suggests how a neural circuit can store new memories while preserving core features of older ones, and suggests novel roles for core elements of the cerebellar circuit.

Selective consolidation of learning and memory via recall-gated plasticity.

In a variety of species and behavioral contexts, learning and memory formation recruits two neural systems, with initial plasticity in one system being consolidated into the other over time. Moreover, consolidation is known to be selective; that is, some experiences are more likely to be consolidated into long-term memory than others. Here, we propose and analyze a model that captures common computational principles underlying such phenomena. The key component of this model is a mechanism by which a long-term learning and memory system prioritizes the storage of synaptic changes that are consistent with prior updates to the short-term system. This mechanism, which we refer to as recall-gated consolidation, has the effect of shielding long-term memory from spurious synaptic changes, enabling it to focus on reliable signals in the environment. We describe neural circuit implementations of this model for different types of learning problems, including supervised learning, reinforcement learning, and autoassociative memory storage. These implementations involve synaptic plasticity rules modulated by factors such as prediction accuracy, decision confidence, or familiarity. We then develop an analytical theory of the learning and memory performance of the model, in comparison to alternatives relying only on synapse-local consolidation mechanisms. We find that recall-gated consolidation provides significant advantages, substantially amplifying the signal-to-noise ratio with which memories can be stored in noisy environments. We show that recall-gated consolidation gives rise to a number of phenomena that are present in behavioral learning paradigms, including spaced learning effects, task-dependent rates of consolidation, and differing neural representations in short- and long-term pathways.

Contributions of cortical neuron firing patterns, synaptic connectivity, and plasticity to task performance

Neuronal responses during behavior are diverse, ranging from highly reliable ‘classical’ responses to irregular ‘non-classically responsive’ firing. While a continuum of response properties is observed across neural systems, little is known about the synaptic origins and contributions of diverse responses to network function, perception, and behavior. To capture the heterogeneous responses measured from auditory cortex of rodents performing a frequency recognition task, we use a novel task-performing spiking recurrent neural network incorporating spike-timing-dependent plasticity. Reliable and irregular units contribute differentially to task performance via output and recurrent connections, respectively. Excitatory plasticity shifts the response distribution while inhibition constrains its diversity. Together both improve task performance with full network engagement. The same local patterns of synaptic inputs predict spiking response properties of network units and auditory cortical neurons from in vivo whole-cell recordings during behavior. Thus, diverse neural responses contribute to network function and emerge from synaptic plasticity rules.

Co-existence of synaptic plasticity and metastable dynamics in a spiking model of cortical circuits.

Evidence for metastable dynamics and its role in brain function is emerging at a fast pace and is changing our understanding of neural coding by putting an emphasis on hidden states of transient activity. Clustered networks of spiking neurons have enhanced synaptic connections among groups of neurons forming structures called cell assemblies; such networks are capable of producing metastable dynamics that is in agreement with many experimental results. However, it is unclear how a clustered network structure producing metastable dynamics may emerge from a fully local plasticity rule, i.e., a plasticity rule where each synapse has only access to the activity of the neurons it connects (as opposed to the activity of other neurons or other synapses). Here, we propose a local plasticity rule producing ongoing metastable dynamics in a deterministic, recurrent network of spiking neurons. The metastable dynamics co-exists with ongoing plasticity and is the consequence of a self-tuning mechanism that keeps the synaptic weights close to the instability line where memories are spontaneously reactivated. In turn, the synaptic structure is stable to ongoing dynamics and random perturbations, yet it remains sufficiently plastic to remap sensory representations to encode new sets of stimuli. Both the plasticity rule and the metastable dynamics scale well with network size, with synaptic stability increasing with the number of neurons. Overall, our results show that it is possible to generate metastable dynamics over meaningful hidden states using a simple but biologically plausible plasticity rule which co-exists with ongoing neural dynamics.

A cerebellar granule cell-climbing fiber computation to learn to track long time intervals

In classical cerebellar learning, Purkinje cells (PkCs) associate climbing fiber (CF) error signals with predictive granule cells (GrCs) that were active just prior (∼150ms). The cerebellum also contributes to behaviors characterized by longer timescales. To investigate how GrC-CF-PkC circuits might learn seconds-long predictions, we imaged simultaneous GrC-CF activity over days of forelimb operant conditioning for delayed water reward. As mice learned reward timing, numerous GrCs developed anticipatory activity ramping at different rates until reward delivery, followed by widespread time-locked CF spiking. Relearning longer delays further lengthened GrC activations. We computed CF-dependent GrC→PkC plasticity rules, demonstrating that reward-evoked CF spikes sufficed to grade many GrC synapses by anticipatory timing. We predicted and confirmed that PkCs could thereby continuously ramp across seconds-long intervals from movement to reward. Learning thus leads to new GrC temporal bases linking predictors to remote CF reward signals-a strategy well suited for learning to track the long intervals common in cognitive domains.

Conductance-based dendrites perform Bayes-optimal cue integration.

A fundamental function of cortical circuits is the integration of information from different sources to form a reliable basis for behavior. While animals behave as if they optimally integrate information according to Bayesian probability theory, the implementation of the required computations in the biological substrate remains unclear. We propose a novel, Bayesian view on the dynamics of conductance-based neurons and synapses which suggests that they are naturally equipped to optimally perform information integration. In our approach apical dendrites represent prior expectations over somatic potentials, while basal dendrites represent likelihoods of somatic potentials. These are parametrized by local quantities, the effective reversal potentials and membrane conductances. We formally demonstrate that under these assumptions the somatic compartment naturally computes the corresponding posterior. We derive a gradient-based plasticity rule, allowing neurons to learn desired target distributions and weight synaptic inputs by their relative reliabilities. Our theory explains various experimental findings on the system and single-cell level related to multi-sensory integration, which we illustrate with simulations. Furthermore, we make experimentally testable predictions on Bayesian dendritic integration and synaptic plasticity.

Co-existence of synaptic plasticity and metastable dynamics in a spiking model of cortical circuits.

Evidence for metastable dynamics and its role in brain function is emerging at a fast pace and is changing our understanding of neural coding by putting an emphasis on hidden states of transient activity. Clustered networks of spiking neurons have enhanced synaptic connections among groups of neurons forming structures called cell assemblies; such networks are capable of producing metastable dynamics that is in agreement with many experimental results. However, it is unclear how a clustered network structure producing metastable dynamics may emerge from a fully local plasticity rule, i.e., a plasticity rule where each synapse has only access to the activity of the neurons it connects (as opposed to the activity of other neurons or other synapses). Here, we propose a local plasticity rule producing ongoing metastable dynamics in a deterministic, recurrent network of spiking neurons. The metastable dynamics co-exists with ongoing plasticity and is the consequence of a self-tuning mechanism that keeps the synaptic weights close to the instability line where memories are spontaneously reactivated. In turn, the synaptic structure is stable to ongoing dynamics and random perturbations, yet it remains sufficiently plastic to remap sensory representations to encode new sets of stimuli. Both the plasticity rule and the metastable dynamics scale well with network size, with synaptic stability increasing with the number of neurons. Overall, our results show that it is possible to generate metastable dynamics over meaningful hidden states using a simple but biologically plausible plasticity rule which co-exists with ongoing neural dynamics.

Understanding Cerebellar Input Stage through Computational and Plasticity Rules.

A central hypothesis concerning brain functioning is that plasticity regulates the signal transfer function by modifying the efficacy of synaptic transmission. In the cerebellum, the granular layer has been shown to control the gain of signals transmitted through the mossy fiber pathway. Until now, the impact of plasticity on incoming activity patterns has been analyzed by combining electrophysiological recordings in acute cerebellar slices and computational modeling, unraveling a broad spectrum of different forms of synaptic plasticity in the granular layer, often accompanied by forms of intrinsic excitability changes. Here, we attempt to provide a brief overview of the most prominent forms of plasticity at the excitatory synapses formed by mossy fibers onto primary neuronal components (granule cells, Golgi cells and unipolar brush cells) in the granular layer. Specifically, we highlight the current understanding of the mechanisms and their functional implications for synaptic and intrinsic plasticity, providing valuable insights into how inputs are processed and reconfigured at the cerebellar input stage.

Spatial interactions impact on Ca-driven synaptic plasticity: An ionic cable theory perspective

We extend our previous paper on deriving an approximate analytical solution of a nonlinear cable equation by including other ion channels in neurons and calcium dynamics based on reaction-diffusion dynamics that lead to a system of nonlinear cable equations. Here, excitable dendrite possesses clusters of voltage-activated ion channels that are discretely distributed as point sources or hotspots of transmembrane current along a continuous cable structure of fixed length. Single and/or trains of action potentials and spatially distributed synaptic inputs drive the depolarisation and activate sparsely distributed voltage-dependent calcium channels. This leads to calcium influx and diffusion in the cable. Here, time-dependent analytical solutions were obtained by applying a perturbation expansion of the non-dimensional voltage (Φ) and non-dimensional calcium (ΦCa) and then solving the resulting set of integral equations. We use this framework to gain insights into calcium-driven synaptic plasticity in dendrites. Many previous studies have traditionally focused on the local impact of calcium on whether the synapse's strength is increased (potentiated) or decreased (depressed). Only recently have studies focusing on heterosynaptic plasticity been gaining popularity, and here we ask the question of how a local plasticity rule is influenced by the spatially and temporally distributed synaptic inputs. Specifically, we focus on how synaptic inputs and calcium influx impact a calcium-derived temporal learning window for spike-timing-dependent plasticity (STDP) at nearby sites to assess the nature of the resulting distance-dependent interaction on the associated learning window at the synapse of interest.