Single-trial Learning Research Articles

The use of Guthrie’s theory in a combination of stimulus and response

Eliminating punishment can lead to a lack of focus or the emergence of bad habits that can affect the teaching and learning process. Stimulus and response should be given continuously as Guthrie suggested. The Contiguous Conditioning Theory created by Edwin Ray Guthrie (1886-1959) says the punishment given during the learning process is needed to change a person's behavior, exercises and tests or tests need to be done to get used to the stimulus that is needed. The purpose of this research are 1) to find the effects of using punishment, reward, exercise, and test (fatigue method), 2) to find The Contiguous Conditioning Theory using fatigue method in one single trial learning can be a new technique in learning English. It is experimental research. The result shows the Guthrie theory of fatigue method in one single trial learning is considered appropriate. The use of punishment and rewards gives a better stimulus. The experiment group has a better average point.

B - 79 Response Time to Derived Relations Is Related to Episodic Memory Performance.

After two stimulus pairs with a common stimulus are presented, healthy adults readily derive multiple indirect associations between each stimulus without explicit training. Factors related to this ability to derive new associations are relatively unstudied. We investigated the effects of sex and episodic memory performance on response times (RT) for different stimulus types (letters versus symbols) during trained and derived relational responding. Ninety-four cognitively healthy young adults were administered a relational responding (RR) task and the Hopkins Verbal Learning Test-Revised (HVLT-R) remotely via videoconferencing. In the RR task, two associations were directly trained in a single learning trial (A→B; A→C). Four other associations can be derived (B→A; C→A; B→C; C→B). Moderated multiple regressions examined main and interaction effects of sex and HVLT-R performance on correct RTs for trained and derived relations between letters and symbols, separately. Higher HVLT-R immediate and delayed recall scores were associated with faster RTs for all derived, but not trained, relations in the letter (p = 0.001-0.022) and symbol (p = 0.006-0.043) conditions. There was no main effect of sex, but significant sex by HVLT-R interactions were observed for several derived relations in the symbol (p = 0.032-0.044) and letter conditions (p = 0.035). Only males showed a significant RR-HVLT-R association. After a single presentation of two stimulus pairs, participants learned the two trained associations and independently derived four new, untrained stimulus relations. Better HVLT-R performance predicted faster RT uniquely for derived relations between letters/symbols. This relationship was more robust in males. Future research should evaluate the effectiveness of RR-based interventions for memory rehabilitation.

An explainable artificial intelligence approach to spatial navigation based on hippocampal circuitry

Learning to navigate a complex environment is not a difficult task for a mammal. For example, finding the correct way to exit a maze following a sequence of cues, does not need a long training session. Just a single or a few runs through a new environment is, in most cases, sufficient to learn an exit path starting from anywhere in the maze. This ability is in striking contrast with the well-known difficulty that any deep learning algorithm has in learning a trajectory through a sequence of objects. Being able to learn an arbitrarily long sequence of objects to reach a specific place could take, in general, prohibitively long training sessions. This is a clear indication that current artificial intelligence methods are essentially unable to capture the way in which a real brain implements a cognitive function. In previous work, we have proposed a proof-of-principle model demonstrating how, using hippocampal circuitry, it is possible to learn an arbitrary sequence of known objects in a single trial. We called this model SLT (Single Learning Trial). In the current work, we extend this model, which we will call e-STL, to introduce the capability of navigating a classic four-arms maze to learn, in a single trial, the correct path to reach an exit ignoring dead ends. We show the conditions under which the e-SLT network, including cells coding for places, head-direction, and objects, can robustly and efficiently implement a fundamental cognitive function. The results shed light on the possible circuit organization and operation of the hippocampus and may represent the building block of a new generation of artificial intelligence algorithms for spatial navigation.

Atypical hypnotic compound ML297 restores sleep architecture immediately following emotionally valenced learning, to promote memory consolidation and hippocampal network activation during recall.

Sleep plays a critical role in consolidating many forms of hippocampus-dependent memory. While various classes of hypnotic drugs have been developed in recent years, it remains unknown whether, or how, some of them affect sleep-dependent memory consolidation mechanisms. We find that ML297, a recently developed candidate hypnotic agent targeting a new mechanism (activating GIRK1/2-subunit containing G-protein coupled inwardly rectifying potassium [GIRK] channels), alters sleep architecture in mice over the first 6 hr following a single-trial learning event. Following contextual fear conditioning (CFC), ML297 reversed post-CFC reductions in NREM sleep spindle power and REM sleep amounts and architecture, renormalizing sleep features to what was observed at baseline, prior to CFC. Renormalization of post-CFC REM sleep latency, REM sleep amounts, and NREM spindle power were all associated with improved contextual fear memory (CFM) consolidation. We find that improvements in CFM consolidation due to ML297 are sleep-dependent, and are associated with increased numbers of highly activated dentate gyrus (DG), CA1, and CA3 neurons during CFM recall. Together our findings suggest that GIRK1/2 channel activation restores normal sleep architecture- including REM sleep, which is normally suppressed following CFC-and increases the number of hippocampal neurons incorporated into the CFM engram during memory consolidation.

The role of non-coding RNAs in the formation of long-term associative memory after single-trial learning in Lymnaea.

Investigations of the molecular mechanisms of long-term associative memory have revealed key roles for a number of highly evolutionarily conserved molecular pathways in a variety of different vertebrate and invertebrate model systems. One such system is the pond snail Lymnaea stagnalis, in which, like in other systems, the transcription factors CREB1 and CREB2 and the enzyme NOS play essential roles in the consolidation of long-term associative memory. More recently, epigenetic control mechanisms, such as DNA methylation, histone modifications, and control of gene expression by non-coding RNAs also have been found to play important roles in all model systems. In this minireview, we will focus on how, in Lymnaea, even a single episode of associative learning can activate CREB and NO dependent cascades due to the training-induced up- or downregulation of the expression levels of recently identified short and long non-coding RNAs.

Calcium-Permeable AMPA Receptors Mediate Timing-Dependent LTP Elicited by Low Repeat Coincident Pre- and Postsynaptic Activity at Schaffer Collateral-CA1 Synapses.

High-frequency stimulation induced long-term potentiation (LTP) and low-frequency stimulation induced LTD are considered as cellular models of memory formation. Interestingly, spike timing-dependent plasticity (STDP) can induce equally robust timing-dependent LTP (t-LTP) and t-LTD in response to low frequency repeats of coincident action potential (AP) firing in presynaptic and postsynaptic cells. Commonly, STDP paradigms relying on 25-100 repeats of coincident AP firing are used to elicit t-LTP or t-LTD, but the minimum number of repeats required for successful STDP is barely explored. However, systematic investigation of physiologically relevant low repeat STDP paradigms is of utmost importance to explain learning mechanisms in vivo. Here, we examined low repeat STDP at Schaffer collateral-CA1 synapses by pairing one presynaptic AP with either one postsynaptic AP (1:1t-LTP), or a burst of 4 APs (1:4t-LTP) and found 3-6 repeats to be sufficient to elicit t-LTP. 6× 1:1t-LTP required postsynaptic Ca2+ influx via NMDARs and L-type VGCCs and was mediated by increased presynaptic glutamate release. In contrast, 1:4t-LTP depended on postsynaptic metabotropic GluRs and ryanodine receptor signaling and was mediated by postsynaptic insertion of AMPA receptors. Unexpectedly, both 6× t-LTP variants were strictly dependent on activation of postsynaptic Ca2+-permeable AMPARs but were differentially regulated by dopamine receptor signaling. Our data show that synaptic changes induced by only 3-6 repeats of mild STDP stimulation occurring in ≤10s can take place on time scales observed also during single trial learning.

A Mechanistic Model for Reward Prediction and Extinction Learning in the Fruit Fly.

Extinction learning, the ability to update previously learned information by integrating novel contradictory information, is of high clinical relevance for therapeutic approaches to the modulation of maladaptive memories. Insect models have been instrumental in uncovering fundamental processes of memory formation and memory update. Recent experimental results in Drosophila melanogaster suggest that, after the behavioral extinction of a memory, two parallel but opposing memory traces coexist, residing at different sites within the mushroom body (MB). Here, we propose a minimalistic circuit model of the Drosophila MB that supports classical appetitive and aversive conditioning and memory extinction. The model is tailored to the existing anatomic data and involves two circuit motives of central functional importance. It employs plastic synaptic connections between Kenyon cells (KCs) and MB output neurons (MBONs) in separate and mutually inhibiting appetitive and aversive learning pathways. Recurrent modulation of plasticity through projections from MBONs to reinforcement-mediating dopaminergic neurons (DAN) implements a simple reward prediction mechanism. A distinct set of four MBONs encodes odor valence and predicts behavioral model output. Subjecting our model to learning and extinction protocols reproduced experimental results from recent behavioral and imaging studies. Simulating the experimental blocking of synaptic output of individual neurons or neuron groups in the model circuit confirmed experimental results and allowed formulation of testable predictions. In the temporal domain, our model achieves rapid learning with a step-like increase in the encoded odor value after a single pairing of the conditioned stimulus (CS) with a reward or punishment, facilitating single-trial learning.

Elucidating memory in the brain via single-cell transcriptomics.

Elucidating the neural mechanisms of memory in the brain is a central goal of neuroscience. Here, we discuss modern-day transcriptomics methodologies, and how they are well-poised to revolutionize our insight into memory mechanisms at unprecedented resolution and throughput. Focusing on the hippocampus and amygdala, two regions extensively examined in memory research, we show how single-cell transcriptomics technologies have been leveraged to understand the naïve state of these brain regions. Building upon this foundation, we show that these technologies can be applied to single-trial learning paradigms to comprehensively identify molecules and cells that participate in the encoding and retrieval of memory. Transcriptomics also provides an opportunity to understand the cell-type organization of the human hippocampus and amygdala, and due to conservation of these brain regions between humans and rodents, to infer behavioral and causal contributions in the human brain by leveraging rodent cell-type homologies and interventions. Ultimately, such transcriptomic technologies are poised to usher in a qualitatively novel understanding of memory in the brain.

Another Example of Conditioned Taste Aversion: Case of Snails.

Simple SummaryIt is important to decide what to eat and what not to eat in the life. Children are likely to reject new foods. When eating a new food results in a negative experience, the child will avoid that specific food in the future. This phenomenon is called ‘conditioned taste aversion’ in mammals, and it is considered necessary for survival by preventing subsequent ingestion of sickening foods. Many researchers study the same kind of phenomenon in invertebrates, too. For example, the formation of conditioned taste aversion was found in the pond snail, Lymnaea stagnalis, with the selective associability between a sweet sucrose solution and a bitter KCl solution. A sweet food attracts many kinds of animals, resulting in the feeding response, whereas a KCl solution is an aversive stimulus, inducing a withdrawal response in snails. After repeated temporally-contingent presentations of these two stimuli, the sucrose solution no longer elicits a feeding response, and this phenomenon persists for a long term. In the present review, we first outline the mechanisms of conditioned taste aversion in mammals, then introduce the conditioned taste aversion in snails, and compare them. Furthermore, the molecular events in snails are discussed, suggesting the general mechanism in conditioned taste aversion.Conditioned taste aversion (CTA) in mammals has several specific characteristics: (1) emergence of a negative symptom in subjects due to selective association with a taste-related stimulus, (2) robust long-term memory that is resistant to extinction induced by repeated presentation of the conditioned stimulus (CS), (3) a very-long-delay presentation of the unconditioned stimulus (US), and (4) single-trial learning. The pond snail, Lymnaea stagnalis, can also form a CTA. Although the negative symptoms, like nausea, in humans cannot be easily observed in invertebrate animal models of CTA, all the other characteristics of CTA seem to be present in snails. Selective associability was confirmed using a sweet sucrose solution and a bitter KCl solution. Once snails form a CTA, repeated presentation of the CS does not extinguish the CTA. A long interstimulus interval between the CS and US, like in trace conditioning, still results in the formation of a CTA in snails. Lastly, even single-trial learning has been demonstrated with a certain probability. In the present review, we compare, in detail, CTA in mammals and snails, and discuss the possible molecular events in CTA.

Differential changes in GAP-43 or synaptophysin during appetitive and aversive taste memory formation

Association between events in time and space is a major mechanism for all animals, including humans, which allows them to learn about the world and potentially change their behavior in the future to adapt to different environments. Conditioning taste aversion (CTA) is a single-trial learning paradigm where animals are trained to avoid a novel flavor which is associated with malaise. Many variables can be analyzed with this model and the circuits involved are well described. Thus, the amygdala and the gustatory cortex (GC) are some of the most relevant structures involved in CTA. In the present study we focused in plastic changes that occur during appetitive and/or aversive taste memory formation. Previous studies have demonstrated that memory consolidation, in hippocampal dependent paradigms, induces plastic changes like increase in the concentration of proteins considered as markers of neuronal plasticity, such as the growth associated protein 43 (GAP-43) and synaptophysin (SYN). In the present experiment in male rats we evaluated changes in GAP-43 and SYN expression, using immunofluorescence, induce by the formation of aversive and appetitive taste memory. We found that taste aversive memory formation can induce an increase in GAP-43 in the granular layer of the GC. Furthermore, we also found an increase in SYN expression in both layers of the GC, the basolateral amygdala (BLA) and the central amygdala (CeA). These results suggest that aversive memory representation induces a new circuitry (inferred from an increase in GAP 43). On the other hand, an appetitive taste learning increased SYN expression in the GC (both layers), the BLA and the CeA without any changes in GAP 43. Together these results indicate that aversive memory formation induces structural and synaptic changes, while appetitive memory formation induces synaptic changes; suggesting that aversive and appetitive memories require a different set of cortical and amygdala plastic changes.

Cockroaches Show Individuality in Learning and Memory During Classical and Operant Conditioning.

Animal personality and individuality are intensively researched in vertebrates and both concepts are increasingly applied to behavioral science in insects. However, only few studies have looked into individuality with respect to performance in learning and memory tasks. In vertebrates, individual learning capabilities vary considerably with respect to learning speed and learning rate. Likewise, honeybees express individual learning abilities in a wide range of classical conditioning protocols. Here, we study individuality in the learning and memory performance of cockroaches, both in classical and operant conditioning tasks. We implemented a novel classical (olfactory) conditioning paradigm where the conditioned response is established in the maxilla-labia response (MLR). Operant spatial learning was investigated in a forced two-choice task using a T-maze. Our results confirm individual learning abilities in classical conditioning of cockroaches that was reported for honeybees and vertebrates but contrast long-standing reports on stochastic learning behavior in fruit flies. In our experiments, most learners expressed a correct behavior after only a single learning trial showing a consistent high performance during training and test. We can further show that individual learning differences in insects are not limited to classical conditioning but equally appear in operant conditioning of the cockroach.

Bidirectional short-term plasticity during single-trial learning of cerebellar-driven eyelid movements in mice.

The brain is constantly monitoring its own performance, using error signals to trigger mechanisms of plasticity that help improve future behavior. Indeed, adaptive changes in behavior have been observed after a single error trial in many learning tasks, including cerebellum-dependent eyeblink conditioning. Here, we demonstrate that the plasticity underlying single-trial learning during eyeblink conditioning in mice is bidirectionally regulated by positive and negative prediction errors, has an ephemeral effect on behavior (decays in <1 min), and can be triggered in the absence of errors in performance. We suggest that these three properties of single-trial learning may be particularly useful for driving mechanisms of motor adaptation that can achieve optimal performance in the face of environmental disturbances with a fast timescale.

Conditioning the neuroimmune response to ethanol using taste and environmental cues in adolescent and adult rats.

A combined odor and taste cue was paired with a binge-like ethanol exposure (4 g/kg intraperitoneal) using a single-trial learning paradigm. Re-exposure to the CS alone was sufficient to evoke a conditioned Interleukin (IL)-6 elevation in the amygdala in adolescents, an effect that was not observed in young adults. This demonstrates a particular sensitivity of adolescents to alcohol-associated cues and neuroimmune learning, whereas prior work indicated that adults require multiple pairings of ethanol to the CS in order to achieve a conditioned amygdala IL-6 response. While the role of immune conditioning has been studied in other drugs of abuse, these findings highlight a previously unknown aspect of alcohol-related learning. Given the emergent importance of the neuroimmune system in alcohol abuse, these findings may be important for understanding cue-induced reinstatement of alcohol intake among problem drinkers.

Terrestrial cue learning and retention during the outbound and inbound foraging trip in the desert ant, Cataglyphis velox.

Foraging ants are able to acquire and retain long-term memories of panorama cues around the nest and along known routes. Here we explore foragers' ability to learn and retain skyline cues experienced on only the outbound or inbound portion of the foraging trip. Foragers exposed to the skyline on the outbound portion showed single trial learning of these cues. Furthermore, the navigational performance of these "Outbound-Only" foragers was on par with foragers that experienced the full route. In contrast, foragers experiencing the skyline only on the inbound portion, "Inbound-Only" foragers, took 5 trips to successfully learn these cues. These performance differences persisted for long-term memory retention. Outbound-Only foragers successfully oriented after a 3-day delay and showed similar performance to the full route control, whereas Inbound-Only foragers were no longer able to orient successfully to these cues after 3days. Additionally, long-term memory formation of skyline cues appears to require multiple presentations, as foragers with only one outbound experience of the skyline could not successfully orient after the delay. Our results suggest that terrestrial cue learning and retention is more robust when cues are experienced on the outbound segment of the foraging trip.

Dendritic processing of spontaneous neuronal sequences for single-trial learning

Spontaneous firing sequences are ubiquitous in cortical networks, but their roles in cellular and network-level computations remain unexplored. In the hippocampus, such sequences, conventionally called preplay, have been hypothesized to participate in learning and memory. Here, we present a computational model for encoding input sequence patterns into internal network states based on the propagation of preplay sequences in recurrent neuronal networks. The model instantiates two synaptic pathways in cortical neurons, one for proximal dendrite-somatic interactions to generate intrinsic preplay sequences and the other for distal dendritic processing of extrinsic signals. The core dendritic computation is the maximization of matching between patterned activities in the two compartments through nonlinear spike generation. The model performs robust single-trial learning with long-term stability and independence that are modulated by the plasticity of dendrite-targeted inhibition. Our results demonstrate that dendritic computation enables somatic spontaneous firing sequences to act as templates for rapid and stable memory formation.

A CREB2-targeting microRNA is required for long-term memory after single-trial learning

Although single-trial induced long-term memories (LTM) have been of major interest in neuroscience, how LTM can form after a single episode of learning remains largely unknown. We hypothesized that the removal of molecular inhibitory constraints by microRNAs (miRNAs) plays an important role in this process. To test this hypothesis, first we constructed small non-coding RNA (sncRNA) cDNA libraries from the CNS of Lymnaea stagnalis subjected to a single conditioning trial. Then, by next generation sequencing of these libraries, we identified a specific pool of miRNAs regulated by training. Of these miRNAs, we focussed on Lym-miR-137 whose seed region shows perfect complementarity to a target sequence in the 3’ UTR of the mRNA for CREB2, a well-known memory repressor. We found that Lym-miR-137 was transiently up-regulated 1 h after single-trial conditioning, preceding a down-regulation of Lym-CREB2 mRNA. Furthermore, we discovered that Lym-miR-137 is co-expressed with Lym-CREB2 mRNA in an identified neuron with an established role in LTM. Finally, using an in vivo loss-of-function approach we demonstrated that Lym-miR-137 is required for single-trial induced LTM.

Single-trial reward learning biases attentional processing of novel food cues

Single-trial reward learning biases attentional processing of novel food cues

Locus coeruleus input to hippocampal CA3 drives single-trial learning of a novel context

The memory for a new episode is formed immediately upon experience and can last up to a lifetime. It has been shown that the hippocampal network plays a fundamental role in the rapid acquisition of a memory of a one-time experience, in which the novelty component of the experience promotes the prompt formation of the memory. However, it remains unclear which neural circuits convey the novelty signal to the hippocampus for the single-trial learning. Here, we show that during encoding neuromodulatory input from locus coeruleus (LC) to CA3, but not CA1 or to the dentate gyrus, is necessary to facilitate novel contextual learning. Silencing LC activity during exposure to a novel context reduced subsequent reactivation of the engram cell ensembles in CA3 neurons and in downstream CA1 upon reexposure to the same context. Calcium imaging of the cells reactivated in both novel and familiar contexts revealed that suppression of LC inputs at the time of encoding resulted in more variable place fields in CA3 neurons. These results suggest that neuromodulatory input from LC to CA3 is crucial for the formation of a persistent memory in the hippocampus.

Dissociation of binding and learning processes.

A single encounter of a stimulus together with a response can result in a short-lived association between the stimulus and the response [sometimes called an event file, see Hommel, Müsseler, Aschersleben, & Prinz, (2001) Behavioral and Brain Sciences, 24, 910-926]. The repetition of stimulus-response pairings typically results in longer lasting learning effects indicating stimulus-response associations (e.g., Logan & Etherton, (1994) Journal of Experimental Psychology: Learning, Memory, and Cognition, 20, 1022-1050]. An important question is whether or not what has been described as stimulus-response binding in action control research is actually identical with an early stage of incidental learning (e.g., binding might be seen as single-trial learning). Here, we present evidence that short-lived binding effects can be distinguished from learning of longer lasting stimulus-response associations. In two experiments, participants always responded to centrally presented target letters that were flanked by response irrelevant distractor letters. Experiment 1 varied whether distractors flanked targets on the horizontal or vertical axis. Binding effects were larger for a horizontal than for a vertical distractor-target configuration, while stimulus configuration did not influence incidental learning of longer lasting stimulus-response associations. In Experiment 2, the duration of the interval between response n - 1 and presentation of display n (500 ms vs. 2000 ms) had opposing influences on binding and learning effects. Both experiments indicate that modulating factors influence stimulus-response binding and incidental learning effects in different ways. We conclude that distinct underlying processes should be assumed for binding and incidental learning effects.

Quantifying learning‐dependent changes in the brain: Single‐trial multivoxel pattern analysis requires slow event‐related fMRI

Single-trial analysis is particularly useful for assessing cognitive processes that are intrinsically dynamic, such as learning. Studying these processes with fMRI is problematic, as the low signal-to-noise ratio of fMRI requires the averaging over multiple trials, obscuring trial-by-trial changes in neural activation. The superior sensitivity of multivoxel pattern analysis over univariate analyses has opened up new possibilities for single-trial analysis, but this may require different fMRI designs. Here, we measured fMRI and pupil dilation responses during discriminant aversive conditioning, to assess associative learning in a trial-by-trial manner. The impact of design choices was examined by varying trial spacing and trial order in a series of five experiments (total n = 66), while keeping stimulus duration constant (4.5 s). Our outcome measure was the change in similarity between neural response patterns related to two consecutive presentations of the same stimulus (within-stimulus) and between patterns related to pairs of different stimuli (between-stimulus) that shared a specific outcome (electric stimulation vs. no consequence). This trial-by-trial similarity analysis revealed clear single-trial learning curves in conditions with intermediate (8.1-12.6 s) and long (16.5-18.4 s) intervals, with effects being strongest in designs with long intervals and counterbalanced stimulus presentation. No learning curves were observed in designs with shorter intervals (1.6-6.1 s), indicating that rapid event-related designs-at present, the most common designs in fMRI research-are not suited for single-trial pattern analysis. These findings emphasize the importance of deciding on the type of analysis prior to data collection.