Aversive Learning Research Articles

Learned Nocebo Effects on Cutaneous Sensations of Pain and Itch: A Systematic Review and Meta-analysis of Experimental Behavioral Studies on Healthy Humans.

In past decades, the field of nocebo research has focused on studying how sensory perception can be shaped by learning. Nocebo effects refer to aggravated sensory experiences or increased sensitivity to sensations such as pain and itch resulting from treatment-related negative experiences. Behavioral conditioning and verbal suggestions of a negative treatment outcome may aggravate pain and itch perception. Gaining a comprehensive view of the magnitude of nocebo effects and contributing factors will help steer nocebo research toward fruitful directions for understanding complex sensory phenomena. We conducted a systematic review and meta-analysis of a total of 37 distinct experimental nocebo studies on healthy participants (all published in English between 2008 and 2021), with four separate meta-analyses for nocebo effects on pain or itch. We conducted subgroup analyses and meta-regression on factors such as type and intensity of sensory stimuli, and length of conditioning paradigms. This meta-analysis showed that, on average, effect sizes of nocebo effects were moderate to large (Hedges g between 0.26 and 0.71 for the four primary outcomes). The combination of conditioning and verbal suggestions yielded stronger nocebo responses on pain in particular. Subgroup analyses, including factors such as the type of sensory stimulation, did not explain the moderate heterogeneity in nocebo magnitudes between different studies. Risk of bias was generally low and was not related to nocebo magnitudes either. We discuss these results in relation to the role of conditioning and aversive learning, and we recommend more consistency in designing and reporting nocebo experiments.

Insights into the Involvement and Therapeutic Target Potential of the Dopamine System in the PosttraumaticStressDisorder.

Posttraumatic stress disorder (PTSD) is a neuropsychiatric disease closely related to life-threatening events and psychological stress. Re-experiencing, hyperarousal, avoidance, and numbness are the hallmark symptoms of PTSD, but their underlying neurological processes have not been clearly elucidated. Therefore, the identification and development of drugs for PTSD that targets brain neuronal activities have stalled. Considering that the persistent fear memory induced by traumatic stimulation causes high alertness, high arousal, and cognitive impairment of PTSD symptoms. While the midbrain dopamine system can affect physiological processes such as aversive fear memory learning, consolidation, persistence, and extinction, by altering the functions of the dopaminergic neurons, our viewpoint is that the dopamine system plays a considerable role in the PTSD occurrence and acts as a potential therapeutic target of the disorder. This paper reviews recent findings on the structural and functional connections between ventral tegmental area neurons and the core synaptic circuits involved in PTSD, gene polymorphisms related to the dopamine system that confer susceptibility to clinical PTSD. Moreover, the progress of research on medications that target the dopamine system as PTSD therapies is also discussed. Our goal is to offer some hints for early detection and assist in identifying novel, efficient approaches for treating PTSD.

Taste aversion learning in the snail Cornu aspersum.

The present study was conducted to provide evidence of conditioned taste aversion learning (CTA) in the snail Cornu aspersum, using quinidine as the aversive stimulus in a procedure of Pavlovian Conditioning of Tentacle Lowering. Subjects were split into two groups: paired and unpaired. During the devaluation phase, subjects from the "paired group" received the US followed by the quinidine exposure, while subjects from the "unpaired group" received the quinidine and, 30min later, the US. Subjects which had received the US paired with the quinidine showed a decrease of the conditioned response (CR), in contrast to subjects which had received the quinidine and the US unpaired. These results provide a useful CTA procedure in terrestrial snails. The implication of the results for learning and the physiological correlates is discussed.

Role of nitric oxide on defensive behavior and long-term aversive learning induced by chemical stimulation of the dorsolateral periaqueductal gray matter

The midbrain periaqueductal gray matter, especially the dorsolateral portion (dlPAG), coordinates immediate defensive responses (DR) to threats, but also ascends forebrain information for aversive learning. The synaptic dynamics in the dlPAG regulate the intensity and type of behavioral expression, as well as long-term processes such as memory acquisition, consolidation, and retrieval. Among several neurotransmitters and neural modulators, nitric oxide seems to play an important regulatory role in the immediate expression of DR, but it remains unclear if this gaseous on-demand neuromodulator contributes to aversive learning. Therefore, the role of nitric oxide in the dlPAG was investigated, during conditioning in an olfactory aversive task. The behavioral analysis consisted of freezing and crouch-sniffing in the conditioning day after glutamatergic NMDA agonist injection into the dlPAG. Two days later, rats were re-exposed to the odor cue and avoidance was measured. 7NI, a selective neuronal nitric oxide synthase inhibitor (40 and 100 nmol), injected before NMDA (50 pmol) impaired immediate DR and consequent aversive learning. The scavenging of extrasynaptic nitric oxide by C-PTIO (1 and 2 nmol) induced similar results. Moreover, spermine NONOate, a nitric oxide donor (5, 10, 20, 40, and 80 nmol), produced DR by itself, but only the low dose also promoted learning. The following experiments utilized a fluorescent probe, DAF-FM diacetate (5 µM), directly into the dlPAG, to quantify nitric oxide in the three previous experimental situations. Nitric oxide levels were increased after NMDA stimulation, decreased after 7NI, and increased after spermine NONOate, in line with alterations in defensive expression. Altogether, the results indicate that nitric oxide plays a modulatory and decisive role in the dlPAG regarding immediate DR and aversive learning.

Abstract TMP117: Housing Light Cycle Impacts Metabolic Profile, Stroke Survival, And Cognitive Outcomes In Diabetic Rats

Diabetes worsens stroke outcomes and cognitive function, but the underlying reasons are not understood. Long-term experimental studies had been limited by greater mortality in diabetic cohorts. Recent studies suggested circadian rhythms may modulate brain ischemia and hence mortality/recovery. The goal of this study was to determine the impact of stroke timing and housing light cycle conditions on survival and cognitive outcomes in control and diabetic rats. Methods: Control (C) and diabetic (D) male rats (n=7/group) were randomly grouped into normal light cycle (NLC 6 am/6 pm) or reverse light cycle (RLC 12 am/12 pm) starting at 4 w of age. At 12 w of age, rats were subjected to 60 min middle cerebral artery occlusion (MCAO, night stroke in NLC and morning stroke in RLC). A battery of behavioral tests was performed up to W8 post-stroke to assess motor, cognitive, and psychosocial status. Results: (Table). RLC conditions improved stroke surgery mortality and long-term survival in diabetic animals. Pre- and post-stroke body weight gain was affected only in the NLC/D group. High mortality in the NLC/D prevented 2x2 comparisons at W8 but suggested the worst performance the in NLC/D cohort. Comparisons of C and D rats in RLC showed a decline in recognition memory in both groups over time with trends for worse performance in diabetic animals. There was no difference in aversive learning or anxiety status. Conclusions: These results suggest that the light cycle and timing of MCAO affect the circadian rhythm, overall health state, and cognitive outcomes, especially in diabetes. RLC experiments may refine and improve the long-term studies in comorbid disease models.

Limitations of enhanced aversion learning in serial interference conditioning

Serial interference conditioning (X → IS → US) involves presenting a target stimulus (X) followed by an interfering stimulus (IS), and then an unconditioned stimulus (US); it typically results in a weakened response to X. In 2016, Kwok et al. reported enhanced learning to Taste X in serial interference conditioning if the IS had previously been paired with another taste (AS: an associatively-activated stimulus). Their results suggest that mediated conditioning may be the crucial factor for producing enhancement to X in the serial interference design. Here, we report 4 serial interference studies with rat subjects in which we introduced different preconditioning techniques with IS and AS to strengthen this mediated enhancement of X. Before serial interference conditioning, we presented compound aversion conditioning (IS + AS – US) in Experiment 1, and IS preconditioning (IS – US; IS + AS – US) in Experiment 2. In Experiments 3 and 4, we introduced 6 additional pairings of IS – AS before serial interference conditioning, or we combined the extended training along with aversive preconditioning of IS, AS, or the IS + AS compound. No enhancement of the aversion to X was detected across these 4 studies, and in Experiments 1, 2, and 4, significant interference effects were recorded. Moreover, limited evidence of mediated conditioning was observed. Collectively, these results confirm that synergistic conditioning is rare in serial conditioning designs, and they suggest a new constraint on mediated conditioning in that aversive preconditioning may limit the influence of associatively-activated representations.

Neuronal activity of the medial prefrontal cortex, nucleus accumbens, and basolateral amygdala in conditioned taste aversion and conditioned place preference induced by different doses of morphine administrations in rats.

To re-examine the paradoxical effect hypothesis of abused drugs, the present study concerned whether different doses of morphine disparately affect neuronal activity and associations among the subareas of the medial prefrontal cortex (mPFC: cingulate cortex 1-Cg1, prelimbic cortex-PrL, infralimbic cortex-IL), the subregions of the nucleus accumbens (NAc; both core and shell), and the basolateral amygdala (BLA) following conditioned taste aversion (CTA) and conditioned place preference (CPP). All rats were given a 0.1% saccharin solution for 15-min, and they were intraperitoneally injected with saline or 20, 30, or 40mg/kg morphine to form the aversive CTA learning. Later, half of the rats were tested for CPP (including the CTA and then CPP tests) for 30-min. Finally, the immunohistochemical staining with c-Fos was conducted after the behavioral test. After the CTA test, c-Fos (%) in the Cg1 and PrL (but not the IL) was more in 20-40mg/kg of the morphine groups; c-Fos (%) in the NAc core, NAc shell, and BLA was more in the 30-40mg/kg morphine group. After the CPP test, the Cg1, PrL, IL, and BLA showed more c-Fos (%) in 20mg/kg morphine; the NAc core showed fewer in c-Fos (%) in the 30-40mg/kg morphine groups. The mPFC subregions (e.g., Cg1, PrL, and IL), NAc subareas (e.g., NAc core and NAc shell), and BLA were involved in the different doses of morphine injections. The correlation analysis showed that a positive correlation was observed between PrL and IL with NAc core with low doses of morphine and with NAc shell with increasing doses of morphine after the CTA test. After the CPP, an association between PrL and NAc core and NAc shell at low doses and between IL and BLA and NAc shell with increasing doses of morphine. Therefore, different neural substrates and the neural connectivity are observed following different doses of morphine and after the CTA and CPP tests. The present data extend the paradoxical effect hypothesis of abused drugs.

Neuromodulation and differential learning across mosquito species.

Mosquitoes can change their feeding behaviours based on past experiences, such as shifting from biting animals to biting humans or avoiding defensive hosts (Wolff & Riffell 2018 J. Exp. Biol. 221, jeb157131. (doi:10.1242/jeb.157131)). Dopamine is a critical neuromodulator for insects, allowing flexibility in their feeding preferences, but its role in the primary olfactory centre, the antennal lobe (AL), remains unclear (Vinauger et al. 2018 Curr. Biol. 28, 333-344.e8. (doi:10.1016/j.cub.2017.12.015)). It is also unknown whether mosquitoes can learn some odours and not others, or whether different species learn the same odour cues. We assayed aversive olfactory learning in four mosquito species with different host preferences, and found that they differentially learn odours salient to their preferred host. Mosquitoes that prefer humans learned odours found in mammalian skin, but not a flower odour, and a nectar-feeding species only learned a floral odour. Comparing the brains of these four species revealed significantly different innervation patterns in the AL by dopaminergic neurons. Calcium imaging in the Aedes aegypti AL and three-dimensional image analyses of dopaminergic innervation show that glomeruli tuned to learnable odours have significantly higher dopaminergic innervation. Changes in dopamine expression in the insect AL may be an evolutionary mechanism to adapt olfactory learning circuitry without changing brain structure and confer to mosquitoes an ability to adapt to new hosts.

Enhanced Reactivation of Remapping Place Cells during Aversive Learning.

Study of the hippocampal place cell system has greatly enhanced our understanding of memory encoding for distinct places, but how episodic memories for distinct experiences occurring within familiar environments are encoded is less clear. We developed a spatial decision-making task in which male rats learned to navigate a multiarm maze to a goal location for food reward while avoiding maze arms in which aversive stimuli were delivered. Task learning induced partial remapping in CA1 place cells, allowing us to identify both remapping and stable cell populations. Remapping cells were recruited into sharp-wave ripples and associated replay events to a greater extent than stable cells, despite having similar firing rates during navigation of the maze. Our results suggest that recruitment into replay events may be a mechanism to incorporate new contextual information into a previously formed and stabilized spatial representation.SIGNIFICANCE STATEMENT Hippocampal place cells provide a map of space that animals use to navigate. This map can change to reflect changes in the physical properties of the environment in which the animal finds itself, and also in response to nonphysical contextual changes, such as changes in the valence of specific locations within that environment. We show here that cells which change their spatial tuning after a change in context are preferentially recruited into sharp-wave ripple-associated replay events compared with stable nonremapping cells. Thus, our data lend strong support to the hypothesis that replay is a mechanism for the storage of new spatial maps.

The association of spouse interactions and emotional learning in interference related to chronic back pain

Social interactions affect individual behaviours, preferences, and attitudes. This is also critical in the context of experiencing pain and expressing pain behaviours, and may relate to learned emotional responses. In this respect, individual variability in the medial prefrontal cortex (mPFC), which is involved in adjusting an organism’s behaviour to its environment by evaluating and interpreting information within the context of past experiences, is important. It is critical for selecting suitable behavioural responses within a social environment and may reinforce maladaptation in chronic pain. In our study, we used brain imaging during appetitive and aversive pavlovian conditioning in persons with chronic back pain (CBP), subacute back pain (SABP), and healthy controls (HC), together with information on spouse responses to pain behaviours. We also examined the relationship of these responses with pain-related interference in the patients. Our findings yielded a significant negative association between mPFC responses to appetitive and aversive learning in CBP. We also observed a significant negative association for mPFC responses during aversive learning and distracting spouse responses, and a significant positive association between mPFC responses during appetitive learning and solicitous spouse responses in CBP. Both significantly predicted pain-related interference in the CBP group (explained variance up to 53%). Significant associations were not found for SABP or HC. Our findings support an association between appetitive and aversive pavlovian learning, related brain circuits and spouse responses to pain in CBP, where appetitive and aversive learning processes seem to be differentially involved. This can inform prevention and early intervention in a mechanistic approach.

Opponent Learning with Different Representations in the Cortico-Basal Ganglia Circuits.

The direct and indirect pathways of the basal ganglia (BG) have been suggested to learn mainly from positive and negative feedbacks, respectively. Since these pathways unevenly receive inputs from different cortical neuron types and/or regions, they may preferentially use different state/action representations. We explored whether such a combined use of different representations, coupled with different learning rates from positive and negative reward prediction errors (RPEs), has computational benefits. We modeled animal as an agent equipped with two learning systems, each of which adopted individual representation (IR) or successor representation (SR) of states. With varying the combination of IR or SR and also the learning rates from positive and negative RPEs in each system, we examined how the agent performed in a dynamic reward navigation task. We found that combination of SR-based system learning mainly from positive RPEs and IR-based system learning mainly from negative RPEs could achieve a good performance in the task, as compared with other combinations. In such a combination of appetitive SR-based and aversive IR-based systems, both systems show activities of comparable magnitudes with opposite signs, consistent with the suggested profiles of the two BG pathways. Moreover, the architecture of such a combination provides a novel coherent explanation for the functional significance and underlying mechanism of diverse findings about the cortico-BG circuits. These results suggest that particularly combining different representations with appetitive and aversive learning could be an effective learning strategy in certain dynamic environments, and it might actually be implemented in the cortico-BG circuits.

Aberrant aversive learning signals in the habenula in remitted unmedicated patients with recurrent depression

Aberrant aversive learning signals in the habenula in remitted unmedicated patients with recurrent depression

Parabrachial-to-parasubthalamic nucleus pathway mediates fear-induced suppression of feeding in male mice

Feeding behavior is adaptively regulated by external and internal environment, such that feeding is suppressed when animals experience pain, sickness, or fear. While the lateral parabrachial nucleus (lPB) plays key roles in nociception and stress, neuronal pathways involved in feeding suppression induced by fear are not fully explored. Here, we investigate the parasubthalamic nucleus (PSTN), located in the lateral hypothalamus and critically involved in feeding behaviors, as a target of lPB projection neurons. Optogenetic activation of lPB-PSTN terminals in male mice promote avoidance behaviors, aversive learning, and suppressed feeding. Inactivation of the PSTN and lPB-PSTN pathway reduces fear-induced feeding suppression. Activation of PSTN neurons expressing pituitary adenylate cyclase-activating polypeptide (PACAP), a neuropeptide enriched in the PSTN, is sufficient for inducing avoidance behaviors and feeding suppression. Blockade of PACAP receptors impaires aversive learning induced by lPB-PSTN photomanipulation. These findings indicate that lPB-PSTN pathway plays a pivotal role in fear-induced feeding suppression.

Astrocyte L-Lactate Signaling in the ACC Regulates Visceral Pain Aversive Memory in Rats.

Pain involves both sensory and affective elements. An aspect of the affective dimension of pain is its sustained unpleasantness, characterized by emotional feelings. Pain results from interactions between memory, attentional, and affective brain circuitry, and it has attracted enormous interest in pain research. However, the brain targets and signaling mechanism involved in pain remain elusive. Using a conditioned place avoidance (CPA) paradigm, we show that colorectal distention (CRD magnitude ≤ 35 mmHg, a subthreshold for pain) paired with a distinct environment can cause significant aversion to a location associated with pain-related insults in rats. We show a substantial increase in the L-lactate concentration in the anterior cingulate cortex (ACC) following CPA training. Local exogenous infusion of lactate into the ACC enhances aversive memory and induces the expression of the memory-related plasticity genes pCREB, CREB, and Erk1/2. The pharmacological experiments revealed that the glycogen phosphorylation inhibitor 1,4-dideoxy-1,4-imino-D-arabinitol (DAB) impairs memory consolidation. Furthermore, short-term Gi pathway activation of ACC astrocytes before CPA training significantly decreases the lactate level and suppresses pain-related aversive learning. The effects were reversed by the local infusion of lactate into the ACC. Our study demonstrates that lactate is released from astrocytes in vivo following visceral pain-related aversive learning and memory retrieval and induces the expression of the plasticity-related immediate early genes CREB, pCREB, and Erk1/2 in the ACC. Chronic visceral pain is an important factor in the pathophysiology of irritable bowel syndrome (IBS). The current study provides evidence that astrocytic activity in the ACC is required for visceral pain-related aversive learning and memory.

Aversive Bimodal Associations Differently Impact Visual and Olfactory Memory Performance in Drosophila.

Animals form sensory associations and store them as memories to guide behavioral decisions. Although unimodal learning has been studied extensively in insects, it is important to explore sensory cues in combination because most behaviors require multimodal inputs. In our study, we optimized the T-maze to employ both visual and olfactory cues in a classical aversive learning paradigm in Drosophila melanogaster. In contrast to unimodal training, bimodal training evoked a significant short-term visual memory after a single training trial. Interestingly, the same protocol did not enhance short-term olfactory memory and even had a negative impact. However, compromised long-lasting olfactory memory significantly improved after bimodal training. Our study demonstrates that the effect of bimodal integration on learning is not always beneficial and is conditional upon the formed memory strengths. We postulate that flies utilize information on a need-to basis: bimodal training augments weakly formed memories while stronger associations are impacted differently.

Impaired Aversive Memory Formation in GPR37L1KO Mice.

GPR37L1 is an orphan G-protein-coupled receptor, which is implicated in neurological disorders, but its normal physiological role is poorly understood. Its close homologue, GPR37, is implicated in Parkinson's disease and affective disorders. In this study, we set out to characterize adult and middle-aged global GPR37L1 knock-out (KO) mice regarding emotional behaviors. Our results showed that GPR37L1KO animals, except adult GPR37L1KO males, exhibited impaired retention of aversive memory formation as assessed by the shorter retention latency in a passive avoidance task. Interestingly, the viral-mediated deletion of GPR37L1 in conditional knockout mice in the hippocampus of middle-aged mice also showed impaired retention in passive avoidance tasks, similar to what was observed in global GPR37L1KO mice, suggesting that hippocampal GPR37L1 is involved in aversive learning processes. We also observed that middle-aged GPR37L1KO male and female mice exhibited a higher body weight than their wild-type counterparts. Adult and middle-aged GPR37L1KO female mice exhibited a reduced level of serum corticosterone and middle-aged GPR37L1KO females showed a reduced level of epinephrine in the dorsal hippocampus in the aftermath of passive avoidance task, with no such effects observed in GPR37L1KO male mice, suggesting that lack of GPR37L1 influences behavior and biochemical readouts in age- and sex-specific manners.

Dopaminergic circuits underlying associative aversive learning.

Associative aversive learning enables animals to predict and avoid threats and thus is critical for survival and adaptive behavior. Anxiety disorders are characterized with deficits in normal aversive learning mechanisms and hence understanding the neural circuits underlying aversive learning and memory has high clinical relevance. Recent studies have revealed the dopamine system as one of the key modulators of aversive learning. In this review, we highlight recent advances that provide insights into how distinct dopaminergic circuits contribute to aversive learning and memory.

Fear conditioning in invertebrates.

Learning to identify and predict threats is a basic skill that allows animals to avoid harm. Studies in invertebrates like Aplysia californica, Drosophila melanogaster, and Caenorhabditis elegans have revealed that the basic mechanisms of learning and memory are conserved. We will summarize these studies and highlight the common pathways and mechanisms in invertebrate fear-associated behavioral changes. Fear conditioning studies utilizing electric shock in Aplysia and Drosophila have demonstrated that serotonin or dopamine are typically involved in relaying aversive stimuli, leading to changes in intracellular calcium levels and increased presynaptic neurotransmitter release and short-term changes in behavior. Long-term changes in behavior typically require multiple, spaced trials, and involve changes in gene expression. C. elegans studies have demonstrated these basic aversive learning principles as well; however, fear conditioning has yet to be explicitly demonstrated in this model due to stimulus choice. Because predator-prey relationships can be used to study learned fear in a naturalistic context, this review also summarizes what is known about predator-induced behaviors in these three organisms, and their potential applications for future investigations into fear conditioning.

Food-related aversion in a female sample of people with anorexia nervosa: Cognitive-behavioural correlates, somatic and subjective anxiety, and early experiences

ObjectiveFood-related anxiety and avoidance are key features of anorexia nervosa, and among the most arduous maintaining processes to address in treatment. This study gathered information on the behavioural and cognitive correlates of food-related anxiety, including their associations with early experiences of aversive learning related to food, and more general anxiety. MethodsOne-hundred and forty-four patients with anorexia nervosa were recruited from clinical services in Italy. They completed online questionnaires to assess food-related anxiety, eating disorder psychopathology, eating disorder safety behaviours and threat cognitions, early experience of aversive learning related to food, and somatic anxiety. ResultsExperiences of food-related aversive learning were recalled by the majority of the sample (87.86%), with negative psychological consequences following eating being the most often reported (75%). Safety behaviours and threat cognitions related to the consequences of eating were also reported (14.29%–87.86%, and 36.43–90% respectively, depending on the behaviour/cognition). Eating disorder psychopathology was predicted by both somatic anxiety and negative psychological consequences following eating, whereas self-reported food anxiety was only predicted by somatic anxiety. ConclusionFindings validate an anxiety-based model of anorexia nervosa which establishes the role of safety behaviours, threat cognitions, early aversive learning experiences, and anxiety in the psychopathology of the illness. Exposure-based interventions have the potential to target these factors, and inhibit food-related fear.

Insulin/IGF signaling regulates presynaptic glutamate release in aversive olfactory learning.

Insulin/insulin-like growth factor (IGF) receptor signaling (IIS) supports context-dependent learning in vertebrates and invertebrates. Here, we identify cell-specific mechanisms of IIS that integrate sensory information with food context to drive synaptic plasticity and learning. In the nematode Caenorhabditis elegans, pairing food deprivation with an odor such as butanone suppresses attraction to that odor. We find that aversive olfactory learning requires the insulin receptor substrate (IRS) protein IST-1 and atypical signaling through the insulin/IGF-1 receptor DAF-2. Cell-specific knockout and rescue demonstrate that DAF-2 acts in the AWCON sensory neuron, which detects butanone, and that learning preferentially depends upon the axonally localized DAF-2c isoform. Acute food deprivation increases DAF-2 levels in AWCON post-transcriptionally through an insulin- and insulin receptor substrate-1 (ist-1)-dependent process. Aversive learning alters the synaptic output of AWCON by suppressing odor-regulated glutamate release in wild-type animals, but not in ist-1 mutants, suggesting that axonal insulin signaling regulates synaptic transmission to support aversive memory.