Form Of Inhibitory Learning Research Articles

Pavlovian safety learning: An integrative theoretical review.

Safety learning involves associating stimuli with the absence of threats, enabling the inhibition of fear and anxiety. Despite growing interest in psychology, psychiatry, and neuroscience, safety learning lacks a formal consensus definition, leading to inconsistent methodologies and varied results. Conceptualized as a form of inhibitory learning (conditioned inhibition), safety learning can be understood through formal learning theories, such as the Rescorla-Wagner and Pearce-Hall models. This review aims to establish a principled conceptualization of 'Pavlovian safety learning', identifying cognitive mechanisms that generate safety and the boundary conditions that constrain it. Based on these observations, we define Pavlovian safety learning as an active associative process, where surprising threat-omission (safety prediction error) acts as a salient reinforcing event. Instead of producing merely neutral or nonaversive states, safety learning endows stimuli with active positive associations to 'safety'. The resulting stimulus-safety memories counteract the influence of fear memories, promoting fear regulation, positive affect, and relief. We critically analyze traditional criteria of conditioned inhibition for their relevance to safety and propose areas for future innovation. A principled concept of Pavlovian safety learning may reduce methodological inconsistencies, stimulate translational research, and facilitate a comprehensive understanding of an indispensable psychological construct.

The cerebellum regulates fear extinction through thalamo-prefrontal cortex interactions in male mice

Fear extinction is a form of inhibitory learning that suppresses the expression of aversive memories and plays a key role in the recovery of anxiety and trauma-related disorders. Here, using male mice, we identify a cerebello-thalamo-cortical pathway regulating fear extinction. The cerebellar fastigial nucleus (FN) projects to the lateral subregion of the mediodorsal thalamic nucleus (MD), which is reciprocally connected with the dorsomedial prefrontal cortex (dmPFC). The inhibition of FN inputs to MD in male mice impairs fear extinction in animals with high fear responses and increases the bursting of MD neurons, a firing pattern known to prevent extinction learning. Indeed, this MD bursting is followed by high levels of the dmPFC 4 Hz oscillations causally associated with fear responses during fear extinction, and the inhibition of FN-MD neurons increases the coherence of MD bursts and oscillations with dmPFC 4 Hz oscillations. Overall, these findings reveal a regulation of fear-related thalamo-cortical dynamics by the cerebellum and its contribution to fear extinction.

Corticostriatal Suppression of Appetitive Pavlovian Conditioned Responding.

The capacity to suppress learned responses is essential for animals to adapt in dynamic environments. Extinction is a process by which animals learn to suppress conditioned responding when an expected outcome is omitted. The infralimbic (IL) cortex to nucleus accumbens shell (NAcS) neural circuit is implicated in suppressing conditioned responding after extinction, especially in the context of operant cocaine-seeking behavior. However, the role of the IL-to-NAcS neural circuit in the extinction of responding to appetitive Pavlovian cues is unknown, and the psychological mechanisms involved in response suppression following extinction are unclear. We trained male Long Evans rats to associate a 10 s auditory conditioned stimulus (CS; 14 trials per session) with a sucrose unconditioned stimulus (US; 0.2 ml per CS) in a specific context, and then following extinction in a different context, precipitated a renewal of CS responding by presenting the CS alone in the original Pavlovian conditioning context. Unilateral, optogenetic stimulation of the IL-to-NAcS circuit selectively during CS trials suppressed renewal. In a separate experiment, IL-to-NAcS stimulation suppressed CS responding regardless of prior extinction and impaired extinction retrieval. Finally, IL-to-NAcS stimulation during the CS did not suppress the acquisition of Pavlovian conditioning but was required for the subsequent expression of CS responding. These results are consistent with multiple studies showing that the IL-to-NAcS neural circuit is involved in the suppression of operant cocaine-seeking, extending these findings to appetitive Pavlovian cues. The suppression of appetitive Pavlovian responding following IL-to-NAcS circuit stimulation, however, does not appear to be an extinction-dependent process.SIGNIFICANCE STATEMENT Extinction is a form of inhibitory learning through which animals learn to suppress conditioned responding in the face of nonreinforcement. We investigated the role of the IL cortex inputs to the NAcS in the extinction of responding to appetitive Pavlovian cues and the psychological mechanisms involved in response suppression following extinction. Using in vivo optogenetics, we found that stimulating the IL-to-NAcS neural circuit suppressed context-induced renewal of conditioned responding after extinction. In a separate experiment, stimulating the IL-to-NAcS circuit suppressed conditioned responding in an extinction-independent manner. These findings can be used by future research aimed at understanding how corticostriatal circuits contribute to behavioral flexibility and mental disorders that involve the suppression of learned behaviors.

Nicotine administration enhances negative occasion setting in adolescent rats

Substantial research has established that exposure to nicotine during adolescence can lead to long-term changes in neural circuitry and behavior. However, relatively few studies have considered the effects of nicotine use on cognition during this critical stage of brain development. This is significant because the influence of nicotine on cognitive performance during adolescence may contribute to the development of regular nicotine use. For example, improvements in cognitive functioning may increase the perceived value of smoking and facilitate impulses to smoke. To address this, the present research tested the effects of nicotine on a form of inhibitory learning during adolescence. Specifically, adolescent rats were exposed to nicotine as they were trained in a negative occasion setting paradigm, in which successful performance depends on learning the conditions under which it is, or is not, appropriate to respond to a target stimulus. Here, we found that nicotine administration enhances negative occasion setting in adolescents. In addition, nicotine increased the amount of orienting behavior directed toward the inhibitory stimulus, suggesting that improvements in this form of behavioral inhibition may be attributed to nicotine-induced increases in attentional processing. These results may help elucidate the factors that contribute to the onset as well as continued use of products containing nicotine during adolescence and provide insight to increase the effectiveness of interventions targeted at reducing the prevalence of adolescent smoking.

Commentary: Olfactory aversive conditioning during sleep reduces cigarette-smoking behavior.

Commentary: Olfactory aversive conditioning during sleep reduces cigarette-smoking behavior.

Acute stress impairs the retrieval of extinction memory in humans

Extinction training is a form of inhibitory learning that allows an organism to associate a previously aversive cue with a new, safe outcome. Extinction does not erase a fear association, but instead creates a competing association that may or may not be retrieved when a cue is subsequently encountered. Characterizing the conditions under which extinction learning is expressed is important to enhancing the treatment of anxiety disorders that rely on extinction-based exposure therapy as a primary treatment technique. The ventromedial prefrontal cortex, which plays a critical role in the expression of extinction memory, has been shown to be functionally impaired after stress exposure. Further, recent work in rodents has demonstrated that exposure to stress leads to deficits in extinction retrieval, although this has yet to be tested in humans. To explore how stress might influence extinction retrieval in humans, participants underwent a differential aversive learning paradigm, in which one image was probabilistically paired with an aversive shock while the other image denoted safety. Extinction training directly followed, at which point reinforcement was omitted. A day later, participants returned to the lab and either completed an acute stress manipulation (i.e., cold pressor), or a control task, before undergoing an extinction retrieval test. Skin conductance responses and salivary cortisol concentrations were measured throughout each session as indices of fear arousal and neuroendocrine stress response, respectively. The efficacy of our stress induction was established by observing significant increases in cortisol for the stress condition only. We examined extinction retrieval by comparing conditioned responses during the last trial of extinction (day 1) with that of the first trial of re-extinction (day 2). Groups did not differ on initial fear acquisition or extinction, however, a day later participants in the stress group (n=27) demonstrated significantly lower extinction retrieval (i.e., greater fear recovery) than those in the control group (n=25). Our results suggest that acute stress impairs the retrieval of extinction learning and offers insight into why treatment strategies used in the clinic may be challenging to recruit in daily life where stress is pervasive.

Directional Theta Coherence in Prefrontal Cortical to Amygdalo-Hippocampal Pathways Signals Fear Extinction

Theta oscillations are considered crucial mechanisms in neuronal communication across brain areas, required for consolidation and retrieval of fear memories. One form of inhibitory learning allowing adaptive control of fear memory is extinction, a deficit of which leads to maladaptive fear expression potentially leading to anxiety disorders. Behavioral responses after extinction training are thought to reflect a balance of recall from extinction memory and initial fear memory traces. Therefore, we hypothesized that the initial fear memory circuits impact behavioral fear after extinction, and more specifically, that the dynamics of theta synchrony in these pathways signal the individual fear response. Simultaneous multi-channel local field and unit recordings were obtained from the infralimbic prefrontal cortex, the hippocampal CA1 and the lateral amygdala in mice. Data revealed that the pattern of theta coherence and directionality within and across regions correlated with individual behavioral responses. Upon conditioned freezing, units were phase-locked to synchronized theta oscillations in these pathways, characterizing states of fear memory retrieval. When the conditioned stimulus evoked no fear during extinction recall, theta interactions were directional with prefrontal cortical spike firing leading hippocampal and amygdalar theta oscillations. These results indicate that the directional dynamics of theta-entrained activity across these areas guide changes in appraisal of threatening stimuli during fear memory and extinction retrieval. Given that exposure therapy involves procedures and pathways similar to those during extinction of conditioned fear, one therapeutical extension might be useful that imposes artificial theta activity to prefrontal cortical-amygdalo-hippocampal pathways that mimics the directionality signaling successful extinction recall.

Neuronal circuits of fear extinction

Fear extinction is a form of inhibitory learning that allows for the adaptive control of conditioned fear responses. Although fear extinction is an active learning process that eventually leads to the formation of a consolidated extinction memory, it is a fragile behavioural state. Fear responses can recover spontaneously or subsequent to environmental influences, such as context changes or stress. Understanding the neuronal substrates of fear extinction is of tremendous clinical relevance, as extinction is the cornerstone of psychological therapy of several anxiety disorders and because the relapse of maladaptative fear and anxiety is a major clinical problem. Recent research has begun to shed light on the molecular and cellular processes underlying fear extinction. In particular, the acquisition, consolidation and expression of extinction memories are thought to be mediated by highly specific neuronal circuits embedded in a large-scale brain network including the amygdala, prefrontal cortex, hippocampus and brain stem. Moreover, recent findings indicate that the neuronal circuitry of extinction is developmentally regulated. Here, we review emerging concepts of the neuronal circuitry of fear extinction, and highlight novel findings suggesting that the fragile phenomenon of extinction can be converted into a permanent erasure of fear memories. Finally, we discuss how research on genetic animal models of impaired extinction can further our understanding of the molecular and genetic bases of human anxiety disorders.

Extinction circuits for fear and addiction overlap in prefrontal cortex

Extinction is a form of inhibitory learning that suppresses a previously conditioned response. Both fear and drug seeking are conditioned responses that can lead to maladaptive behavior when expressed inappropriately, manifesting as anxiety disorders and addiction, respectively. Recent evidence indicates that the medial prefrontal cortex (mPFC) is critical for the extinction of both fear and drug-seeking behaviors. Moreover, a dorsal-ventral distinction is apparent within the mPFC, such that the prelimbic (PL-mPFC) cortex drives the expression of fear and drug seeking, whereas the infralimbic (IL-mPFC) cortex suppresses these behaviors after extinction. For conditioned fear, the dorsal-ventral dichotomy is accomplished via divergent projections to different subregions of the amygdala, whereas for drug seeking, it is accomplished via divergent projections to the subregions of the nucleus accumbens. Given that the mPFC represents a common node in the extinction circuit for these behaviors, treatments that target this region may help alleviate symptoms of both anxiety and addictive disorders by enhancing extinction memory.

Mechanisms of fear extinction

Excessive fear and anxiety are hallmarks of a variety of disabling anxiety disorders that affect millions of people throughout the world. Hence, a greater understanding of the brain mechanisms involved in the inhibition of fear and anxiety is attracting increasing interest in the research community. In the laboratory, fear inhibition most often is studied through a procedure in which a previously fear conditioned organism is exposed to a fear-eliciting cue in the absence of any aversive event. This procedure results in a decline in conditioned fear responses that is attributed to a process called fear extinction. Extensive empirical work by behavioral psychologists has revealed basic behavioral characteristics of extinction, and theoretical accounts have emphasized extinction as a form of inhibitory learning as opposed to an erasure of acquired fear. Guided by this work, neuroscientists have begun to dissect the neural mechanisms involved, including the regions in which extinction-related plasticity occurs and the cellular and molecular processes that are engaged. The present paper will cover behavioral, theoretical and neurobiological work, and will conclude with a discussion of clinical implications.

The L-type calcium channel blocker nifedipine impairs extinction, but not reduced contingency effects, in mice

We recently reported that fear extinction, a form of inhibitory learning, is selectively blocked by systemic administration of L-type voltage-gated calcium channel (LVGCC) antagonists, including nifedipine, in mice. We here replicate this finding and examine three reduced contingency effects after vehicle or nifedipine (40 mg/kg) administration. In the first experiment, contingency reduction was achieved by adding USs to the training protocol (degraded contingency), a phenomenon thought to be independent of behavioral inhibition. In the second experiment, contingency reduction was achieved by varying the percentage of CS-US pairing, a phenomenon thought to be weakly dependent on behavioral inhibition. In the third and fourth experiments, contingency reduction was achieved by adding CSs to the training protocol (partial reinforcement), a phenomenon thought to be completely dependent on behavioral inhibition. We found that none of these reduced contingency effects was impaired by nifedipine. In a final experiment, we found that extinction conducted 1 or 3 h post-acquisition, but not immediately, was LVGCC-dependent. Taken together, the results suggest that reduced contingency effects and extinction depend on different molecular mechanisms and that LVGCC dependence of behavioral inhibition develops with time after associative CS-US learning.

Extinction-induced Neuroplasticity Attenuates Stress-induced Cocaine Seeking: A State-dependent Learning Hypothesis

Chronic drug use weakens excitatory neocortical input to the nucleus accumbens (NAc). We previously reported that extinction training, a form of inhibitory learning that progressively reduces cocaine-seeking behaviour when reward is withheld, reverses this deficit by up-regulating GluR1 and GluR2/3 subunits of alpha-amino-3-hydroxy-5-methyl-4-isoxazole propionic acid (AMPA) glutamate receptors in the NAc. The level of GluR1 up-regulation is positively associated with a reduction in cocaine seeking, suggesting that extinction-induced up-regulation in AMPA receptors in the NAc opposes motivational influences that maintain cocaine seeking. This hypothesis is supported by the finding that over-expression of GluR1 and GluR2 in the NAc facilitates extinction of cocaine self-administration. Furthermore, a single extinction training session conducted during GluR1 and GluR2 over-expression strongly and selectively attenuates the ability of an environmental stressor to trigger relapse to cocaine seeking long after GluR1 and GluR2 over-expression declines. These results could suggest that excitatory input to the NAc promotes extinction learning, but only when memory is recalled under stressful situations.Recent studies indicate that both environmental stress and the frustrative stress of withholding reward during extinction of drug self-administration induce similar neurochemical events in the NAc. These neurochemical events could impose a “state-dependency” on extinction learning such that subsequent exposure to stress acts as a cue to enhance retrieval of extinction memory. Our results suggest that extinction-induced up-regulation in NAc AMPA receptors acts reciprocally to facilitate state-dependent extinction learning, as stressful situations evoke extinction memories that exert powerful inhibitory control over drug-seeking behaviour. These results may have important therapeutic implications for behaviour-based approaches aimed at treating drug addiction.

Extinction-induced upregulation in AMPA receptors reduces cocaine-seeking behaviour.

Cocaine addiction is thought to involve persistent neurobiological changes that facilitate relapse to drug use despite efforts to abstain. But the propensity for relapse may be reduced by extinction training--a form of inhibitory learning that progressively reduces cocaine-seeking behaviour in the absence of cocaine reward. Here we show that extinction training during withdrawal from chronic cocaine self-administration induces experience-dependent increases in the GluR1 and GluR2/3 subunits of AMPA (alpha-amino-3-hydroxy-5-methyl-4-isoxazole propionate) glutamate receptors in the nucleus accumbens shell, a brain region that is critically involved in cocaine reward. Increases in the GluR1 subunit are positively associated with the level of extinction achieved during training, suggesting that GluR1 may promote extinction of cocaine seeking. Indeed, viral-mediated overexpression of both GluR1 and GluR2 in nucleus accumbens shell neurons facilitates extinction of cocaine- but not sucrose-seeking responses. A single extinction training session, when conducted during GluR subunit overexpression, attenuates stress-induced relapse to cocaine seeking even after GluR overexpression declines. Our findings indicate that extinction-induced plasticity in AMPA receptors may facilitate control over cocaine seeking by restoring glutamatergic tone in the nucleus accumbens, and may reduce the propensity for relapse under stressful situations in prolonged abstinence.