Unconditioned Stimulus Intensity Research Articles

Reinforcement expectation in the honeybee (Apis mellifera): Can downshifts in reinforcement show conditioned inhibition?

When animals learn the association of a conditioned stimulus (CS) with an unconditioned stimulus (US), later presentation of the CS invokes a representation of the US. When the expected US fails to occur, theoretical accounts predict that conditioned inhibition can accrue to any other stimuli that are associated with this change in the US. Empirical work with mammals has confirmed the existence of conditioned inhibition. But the way it is manifested, the conditions that produce it, and determining whether it is the opposite of excitatory conditioning are important considerations. Invertebrates can make valuable contributions to this literature because of the well-established conditioning protocols and access to the central nervous system (CNS) for studying neural underpinnings of behavior. Nevertheless, although conditioned inhibition has been reported, it has yet to be thoroughly investigated in invertebrates. Here, we evaluate the role of the US in producing conditioned inhibition by using proboscis extension response conditioning of the honeybee (Apis mellifera). Specifically, using variations of a "feature-negative" experimental design, we use downshifts in US intensity relative to US intensity used during initial excitatory conditioning to show that an odorant in an odor-odor mixture can become a conditioned inhibitor. We argue that some alternative interpretations to conditioned inhibition are unlikely. However, we show variation across individuals in how strongly they show conditioned inhibition, with some individuals possibly revealing a different means of learning about changes in reinforcement. We discuss how the resolution of these differences is needed to fully understand whether and how conditioned inhibition is manifested in the honeybee, and whether it can be extended to investigate how it is encoded in the CNS. It is also important for extension to other insect models. In particular, work like this will be important as more is revealed of the complexity of the insect brain from connectome projects.

Conditioned place avoidance in the planaria Schmidtea mediterranea: A pre-clinical invertebrate model of anxiety-related disorders

The objective of the present study was to develop a model of avoidance learning and its extinction in planarians (Schmidtea mediterranea). Based on previous experiments showing conditioned place preference, we developed a procedure to investigate conditioned place avoidance (CPA) using shock as an unconditioned stimulus (US) and an automated tracking system to record the animals’ behaviour. In Experiment 1, we assessed the unconditioned properties of different shock intensities by measuring post shock activity. In two subsequent experiments we investigated CPA using different designs, surfaces as conditioned stimuli (CSs; rough and smooth), and different US intensities (5 V and 10 V). In general, we observed the successful development of CPA. However, CPA was stronger with higher shock intensities, and we found that, in our preparation, a rough surface is best at entering into an association with the shock than a smooth surface. Finally, we also observed extinction of CPA. The evidence of CPA and its extinction in flatworms validates the planaria as a pre-clinical model for the study of avoidance learning, a hallmark of anxiety disorders.

Role of prediction error and the cholinergic system on memory reconsolidation processes in mice

The ability to make predictions based on stored information is a general coding strategy. A prediction error (PE) is a mismatch between expected and current events. Our memories, like ourselves, are subject to change. Thus, an acquired memory can become active and update its content or strength by a labilization-reconsolidation process. Within the reconsolidation framework, PE drives the updating of consolidated memories. In the past our lab has made key progresses showing that a blockade in the central cholinergic system during reconsolidation can cause memory impairment, while reinforcement of cholinergic activity enhances it. In the present work we determined that PE is a necessary condition for memory to reconsolidate in an inhibitory avoidance task using both male and female mice. Depending on the intensity of the unconditioned stimulus (US) used during training, a negative (higher US intensity) or positive (lower US intensity/no US) PE on a retrieval session modified the behavioral response on a subsequent testing session. Furthermore, we demonstrated that the cholinergic system modulates memory reconsolidation only when PE is detected. In this scenario administration of oxotremorine, scopolamine or nicotine after memory reactivation either enhanced or impaired memory reconsolidation in a sex-specific manner.

High Unconditioned Stimulus Intensity Results in Stronger Threat Conditioning Than Low Intensity

High Unconditioned Stimulus Intensity Results in Stronger Threat Conditioning Than Low Intensity

How disappointing: Startle modulation reveals conditional stimuli presented after pleasant unconditional stimuli acquire negative valence.

Past research on backward conditioning in evaluative and fear conditioning yielded inconsistent results in that self-report measures suggest that the conditional stimulus (CS) acquired the valence of the unconditional stimulus (US) in fear conditioning (assimilation effects), but the opposite valence in evaluative conditioning (contrast effects). Conversely, implicit measures of CS valence suggest assimilation effects in evaluative backward conditioning, whereas startle modulation indicates contrast effects in backward fear conditioning. The current study investigated whether US intensity could account for the dissociation on implicit measures between fear and evaluative conditioning. Self-report measures of evaluative learning indicated assimilation effects for forward conditioning, whereas backward contrast effects were observed with intense USs only. Blink startle modulation indicated assimilation effects in forward conditioning and contrast effects in backward conditioning, regardless of US intensity. Experiment 2 included a neutral US in order to assess whether the offset of the positive US elicits an opponent emotional response that mirrors relief (disappointment), which is thought to mediate the reduction in startle seen during backward CSs in fear conditioning. This opponent emotional response was evident as startle magnitude during backward CSs increased linearly with increasing US pleasantness. Omission of the forward CSs led to an assimilation effect in self-report measures. The current results extend our understanding of emotional learning to stimuli encountered after salient emotional events. Startle reflects the emotion prevailing after US offset, relief or disappointment, whereas self-report measures seem more attuned to factors such as US predictability and intensity.

Reactivation of the Unconditioned Stimulus Inhibits the Return of Fear Independent of Cortisol.

Reconsolidation is the post-retrieval stabilization of memories, a time-limited process during which reactivated (i.e., retrieved) memories can be updated with new information, become stronger or weaker, depending on the specific treatment. We have previously shown that the stress hormone cortisol has an enhancing effect on the reconsolidation of fear memories in men. This effect was specific, i.e., limited to the conditioned stimulus (CS) that was reactivated, and did not generalize to other previously reinforced, but not reactivated CS. Based on these results, we suggested that cortisol plays a critical role in the continuous strengthening of reactivated emotional memories, contributing to their persistence and robustness. In the current study, we aimed to achieve a more generalized reconsolidation enhancement using an alternative reactivation method, i.e., by a low-intensity unconditioned stimulus (UCS) presentation instead of the more common unreinforced CS presentation. In previous studies, UCS reactivation was shown to lead to a more generalized reconsolidation effect. Therefore, we hypothesized that the combination of cortisol treatment and UCS reactivation would lead to an enhanced fear memory reconsolidation, which would generalize from previously reinforced CS to stimuli that resemble it. We tested 75 men in a 3-day fear conditioning paradigm: fear acquisition training on day 1; UCS reactivation/no reactivation and pharmacological treatment (20 mg hydrocortisone/placebo) on day 2; extinction training, reinstatement and test (of original and modified stimuli) on day 3. In contrast to our hypothesis, UCS reactivation prevented the return of fear [observed in skin conductance responses (SCR)] regardless of the pharmacological manipulation: while reinstatement to the original CS was found in the no-reactivation group, both reactivation groups (cortisol and placebo) showed no reinstatement. As the only methodological difference between our previous study and the current one was the reactivation method, we focus on UCS reactivation as the main explanation for these unexpected findings. We suggest that the robust prediction error generated by the UCS reactivation method (as opposed to CS reactivation), combined with the lower UCS intensity, has by itself weakened the emotional value of the UCS, thus preventing the return of fear to the CS that was associated with it. We call for future research to support these findings and to examine the potential of this reactivation method, or variations thereof, as a tool for therapeutic use.

Cannabidiol disrupts the consolidation of specific and generalized fear memories via dorsal hippocampus CB1 and CB2 receptors

Pharmacological interventions able to modulate a fear memory while it is consolidated could have therapeutic value in tempering those maladaptively overconsolidated. Animal and human studies have shown the intensity of unconditioned stimulus delivered during fear conditioning influences qualitative and quantitative aspects of the memory to be established. By varying the shock intensity used for contextual pairing in rats, here we induced specific and more generalized long-term fear memories to investigate whether, how and where in the brain the cannabidiol (CBD; 3.0–30 mg/kg i.p.) could impair their consolidation and related outcomes. When given immediately after their acquisition, it reduced respectively the conditioned fear expression, and fear generalization, ultrasonic vocalizations at 22-kHz and the relative resistance to extinction. CBD had no effects on short-term fear memory, and its delayed treatment no longer affected the consolidation process. As the dorsal hippocampus (DH) modulates fear memory specificity and generalization, and cannabinoid type-1 (CB1) and type-2 (CB2) receptors contribute to consolidation, we investigated their involvement in CBD effects. Both systemic and intra-DH treatment with the CB1 receptor antagonist/inverse agonist AM251 or the CB2 receptor antagonist/inverse agonist AM630 prevented the disrupting CBD effects on consolidation. Since the CBD effects on the endocannabinoid transmission are probably indirect, we investigated and demonstrated the FAAH inhibitor URB597 induced effects similar to those of CBD when given systemically or intra-DH. Altogether, the present results suggest the CBD disrupts the consolidation of different fear memories via anandamide-mediated activation of DH CB1 and CB2 receptors.

Uncertainty-Dependent Extinction of Fear Memory in an Amygdala-mPFC Neural Circuit Model.

Uncertainty of fear conditioning is crucial for the acquisition and extinction of fear memory. Fear memory acquired through partial pairings of a conditioned stimulus (CS) and an unconditioned stimulus (US) is more resistant to extinction than that acquired through full pairings; this effect is known as the partial reinforcement extinction effect (PREE). Although the PREE has been explained by psychological theories, the neural mechanisms underlying the PREE remain largely unclear. Here, we developed a neural circuit model based on three distinct types of neurons (fear, persistent and extinction neurons) in the amygdala and medial prefrontal cortex (mPFC). In the model, the fear, persistent and extinction neurons encode predictions of net severity, of unconditioned stimulus (US) intensity, and of net safety, respectively. Our simulation successfully reproduces the PREE. We revealed that unpredictability of the US during extinction was represented by the combined responses of the three types of neurons, which are critical for the PREE. In addition, we extended the model to include amygdala subregions and the mPFC to address a recent finding that the ventral mPFC (vmPFC) is required for consolidating extinction memory but not for memory retrieval. Furthermore, model simulations led us to propose a novel procedure to enhance extinction learning through re-conditioning with a stronger US; strengthened fear memory up-regulates the extinction neuron, which, in turn, further inhibits the fear neuron during re-extinction. Thus, our models increased the understanding of the functional roles of the amygdala and vmPFC in the processing of uncertainty in fear conditioning and extinction.

Effects of sucrose concentration and water deprivation on Pavlovian conditioning and responding for conditioned reinforcement.

An appetitive Pavlovian conditioned stimulus (CS) can predict an unconditioned stimulus (US) and acquire incentive salience. We tested the hypothesis that US intensity and motivational state of the subject would influence Pavlovian learning and impact the attribution of incentive salience to an appetitive Pavlovian CS. To this end, we examined the effects of sucrose concentration and water deprivation on the acquisition of Pavlovian conditioning and responding for a conditioned reinforcer. Male Long-Evans rats (Harlan; 220-240 g) receiving 3% (3S) or 20% (20S) sucrose were either non-water deprived or given water for 1 hr per day. During Pavlovian conditioning sessions, half the rats in each concentration and deprivation condition received a 10-s CS paired with 0.2 ml of sucrose (16 trials/session; 3.2 ml/session). The remainder received unpaired CS and US presentations. Entries into a port where sucrose was delivered were recorded. Next, responding for conditioned reinforcement was tested, wherein pressing an active lever produced the CS and pressing an inactive lever had no consequences. CS-elicited port entries increased, and latency to the first CS-elicited port entry decreased across sessions in paired groups. Water deprivation augmented these effects, whereas sucrose concentration had no significant impact on behavior. Responding for conditioned reinforcement was observed in the 20S water-deprived, paired group. Thus, water deprivation can facilitate the acquisition of Pavlovian conditioning, potentially by enhancing motivational state, and a high-intensity US and a high motivational state can interact to heighten the attribution of incentive salience to an appetitive Pavlovian CS. (PsycINFO Database Record

The Impact of Unconditioned Stimulus Devaluation on Conditional Fear Extinction

Unconditioned stimulus(US) devaluation has been put forward as an effective measure to decrease fear response. Previous studies mostly focused on investigating the impact of US devaluation in the test phase after fear acquisition. As widely recognized, exposure therapy based on the theory of extinction training is a frequently used method for the treatment of mental disorders. Hence, we made an attempt to implement this program in the extinction training to examine if it could improve the therapeutic effect. In addition, to further understand the mechanisms of US devaluation, evaluative conditioning was explored.An experiment was designed to test the impact of reduction in US intensity on conditioned fear extinction.All participants were subjected to a fear conditioning experiment consisted of acquisition, US devaluation and extinction phases while subjective US-expectancy and skin conductance response(SCR)were rated online. In the experiment, the intensity of US was decreased after acquisition for one group(devaluation) and held constant for another group(control). Two simple geometrical figures served as CS+ and CS?, and a 1-sec female vocal stimulus(i.e., scream) as US. Each CS+ was paired with a US during the acquisition phase, and in the subsequent devaluation phrase, subjects were only exposed to the intensity-changed US for three times. To measure evaluative conditioning, participants were required to rate CS-valence at the end of each conditioning phase.The results show that US-expectancy to CS+ was not significantly different between two groups, which seemed to reflect a similar mode of fear extinction. However, the SCR to CS+ of devaluation groupwas significantly lower than that of control group, suggesting an efficient promoted process of fear extinction by US revaluation. The effect of US devaluation was also found in evaluative conditioning. Compared to control group,devaluation group showed more positive valence ratings for CS+.The results suggest that US devaluation did promote the extinction according to the SCR. Through the US devaluation, the explicit awareness of CS-US bond did not change; but the SCR, representing a procedural fear memory formed by implicit learning, had been influenced, which declared a separation between different fear response indexes. From the evaluating conditioning results, we inferred that US might have served as a transporter, to transform the negative valence to CS. After devaluation, individuals might restate the cognition of CS fear valence, leading to the promotion of extinction. The results suggest that the modulation of US intensity may provide a new perspective for exposure therapy. Based on relevant literature review, the knowledge of the internal mechanisms of US devaluation that influence the conditioned fear extinction has acquired great advance. In the future, the treatment on mental disorders should be more focused on the behavioral therapy based on extinction training.

Eyeblink classical conditioning and post-traumatic stress disorder - a model systems approach.

Not everyone exposed to trauma suffers flashbacks, bad dreams, numbing, fear, anxiety, sleeplessness, hyper-vigilance, hyperarousal, or an inability to cope, but those who do may suffer from post-traumatic stress disorder (PTSD). PTSD is a major physical and mental health problem for military personnel and civilians exposed to trauma. There is still debate about the incidence and prevalence of PTSD especially among the military, but for those who are diagnosed, behavioral therapy and drug treatment strategies have proven to be less than effective. A number of these treatment strategies are based on rodent fear conditioning research and are capable of treating only some of the symptoms because the extinction of fear does not deal with the various forms of hyper-vigilance and hyperarousal experienced by people with PTSD. To help address this problem, we have developed a preclinical eyeblink classical conditioning model of PTSD in which conditioning and hyperarousal can both be extinguished. We review this model and discuss findings showing that unpaired stimulus presentations can be effective in reducing levels of conditioning and hyperarousal even when unconditioned stimulus intensity is reduced to the point where it is barely capable of eliciting a response. These procedures have direct implications for the treatment of PTSD and could be implemented in a virtual reality environment.

Latent inhibition and facilitation of conditioned taste aversion in preweanling rats.

Early in ontogeny, taste preexposure has been found to induce latent inhibition as well as produce a facilitation of conditioned taste aversion (CTA). In this study, the effect of taste preexposure on CTA was investigated in 13-14 day old rats as a function of taste preexposure (0, 1, or 3 trials) and unconditioned stimulus intensity (LiCl: 0, 0.15, or 0.30 M). After one conditioning trial, with the low intensity US, an aversion was only observed after taste preexposure (facilitation). When using the strong US, an aversion was found without preexposure while latent inhibition was observed with 3 preexposure trials. In conclusion, stimulus preexposure can either facilitate conditioning or produce latent inhibition in infant rats, depending on the amount of stimulus preexposure and the intensity of the US.

Effects of unconditioned stimulus intensity and fear extinction on subsequent sleep architecture in an afternoon nap

Impaired fear extinction and disturbed sleep coincide in post-traumatic stress disorder (PTSD), but the nature of this relationship is unclear. Rapid eye movement (REM) sleep deprivation impairs fear extinction recall in rodents and young healthy subjects, and animal models have demonstrated both disrupted sleep after fear conditioning and normalized sleep after extinction learning. As a correlation between unconditioned stimulus (US) responding and subsequent sleep architecture has been observed in healthy subjects, the goal of this study was to test whether US intensity would causally affect subsequent sleep. Twenty-four young healthy subjects underwent a fear conditioning session with skin conductance response measurements before an afternoon session of polysomnographically recorded sleep (up to 120min) in the sleep laboratory. Two factors were manipulated experimentally in a 2×2 design: US (electrical shock) was set at high or low intensity, and subjects did or did not receive an extinction session after fear conditioning. We observed that neither factor affected REM sleep amount, that high US intensity nominally increased sleep fragmentation (more Stage 1 sleep, stage shifts and wake after sleep onset), and that extinction increased Stage 4 amount. Moreover, reduced Stage 1 and increased Stage 4 and REM sleep were associated with subjective sleep quality of the afternoon nap. These results provide evidence for the notion that US intensity and extinction affect subsequent sleep architecture in young healthy subjects, which may provide a translational bridge from findings in animal studies to correlations observed in PTSD patients.

Dissociation between implicit and explicit responses in postconditioning UCS revaluation after fear conditioning in humans.

The nature of the relationship between explicit and implicit learning is a topic of considerable debate. To investigate this relationship we conducted two experiments on postconditioning revaluation of the unconditional stimulus (UCS) in human fear conditioning. In Experiment 1, the intensity of the UCS was decreased after acquisition for one group (devaluation) and held constant for another group (control). A subsequent test revealed that even though both groups exhibited similar levels of UCS expectancy, the devaluation group had significantly smaller conditional skin conductance responses. The devaluation effect was not explained by differences in the explicit estimates of UCS probability or explicit knowledge that the UCS intensity had changed. In Experiment 2, the value of the UCS was increased after acquisition for one group (inflation) and held constant for another group (control). Test performance revealed that UCS inflation did not alter expectancy ratings, but the inflation group exhibited larger learned skin conductance responses than the control group. The inflation effect was not explained by differences in the explicit estimates of UCS probability or explicit knowledge that the UCS intensity had changed. The SCR revaluation effect was not dependent on explicit memory processes in either experiment. In both experiments we found differences on an implicit measure of learning in the absence of changes in explicit measures. Together, the differences observed between expectancy measures and skin conductance support the idea that these responses might reflect different types of memory formed during the same training procedure and be supported by separate neural systems.

Conditioned suppression is an inverted-U function of footshock intensity

Most theories of associative learning assert that conditioned responding to a target cue is a monotonically increasing function of unconditioned-stimulus (US) intensity. In a lick suppression preparation with rats, a cue was paired with a 0.4-, 0.6-, 0.8-, 1.0-, 1.2-, or 1.4-mA footshock in Experiment 1a, and with a 0.3-, 0.8-, 1.3-, or 1.8-mA footshock in Experiment 1b. Subsequent suppression in response to the cue was an inverted-U function of the US intensity. In Experiment 2, we demonstrated that massive extinction of the training context and compound conditioning can each attenuate the response decrement caused by training with a high-intensity US. The sometimes-competing-retrieval model (Stout & Miller, Psychological Review 114:759-783, 2007) provides a better fit to these data than do several other models of associative learning.

A Low Concentration of Ethanol Impairs Learning but Not Motor and Sensory Behavior in Drosophila Larvae

Drosophila melanogaster has proven to be a useful model system for the genetic analysis of ethanol-associated behaviors. However, past studies have focused on the response of the adult fly to large, and often sedating, doses of ethanol. The pharmacological effects of low and moderate quantities of ethanol have remained understudied. In this study, we tested the acute effects of low doses of ethanol (∼7 mM internal concentration) on Drosophila larvae. While ethanol did not affect locomotion or the response to an odorant, we observed that ethanol impaired associative olfactory learning when the heat shock unconditioned stimulus (US) intensity was low but not when the heat shock US intensity was high. We determined that the reduction in learning at low US intensity was not a result of ethanol anesthesia since ethanol-treated larvae responded to the heat shock in the same manner as untreated animals. Instead, low doses of ethanol likely impair the neuronal plasticity that underlies olfactory associative learning. This impairment in learning was reversible indicating that exposure to low doses of ethanol does not leave any long lasting behavioral or physiological effects.

Effect of Intensity of Unconditional Stimulus on Reconsolidation of Contextual Fear Memory

Memory reconsolidation is ubiquitous across species and various memory tasks. It is a dynamic process in which memory is modified and/or updated. In experimental conditions, memory reconsolidation is usually characterized by the fact that the consolidated memory is disrupted by a combination of memory reactivation and inhibition of protein synthesis. However, under some experimental conditions, the reactivated memory is not disrupted by inhibition of protein synthesis. This so called "boundary condition" of reconsolidation may be related to memory strength. In Pavlovian fear conditioning, the intensity of unconditional stimulus (US) determines the strength of the fear memory. In this study, we examined the effect of the intensity of US on the reconsolidation of contextual fear memory. Strong contextual fear memory, which is conditioned with strong US, is not disrupted by inhibition of protein synthesis after its reactivation; however, a weak fear memory is often disrupted. This suggests that a US of strong intensity can inhibit reconsolidation of contextual fear memory.

Social Facilitation of Long-Lasting Memory Retrieval in Drosophila

Recent studies demonstrate that social interactions can have a profound influence on Drosophila melanogaster behavior and cuticular pheromone patterns. Olfactory memory performance has mostly been investigated in groups, and previous studies have reported that grouped flies do not interact with each other and behave in the same way as individual flies during short-term memory retrieval. However, the influence of social effects on the two known forms of Drosophila long-lasting associative memory, anesthesia-resistant memory (ARM) and long-term memory (LTM), has never been reported. We show here that ARM is displayed by individual flies but is socially facilitated; flies trained for ARM interact within a group to improve their conditioned performance. In contrast, testing shows LTM improvement in individual flies rather than in a group. We show that the social facilitation of ARM during group testing is independent of the social context of training and does not involve nonspecific aggregation. Furthermore, we demonstrate that social interactions facilitate ARM retrieval. We also show that social interactions necessary for this facilitation are specifically generated by trained flies: when single flies trained for ARM are mixed with groups of naive flies, they display poor retrieval, whereas mixing with groups trained either for ARM or LTM enhances performance.

Prefrontal control of trace eyeblink conditioning in rabbits ( Oryctolagus cuniculus) II: Effects of type of unconditioned stimulus (airpuff vs. periorbital shock) and unconditioned stimulus intensity

Previous research has implicated the medial prefrontal cortex (mPFC) in the control of classically conditioned autonomic and somatomotor responses. In eyeblink (EB) classical conditioning prefrontal involvement appears to be limited to paradigms that are more difficult to learn, in that acquisition is slower. These include trace conditioning and discrimination/reversal. Some of this research suggests that the participation of mPFC in classical EB conditioning is related to the intensity or type of unconditioned stimulus (US) employed. In the present two experiments we thus studied the effects of manipulation of periorbital shock intensity as the US in Experiment 1 and in Experiment 2 the intensity of a corneal airpuff as the US on Pavlovian trace EB conditioning. The results indicate that there are optimal intensities of both airpuff and periorbital shock as the US in the demonstration of mPFC control of trace classical EB conditioning.

Unblocking in Pavlovian fear conditioning.

Six experiments used rats to study blocking and unblocking of fear learning. An excitatory stimulus (A) blocked fear learning to a neutral stimulus (B). Unblocking of B occurred if the AB compound signaled an increase in unconditioned stimulus (US) intensity or number. Assessments of associative change during blocking showed that more was learned about B than A. Such assessments during unblocking revealed that more was learned about B than A following an increase in US intensity but not US number. These US manipulations had no differential effects on single-cue learning. The results show that variations in US intensity or number produce unblocking of fear learning, but for each there is a different profile of associative change and a potentially different mechanism.