Reversal Learning In Mice Research Articles

Activity in the Dorsomedial Striatum Underlies Serial Reversal Learning Performance Under Probabilistic Uncertainty

BackgroundCorticostriatal circuits, particularly the dorsomedial striatum (DMS) and lateral orbitofrontal cortex, are critical for navigating reversal learning under probabilistic uncertainty. These same areas are implicated in the reversal learning impairments observed in individuals with psychosis as well as their psychotic symptoms, suggesting that they may share a common neurobiological substrate. To address this question, we used psychostimulant exposure and specific activation of the DMS during reversal learning in mice to assess corticostriatal activity. MethodsWe used amphetamine treatment to induce psychosis-relevant neurobiology in male mice during reversal learning and to examine pathway-specific corticostriatal activation. To determine the causal role of DMS activity, we used chemogenetics to drive midbrain inputs during a range of probabilistic contingencies. ResultsMice treated with amphetamine showed altered punishment learning, which was associated with decreased shifting after losses and increased perseverative errors after reversals. Reversal learning performance and strategies were dependent on increased activity in lateral orbitofrontal cortex to DMS circuits as well as in the DMS itself. Specific activation of midbrain to DMS circuits also decreased shifting after losses and reversal learning performance. However, these alterations were dependent on the probabilistic contingency. ConclusionsOur work suggests that the DMS plays a multifaceted role in reversal learning. Increasing DMS activity impairs multiple reversal learning processes dependent on the level of uncertainty, confirming its role in the maintenance and selection of incoming cortical inputs. Together, these outcomes suggest that elevated dopamine levels in the DMS could contribute to decision-making impairments in individuals with psychosis.

The effect of visually evoked innate fear on reward-associated conditional response and reversal learning in mice

The response to visually evoked innate fear is essential for survival and impacts the cognition and behavior of animals to threats in the environment. However, contradictory findings of the interaction of fear and executive behaviors were reported by previous studies. To address this question, the present study investigated the effect of looming stimuli-driven visually innate fear on reward-associated conditioned response and reversal learning in mice with low or high motivation for sucrose. The mice with low motivation exposed to looming stimuli displayed reduced efficiency in the test of conditional response in the fixed ratio 1 schedule and impaired executive motivation as tested in the progressive ratio schedule of reinforcement. However, the high motivated mice exposed to looming stimuli showed an unaffected conditional response but an increased executive motivation. In the reversal learning program, looming stimuli at the middle stage caused deficits in cognitive flexibility in the mice with low and high motivation. Therefore, these results illuminate the impact of visually evoked innate fear on conditional response and reversal learning and further show that the impacts are relevant to internal motivation and external fear stimuli.

Overexpression of miR-99a in hippocampus leads to impairment of reversal learning in mice

As one of the most common human genetic disorders, Down syndrome (DS) is characterized by a mild-to-moderate cognitive disability, which mainly results from genes overexpression on chromosome 21. The expression of miR-99a, a gene harboring on chromosome 21, is increased by 50 folds in DS brain samples. This study aims to investigate the effect of miR-99a overexpression in the hippocampus on mouse behaviors and explore the underlying mechanisms. Lentivirus vectors were delivered into the hippocampus for focal miR-99a overexpression in mice. Then behaviors were observed by an open field, elevated plus maze, rotarod motor test, and Morris water maze. The genes affected by miR-99a were identified by RNA sequencing (RNA-seq) and confirmed by quantitative RT-PCR (qRT-PCR) in samples isolated from the hippocampus injected with lentivirus-GFP-miR-99a or lentivirus-GFP vectors. It was found that the expression of miR-99a with intrahippocampal delivery of lentivirus-GFP-miR-99a resulted in reversal learning impairment in mice although it had no influence on motor function and anxiety. Meanwhile, RNA-seq results showed that 92 genes including mRNAs and microRNAs were significantly regulated by miR-99a, consistent with qRT-PCR consequence. Moreover, dual-luciferase reporter assay showed that miR-99a could directly bind to the 3’-untranslated regions (3’UTR) of target genes (Clic6 and Kcnj13) with an inhibitory effect on their activity. Furthermore, we also found that miR-99a overexpression affected different biological processes by bioinformatic analyses. Our study showed that miR-99a overexpression in the hippocampus leads to cognitive impairment through regulating the expressions of various genes, which reveals a novel function of miR-99a and provides new insights into understanding the pathophysiologic process of DS.

Learning Set Formation and Reversal Learning in Mice During High-Throughput Home-Cage-Based Olfactory Discrimination.

Rodent behavioral tasks are crucial to understanding the nature and underlying biology of cognition and cognitive deficits observed in psychiatric and neurological pathologies. Olfaction, as the primary sensory modality in rodents, is widely used to investigate cognition in rodents. In recent years, automation of olfactory tasks has made it possible to conduct olfactory experiments in a time- and labor-efficient manner while also minimizing experimenter-induced variability. In this study, we bring automation to the next level in two ways: First, by incorporating a radio frequency identification-based sorter that automatically isolates individuals for the experimental session. Thus, we can not only test animals during defined experimental sessions throughout the day but also prevent cagemate interference during task performance. Second, by implementing software that advances individuals to the next test stage as soon as performance criteria are reached. Thus, we can prevent overtraining, a known confounder especially in cognitive flexibility tasks. With this system in hand, we trained mice on a series of four odor pair discrimination tasks as well as their respective reversals. Due to performance-based advancement, mice normally advanced to the next stage in less than a day. Over the series of subsequent odor pair discriminations, the number of errors to criterion decreased significantly, thus indicating the formation of a learning set. As expected, errors to criterion were higher during reversals. Our results confirm that the system allows investigating higher-order cognitive functions such as learning set formation (which is understudied in mice) and reversal learning (which is a measure of cognitive flexibility and impaired in many clinical populations). Therefore, our system will facilitate investigations into the nature of cognition and cognitive deficits in pathological conditions by providing a high-throughput and labor-efficient experimental approach without the risks of overtraining or cagemate interference.

The selective 5-HT2A receptor agonist 25CN-NBOH does not affect reversal learning in mice.

Psychedelic 5-hydroxytryptamine 2A receptor (5-HT2AR) agonists are showing promise in the treatment of psychiatric disorders, such as treatment-resistant depression and anxiety. Human studies suggest that enhanced cognitive flexibility may contribute to their clinical efficacy. Both improvement and impairment of cognitive flexibility has been reported with 5-HT2AR ligands, making the link between 5-HT2AR pharmacology and cognitive flexibility equivocal. We tested the selective 5-HT2AR agonist 25CN-NBOH in healthy male C57BL/6JOlaHsd mice in a touchscreen-based mouse reversal learning test. No effects were observed on acquisition of the new stimulus-reward contingency, learning errors, or perseverative responses during reversal. Our results suggest that 25CN-NBOH does not affect reversal learning in the schedule used in this study.

β-lactolin, a whey-derived glycine-threonine-tryptophan-tyrosine lactotetrapeptide, improves prefrontal cortex-associated reversal learning in mice.

Dementia and cognitive decline have become worldwide public health problems. We have previously reported that a whey-derived glycine-threonine-tryptophan-tyrosine peptide, β-lactolin, improves hippocampus-dependent memory functions in mice. The supplementation with a whey digest rich in β-lactolin improves memory retrieval and executive function in a clinical trial, but the effect of β-lactolin on prefrontal cortex (PFC)-associated cognitive function was unclear. Here we examined the effect of β-lactolin and the whey digest on PFC-associated visual discrimination (VD) and reversal discrimination (RD) learning, using a rodent touch panel-based operant system. β-Lactolin and the whey digest significantly improved the RD learning, and the whey digest enhanced the response latency during the VD task, indicating that β-lactolin and the whey digest improve PFC-associated cognitive functions. Given the translational advantages of the touch panel operant system, consumption of β-lactolin in daily life could be beneficial for improving human PFC-associated cognitive function, helping to prevent dementia.

Hop-Derived Iso-α-Acids in Beer Improve Visual Discrimination and Reversal Learning in Mice as Assessed by a Touch Panel Operant System.

Dementia and cognitive decline have become worldwide health problems due to rapid growth of the aged population in many countries. We previously demonstrated that single or short-term administration of iso-α-acids, hop-derived bitter acids in beer, improves the spatial memory of scopolamine-induced amnesia model mice in the Y-maze and enhances novel object recognition in normal mice via activation of the vagus nerve and hippocampal dopaminergic system. However, these behavioral tests do not replicate the stimulus conditions or response requirements of human memory tests, and so may have poor translational validity. In this report, we investigated the effects of iso-α-acids on visual discrimination (VD) and reversal discrimination (RD) using a touch panel-based operant system similar to that used for human working memory tests. In the VD task, scopolamine treatment reduced correct response rate and prolonged response latency in mice, deficits reversed by prior oral administration of iso-α-acids. In the RD task, administration of iso-α-acids significantly increased correct response rate compared to vehicle administration. Previous studies have reported that dopamine signaling is involved in both VD and RD learning, suggesting that enhancement of dopamine release contributes to improved memory performance in mice treated with iso-α-acids. Taken together, iso-α-acids improve VD and RD learning, which are considered high-order cognitive functions. Given the translational advantages of the touch panel-based operant system, the present study suggests that iso-α-acids could be effective for improvement of working memory in human dementia patients.

Selective effects of 5-HT2C receptor modulation on performance of a novel valence-probe visual discrimination task and probabilistic reversal learning in mice

RationaleDysregulation of the serotonin (5-HT) system is a pathophysiological component in major depressive disorder (MDD), a condition closely associated with abnormal emotional responsivity to positive and negative feedback. However, the precise mechanism through which 5-HT tone biases feedback responsivity remains unclear. 5-HT2C receptors (5-HT2CRs) are closely linked with aspects of depressive symptomatology, including abnormalities in reinforcement processes and response to stress. Thus, we aimed to determine the impact of 5-HT2CR function on response to feedback in biased reinforcement learning.MethodsWe used two touchscreen assays designed to assess the impact of positive and negative feedback on probabilistic reinforcement in mice, including a novel valence-probe visual discrimination (VPVD) and a probabilistic reversal learning procedure (PRL). Systemic administration of a 5-HT2CR agonist and antagonist resulted in selective changes in the balance of feedback sensitivity bias on these tasks.ResultsSpecifically, on VPVD, SB 242084, the 5-HT2CR antagonist, impaired acquisition of a discrimination dependent on appropriate integration of positive and negative feedback. On PRL, SB 242084 at 1 mg/kg resulted in changes in behaviour consistent with reduced sensitivity to positive feedback. In contrast, WAY 163909, the 5-HT2CR agonist, resulted in changes associated with increased sensitivity to positive feedback and decreased sensitivity to negative feedback.ConclusionsThese results suggest that 5-HT2CRs tightly regulate feedback sensitivity bias in mice with consequent effects on learning and cognitive flexibility and specify a framework for the influence of 5-HT2CRs on sensitivity to reinforcement.

Lack of Pannexin 1 Alters Synaptic GluN2 Subunit Composition and Spatial Reversal Learning in Mice.

Long-term potentiation (LTP) and long-term depression (LTD) are two forms of synaptic plasticity that have been considered as the cellular substrate of memory formation. Although LTP has received considerable more attention, recent evidences indicate that LTD plays also important roles in the acquisition and storage of novel information in the brain. Pannexin 1 (Panx1) is a membrane protein that forms non-selective channels which have been shown to modulate the induction of hippocampal synaptic plasticity. Animals lacking Panx1 or blockade of Pannexin 1 channels precludes the induction of LTD and facilitates LTP. To evaluate if the absence of Panx1 also affects the acquisition of rapidly changing information we trained Panx1 knockout (KO) mice and wild type (WT) littermates in a visual and hidden version of the Morris water maze (MWM). We found that KO mice find the hidden platform similarly although slightly quicker than WT animals, nonetheless, when the hidden platform was located in the opposite quadrant (OQ) to the previous learned location, KO mice spent significantly more time in the previous quadrant than in the new location indicating that the absence of Panx1 affects the reversion of a previously acquired spatial memory. Consistently, we observed changes in the content of synaptic proteins critical to LTD, such as GluN2 subunits of N-methyl-D-aspartate receptors (NMDARs), which changed their contribution to synaptic plasticity in conditions of Panx1 ablation. Our findings give further support to the role of Panx1 channels on the modulation of synaptic plasticity induction, learning and memory processes.

Awake, long-term intranasal insulin treatment does not affect object memory, odor discrimination, or reversal learning in mice

Intranasal insulin delivery is currently being used in clinical trials to test for improvement in human memory and cognition, and in particular, for lessening memory loss attributed to neurodegenerative diseases. Studies have reported the effects of short-term intranasal insulin treatment on various behaviors, but less have examined long-term effects. The olfactory bulb contains the highest density of insulin receptors in conjunction with the highest level of insulin transport within the brain. Previous research from our laboratory has demonstrated that acute insulin intranasal delivery (IND) enhanced both short- and long-term memory as well as increased two-odor discrimination in a two-choice paradigm. Herein, we investigated the behavioral and physiological effects of chronic insulin IND. Adult, male C57BL6/J mice were intranasally treated with 5μg/μl of insulin twice daily for 30 and 60days. Metabolic assessment indicated no change in body weight, caloric intake, or energy expenditure following chronic insulin IND, but an increase in the frequency of meal bouts selectively in the dark cycle. Unlike acute insulin IND, which has been shown to cause enhanced performance in odor habituation/dishabituation and two-odor discrimination tasks in mice, chronic insulin IND did not enhance olfactometry-based odorant discrimination or olfactory reversal learning. In an object memory recognition task, insulin IND-treated mice did not perform differently than controls, regardless of task duration. Biochemical analyses of the olfactory bulb revealed a modest 1.3 fold increase in IR kinase phosphorylation but no significant increase in Kv1.3 phosphorylation. Substrate phosphorylation of IR kinase downstream effectors (MAPK/ERK and Akt signaling) proved to be highly variable. These data indicate that chronic administration of insulin IND in mice fails to enhance olfactory ability, object memory recognition, or a majority of systems physiology metabolic factors – as reported to elicit a modulatory effect with acute administration. This leads to two alternative interpretations regarding long-term insulin IND in mice: 1) It causes an initial stage of insulin resistance to dampen the behaviors that would normally be modulated under acute insulin IND, but ability to clear a glucose challenge is still retained, or 2) There is a lack of behavioral modulation at high concentration of insulin attributed to the twice daily intervals of hyperinsulinemia caused by insulin IND administration without any insulin resistance, per se.

Touchscreen-based Visual Discrimination and Reversal Tasks for Mice to Test Cognitive Flexibility.

Reversal learning can be used to examine deficits in cognitive flexibility, which have been linked to a number of neuropsychiatric disorders including schizophrenia and addiction. However, methods of examining reversal learning have varied substantially between species. Touchscreen technology has allowed researchers to explore cognitive deficits with a platform that is translatable across rodents, non-human primates and human subjects. Here we describe a method for measuring visual discrimination and reversal learning in mice using automated touchscreen-based operant chambers.

Effects of acute sleep deprivation on motor and reversal learning in mice

Sleep supports the formation of a variety of declarative and non-declarative memories, and sleep deprivation often impairs these types of memories. In human subjects, natural sleep either during a nap or overnight leads to long-lasting improvements in visuomotor and fine motor tasks, but rodent models recapitulating these findings have been scarce. Here we present evidence that 5h of acute sleep deprivation impairs mouse skilled reach learning compared to a matched period of ad libitum sleep. In sleeping mice, the duration of total sleep time during the 5h of sleep opportunity or during the first bout of sleep did not correlate with ultimate gain in motor performance. In addition, we observed that reversal learning during the skilled reaching task was also affected by sleep deprivation. Consistent with this observation, 5h of sleep deprivation also impaired reversal learning in the water-based Y-maze. In conclusion, acute sleep deprivation negatively impacts subsequent motor and reversal learning and memory.

A novel automated behavioral test battery assessing cognitive rigidity in two genetic mouse models of autism.

Repetitive behaviors are a key feature of many pervasive developmental disorders, such as autism. As a heterogeneous group of symptoms, repetitive behaviors are conceptualized into two main subgroups: sensory/motor (lower-order) and cognitive rigidity (higher-order). Although lower-order repetitive behaviors are measured in mouse models in several paradigms, so far there have been no high-throughput tests directly measuring cognitive rigidity. We describe a novel approach for monitoring repetitive behaviors during reversal learning in mice in the automated IntelliCage system. During the reward-motivated place preference reversal learning, designed to assess cognitive abilities of mice, visits to the previously rewarded places were recorded to measure cognitive flexibility. Thereafter, emotional flexibility was assessed by measuring conditioned fear extinction. Additionally, to look for neuronal correlates of cognitive impairments, we measured CA3-CA1 hippocampal long term potentiation (LTP). To standardize the designed tests we used C57BL/6 and BALB/c mice, representing two genetic backgrounds, for induction of autism by prenatal exposure to the sodium valproate. We found impairments of place learning related to perseveration and no LTP impairments in C57BL/6 valproate-treated mice. In contrast, BALB/c valproate-treated mice displayed severe deficits of place learning not associated with perseverative behaviors and accompanied by hippocampal LTP impairments. Alterations of cognitive flexibility observed in C57BL/6 valproate-treated mice were related to neither restricted exploration pattern nor to emotional flexibility. Altogether, we showed that the designed tests of cognitive performance and perseverative behaviors are efficient and highly replicable. Moreover, the results suggest that genetic background is crucial for the behavioral effects of prenatal valproate treatment.

Mediodorsal Thalamus Hypofunction Impairs Flexible Goal-Directed Behavior

BackgroundCognitive inflexibility is a core symptom of several mental disorders including schizophrenia. Brain imaging studies in schizophrenia patients performing cognitive tasks have reported decreased activation of the mediodorsal thalamus (MD). Using a pharmacogenetic approach to model MD hypofunction, we recently showed that decreasing MD activity impairs reversal learning in mice. While this demonstrates causality between MD hypofunction and cognitive inflexibility, questions remain about the elementary cognitive processes that account for the deficit. MethodsUsing the Designer Receptors Exclusively Activated by Designer Drugs system, we reversibly decreased MD activity during behavioral tasks assessing elementary cognitive processes inherent to flexible goal-directed behaviors, including extinction, contingency degradation, outcome devaluation, and Pavlovian-to-instrumental transfer (n = 134 mice). ResultsWhile MD hypofunction impaired reversal learning, it did not affect the ability to learn about nonrewarded cues or the ability to modulate action selection based on the outcome value. In contrast, decreasing MD activity delayed the ability to adapt to changes in the contingency between actions and their outcomes. In addition, while Pavlovian learning was not affected by MD hypofunction, decreasing MD activity during Pavlovian learning impaired the ability of conditioned stimuli to modulate instrumental behavior. ConclusionsMediodorsal thalamus hypofunction causes cognitive inflexibility reflected by an impaired ability to adapt actions when their consequences change. Furthermore, it alters the encoding of environmental stimuli so that they cannot be properly utilized to guide behavior. Modulating MD activity could be a potential therapeutic strategy for promoting adaptive behavior in human subjects with cognitive inflexibility.

A Kind of D-Amino Acid Oxidase Inhibitor, Sodium Benzoate, Might Relieve Panic Symptoms in a First-Episode, Drug-Naïve Panic-Disorder Patient

A Kind of D-Amino Acid Oxidase Inhibitor, Sodium Benzoate, Might Relieve Panic Symptoms in a First-Episode, Drug-Naïve Panic-Disorder Patient

Impairment effects of tail suspension stress on spatial memory and its reversal learning in mice

Present work investigated the effects of tail suspension stress (TSS) on spatial memory acquisition, consolidation, and its reversal learning in mice. Eighty-one adult male KM mice were divided into four groups (each group including a TSS subgroup and its control subgroup): absolute spatial memory acquisition and consolidation groups (group AA and CA); relative spatial memory acquisition and consolidation groups (group AR and CR). TSS (20 min) was performed immediately before (acquisition) or after (consolidation) a daily training. Results showed that there was no significant difference between control animals and TSS animals in each group in early spatial memory training days (5-8 d of training). Along with training, the performance of control animals improved significantly, but the performance of TSS animals improved slightly (group AA, CA and AR) or even did not change (group CR) (P<0.01). Reversal learning was also impaired in TSS animals (P<0.01). The results indicated that TSS could impair spatial memory acquisition, consolidation and reversal learning (especially the relative spatial memory consolidation and its reversal learning) in mice.

Genetic Dissection of Behavioral Flexibility: Reversal Learning in Mice

Behavioral inflexibility is a feature of schizophrenia, attention-deficit/hyperactivity disorder, and behavior addictions that likely results from heritable deficits in the inhibitory control over behavior. Here, we investigate the genetic basis of individual differences in flexibility, measured using an operant reversal learning task. We quantified discrimination acquisition and subsequent reversal learning in a cohort of 51 BXD strains of mice (2-5 mice/strain, n = 176) for which we have matched data on sequence, gene expression in key central nervous system regions, and neuroreceptor levels. Strain variation in trials to criterion on acquisition and reversal was high, with moderate heritability (∼.3). Acquisition and reversal learning phenotypes did not covary at the strain level, suggesting that these traits are effectively under independent genetic control. Reversal performance did covary with dopamine D2 receptor levels in the ventral midbrain, consistent with a similar observed relationship between impulsivity and D2 receptors in humans. Reversal, but not acquisition, is linked to a locus on mouse chromosome 10 with a peak likelihood ratio statistic at 86.2 megabase (p < .05 genome-wide). Variance in messenger RNA levels of select transcripts expressed in neocortex, hippocampus, and striatum correlated with the reversal learning phenotype, including Syn3, Nt5dc3, and Hcfc2. This work demonstrates the clear trait independence between, and genetic control of, discrimination acquisition and reversal and illustrates how globally coherent data sets for a single panel of highly related strains can be interrogated and integrated to uncover genetic sources and molecular and neuropharmacological candidates of complex behavioral traits relevant to human psychopathology.

Genetic inactivation of D-amino acid oxidase enhances extinction and reversal learning in mice

Activation of the N-methyl-D-aspartate receptor (NMDAR) glycine site has been shown to accelerate adaptive forms of learning that may benefit psychopathologies involving cognitive and perseverative disturbances. In this study, the effects of increasing the brain levels of the endogenous NMDAR glycine site agonist D-serine, through the genetic inactivation of its catabolic enzyme D-amino acid oxidase (DAO), were examined in behavioral tests of learning and memory. In the Morris water maze task (MWM), mice carrying the hypofunctional Dao1(G181R) mutation demonstrated normal acquisition of a single platform location but had substantially improved memory for a new target location in the subsequent reversal phase. Furthermore, Dao1(G181R) mutant animals exhibited an increased rate of extinction in the MWM that was similarly observed following pharmacological administration of D-serine (600 mg/kg) in wild-type C57BL/6J mice. In contextual and cued fear conditioning, no alterations were found in initial associative memory recall; however, extinction of the contextual fear memory was facilitated in mutant animals. Thus, an augmented level of D-serine resulting from reduced DAO activity promotes adaptive learning in response to changing conditions. The NMDAR glycine site and DAO may be promising therapeutic targets to improve cognitive flexibility and inhibitory learning in psychiatric disorders such as schizophrenia and anxiety syndromes.

Effects of Diazepam or Chronic Alcohol Treatment on Spatial Reversal Learning in Mice

Mice submitted to chronic alcohol consumption (CAC; 11 months) or to systemic diazepam administration were trained in a spatial reversal learning task. Although CAC-treated mice were able to learn the initial acquisition at normal rates, they were impaired during the first reversal of the discrimination and subsequent reversal sessions. In contrast, diazepam administration induced no deficits for any behavioral measure. In conclusion, CAC, but not diazepam administration, induces an exaggerated sensitivity to proactive interference. The two treatments spared, however, the development of the learning set curve. These results are congruent with clinical data showing that nondeclarative or implicit forms of memory processes are spared in diazepam-treated subjects or in chronic alcoholics.

Effects of radiofrequency versus neurotoxic cingulate lesions on spatial reversal learning in mice

Effects of radiofrequency versus neurotoxic cingulate lesions on spatial reversal learning in mice