Probabilistic Reversal Learning Task Research Articles

Belief Updating, Childhood Maltreatment, and Paranoia in Schizophrenia-Spectrum Disorders.

Exposure to childhood maltreatment-a risk factor for psychosis is associated with paranoia-may impact one's beliefs about the world and how beliefs are updated. We hypothesized that increased exposure to childhood maltreatment is related to volatility-related belief updating, specifically higher expectations of volatility, and that these relationships are strongest for threat-related maltreatment. Additionally, we tested whether belief updating mediates the relationship between maltreatment and paranoia. Belief updating was measured in 75 patients with schizophrenia-spectrum disorders and 76 nonpsychiatric controls using a 3-option probabilistic reversal learning (3PRL) task. A Hierarchical Gaussian Filter (HGF) was used to estimate computational parameters of belief updating, including prior expectations of volatility (μ03). The Childhood Trauma Questionnaire (CTQ) was used to assess cumulative maltreatment, threat, and deprivation exposure. Paranoia was measured using the Positive and Negative Syndrome Scale (PANSS) and the revised Green et al. Paranoid Thoughts Scale (R-GPTS). Greater exposure to childhood maltreatment is associated with higher prior expectations of volatility in the whole sample and in individuals with schizophrenia-spectrum disorders. This was specific to threat-related maltreatment, rather than deprivation, in schizophrenia-spectrum disorders. Paranoia was associated with both exposure to childhood maltreatment and volatility priors, but we did not observe a significant indirect effect of volatility priors on the relationship between maltreatment and paranoia. Our study suggests that individuals with schizophrenia-spectrum disorders who were exposed to threatening experiences during childhood expect their environment to be more volatile, potentially facilitating aberrant belief updating and conferring risk for paranoia.

Behavioral Interventions Can Improve Brain Injury-Induced Deficits in Behavioral Flexibility and Impulsivity Linked to Impaired Reward-Feedback Beta Oscillations.

Traumatic brain injury (TBI) affects a large population, resulting in severe cognitive impairments. Although cognitive rehabilitation is an accepted treatment for some deficits, studies in patients are limited in ability to probe physiological and behavioral mechanisms. Therefore, animal models are needed to optimize strategies. Frontal TBI in a rat model results in robust and replicable cognitive deficits, making this an ideal candidate for investigating various behavioral interventions. In this study, we report three distinct frontal TBI experiments assessing behavior well into the chronic post-injury period using male Long-Evans rats. First, we evaluated the impact of frontal injury on local field potentials recorded simultaneously from 12 brain regions during a probabilistic reversal learning (PbR) task. Next, a set of rats were tested on a similar PbR task or an impulsivity task (differential reinforcement of low-rate behavior [DRL]) and half received salient cues associated with reinforcement contingencies to encourage engagement in the target behavior. After intervention on the PbR task, brains were stained for markers of activity. On the DRL task, cue relevance was decoupled from outcomes to determine if beneficial effects persisted on impulsive behavior. TBI decreased the ability to detect reinforced outcomes; this was evident in task performance and reward-feedback signals occurring at beta frequencies in lateral orbitofrontal cortex (OFC) and associated frontostriatal regions. The behavioral intervention improved flexibility and increased OFC activity. Intervention also reduced impulsivity, even after cues were decoupled, which was partially mediated by improvements in timing behavior. The current study established a platform to begin investigating cognitive rehabilitation in rats and identified a strong role for dysfunctional OFC signaling in probabilistic learning after frontal TBI.

Enhanced cognitive flexibility and phasic striatal dopamine dynamics in a mouse model of low striatal tonic dopamine.

The catecholamine neuromodulators dopamine and norepinephrine are implicated in motor function, motivation, and cognition. Although roles for striatal dopamine in these aspects of behavior are well established, the specific roles for cortical catecholamines in regulating striatal dopamine dynamics and behavior are less clear. We recently showed that elevating cortical dopamine but not norepinephrine suppresses hyperactivity in dopamine transporter knockout (DAT-KO) mice, which have elevated striatal dopamine levels. In contrast, norepinephrine transporter knockout (NET-KO) mice have a phenotype distinct from DAT-KO mice, as they show elevated extracellular cortical catecholamines but reduced baseline striatal dopamine levels. Here we evaluated the consequences of altered catecholamine levels in NET-KO mice on cognitive flexibility and striatal dopamine dynamics. In a probabilistic reversal learning task, NET-KO mice showed enhanced reversal learning, which was consistent with larger phasic dopamine transients (dLight) in the dorsomedial striatum (DMS) during reward delivery and reward omission, compared to WT controls. Selective depletion of dorsal medial prefrontal cortex (mPFC) norepinephrine in WT mice did not alter performance on the reversal learning task but reduced nestlet shredding. Surprisingly, NET-KO mice did not show altered breakpoints in a progressive ratio task, suggesting intact food motivation. Collectively, these studies show novel roles of cortical catecholamines in the regulation of tonic and phasic striatal dopamine dynamics and cognitive flexibility, updating our current views on dopamine regulation and informing future therapeutic strategies to counter multiple psychiatric disorders.

Non-motor symptoms associated with progressive loss of dopaminergic neurons in a mouse model of Parkinson's disease.

Parkinson's disease (PD) is characterized by three main motor symptoms: bradykinesia, rigidity and tremor. PD is also associated with diverse non-motor symptoms that may develop in parallel or precede motor dysfunctions, ranging from autonomic system dysfunctions and impaired sensory perception to cognitive deficits and depression. Here, we examine the role of the progressive loss of dopaminergic transmission in behaviors related to the non-motor symptoms of PD in a mouse model of the disease (the TIF-IADATCreERT2 strain). We found that in the period from 5 to 12 weeks after the induction of a gradual loss of dopaminergic neurons, mild motor symptoms became detectable, including changes in the distance between paws while standing as well as the swing speed and step sequence. Male mutant mice showed no apparent changes in olfactory acuity, no anhedonia-like behaviors, and normal learning in an instrumental task; however, a pronounced increase in the number of operant responses performed was noted. Similarly, female mice with progressive dopaminergic neuron degeneration showed normal learning in the probabilistic reversal learning task and no loss of sweet-taste preference, but again, a robustly higher number of choices were performed in the task. In both males and females, the higher number of instrumental responses did not affect the accuracy or the fraction of rewarded responses. Taken together, these data reveal discrete, dopamine-dependent non-motor symptoms that emerge in the early stages of dopaminergic neuron degeneration.

Different learning aberrations relate to delusion-like beliefs with different contents.

The prediction error account of delusions has had success. However, its explanation of delusions with different contents has been lacking. Persecutory delusions and paranoia are the common unfounded beliefs that others have harmful intentions towards us. Other delusions include believing that one's thoughts or actions are under external control, or that events in the world have specific personal meaning. We compare learning on two different cognitive tasks, probabilistic reversal learning (PRL) and Kamin blocking, that have relationships to paranoid and non-paranoid delusion-like beliefs, respectively. We find that Clinical High-Risk status alone does not result in different behavioral results on the PRL task but that an individual's level of paranoia is associated with excessive switching behavior. During the Kamin blocking task, paranoid individuals learned inappropriately about the blocked cue. However, they also had decreased learning about the control cue, suggesting more general learning impairments. Non-paranoid delusion-like belief conviction (but not paranoia) was associated with aberrant learning about the blocked cue but intact learning about the control cue, suggesting specific impairments in learning related to cue combination. We fit task-specific computational models separately to behavioral data to explore how latent parameters vary within individuals between tasks, and how they can explain symptom-specific effects. We find that paranoia is associated with low learning rates on the PRL task as well as the blocking task. Non-paranoid delusion-like belief conviction was instead related to parameters controlling the degree and direction of similarity between cue updating during simultaneous cue presentation. These results suggest that paranoia and other delusion-like beliefs involve dissociable deficits in learning and belief updating, which - given the transdiagnostic status of paranoia - may have differential utility in predicting psychosis.

Characterisation of behaviours relevant to apathy syndrome in the aged male rat

Apathy is a complex psychiatric syndrome characterised by motivational deficit, emotional blunting and cognitive changes. It occurs alongside a broad range of neurological disorders, but also occurs in otherwise healthy ageing. Despite its clinical prevalence, apathy does not yet have a designated treatment strategy. Generation of a translational animal model of apathy syndrome would facilitate the development of novel treatments. Given the multidimensional nature of apathy, a model cannot be achieved with a single behavioural test. Using a battery of behavioural tests we investigated whether aged rats exhibit behavioural deficits across different domains relevant to apathy. Using the effort for reward and progressive ratio tasks we found that aged male rats (21–27 months) show intact reward motivation. Using the novelty supressed feeding test and position-based object exploration we found aged rats showed increased anxiety-like behaviour inconsistent with emotional blunting. The sucrose preference test and reward learning assay showed intact reward sensitivity and reward-related cognition in aged rats. However, using a bowl-digging version of the probabilistic reversal learning task, we found a deficit in cognitive flexibility in aged rats that did not translate across to a touchscreen version of the task. While these data reveal important changes in cognitive flexibility and anxiety associated with ageing, aged rats do not show deficits across other behavioural domains relevant to apathy. This suggests that aged rats are not a suitable model for age-related apathy syndrome. These findings contrast with previous work in mice, revealing important species differences in behaviours relevant to apathy syndrome in ageing.

Mild exogenous inflammation blunts neural signatures of bounded evidence accumulation and reward prediction error processing in healthy male participants

BackgroundAltered neural haemodynamic activity during decision making and learning has been linked to the effects of inflammation on mood and motivated behaviours. So far, it has been reported that blunted mesolimbic dopamine reward signals are associated with inflammation-induced anhedonia and apathy. Nonetheless, it is still unclear whether inflammation impacts neural activity underpinning decision dynamics. The process of decision making involves integration of noisy evidence from the environment until a critical threshold of evidence is reached. There is growing empirical evidence that such process, which is usually referred to as bounded accumulation of decision evidence, is affected in the context of mental illness. MethodsIn a randomised, placebo-controlled, crossover study, 19 healthy male participants were allocated to placebo and typhoid vaccination. Three to four hours post-injection, participants performed a probabilistic reversal-learning task during functional magnetic resonance imaging. To capture the hidden neurocognitive operations underpinning decision-making, we devised a hybrid sequential sampling and reinforcement learning computational model. We conducted whole brain analyses informed by the modelling results to investigate the effects of inflammation on the efficiency of decision dynamics and reward learning. ResultsWe found that during the decision phase of the task, typhoid vaccination attenuated neural signatures of bounded evidence accumulation in the dorsomedial prefrontal cortex, only for decisions requiring short integration time. Consistent with prior work, we showed that, in the outcome phase, mild acute inflammation blunted the reward prediction error in the bilateral ventral striatum and amygdala. ConclusionsOur study extends current insights into the effects of inflammation on the neural mechanisms of decision making and shows that exogenous inflammation alters neural activity indexing efficiency of evidence integration, as a function of choice discriminability. Moreover, we replicate previous findings that inflammation blunts striatal reward prediction error signals.

Lasting dynamic effects of the psychedelic 2,5-dimethoxy-4-iodoamphetamine ((±)-DOI) on cognitive flexibility.

Psychedelic drugs can aid fast and lasting remission from various neuropsychiatric disorders, though the underlying mechanisms remain unclear. Preclinical studies suggest serotonergic psychedelics enhance neuronal plasticity, but whether neuroplastic changes can also be seen at cognitive and behavioural levels is unexplored. Here we show that a single dose of the psychedelic 2,5-dimethoxy-4-iodoamphetamine ((±)-DOI) affects structural brain plasticity and cognitive flexibility in young adult mice beyond the acute drug experience. Using ex vivo magnetic resonance imaging, we show increased volumes of several sensory and association areas one day after systemic administration of 2 mgkg-1 (±)-DOI. We then demonstrate lasting effects of (±)-DOI on cognitive flexibility in a two-step probabilistic reversal learning task where 2 mgkg-1 (±)-DOI improved the rate of adaptation to a novel reversal in task structure occurring one-week post-treatment. Strikingly, (±)-DOI-treated mice started learning from reward omissions, a unique strategy not typically seen in mice in this task, suggesting heightened sensitivity to previously overlooked cues. Crucially, further experiments revealed that (±)-DOI's effects on cognitive flexibility were contingent on the timing between drug treatment and the novel reversal, as well as on the nature of the intervening experience. (±)-DOI's facilitation of both cognitive adaptation and novel thinking strategies may contribute to the clinical benefits of psychedelic-assisted therapy, particularly in cases of perseverative behaviours and a resistance to change seen in depression, anxiety, or addiction. Furthermore, our findings highlight the crucial role of time-dependent neuroplasticity and the influence of experiential factors in shaping the therapeutic potential of psychedelic interventions for impaired cognitive flexibility.

Prospective associations between cognitive flexibility and eating disorder symptoms in anorexia nervosa and bulimia nervosa

This study investigated concurrent and prospective associations between measures of reversal learning and attentional set-shifting and eating disorder symptoms at baseline, 3 months, and 6 months among individuals with anorexia nervosa restricting subtype (AN-R, n = 26), AN binge eating/purging subtype (AN-BP, n = 22), bulimia nervosa (BN, n = 35), and healthy controls (n = 27), and explored whether these associations differed by diagnosis. At baseline, participants completed diagnostic interviews, height/weight measurements, and measures of set-shifting (the Intradimensional/Extradimensional shift task) and reversal learning (a probabilistic reversal learning task). At 3- and 6-month follow-up, participants with eating disorders completed assessments of weight and eating disorder symptoms. A one-way analysis of variance found no evidence that baseline reversal learning and attentional set-shifting differed across diagnostic groups. Multilevel modeling analyses indicated that perseverative errors (an index of reversal learning) predicted an increase in purging over time for individuals with AN-BP and BN. Set-shifting errors differentially predicted frequency of loss of control eating for individuals with AN-BP and BN; however, set-shifting was not related to loss of control eating when examined separately in AN-BP and BN. These findings suggest that disentangling facets of cognitive flexibility may help understand change in eating disorder symptoms.

Ketamine produces no detectable long-term positive or negative effects on cognitive flexibility or reinforcement learning of male rats.

Patients with major depressive disorder (MDD) often experience abnormalities in behavioral adaptation following environmental changes (i.e., cognitive flexibility) and tend to undervalue positive outcomes but overvalue negative outcomes. The probabilistic reversal learning task (PRL) is used to study these deficits across species and to explore drugs that may have therapeutic value. Selective serotonin-reuptake inhibitors (SSRIs) have limited effectiveness in treating MDD and produce inconsistent effects in non-human versions of the PRL. As such, ketamine, a novel and potentially rapid-acting therapeutic, has begun to be examined using the PRL. Two previous studies examining the effects of ketamine in the PRL have shown conflicting results and only examined short-term effects of ketamine. This experiment examined PRL performance across a 2-week period following a single exposure to a ketamine dose that varied across groups. After five sessions of PRL training, groups of rats received an injection of either 0, 10, 20 or 30 mg/kg ketamine. One-hour post-injection, rats engaged in the PRL, and subsequently sessions continued daily for 2 weeks. Traditional behavioral and computational reinforcement learning-derived measures were examined. Results showed that ketamine had acute effects 1-h post-injection, including a significant decrease in the value of the punishment learning rate. Beyond 1 h, ketamine produced no detectable improvements nor decrements in performance across 2 weeks. Overall, the present results suggest that the range of ketamine doses examined do not have long-term positive or negative effects on cognitive flexibility or reward processing in healthy rats as measured by the PRL.

Compulsivity and Inhibitory Control Deficits in Abstinent Individuals With Heroin Addiction and Their Biological Siblings Compared With Unrelated Healthy Control Participants

BackgroundCompulsivity represents the performance of persistent and repetitive acts despite negative consequences and is considered one of the critical mechanisms for drug addiction. Although compulsivity-related neurocognitive impairments have been linked to addiction, it remains unclear whether these deficits might have predated drug abuse as potential familial susceptibilities. MethodsA large sample of 213 adult participants were recruited, including 70 abstinent individuals addicted to heroin (HAs), 69 unaffected biological siblings of the HAs (siblings), and 74 unrelated healthy control participants. Compulsivity-related neurocognitive functions were evaluated using the intradimensional/extradimensional set-shift task and a probabilistic reversal learning task. Compulsive traits were measured by the Obsessive-Compulsive Inventory-Revised. Inhibitory control was assessed using the stop signal task and Stroop Color and Word Test. Network models for group recognition were conducted using multilayer perceptron neural networks. ResultsData indicated that both HAs and siblings performed worse than healthy control participants on compulsivity-related aspects (i.e., shifting and reversal learning functions) and inhibitory control and had higher levels of self-reported compulsive traits. Furthermore, neural models revealed that a possible 3-facet clustering of neurocognitive deficits was linked to both HAs and siblings. ConclusionsOur findings suggest that deficits in shift reversal and inhibitory control aspects and elevated compulsive traits, shared by HAs and their unaffected siblings, may putatively represent conceivable markers associated with familial vulnerabilities implicated in the development of heroin dependence.

Meta-reinforcement learning via orbitofrontal cortex

The meta-reinforcement learning (meta-RL) framework, which involves RL over multiple timescales, has been successful in training deep RL models that generalize to new environments. It has been hypothesized that the prefrontal cortex may mediate meta-RL in the brain, but the evidence is scarce. Here we show that the orbitofrontal cortex (OFC) mediates meta-RL. We trained mice and deep RL models on a probabilistic reversal learning task across sessions during which they improved their trial-by-trial RL policy through meta-learning. Ca2+/calmodulin-dependent protein kinase II-dependent synaptic plasticity in OFC was necessary for this meta-learning but not for the within-session trial-by-trial RL in experts. After meta-learning, OFC activity robustly encoded value signals, and OFC inactivation impaired the RL behaviors. Longitudinal tracking of OFC activity revealed that meta-learning gradually shapes population value coding to guide the ongoing behavioral policy. Our results indicate that two distinct RL algorithms with distinct neural mechanisms and timescales coexist in OFC to support adaptive decision-making.

Metabolic and functional substrates of impulsive decision-making in individuals with heroin addiction after prolonged methadone maintenance treatment

Elevated impulsivity has been frequently reported in individuals with opioid addiction receiving methadone maintenance therapy (MMT), but the underlying neural mechanisms and cognitive subprocesses are not fully understood. We acquired functional magnetic resonance imaging (fMRI) data from 37 subjects with heroin addiction receiving long-term MMT and 33 healthy controls who performed a probabilistic reversal learning task, and measured their resting-state brain glucose using fluorine-18-fluorodeoxyglucose positron emission tomography (18F-FDG PET). Subjects receiving MMT exhibited significantly elevated self-reported impulsivity, and computational modeling revealed a marked impulsive decision bias manifested as switching more frequently without available evidence. Moreover, this impulsive decision bias was associated with the dose and duration of methadone use, irrelevant to the duration of heroin use. During the task, the switch-related hypoactivation in the left rostral middle frontal gyrus was correlated with the impulsive decision bias while the function of reward sensitivity was intact in subjects receiving MMT. Using prior brain-wide receptor density data, we found that the highest variance of regional metabolic abnormalities was explained by the spatial distribution of μ-opioid receptors among 10 types of neurotransmitter receptors. Heightened impulsivity in individuals receiving prolonged MMT is manifested as atypical choice bias and noise in decision-making processes, which is further driven by deficits in top-down cognitive control, other than reward sensitivity. Our findings uncover multifaceted mechanisms underlying elevated impulsivity in subjects receiving MMT, which might provide insights for developing complementary therapies to improve retention during MMT.

Effects of fentanyl self-administration on risk-taking behavior in male rats.

Individuals with opioid use disorder (OUD) exhibit impaired decisionmaking and elevated risk-taking behavior. In contrast to the effects of natural and semi-synthetic opioids, however, the impact of synthetic opioids on decisionmaking is still unknown. The objective of the current study was to determine how chronic exposure to the synthetic opioid fentanyl alters risk-based decisionmaking in adult male rats. Male rats underwent 14 days of intravenous fentanyl or oral sucrose self-administration. After 3 weeks of abstinence, rats were tested in a decision-making task in which they chose between a small, safe food reward and a large food reward accompanied by variable risk of footshock punishment. Following testing in the decision-making task, rats were tested in control assays that assessed willingness to work for food and shock reactivity. Lastly, rats were tested on a probabilistic reversal learning task to evaluate enduring effects of fentanyl on behavioral flexibility. Relative to rats in the sucrose group, rats in the fentanyl group displayed greater choice of the large, risky reward (risk taking), an effect that was present as long as 7 weeks into abstinence. This increased risktaking was driven by enhanced sensitivity to the large rewards and diminished sensitivity to punishment. The fentanyl-induced elevation in risktaking was not accompanied by alterations in food motivation or shock reactivity or impairments in behavioral flexibility. Results from the current study reveal that the synthetic opioid fentanyl leads to long-lasting increases in risktaking in male rats. Future experiments will extend this work to females and identify neural mechanisms that underlie these drug-induced changes in risktaking.

Importance of additional behavioral observation in psychopharmacology: a case study on agomelatine's effects on feedback sensitivity in probabilistic reversal learning in rats.

Since the second half of the twentieth century, many important discoveries in the field of behavioral psychopharmacology have been made using operant conditioning cages. These cages provide objective data collection and have revolutionized behavioral research. Unfortunately, in the rush towards automation, many mistakes may have been made that could have been avoided by observing experimental animals. The study described in this paper is an excellent example of how important additional behavioral observation can be for interpreting instrumental data. In this study, we evaluated the effects of single injections of 3 different doses of agomelatine (5, 10, and 40 mg/kg) on feedback sensitivity in rats. To this end, we tested 40 animals in the instrumental probabilistic reversal learning task in a Latin square design. The highest applied dose of agomelatine, prima facie, reduced the sensitivity of rats to negative feedback - an effect that can be considered antidepressant. However, additional behavioral observation dramatically changed the interpretation of the results and revealed that the perceived effect of agomelatine on sensitivity to negative feedback can actually be attributed to drug-induced drowsiness.

Postnatal Phencyclidine-Induced Deficits in Decision Making Are Ameliorated by Optogenetic Inhibition of Ventromedial Orbitofrontal Cortical Glutamate Neurons

BackgroundThe orbitofrontal cortex (OFC) is essential for decision making, and functional disruptions within the OFC are evident in schizophrenia. Postnatal phencyclidine (PCP) administration in rats is a neurodevelopmental manipulation that induces schizophrenia-relevant cognitive impairments. We aimed to determine whether manipulating OFC glutamate cell activity could ameliorate postnatal PCP-induced deficits in decision making. MethodsMale and female Wistar rats (n = 110) were administered saline or PCP on postnatal days 7, 9, and 11. In adulthood, we expressed YFP (yellow fluorescent protein) (control), ChR2 (channelrhodopsin-2) (activation), or eNpHR 3.0 (enhanced halorhodopsin) (inhibition) in glutamate neurons within the ventromedial OFC (vmOFC). Rats were tested on the probabilistic reversal learning task once daily for 20 days while we manipulated the activity of vmOFC glutamate cells. Behavioral performance was analyzed using a Q-learning computational model of reinforcement learning. ResultsCompared with saline-treated rats expressing YFP, PCP-treated rats expressing YFP completed fewer reversals, made fewer win-stay responses, and had lower learning rates. We induced similar performance impairments in saline-treated rats by activating vmOFC glutamate cells (ChR2). Strikingly, PCP-induced performance deficits were ameliorated when the activity of vmOFC glutamate cells was inhibited (halorhodopsin). ConclusionsPostnatal PCP-induced deficits in decision making are associated with hyperactivity of vmOFC glutamate cells. Thus, normalizing vmOFC activity may represent a potential therapeutic target for decision-making deficits in patients with schizophrenia.

Perseveration and Shifting in Obsessive-Compulsive Disorder as a Function of Uncertainty, Punishment, and Serotonergic Medication

BackgroundThe nature of cognitive flexibility deficits in obsessive-compulsive disorder (OCD), which historically have been tested with probabilistic reversal learning tasks, remains elusive. Here, a novel deterministic reversal task and inclusion of unmedicated patients in the study sample illuminated the role of fixed versus uncertain rules/contingencies and of serotonergic medication. Additionally, our understanding of probabilistic reversal was enhanced through theoretical computational modeling of cognitive flexibility in OCD. MethodsWe recruited 49 patients with OCD, 21 of whom were unmedicated, and 43 healthy control participants matched for age, IQ, and gender. Participants were tested on 2 tasks: a novel visuomotor deterministic reversal learning task with 3 reversals (feedback rewarding/punishing/neutral) measuring accuracy/perseveration and a 2-choice visual probabilistic reversal learning task with uncertain feedback and a single reversal measuring win-stay and lose-shift. Bayesian computational modeling provided measures of learning rate, reinforcement sensitivity, and stimulus stickiness. ResultsUnmedicated patients with OCD were impaired on the deterministic reversal task under punishment only at the first and third reversals compared with both control participants and medicated patients with OCD, who had no deficit. Perseverative errors were correlated with OCD severity. On the probabilistic reversal task, unmedicated patients were only impaired at reversal, whereas medicated patients were impaired at both the learning and reversal stages. Computational modeling showed that the overall change was reduced feedback sensitivity in both OCD groups. ConclusionsBoth perseveration and increased shifting can be observed in OCD, depending on test conditions including the predictability of reinforcement. Perseveration was related to clinical severity and remediated by serotonergic medication.

Explaining reversal learning deficits in anxiety with electrophysiological evidence

Reversal learning is a crucial aspect of behavioral flexibility that plays a significant role in environmental adaptation and development. While previous studies have established a link between anxiety and impaired reversal learning ability, the underlying mechanisms behind this association remain unclear. This study employed a probabilistic reversal learning task with electroencephalographic recording to investigate these mechanisms. Participants were divided into two groups based on their scores on Spielberger's State-Trait Anxiety Inventory: high trait-anxiety (HTA) and low trait-anxiety (LTA), consisting of 50 individuals in each group. The results showed that the HTA group had poorer reversal learning performance than the LTA group, including a lower tendency to shift to the new optimal option after rule reversals (reversal-shift). The study also examined event-related potentials elicited by reversals and found that although the N1 (related to attention allocation), feedback-related negativity (FRN: related to belief updating), and P3 (related to response inhibition) were all sensitive to the grouping factor, only the FRN elicited by reversal-shift mediated the relationship between anxiety and the number/reaction time of reversal-shift. From these findings, we suggest that abnormalities in belief updating may contribute to the impaired reversal learning performance observed in anxious individuals. In our opinion, this study sheds light on potential targets for interventions aimed at improving behavioral flexibility in anxious individuals.

Assumed shared belief about conspiracy theories in social networks protects paranoid individuals against distress

Paranoia is the belief that others intend you harm. It is related to conspiracy theories, wherein those others represent an organized faction, coordinating the harm against self and others, and violating societal norms. Current psychological studies of paranoid conspiracy theorizing focus either on the individual or their broader social network. Likewise, theories of belief formation and updating often contain individual level processes as well as broader interpersonal and organizational factors. Here we examine paranoia and conspiracy theorizing in terms of individual behavioral predictors (performance on a probabilistic reversal learning task which assays belief updating) as well as social sensing: we ask participants to report the features of their social network, including whether their friends and acquaintances share their paranoid conspiratorial beliefs. We find that people who believe paranoid conspiracy theories expect more volatility during the task. They also assume that members of their social network share their paranoid beliefs. Critically, those participants with larger social networks and greater assumed shared belief tend to harbor their conspiratorial beliefs with less emotional distress and expect less volatility in the task. This is evidence that, like political and religious beliefs, conspiracy theories may flourish under a sacred canopy of belief consensus. These data suggest that friends and acquaintances may serve as sources of credulity and moving between them may sustain conspiracy beliefs when there is detraction. This hybrid individual/social account may shed light on clinical paranoia and persecutory delusion, wherein disability is defined normatively, and social supports are fewer.

Aberrant uncertainty processing is linked to psychotic-like experiences, autistic traits, and is reflected in pupil dilation during probabilistic learning

Aberrant belief updating due to misestimation of uncertainty and an increased perception of the world as volatile (i.e., unstable) has been found in autism and psychotic disorders. Pupil dilation tracks events that warrant belief updating, likely reflecting the adjustment of neural gain. However, whether subclinical autistic or psychotic symptoms affect this adjustment and how they relate to learning in volatile environments remains to be unraveled. We investigated the relationship between behavioral and pupillometric markers of subjective volatility (i.e., experience of the world as unstable), autistic traits, and psychotic-like experiences in 52 neurotypical adults with a probabilistic reversal learning task. Computational modeling revealed that participants with higher psychotic-like experience scores overestimated volatility in low-volatile task periods. This was not the case for participants scoring high on autistic-like traits, who instead showed a diminished adaptation of choice-switching behavior in response to risk. Pupillometric data indicated that individuals with higher autistic- or psychotic-like trait and experience scores differentiated less between events that warrant belief updating and those that do not when volatility was high. These findings are in line with misestimation of uncertainty accounts of psychosis and autism spectrum disorders and indicate that aberrancies are already present at the subclinical level.