Reinforcement Contingencies Research Articles

Correspondence between preference for and efficacy of behavioral interventions: A systematic review.

Understanding of the correspondence between intervention preference and efficacy is limited. We systematically reviewed 112 articles (457 cases) evaluating efficacy of and preference for behavioral interventions. We analyzed the percentage of cases for whom interventions were preferred and efficacious across broad (e.g., behavior reduction, performance, skill acquisition) and specific (e.g., noncontingent reinforcement, video modeling) intervention types. Authors reported one preferred intervention for most cases. Regarding efficacy, authors reported about half of cases as having one efficacious intervention and the other half having multiple equally efficacious interventions. The same intervention was preferred and efficacious for 74% of cases for whom authors reported one preferred and one efficacious intervention. Several specific interventions were generally preferred and efficacious across cases (e.g., digital stimuli, computer-based instruction, accumulated reinforcement, contingent reinforcement). We discuss clinical recommendations, the importance of assessing preference, and the need for research in developing protocols for assessing intervention preference.

Utilizing Reinforcement Contingencies to Enhance Behavioral Outcomes in Incarcerated Youth: Roles of Behavior Management and Staff Interactions in Reducing Readmission

Long-term placement could be stressful for youth, who may exhibit problem behaviors such as non-compliance in facilities. This study demonstrates that the consistent involvement of staff in modifying the youths’ behaviors, through a reward system featuring plus points and minus points as responses to particular behaviors, significantly influenced the likelihood of readmission. Furthermore, the research revealed that post-release contact with staff lowered the risk of readmission for non-student youths, highlighting the supportive staff-youth relationships in mitigating recidivism, particularly for the majority of youths detached from educational systems. These findings emphasize the importance of reinforcement and supportive interactions within youth corrections.

Blending Staff Preference Assessments and Contingent Reinforcement to Enhance Data Collection in a Residential Facility for Adults with Severe Aggressive Behavior

Blending Staff Preference Assessments and Contingent Reinforcement to Enhance Data Collection in a Residential Facility for Adults with Severe Aggressive Behavior

A point contingency increased webcam usage in a university classroom

The use of online instruction has increased substantially in the last few years. An important aspect of remote instruction that has received some attention via survey-based research is student webcam usage. There are few empirical strategies to increase students’ webcam usage. In the present study, we replicated a prior study by providing students with points contingent on webcam usage during remote college instruction. An alternating treatments design was used to assess the influence of the contingent point delivery on webcam usage. Twenty-four undergraduate students in a psychology course participated. The contingency enhanced webcam usage and the points served as effective reinforcers. A simple reinforcement contingency can improve webcam usage in a college classroom, but outcomes can likely be enhanced by including additional antecedent operations.

Using Drift Diffusion and RL Models to Disentangle Effects of Depression On Decision-Making vs. Learning in the Probabilistic Reward Task.

The Probabilistic Reward Task (PRT) is widely used to investigate the impact of Major Depressive Disorder (MDD) on reinforcement learning (RL), and recent studies have used it to provide insight into decision-making mechanisms affected by MDD. The current project used PRT data from unmedicated, treatment-seeking adults with MDD to extend these efforts by: (1) providing a more detailed analysis of standard PRT metrics-response bias and discriminability-to better understand how the task is performed; (2) analyzing the data with two computational models and providing psychometric analyses of both; and (3) determining whether response bias, discriminability, or model parameters predicted responses to treatment with placebo or the atypical antidepressant bupropion. Analysis of standard metrics replicated recent work by demonstrating a dependency between response bias and response time (RT), and by showing that reward totals in the PRT are governed by discriminability. Behavior was well-captured by the Hierarchical Drift Diffusion Model (HDDM), which models decision-making processes; the HDDM showed excellent internal consistency and acceptable retest reliability. A separate "belief" model reproduced the evolution of response bias over time better than the HDDM, but its psychometric properties were weaker. Finally, the predictive utility of the PRT was limited by small samples; nevertheless, depressed adults who responded to bupropion showed larger pre-treatment starting point biases in the HDDM than non-responders, indicating greater sensitivity to the PRT's asymmetric reinforcement contingencies. Together, these findings enhance our understanding of reward and decision-making mechanisms that are implicated in MDD and probed by the PRT.

Behavioral Interventions Can Improve Brain Injury-Induced Deficits in Behavioral Flexibility and Impulsivity Linked to Impaired Reward-Feedback Beta Oscillations.

Traumatic brain injury (TBI) affects a large population, resulting in severe cognitive impairments. Although cognitive rehabilitation is an accepted treatment for some deficits, studies in patients are limited in ability to probe physiological and behavioral mechanisms. Therefore, animal models are needed to optimize strategies. Frontal TBI in a rat model results in robust and replicable cognitive deficits, making this an ideal candidate for investigating various behavioral interventions. In this study, we report three distinct frontal TBI experiments assessing behavior well into the chronic post-injury period using male Long-Evans rats. First, we evaluated the impact of frontal injury on local field potentials recorded simultaneously from 12 brain regions during a probabilistic reversal learning (PbR) task. Next, a set of rats were tested on a similar PbR task or an impulsivity task (differential reinforcement of low-rate behavior [DRL]) and half received salient cues associated with reinforcement contingencies to encourage engagement in the target behavior. After intervention on the PbR task, brains were stained for markers of activity. On the DRL task, cue relevance was decoupled from outcomes to determine if beneficial effects persisted on impulsive behavior. TBI decreased the ability to detect reinforced outcomes; this was evident in task performance and reward-feedback signals occurring at beta frequencies in lateral orbitofrontal cortex (OFC) and associated frontostriatal regions. The behavioral intervention improved flexibility and increased OFC activity. Intervention also reduced impulsivity, even after cues were decoupled, which was partially mediated by improvements in timing behavior. The current study established a platform to begin investigating cognitive rehabilitation in rats and identified a strong role for dysfunctional OFC signaling in probabilistic learning after frontal TBI.

Dopaminergic lesions of the anterior cingulate cortex of rats increase vulnerability to salient distractors.

The anterior cingulate cortex (ACC) has been shown to be critical to many aspects of executive function including filtering irrelevant information, updating response contingencies when reinforcement contingencies change and stabilizing task sets. Nonspecific lesions to this region in rats produce a vulnerability to distractors that have gained salience through prior associations with reinforcement. These lesions also exacerbate cognitive fatigue in tests of sustained attention but do not produce global attentional impairments nor do they produce distractibility to novel distractors that do not have a prior association with reinforcement. To determine the neurochemical basis of these cognitive impairments, dopaminergically selective lesions of the ACC were made in both male and female Long-Evans, hooded rats prior to assessment in two attentional tasks. Dopaminergic lesions of the ACC increase the vulnerability of subjects to previously reinforced distractors and impede formation of an attentional set. Lesioned rats were not more susceptible to the effects of novel, irrelevant stimuli in a test of sustained attention as has been previously shown. Additionally, the effects of dopaminergic lesions were found to differ based on sex. Lesioned female, but not male, rats were more vulnerable than sham-lesioned females to the effects of prolonged testing and the removal of reinforcement during a test of sustained attention. Together, these data support the hypothesis that dopamine in the ACC is critical to filtering distractors whose salience has been gained through reinforcement.

Influence of reinforcement and its omission on trial-by-trial changes of response bias in perceptual decision making.

Discrimination performance in perceptual choice tasks is known to reflect both sensory discriminability and nonsensory response bias. In the framework of signal detection theory, these aspects of discrimination performance are quantified through separate measures, sensitivity (d') for sensory discriminability and decision criterion (c) for response bias. However, it is unknown how response bias (i.e., criterion) changes at the single-trial level as a consequence of reinforcement history. We subjected rats to a two-stimulus two-response conditional discrimination task with auditory stimuli and induced response bias through unequal reinforcement probabilities for the two responses. We compared three signal-detection-theory-based criterion learning models with respect to their ability to fit experimentally observed fluctuations of response bias on a trial-by-trial level. These models shift the criterion by a fixed step (1) after each reinforced response or (2) after each nonreinforced response or (3) after both. We find that all three models fail to capture essential aspects of the data. Prompted by the observation that steady-state criterion values conformed well to a behavioral model of signal detection based on the generalized matching law, we constructed a trial-based version of this model and find that it provides a superior account of response bias fluctuations under changing reinforcement contingencies.

Relationship between opioid cross-tolerance during buprenorphine stabilization and return to opioid use during buprenorphine dose tapering.

Opioid injection drug use (IDU) has been linked to a more severe pattern of use (e.g. tolerance, overdose risk) and shorter retention in treatment, which may undermine abstinence attempts. This secondary data analysis of four human laboratory studies investigated whether current opioid IDU modulates subjective abuse liability responses to high-dose hydromorphone during intermediate-dose buprenorphine stabilization (designed to suppress withdrawal but allow surmountable agonist effects), and whether hydromorphone response magnitude predicts latency of return to opioid use during buprenorphine dose-tapering. Regular heroin users not currently seeking treatment (n = 54; 29 current injectors, 25 non-injectors) were stabilized on 8-mg/day sublingual buprenorphine and assessed for subjective responses (e.g. 'liking', craving) to hydromorphone 24-mg intramuscular challenge (administered 16-hr post-buprenorphine) under randomized, double-blinded, controlled conditions. A subgroup (n = 35) subsequently completed a standardized 3-week outpatient buprenorphine dose-taper, paired with opioid-abstinent contingent reinforcement, and were assessed for return to opioid use based on thrice-weekly urinalysis and self-report. During buprenorphine stabilization, IDU reported lower 'liking' of buprenorphine and post-hydromorphone peak 'liking', 'good effect' and 'high' compared to non-IDU. Less hydromorphone peak increase-from-baseline in 'liking' (which correlated with less hydromorphone-induced craving suppression) predicted significantly faster return to opioid use during buprenorphine dose-tapering. In these buprenorphine-stabilized regular heroin users, IDU is associated with attenuated 'liking' response (more cross-tolerance) to buprenorphine and to high-dose hydromorphone challenge and, in turn, this cross-tolerance (but not IDU) predicts faster return to opioid use. Further research should examine mechanisms that link cross-tolerance to treatment response.

Cognitive-Enhancing Effects of Acetylcholine Receptor Agonists in Group-Housed Cynomolgus Monkeys Who Drink Ethanol.

The cognitive impairments that are often observed in patients with alcohol use disorder (AUD) partially contribute to the extremely low rates of treatment initiation and adherence. Brain acetylcholine receptors (AChR) mediate and modulate cognitive and reward-related behavior, and their distribution can be altered by long-term heavy drinking. Therefore, AChRs are promising pharmacotherapeutic targets for treating the cognitive symptoms of AUD. In the present study, the procognitive efficacy of two AChR agonists, xanomeline and varenicline, were evaluated in group-housed monkeys who self-administered ethanol for more than 1 year. The muscarinic AChR antagonist scopolamine was used to disrupt performance of a serial stimulus discrimination and reversal (SDR) task designed to probe cognitive flexibility, defined as the ability to modify a previously learned behavior in response to a change in reinforcement contingencies. The ability of xanomeline and varenicline to remediate the disruptive effects of scopolamine was compared between socially dominant and subordinate monkeys, with lighter and heavier drinking histories, respectively. We hypothesized that subordinate monkeys would be more sensitive to all three drugs. Scopolamine dose-dependently impaired performance on the serial SDR task in all monkeys at doses lower than those that produced nonspecific impairments (e.g., sedation); its potency did not differ between dominant and subordinate monkeys. However, both AChR agonists were effective in remediating the scopolamine-induced deficit in subordinate monkeys but not in dominant monkeys. These findings suggest xanomeline and varenicline may be effective for enhancing cognitive flexibility in individuals with a history of heavy drinking. SIGNIFICANCE STATEMENT: Procognitive effects of two acetylcholine (ACh) receptor agonists were assessed in group-housed monkeys who had several years' experience drinking ethanol. The muscarinic ACh receptor agonist xanomeline and the nicotinic ACh receptor agonist varenicline reversed a cognitive deficit induced by the muscarinic ACh receptor antagonist scopolamine. However, this effect was observed only in lower-ranking (subordinate) monkeys and not higher-ranking (dominant monkeys). Results suggest that ACh agonists may effectively remediate alcohol-induced cognitive deficits in a subpopulation of those with alcohol use disorder.

A preliminary investigation of eye-tracking software to inform an ABA renewal mitigation procedure

ABA renewal is one type of operant renewal in which a target response is reinforced in a unique context (i.e., Context A), extinguished in novel context (i.e., Context B), and then recurs following a transition back to the original context. Recently, researchers have examined the robust phenomenon of ABA renewal when differential reinforcement of an alternative response is included in Context B and the renewal test. One method to mitigate ABA renewal is to program common stimuli so as to increase the similarity between Context A and Context B. This stimulus control strategy may support the generalization of behavior change between contexts. Currently, no studies exist on how to empirically derive the selection of the stimuli to program into Context B. We conducted a preliminary investigation using eye-tracking software to empirically determine which common stimulus to program into a three-phase ABA renewal arrangement that included differential reinforcement for 12 undergraduate students in a translational preparation. Our results replicate previous research demonstrating ABA renewal despite differential reinforcement contingencies. Further, ABA renewal may be less robust and more variable when common stimuli selected for programming are empirically determined using eye-tracking software.

An experimental analysis of task refusal: A comparison of negative reinforcement contingencies and transitions between academic tasks

AbstractThe purpose of the study was to do an experimental analysis of academic task refusal for one girl with a developmental disability. Task refusal was analyzed in two experimental analyses. First, an analysis testing if the behavior was maintained by negative reinforcement, and the second, an analysis testing if the behavior was the result of transitioning between academic tasks differing in preference. Task refusal did not occur in the demand condition of the functional analysis, indicating that the behavior was not maintained by escape from demands. Conversely, task refusal occurred solely in the second experimental analysis when transitioning from a high‐preferred to a low‐preferred academic task. In this case, the context of terminating a preferred academic task and transitioning to a less preferred academic task was aversive but not the demand itself. In addition, when an embedded break condition was compared to a no break condition in a multielement design, task refusal was reduced to zero levels.

Giving time a chance in the midsession reversal task.

The midsession reversal task involves a simultaneous discrimination between stimuli S1 and S2. Choice of S1 but not S2 is reinforced during the first 40 trials, and choice of S2 but not S1 is reinforced during the last 40 trials. Trials are separated by a constant intertrial interval (ITI). Pigeons learn the task seemingly by timing the moment of the reversal trial. Hence, most of their errors occur around trial 40 (S2 choices before trial 41 and S1 choices after trial 40). It has been found that when the ITI is doubled on a test session, the reversal trial is halved, a result consistent with timing. However, inconsistent with timing, halving the ITI on a test session did not double the reversal trial. The asymmetry of ITI effects could be due to the intrusion of novel cues during testing, cues that preempt the timing cue. To test this hypothesis, we ran two types of tests after the regular training in the midsession reversal task, one with S1 and S2 choices always reinforced, and another with S1 always reinforced but S2 reinforced only after 20 trials when the ITI doubled or 40 trials when the ITI halved. For most pigeons, performance was consistent with timing both when the ITI doubled and when it was halved, but some pigeons appeared to follow strategies based on counting or on reinforcement contingencies.

How expected and experienced reward and relief contribute to gaming-related mental imagery and gaming frequency in daily life: Testing a dual pathway hypothesis

AbstractBackground and aimsResearch on the development of gaming disorder assumes that the quality of reinforcement learning as well as the content of use expectancies are initially rewarding in the early stages of the addictive behavior and becomes steadily more compensatory in the later stages. This assumed transition could be reflected in gaming-related mental imagery as well as the decision to play videogames in daily life.MethodsWe recruited 127 individuals who play videogames. Following a strict diagnostic procedure, individuals were either classified as showing casual or at-risk gaming patterns. The experience and expectancy of reward and relief were assessed in the laboratory, followed by a 14-day ambulatory assessment asking for gaming-related mental imagery intensity and playing frequency. Besides group differences, we tested a gratification and a compensation pathway in a structural equation model among groups separately.ResultsResults indicate that mental imagery and playing frequency as well as reinforcement processes and use expectancies are heightened among individuals showing at-risk gaming patterns as compared to casual gaming patterns. Gaming-related mental imagery was only predicted by compensation among individuals showing casual gaming patterns, and we found no significant predictions for daily gaming frequency in any of the models.Discussion and conclusionsThe results implicate that individuals with at-risk gaming patterns might hold stronger learned reinforcement contingencies. Daily usage seems unaffected by these contingencies, possibly indicative of habitualized behaviors. Additionally, the results provide some support for the consideration of imaginal desire thoughts as a specific coping mechanism in the context of gaming behaviors.

Impact of Behavior Modification on Female Campers’ Physical Activity in Summer Camp

In order to combat rampant health and wellness deterioration over the summer months, residential summer camps have been presented as a possible solution to thwart such declines in overall health and wellbeing. The purpose of this study was to determine the differential effects of prompting, and prompting combined with reinforcement on female campers’ step counts at a residential summer camp. The participants in this study were 104 female campers (Mage = 13.71), all attending the same residential summer camp. An alternating treatment design was implemented to evaluate campers’ daily physical activity across three conditions (baseline, prompting, and prompting combined with contingent reinforcement) throughout the duration of the 51 days camp experience. In accordance with standard Applied Behavior Analysis research, data were plotted graphically in order to employ visual analysis to determine functional relationships between the intervention (prompting only, prompting plus group contingency, and target behavior [step count]). Results of this study indicate that prompting with group contingencies (29%) and without (13%) successfully led to an increased amount of daily physical activity. Further, small variance within the group contingency group illustrates the breadth of success for this technique. This is the first comprehensive intervention focused primarily on influencing female campers’ physical activity levels in the residential camp context and demonstrates a cost-effective strategy for improving activity among female campers.

Instructing via relations: Function transformations of response and consequence functions of upcoming contingencies

One part of the relational frame theory account of rule-governed behavior is relational responses between elements of a rule and the behavioral and consequential components of the upcoming contingency. This study reports two experiments that used a novel task designed to exert contextual control over relational responses involving components of upcoming reinforcement contingencies. The task presents participants with a series of choices between bubble-clicking tasks. Each trial begins by illustrating the number of bubbles to be clicked and points that may be earned for completing a source task, and presents Crel and Cfunc stimuli to indicate how the task options differ from this task in terms of the number of bubbles to be clicked and the amount of points that may be earned. Experiment 1 exposed participants to a version of the task employing natural language Crels and Cfuncs, and task performances were in line with experimenter expectations. Experiment 2 employed the task to establish Crel and Cfunc functions for novel stimuli, and investigated the impact of post-choice feedback on the development of these functions. Results indicated that the task can establish Crel and Cfunc functions for novel stimuli effectively and provides a means for investigating transformations of functions involving components of contingencies.

Application of the evolutionary theory of behavior dynamics to severe challenging behavior.

The evolutionary theory of behavior dynamics (ETBD) is a genetic algorithm that applies the Darwinian principles of evolutionary biology to model how behavior changes dynamically via selection by contingencies of reinforcement. The ETBD is a complexity theory where low-level rules of selection, reproduction, and mutation operate iteratively to animate "artificial organisms" that generate emergent outcomes. Numerous studies have demonstrated the ETBD can accurately model behavior of live animals in the laboratory, and it has been applied recently to model automatically maintained self-injury. The purpose of the current series of studies was to further extend the application of the ETBD to model additional functional classes of challenging behavior and clinical procedures. Outcomes obtained with artificial organisms generally corresponded well with outcomes observed with clinical cases sourced from consecutive controlled case series studies. Conceptual and methodological considerations on the application of the ETBD to model challenging behavior are discussed.

Merging OBM with Discipline Systems: Making the Case for Performance Recovery

ABSTRACT Too often management attempts to control employee behavior by threats and punishment. Behavior analysis eschews aversive control and organizational behavior management (OBM) exemplifies this philosophical and ethical preference with a rich history of reinforcement strategies for appropriate work performance. Discipline in OBM emphasizes clarification of job requirements, monitoring behavior and results, frequent feedback, and maximizing short-, medium-, and long-term contingencies of reinforcement for effective performance, thus preventing additional problematic behaviors from employees. This results in efficient supervision that promotes employee development leading to successful worker performance and strategic goals for the organization. However, dangerous or inappropriate work behaviors necessitate punitive consequences. Well controlled evidence-based research concerning punishment in organizational settings is lacking and possible benefits are unknown.

In Memoriam: Peter J. Urcuioli (1952-2022).

In Memoriam: Peter J. Urcuioli (1952-2022).

Do contingency-conflicting elements drop out of equivalence classes? Retesting Sidman's (2000) theory.

Sidman's (2000) theory of stimulus equivalence states that all positive elements in a reinforcement contingency enter an equivalence class. The theory also states that if an element from an equivalence class conflicts with a reinforcement contingency, the conflicting element will "drop out" of the class. Minster et al. (2006) found evidence that a conflicting reinforcer does not drop out of an equivalence class. To explain their results, they proposed that the reinforcer enters the class via pairing after conditional relations have been established, and when there is a conflict between the class and the contingencies, conditionally related elements that have a longer history in the class and that were brought in via reinforcement will exert stronger control. In the current study, stimulus-reinforcer relations were established before conditional relations to assess the role of developmental order of stimulus relations on conditional-discrimination performance. The results replicate the findings of Minster et al. (2006) but suggest that developmental order may not be an important factor contributing to maintained accuracy on baseline conditional relations. An interpretation of "dropping out" in terms of differentiated subclasses is discussed. The relevance of the results to the phenomenon known as the differential outcomes effect is also discussed.