Fixed-interval Schedule Research Articles

The paradoxical performance by different species on the ephemeral reward task.

The ephemeral reward task consists of giving an animal a choice between two distinctive stimuli, A and B (e.g., black and white), on each of which is placed a bit of food. If the animal chooses the food on A, it gets that reinforcer, but the other stimulus, B, is removed, and the trial is over. If it chooses the food on B, however, it gets that food and the stimulus A remains, so it can have that food as well. Thus, choice of stimulus B gives the animal two reinforcers rather than one. Wrasse (cleaner fish) easily learn to choose optimally, whereas surprisingly, most non-human primates do not. Parrots, however, appear to learn this task as easily as the fish. To test the hypothesis that animals that choose with their mouth can learn it, we tested pigeons and found that they show no evidence of optimal learning with this task (with either the manual presentation of the stimuli or the operant presentation of the stimuli). Similarly, rats show no evidence of optimal learning. However, if a 20-s delay (fixed-interval schedule) is inserted between stimulus choice and reinforcement, both pigeons and rats learn to perform optimally. The ephemeral reward task appears to promote impulsive choice in several species, but with this task (and others), inserting a delay between choice and reinforcement promotes more careful choice, leading to optimal performance.

Conceptualizing Fixed-Interval Praise Delivery

This article provides a conceptual framework for using fixed-interval praise delivery in the educational setting. Fixed-interval praise delivery can be conceptualized as an antecedent-based strategy that disrupts the natural behavior to contingency relationship in a four-term contingency model (Establishing operation–Antecedent–Behavior–Consequence). Historically, teachers are trained to deliver praise as a consequence-based practice (i.e., contingently). This article describes how teachers can also use praise on a fixed interval as an antecedent-based practice. When praise is delivered on a fixed-interval schedule, educators directly manipulate the level of praise delivered to maintain or increase appropriate student behavior. Using praise as an antecedent-based strategy has the potential to establish and maintain high-quality student–teacher relationships, which positively impacts student behavior. Practical, applied examples and discussion of fixed-interval praise delivery are provided.

Lineage- and Sex-Dependent Behavioral and Biochemical Transgenerational Consequences of Developmental Exposure to Lead, Prenatal Stress, and Combined Lead and Prenatal Stress in Mice.

Background:Lead (Pb) exposure and prenatal stress (PS) during development are co-occurring risk factors with shared biological substrates. PS has been associated with transgenerational passage of altered behavioral phenotypes, whereas the transgenerational behavioral or biochemical consequences of Pb exposure, and modification of any such effects by PS, is unknown.Objectives:The present study sought to determine whether Pb, PS, or combined Pb and PS exposures produced adverse transgenerational consequences on brain and behavior.Methods:Maternal Pb and PS exposures were carried out in F0 mice. Outside breeders were used at each subsequent breeding, producing four F1-F2 lineages: [F1 female-F2 female (FF), FM (male), MF, and MM]. F3 offspring were generated from each of these lineages and examined for outcomes previously found to be altered by Pb, PS, or combined Pb and PS in F1 offspring: behavioral performance [fixed-interval (FI) schedule of food reward, locomotor activity, and anxiety-like behavior], dopamine function [striatal expression of tyrosine hydroxylase (Th)], glucocorticoid receptor (GR) and plasma corticosterone, as well as brain-derived neurotrophic factor (BDNF) and total percent DNA methylation of Th and Bdnf genes in the frontal cortex and hippocampus.Results:Maternal F0 Pb exposure produced runting in F3 offspring. Considered across lineages, F3 females exhibited Pb-related alterations in behavior, striatal BDNF levels, frontal cortical Th total percentage DNA methylation levels and serum corticosterone levels, whereas F3 males showed Pb- and PS-related alterations in behavior and total percent DNA methylation of hippocampal Bdnf. However, numerous lineage-specific effects were observed, most of greater magnitude than those observed across lineages, with outcomes differing by F3 sex.Discussion:These findings support the possibility that exposures of previous generations to Pb or PS may influence the brain and behavior of future generations. Observed changes were sex-dependent, with F3 females showing multiple changes through Pb-exposed lineages. Lineage effects may occur through maternal responses to pregnancy, altered maternal behavior, epigenetic modifications, or a combination of mechanisms, but they have significant public health ramifications regardless of mechanism. https://doi.org/10.1289/EHP4977

Temporal regularity and stimulus control in multiple fixed interval schedules

In multiple fixed interval schedules of reinforcement, different time intervals are signaled by different environmental stimuli which acquire control over behavior. Previous work has shown that temporal performance is controlled not only by external stimuli but also by temporal aspects of the task, depending on the order in which the different intervals are trained – intermixed across trials or in blocks of several trials. The aim of this study was to further describe the training conditions under which the stimuli acquire control over temporal performance. We manipulated the number of consecutive trials of each fixed interval (FI) per training block (Experiment I) and the number of FIs trained (Experiment II). The results suggest that when trained in blocks of several consecutive trials of the same FI, temporal performance is controlled by temporal regularities across trials and not by the visual stimuli that signal the FIs. One possible account for those data is that the temporal cues overshadow the visual stimuli for the control of temporal performance. Similar results have also been observed with humans, which suggest that temporal regularity overcomes the stimuli in the control of behavior in temporal tasks across species.

TRANSITIONS FROM RICH-TO-LEAN SCHEDULES INCREASE ATTACK IN A LABORATORY MODEL OF SOCIAL AGGRESSION IN PIGEONS: II. FIXED-INTERVAL SCHEDULES.

Pigeons key pecked under two-component multiple fixed-interval (FI) schedules. Each component provided a different reinforcer magnitude (small or large), signaled by the color of the key light. Attacks toward a live, protected target pigeon were measured. Large- (rich) and small- (lean) reinforcer components alternated irregularly such that four different interval types (transitions) between the size of the immediately preceding reinforcer and the size of the upcoming reinforcer occurred within each session: lean-to-lean, lean-to-rich, rich-to-lean, and rich-torich transitions. The FI for each component was the same within each phase, but was manipulated across phases. For all pigeons, more attack occurred following the presentations of the larger reinforcer (i.e., during rich-to-lean and rich-to-rich transitions). For 2 of the 3 pigeons, this effect was modulated by the size of the upcoming reinforcer; attack following larger reinforcers was elevated when the upcoming reinforcer was small (i.e., during rich-to-lean transitions). This rich-to-lean effect on attack diminished or disappeared as the length of the FI schedule was increased (i.e., control over attack by the upcoming reinforcer size diminished with increases in the inter-reinforcement interval). For all pigeons and at all FIs, however, postreinforcement pauses were longest during the rich-to-lean transitions. These data (1) are consistent with the notion that postreinforcement periods during intermittent schedules function aversively and, thus, can precipitate aggressive behavior, and (2) suggest that rich-to-lean conditions may be especially aversive. They also indicate, however, that aversive effects of rich-to-lean transitions may differ across fixed-ratio (FR) and FI schedules, and that variables controlling attacking and pausing may not be isomorphic between these different schedule types.

Ovarian Hormones Mediate Changes in Adaptive Choice and Motivation in Female Rats.

In female rodents, sexual receptivity is coordinated with cyclic changes in the release of gonadal hormones. Increases in estradiol (E) and progesterone (P) during proestrus and estrus not only induce ovulation but also modulate behaviors that increase the likelihood that the female will find a mate and reproduce. This includes changes in receptive behaviors, such as lordosis, as well as changes in appetitive or proceptive behaviors, including motivation. Interestingly, the direction of these changes in motivation is dependent on the type of reward that is being pursued. While induction of sexual receptivity by E and P increases motivation for access to a male, motivation for a palatable food reward is decreased. These concurrent changes may facilitate adaptive choice across the estrous cycle; females bias their choice for sex when fertilization is most likely to occur, but for food when copulation is unlikely to result in impregnation. In order to test this hypothesis, we developed a novel paradigm to measure the motivated choice between a palatable food reward and access to a male conspecific. Ovariectomized, hormone primed females were trained to operantly respond for both food and sex on a fixed interval (FI) schedule. After training, unprimed and primed females were tested in a chamber that allows them to choose between food and sex while still requiring responding on the FI schedule for reach reward. From this we can not only determine the impact of hormone priming on female choice for food or sex, but also how this is reflected by changes in motivation for each specific reward, as measured by the average number of responses made during each fixed interval. Induction of sexual receptivity by hormone priming biases choice toward sex over food and this change is accompanied by an increase in motivation for sex but a decrease in motivation for food. This work provides evidence in support of a novel framework for understanding how the release of ovarian hormones over the course of the estrous cycle modulates adaptive behavioral choice in females by directly assessing motivation via operant responding when multiple rewards are available.

Reversing Breathing Paralysis through Optimization of Intermittent Hypoxia Treatment after Cervical Spinal Cord Injury

Spinal cord injury (SCI) most commonly occurs at the cervical level and can interrupt descending neural pathways, causing paralysis of the diaphragm, as well as profound breathing motor difficulties which threaten survival and greatly decrease quality of life. Intermittent hypoxia (IH) treatment is often utilized in preclinical models to attenuate breathing motor deficits resulting from cervical SCI by inducing a prolonged increase in respiratory motor output known as long term facilitation (LTF), a form of breathing motor plasticity. IH typically consists of the repeated, alternating exposure of a subject to consistent and equal 5‐minute periods of hypoxia and normoxia and thus can be fittingly termed fixed interval intermittent hypoxia (FIH). FIH exhibits similarity to the psychological construct of operant conditioning in which the increased incidence and persistence of a desired, spontaneous behavior is trained through reinforcement. As such, each interval of hypoxia can be construed as the period during which the subject responds with heightened respiratory drive and is subsequently reinforced by an interval of normoxia. Provided that IH is a form of operant conditioning, it can be optimized through application of seminal psychological findings which established variable interval schedules of reinforcement as more effective than fixed interval schedules for learning. Therefore, using the duration of the hypoxic interval as our independent variable, we hypothesize that varied interval intermittent hypoxia (VIH) treatment will induce a greater, more prolonged increase in respiratory motor output than FIH after injury. We utilized the C2 hemisection injury model in rats and treated with VIH or FIH for 5 days at 1‐week post‐injury. Following treatment, we conducted diaphragm electromyograph recordings to assess breathing motor recovery within each animal by comparing baseline activity to maximal output induced by nasal occlusion, occurring immediately after cessation of IH treatment. Preliminary results show that 1‐week post‐injury VIH treated animals exhibited recovery on average equaling 33.87±7.89% as compared to the 19.28±6.02% recovery in FIH treated animals (differences nonsignificant by unpaired t‐test, p>0.05 with uncertainty shown as standard error of the mean). These data suggest that VIH may induce more increased and prolonged recovery than FIH in post‐injury models. Ongoing work includes evaluation of VIH treatment in animals at 8 weeks after injury and will expand outcome measurement timepoints to include 1 week after cessation of treatment to interrogate the persistence of induced recovery. Additionally, further exploration will focus on the molecular markers present within the phrenic motor nucleus of the cervical spinal cord and on the development of IH paradigms based on breathing frequency.Support or Funding InformationNINDS R01NS101105 (Warren J. Alilain)This abstract is from the Experimental Biology 2019 Meeting. There is no full text article associated with this abstract published in The FASEB Journal.

Limited developmental neurotoxicity from neonatal inhalation exposure to diesel exhaust particles in C57BL/6 mice

BackgroundRecent epidemiological studies indicate early-life exposure to pollution particulate is associated with adverse neurodevelopmental outcomes. The need is arising to evaluate the risks conferred by individual components and sources of air pollution to provide a framework for the regulation of the most relevant components for public health protection. Previous studies in rodent models have shown diesel particulate matter has neurotoxic potential and could be a health concern for neurodevelopment. The present study shows an evaluation of pathological and protracted behavioral alterations following neonatal exposure to aerosolized diesel exhaust particles (NIST SRM 1650b). The particular behavioral focus was on temporal control learning, a broad and fundamental cognitive domain in which reward delivery is contingent on a fixed interval schedule. For this purpose, C57BL/6 J mice were exposed to aerosolized NIST SRM 1650b, a well-characterized diesel particulate material, from postnatal days 4–7 and 10–13, for four hours per day. Pathological features, including glial fibrillary-acidic protein, myelin basic protein expression in the corpus callosum, and ventriculomegaly, as well as learning alterations were measured to determine the extent to which NIST SRM 1650b would induce developmental neurotoxicity.ResultsTwenty-four hours following exposure significant increases in glial-fibrillary acidic protein (GFAP) in the corpus callosum and cortex of exposed male mice were present. Additionally, the body weights of juvenile and early adult diesel particle exposed males were lower than controls, although the difference was not statistically significant. No treatment-related differences in males or females on overall locomotor activity or temporal learning during adulthood were observed in response to diesel particulate exposure.ConclusionWhile some sex and regional-specific pathological alterations in GFAP immunoreactivity suggestive of an inflammatory reaction to SRM 1650b were observed, the lack of protracted behavioral and pathological deficits suggests further clarity is needed on the developmental effects of diesel emissions prior to enacting regulatory guidelines.

To peck or not peck: Which do pigeons prefer?

Animals are expected to minimize time and effort to reinforcement. Thus, not pecking should be preferred over pecking. However, even if time is held constant, pigeons often peck when it is allowed but not required (e.g., fixed time schedules), but with such schedules pecking may be adventitiously reinforced. In the present experiment, to better compare a schedule of reinforcement that requires pecking with one that requires the absence of pecking, we compared a modified fixed-interval (FI) schedule in which reinforcement follows the first peck after the interval has elapsed and a differential-reinforcement-of-other behavior (DRO) schedule, which requires pigeons to abstain from pecking for a similar interval. The delay to reinforcement was matched on a trial-by-trial basis by yoking the duration of the FI to match the DRO schedule that preceded it. Of 12 pigeons, six preferred the DRO schedule over the FI schedule and six did not show a schedule preference. Those that were indifferent between the schedules apparently had a stronger spatial preference than their schedule preference. Individual differences in the preference of the pigeons may have been related to their behavior during the DRO schedule.

Automatic reinforcement from operant wheel-running undermines temporal control by fixed-interval schedules of reinforcement

The current study compared the development of response patterns for operant wheel-running and lever-pressing on fixed-interval schedules. Eleven female Long-Evans rats were exposed to fixed-interval (FI) 15-s, 30-s, and 60-s schedules with wheel revolutions as the operant behavior and sucrose solution as reinforcement. Subsequently, a lever was mounted in each wheel and rats responded on an FI-30 s schedule of sucrose reinforcement. Operant lever-pressing on average developed a scalloping pattern of low responding early in the reinforcement interval followed by an increase in pressing to the moment of reinforcement. In contrast, average operant wheel-revolutions peaked early in the reinforcement interval followed by a plateau, a pattern that did not change over sessions. Variation in the FI-schedule value (interval size) with operant wheel-running did not alter the pattern of running throughout the reinforcement interval, but merely parsed this pattern at different points. Cumulative records for the last session showed long postreinforcement pauses (PRP) for lever pressing. Wheel running, however, rose quickly after reinforcement and continued throughout the reinforcement interval. Overall and local wheel-running rates decreased and PRP duration increased as the interval size of the FI schedule increased. We propose that the automatic reinforcement generated by wheel running, but not lever pressing, provides an account of the poor temporal regulation of operant wheel-running in our study.

Generalization of response patterns in a multiple peak procedure

Stimulus generalization is typically assessed by analyzing overall response rates. Studies of generalization of response-rate patterns across time are less common, despite the ubiquitous nature of time and the strong temporal control over behavior in the natural world. Thus, we investigated generalization of response-rate patterns across time using a multiple peak procedure in pigeons. The frequency (fast or slow) at which the color of a keylight changed signaled a fixed-interval (FI) 5-s or 20-s schedule, counterbalanced across subjects. In peak trials, the frequency of keylight-color changes was varied. For the fast and slow training stimuli, response rates in peak trials were controlled by the arranged FI schedule value; they increased as the arranged reinforcer time approached, and decreased thereafter. Response-rate patterns to all test stimuli were similar to response-rate patterns to the slow training stimulus for all subjects. Thus, overall, strong generalization from the slow training stimulus to all test stimuli was evident, whereas there was little to no generalization from the fast training stimulus. These findings extend past research examining generalization of temporally controlled response-rate patterns, and provide a useful starting point for future investigations of generalization of fixed-interval responding. A thorough understanding of generalization processes requires analysis of dependent variables other than overall response rates, especially when responding is likely to be temporally controlled.

5-HT1a Receptor Involvement in Temporal Memory and the Response to Temporal Ambiguity.

It has previously been demonstrated that rats trained on the peak-interval procedure to associate two different cues with two different fixed interval schedules will generate a scalar peak function at an intermediate time when presented with the compound cue. This response pattern has been interpreted as resulting from the simultaneous retrieval of different temporal memories, and a consequential averaging process to resolve the ambiguity. In the present set of studies, we investigated the role that serotonin 1a receptors play in this process. In Experiment 1, rats were trained on a peak-interval procedure to associate the interoceptive states induced by saline and the 5-HT1a agonist, 8-OH-DPAT, with a 5 s or 20 s fixed-interval schedule signaled by the same tone cue (counter-balanced). While peak functions following administration of saline were centered at the appropriate time (5 s or 20 s), peak functions following administration of the agonist were centered around 7 s, irrespective of the reinforced time during training, suggesting agonist-induced disruption in selective temporal memory retrieval, resulting in increased ambiguity regarding the appropriate time at which to respond. In Experiment 2, rats were trained in a peak-interval procedure to associate a tone cue with a 10 s fixed interval and a light cue with a 20 s fixed interval. Administration of the 5-HT1a antagonist, WAY-100635, had no impact on timing when single cues were presented, but altered the intermediate, scalar, response to the stimulus compound, suggesting antagonist-induced disruption in the processes used to deal with temporal memory ambiguity. Together, these data suggest that manipulations of 5HT transmission at the 5-HT1a receptor cause changes in the temporal pattern of responding that are consistent with alterations in temporal memory processes and responses to temporal ambiguity.

Effect of neonatal hyperoxia followed by concentrated ambient ultrafine particle exposure on cumulative learning in C57Bl/6J mice

Hyperoxia during treatment for prematurity may enhance susceptibility to other risk factors for adverse brain development, such as air pollution exposure, as both of these risk factors have been linked to a variety of adverse neurodevelopmental outcomes. This study investigated the combined effects of neonatal hyperoxia followed by inhalation of concentrated ambient ultrafine particles (CAPS, <100 nm in aerodynamic diameter) on learning. C57BL/6 J mice were birthed into 60% oxygen until postnatal day (PND) 4 and subsequently exposed to filtered air or to CAPS using the Harvard University Concentrated Ambient Particle System (HUCAPS) from PND 4–7 and 10-13. Behavior was assessed on a fixed interval (FI) schedule of reinforcement in which reward is available only after a fixed interval of time elapses, as well as expected reductions in behavior during an extinction procedure when reward was withheld. Both produce highly comparable behavioral performance across species. Performance measures included rate of responding, response accuracy, and temporal control (quarter life). Exposure to hyperoxia or CAPS resulted in lower mean quarter life values, an effect that was further enhanced in males by combined exposure, findings consistent with delayed learning of the FI schedule. Females also initially exhibited greater reductions in quarter life values following the combined exposure to hyperoxia and CAPS and delayed reductions in response rates during extinction. Combined hyperoxia and CAPS produced greater learning deficits than either risk factor alone, consistent with enhanced neurodevelopmental toxicity, findings that could reflect a convergence of both insults on common neurobiological systems. The basis for sex differences in outcome warrants further research. This study highlights the potential for heightened risk of adverse neurodevelopment outcomes in individuals born preterm in regions with higher levels of ultrafine particle (UFP) air pollution, in accord with the multiplicity of risk factors extant in the human environment.

Recent and remote history effects on fixed-interval schedule performance

Avaliaram-se os efeitos de histórias recente e remota sobre o desempenho atual de ratos em esquemas FI, sob a mesma ou diferentes condições de estímulos. Os ratos foram distribuídos em sete grupos: os do Grupo 1 foram expostos apenas a um FI; os dos grupos 2, 4 e 5, foram expostos a um FR e a um DRL nas fases de História Remota e História Recente, respectivamente; os ratos dos grupos 3, 6 e 7 foram expostos a um DRL e a um FR nas fases de História Remota e História Recente, respectivamente. Na Fase de Teste, todos os ratos foram expostos a um FI. Para os ratos dos grupos 4 a 7, manipulou-se o estímulo em vigor em cada fase. Para esses ratos, nas fases de História Remota e História Recente, a luz da câmara estava acesa e apagada, respectivamente. Na Fase de Teste, a luz estava acesa, para os ratos dos grupos 4 e 6, e apagada, para os ratos dos grupos 5 e 7. Efeitos de histórias recentes (FR ou DRL) foram observados sobre o comportamento em FI, independentemente de os estímulos na fase de Teste terem sido semelhantes àqueles em vigor na fase de História Remota ou História Recente.

Endocrine active metals, prenatal stress and enhanced neurobehavioral disruption

Metals, including lead (Pb), methylmercury (MeHg) and arsenic (As), are long-known developmental neurotoxicants. More recently, environmental context has been recognized to modulate metals toxicity, including nutritional state and stress exposure. Modulation of metal toxicity by stress exposure can occur through shared targeting of endocrine systems, such as the hypothalamic-pituitary-adrenal axis (HPA). Our previous rodent research has identified that prenatal stress (PS) modulates neurotoxicity of two endocrine active metals (EAMs), Pb and MeHg, by altering HPA and CNS systems disrupting behavior. Here, we review this research and further test the hypothesis that prenatal stress modulates metals neurotoxicity by expanding to test the effect of developmental As ± PS exposure. Serum corticosterone and behavior was assessed in offspring of dams exposed to As ± PS. PS increased female offspring serum corticosterone at birth, while developmental As exposure decreased adult serum corticosterone in both sexes. As + PS induced reductions in locomotor activity in females and reduced response rates on a Fixed Interval schedule of reinforcement in males, with the latter suggesting unique learning deficits only in the combined exposure. As-exposed males showed increased time in the open arms of an elevated plus maze and decreased novel object recognition whereas females did not. These data further confirm the hypothesis that combined exposure to chemical (EAMs) and non-chemical (PS) stressors results in enhanced neurobehavioral toxicity. Given that humans are exposed to multiple environmental risk factors that alter endocrine function in development, such models are critical for risk assessment and public health protection, particularly for children.

Selective attention in pigeon temporal discrimination

Cues can vary in how informative they are about when specific outcomes, such as food availability, will occur. This study was an experimental investigation of the functional relation between cue informativeness and temporal discrimination in a peak-interval (PI) procedure. Each session consisted of fixed-interval (FI) 2- and 4-s schedules of food and occasional, 12-s PI trials during which pecks had no programmed consequences. Across conditions, the phi (ϕ) correlation between key light color and FI schedule value was manipulated. Red and green key lights signaled the onset of either or both FI schedules. Different colors were either predictive (ϕ = 1), moderately predictive (ϕ = 0.2-0.8) or not predictive (ϕ = 0) of a specific FI schedule. This study tested the hypothesis that temporal discrimination is a function of the momentary conditional probability of food; that is, pigeons peck the most at either 2 s or 4 s when ϕ = 1 and peck at both intervals when ϕ < 1. Response distributions were bimodal Gaussian curves; distributions from red- and green-key PI trials converged when ϕ ≤ 0.6. Peak times estimated by summed Gaussian functions, averaged across conditions and pigeons, were 1.85 and 3.87 s; however, pigeons did not always maximize the momentary probability of food. When key light color was highly correlated with FI schedules (ϕ ≥ 0.6), estimates of peak times indicated that temporal discrimination accuracy was reduced at the unlikely interval, but not the likely interval. The mechanism of this reduced temporal discrimination accuracy could be interpreted as an attentional process.

The effects of fixed-interval schedules on variability of pigeons' pecking location.

Many studies that have investigated performance under reinforcement schedules have measured response rate or interresponse time, which reflect the temporal dimension of responding; however, relatively few studies have examined other dimensions. The present study investigated the effects of fixed-interval schedules on the location of pigeons' pecking response. A circular response area 22.4 cm in diameter was used so that the pecking responses were effective over a wide range. Pigeons were exposed to a fixed-interval schedule whose requirement was systematically varied between conditions. Response location moved closer to the location of the last reinforced response as time elapsed in each trial. Additionally, as the fixed-interval duration requirement increased, response locations shifted to the border of the response area and the variability of response locations increased. These results suggest that fixed-interval schedules systematically control response location.

反応非依存強化子呈示による消去された反応の復活 : 定間隔(FI)強化スケジュールによる検討

反応非依存強化子呈示による消去された反応の復活 : 定間隔(FI)強化スケジュールによる検討

EFECTOS DE L A S INSTRUCCIONES ENUNCIADA S POR EL E XPERIMENTADOR Y EL PARTICIPANTE EN L A EJECUCIÓN DE UN PROGRAMA EN HUMANOS

The experiment examined effects of instructions on human schedule performance when providers of the instructions were persons other than the experimenter. Pressing a key by one member of each pair of eight undergraduates produced points on a multiple fixed-interval (FI) FI schedule.Another member of the pair was exposed to a multiple fixed-ratio (FR) differential-reinforcement-of-low-rate (DRL) schedule. After every session, verbal descriptions of how to increase points written by another member of the pair were presented.The final response rates under the multiple FI FI schedule were indistinguishable between the two components in each of four participants although they each received verbal descriptions indicating that the way to increase points with the key was to respond rapidly in one component and to respond slowly in another. Such weak effects of instructions given from persons other than the experimenter were contrasted with stronger effects of instructions given by the experimenter, that is, the final response rates were higher with the instruction to respond rapidly than with the instruction to respond slowly for three of the four participants.This differential effect across the instruction providers was not found in each of four participants who were exposed to the multiple FR DRL schedule.

Novel reinforcement learning paradigm based on response patterning under interval schedules of reinforcement

There is a need to develop cognitive tasks that address valid neuropsychological constructs implicated in disease mechanisms and can be used in animals and humans to guide novel drug discovery. Present experiments aimed to characterize a novel reinforcement learning task based on a classical operant behavioral phenomenon observed in multiple species – differences in response patterning under variable (VI) vs fixed interval (FI) schedules of reinforcement. Wistar rats were trained to press a lever for food under VI30 s and later weekly test sessions were introduced with reinforcement schedule switched to FI30 s. During the FI30 s test session, post-reinforcement pauses (PRPs) gradually grew towards the end of the session reaching 22–43% of the initial values. Animals could be retrained under VI30 s conditions, and FI30 s test sessions were repeated over a period of several months without appreciable signs of a practice effect. Administration of the non-competitive N-methyl-d-aspartate (NMDA) receptor antagonist MK-801 ((5S,10R)-(+)-5-Methyl-10,11-dihydro-5H-dibenzo[a,d]cyclohepten-5,10-imine maleate) prior to FI30 s sessions prevented adjustment of PRPs associated with the change from VI to FI schedule. This effect was most pronounced at the highest tested dose of MK-801 and appeared to be independent of the effects of this dose on response rates. These results provide initial evidence for the possibility to use different response patterning under VI and FI schedules with equivalent reinforcement density for studying effects of drug treatment on reinforcement learning.