Three-component Multiple Schedule Research Articles

Behavioral resistance as function of different levels of instruction completeness

The present study examined the effects of different levels of instruction completeness on the behavioral persistence of humans engaged in a computer task. Five undergraduate students responded in a three-component multiple schedule of reinforcement during baseline. In two components, responses produced points according to a fixed-interval (FI) 5 s schedule of reinforcement. In the third component, extinction was programmed, and no instruction was available (No-Instruction Component - NI). The complete instruction "Press once every 5 seconds to earn points" appeared on the computer screen during one FI component (Complete-Instruction Component – CI), and the minimal instruction "Press to earn points" appeared on the computer screen during the other FI component (Minimal-Instruction Component – MI). The reinforcement rate was equal between the FI components. Increases in response force disturbed responding during test relative to baseline. Overall, greater persistence occurred in the component correlated with the complete instruction (i.e., CI component), suggesting that different levels of instruction completeness can differentially affect behavioral persistence when the reinforcement rate is held constant.

THE EFFECTS OF UNSIGNALED AND SIGNALED DELAYS OF REINFORCEMENT IN RATS: A BETWEEN-PROCEDURES COMPARISON

Using eight experimentally naive Wistar rats, the effects of immediate, unsignaled and signaled delays of reinforcement on lever-pressing response rates were compared with two different procedures. In the Between-Phases procedure, each experimental condition was presented in three thirty-session consecutive phases; whereas, in the Multiple-Schedule procedure, each experimental condition was correlated with one component of a three-component multiple schedule of reinforcement. Regardless of the procedure used, consistent results were observed, that is, differences in response rates were found when rats were exposed to a delay of reinforcement condition (Signaled or Unsignaled) in contrast to the immediate-reinforcement condition. These results suggest that even when rats are exposed to different conditions in the same session, similar results occur to those found when these conditions are arranged between phases. Similarly, they provide some information regarding the usefulness of employing a multiple schedule to assess the effects of different variables (Immediate, Unsignaled, and Signaled food deliveries) in relatively less time than a between-phases procedure.

Further Analysis of the Predictive Effects of a Free-Operant Competing Stimulus Assessment on Stereotypy.

We conducted five experiments to evaluate the predictive validity of a free-operant competing stimulus assessment (FOCSA). In Experiment 1, we showed that each participant's repetitive behavior persisted without social consequences. In Experiment 2, we used the FOCSA to identify high-preference, low-stereotypy (HP-LS) items for 11 participants and high-preference, high-stereotypy (HP-HS) items for nine participants. To validate the results of the FOCSAs (Experiment 3), we used a three-component multiple schedule to evaluate the immediate and subsequent effects of an HP-LS stimulus, an HP-HS stimulus, or both (in separate test sequences) on each participant's stereotypy. Results of Experiment 3 showed that the FOCSA correctly predicted the immediate effect of the HP-LS stimulus for 10 of 11 participants; however, the FOCSA predictions were less accurate for the HP-HS stimulus. Results of Experiment 4 showed that a differential reinforcement of other behavior procedure in which participants earned access to the HP-LS for omitting vocal stereotypy increased all five participants' latency to engaging in stereotypy; however, clinically significant omission durations were only achieved for one participant. Experiment 5 showed that differential reinforcement of alternative behavior in which participants earned access to the HP-LS stimulus contingent upon correct responses during discrete-trial training reduced targeted and nontargeted stereotypy and increased correct academic responding for all four participants. The potential utility of the FOCSA is discussed.

Response-reinforcer dependency and resistance to change.

The effects of the response-reinforcer dependency on resistance to change were studied in three experiments with rats. In Experiment 1, lever pressing produced reinforcers at similar rates after variable interreinforcer intervals in each component of a two-component multiple schedule. Across conditions, in the fixed component, all reinforcers were response-dependent; in the alternative component, the percentage of response-dependent reinforcers was 100, 50 (i.e., 50% response-dependent and 50% response-independent) or 10% (i.e., 10% response-dependent and 90% response-independent). Resistance to extinction was greater in the alternative than in the fixed component when the dependency in the former was 10%, but was similar between components when this dependency was 100 or 50%. In Experiment 2, a three-component multiple schedule was used. The dependency was 100% in one component and 10% in the other two. The 10% components differed on how reinforcers were programmed. In one component, as in Experiment 1, a reinforcer had to be collected before the scheduling of other response-dependent or independent reinforcers. In the other component, response-dependent and -independent reinforcers were programmed by superimposing a variable-time schedule on an independent variable-interval schedule. Regardless of the procedure used to program the dependency, resistance to extinction was greater in the 10% components than in the 100% component. These results were replicated in Experiment 3 in which, instead of extinction, VT schedules replaced the baseline schedules in each multiple-schedule component during the test. We argue that the relative change in dependency from Baseline to Test, which is greater when baseline dependencies are high rather than low, could account for the differential resistance to change in the present experiments. The inconsistencies in results across the present and previous experiments suggest that the effects of dependency on resistance to change are not well understood. Additional systematic analyses are important to further understand the effects of the response-reinforcer relation on resistance to change and to the development of a more comprehensive theory of behavioral persistence.

The effects of chlordiazepoxide andd-amphetamine during a three-component multiple schedule

Multiple schedules have been used in behavioral pharmacology research to show that a drug's effect on behavior can be a function of the schedule of reinforcement that supports that behavior. However, less research has examined whether the context of the schedule of reinforcement in a multiple schedule can change the drug's effect on behavior. We examined the effects of acute chlordiazepoxide and d-amphetamine injections on the behavior of two groups of pigeons trained on a three-component multiple schedule with identical schedules of reinforcement in the first and last components. For one group of pigeons reinforcement was unavailable during the middle component (decreased-middle-component). For the second group reinforcement rate was higher during the middle component than during the first or third components (increased-middle-component). In the decreased-middle-component group, chlordiazepoxide (3.2-32 mg/kg) decreased third-component response rates less than it decreased responding in the first component. Conversely, in the increased-middle-component group, chlordiazepoxide (3.2-10 mg/kg) decreased third-component response rates more than in the first component. In both groups, d-amphetamine did not differentially affect response rates across components. These results are consistent with previous research showing that drugs can differentially affect responding to two different schedules of reinforcement during the same session, and suggest that pharmacological preparations may be helpful in elucidating the mechanisms that control multiple schedule interactions.

EFFECTS OF NONCONTINGENT MUSIC ON VOCAL STEREOTYPY AND TOY MANIPULATION IN CHILDREN WITH AUTISM SPECTRUM DISORDERS

Noncontingent music has been shown to reduce engagement in vocal stereotypy in children with autism spectrum disorders, but its effects on appropriate collateral behavior remain unknown. Given that noncontingent music is typically implemented during periods of free play, clinicians may be concerned with the effects of the intervention on toy manipulation. Thus, we examined the immediate and subsequent effects of noncontingent music on engagement in vocal stereotypy and toy manipulation in four children with autism spectrum disorders by using a three‐component multiple schedule combined with a multi‐element design. The results suggest that noncontingent music (i) reduced immediate engagement in vocal stereotypy for three of four participants, (ii) never increased subsequent engagement in vocal stereotypy, and (iii) produced idiosyncratic effects on immediate and subsequent engagement in toy manipulation for two participants. The clinical implications of the results are discussed in terms of improving the treatment of vocal stereotypy using noncontingent music. Copyright © 2012 John Wiley & Sons, Ltd.

Expanding Functional Analysis of Automatically Reinforced Behavior Using a Three-Component Multiple-Schedule

Current functional analysis methodology provides the general label “automatic reinforcement” for behaviors that persist in the absence of social consequences. Likewise, current treatment-evaluation methods may demonstrate that a given intervention decreases automatically reinforced behavior. However, neither yields results that indicate whether an intervention contains stimulation that is functionally matched to the product of automatically reinforced behavior. We present a sequential assessment model to evaluate interventions for automatically reinforced behavior using a three-component multiple-schedule. This three-component multiple-schedule can be used to identify interventions that produce an abolishing operation for subsequent engagement in automatically reinforced behavior. We provide a step-by-step description of the procedures and data analysis, as well as a general overview of our findings to date. The potential clinical utility of the methodology and applications for future research are also discussed.

TOLERANCE TO EFFECTS OF COCAINE ON BEHAVIOR UNDER A RESPONSE‐INITIATED FIXED‐INTERVAL SCHEDULE

Tolerance to effects of cocaine can be modulated by schedules of reinforcement. With multiple ratio schedules, research has shown an inverse relationship between ratio requirement and amount of tolerance that resulted from daily administration of the drug. In contrast, tolerance to the effects of cocaine on behavior under multiple interval schedules generally has developed regardless of interval value. Under interval schedules reinforcement depends on the animal making one response following a time interval. Thus, as time to respond increases, the time to reinforcement decreases. On the other hand, fixed ratio schedules require a specified number of responses to be made prior to reinforcement. Therefore, delaying the initiation of responding does not coincide with a significant decrease in the time to reinforcement. In the current experiment, 6 pigeons were trained to respond under a three-component multiple schedule, with a different tandem fixed-ratio 1 fixed-interval schedule in each component. The multiple schedule required one response, which was followed by one of three fixed-interval values (5, 15, or 60 s). Thus, the multiple schedule was interval-like because after the fixed-ratio 1, only one more response was required for reinforcement, but it was also ratio-like because the length of the pause at the beginning of each interreinforcer interval affected the time until the next reinforcer. Acute administration of cocaine generally resulted in dose-dependent decreases in responding. Chronic (i.e., daily) administration of a rate-decreasing dose resulted in tolerance patterns similar to those usually obtained with multiple ratio schedules. That is, the magnitude of tolerance was related inversely to schedule size. These results suggest that delay to reinforcement from the initial response may play a role in the development of schedule-parameter-related tolerance.

DIFFERENTIAL ANTAGONISM OF COCAINE SELF—ADMINISTRATION AND COCAINE—INDUCED DISRUPTIONS OF LEARNING BY HALOPERIDOL IN RHESUS MONKEYS

Six rhesus monkeys responding under a three-component multiple schedule were administered haloperidol to determine its effects on cocaine self-administration and on cocaine's disruptive effects on the repeated acquisition and performance of response chains. In the absence of haloperidol, 0.0032-0.032 mg/kg/infusion of cocaine increased response rate and the number of infusions in the self-administration component when compared to saline administration, whereas 0.1-0.32 mg/kg/infusion decreased response rate and the number of infusions. When compared to saline administration, the two lowest infusion doses of cocaine had little or no effect on responding in the acquisition and performance components; however, higher infusion doses of cocaine dose-dependently decreased response rate in these components. In addition, the higher doses of cocaine also increased the percentage of errors in the acquisition and performance components. Pretreatment with haloperidol (0.0032 or 0.01 mg/kg, i.m.) antagonized the effects of low doses of cocaine on the number of infusions in the self-administration component, whereas only the 0.01-mg/kg dose antagonized the effects of high doses of cocaine on the number of infusions. Neither dose of haloperidol antagonized the rate-decreasing effects of cocaine on responding in the acquisition and performance components significantly; the highest dose of haloperidol alone decreased rates of responding in each component. Antagonism of cocaine's error-increasing effects by haloperidol was only evident at one dose of cocaine (0.032 mg/kg/infusion), and was more complete in the performance components than in the acquisition components. Together, these data show the limited suitability of haloperidol for selectively antagonizing cocaine self-administration in the context of a multiple schedule involving transition behavior, and show the lack of uniform antagonism across operant behaviors.

Signals, resistance to change, and conditioned reinforcement in a multiple schedule

The effect of signals on resistance to change was evaluated using pigeons responding on a three-component multiple schedule. Each component contained a variable-interval initial link followed by a fixed-time terminal link. One component was an unsignaled-delay schedule, and two were equivalent signaled-delay schedules. After baseline training, resistance to change was assessed through (a) extinction and (b) adding free food to the intercomponent interval. During these tests, the signal stimulus from one of the signaled-delay components (SIG-T) was replaced with the initial-link stimulus from that component, converting it to an unsignaled-delay schedule. That signal stimulus was added to the delay period of the unsignaled-delay component (UNS), converting it to a signaled-delay schedule. The remaining signaled component remained unchanged (SIG-C). Resistance-to-change tests showed removing the signal had a minimal effect on resistance to change in the SIG-T component compared to the unchanged SIG-C component except for one block during free-food testing. Adding the signal to the UNS component significantly increased response rates suggesting that component had low response strength. Interestingly, the direction of the effect was in the opposite direction from what is typically observed. Results are consistent with the conclusion that the signal functioned as a conditioned reinforcer and inconsistent with a generalization-decrement explanation.

FURTHER EVALUATION OF METHODS TO IDENTIFY MATCHED STIMULATION

The effects of preferred stimulation on the vocal stereotypy of 2 individuals were evaluated in two experiments. The results of Experiment 1 showed that (a) the vocal stereotypy of both participants persisted in the absence of social consequences, (b) 1 participant manipulated toys that did and did not produce auditory stimulation, but only sound-producing toys decreased his vocal stereotypy, and (c) only noncontingent music decreased vocal stereotypy for the other participant, but sterotypy paradoxically increased when toys were presented with music. Using a three-component multiple schedule, the results of Experiment 2 showed that the vocal stereotypy of both participants remained below preintervention levels following the removal of auditory stimulation and that 1 participant's vocal stereotypy increased following the removal of contingent reprimands. These patterns suggest that auditory stimulation functioned as an abolishing operation for vocal stereotypy and reprimands functioned as an establishing operation for vocal stereotypy. Together, the two experiments provide a method for identifying alternative stimulation that may substitute for automatically reinforced behavior.

EFFECTS OF MORPHINE ON TEMPORAL DISCRIMINATION AND COLOR MATCHING: GENERAL DISRUPTION OF STIMULUS CONTROL OR SELECTIVE EFFECTS ON TIMING?

Discrepant effects of drugs on behavior maintained by temporal-discrimination procedures make conclusive statements about the neuropharmacological bases of timing difficult. The current experiment examined the possible contribution of a general, drug-induced disruption of stimulus control. Four pigeons responded on a three-component multiple schedule that included a fixed-interval 2-min, temporal discrimination, and color-matching component. Under control conditions, response rates and choice responses during the first two components showed evidence of control by time, and accuracy for color matching was high in the third component. Morphine administration flattened the distribution of fixed-interval responding and produced a general disruption of accuracy in the temporal-discrimination component, whereas accuracy in the color-matching component was relatively unaffected. Analysis of the psychophysical functions from the temporal-discrimination component indicated that morphine decreased accuracy of temporal discrimination by decreasing overall stimulus control, rather than by selectively affecting timing. These results suggest the importance of determining the neurophysiological bases of stimulus control as it relates to temporal discrimination.

EFFECTS OF COCAINE ON PERFORMANCE UNDER FIXED‐INTERVAL SCHEDULES WITH A SMALL TANDEM RATIO REQUIREMENT

Daily administration of cocaine often results in the development of tolerance to its effects on responding maintained by fixed-ratio schedules. Such effects have been observed to be greater when the ratio value is small, whereas less or no tolerance has been observed at large ratio values. Similar schedule-parameter-dependent tolerance, however, has not been observed with fixed-interval schedules arranging comparable interreinforcement intervals. This experiment examined the possibility that differences in rate and temporal patterning between the two types of schedule are responsible for the differences in observed patterns of tolerance. Five pigeons were trained to key peck on a three-component multiple (tandem fixed-interval fixed-ratio) schedule. The interval values were 10, 30, and 120 s; the tandem ratio was held constant at five responses. Performance appeared more like that observed under fixed-ratio schedules than fixed-interval schedules. Effects of various doses of cocaine given weekly were then determined for each pigeon. A dose that reduced responding was administered prior to each session for 50 days. A reassessment of effects of the range of doses revealed tolerance. The degree of tolerance was similar across components of the multiple schedule. Next, the saline vehicle was administered prior to each session for 50 days to assess the persistence of tolerance. Tolerance diminished in all subjects. Overall, the results suggested that schedule-parameter-dependent tolerance does not depend on the temporal pattern of responding engendered by fixed-ratio schedules.

Does The Temporal Placement of Food-Pellet Reinforcement Alter Induction When Rats Respond on A Three-Component Multiple Schedule?

A series of recent studies have demonstrated that rats will increase their rate of operant responding for sucrose reinforcement when food-pellet reinforcement will be upcoming in the same session. One potential explanation for this increase is that operant, rather than respondent or general, behavior becomes increasingly probable in sessions in which food-pellet reinforcement will be available. This explanation implies that it is not necessarily upcoming food-pellet reinforcement that produces the induction. The present study investigated this implication by having rats press 1 lever (Experiment 1) or 3 different levers (Experiment 2) for 1 % liquid-sucrose reinforcers delivered by a 3-component multiple schedule. Across treatment conditions, food-pellet reinforcement replaced sucrose reinforcement in one of the three 15-min components. Doing so produced an induction effect in responding for sucrose in the other components. However, the size of induction did not differ depending on the temporal placement of the food-pellet reinforcement. These results are therefore consistent with the above, operant explanation.

Cocaine self-administration in monkeys: effects on the acquisition and performance of response sequences

A three-component multiple schedule of intravenous cocaine self-administration (0.01–0.3 mg/kg), repeated acquisition and performance was used to examine the effects of self-administered cocaine on learning in rhesus monkeys. A 0.03 mg/kg infusion of cocaine maintained reliable self-administration without markedly decreasing overall response rate or increasing the percentage of errors in the acquisition and performance components in which food was presented. When saline was substituted for 0.03 mg/kg of cocaine, there was little or no effect on responding in the acquisition or performance components while the number of infusions and response rate in the self-administration component decreased. These effects occurred to a greater extent under a FR 90 schedule (Experiment 2) as compared to a FR 30 schedule (Experiment 1) of cocaine self administration. Substitution of higher infusion doses of cocaine also decreased response rate and the number of infusions in the self-administration components, and substantially decreased responding in the acquisition components; decreases in overall accuracy of responding were evident when responding in this schedule component occurred. Taken together, these data indicate that learning is generally more sensitive than performance to the disruptive effects of self-administered cocaine.

Previous- and following-component contrast effects using a three-component multiple schedule

Behavioral contrast can be defined as an inverse relation between the rate of behavior in one component of a multiple schedule of reinforcement and the conditions of reinforcement in another component. In the present experiment, four pigeons pecked a key for mixed-grain reinforcers delivered by a three-component multiple schedule. During baseline conditions, the same variable-interval schedule was in effect during each component. In contrast conditions, the rate of reinforcement in the second component was increased or decreased. Behavioral contrast was usually observed in both the first and third components. Across-component contrast effects were neither larger nor more reliable when the change in reinforcement occurred in the following component than when it occurred in the previous component. Furthermore, in both the first and third components, the size of contrast was almost always largest early in the component and decreased as the component progressed. Both across- and within-component data were analyzed using the model proposed by Williams and Wixted (1986). The results question the adequacy of the model. The results also pose difficulties for several existing theories of contrast.

Behavioral effects of acute and chronic cocaine administration in male and female rats: effects of fixed-ratio schedule parameters.

Intact and gonadectomized male and female rats pressed a lever to obtain food on different fixed-ratio (FR) schedules in a three-component multiple schedule. The values of a small, intermediate and large FR schedule were individually determined and were higher for intact male rats than for most subjects in the other groups. Acute cocaine administration (1.0-30.0mg/kg) dose-dependently decreased response rates maintained by all three schedules, but responding maintained by the large FR schedule was more sensitive to the rate-decreasing effects of acute cocaine administration. Response rates of intact male rats were less sensitive to the rate-decreasing effects of cocaine than those of the other groups, at least at higher doses during the small and intermediate FR schedules. Cocaine's dose-effect curve was redetermined after chronic administration of a behaviorally active dose of cocaine. Differences between groups of subjects were not evident. Behavioral tolerance was consistently observed when responding was maintained by the small FR schedule. Effects varied between subjects within groups when responding was maintained by the intermediate FR schedule, but behavioral tolerance was frequently observed. Behavioral sensitization was evident during the large FR schedule, but these data were difficult to interpret because of a considerable shift in response rates after vehicle administration. The data suggest that the comparison of drug effects in male and female rats requires a systematic analysis of the contribution of behavioral parameters. They also provide additional evidence for the notion that reference to reinforcement-loss alone is not sufficient to explain the development of tolerance to the behavioral effects of cocaine.

EFFECTS OF IMPOSED POSTFEEDBACK DELAYS IN PROGRAMMED INSTRUCTION

Imposed postfeedback delays promote discrimination training; the present experiments determined whether they also improve performance in programmed instruction. In two experiments, college students completed 45 sets of Holland and Skinner's (1961) programmed text on behavior analysis in a computerized format in a three-component multiple schedule. In Experiment 1, the conditions were (a) no delay between questions, (b) a 10-s delay after each question (noncontingent delay), and (c) a 10-s delay after each question answered incorrectly (contingent delay). Noncontingent delay produced better performance than no delay and contingent delay. To determine whether performance increased in the noncontingent delay condition because subjects studied the material during delay periods, Experiment 2 tested three conditions: (a) no delay between questions, (b) a 10-s delay after each question (noncontingent delay), and (c) a 10-s delay after each question with the screen blank during the delay period. Noncontingent delay produced better performance than no delay, but there was no difference in performance between no delay and noncontingent delay with blank screen. Hence, noncontingent delay improved performance because students used delay periods to study. Furthermore, subjects preferred noncontingent delay to the other conditions, and session time increased only slightly.

Effects of three monoamine uptake inhibitors on behavior maintained by cocaine or food presentation in rhesus monkeys

Rhesus monkeys ( n = 6) were surgically prepared with double lumen i.v. catheters and the effects of continuous infusion of the monoamine reuptake blockers mazindol, sertraline and fluoxetine were examined on behavior maintained by food presentation or i.v. cocaine injections. Under baseline conditions, lever pressing was maintained under a three-component multiple schedule of reinforcement in which food (1-g banana-flavored pellets) was available for 600 s under a fixed-ratio 30 schedule in the first and third components. In the second component, the dose of cocaine that maintained maximum rates of responding (0.03 or 0.05 mg/kg per injection) was available for 1800 s under a fixed-ratio 30 schedule. There was a brief time-out after each reinforcer. When behavior was stable, mazindol (0.4–3.2 mg/kg per 24 h), sertraline (0.1–8.0 mg/kg per 24 h) or fluoxetine (0.4–3.2 mg/kg per 24 h) was administered continuously via the second lumen of the double lumen catheter. Mazindol was administered for the same number of sessions that were required for responding to decline to low levels when the monkeys were allowed to self-administer saline [5–13] while sertraline and fluoxetine were administered for a minimum of 21 days. Baseline conditions were reinstated between doses of each drug. Each drug decreased cocaine-maintained responding in a dose-related manner. In most cases, food-maintained responding was disrupted at doses equal to or lower than those that decreased cocainemaintained responding. Additionally, the higher doses of each drug decreased food intake outside the daily sessions. These results suggest that monoamine uptake blockers with prominent effects on either dopamine or serotonin neurotransmission can decrease cocaine self-administration but only at doses that also affect behavior maintained by other reinforcers.

The relationship of local to overall behavioral contrast

Pigeons were presented with a three-component multiple schedule, with components appearing in an unpredictable order. After a baseline period in which all components were associated with reinforcement, a discrimination period followed in which one of the components was associated with extinction. Of the remaining two positive components, one was at times directly preceded by the extinction component, and one was not. Both overall positive contrast and local positive contrast were measured relative to a baseline produced each session, and both types of contrast were found. The association between overall and local contrast decreased as discrimination training progressed. The results agree with a precursor theory of the origin of overall contrast.