Variable-interval Schedule Of Food Reinforcement Research Articles

Predator videos and electric shock function as punishers for zebrafish (Danio rerio).

Zebrafish (Danio rerio) are a promising animal model for studying the effects of gene-environment interactions on behavior. Two experiments were conducted to assess punishment effects of presenting predator videos (Indian leaf fish; Nandus nandus) and electric shock on operant approach responses in zebrafish. In Experiment 1, the predator video and shock stimuli were presented upon a response maintained by a single variable-interval schedule of food reinforcement in different groups of fish. In Experiment 2, the predator video and shock stimuli were presented upon one of two response alternatives maintain by concurrently available variable-interval schedules of food reinforcement in different groups of fish. Responding decreased when the predator video and shock stimuli were presented relative to their absence in both experiments. Moreover, responding on an unpunished alternative did not reliably decrease in Experiment 2. These results indicate that the decrease in responding resulted from the punishment contingency rather than from elicited species-specific defense responses or conditioned avoidance. Thus, the predator video and electric shock functioned as punishers of operant behavior for zebrafish. Identifying punishers for this species could lead to research on how gene-environment interactions influence individual differences in sensitivity to punishment.

Behavioral intoxication following voluntary oral ingestion of tetramethylenedisulfotetramine: Dose-dependent onset, severity, survival, and recovery

Tetramethylenedisulfotetramine (tetramine, or TETS) is a highly toxic rodenticide that has been responsible for over 14,000 accidental and intentional poisonings worldwide. Although the vast majority of TETS poisonings involved tainted food or drink, the laboratory in vivo studies of TETS intoxication used intraperitoneal injection or gavage for TETS exposure. Seeking to develop and characterize a more realistic model of TETS intoxication in the present study, rats were trained to rapidly and voluntarily consume a poisoned food morsel. Initially, the overt toxic effects of TETS consumption across a large range of doses were characterized, then a focused range of doses was selected for more intensive behavioral evaluation (in operant test chambers providing a variable-interval schedule of food reinforcement). The onset of intoxication following voluntary oral consumption of TETS was rapid, and clear dose-dependent response-rate suppression was observed across multiple performance measures within the operant-chamber environment. At most doses, recovery of operant performance did not occur within 30h. Food consumption and body weight changes were also dose dependent and corroborated the behavioral measures of intoxication. This voluntary oral-poisoning method with concomitant operant-behavioral assessment shows promise for future studies of TETS (and other toxic chemicals of interest) and may be extremely valuable in characterizing treatment outcomes.

乱比率(RR)及び変間隔(VI)食餌強化スケジュールの下でのハトのタイムアウト行動

乱比率(RR)及び変間隔(VI)食餌強化スケジュールの下でのハトのタイムアウト行動

ＶＩ強化によって維持しているラットのレバー押し反応に対するＶＲ罰の効果

The effects of reinforcement and punishment on response suppression under variable-interval reinforcement and variable-ratio punishment schedules were investigated. At baseline, lever pressing in rats was maintained by a variable-interval food reinforcement schedule. In the punishment condition, responding was punished by a grid shock under a variable-ratio schedule in which three rats experienced four or five punishment rates and a fixed reinforcement rate. Results indicated that there was a negative linear correlation between the variable-ratio punishment rate and the response rate. Results of three rats that experienced five or six reinforcement rates with a fixed punishment rate indicated that punishment suppressed responding at all reinforcement rates. These findings suggest that the punishment rate was strongly related to response suppression under both variable-interval reinforcement and variable-ratio punishment schedules.

Comparison of naltrexone and quaternary naltrexone after systemic and intracerebroventricular administration in pigeons

The behavioral effects of naltrexone and quaternary naltrexone were evaluated in two groups of pigeons. One group responded under a fixed-ratio schedule of food reinforcement and was trained to discriminate between 3.2 mg/kg morphine (i.m.) and saline. Drug-appropriate responding occurred in a dose-related manner to morphine, given intramuscularly and intraventricularly. When administered intraventricularly morphine was 50 times more potent as a discriminative stimulus and 50–100 times more potent at suppressing responding. Naltrexone, given intraventricularly and intramuscularly, attenuated the discriminative stimulus effects of morphine. Quaternary naltrexone was more potent at suppressing responding when administered intraventricularly but it failed to attenuate the discriminative stimulus effects of morphine. A second group of pigeons, responding under a variable-interval schedule of food reinforcement, was treated with 100.0 mg/kg/day of morphine. Naltrexone and quaternary naltrexone suppressed responding by both routes of administration. Naltrexone was approximately equipotent when given intramuscularly or intraventricularly, and the doses that suppressed responding were 50–500 times smaller than doses required to suppress responding in untreated pigeons. Although quaternary naltrexone was 1800 times more potent when given intraventricularly, the doses necessary to suppress responding by each route were the same as doses required in untreated pigeons. These results extend the conditions under which a quaternary derivative of naltrexone failed to display antagonist activity in the pigeon. The utility of this compound for characterizing central and peripheral mechanisms of action has not been established in different species and testing conditions and, therefore, appears to be appropriate only under conditions in which it is evaluated after systemic, as well as central, administration.

Sensitivity to reinforcement in successive and delayed discriminations

Pigeons' responses were recorded in successive 15-s subintervals of 60-s components of several multiple variable-interval schedules of food reinforcement. In the standard multiple schedule or successive discrimination, discriminative stimuli were present throughout each component. In the delayed discrimination or memory procedure, red or green stimuli were present in the first 15 s of components and were followed by a white stimulus for the remainder of both components. Ratios of responses in the first 15 s of the two components, where discriminative stimuli were present, were sensitive to ratios of reinforcers obtained in the two components, to the same extent in both multiple and memory procedures. In both procedures, sensitivity to reinforcement decreased systematically over component subintervals, but to a greater extent in the memory procedure where discriminative stimuli were absent. The reduction in sensitivity with time since presentation of prior discriminative stimuli in the memory procedure was therefore influenced by two main factors: delayed stimulus control by the discriminative stimuli presented earlier in the component, and a decrease in sensitivity to reinforcement with increasing time since component alternation.

Concurrent Reinforcement of Topographically Different Responses and the Matching Relation

Three rats responded under concurrent variable-interval schedules of food reinforcement. One schedule component provided reinforcement for the manipulation of an omnidirectional rod; the other schedule component provided reinforcement for pressing a lever. The same force was required to execute each response. Reinforcement rates provided by the schedules were varied over experimental conditions. Allocation of both responses and time between schedules undermatched the ratios of reinforcements obtained from the schedules for each rat. All rats displayed bias in favor of the lever with both response and time allocation, but no consistent difference in the magnitude of bias with response-based versus time-based measures of choice was observed. Previous research on choice between topographically different responses revealed substantially greater bias in response-based measures of choice than in time-based measures. However, response topography has been confounded with response force in previous research. Findings of the present study, in which force requirements for the two responses were equal, indicate that differences in response topography do not necessarily produce differences between response-based and time-based measures of bias. Rather, these findings suggest that differences in measures of bias may result from different force requirements of the responses.

A time-series analysis of changeover performance on concurrent variable-interval schedules

Pigeons responded to concurrent variable-interval variable-interval schedules of food reinforcement. Interchangeover times and reinforcements were recorded in intact time series during acquisition following several schedule-density manipulations. Probability of a changeover, while constant as a function of time since the previous changeover, was found to be a nonmonotonically increasing function of time since reinforcement. Autocorrelation analyses of intact time series revealed the presence of statistically significant sequential dependencies in the time series during acquisition, but not during asymptotic performance. Lag transformations of actual interchangeover times revealed inhomogeneities in the time series not shown in the autocorrelations or in the overall distribution of interchangeover times.

Autocontingencies: Rats count to three to predict safety from shock

Following training on a variable-interval food-reinforcement schedule, rats were exposed to three unsignaled shocks during each 30-min session. Although leverpressing was initially suppressed, responding was significantly accelerated following offset of the third shock, regardless of when in the session it occurred. Control sessions in which only two shocks were programmed, one early and one late, did not yield baseline acceleration. Evidence of “counting to three” was less obvious in subjects simultaneously exposed to a temporal autocontingency, that is, for which each shock also predicted a minimum 3-min safety period. The addition of a signal prior to each shock eliminated evidence of counting behavior altogether. We conclude that rats may be taught to count, but such behavior is highly unnatural and may be blocked or overshadowed by more salient sources of information.

FREE‐OPERANT FORGETTING: DELAYED STIMULUS CONTROL OF MULTIPLE‐SCHEDULE PERFORMANCE

Pigeons' responses were reinforced in two components of several multiple variable-interval variable-interval schedules of food reinforcement. In one component, the key was illuminated green for 15 seconds and white for 45 seconds. In the other component, the key was illuminated red for 15 seconds and white for 45 seconds. Values for the exponent of the power functions relating response ratios to reinforcement ratios were higher in the presence of the discriminative stimuli (green or red) than in the presence of white. Sensitivity of response ratios to changes in reinforcement ratios provided an index of the extent to which responding was under delayed stimulus control by prior discriminative stimuli.

The influence of positive and negative reinforcement on selective attention in the rat

In Experiments 1 and 2 rats were trained under two multiple schedules of reinforcement. In one, bar pressing during a tone-light compound stimulus was reinforced under a variable-interval food reinforcement schedule. In the other multiple schedule, bar pressing avoided grid shock on a free-operant schedule. In both multiple schedules, a discrimination was maintained by an extinction schedule that was operative during the absence of the tone-light compound. In Experiments 1 and 2 the intensity of the tone-light compound was manipulated over three levels. Subsequent extinction tests revealed that light was attended to, almost exclusively of the tone, when food reinforcement had maintained bar pressing. On the other hand, the tone gained considerable attentional control under the shock avoidance schedule. This stimulus-reinforcer interaction was maintained for all three levels of the compound intensity. In Experiment 3 it was investigated whether this interaction was associative by presenting shock during the absence of the tone-light compound when food reinforcement maintained responding, and food during the absence of the compound when shock avoidance maintained responding. Since both food and shock were presented during a single session for both schedules, nonassociative effects of the reinforcing stimuli were equivalent across the schedules. Nevertheless, the stimulus-reinforcer interaction was maintained, indicating that the interaction was an associative effect.

AN INTERRESPONSE TIME ANALYSIS OF VARIABLE‐RATIO PUNISHMENT

An interresponse time analysis was used to study the effects of variable-ratio punishment schedules on the temporal pattern of reinforced responding. Twelve pigeons responded on a baseline variable-interval schedule of food reinforcement. A variable-ratio ten schedule of electric shock punishment was then introduced. The shock intensity was systematically increased to the highest intensity at which responding could be maintained. At this intensity, the mean variable-ratio value was increased and then decreased. Variable-ratio punishment resulted in an increased relative frequency of very short unreinforced interresponse times (response bursting). Increased response bursting accounted for instances of response rate facilitation. In addition, shock was followed by interresponse times of decreasing mean length over the first several responses after shock.

Choice responding following multiple schedule training

Pigeons’ choice responding on 10-sec interpolated probes was studied after baseline training on multiple variable-interval variable-interval schedules of food reinforcement. Unreinforced choice following training with three different relative reinforcement rates (Experiment 1), with a 3-ply multiple schedule (Experiment 2), and with three different relative reinforcement durations (Experiment 3) was examined. Least squares lines were fit to choice relative response rate and schedule relative response rate as functions of training relative reinforcement rate; choice slope was significantly greater than schedule slope in all three experiments. This result is counter to the prediction of Herrnstein’s (1970) theory that these slopes should not differ. Luce’s (1959) theory also failed to account for the data. It was concluded that choice responding was controlled by both approach to the stimulus associated with the smaller mean interreinforcer interval or the longer duration, and avoidance of the other stimulus.

Transfer of conditioned suppression and conditioned acceleration from instrumental to consummatory baselines

Following training on a variable-interval food reinforcement schedule, rats were exposed to Pavlovian procedures which produced reliable conditioned suppression and conditioned acceleration of the leverpressing (instrumental) baseline. When free food was simultaneously made available in the test cage, all subjects spent the majority of each session “freeloading,” that is, eating food from a dish rather than leverpressing for it. When superimposed upon the freeloading baseline, the conditioned suppression and conditioned acceleration procedures affected the rate of pellet consumption identically in magnitude and direction to their previous effects on leverpressing. These results suggest a motivational mechanism for conditioned suppression and acceleration, rather than one which depends upon spurious punishment of specific response sequences.

Behavioral contrast and induction in the crow

Common crows received baseline training on an equal-valued multiple variable-interval variable-interval schedule of food reinforcement. When the schedule was subsequently changed to a multiple variable—interval variable-time schedule, in which reinforcement was delivered independently of responding in the latter component, this resulted in negative induction. That is, responding decreased in both components. After a return to the baseline schedule, a change to a multiple variable—interval extinction schedule, resulted in decreased responding in the extinction component. Accompanying this change was an increase in responding during the unaltered variable—interval component, i.e., positive behavioral contrast. Differences between these findings and predictions derived from several theories of behavioral contrast are discussed.

YOKED VARIABLE‐RATIO AND VARIABLE‐INTERVAL RESPONDING IN PIGEONS1

Pigeons' key pecks were maintained by variable-ratio or variable-interval schedules of food reinforcement. For pairs of pigeons in one group, variable-ratio reinforcement was arranged for one pigeon's pecks; for the second pigeon, reinforcement was arranged according to a variable-interval schedule yoked to the interreinforcement times produced by the first pigeon. For pairs of pigeons in another group, variable-interval reinforcement was arranged for one pigeon's pecks; for the second pigeon, reinforcement was arranged according to a variable-ratio schedule yoked to the interreinforcement responses produced by the first pigeon. For each pair, the yoking procedure was maintained for four or five consecutive sessions of 50 reinforcements each. In more than three-quarters of the pairs, variable-ratio response rates were higher than variable-interval rates within two sessions; in all cases, the rate difference developed within four sessions.

CONCURRENT PERFORMANCES: RATE CONSTANCIES WITHOUT CHANGEOVER DELAYS1

Pigeons' pecks on two keys were maintained, without changeover delays, by independent variable-interval schedules of food reinforcement. Four regularly cycling 2-min components scheduled reinforcement respectively for both keys, left key only, both keys, and right key only. Initially, reinforcement scheduled for one key alone produced more responding on that key than reinforcement scheduled concurrently for both keys. Continued sessions reduced this difference; response rate on a given key approached constancy, or invariance with respect to the performance on and schedule for the other key. When extinction replaced the reinforcement schedule on either key, responding on that key decreased more during components that scheduled reinforcement for the other key than during those that did not. This demonstration that responses on one key were not supported by reinforcers on the other key suggested that the alternation of concurrent responding and either-key-alone responding prevented concurrent superstitions from developing.

THE EFFECTS OF TOTAL DARKNESS ON SCHEDULE CONTROL

The study investigated the effect of total darkness on the key pecking of pigeons under fixed-ratio, variable-ratio, fixed-interval, and variable-interval schedules of food reinforcement. Eight pigeons were divided into groups of two, with each group conditioned to peck under one of the four schedules of reinforcement. Under an ABAB procedure, all pigeons experienced alternating light and dark conditions. The house- and keylights were (a) maintained at full intensity for the first 30 one-hour sessions, (b) faded out and disconnected over Sessions 31 through 50, (c) totally illuminated for Sessions 51 to 60, and (d) disconnected again for the final 10 sessions. Responding under the ratio schedules increased from 20% to 108% in the dark and responding under the interval schedules in the dark decreased by 37% to 93%.

DEVELOPMENT AND MAINTENANCE OF ATTACK IN PIGEONS DURING VARIABLE‐INTERVAL REINFORCEMENT OF KEY PECKING1

Key-peck responses of two pigeons were maintained on variable-interval schedules of food reinforcement in the presence of a stuffed pigeon to study the characteristics of attack induced by that schedule. The mean interval of the schedule was increased from 15 sec to 600 sec in eight steps before an intermediate interval was reintroduced. The principal characteristics of attack were: (1) substantial attack first occurred on a variable-interval schedule of 90 sec in one pigeon and at 180 sec in the other, (2) the highest attack rates occurred on variable-interval schedules of 300 sec and 600 sec, (3) attack rate generally increased to a maximum and then decreased to a lower level across sessions at each schedule, (4) attacks developed a postreinforcement locus across the initial sessions on all schedules and, except on variable-interval schedules of 300 and 600 sec, occurred primarily in the postreinforcement period during extended training, (5) attack rates and key-peck rates were not recovered when the intermediate-length schedules were reintroduced, and (6) attack rate and key-peck rates were negatively correlated. Except for the fact that the maximum attack rates occurred at interfood intervals of 300 and 600 sec, and that attack and key-peck rates were negatively correlated, these findings have counter-parts in experiments with other reinforcement schedules.

Suppression of operant behavior and schedule-induced licking in rats.

The first experiment studied the effects of punishment on rats' lever pressing maintained by a fixed-interval schedule of food reinforcement and on the associated schedule-induced licking. When licking was followed by shock, licking was suppressed but lever pressing was largely unaffected. When lever pressing was followed by shock, lever pressing was suppressed but licking was unaffected. In both cases, the punished behavior recovered its previous unpunished level when the shocks were discontinued. In a second experiment, the rats' lever pressing was maintained by a variable-interval schedule of food reinforcement under which polydipsic licking also developed. Both lever pressing and licking were partially suppressed during a stimulus correlated with occasional unavoidable electric shocks. With a higher shock intensity, both behaviors were suppressed further. Both lever pressing and licking recovered their previous levels when shocks were discontinued. These results show that schedule-induced licking, which has been described as adjunctive behavior, can be suppressed by procedures that suppress reinforced lever pressing, an operant behavior.