Fixed-interval 30-s Schedule Research Articles

Between-session memory degradation accounts for within-session changes in fixed-interval performance

A common assumption in the study of fixed-interval (FI) timing is that FI performance is largely stable within sessions, once it is stable between sessions. Within-session changes in FI performance were examined in published data (Daniels and Sanabria, 2017), wherein some rats were trained on a FI 30-s schedule of food reinforcement (FI30) and others on a FI 90-s schedule (FI90). Following stability, FI90 rats were pre-fed for five sessions. Response rates declined as a function of trial, due more to latency lengthening than to run-rate reduction. Latencies were best described by a dynamic gamma-exponential mixture distribution, in which latency lengthening was driven by the growth of the criterion pulse count for a response and not by a reduction in the speed of an endogenous clock. The speed of the clock was selectively sensitive to the length of the FI; the prevalence and length of exponentially-distributed latencies were selectively sensitive to pre-feeding. These findings reveal (a) that parameters governing FI latencies are selectively sensitive to a range of manipulations, (b) a potential degradation of the criterion pulse count between consecutive sessions, and (c) a subsequent recovery of the criterion pulse count within sessions.

Fixed-interval pause duration in chained fixed-ratio, fixed-interval schedules.

rats were submitted to chained fixed-ratio (FR), fixed-interval (FI) schedules of reinforcement. A FR schedule at one lever produced a discriminative stimulus associated with a FI 60-s schedule of primary reinforcement (water) at the second response lever. In Experiment 1, the FI schedule was kept constant while the FR requirement was changed from one to seven responses under five different experimental conditions for five rats. Increases in the FR requirement resulted in increases in post- reinforcement pauses but also decreases in pauses in the FI schedule. Using another five rats, Experiment 2 tested the hypothesis that short pauses in the FI schedule result from the use of the chained schedules procedure. Baseline was a FI 80-s schedule. In the second condition, chained FR 1 FI 80-s schedules were programmed. The third condition was a return to baseline. In baselines 1 and 2, the FI pause was compatible with the literature but decreased considerably when a chained schedule was used. The present results support the hypothesis that the time between primary reinforcement presentations dominates the control of FI pauses over control by the onset of a discriminative stimulus. Keywords: timing; chained schedules; fixed ratio; fixed interval; water; rats.

Effects of response-independent stimuli on fixed-interval and fixed-ratio performance of rats: a model for stressful disruption of cyclical eating patterns

Binge eating is often associated with stress-induced disruption of typical eating patterns. Three experiments were performed with the aim of developing a potential model for this effect by investigating the effect of presenting response-independent stimuli on rats' lever-pressing for food reinforcement during both fixed-interval (FI) and fixed-ratio (FR) schedules of reinforcement. In Experiment 1, a response-independent brief tone (500-ms, 105-dB, broadband, noisy signal, ranging up to 16kHz, with spectral peaks at 3 and 500Hz) disrupted the performance on an FI 60-s schedule. Responding with the response-independent tone was more vigorous than in the absence of the tone. This effect was replicated in Experiment 2 using a within-subject design, but no such effect was noted when a light was employed as a disrupter. In Experiment 3, a 500-ms tone, but not a light, had a similar effect on rats' performance on FR schedules. This tone-induced effect may represent a release from response-inhibition produced by an aversive event. The implications of these results for modeling binge eating are discussed.

Within-session modulation of timed anticipatory responding: When to start responding

The peak procedure is widely used in the study of interval timing with animals. Multiple timing measures can be derived from peak responding. These measures are typically presented as averages across many trials based on the implicit assumption that peak responding is stable throughout the session. We tested this assumption by examining whether peak responding changed over the course of the session in 45 mice that were trained on a fixed-interval 30-s schedule. All common measures of peak responding, except stop times, changed over the course of the session: start times increased, response rates and spreads decreased, and, although less reliably, peak times also shifted rightward. These results are congruent with a motivational interpretation, whereby increased satiety leads to the observed behavioral signature of within-session modulation of timed anticipatory responding.

Effects of fluoxetine on hippocampal rhythmic slow activity and behavioural inhibition

Anxiolytics that act as GABAA agonists and those that act as 5-HT1A receptor agonists all reduce the frequency of hippocampal rhythmic slow activity (RSA). Changes in RSA have been linked to changes in behavioural inhibition and therefore anxiety - but this has not been tested with specific serotonin reuptake inhibitors, which are antidepressant and anxiolytic; therefore we tested the effects of fluoxetine on RSA and behavioural inhibition. Fluoxetine (FLU; 10 and 20 mg/kg, intraperitoneally) produced a dose-related reduction in the frequency of reticular-elicited RSA. Groups of rats received, intraperitoneally, either (i) saline, or 5 mg/kg fluoxetine, or 10 mg/kg fluoxetine; or (ii) saline, or 20 mg/kg fluoxetine, or 6.6 mg/kg of the 5-HT1A agonist buspirone (BUS) and were tested on a fixed interval 60-s schedule and a differential reinforcement of low rates 15-s schedule. FLU at 5 mg/kg produced effects similar to low doses of BUS and other anxiolytics. FLU (10 and 20 mg/kg) produced effects more like those reported earlier for higher doses of BUS. These results continue to link anxiolysis, RSA and behavioural inhibition, and suggest that serotonergic anxiolytics share some of the central actions of GABAergic anxiolytics, but at higher doses, administered acutely, have distinct side effects that can obscure their anxiolytic action in behavioural tasks.

Investigations of timing during the schedule and reinforcement intervals with wheel-running reinforcement

Across two experiments, a peak procedure was used to assess the timing of the onset and offset of an opportunity to run as a reinforcer. The first experiment investigated the effect of reinforcer duration on temporal discrimination of the onset of the reinforcement interval. Three male Wistar rats were exposed to fixed-interval (FI) 30-s schedules of wheel-running reinforcement and the duration of the opportunity to run was varied across values of 15, 30, and 60s. Each session consisted of 50 reinforcers and 10 probe trials. Results showed that as reinforcer duration increased, the percentage of postreinforcement pauses longer than the 30-s schedule interval increased. On probe trials, peak response rates occurred near the time of reinforcer delivery and peak times varied with reinforcer duration. In a second experiment, seven female Long-Evans rats were exposed to FI 30-s schedules leading to 30-s opportunities to run. Timing of the onset and offset of the reinforcement period was assessed by probe trials during the schedule interval and during the reinforcement interval in separate conditions. The results provided evidence of timing of the onset, but not the offset of the wheel-running reinforcement period. Further research is required to assess if timing occurs during a wheel-running reinforcement period.

Responding for sucrose and wheel-running reinforcement: effect of D-amphetamine

The present study assessed the effect of D-amphetamine on responding maintained by wheel-running and sucrose reinforcement. Six male albino Wistar rats were placed in running wheels and exposed to a fixed-interval 30-s schedule that produced either a drop of 5% sucrose solution or the opportunity to run for 15 s as reinforcing consequences for lever pressing. Each reinforcer type was signaled by a different stimulus. Doses of 0.25, 0.5, 1.0, 1.5, and 3.0 mg/kg D-amphetamine were administered by i.p. injection 20 min prior to a session. As the dose increased, index of curvature values decreased toward zero and rate-dependency plots revealed increases in lower rates early in the interval and decreases in higher rates toward the end of the interval. Effects were similar in the presence of both stimuli. However, an analysis of post-reinforcement pauses and local response rates broken down by transitions revealed a differential effect. As the dose increased, local response rates following a wheel-running reinforcer were affected more than those following a sucrose reinforcer.

Differences in corticosterone level due to inter-food interval length: Implications for schedule-induced polydipsia

The purpose of this study was to determine the effects of different food-reinforcement schedules on plasma corticosterone (CORT), and its possible involvement in the acquisition and maintenance of schedule-induced polydipsia (SIP). In Experiment 1, three groups of rats were submitted to two different fixed-interval (FI) schedules with inter-food intervals of 30 and 120 s, and to a massed-feeding presentation for 40 days until SIP was well stabilized. In Experiment 2, six groups of rats were exposed to the same schedules, FI 30s and FI 120s, and to the massed-feeding condition, but no water bottles were presented. CORT levels were determined on Days 3 and 40. Results of Experiment 1 indicated that FI 30s schedule, but not FI 120s or the massed-feeding condition, induces excessive drinking from Day 3. Results in Experiment 2 indicated that CORT levels were similar for all the groups on Day 3. However, only animals on the FI 30s schedule did increase their CORT levels on Day 40, with no variation in the hormone in the other two conditions, FI 120s and massed-feeding presentations. The data are discussed in terms of the implications of these results for hypotheses of SIP as anxiolitic behavior.

Different systems in the posterior hypothalamic nucleus of rats control theta frequency and trigger movement

Reduced frequency of theta activity is thought to compromise hippocampal function and so behavioural inhibition. The anxiolytic benzodiazepine chlordiazepoxide (CDP) reduces theta frequency when injected into the medial supramammillary nucleus (mSuM), posterior hypothalamic nucleus (PH) and dorsomedial hypothalamic nucleus (DMH). These hypothalamic effects on theta could underlie at least some behavioural effects of benzodiazepines. We have previously shown that in a fixed interval 60-s schedule (FI60), CDP injected into mSuM reduced both theta frequency and behavioural inhibition. The present experiments test the effect of injections into PH and DMH on theta and hippocampal-sensitive behaviour (FI60 and open field ambulation). Systemic CDP (5 mg/kg i.p.) released, but PH/CDP (20 μg in 0.5 μl vehicle) suppressed FI responding, though they both reduced FI theta frequency. In the open field, both CDP i.p. and PH/CDP reduced ambulation, but only the systemic injection reduced ambulation theta frequency. Taken together with previous research, these results support a role for PH in the control of voluntary behaviour. They imply that this function may be suppressed, independently of theta, by benzodiazepines. An anxiolytic effect of PH/CDP in FI60 may, therefore, have been masked by a concurrent action of CDP on the PH motor system. DMH/CDP did not affect behaviour or theta in either experiment, despite the fact that this nucleus is involved in benzodiazepine mediation of risk assessment and the flight response. This suggests that, like the control of theta frequency by the hypothalamus, the neural mechanisms underlying anxiety are distributed in complex networks.

EFFECTS OF REINFORCEMENT HISTORY ON RESPONSE RATE AND RESPONSE PATTERN IN PERIODIC REINFORCEMENT

Several researchers have suggested that conditioning history may have long-term effects on fixed-interval performances of rats. To test this idea and to identify possible factors involved in temporal control development, groups of rats initially were exposed to different reinforcement schedules: continuous, fixed-time, and random-interval. Afterwards, half of the rats in each group were studied on a fixed-interval 30-s schedule of reinforcement and the other half on a fixed-interval 90-s schedule of reinforcement. No evidence of long-term effects attributable to conditioning history on either response output or response patterning was found; history effects were transitory. Different tendencies in trajectory across sessions were observed for measures of early and late responding within the interreinforcer interval, suggesting that temporal control is the result of two separate processes: one involved in response output and the other in time allocation of responding and not responding.

Habituation contributes to the decline in wheel running within wheel-running reinforcement periods

Habituation appears to play a role in the decline in wheel running within an interval. Aoyama and McSweeney [Aoyama, K., McSweeney, F.K., 2001. Habituation contributes to within-session changes in free wheel running. J. Exp. Anal. Behav. 76, 289-302] showed that when a novel stimulus was presented during a 30-min interval, wheel-running rates following the stimulus increased to levels approximating those earlier in the interval. The present study sought to assess the role of habituation in the decline in running that occurs over a briefer interval. In two experiments, rats responded on fixed-interval 30-s schedules for the opportunity to run for 45 s. Forty reinforcers were completed in each session. In the first experiment, the brake and chamber lights were repeatedly activated and inactivated after 25 s of a reinforcement interval had elapsed to assess the effect on running within the remaining 20 s. Presentations of the brake/light stimulus occurred during nine randomly determined reinforcement intervals in a session. In the second experiment, a 110 dB tone was emitted after 25 s of the reinforcement interval. In both experiments, presentation of the stimulus produced an immediate decline in running that dissipated over sessions. No increase in running following the stimulus was observed in the first experiment until the stimulus-induced decline dissipated. In the second experiment, increases in running were observed following the tone in the first session as well as when data were averaged over several sessions. In general, the results concur with the assertion that habituation plays a role in the decline in wheel running that occurs within both long and short intervals.

Dishabituation with component transitions may contribute to the interactions observed during multiple schedules.

Rates of responding by rats were usually higher during the variable interval (VI) 30-s component of a multiple VI 30-s fixed interval (FI) 30-s schedule than during the same component of a multiple VI 30-s VI 30-s schedule (Experiment 1). Response rates were also usually higher during the FI 30-s component of a multiple VI 30-s FI 30-s schedule than during the same component of a multiple FI 30-s FI 30-s schedule (Experiment 2). The differences in response rates were not observed when the components provided VI or FI 120-s schedules. These results were predicted by the idea that differences in habituation to the reinforcer between multiple schedules contribute to behavioral interactions, such as behavioral contrast. However, differences in habituation were not apparent in the within-session patterns of responding. Finding differences in response rates in both experiments violates widely-held assumptions about behavioral interactions, including that behavioral contrast does not occur for rats and that improving the conditions of reinforcement decreases, rather than increases, response rate in the alternative component.

Responding for sucrose and wheel-running reinforcement: effects of sucrose concentration and wheel-running reinforcer duration.

Six male albino rats were placed in running wheels and exposed to a fixed-interval 30-s schedule of lever pressing that produced either a drop of sucrose solution or the opportunity to run for a fixed duration as reinforcers. Each reinforcer type was signaled by a different stimulus. In Experiment 1, the duration of running was held constant at 15 s while the concentration of sucrose solution was varied across values of 0, 2.5. 5, 10, and 15%. As concentration decreased, postreinforcement pause duration increased and local rates decreased in the presence of the stimulus signaling sucrose. Consequently, the difference between responding in the presence of stimuli signaling wheel-running and sucrose reinforcers diminished, and at 2.5%, response functions for the two reinforcers were similar. In Experiment 2, the concentration of sucrose solution was held constant at 15% while the duration of the opportunity to run was first varied across values of 15, 45, and 90 s then subsequently across values of 5, 10, and 15 s. As run duration increased, postreinforcement pause duration in the presence of the wheel-running stimulus increased and local rates increased then decreased. In summary, inhibitory aftereffects of previous reinforcers occurred when both sucrose concentration and run duration varied; changes in responding were attributable to changes in the excitatory value of the stimuli signaling the two reinforcers.

Schedule-controlled behavior in rats exposed perinatally to the PCB mixture Aroclor 1254

Exposure to polychlorinated biphenyls (PCBs) has been shown to detrimentally affect learning and memory in children as well as schedule-controlled behavior in experimental animals. The objective of the present series of experiments was to extend research into the effects of PCBs on behavior maintained under both short (30 s) and long (5 min) fixed-interval (FI) schedules as well as an FI 3-min with reinforcement omission. Long–Evans rats were exposed to 0 or 6 mg/kg/day Aroclor 1254 (A1254) via oral gavage from Gestation Day 6 (GD 6) through Postnatal Day 21 (PND 21). At approximately PND 90, acquisition and steady-state performance were assessed under a series of FI reinforcement schedules consisting of FI 30-s, FI 5-min, and FI 3-min with 33% of the scheduled reinforcers omitted. Performance measures included index of curvature (IOC), response rate, and postreinforcement pause (PRP). There were no effects of A1254 on the acquisition of behavior under the FI 30-s schedule. Subsequently, there was an initial decrease in response rate and IOC and an increase in PRP following the transition from FI 30-s to the FI 5-min; there were, however, no treatment-related effects on any measure. During the reinforcement-omission procedure, there was an increase in the rate of responding and a decrease in IOC and PRP following omission intervals irrespective of treatment. These data are inconsistent with previous findings and suggest that perinatal A1254 exposure in the rat does not disrupt temporally organized behavior.

The long-term effect of high- and low-rate responding histories on fixed-interval responding in rats.

Tell rats were given extended lever-press training on a fixed-interval (FI) 30-s food reinforcement schedule from the outset or following exposure to one or two previous reinforcement schedules. For 4 rats the previots schedule was either fixed-ratio 20, which generated high response rates, or differential-reinforcement-of-low-rate 20 s, which produced low response rates. For 4 additional rats the extended training on FI 30 s was preceded by experience with two schedules: fixed-ratio 20 followed by differential-reinforcement-of-low-rate 20 s; or the same two schedules in the reverse order. Fixed-interval response rates were initially affected by the immediately preceding schedule, but after 80 to 100 sessions, all traces of prior schedule history had disappeared. The results also showed no long-term effect of schedule history on the interfood-interval patterns of responding on the FI 30-s schedule. These results support one of the most central tenets of the experimental analysis of behavior: control by the immediate consequences of behavior.

Soft commitment: self-control achieved by response persistence.

With reinforcement contingent on a single peck on either of two available keys (concurrent continuous reinforcement schedules) 4 pigeons, at 80% of free-feeding weights, preferred a smaller-sooner reinforcer (2.5 s of mixed grain preceded by a 0.5-s delay) to a larger-later reinforcer (4.5 s of mixed grain preceded by a 3.5-s delay). However, when the smaller-sooner and larger-later reinforcers were contingent on a concurrent fixed-ratio 31 schedule (the first 30 pecks distributed in any way on the two keys), all pigeons obtained the larger-later reinforcer much more often than they did when only a single peck was required. This "self-control" was achieved by beginning to peck the key leading to the larger-later reinforcer and persisting on that key until reinforcement occurred. We call this persistence "soft commitment" to distinguish it from strict commitment, in which self-control is achieved by preventing changeovers. Soft commitment also effectively achieved self-control when a brief (1-s) signal was inserted between the 30th and 31st response of the ratio and with concurrent fixed-interval 30-s schedules (rather than ratio schedules) of reinforcement. In a second experiment with the same subjects, the fixed ratio was interrupted by darkening both keys and lighting a third (center) key on which pecking was required for various fractions of the fixed-ratio count. The interruption significantly reduced self-control. When interruption was complete (30 responses on the center key followed by a single choice response), pigeons chose the smaller-sooner reinforcer as frequently as they did when only a single choice response was required.

Effects of a variable-ratio conditioning history on sensitivity to fixed-interval contingencies in rats.

We investigated the possibility that human-like fixed-interval performances would appear in rats given a variable-ratio history (Wanchisen, Tatham, & Mooney, 1989). Nine rats were trained under single or compound variable-ratio schedules and then under a fixed-interval 30-s schedule. The histories produced high fixed-interval rates that declined slowly over 90 sessions; differences as a function of the particular history were absent. Nine control animals given only fixed-interval training responded at lower levels initially, but rates increased with training. Despite differences in absolute rates, rates within the intervals and postreinforcement pauses indicated equivalent development of the accelerated response patterns suggestive of sensitivity to fixed-interval contingencies. The finding that the histories elevated rates without retarding development of differentiated patterns suggests that the effective response unit was a burst of several lever presses and that the fixed-interval contingencies acted on these units in the same way as for single responses. Regardless of history, the rats did not manifest the persistent, undifferentiated responding reported for humans under comparable schedules. We concluded that the shortcomings of animal models of human fixed-interval performances cannot be easily remedied by including a variable-ratio conditioning history within the model.

Psychological distance to reward in monkeys

A concurrent-chains schedule was employed to examine crab-eating macaques' choice between segmented and unsegmented fixed-interval 30-s schedules. A stimulus change occurred during one of the fixed-interval schedules (segmented schedule), while no stimulus change occurred during the other (unsegmented schedule). The subjects were exposed to three consecutive stimulus-change conditions, in an attempt to explore whether correlation of the stimulus changes with a fixed interval of nonreinforcement affects the preference between the alternatives. When the stimulus change always occurred at a half point of the segmented schedule (the first and third conditions), all subjects preferred the fixed-interval schedule without stimulus changes. This replicated previous findings with pigeons and humans. On the other hand, when the intervals before and after the stimulus change varied on every entry to the segmented schedule with the sum of them being constant (the second condition), the subjects were indifferent to the alternatives. These results are consistent with the view that the preference for unsegmented schedules over segmented ones might be due to aversiveness which the initial component in the segmented schedule possesses as a result of its correlation with a fixed interval of nonreinforcement.

Variable-ratio conditioning history produces high- and low-rate fixed-interval performance in rats.

Four rats were exposed to an A-B-A-B series of 30 sessions each of variable-ratio 20 (A) and fixed-interval 30-s (B) schedules. Four other rats received 120 sessions of fixed-interval 30 s. The rats with a history of variable-ratio responding subsequently showed primarily high or low response-rate patterns on the fixed-interval schedule without evidence of classical scalloping (i.e., increased rates of responding throughout the interreinforcement interval), except infrequently in 1 rat. The rats exposed to only the fixed-interval 30-s schedule displayed the expected sequence of scalloping giving way to lower rate break-run or simply low-rate responding over time. This experiment shows that when naive rats are exposed to even a simple history of reinforcement (in this case, a variable-ratio 20), their subsequent fixed-interval performance is very different from comparable performance in naive rats, and might be said to be more similar to the responding of adult humans. The argument is made that care should be taken in comparing the fixed-interval performance of humans and nonhumans because humans have a complex history of reinforcement, whereas laboratory nonhumans are typically naive.

Instructed Human Fixed-Interval Performance: The Effects of the Experimental Setting

Four experimentally naive human subjects were exposed to three fixed-interval (FI) schedules of reinforcement: FI 600 s, FI 300 s, and FI 60 s. The subjects were given instructions specifying the fixed interval based nature of the schedules and the behavior required to obtain points, later exchangeable for money. The experimental setting comprised of three rooms: Room A contained reading material, food snacks, and a variety of nonalcoholic beverages; Room B contained a computer keyboard; and Room C contained a monitor connected to the keyboard in Room B. The subjects were instructed to type “FEED” on the keyboard in Room B and then immediately check the monitor in Room C for the delivery of points. During exposure to the FI 600-s schedule all subjects produced pause-respond local response rates. These patterns persisted when subjects were transferred to the FI 300-s schedule. For a number of sessions during exposure to the FI 300-s schedule Room A was locked. The introduction of these “two-room” sessions decreased response rates and increased the postreinforcement pauses (PRPs) for three subjects. The FI 60-s schedule produced low response rates and extended PRPs for all four subjects. With a return to the FI 600 s, all subjects reverted to the pause-respond pattern. These results emphasize the importance of the experimental setting in human operant studies.