Quantitative analysis of performance on a progressive-ratio schedule: effects of reinforcer type, food deprivation and acute treatment with Δ9-tetrahydrocannabinol (THC).

Rats' performance on a progressive-ratio schedule maintained by sucrose (0.6M, 50 µl) and corn oil (100%, 25 µl) reinforcers was assessed using a model derived from Killeen's (1994) theory of schedule-controlled behaviour, 'Mathematical Principles of Reinforcement'. When the rats were maintained at 80% of their free-feeding body weights, the parameter expressing incentive value, a, was greater for the corn oil than for the sucrose reinforcer; the response-time parameter, δ, did not differ between the reinforcer types, but a parameter derived from the linear waiting principle (T0), indicated that the minimum post-reinforcement pause was longer for corn oil than for sucrose. When the rats were maintained under free-feeding conditions, a was reduced, indicating a reduction of incentive value, but δ was unaltered. Under the food-deprived condition, the CB1 cannabinoid receptor agonist Δ(9)-tetrahydrocannabinol (THC: 0.3, 1 and 3 mg kg(-1)) increased the value of a for sucrose but not for corn oil, suggesting a selective enhancement of the incentive value of sucrose; none of the other parameters was affected by THC. The results provide new information about the sensitivity of the model's parameters to deprivation and reinforcer quality, and suggest that THC selectively enhances the incentive value of sucrose.

Effects of SKF-83566 and haloperidol on performance on progressive ratio schedules maintained by sucrose and corn oil reinforcement: quantitative analysis using a new model derived from the Mathematical Principles of Reinforcement (MPR).

RATIONALE: Mathematical models can assist the interpretation of the effects of interventions on schedule-controlled behaviour and help to differentiate between processes that may be confounded in traditional performance measures such as response rate and the breakpoint in progressive ratio (PR) schedules. OBJECTIVE: The effects of a D1-like dopamine receptor antagonist, 8-bromo-2,3,4,5-tetrahydro-3-methyl-5-phenyl-1H-3-benzazepin-7-ol hydrobromide (SKF-83566), and a D2-like receptor antagonist, haloperidol, on rats' performance on PR schedules maintained by sucrose and corn oil reinforcers were assessed using a new model derived from Killeen's (Behav Brain Sci 17:105-172, 1994) Mathematical Principles of Reinforcement. METHOD: Separate groups of rats were trained under a PR schedule using sucrose or corn oil reinforcers. SKF-83566 (0.015 and 0.03 mg kg(-1)) and haloperidol (0.05 and 0.1 mg kg(-1)) were administered intraperitoneally (five administrations of each treatment). Running and overall response rates in successive ratios were analysed using the new model, and estimates of the model's parameters were compared between treatments. RESULTS: Haloperidol reduced a (the parameter expressing incentive value) in the case of both reinforcers, but did not affect the parameters related to response time and post-reinforcement pausing. SKF-83566 reduced a and k (the parameter expressing sensitivity of post-reinforcement pausing to the prior inter-reinforcement interval) in the case of sucrose, but did not affect any of the parameters in the case of corn oil. CONCLUSIONS: The results are consistent with the hypothesis that blockade of both D1-like and D2-like receptors reduces the incentive value of sucrose, whereas the incentive value of corn oil is more sensitive to blockade of D2-like than D1-like receptors.

Pharmacological studies of performance on the free-operant psychophysical procedure.

In the free-operant psychophysical procedure (FOPP), reinforcement is provided intermittently for responding on lever A in the first half and lever B in the second half of a trial. Temporal differentiation is measured from the psychometric function (percent responding on B, %B, versus time from trial onset, t), the index of timing being T50, the value of t at %B=50. T50 is reduced by acute treatment with 5-hydroxytryptamine (5-HT1A, 5-HT2A) and dopamine (D1-like, D2-like) receptor agonists. The effects of the agonists can be reversed by the respective antagonists of these receptors. Evidence is reviewed suggesting that the effect of endogenous 5-HT is mediated by 5-HT2A receptors and the effect of endogenous dopamine by D1-like receptors. Data are presented on the effects of lesions of the prefrontal cortex and corpus striatum on the sensitivity of performance on the FOPP to D1-like and D2-like receptor agonists. Lesions of the nucleus accumbens, but not the dorsal striatum or prefrontal cortex, attenuated the effects of a D1-like receptor agonist, 6-chloro-2,3,4,5-tetrahydro-1-phenyl-1H-3-benzazepine [SKF-81297], but not a D2-like receptor agonist, quinpirole, on T50. The results indicate that a population of D1-like receptors in the ventral striatum may contribute to the control of timing performance on the FOPP.

Fos expression in the prefrontal cortex and ventral striatum after exposure to a free-operant timing schedule.

It has been proposed that cortico-striato-thalamo-cortical circuits that incorporate the prefrontal cortex and corpus striatum regulate interval timing behaviour. In the present experiment regional Fos expression was compared between rats trained under an immediate timing schedule, the free-operant psychophysical procedure (FOPP), which entails temporally regulated switching between two operanda, and a yoked variable-interval (VI) schedule matched to the timing task for food deprivation level, reinforcement rate and overall response rate. The density of Fos-positive neurones (counts mm(-2)) in the orbital prefrontal cortex (OPFC) and the shell of the nucleus accumbens (AcbS) was greater in rats exposed to the FOPP than in rats exposed to the VI schedule, suggesting a greater activation of these areas during the performance of the former task. The enhancement of Fos expression in the OPFC is consistent with previous findings with both immediate and retrospective timing schedules. Enhanced Fos expression in the AcbS was previously found in retrospective timing schedules based on conditional discrimination tasks, but not in a single-operandum immediate timing schedule, the fixed-interval peak procedure. It is suggested that the ventral striatum may be engaged during performance on timing schedules that entail operant choice, irrespective of whether they belong to the immediate or retrospective categories.

Fos expression in the orbital prefrontal cortex after exposure to the fixed-interval peak procedure.

It has been proposed that cortico-striato-thalamo-cortical circuits that incorporate the prefrontal cortex and dorsal striatum regulate interval timing behaviour. The present experiment examined whether performance on the fixed-interval peak procedure (FIPP), an immediate timing schedule, would induce neuronal activity in cortical and striatal areas, as revealed by enhanced expression of the Fos protein, a marker for neuronal activation. Regional Fos expression was compared between rats trained on the FIPP and rats trained on a variable-interval (VI) schedule matched to the FIPP for overall response rate and reinforcer delivery. Response rate in the peak trials of the FIPP conformed to a temporally differentiated pattern, which was well described by a modified Gaussian function; in agreement with previous findings, the peak time occurred close to the time at which the reinforcer was delivered in the fixed-interval trials, and the Weber fraction was within the range of values reported previously. The density of Fos-positive neurones (counts mm(-2)) in the orbital prefrontal cortex (OPFC) was greater in rats exposed to the FIPP than in rats exposed to the VI schedule, suggesting a greater activation of this area during the performance of the former task. This is consistent with the results of previous studies that have implicated the OPFC in interval timing behaviour. However, there was no significant difference between the levels of Fos expression in the dorsal or ventral striatum of the rats trained under the two schedules.

Nucleus accumbens and delay discounting in rats: evidence from a new quantitative protocol for analysing inter-temporal choice.

RATIONALE: There is evidence that the core of the nucleus accumbens (AcbC) is involved in inter-temporal choice behaviour. OBJECTIVE: A new behavioural protocol was used to examine the effect of destruction of the AcbC on delay discounting in inter-temporal choice schedules in rats. METHOD: Rats with excitotoxic lesions of the AcbC or sham lesions made repeated choices on an adjusting-delay schedule between a smaller reinforcer (A) that was delivered immediately and a larger reinforcer (B) that was delivered after a delay which increased or decreased depending on the subject's choices. In two phases of the experiment, reinforcer sizes were selected which enabled theoretical parameters expressing delay discounting and sensitivity to reinforcer size to be estimated from the ratio of the indifference delays (i.e. the quasi-stable values of the adjusting delay seen after extended training) obtained in the two phases. RESULTS: In both groups, indifference delays were shorter when the sizes of A and B were 14 and 25 µl than when they were 25 and 100 µl of a 0.6 M sucrose solution. Indifference delays were shorter in AcbC-lesioned than in sham-lesioned rats. Estimates of delay discounting rate based on the ratio of the indifference delays were lower in the AcbC-lesioned than in the sham-lesioned rats. The size sensitivity parameter did not differ between the groups. Adjusting delays in successive blocks of trials were analysed using Fourier transform. The period corresponding to the dominant frequency of the power spectrum and power within the dominant frequency band did not differ between the groups. CONCLUSIONS: Destruction of the AcbC increased the rate of delay discounting.

Effect of orexin-B-saporin-induced lesions of the lateral hypothalamus on performance on a progressive ratio schedule.

It has been suggested that a sub-population of orexinergic neurones whose somata lie in the lateral hypothalamic area (LHA) play an important role in regulating the reinforcing value of both food and drugs. This experiment examined the effect of disruption of orexinergic mechanisms in the LHA on performance on the progressive ratio schedule of reinforcement, in which the response requirement increases progressively for successive reinforcers. The data were analysed using a mathematical model which yields a quantitative index of reinforcer value and dissociates effects of interventions on motor and motivational processes. Rats were trained under a progressive ratio schedule using food-pellet reinforcement. They received bilateral injections of conjugated orexin-B-saporin (OxSap) into the LHA or sham lesions. Training continued for a further 40 sessions after surgery. Equations were fitted to the response rate data from each rat, and the parameters of the model were derived for successive blocks of 10 sessions. The OxSap lesion reduced the number of orexin-containing neurones in the LHA by approximately 50% compared with the sham-lesioned group. The parameter expressing the incentive value of the reinforcer was not significantly altered by the lesion. However, the parameter related to the maximum response rate was significantly affected, suggesting that motor capacity was diminished in the OxSap-lesioned group. The results indicate that OxSap lesions of the LHA disrupted food-reinforced responding on the progressive ratio schedule. It is suggested that this disruption was brought about by a change in non-motivational (motor) processes.

A clozapine-like effect of cyproheptadine on progressive ratio schedule performance.

The atypical antipsychotic drug clozapine has multiple pharmacological actions, some of which, including 5-hydroxytryptamine (5-HT2) and histamine (H1) receptor antagonist effects, are shared by the non-selective 5-HT receptor antagonist cyproheptadine. Atypical antipsychotics have a characteristic profile of action on operant behaviour maintained by progressive ratio schedules, as revealed by Killeen's (1994) mathematical model of schedule controlled behaviour. These drugs increase the values of a parameter that expresses the 'incentive value' of the reinforcer (a) and a parameter that is inversely related to the 'motor capacity' of the organism (δ). This experiment examined the effects of acute treatment with cyproheptadine and clozapine on performance on a progressive ratio schedule of food reinforcement in rats; the effects of a conventional antipsychotic, haloperidol, and two drugs with food intake-enhancing effects, chlordiazepoxide and Δ9-tetrahydrocannabinol (THC), were also examined. Cyproheptadine (1, 5 mg kg⁻¹) and clozapine (3.75, 7.5 mg kg⁻¹) increased a and δ. Haloperidol (0.05, 0.1 mg kg⁻¹) reduced a and increased δ. Chlordiazepoxide (3, 10 mg kg⁻¹) increased a but reduced δ. THC (1, 3 mg kg⁻¹) had no effect. Interpretation based on Killeen's (1994) model suggests that cyproheptadine and clozapine enhanced the incentive value of the reinforcer and impaired motor performance. Motor impairment may be due to sedation (possibly reflecting H1 receptor blockade). Enhancement of incentive value may reflect simultaneous blockade of H1 and 5-HT2 receptors, which has been proposed as the mechanism underlying the food intake-enhancing effect of cyproheptadine. In agreement with previous findings, haloperidol impaired motor performance and reduced the incentive value of the reinforcer. Chlordiazepoxide's effect on a is consistent with its food intake-enhancing effect.

Fos expression in the prefrontal cortex and nucleus accumbens following exposure to retrospective timing tasks.

The dorsal striatum and prefrontal cortex have been implicated in interval timing. We examined whether performance of temporal discrimination tasks is associated with increased neuronal activation in these areas, as revealed by Fos expression, a marker for neuronal activation. In Experiment 1, rats were trained on a discrete-trials temporal discrimination task in which a light (22 cd/m²) was presented for a variable time, t (2.5-47.5 s), after which levers A and B were presented. A response on lever A was reinforced if t < 25 s, and a response on lever B was reinforced if t > 25 s. A second group was trained on a light-intensity discrimination procedure, in which a light of variable intensity, i (3.6-128.5 cd/m²) was presented for 25 s. A response on lever A was reinforced if i < 22 cd/m², and a response on lever B was reinforced if i > 22 cd/m². In Experiment 2, bisection procedures were used to assess temporal (200-800 ms, 22 cd/m²) and light-intensity (3.6-128.5 cd/m², 400 ms) discrimination. The increase in proportional choice of lever B as a function of stimulus duration or intensity conformed to a two-parameter logistic equation. Fos expression in the prefrontal cortex and nucleus accumbens was higher in rats performing temporal discrimination tasks than in those performing light-intensity discrimination tasks, indicating greater neuronal activation in these areas during temporal discrimination tasks. Fos expression in the dorsal striatum did not differ between rats performing temporal and light-intensity discrimination tasks. These results suggest that the prefrontal cortex and nucleus accumbens are involved in temporal discrimination.

Choice between reinforcer delays versus choice between reinforcer magnitudes: differential Fos expression in the orbital prefrontal cortex and nucleus accumbens core.

Lesions of the orbital prefrontal cortex (OPFC) and the nucleus accumbens core (AcbC) can disrupt performance in inter-temporal choice tasks, possibly by increasing the organism's sensitivity to delay and/or magnitude of reinforcement. This experiment examined whether exposure to an inter-temporal choice would induce neuronal activation in these areas, as indicated by enhanced expression of the Fos protein. Twelve rats were trained to press levers A and B under an adjusting-delay schedule in which a response on A delivered 50 microl of a sucrose reinforcer after 2 or 18s, whereas a response on B delivered the same reinforcer after a delay that was adjusted in accordance with the rat's choices. Another 12 rats were trained under a similar schedule in which a response on A delivered an immediate reinforcer of size 20 or 180 microl, whereas a response on B delivered an immediate reinforcer whose size was adjusted in accordance with the rat's choices. A third group received training under a schedule that did not entail variation of reinforcer size or delay, or choice between reinforcers, and a control group underwent food restriction without behavioural training. Exposure to the adjusting-delay schedule was associated with enhanced Fos expression in both the OPFC and AcbC, whereas exposure to the adjusting-magnitude schedule was associated with enhanced Fos expression in the OPFC but not the AcbC, compared to the control group. The results are consistent with previous findings that implicated the AcbC and OPFC in delay discounting, and the OPFC in sensitivity to reinforcer size.