Avoidance sessions as aversive events.

Rats living continuously in conditioning chambers were permitted to work for food before and after their daily avoidance sessions. The avoidance procedure disrupted this responding reinforced by food, a result that indicates conditioned suppression on a time scale much greater than that previously studied in nonhuman animals.

Training and maintenance of keypecking in the pigeon by negative reinforcement.

Pigeons were trained to peck a key to escape a pulsing shock of linearly increasing intensity. As the rate of increase was varied from 0.0374 milliamperes per minute to 37.4 milliamperes per minute, the intensity at which most pecking occurred varied from 2.2 to 5.0 milliamperes.

A self-interpretive behavior analysis.

Although it rejects self-awareness as psychological bedrock, behavior-analytic theory can be stated self-inclusively, keeping the theorist within view. Its principles of discrimination and generalization have been elaborated to include concepts and higher order conditionalities, including those of logic and of awareness. Its violating a cultural bias that is called the "fundamental attribution error" may be a primary source of controversies. Its other disagreements with mainstream psychologies hinge more on contiguous versus remote causation than on mentalism versus antimentalism, which Skinner emphasized. The nonmediational, Skinnerian theorist is a participation in the world rather than an isolated self.

Ethanol consumption and the matching law: a choice analysis using a limited-access paradigm.

Choice analyses, especially R. J. Herrnstein's (1961, 1970) matching law, have recently been extended to substance abuse and drug research. The experiment reported here used a limited-access paradigm to engender ethanol consumption in Sprague-Dawley rats (Rattus norvegicus). After stable ethanol consumption was established, several 2-bottle choice tests were run. Relative volumes of solutions consumed were compared to relative ethanol concentrations as an application of the matching law. The formula for the generalized matching law confirmed that although biases varied, they were small, and more important, sensitivities to the relative concentrations were positive in 24 of 28 subjects. The results also revealed a high positive correlation between baseline ethanol consumption (g/kg) and subsequently assessed sensitivity. Overall, these findings suggest that a matching law analysis can be useful for examining ethanol intake in randomly bred rats.

Warmup in avoidance as a function of time since prior training.

On avoidance procedures, rats and pigeons typically show warmup effects, characterized by improving performance within sessions and loss of the improvement ("warmup decrement") between sessions. Between-session losses were examined by varying the time between periods of avoidance training. In one experiment, rats lived fulltime in conditioning chambers while intermission intervals were varied. In a second experiment, the animals lived in home cages between sessions; timeout intervals were introduced at midession, producing recurrence of warmup in the second half-session. In both experiments, the warmup decrements increased substantially as the timeout or intersession intervals were increased from zero to 30 minutes. With intervals of 60 or 120 minutes, the decrements approached or exceeded those obtained with intervals of a day or more. When avoidance was interposed between appetitive sessions, the appetitive responding was disrupted, but this seemed unrelated to the warmup or to the proficiency of avoidance. The warmup in avoidance shares characteristics with transient punishment effects, with the Kamin effect, and with habituation phenomena, but it is premature to assume that they reflect common processes.

Warmup in free-operant avoidance as a function of the response-shock = shock-shock interval.

Warmup effects, the repeated within-session transitions from ineffective to effective avoidance, were examined with rats on free-operant shock-delay procedures. The shock-shock and response-shock intervals were kept equal as they were varied. As measured by both response rates and shock rates, the magnitude of within-session change in performance was inversely related to the size of the manipulated intervals. The duration of warmup tended to decrease as the intervals were increased. This finding, that increased shock frequencies do not shorten the warmup, appears to be inconsistent with all interpretations of the warmup that have been offered to date. Late-session performances replicated general features of prior experiments, but differed with respect to details of secondary conclusions in previous reports. These differences may stem from the selection of especially proficient avoiders for previous experiments.

Beyond the molar-molecular distinction: we need multiscaled analyses.

Dinsmoor's (2001) adherence to molecular analyses may require him to assert that molar and molecular principles are mutually exclusive, but to instead analyze the phenomena of avoidance as inherently multiscaled is to follow a well-established practice in the natural sciences. Besides the issue of scale, two-factor theory, which Dinsmoor advocates, has little to say about some important and longstanding results in experiments that qualify as avoidance.

Negative reinforcement without shock reduction.

Stable lever-press responding in rats was reliably produced and maintained by a procedure in which responses could delay shocks without affecting overall shock frequency. Responding was not maintained when the delay-of-shock involved an increase in overall shock frequency.

Aversive control: A separate domain?

Traditionally, aversive control has been viewed as a separate domain within behavior theory. Sometimes this separateness has been based upon a distinction between reinforcement and punishment, and sometimes upon a distinction between positive and negative reinforcement. The latter is regarded here as the more compelling basis, due to some inherent procedural asymmetries. An approach to the interpretation of negative reinforcement is presented, with indication of types of experiments that support it and that also point to promising directions for further work. However, most of the interpretive issues that arise here are relevant to positively reinforced behavior as well. These include: possible reformulation of the operant/respondent distinction; the place of emotional concepts in behavior analysis; the need for simultaneous, complementary analysis on differing time scales; the understanding of behavioral situations with rewarding or aversive properties that depend as much upon the contingencies that the situations involve as upon the primary rewarding or aversive stimuli that they include. Thus, an adequate understanding of this domain, which has been traditionally viewed as distinct, has implications for all domains of behavior-analytic theory.

Notes on fixed-ratio and fixed-interval escape responding in the pigeon.

After learning to peck a key when each peck removed a slowly increasing series of electric shocks, pigeons were placed on fixed-ratio and fixed-interval escape schedules. The resulting behavior was comparable to that of other species on ratio and interval escape schedules. Thus, while the pigeon apparently requires special techniques for the initial shaping of a key-peck response with negative reinforcement, this response, once obtained, can be subjected to intermittent schedules of negative reinforcement with no great difficulty.

Escape and avoidance of shock by pigeons pecking a key.

Pigeons had been trained to peck a key when each peck removed a slowly increasing series of electric shocks. Without loss of the established key-pecking response, the birds were gradually weaned from this procedure to one where intense shocks were presented suddenly, duplicating features that had proved ineffective for initial shaping of the response. Finally, a procedure was introduced in which key pecks could avoid shock. Avoidance responding was maintained in two of three pigeons.

Timing in free-operant and discrete-trial avoidance.

A procedure ("discrete-trial" avoidance) was devised to differentiate between the two main theories of responding in Sidman's "free-operant" avoidance procedure. One theory, a version of two-factor theory, holds that responding is reinforced by the removal of a conditioned aversive stimulus. The conditioned aversive stimulus is held to be temporal, which accounts for the spaced responding, or timing, that Sidman's procedure produces. The other theory holds that the reinforcement for both responding and timing is shock-frequency reduction. The new procedure eliminated this reinforcement for timing, but retained the conditions for the formation of conditioned aversive temporal stimuli. According to one theory, the new procedure should have sustained timing as well as Sidman's, while according to the other, it should have sustained no timing. The results confirmed neither theory. Timing was found with both procedures, but unequally in degree and kind. Large variations in the precision of timing did not appear to be correlated with successful avoidance for either procedure.

Negative reinforcement as shock-frequency reduction.

Is a conditioned aversive stimulus necessary in avoidance conditioning? Or is a reduction in the rate of aversive stimulation alone sufficient to generate and maintain an avoidance response? Rats were subjected to an avoidance procedure in which shocks occurred randomly in time, but a response could reduce the overall rate of shock. Fifteen acquisition curves, obtained from 16 animals, showed both immediate and delayed, rapid and gradual increases in response rate; there was no representative acquisition curve. Response rates were directly related to the amount by which the response reduced shock frequency. In extinction, when shock rates were not affected by responding, the response total was inversely related to the amount by which the response had reduced shock frequency during prior conditioning, with as many as 20,000 extinction responses when the shock frequency reduction had been relatively small. Responding on this procedure shows that avoidance conditioning can occur without benefit of either classical exteroceptive stimuli or covert stimuli inferred from the temporal constancies of a procedure. It also shows that reduction in shock rate is alone sufficient to maintain avoidance.

Remote effects of aversive contingencies: Disruption of appetitive behavior by adjacent avoidance sessions.

Disruption of ongoing appetitive behavior before and after daily avoidance sessions was examined. After baselines of appetitive responding were established under a fixed-interval 180-s schedule of food presentation, 4 rats were exposed to 40-min sessions of the appetitive schedule just prior to 100-min sessions of electric shock postponement, while another 4 rats received the 40-min appetitive sessions just following daily sessions of shock postponement. In all 8 subjects, fixed-interval response rates decreased relative to baseline levels, the effect being somewhat more pronounced when the avoidance sessions immediately followed. The disruption of fixed-interval responding was only partially reversed when avoidance sessions were discontinued. During the initial exposure to the avoidance sessions, patterns of responding under the fixed-interval schedule were differentially sensitive to disruption, with high baseline response rates generally more disturbed than low rates. These disruptions were not systematically related to changes in reinforcement frequency, which remained fairly high and invariant across all conditions of the experiment; they were also not systematically related to the response rates or to the shock rates of the adjacent avoidance sessions. The results, while qualitatively resembling patterns of conditioned suppression as typically studied, occurred on a greatly expanded time scale. As disruption of behavior extending over time, the present data suggest that some forms of conditioned suppression are perhaps best viewed within a larger temporal context.

Choice in situations of time-based diminishing returns: immediate versus delayed consequences of action.

Pigeons chose between two schedules of food presentation, a fixed-interval schedule and a progressive-interval schedule that began at 0 s and increased by 20 s with each food delivery provided by that schedule. Choosing one schedule disabled the alternate schedule and stimuli until the requirements of the chosen schedule were satisfied, at which point both schedules were again made available. Fixed-interval duration remained constant within individual sessions but varied across conditions. Under reset conditions, completing the fixed-interval schedule not only produced food but also reset the progressive interval to its minimum. Blocks of sessions under the reset procedure were interspersed with sessions under a no-reset procedure, in which the progressive schedule value increased independent of fixed-interval choices. Median points of switching from the progressive to the fixed schedule varied systematically with fixed-interval value, and were consistently lower during reset than during no-reset conditions. Under the latter, each subject's choices of the progressive-interval schedule persisted beyond the point at which its requirements equaled those of the fixed-interval schedule at all but the highest fixed-interval value. Under the reset procedure, switching occurred at or prior to that equality point. These results qualitatively confirm molar analyses of schedule preference and some versions of optimality theory, but they are more adequately characterized by a model of schedule preference based on the cumulated values of multiple reinforcers, weighted in inverse proportion to the delay between the choice and each successive reinforcer.

Pigeons' choices between fixed-ratio and linear or geometric escalating schedules.

Four related procedures provided a basis for comparing the linear-optimality principle with a principle based on the sums of reciprocals of distances to reinforcement, and to explore the generality of the sums-of-reciprocals principle as a description of choice patterns in situations of diminishing returns. The procedures all arranged choices between fixed-ratio schedules and progressive-ratio schedules, which escalated with each consecutive choice. In contrast to previous work that involved constant ratio increments, two sets of procedures in this study involved relatively small increments that are similar to the early values when a progressive schedule is increasing proportionally. The remaining two sets of procedures examined progressive schedules with proportional increments. In addition, the initial value of the progressive alternative was manipulated to determine its effects on patterns of choice with both linear and proportional types of escalation. With the exception of one phase, regardless of the initial/reset value and the patterns of escalation, patterns of choice with pigeons were well characterized by the sums-of-reciprocals principle. This supports previous research with pigeons using fixed-increment progressive schedules, as well as situations in which the progressive schedule increased by constant proportions instead of by constant increments. The findings are attributed to the feature of this averaging technique whereby it differentially values reinforcers based on their relative proximity to a particular choice point.

Effects of fixed and variable ratios on human behavioral variability.

The effect that ratio schedules of reinforcement had upon variability of responding was investigated in college students. Subjects were paid $0.02 contingent upon completion of eight presses, distributed in any combination across two push buttons; 256 different sequences were possible. Sequence emission was reinforced according to fixed- and variable-ratio schedules. Ratio requirements of 1, 2, 4 and 8 were presented in alternate components of a multiple schedule. The variability engendered by variable-ratio schedules was also compared to that engendered by fixed ratios. Variability increased with ratio size, irrespective of whether the schedule requirement was fixed or variable. The data demonstrate the similarity between the determinants of human and nonhuman variability, and they illustrate the role of ratio size in determining variability in operant behavior.

The puzzle of responding maintained by response-contingent shock.

Four squirrel monkeys were first exposed to a sequence of procedures that reliably generate responding maintained by brief response-contingent electric shocks arranged according to a fixed-interval schedule. After responding had become stable on the fixed-interval schedule, additional contingencies were added in tandem, whereby after completion of the interval, the spacing of responses affected shock delivery. In one procedure, responses had to be spaced more widely than their previous median value if shock were to be delivered. In the other procedure, responses had to be spaced more closely to produce shock. On the first of these procedures, decreased but stable responses rates would indicate that shock functioned as a positive reinforcer; on the second, increased response rates would indicate the positively reinforcing function. Instead, response rates accelerated on the procedure that targeted more widely spaced responses for shock delivery, and decelerated or ceased on the procedure that arranged for shocks to be produced by more closely spaced responses. Consistent with other recent findings, these results question the interpretation of performances maintained by response-contingent shock as engendered by positive reinforcement and are consistent with aversive-control interpretations. The details of that aversive control are not entirely clear, however, and these same procedures would be informative if applied to shock-maintained behavior that is generated in other ways.

Preference between variable-ratio and fixed-ratio schedules: local and extended relations.

Although it has repeatedly been demonstrated that pigeons, as well as other species, will often choose a variable schedule of reinforcement over an equivalent (or even richer) fixed schedule, the exact nature of that controlling relation has yet to be fully assessed. In this study pigeons were given repeated choices between concurrently available fixed-ratio and variable-ratio schedules. The fixed-ratio requirement (30 responses) was constant throughout the experiment, whereas the distribution of individual ratios making up the variable-ratio schedule changed across phases: The smallest and largest of these components were varied gradually, with the mean variable-ratio requirement constant at 60 responses. The birds' choices of the variable-ratio schedule tracked the size of the smallest variable-ratio component. A minimum variable-ratio component at or near 1 produced strong preference for the variable-ratio schedule, whereas increases in the minimum variable-ratio component resulted in reduced preference for the variable-ratio schedule. The birds' behavior was qualitatively consistent with Mazur's (1984) hyperbolic model of delayed reinforcement and could be described as approximate maximizing with respect to reinforcement value.

Pigeons' choices in situations of diminishing returns: fixed- versus progressive-ratio schedules.

In two different discrete-trial procedures, pigeons were faced with choices between fixed-ratio and progressive-ratio schedules. The latter schedules entail diminishing returns, a feature analogous to foraging situations in the wild. In the first condition (no reset), subjects chose between a progressive-ratio schedule that increased in increments of 20 throughout a session and a fixed-ratio schedule that was constant across blocks of sessions. The size of the fixed ratio was varied parametrically through an ascending and then a descending series. In the reset condition, the same fixed-ratio values were used, but each selection (and completion) of the fixed ratio reset the progressive-ratio schedule back to its minimal value. In the no-reset procedure, the pigeons tended to cease selecting the progressive ratio when it equaled or slightly exceeded the fixed-ratio value, whereas in reset, they chose the fixed ratio well in advance of that equality point. These results indicate sensitivity to molar as well as to molecular reinforcement rates, and those molar relationships are similar to predictions based on the marginal value theorem of optimal foraging theory (e.g., Charnov, 1976). However, although previous results with monkeys (Hineline & Sodetz, 1987) appeared to minimize responses per reinforcement, the present results corresponded more closely to predictions based on sums-of-reciprocals of distance from point of choice to each of the next four reinforcers. Results obtained by Hodos and Trumbule (1967) with chimpanzees in a similar procedure were intermediate between these two relationships. Variability of choices, as well as median choice points, differed between the reset and no-reset conditions.(ABSTRACT TRUNCATED AT 250 WORDS)