Philosophical behaviorism: a review of things that happen because they should: a teleological approach to action, by Rowland Stout.

Mentalistic terms such as belief and desire have been rejected by behavior analysts because they are traditionally held to refer to unobservable events inside the organism. Behavior analysis has consequently been viewed by philosophers to be at best irrelevant to psychology, understood as a science of the mind. In this book, the philosopher Rowland Stout argues cogently that beliefs and desires (like operants such as rats' lever presses) are best understood in terms of an interaction over time between overt behavior and its overt consequences (a viewpoint called teleological behaviorism). This book is important because it identifies the science of the mind with the science of overt behavior and implies that the psychologists best equipped to study mental life are not those who purport to do so but those who focus on the experimental analysis of behavior.

Self-control and social cooperation.

Participants repeatedly played a self-control game in which choice of the higher of two monetary rewards on the present trial reduced the overall reward ('alone condition'). Other participants played a prisoner's dilemma (social cooperation) game in which choices alternated so that overall reward-reducing consequences of choosing the higher current amount were experienced by the other player ('together condition'). Participants playing the self-control game chose the lower current amount (and higher overall reward) significantly more frequently than did those playing the social cooperation game. In a second phase, half of the subjects who had played the self-control game played the social cooperation game and vice-versa. Little or no transfer was observed between conditions. In a second experiment, raising the amount of the next-trial reward increased self-control but not social cooperation. Some transfer between self-control and social cooperation was observed. The crucial variable responsible for participants' better performance (closer to optimization) in the self-control game compared to the social cooperation game may have been the higher probability in the former that choice of the lower reward on the present trial would be repeated on subsequent trials.

Commitment using punishment.

Experimental parameters were adjusted so that pigeons' pairwise choices among three alternatives reflected the following order of preference: (a) a smaller-sooner reinforcer, (b) a larger-later reinforcer, and (c) the smaller-sooner reinforcer followed by a punishment (consisting of an extended blackout period). After this order of preference was established, the pigeons were exposed to a two-link, concurrent-chain-like choice procedure. One terminal link consisted of a choice between the smaller-sooner and the larger-later reinforcer; the other terminal link was identical to the first except that the smaller-sooner reinforcer was followed by blackout punishment. The pigeons' preference (in their initial-link choice) for the terminal link with the punished smaller-sooner alternative increased as the delay between the initial and terminal links increased. By choosing this terminal link, the pigeons are said to have "committed" themselves to obtaining the larger-later reinforcer. However, unlike prior studies of commitment (e.g., Rachlin & Green, 1972), it was still possible after making the commitment for the pigeons to choose the smaller-sooner reinforcer and undergo the punishment. The pigeons did in fact occasionally make this highly deleterious choice.

Behavioral economics without anomalies.

Behavioral economics is often conceived as the study of anomalies superimposed on a rational system. As research has progressed, anomalies have multiplied until little is left of rationality. Another conception of behavioral economics is based on the axiom that value is always maximized. It incorporates so-called anomalies either as conflicts between temporal patterns of behavior and the individual acts comprising those patterns or as outcomes of nonexponential time discounting. This second conception of behavioral economics is both empirically based and internally consistent.

Soft commitment: self-control achieved by response persistence.

With reinforcement contingent on a single peck on either of two available keys (concurrent continuous reinforcement schedules) 4 pigeons, at 80% of free-feeding weights, preferred a smaller-sooner reinforcer (2.5 s of mixed grain preceded by a 0.5-s delay) to a larger-later reinforcer (4.5 s of mixed grain preceded by a 3.5-s delay). However, when the smaller-sooner and larger-later reinforcers were contingent on a concurrent fixed-ratio 31 schedule (the first 30 pecks distributed in any way on the two keys), all pigeons obtained the larger-later reinforcer much more often than they did when only a single peck was required. This "self-control" was achieved by beginning to peck the key leading to the larger-later reinforcer and persisting on that key until reinforcement occurred. We call this persistence "soft commitment" to distinguish it from strict commitment, in which self-control is achieved by preventing changeovers. Soft commitment also effectively achieved self-control when a brief (1-s) signal was inserted between the 30th and 31st response of the ratio and with concurrent fixed-interval 30-s schedules (rather than ratio schedules) of reinforcement. In a second experiment with the same subjects, the fixed ratio was interrupted by darkening both keys and lighting a third (center) key on which pecking was required for various fractions of the fixed-ratio count. The interruption significantly reduced self-control. When interruption was complete (30 responses on the center key followed by a single choice response), pigeons chose the smaller-sooner reinforcer as frequently as they did when only a single choice response was required.

Teleological behaviorism.

A psychological science of efficient causes, using internal mechanisms to explain overt behavior, is distinguished from another psychological science, based on Aristotelian final causes, using external objects and goals to explain overt behavior. Efficient-cause psychology is designed to answer the question of how a particular act is emitted; final-cause psychology is designed to answer the question of why a particular act is emitted. Physiological psychology, modern cognitive psychology, and some parts of behaviorism including Skinnerian behaviorism are efficient-cause psychologies; final-cause psychology, a development of Skinnerian behaviorism, is here called teleological behaviorism. Each of these two conceptions of causality in psychology implies a different view of the mind, hence a different meaning of mental terms.

Diminishing marginal value as delay discounting.

The fundamental law underlying economic demand and exchange is the tendency for value of marginal units to diminish with increasing amounts of a commodity. The present paper demonstrates that this law follows from three still-more-basic psychological assumptions: (a) limited consumption rate, (b) delay discounting, and (c) choice of highest valued alternative. Cases of diminishing marginal value apparently due to pure intensity of reward may plausibly be attributed to the above three factors. The further assumption that maximum consumption rate may vary within and across individuals implies that some substances may be unusually addictive and that some individual animals may be unusually susceptible to addiction.

Economic substitutability of electrical brain stimulation, food, and water.

Concurrent variable-ratio schedules of electrical brain stimulation, food, and water were paired in various combinations as reinforcement of rats' lever presses. Relative prices of the concurrent reinforcers were varied by changing the ratio of the response requirements on the two levers. Economic substitutability, measured by the sensitivity of response ratio to changes in relative price, was highest with brain stimulation reinforcement of presses on both levers and lowest with food reinforcement of presses on one lever and water reinforcement of presses on the other. Substitutability with brain stimulation reinforcement of presses on one lever and either food or water reinforcement for presses on the other was about as high as with brain stimulation for presses on both levers. Electrical brain stimulation for rats may thus serve as an economic substitute for two reinforcers, neither of which is substitutable for the other.

Subjective probability and delay.

Human subjects indicated their preference between a hypothetical $1,000 reward available with various probabilities or delays and a certain reward of variable amount available immediately. The function relating the amount of the certain-immediate reward subjectively equivalent to the delayed $1,000 reward had the same general shape (hyperbolic) as the function found by Mazur (1987) to describe pigeons' delay discounting. The function relating the certain-immediate amount of money subjectively equivalent to the probabilistic $1,000 reward was also hyperbolic, provided that the stated probability was transformed to odds against winning. In a second experiment, when human subjects chose between a delayed $1,000 reward and a probabilistic $1,000 reward, delay was proportional to the same odds-against transformation of the probability to which it was subjectively equivalent.

Is there a decisive test between matching and maximizing?

Reinforcers under typical concurrent variable-interval, variable-ratio schedules may be (a) earned and obtained during the variable-interval component, (b) earned and obtained during the variable-ratio component, or (c) earned during the variable-ratio component and obtained during the variable-interval component. Categories a and b, which have no bearing on matching versus maximizing accounts of choice, were set at zero. The rate of Category c reinforcers and the duration of a changeover delay were varied. Simple matching, which predicts exclusive choice of the variable-interval component, and strict maximizing of overall reinforcement rate, which predicts a bias towards the variable-ratio component, were both disconfirmed: Subjects spent approximately 25% of their time in the variable-ratio component, contrary to the matching prediction, but earned only about one third of the reinforcers predicted by strict maximizing. However, maximizing describes the findings functionally in terms of discounting of delayed reinforcers; matching may describe the data in terms of a restructuring of the alternatives. Matching and maximizing are not competing theories about the fundamental nature of choice, but compatible points of view that may reveal environmental function and behavioral structure.

Probability and delay in commitment.

In the first stage of a two-stage choice, human subjects chose between probabilistic access to a second choice (between a small high-probability reward and a large low-probability reward) and commitment to the large low-probability reward. When confronted with the second-stage choice, subjects strongly preferred the small high-probability reward. When the first-stage probability (of access to the second stage) was high, subjects strongly preferred the path leading to the choice in the second stage. But when the first-stage probability was low, subjects committed themselves to the large low-probability reward. These results parallel those obtained by Rachlin and Green (1972) with pigeons and constitute some evidence that probabilities may be interpreted as delays.

Matching and maximizing with concurrent ratio-interval schedules.

Animals exposed to standard concurrent variable-ratio variable-interval schedules could maximize overall reinforcement rate if, in responding, they showed a strong response bias toward the variable-ratio schedule. Tests with the standard schedules have failed to find such a bias and have been widely cited as evidence against maximization as an explanation of animal choice behavior. However, those experiments were confounded in that the value of leisure (behavior other than the instrumental response) partially offsets the value of reinforcement. The present experiment provides another such test using a concurrent procedure in which the confounding effects of leisure were mostly eliminated while the critical aspects of the concurrent variable-ratio variable-interval contingency were maintained: Responding in one component advanced only its ratio schedule while responding in the other component advanced both ratio schedules. The bias toward the latter component predicted by maximization theory was found.

Eating and drinking: An economic analysis.

Food-deprived rats were exposed to various schedules of food delivery; water-deprived rats were exposed to various schedules of water delivery. Eating and drinking were measured over sessions and at points throughout sessions. The symmetries and asymmetries of food and water consumption were explored in terms of: (1) substitutability of food versus water, and of food and water on the one hand versus leisure on the other, (2) constraints imposed by various schedules of food and water, and (3) the tendency of rats to maximize utility within the imposed constraints.

Syntheses, analgetic activity, and physical dependence capacity of 5-phenyl-6,7-benzomorphan derivatives.

The synthesis, analgetic activity, and physical dependence capacity of a large number of 5-phenyl-6,7-benzomorphan derivatives are described. Observations made during the Stevens' rearrangement of 1-benzyl-1-methyl-delta 3-piperidinium salt derivatives (V) under various conditions are discussed. The absolute configuration of the 9-demethyl series and the 2'-deoxy series is established by comparison of their ORD and CD spectra with those of 49, whose absolute configuration was previously established by X-ray crystallography. A convenient synthesis of 3H-labeled phenols using 3H3PO4 is described, as well as the preparation of 14C-labeled compounds by conventional methods.

A molar theory of reinforcement schedules.

Behavior of subjects exposed to concurrent and individual interval and ratio schedules of reinforcement may be described in terms of a set of expressions relating the value of responses to their durations, a feedback equation relating reinforcement to response duration, and the assumption that subjects allocate their time among various responses so as to maximize value.

Pigeons' preferences for stimulus information: effects of amount of information.

A concurrent-chain procedure was used to study pigeons' preferences as a function of amount of information. Pigeons chose between two terminal links. Both terminal links ended in food reinforcement with probability (p) and in blackout with probability (1-p). One terminal link (noninformative link) was signalled by a stimulus uncorrelated with either food or blackout. The other terminal link (informative link) was signalled by stimuli correlated with these outcomes. Amount of information conveyed by these stimuli was varied across conditions by changing the probability of reinforcement (p) and blackout (1-p). The pigeons strongly preferred the informative link, and preferences were greater at p values above 0.50 than for their complements. The pigeons engaged in different behaviors during the stimulus periods, suggesting that the value of informative stimuli may be in their function as discriminative stimuli for interim activities and terminal responses.

Economic and biological influences on a pigeon's key peck.

Pigeons were studied in a two-component multiple schedule. In the first phase of the experiment, key pecks were reinforced on a variable-interval 2-min schedule in both components and free food was delivered additionally during one component. When components alternated every 8 sec, all pigeons pecked at a much higher rate during the component with free food than during the other component. At a component duration of 16 min, the reverse was true: all pigeons pecked at a higher rate during the component without free food. In the second phase, the additional food during one component was made contingent on pecking. Responding during the component without the extra food remained essentially unchanged, as expected, since rate of reinforcement remained identical to that in the previous phase. However, rate of responding during the component with the extra food (now contingent on pecking) was elevated, compared to the rate in the first phase, and did not show the marked decline as component duration was increased.