Relative reinforcer rates determine pigeons' attention allocation when separately trained stimuli are presented together.

Previous research suggests that organisms allocate more attention to stimuli associated with higher reinforcer rates. This finding has been replicated several times when stimuli are trained together as compounds, but not in other procedures. Thus, the generality of the relation between relative reinforcer rates and divided attention is not well established. Therefore, we investigated whether relative reinforcer rates determine attention allocation when stimuli are trained separately and then encountered together. Pigeons learned to associate two colors and two frequencies of key light on/off alternation with a left or right comparison key in a symbolic 0-s delayed matching-to-sample task. Across conditions, we varied the probability of reinforcement associated with each stimulus dimension during training. After training, we introduced test trials in which a color and flash-frequency stimulus were presented simultaneously. During sample-stimulus presentation in test trials, all pigeons preferred the stimulus associated with the higher reinforcer rate, suggesting that more attention was allocated to that stimulus. Interestingly, such attention allocation did not result in preference for the comparison that matched that stimulus. Instead, all pigeons preferred the comparison that was physically closer to the stimulus associated with the higher reinforcer rate, suggesting that comparison choice was controlled by the location of that stimulus. Nevertheless, overall, our results provide the first evidence that relative reinforcer rates determine divided attention between separately trained stimuli and thus demonstrate the generality of the relation between relative reinforcement and attention allocation. We suggest several avenues for future research to establish further the generality of this relation.

Divided stimulus control depends on differential and nondifferential reinforcement: Testing a quantitative model.

We investigated the effects of differential and nondifferential reinforcers on divided control by compound-stimulus dimensions. Six pigeons responded in a delayed matching-to-sample procedure in which a blue or yellow sample stimulus flashed on/off at a fast or slow rate, and subjects reported its color or alternation frequency. The dimension to report was unsignaled (Phase 1) or signaled (Phase 2). Correct responses were reinforced with a probability of .70, and the probability of reinforcers for errors varied across conditions. Comparison choice depended on reinforcer ratios for correct and incorrect responding; as the frequency of error reinforcers according to a dimension increased, control (measured by log d) by that dimension decreased and control by the other dimension increased. Davison and Nevin's (1999) model described data when the dimension to report was unsignaled, whereas model fits were poorer when it was signaled, perhaps due to carryover between conditions. We are the first to test this quantitative model of divided control with reinforcers for errors and when the dimension to report is signaled; hence, further research is needed to establish the model's generality. We question whether divided stimulus control is dimensional and suggest it may instead reflect joint control by compound stimuli and reinforcer ratios.

Is superstitious responding a matter of detectability? A replication of Killeen (1978).

Organisms may sometimes behave as if a contingency exists between behavior and consequences, even if this is not actually the case. Killeen (1978) suggested that such superstition occurs because of factors that bias subjects to behave "superstitiously" rather than because of failures of discrimination. We systematically replicated Killeen's experiment and compared contingency discrimination between different consequences. Six pigeons responded in a matching-to-sample procedure in which a response-independent or response-dependent stimulus change, food delivery, or blackout occurred. The pigeons reported whether the consequence was response dependent or response independent by choosing between two side keys. Discrimination was strongest after stimulus changes, weaker after blackouts, and weakest after food deliveries. These differences persisted even after additional training, suggesting asymmetries that may reflect differences in the disruptive effects of different consequences on remembering and/or behavioral mnemonics. Importantly, the pigeons were not biased to report response-dependent consequences unless that response was consistent with locational biases; that is, they behaved "superstitiously" when there was a reason to be biased to do so. These findings corroborate Killeen's and demonstrate that behavior may deviate from contingencies not necessarily because subjects cannot discriminate those contingencies but because they are biased to behave otherwise.

Revaluation of overselected stimuli: Emergence of control by underselected stimuli depends on degree of overselectivity.

Stimulus overselectivity describes strong control by one stimulus element at the expense of other equally relevant elements. Research suggests that control by underselected stimuli emerges following extinction of the overselected stimulus ("revaluation") and the emergence is larger when overselectivity is greater. We compared such revaluation effects with a control compound or condition in two experiments. Human participants chose between compound S+ and S- stimuli. Then, to assess control by compound-stimulus elements, participants chose between individual elements in a testing phase without feedback. The S+ element chosen most often (the overselected element) underwent revaluation, during which choice of that element was extinguished and choice of a novel element reinforced. Thereafter, participants completed a retesting phase. Revaluation reduced choice of the overselected element. Choice of the underselected element decreased for participants with low overselectivity but increased for participants with high overselectivity. This was not the case for a control compound that did not undergo revaluation (Experiments 1 and 2) or in a control condition in which the overselected element continued to be reinforced during revaluation (Experiment 2). These findings suggest that overselectivity levels may modulate revaluation effects, and they also highlight the importance of the contingency change in postrevaluation changes in stimulus control.

Bringing the past into the present: Control by exteroceptive stimuli and key-peck location in a concurrent-chains procedure.

We recently found that initial-link stimuli signaling trial outcomes (signals) in a concurrent-chains procedure exerted imperfect control during initial and terminal links. Here, we conducted a follow-up experiment to investigate further such imperfect control. Five pigeons worked on a concurrent-chains procedure in which one alternative led to a terminal link ending in a smaller-sooner reinforcer delivery, and the other in a larger-later reinforcer. During initial links of some trials, compound stimuli (signals) signaled the trial outcome. We assessed control by signal dimensions in Conflicting trials, in which the dimensions signaled conflicting outcomes. Unlike our previous experiment, signals remained present during terminal links. During initial links, preference favored the signaled key in Signaled trials, and the key signaled by the dimension exerting stronger control in Conflicting trials, suggesting strong signal control. Initial-link choice also depended on trial outcomes; preference was overall biased towards the smaller-sooner key. Terminal-link responding was primarily controlled by the key peck producing terminal-link entry, although some weak signal control was also evident. Thus, signal control during initial and terminal links was enhanced, and control by key-peck location during terminal links persisted, when signals remained present during terminal links. This suggests that our previous findings were partly related to temporal separation between signals and trial outcomes, and to history effects producing strong control by key-peck location.

Effects of brief post-sample cues signaling presence or absence of reinforcers in delayed matching-to-sample.

When short-term memory is assessed in the delayed matching-to-sample (DMTS) procedure, performance is better when cues signal larger reinforcer magnitudes or higher reinforcer probabilities for correct responding. Previous studies demonstrating signaled-magnitude or signaled-probability effects presented cues for a prolonged period during the sample stimulus and/or retention interval. The present study asked whether a signaled-probability effect would occur with brief post-sample cues that signaled the presence or absence of reinforcement. Five pigeons responded in a DMTS task in which sample stimuli were sometimes followed by a 0.5-s cue signaling that reinforcers would either be available or not available in the current trial, and the retention interval varied from 0.5 s to 20 s. A reliable signaled-probability effect was found when reinforcers were arranged independently and for all correct responses, whereas a smaller, less systematic effect was found when reinforcers were arranged dependently and probabilistically. These findings highlight the importance of reinforcement contingencies and contingency discriminability in remembering, and add to the evidence showing that cues signaling differential reinforcement in DMTS may affect processes during the retention interval and comparison phase, rather than attention to the sample stimulus.

Timing compound stimuli: Relative reinforcer probabilities divide stimulus control in the multiple peak procedure.

Previous research suggests that when multiple stimuli signal the location of future reinforcers, the extent of control by each stimulus depends on the relative reinforcer probability associated with that stimulus. In this experiment, we asked whether relative reinforcer probabilities also divide control between stimuli that signal the time to future reinforcers. Six pigeons responded in a multiple peak procedure in which 2 dimensions of a compound stimulus-a color (red or green) and a frequency of on/off alternation (fast or slow)-signaled a fixed-interval 2- or 8-s schedule. Across conditions, we varied the probability of reinforcer deliveries associated with each dimension from .1 to .9. Relative reinforcer probabilities determined the degree of control by each stimulus dimension; as the probability of reinforcer deliveries associated with one dimension increased, a peak in response rates at the time signaled by that dimension became apparent while a peak at the time signaled by the other dimension diminished. However, these effects of relative reinforcers were smaller than in previous research, probably because elapsed time also competed for control over behavior. These findings extend the relation between relative reinforcers and divided stimulus control from spatial to temporal discriminations. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Stimulus control depends on the subjective value of the outcome.

Stimuli that provide information about likely future reinforcers tend to shift behavior, provided a reliable relation between the stimulus and the reinforcer can be discriminated. Stimuli that are apparently more reliable exert greater control over behavior. We asked how the subjective value (measured in terms of preference) of reinforcers associated with stimuli influences stimulus control. Five pigeons worked on a concurrent chains procedure in which half of all trials ended in a smaller reinforcer sooner, and the other half in a larger reinforcer later. In Signaled trials, the color and flash duration on the keys in the initial link signaled the outcome of the trial. In Conflicting probe trials, the color and the flash duration signaled conflicting information about the outcome of the trial. Choice in Signaled trials shifted toward the signaled outcome, but was never exclusive. In Conflicting probe trials, control was divided idiosyncratically between the 2 stimulus dimensions, but still favored the outcome with the higher subjective value. Thus, stimulus control depends not only on the perceived reliability of stimuli, but also on the subjective value of the outcome.

Signaled reinforcement: Effects of signal reliability on choice between signaled and unsignaled alternatives.

When reinforcer availability on one alternative of a concurrent schedule is signaled by a discriminative stimulus, responding on that alternative decreases. We investigated how the correlation between signal presentation and reinforcement (signal reliability) affects choice between signaled and unsignaled alternatives. Six pigeons responded in a concurrent schedule, in which reinforcers on one alternative were signaled by a key-color change. Across conditions, the probability of reinforcement following signal presentation varied (the probability in its absence was the complement). As signal reliability increased, response rates and latencies following signal onset on the signaled alternative decreased, whereas responding on the unsignaled alternative remained unchanged. Because the signal did not alter overall reinforcer rates, these findings are consistent with matching theories and research suggesting that responding on one alternative of a concurrent schedule depends on reinforcer, but not response, rates on other alternatives. However, these findings are inconsistent with others demonstrating concomitant changes in responding on signaled and unsignaled alternatives. We consider whether a response-competition account of concurrent performance can explain these discrepancies, and suggest avenues for future studies to investigate the mechanisms underlying effects of signaled reinforcement in concurrent schedules.

Environment tracking and signal following in a reinforcer-ratio reversal procedure.

Several studies suggest that the degree of control by reinforcer ratios (environment tracking) and by exteroceptive stimuli that signal future reinforcer availability (signal following) depends on environmental certainty: As reinforcers become more likely at one location, environmental contingencies exert stronger control and exteroceptive stimuli exert weaker control. This research has not yet been extended to environments in which reinforcer availability changes across time, even though such changes are present in most natural environments. Thus, in the present experiment, we examined environment tracking and signal following in a concurrent schedule in which the reinforcer ratio reversed to its reciprocal 30 s after a reinforcer delivery and keylight-color stimuli signaled the likely or definite time or location of the next reinforcer. Across conditions, we manipulated environmental certainty by varying the probability of reinforcer deliveries on the locally richer key. This made the location of future reinforcers at a particular time more or less certain, but did not change the overall reinforcer ratio. Changes in local environmental certainty had little to no effect on environment tracking and signal following; in all conditions, keylight-color stimuli strongly controlled choice and reinforcer ratios exerted weak control. The present findings suggest that the extent of environment tracking and signal following is primarily determined by global, not local, environmental certainty.

Generalization of response patterns in a multiple peak procedure.

Stimulus generalization is typically assessed by analyzing overall response rates. Studies of generalization of response-rate patterns across time are less common, despite the ubiquitous nature of time and the strong temporal control over behavior in the natural world. Thus, we investigated generalization of response-rate patterns across time using a multiple peak procedure in pigeons. The frequency (fast or slow) at which the color of a keylight changed signaled a fixed-interval (FI) 5-s or 20-s schedule, counterbalanced across subjects. In peak trials, the frequency of keylight-color changes was varied. For the fast and slow training stimuli, response rates in peak trials were controlled by the arranged FI schedule value; they increased as the arranged reinforcer time approached, and decreased thereafter. Response-rate patterns to all test stimuli were similar to response-rate patterns to the slow training stimulus for all subjects. Thus, overall, strong generalization from the slow training stimulus to all test stimuli was evident, whereas there was little to no generalization from the fast training stimulus. These findings extend past research examining generalization of temporally controlled response-rate patterns, and provide a useful starting point for future investigations of generalization of fixed-interval responding. A thorough understanding of generalization processes requires analysis of dependent variables other than overall response rates, especially when responding is likely to be temporally controlled.

The effects of changeover delays on local choice.

In concurrent schedules with a changeover delay (COD), choice often strongly favours the just-reinforced alternative immediately after a reinforcer delivery. These 'preference pulses' may be caused by a change in reinforcer availability created by the COD, and/or because the COD decreases the overall probability of switching. We investigated which explanation better accounts for preference pulses by arranging concurrent schedules that allowed us to separate the COD's effects on reinforcer availability from its effects on the probability of switching. When the reinforcer ratio was 1:1, pulses were inconsistently accompanied by changes in reinforcer availability, but consistently accompanied by longer visits. These pulses appeared to be related only to the decreased probability of switching caused by the COD, providing the first evidence of pulses after reinforcers caused by the probability of switching alone. When the reinforcer ratio was 1:5 or 5:1; preference pulses were accompanied by changes in reinforcer availability and by longer visits. These pulses appeared to be related to the COD's effects on reinforcer availability, although a small portion appeared to be related to low probability of switching. These findings suggest that the COD affects preference pulses by both decreasing the probability of switching and creating a change in reinforcer availability.

How do reinforcers affect choice? Preference pulses after responses and reinforcers.

In concurrent schedules, reinforcers are often followed by a brief period of heightened preference for the just-productive alternative. Such 'preference pulses' may reflect local effects of reinforcers on choice. However, similar pulses may occur after nonreinforced responses, suggesting that pulses after reinforcers are partly unrelated to reinforcer effects. McLean, Grace, Pitts, and Hughes (2014) recommended subtracting preference pulses after responses from preference pulses after reinforcers, to construct residual pulses that represent only reinforcer effects. Thus, a reanalysis of existing choice data is necessary to determine whether changes in choice after reinforcers in previous experiments were actually related to reinforcers. In the present paper, we reanalyzed data from choice experiments in which reinforcers served different functions. We compared local choice, mean visit length, and visit-length distributions after reinforcers and after nonreinforced responses. Our reanalysis demonstrated the utility of McLean et al.'s preference-pulse correction for determining the effects of reinforcers on choice. However, visit analyses revealed that residual pulses may not accurately represent reinforcer effects, and reinforcer effects were clearer in visit analyses than in local-choice analyses. The best way to determine the effects of reinforcers on choice may be to conduct visit analyses in addition to local-choice analyses.

D-PLACE: A Global Database of Cultural, Linguistic and Environmental Diversity.

From the foods we eat and the houses we construct, to our religious practices and political organization, to who we can marry and the types of games we teach our children, the diversity of cultural practices in the world is astounding. Yet, our ability to visualize and understand this diversity is limited by the ways it has been documented and shared: on a culture-by-culture basis, in locally-told stories or difficult-to-access repositories. In this paper we introduce D-PLACE, the Database of Places, Language, Culture, and Environment. This expandable and open-access database (accessible at https://d-place.org) brings together a dispersed corpus of information on the geography, language, culture, and environment of over 1400 human societies. We aim to enable researchers to investigate the extent to which patterns in cultural diversity are shaped by different forces, including shared history, demographics, migration/diffusion, cultural innovations, and environmental and ecological conditions. We detail how D-PLACE helps to overcome four common barriers to understanding these forces: i) location of relevant cultural data, (ii) linking data from distinct sources using diverse ethnonyms, (iii) variable time and place foci for data, and (iv) spatial and historical dependencies among cultural groups that present challenges for analysis. D-PLACE facilitates the visualisation of relationships among cultural groups and between people and their environments, with results downloadable as tables, on a map, or on a linguistic tree. We also describe how D-PLACE can be used for exploratory, predictive, and evolutionary analyses of cultural diversity by a range of users, from members of the worldwide public interested in contrasting their own cultural practices with those of other societies, to researchers using large-scale computational phylogenetic analyses to study cultural evolution. In summary, we hope that D-PLACE will enable new lines of investigation into the major drivers of cultural change and global patterns of cultural diversity.

Pulotu: Database of Austronesian Supernatural Beliefs and Practices.

Scholars have debated naturalistic theories of religion for thousands of years, but only recently have scientists begun to test predictions empirically. Existing databases contain few variables on religion, and are subject to Galton's Problem because they do not sufficiently account for the non-independence of cultures or systematically differentiate the traditional states of cultures from their contemporary states. Here we present Pulotu: the first quantitative cross-cultural database purpose-built to test evolutionary hypotheses of supernatural beliefs and practices. The Pulotu database documents the remarkable diversity of the Austronesian family of cultures, which originated in Taiwan, spread west to Madagascar and east to Easter Island-a region covering over half the world's longitude. The focus of Austronesian beliefs range from localised ancestral spirits to powerful creator gods. A wide range of practices also exist, such as headhunting, elaborate tattooing, and the construction of impressive monuments. Pulotu is freely available, currently contains 116 cultures, and has 80 variables describing supernatural beliefs and practices, as well as social and physical environments. One major advantage of Pulotu is that it has separate sections on the traditional states of cultures, the post-contact history of cultures, and the contemporary states of cultures. A second major advantage is that cultures are linked to a language-based family tree, enabling the use phylogenetic methods, which can be used to address Galton's Problem by accounting for common ancestry, to infer deep prehistory, and to model patterns of trait evolution over time. We illustrate the power of phylogenetic methods by performing an ancestral state reconstruction on the Pulotu variable "headhunting", finding evidence that headhunting was practiced in proto-Austronesian culture. Quantitative cross-cultural databases explicitly linking cultures to a phylogeny have the potential to revolutionise the field of comparative religious studies in the same way that genetic databases have revolutionised the field of evolutionary biology.