Paradoxical choice and the reinforcing value of information.

Signals that reduce uncertainty can be valuable because well-informed decision-makers can better align their preferences to opportunities. However, some birds and mammals display an appetite for informative signals that cannot be used to increase returns. We explore the role that reward-predictive stimuli have in fostering such preferences, aiming at distinguishing between two putative underlying mechanisms. The 'information hypothesis' proposes that reducing uncertainty is reinforcing per se, somewhat consistently with the concept of curiosity: a motivation to know in the absence of tractable extrinsic benefits. In contrast, the 'conditioned reinforcement hypothesis', an associative account, proposes asymmetries in secondarily acquired reinforcement: post-choice stimuli announcing forthcoming rewards (S+) reinforce responses more than stimuli signalling no rewards (S-) inhibit responses. In three treatments, rats faced two equally profitable options delivering food probabilistically after a fixed delay. In the informative option (Info), food or no food was signalled immediately after choice, whereas in the non-informative option (NoInfo) outcomes were uncertain until the delay lapsed. Subjects preferred Info when (1) both outcomes were explicitly signalled by salient auditory cues, (2) only forthcoming food delivery was explicitly signalled, and (3) only the absence of forthcoming reward was explicitly signalled. Acquisition was slower in (3), when food was not explicitly signalled, showing that signals for positive outcomes have a greater influence on the development of preference than signals for negative ones. Our results are consistent with an elaborated conditioned reinforcement account, and with the conjecture that both uncertainty reduction and conditioned reinforcement jointly act to generate preference.

Anterior Temporal Lobe Tracks the Formation of Prejudice.

Despite advances in understanding the brain structures involved in the expression of stereotypes and prejudice, little is known about the brain structures involved in their acquisition. Here, we combined fMRI, a task involving learning the valence of different social groups, and modeling of the learning process involved in the development of biases in thinking about social groups that support prejudice. Participants read descriptions of valenced behaviors performed by members of novel social groups, with majority groups being more frequently encountered during learning than minority groups. A model-based fMRI analysis revealed that the anterior temporal lobe tracked the trial-by-trial changes in the valence associated with each group encountered in the task. Descriptions of behavior by group members that deviated from the group average (i.e., prediction errors) were associated with activity in the left lateral PFC, dorsomedial PFC, and lateral anterior temporal cortex. Minority social groups were associated with slower acquisition rates and more activity in the ventral striatum and ACC/dorsomedial PFC compared with majority groups. These findings provide new insights into the brain regions that (a) support the acquisition of prejudice and (b) detect situations in which an individual's behavior deviates from the prejudicial attitude held toward their group.

SSRI enhances sensitivity to background outcomes and modulates response rates: A randomized double blind study of instrumental action and depression.

Serotonin reuptake inhibitors (SSRIs) have immediate effects on synaptic levels of serotonin but their therapeutic effects are often delayed. This delay has been suggested to reflect time required for new learning and therefore that SSRIs might be having effects on the learning process. We examined the effects of elevating serotonin levels, through short-term SSRI administration (escitalopram), on learning about perceptions of instrumental control. A randomised double blind procedure was used to allocate healthy people, categorised as mildly depressed (high BDI⩾10: n=76) or not depressed (low BDI⩽5: n=78) to either a drug (escitalopram, 10mg/7days) or placebo control group. Following treatment, participants were trained with a simple task that involved learning the effectiveness of an instrumental action (key press) and the background context at eliciting an outcome (auditory cue) where there was no programmed contingency. The effects of the drug were (i) to moderate response rates and (ii) to enhance sensitivity to the background or context rate of occurrence of the outcome. These findings suggest that serotonin modulates learning about the long-term rate of outcomes, which supports perception of instrumental control, and that this may provide a clue to the mechanism for supporting the development of the therapeutic effects of the drug.

High trait anxiety during adolescence interferes with discriminatory context learning.

Persistent adult anxiety disorders often begin in adolescence. As emphasis on early treatment grows, we need a better understanding of how adolescent anxiety develops. In the current study, we used a fear conditioning paradigm to identify disruptions in cue and context threat-learning in 19 high anxious (HA) and 24 low anxious (LA) adolescents (12-17years). We presented three neutral female faces (conditioned stimulus, CS) in three contingent relations with an unconditioned stimulus (UCS, a shrieking female scream) in three virtual room contexts. The degree of contingency between the CSs and the UCSs varied across the rooms: in the predictable scream condition, the scream followed the face on 100% of trials; in the unpredictable scream condition, the scream and face appeared randomly and independently of each other; in the no-scream condition the CS was presented in the absence of any UCS. We found that the LA adolescents showed higher levels of fear-potentiated startle to the faces relative to the rooms. This difference was independent of the contingency condition. The HA adolescents showed non-differential startle between the CSs, but, in contrast to previous adult data, across both cue types displayed lowest startle to the unpredictable condition and highest startle to the no-scream condition. Our study is the first to examine context conditioning in adolescents, and our results suggest that high trait anxiety early in development may be associated with an inability to disambiguate the signalling roles of cues and contexts, and a mislabelling of safety or ambiguous signals.

Does the inherence heuristic take us to psychological essentialism?

We argue that the claim that essence-based causal explanations emerge, hydra-like, from an inherence heuristic is incomplete. No plausible mechanism for the transition from concrete properties, or cues, to essences is provided. Moreover, the fundamental shotgun and storytelling mechanisms of the inherence heuristic are not clearly enough specified to distinguish them, developmentally, from associative or causal networks.

It's not just what we encode, but how we encode it: associations between neuroticism and learning.

OBJECTIVE: Neuroticism is a strong predictor of future mental health problems. The informativeness of this association has been questioned because of the limited understanding of the mechanisms underlying Neuroticism. In this article the authors extend our understanding of the association between information processing and Neuroticism. METHOD: Two independent studies involving separate sets of college students (N = 89 and N = 33), use self-rated Neuroticism scores to compare individuals' ability to learn simple and more complex discriminations, between simple shapes and words presented alone and in compound. RESULTS: Neuroticism was found to be associated with differences in learning to discriminate simple stimuli from compounds containing the same simple stimuli. Individuals with high levels of Neuroticism appeared to process compounds of stimuli as whole units even when this ceased to be an effective strategy for learning. In contrast, individuals with lower levels of Neuroticism performed better with discriminations that could be solved while learning about separate stimuli, rather than compounds. CONCLUSIONS: The authors discuss possible mechanisms of learning identified by these tasks and consider what implications their observations have for an understanding of the relationship between Neuroticism and mental health problems.

No impaired integration in psychopathy: Evidence from an illusory conjunction paradigm.

Progress in psychopathy research has been hampered by ongoing contention about its fundamental cause. The Impaired Integration theory of psychopathy provides an attention-based account of information integration abnormalities. We set out to evaluate the suggested mechanism via an innovative application of the well-established illusory conjunction paradigm. Two hundred participants were recruited by utilizing a psychopathic-trait-maximization technique, sampling individuals from an ex-prisoner and a population sample. We found no support for information integration deficits in psychopathic individuals (BF10 = 0.156), and the absence of a relationship between psychopathic traits and illusory conjunctions remained when accounting for confounding variables. These findings question the mechanism proposed by the Impaired Integration theory and pave the way for future research to advance our understanding of psychopathic trait etiology by assessing specific and falsifiable mechanisms thought to bring about the observed cognitive and behavioral deficits. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Determinants of extinction in a streamed trial procedure.

The strength of an association between a cue and its outcome is influenced by both the probability of the outcome given the cue and the probability of the outcome in the absence of the cue. Once an association has been formed, extinction is the procedure for reducing responding indicative of the association by repeated presentation of the cue without the outcome. The present experiments tested whether cumulative frequency and/or cumulative duration of these events affects associative extinction in a streamed trial extinction procedure with human participants. Experiment 1 assessed the effects of parametric manipulations of the frequency and duration of either the cue by itself or cue-outcome co-absence. In Experiment 1, participants proved relatively insensitive to manipulation of the event's duration. In contrast, judgements of the association by participants decreased when the frequency of cue-alone events was increased, even when the durations of those events were decreased so that cumulative exposure to the cue was equated. No effect of either the duration or the frequency of cue-outcome co-absence was observed. Experiment 2 demonstrated that the effect of cue-alone (i.e., extinction trial) frequency generalises across a wide range of parameters for initial acquisition achieved by cue-outcome pairings. Experiment 3 tested for an interaction between event duration during initial learning and event duration during extinction. Collectively, these results indicate that the cumulative frequency, and not the cumulative duration, of extinction trials as well as the duration of the cue-outcome co-absences between extinction trials control the effectiveness of an extinction procedure.

Functional neuroanatomical correlates of contingency judgement.

Contingency judgement is an ability to detect relationships between events and is crucial in the allocation of attentional resources for reasoning, categorization, and decision making to control behaviour in our environment. Research has suggested that the allocation of attention is sensitive to the frequency of contingency information whether it constitutes a negative, zero or positive relationship. The aim of the present study was to explore the functional neuroanatomical correlates of contingency judgement with different frequencies and whether these are distinct from each other or whether they rely on a common mechanism. Using three contingency tasks within a streaming paradigm (one each for negative, zero, and positive contingency frequencies), we assessed brain activity by means of functional magnetic resonance imaging (fMRI) in 20 participants. Contingency frequency was manipulated between blocks which allowed us to determine the neural correlates of each of the three contingency tasks as well as the common areas of activation. The conjunction of task activation showed activity in left parietal cortices (BA 23, 40) and superior temporal gyrus (BA42). Further, the interaction analysis revealed distinct areas that mainly involve lateral (BA 45) and medial (BA 9) prefrontal cortices in the judgment of negative contingencies compared with positive and zero contingencies. We interpret the finding as evidence that the shared regions may be involved in coding, integration, and updating of associative relations and distinct regions may be involved in the investment of attentional resources to varied degrees in the computation of contingencies to make a judgment.

Characterising the unity and diversity of executive functions in a within-subject fMRI study.

Behavioural studies investigating the relationship between Executive Functions (EFs) demonstrated evidence that different EFs are correlated with each other, but also that they are partially independent from each other. Neuroimaging studies investigating such an interrelationship with respect to the functional neuroanatomical correlates are sparse and have revealed inconsistent findings. To address this question, we created four tasks derived from the same basic paradigm, one each for updating, inhibition, switching, and dual-tasking. We assessed brain activity through functional magnetic resonance imaging (fMRI) in twenty-nine participants while they performed the four EF tasks plus control tasks. For the analysis, we first determined the neural correlates of each EF by subtracting the respective control tasks from the EF tasks. We tested for unity in EF tasks by calculating the conjunction across these four "EF-minus-control" contrasts. This identified common areas including left lateral frontal cortices [middle and superior frontal gyrus (BA 6)], medial frontal cortices (BA 8) as well as parietal cortices [inferior and superior parietal lobules (BA 39/7)]. We also observed areas activated by two or three EF tasks only, such as frontoparietal areas [e.g., SFG (BA8) right inferior parietal lobule (BA 40), left precuneus (BA 7)], and subcortical regions [bilateral thalamus (BA 50)]. Finally, we found areas uniquely activated for updating [bilateral MFG (BA 8) and left supramarginal gyrus (BA 39)], inhibition (left IFG BA 46), and dual-tasking [left postcentral gyrus (BA 40)]. These results demonstrate that the functional neuroanatomical correlates of the four investigated EFs show unity as well as diversity.

Benefiting from trial spacing without the cost of prolonged training: Frequency, not duration, of trials with absent stimuli enhances perceived contingency.

The statistical relation between two events influences the perception of how one event relates to the presence or absence of another. Interestingly, the simultaneous absence of both events, just like their mutual occurrence, is relevant for describing their contingency. In three experiments, we explored the relevance of coabsent events by varying the duration and frequency of trials without stimuli. We used a rapid trial streaming procedure and found that the perceived association between events is enhanced with increasing frequency of coabsent events, unlike the duration of coabsent events, which had little effect. These findings suggest ways in which the benefits of trial spacing, during which both events are absent, could be obtained without increasing total training time. Centrally, this can be done by frequent repeating of shortened coabsent events, each marked by a trial contextual cue. We discuss four potential accounts of how coabsent experience might be processed contributing to this effect: (a) contingency sensitivity, (b) testing effect, (c) reduced associative interference by the context, and (d) reduced encoding interference. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

More frequent, shorter trials enhance acquisition in a training session: There is a free lunch!

The strength of the learned relation between two events, a model for causal perception, has been found to depend on their overall statistical relation, and might be expected to be related to both training trial frequency and trial duration. We report five experiments using a rapid-trial streaming procedure containing Event 1-Event 2 pairings (A trials), Event 1-alone (B trials), Event 2-alone (C trials), and neither event (D trials), in which trial frequencies and durations were independently varied. Judgements of association increased with increasing frequencies of A trials and decreased with increasing frequencies of both B and C trials but showed little effect of frequency of D trials. Across five experiments, a weak but often significant effect of trial duration was also detected, which was always in the same direction as trial frequency. Thus, both frequency and duration of trials influenced learning, but frequency had decidedly stronger effects. Importantly, the benefit of more trials greatly outweighed the observed reduction in effect size caused by a proportional decrease in trial duration. In experiment 5, more trials of proportionately shorter duration enhanced effects on contingency judgments despite a shortening of the training session. We consider the observed 'frequency advantage' with respect to both frequentist models of learning and models based on information. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Competition between multiple causes of a single outcome in causal reasoning.

A strong positive predictor of an outcome modulates the causal judgments of a moderate predictor. To study the empirical basis of this modulation, we compared treatments with one and with two strong competing (i.e., modulating) causes. This allowed us to vary the frequency of outcome occurrences or effects paired with the predictors. We investigated causal competition between positive predictors (those signaling the occurrence of the outcome), between negative predictors (those signaling the absence of the outcome) and between predictors of opposite polarity (positive and negative). The results are consistent with a contrast rather than a reduced associative strength or conditional contingency account, because a strong predictor of opposite polarity enhances rather than reduces causal estimates of moderate predictors. In addition, we found competition effects when the strong predictor predicted fewer outcome occurrences than the moderate predictor, thus implying that cue competition is, at least sometimes, a consequence of contingency rather than total cue-outcome pairings.

Cue competition influences biconditional discrimination.

When multiple cues are presented in compound and trained to predict an outcome, the cues may compete for association with an outcome. However, if both cues are necessary for solution of the discrimination, then competition might be expected to interfere with the solution of the discrimination. We consider how unequal stimulus salience influences learning in configural discriminations, where no individual stimulus predicts the outcome. We compared two hypotheses: (1) salience modulation minimises the initial imbalance in salience and (2) unequal stimulus salience will impair acquisition of configural discriminations. We assessed the effect of varying stimulus salience in a biconditional discrimination (AX+, AY-, BX-, BY+). Across two experiments, we found stronger discrimination when stimuli had matched, rather than mismatched, salience, supporting our second hypothesis. We discuss the implications of this finding for Mackintosh's model of selective attention, modified elemental models and configural models of learning.

Superstition predicts perception of illusory control.

Superstitions are common, yet we have little understanding of the cognitive mechanisms that bring them about. This study used a laboratory-based analogue for superstitious beliefs that involved people monitoring the relationship between undertaking an action (pressing a button) and an outcome occurring (a light illuminating). The task was arranged such that there was no objective contingency between pressing the button and the light illuminating - the light was just as likely to illuminate whether the button was pressed or not. Nevertheless, most people rated the causal relationship between the button press and the light illuminating to be moderately positive, demonstrating an illusion of causality. This study found that the magnitude of this illusion was predicted by people's level of endorsement of common superstitious beliefs (measured using a novel Superstitious Beliefs Questionnaire), but was not associated with mood variables or their self-rated locus of control. This observation is consistent with a more general individual difference or bias to overweight conjunctive events over disjunctive events during causal reasoning in those with a propensity for superstitious beliefs.

Paradoxical choice in rats: Subjective valuation and mechanism of choice.

Decision-makers benefit from information only when they can use it to guide behavior. However, recent experiments found that pigeons and starlings value information that they cannot use. Here we show that this paradox is also present in rats, and explore the underlying decision process. Subjects chose between two options that delivered food probabilistically after a fixed delay. In one option ("info"), outcomes (food/no-food) were signaled immediately after choice, whereas in the alternative ("non-info") the outcome was uncertain until the delay lapsed. Rats sacrificed up to 20% potential rewards by preferring the info option, but reversed preference when the cost was 60%. This reversal contrasts with the results found with pigeons and starlings and may reflect species' differences worth of further investigation. Results are consistent with predictions of the Sequential Choice Model (SCM), that proposes that choices are driven by the mechanisms that control action in sequential encounters. As expected from the SCM, latencies to respond in single-option trials predicted preferences in choice trials, and latencies in choice trials were the same or shorter than in single-option trials. We argue that the congruence of results in distant vertebrates probably reflects evolved adaptations to shared fundamental challenges in nature, and that the apparently paradoxical overvaluing of information is not sub-optimal as has been claimed, even though its functional significance is not yet understood.

Individual differences are more than a gene × environment interaction: The role of learning.

Individual differences in behavior are understood generally as arising from an interaction between genes and environment, omitting a crucial component. The literature on animal and human learning suggests the need to posit principles of learning to explain our differences. One of the challenges for the advancement of the field has been to establish how general principles of learning can explain the almost infinite variation in behavior. We present a case that: (a) individual differences in behavior emerge, in part, from principles of learning; (b) associations provide a descriptive mechanism for understanding the contribution of experience to behavior; and (c) learning theories explain dissociable aspects of behavior. We use 4 examples from the field of learning to illustrate the importance of involving psychology, and associative theory in particular, in the analysis of individual differences, these are (a) fear learning; (b) behavior directed to cues for outcomes (i.e., sign- and goal- tracking); (c) stimulus learning related to attention; and (d) human causal learning. (PsycINFO Database Record

Individual difference in configural associative learning.

Individuals differ in their ability to acquire associations between stimuli and paired outcomes, an ability that has been proposed to be independent of general metrics of intelligence or memory (e.g., Kaufman, DeYoung, Gray, Brown, & Mackintosh, 2009). The nature of these differences may reflect the type of associative structures acquired during learning, for instance, configuring stimuli to facilitate flexible learning and memory. We test the hypothesis that individuals differ in configural associative learning as distinct from simpler (elemental) stimulus-outcome learning. In Experiment 1 participants were screened for attentional scope and we found that attentional scope predicted configural associative learning that could not be explained simply in terms of differences in strength of associative learning. In Experiment 2, attentional scope was trained resulting in a shift in participants' ability to learn about subsequent configurations unrelated to the training material. We discuss how the differences between individual learners reflect differences in configuring rather than simply differences in strength or speed of learning. (PsycINFO Database Record

Depressive realism and outcome density bias in contingency judgments: the effect of the context and intertrial interval.

The perception of the effectiveness of instrumental actions is influenced by depressed mood. Depressive realism (DR) is the claim that depressed people are particularly accurate in evaluating instrumentality. In two experiments, the authors tested the DR hypothesis using an action-outcome contingency judgment task. DR effects were a function of intertrial interval length and outcome density, suggesting that depressed mood is accompanied by reduced contextual processing rather than increased judgment accuracy. The DR effect was observed only when participants were exposed to extended periods in which no actions or outcomes occurred. This implies that DR may result from an impairment in contextual processing rather than accurate but negative expectations. Therefore, DR is consistent with a cognitive distortion view of depression.