Loss, gain and choice difficulty in gambling patients: Neural and behavioural processes.

Impaired decision-making is often displayed by individuals suffering from gambling disorder (GD). Since there are a variety of different phenomena influencing decision-making, we focused in this study on the effects of GD on neural and behavioural processes related to loss aversion and choice difficulty. Behavioural responses as well as brain images of 23 patients with GD and 20 controls were recorded while they completed a mixed gambles task, where they had to decide to either accept or reject gambles with different amounts of potential gain and loss. We found no behavioural loss aversion in either group and no group differences regarding loss and gain-related choice behaviour, but there was a weaker relation between choice difficulty and decision time in patients with GD. Similarly, we observed no group differences in processing of losses or gains, but choice difficulty was weaker associated with brain activity in the right anterior insula and anterior cingulate cortex in patients with GD. Our results showed for the first time the effects of GD on neural processes related to choice difficulty. In addition, our findings on choice difficulty give new insights on the psychopathology of GD and on neural processes related to impaired decision-making in GD.

Is impulsivity related to attentional bias in cigarette smokers? An exploration across levels of nicotine dependency and deprivation.

Research has largely focused on how attentional bias to smoking-related cues and impulsivity independently influence the development and maintenance of cigarette smoking, with limited exploration of the relationship between these mechanisms. The current experiments systematically assessed relationships between multiple dimensions of impulsivity and attentional bias, at different stages of attention, in smokers varying in nicotine dependency and deprivation. Nonsmokers (NS; n  = 26), light-satiated smokers (LS; n  = 25), heavy-satiated smokers (HS; n  = 23) and heavy 12-hour nicotine-deprived smokers (HD; n  = 30) completed the Barratt Impulsivity Scale, delayed discounting task, stop-signal task, information sampling task and a visual dot-probe assessing initial orientation (200 ms) and sustained attention (2000 ms) toward smoking-related cues. Sustained attention to smoking-related cues was present in both HS and LS, while initial orientation bias was only evident in HS. HS and LS also had greater levels of trait motor and nonplanning impulsivity and heightened impulsive choice on the delay discounting task compared with NS, while heightened trait attentional impulsivity was only found in HS. In contrast, in HD, nicotine withdrawal was associated with no attentional bias but heightened reflection impulsivity, poorer inhibitory control and significantly lower levels of impulsive choice relative to satiated smokers. Trait and behavioral impulsivity were not related to the extent of attentional bias to smoking-related cues at any stage of attention, level of nicotine dependency or state of deprivation. Findings have both clinical and theoretical implications, highlighting the unique and independent roles impulsivity and attentional bias may play at different stages of the nicotine addiction cycle.

Differences in Discounting Behavior and Brain Responses for Food and Money Reward.

Most neuroeconomic research seeks to understand how value influences decision-making. The influence of reward type is less well understood. We used functional magnetic resonance imaging (fMRI) to investigate delay discounting of primary (i.e., food) and secondary rewards (i.e., money) in 28 healthy, normal-weighted participants (mean age = 26.77; 18 females). To decipher differences in discounting behavior between reward types, we compared how well-different option-based statistical models (exponential, hyperbolic discounting) and attribute-wise heuristic choice models (intertemporal choice heuristic, dual reasoning and implicit framework theory, trade-off model) captured the reward-specific discounting behavior. Contrary to our hypothesis of different strategies for different rewards, we observed comparable discounting behavior for money and food (i.e., exponential discounting). Higher k values for food discounting suggest that individuals decide more impulsive if confronted with food. The fMRI revealed that money discounting was associated with enhanced activity in the right dorsolateral prefrontal cortex, involved in executive control; the right dorsal striatum, associated with reward processing; and the left hippocampus, involved in memory encoding/retrieval. Food discounting, instead, was associated with higher activity in the left temporoparietal junction suggesting social reinforcement of food decisions. Although our findings do not confirm our hypothesis of different discounting strategies for different reward types, they are in line with the notion that reward types have a significant influence on impulsivity with primary rewards leading to more impulsive choices.

The neural representation of metacognition in preferential decision-making.

Humans regularly assess the quality of their judgements, which helps them adjust their behaviours. Metacognition is the ability to accurately evaluate one's own judgements, and it is assessed by comparing objective task performance with subjective confidence report in perceptual decisions. However, for preferential decisions, assessing metacognition in preference-based decisions is difficult because it depends on subjective goals rather than the objective criterion. Here, we develop a new index that integrates choice, reaction time, and confidence report to quantify trial-by-trial metacognitive sensitivity in preference judgements. We found that the dorsomedial prefrontal cortex (dmPFC) and the right anterior insular were more activated when participants made bad metacognitive evaluations. Our study suggests a crucial role of the dmPFC-insula network in representing online metacognitive sensitivity in preferential decisions.

Attribute latencies causally shape intertemporal decisions.

Intertemporal choices - decisions that play out over time - pervade our life. Thus, how people make intertemporal choices is a fundamental question. Here, we investigate the role of attribute latency (the time between when people start to process different attributes) in shaping intertemporal preferences using five experiments with choices between smaller-sooner and larger-later rewards. In the first experiment, we identify attribute latencies using mouse-trajectories and find that they predict individual differences in choices, response times, and changes across time constraints. In the other four experiments we test the causal link from attribute latencies to choice, staggering the display of the attributes. This changes attribute latencies and intertemporal preferences. Displaying the amount information first makes people more patient, while displaying time information first does the opposite. These findings highlight the importance of intra-choice dynamics in shaping intertemporal choices and suggest that manipulating attribute latency may be a useful technique for nudging.

Altruism, reciprocity, and probability: Examining relations through a discounting framework.

Probability and reciprocation have been implicated as key variables for understanding altruism and cooperation. Social discounting, which describes the decline in reward value as the recipient increases in social distance, has provided a framework through which to examine altruistic and cooperative choice. A previous study introduced reciprocal discounting as a way of studying perceived altruism from others (termed reciprocal altruism). But probability discounting has not yet been examined in relation to reciprocal discounting. In order to extend research on reciprocal discounting, the present study evaluated correlations between social, reciprocal, and probability discounting as well as relations between standard social distance (used in social discounting) and reciprocal social distance (the participant's perceived social distance placement on someone else's list) among 129 participants. Upon evaluation, the fit of median reciprocal discount rates to the hyperbolic form was replicated. A strong correlation between social and reciprocal discount rates and a moderate correlation between social and probability discount rates were found as well. Additionally, reciprocal and probability discount rates yielded moderate correlations while reciprocal and standard social distance analyses revealed more correspondence between reward values when persons were socially close (i.e., Person 1) or socially distant (i.e., Person 100). This study provides further evidence that reciprocation and probability likely impact altruistic choice while laying groundwork for further investigations into social distance.

Pre-acquired Functional Connectivity Predicts Choice Inconsistency.

Economic choice theories usually assume that humans maximize utility in their choices. However, studies have shown that humans make inconsistent choices, leading to suboptimal behavior, even without context-dependent manipulations. Previous studies showed that activation in value and motor networks are associated with inconsistent choices at the moment of choice. Here, we investigated if the neural predispositions, measured before a choice task, can predict choice inconsistency in a later risky choice task. Using functional connectivity (FC) measures from resting-state functional magnetic resonance imaging (rsfMRI), derived before any choice was made, we aimed to predict subjects' inconsistency levels in a later-performed choice task. We hypothesized that rsfMRI FC measures extracted from value and motor brain areas would predict inconsistency. Forty subjects (21 females) completed a rsfMRI scan before performing a risky choice task. We compared models that were trained on FC that included only hypothesized value and motor regions with models trained on whole-brain FC. We found that both model types significantly predicted inconsistency levels. Moreover, even the whole-brain models relied mostly on FC between value and motor areas. For external validation, we used a neural network pretrained on FC matrices of 37,000 subjects and fine-tuned it on our data and again showed significant predictions. Together, this shows that the tendency for choice inconsistency is predicted by predispositions of the nervous system and that synchrony between the motor and value networks plays a crucial role in this tendency.

Prefrontal activity during IOWA Gambling Task in young adult women.

This study aims to investigate the relationships between personality traits of impulsivity, using the UPPS-P Impulsive Behaviour Scales shortened version, and prefrontal cortex (PFC) activity during the IOWA Gambling Task (IGT) in young adult women. The study included a sample of 83 young, healthy females (19.8 ± 1.4 years), who voluntarily took part in the study. Repeated measures analysis during the IGT revealed a significant increase in HbO (all p <.001; ηp2 >.31) and a decrease in Hbr (all p <.003; ηp2 >.08) in all prefrontal quadrants. This increase in oxygenation occurs primarily during the choice period under ambiguity (r =.23; p =.039). Additionally, there was a significant linear decrease in selecting the decks associated with a high frequency of losses (p <.001), while the favorable deck with low losses showed a linear increase (F = 12.96; p <.001). Notably, discrepancies were found between UPPS-P and IGT impulsivity ratings. The Lack of Perseverance and Lack of Premeditation scales from the UPPS-P were identified as significant predictors of HbO levels, mainly in the two quadrants of the left hemisphere's, lateral (adjusted R2 =.23; p <.001; f2 =.34) and rostral (adjusted R2 =.13; p <.002; f2 =.17). These findings suggest that young adult women predominantly adopt a punishment-avoidance strategy during IGT, exhibiting increased activation in the left hemisphere, especially during the task's initial phase characterized by ambiguity.

Choice impulsivity after repeated social stress is associated with increased perineuronal nets in the medial prefrontal cortex.

Repeated stress can predispose to substance abuse. However, behavioral and neurobiological adaptations that link stress to substance abuse remain unclear. This study investigates whether intermittent social defeat (ISD), a stress protocol that promotes drug-seeking behavior, alters intertemporal decision-making and cortical inhibitory function in the medial prefrontal cortex (mPFC). Male long evans rats were trained in a delay discounting task (DDT) where rats make a choice between a fast (1 s) small reward (1 sugar pellet) and a large reward (3 sugar pellets) that comes with a time delay (10 s or 20 s). A decreased preference for delayed rewards was used as an index of choice impulsivity. Rats were exposed to ISD and tested in the DDT 24 h after each stress episode, and one- and two-weeks after the last stress episode. Immunohistochemistry was performed in rat's brains to evaluate perineuronal nets (PNNs) and parvalbumin GABA interneurons (PV) labeling as markers of inhibitory function in mPFC. ISD significantly decreased the preference for delayed large rewards in low impulsive, but not high impulsive, animals. ISD also increased the density of PNNs in the mPFC. These results suggest that increased choice impulsivity and cortical inhibition predispose animals to seek out rewards after stress.

Value Estimation versus Effort Mobilization: A General Dissociation between Ventromedial and Dorsomedial Prefrontal Cortex.

Deciding on a course of action requires both an accurate estimation of option values and the right amount of effort invested in deliberation to reach sufficient confidence in the final choice. In a previous study, we have provided evidence, across a series of judgment and choice tasks, for a dissociation between the ventromedial prefrontal cortex (vmPFC), which would represent option values, and the dorsomedial prefrontal cortex (dmPFC), which would represent the duration of deliberation. Here, we first replicate this dissociation and extend it to the case of an instrumental learning task, in which 24 human volunteers (13 women) choose between options associated with probabilistic gains and losses. According to fMRI data recorded during decision-making, vmPFC activity reflects the sum of option values generated by a reinforcement learning model and dmPFC activity the deliberation time. To further generalize the role of the dmPFC in mobilizing effort, we then analyze fMRI data recorded in the same participants while they prepare to perform motor and cognitive tasks (squeezing a handgrip or making numerical comparisons) to maximize gains or minimize losses. In both cases, dmPFC activity is associated with the output of an effort regulation model, and not with response time. Taken together, these results strengthen a general theory of behavioral control that implicates the vmPFC in the estimation of option values and the dmPFC in the energization of relevant motor and cognitive processes.

How do animals weigh conflicting information about reward sources over time? Comparing dynamic averaging models.

Optimal foraging theory suggests that animals make decisions which maximize their food intake per unit time when foraging, but the mechanisms animals use to track the value of behavioral alternatives and choose between them remain unclear. Several models for how animals integrate past experience have been suggested. However, these models make differential predictions for the occurrence of spontaneous recovery of choice: a behavioral phenomenon in which a hiatus from the experimental environment results in animals reverting to a behavioral allocation consistent with a reward distribution from the more distant past, rather than one consistent with their most recently experienced distribution. To explore this phenomenon and compare these models, three free-operant experiments with rats were conducted using a serial reversal design. In Phase 1, two responses (A and B) were baited with pellets on concurrent variable interval schedules, favoring option A. In Phase 2, lever baiting was reversed to favor option B. Rats then entered a delay period, where they were maintained at weight in their home cages and no experimental sessions took place. Following this delay, preference was assessed using initial responding in test sessions where levers were presented, but not baited. Models were compared in performance, including an exponentially weighted moving average, the Temporal Weighting Rule, and variants of these models. While the data provided strong evidence of spontaneous recovery of choice, the form and extent of recovery was inconsistent with the models under investigation. Potential interpretations are discussed in relation to both the decision rule and valuation functions employed.

Processing of visual social-communication cues during a social-perception of action task in autistic and non-autistic observers.

Social perception and communication differ between those with and without autism, even when verbal fluency and intellectual ability are equated. Previous work found that observers responded more quickly to an actor's points if the actor had chosen by themselves where to point instead of being directed where to point. Notably, this 'choice-advantage' effect decreased across non-autistic participants as the number of autistic-like traits and tendencies increased (Pesquita et al., 2016). Here, we build on that work using the same task to study individuals over a broader range of the spectrum, from autistic to non-autistic, measuring both response initiation and mouse movement times, and considering the response to each actor separately. Autistic and non-autistic observers viewed videos of three different actors pointing to one of two locations, without knowing that the actors were sometimes freely choosing to point to one target and other times being directed where to point. All observers exhibited a choice-advantage overall, meaning they responded more rapidly when actors were freely choosing versus when they were directed, indicating a sensitivity to the actors' postural cues and movements. Our fine-grained analyses found a more robust choice-advantage to some actors than others, with autistic observers showing a choice-advantage only in response to one of the actors, suggesting that both actor and observer characteristics influence the overall effect. We briefly explore existing actor characteristics that may have contributed to this effect, finding that both duration of exposure to pre-movement cues and kinematic cues of the actors likely influence the choice advantage to different degrees across the groups. Altogether, the evidence suggested that both autistic and non-autistic individuals could detect the choice-advantage signal, but that for autistic observers the choice-advantage was actor specific. Notably, we found that the influence of the signal, when present, was detected early for all actors by the non-autistic observers, but detected later and only for one actor by the autistic observers. Altogether, we have more accurately characterized the ability of social-perception in autistic individuals as intact, but highlighted that detection of signal is likely delayed/distributed compared to non-autistic observers and that it is important to investigate actor characteristics that may influence detection and use of their social-perception signals.

The explore/exploit trade-off: An ecologically valid and translational framework that can advance mechanistic understanding of eating disorders.

The explore/exploit trade-off is a decision-making process that is conserved across species and balances exploring unfamiliar choices of unknown value with choosing familiar options of known value to maximize reward. This framework is rooted in behavioral ecology and has traditionally been used to study maladaptive versus adaptive non-human animal foraging behavior. Researchers have begun to recognize the potential utility of understanding human decision-making and psychopathology through the explore/exploit trade-off. In this article, we propose that explore/exploit trade-off holds promise for advancing our mechanistic understanding of decision-making processes that confer vulnerability for and maintain eating pathology due to its neurodevelopmental bases, conservation across species, and ability to be mathematically modeled. We present a model for how suboptimal explore/exploit decision-making can promote disordered eating and present recommendations for future research applying this framework to eating pathology. Taken together, the explore/exploit trade-off provides a translational framework for expanding etiologic and maintenance models of eating pathology, given developmental changes in explore/exploit decision-making that coincide in time with the emergence of eating pathology and evidence of biased explore/exploit decision-making in psychopathology. Additionally, understanding explore/exploit decision-making in eating disorders may improve knowledge of their underlying pathophysiology, informing targeted clinical interventions such as neuromodulation and pharmacotherapy. PUBLIC SIGNIFICANCE STATEMENT: The explore/exploit trade-off is a cross-species decision-making process whereby organisms choose between a known option with a known reward or sampling unfamiliar options. We hypothesize that imbalanced explore/exploit decision-making can promote disordered eating and present preliminary data. We propose that explore/exploit trade-off has significant potential to advance understanding of the neurocognitive and neurodevelopmental mechanisms of eating pathology, which could ultimately guide revisions of etiologic models and inform novel interventions.

El balance entre explorar y explotar es un proceso de toma de decisiones que se conserva a través de las especies y equilibra la exploración de opciones desconocidas de valor desconocido con la elección de opciones familiares de valor conocido para maximizar la recompensa. Este marco está arraigado en la ecología del comportamiento y tradicionalmente se ha utilizado para estudiar el comportamiento de forrajeo no adaptativo versus adaptativo en animales no humanos. Los investigadores han comenzado a reconocer la utilidad potencial de entender la toma de decisiones humanas y la psicopatología a través del balance entre explorar y explotar. En este artículo, proponemos que el balance entre explorar y explotar ofrece promesas para avanzar en nuestra comprensión mecanicista de los procesos de toma de decisiones que confieren vulnerabilidad y mantienen la patología alimentaria debido a sus bases neurodesarrolladoras, su conservación a través de las especies y su capacidad de ser modelado matemáticamente. Presentamos un modelo de cómo la toma de decisiones subóptima entre explorar y explotar puede promover la alimentación disfuncional y presentamos recomendaciones para futuras investigaciones que apliquen este marco a la patología alimentaria. En conjunto, el balance entre explorar y explotar proporciona un marco translacional para expandir los modelos etiológicos y de mantenimiento de la patología alimentaria, dadas los cambios en el desarrollo de la toma de decisiones entre explorar y explotar que coinciden en el tiempo con la aparición de la patología alimentaria y la evidencia de una toma de decisiones entre explorar y explotar sesgada en la psicopatología. Además, comprender la toma de decisiones entre explorar y explotar en los trastornos alimentarios puede mejorar el conocimiento de su fisiopatología subyacente, informando intervenciones clínicas dirigidas como la neuromodulación y la farmacoterapia.

Dopamine activity in the nigrostriatal pathway alters cue-induced risky choice patterns in female rats.

Deficits in cost/benefit decision making is a critical risk factor for gambling disorder. Reward-paired cues may play an important role, as these stimuli can enhance risk preference in rats. Despite extensive research implicating the dorsal striatum in the compulsive aspects of addiction, the role of nigrostriatal dopaminergic activity in cue-induced risk preference remains unclear, particularly in females. Accordingly, we examined the effects of manipulating the dopaminergic nigrostriatal pathway on cue-induced risky choice in female rats. TH:Cre rats were trained on the cued version of the rat Gambling Task. This task was designed such that maximal reward is attained by avoiding the high-risk, high-reward options and instead favouring the options associated with lower per-trial gains, as they feature less frequent and shorter time-out penalties. Adding reward-paired audiovisual cues to the task leads to greater risky choice on average. To assess the role of the nigrostriatal pathway, a viral vector carrying either Cre-dependent inhibitory or excitatory DREADD was infused into the substantia nigra. Rats then received clozapine-N-oxide either during task acquisition or after a stable performance baseline was reached. Inhibition of this pathway accelerated the development of risk preference in early sessions and increased risky choice during performance, but long-term inhibition actually improved decision making. Activation of this pathway had minimal effects. These results provide evidence for the involvement of the dopaminergic nigrostriatal pathway in cue-induced risk preference in females, therefore shedding light on its role in cost/benefit decision-making deficits and expanding our knowledge of the female dopaminergic system.

Life-History Trade-Offs in Drosophila: Flies Select a Diet to Maximize Reproduction at the Expense of Lifespan.

Macronutrient intake impacts physiology, behavior, and gene expression in a wide range of organisms. We used the response surface methodology to compare how life history traits, lifespan, and reproduction differ as a function of protein and carbohydrate intakes under choice and no-choice feeding regimens in the fruit fly, Drosophila melanogaster. We found that when offered a choice of nutritionally complementary foods mated female flies regulated toward a protein to carbohydrate ratio (P:C) that was associated with shortened lifespan and maximal egg production when compared to response surfaces derived from flies fed 1 of a range of fixed diets differing in P:C (no-choice regimen). This difference in lifespan between choice and no-choice feeding was not seen in males or virgin flies, reflecting the fact that increased protein intake is triggered by mating to support egg production. However, whereas in mated females a higher P:C intake was associated with greater egg production under both choice and no-choice feeding, contrary to expectations, choice-fed mated flies laid fewer eggs than no-choice flies on equivalent macronutrient intakes, perhaps reflecting that they had to ingest twice the volume of food to attain an equivalent intake of nutrients than no-choice flies on a diet of equivalent P:C ratio.

Multiple timescales of temporal context in risky choice: Behavioral identification and relationships to physiological arousal.

Context-dependence is fundamental to risky monetary decision-making. A growing body of evidence suggests that temporal context, or recent events, alters risk-taking at a minimum of three timescales: immediate (e.g. trial-by-trial), neighborhood (e.g. a group of consecutive trials), and global (e.g. task-level). To examine context effects, we created a novel monetary choice set with intentional temporal structure in which option values shifted between multiple levels of value magnitude ("contexts") several times over the course of the task. This structure allowed us to examine whether effects of each timescale were simultaneously present in risky choice behavior and the potential mechanistic role of arousal, an established correlate of risk-taking, in context-dependency. We found that risk-taking was sensitive to immediate, neighborhood, and global timescales: risk-taking decreased following large (vs. small) outcome amounts, increased following large positive (but not negative) shifts in context, and increased when cumulative earnings exceeded expectations. We quantified arousal with skin conductance responses, which were related to the global timescale, increasing with cumulative earnings, suggesting that physiological arousal captures a task-level assessment of performance. Our results both replicate and extend prior research by demonstrating that risky decision-making is consistently dynamic at multiple timescales and that the role of arousal in risk-taking extends to some, but not all timescales of context-dependence.

Predictions about reward outcomes in rhesus monkeys.

Human infants and nonhuman animals respond to surprising events by looking longer at unexpected than expected situations. These looking responses provide core cognitive evidence that nonverbal minds make predictions about possible outcomes and detect when these predictions fail to match reality. We propose that this phenomenon has crucial parallels with the processes of reward prediction error, indexing the difference between expected and actual reward outcomes. Most work on reward prediction errors to date involves neurobiological techniques that cannot be implemented in many relevant populations, so we developed a novel behavioral task to assess monkeys' predictions about reward outcomes using looking time responses. In Study 1, we tested how semi-free-ranging monkeys (n = 210) responded to positive error (more rewards than expected), negative error (less rewards than expected), and a number control. We found that monkeys looked longer at a given reward when it was unexpectedly large or small, compared to when the same quantity was expected. In Study 2, we compared responses in the positive error condition in monkeys ranging from infancy to old age (n = 363), to assess lifespan changes in sensitivity to reward predictions. We found that adolescent monkeys showed heightened responses to unexpected rewards, similar to patterns seen in humans, but showed no changes during aging. These results suggest that monkeys' looking responses can be used to track their predictions about rewards, and that monkeys share some developmental signatures of reward sensitivity with humans, providing a new approach to access cognitive processes underlying reward-based decision making. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Option similarity modulates the link between choice and memory.

Choices made in everyday life are highly variable. Sometimes, you may find yourself choosing between two similar options (e.g., breakfast foods to eat) and other times between two dissimilar options (e.g., what to buy with a gift certificate). The goal of the present study was to understand how the similarity of choice options affects our ability to remember what we choose and what we did not choose. We hypothesized that choosing between similar as compared to dissimilar options would evoke a comparison-based strategy (evaluating options with respect to one another), fostering a relational form of encoding and leading to better memory for both the chosen and unchosen options. In Experiment 1, participants reported their strategy when choosing between pairs of similar or dissimilar options, revealing that participants were more likely to use a comparison-based strategy when faced with similar options. In Experiment 2, we tested memory after participants made choices between similar or dissimilar options, finding improved memory for both chosen and unchosen options from the similar compared to dissimilar choice trials. In Experiment 3, we examined strategy use when choosing between pairs of similar or dissimilar options and memory for these options. Replicating and extending the results of the first two experiments, we found that participants were more likely to use a comparison-based strategy when choosing between similar than dissimilar options, and that the positive effect of similarity on memory was stronger for unchosen than chosen options when controlling for strategy use. We interpret our results as evidence that option similarity impacts the mnemonic processes used during choice, altering what we encode and ultimately remember about our choices.

A critical review of risk-sensitive foraging.

Foraging is risk sensitive if choices depend on the variability of returns from the options as well as their mean return. Risk-sensitive foraging is important in behavioural ecology, psychology and neurophysiology. It has been explained both in terms of mechanisms and in terms of evolutionary advantage. We provide a critical review, evaluating both mechanistic and evolutionary accounts. Some derivations of risk sensitivity from mechanistic models based on psychophysics are not convincing because they depend on an inappropriate use of Jensen's inequality. Attempts have been made to link risk sensitivity to the ecology of a species, but again these are not convincing. The field of risk-sensitive foraging has provided a focus for theoretical and empirical work and has yielded important insights, but we lack a simple and empirically defendable general account of it in either mechanistic or evolutionary terms. However, empirical analysis of choice sequences under theoretically motivated experimental designs and environmental settings appears a promising avenue for mapping the scope and relative merits of existing theories. Simply put, the devil is in the sequence.

Recent Opioid Use Impedes Range Adaptation in Reinforcement Learning in Human Addiction.

BACKGROUND: Drugs like opioids are potent reinforcers thought to co-opt value-based decisions by overshadowing other rewarding outcomes, but how this happens at a neurocomputational level remains elusive. Range adaptation is a canonical process of fine-tuning representations of value based on reward context. Here, we tested whether recent opioid exposure impacts range adaptation in opioid use disorder, potentially explaining why shifting decision making away from drug taking during this vulnerable period is so difficult. METHODS: Participants who had recently (<90 days) used opioids (n = 34) or who had abstained from opioid use for ≥ 90 days (n = 20) and comparison control participants (n = 44) completed a reinforcement learning task designed to induce robust contextual modulation of value. Two models were used to assess the latent process that participants engaged while making their decisions: 1) a Range model that dynamically tracks context and 2) a standard Absolute model that assumes stationary, objective encoding of value. RESULTS: Control participants and ≥90-days-abstinent participants with opioid use disorder exhibited choice patterns consistent with range-adapted valuation. In contrast, participants with recent opioid use were more prone to learn and encode value on an absolute scale. Computational modeling confirmed the behavior of most control participants and ≥90-days-abstinent participants with opioid use disorder (75%), but a minority in the recent use group (38%), was better fit by the Range model than the Absolute model. Furthermore, the degree to which participants relied on range adaptation correlated with duration of continuous abstinence and subjective craving/withdrawal. CONCLUSIONS: Reduced context adaptation to available rewards could explain difficulty deciding about smaller (typically nondrug) rewards in the aftermath of drug exposure.