Effort-cost decision-making associated with negative symptoms in schizophrenia and bipolar disorder.

Motivational deficits and reduced goal-directed behavior for external rewards have long been considered an important features of negative symptoms in patients with schizophrenia (SCZ). Negative symptoms have also a high prevalence in bipolar disorder (BP). We used a transdiagnostic approach in order to examine association between negative symptoms and effort allocation for monetary rewards. 41 patients with SCZ and 34 patients with BP were enrolled in the study along with 41 healthy controls (HC). Effort-Expenditure for Rewards Task (EEfRT) was used to measure subjects' effort allocation for monetary rewards. Generalized estimating equation models were used to analyze EEfRT choice behavior. Negative symptoms were assessed using the Brief Negative Symptom Scale (BNSS). SCZ and BP groups expended lower effort to obtain a monetary rewards compared to HC. Severity of negative symptoms was negatively correlated with EEfRT performance in both diagnostic groups. Each diagnostic group showed lower effort allocation for monetary rewards compared to HC suggesting reduced motivation for monetary rewards. In addition, our results suggest that abnormal effort-based decision-making might be a transdiagnostic factor underlying negative symptoms.

Elevated Amygdala Responses During De Novo Pavlovian Conditioning in Alcohol Use Disorder Are Associated With Pavlovian-to-Instrumental Transfer and Relapse Latency.

Background: Contemporary learning theories of drug addiction ascribe a key role to Pavlovian learning mechanisms in the development, maintenance, and relapse of addiction. In fact, cue-reactivity research has demonstrated the power of alcohol-associated cues to activate the brain's reward system, which has been linked to craving and subsequent relapse. However, whether de novo Pavlovian conditioning is altered in alcohol use disorder (AUD) has rarely been investigated. Methods: To characterize de novo Pavlovian conditioning in AUD, 62 detoxified patients with AUD and 63 matched healthy control participants completed a Pavlovian learning task as part of a Pavlovian-to-instrumental transfer paradigm during a functional magnetic resonance imaging session. Patients were followed up for 12 months to assess drinking behavior and relapse status. Results: While patients and healthy controls did not differ in their ability to explicitly acquire the contingencies between conditioned and unconditioned stimuli, patients with AUD displayed significantly stronger amygdala responses toward Pavlovian cues, an effect primarily driven by stronger blood oxygen level-dependent differentiation during learning from reward compared with punishment. Moreover, in patients compared with controls, differential amygdala responses during conditioning were positively related to the ability of Pavlovian stimuli to influence ongoing instrumental choice behavior measured during a subsequent Pavlovian-to-instrumental transfer test. Finally, patients who relapsed within the 12-month follow-up period showed an inverse association between amygdala activity during conditioning and relapse latency. Conclusions: We provide evidence of altered neural correlates of de novo Pavlovian conditioning in patients with AUD, especially for appetitive stimuli. Thus, heightened processing of Pavlovian cues might constitute a behaviorally relevant mechanism in alcohol addiction.

Alcohol Approach Bias Is Associated With Both Behavioral and Neural Pavlovian-to-Instrumental Transfer Effects in Alcohol-Dependent Patients.

Background: Even after qualified detoxification, alcohol-dependent (AD) patients may relapse to drinking alcohol despite their decision to abstain. Two mechanisms may play important roles. First, the impact of environmental cues on instrumental behavior (i.e., Pavlovian-to-instrumental transfer [PIT] effect), which was found to be stronger in prospectively relapsing AD patients than in abstaining patients. Second, an automatic approach bias toward alcohol stimuli was observed in AD patients, and interventions targeting this bias reduced the relapse risk in some studies. Previous findings suggest a potential behavioral and neurobiological overlap between these two mechanisms. Methods: In this study, we examined the association between alcohol approach bias and both behavioral and neural non-drug-related PIT effects in AD patients after detoxification. A total of 100 AD patients (17 females) performed a PIT task and an alcohol approach/avoidance task. Patients were followed for 6 months. Results: A stronger alcohol approach bias was associated with both a more pronounced behavioral PIT effect and stronger PIT-related neural activity in the right nucleus accumbens. Moreover, the association between alcohol approach bias and behavioral PIT increased with the severity of alcohol dependence and trait impulsivity and was stronger in patients who relapsed during follow-up in the exploratory analysis. Conclusions: These findings indicate partial behavioral and neurobiological overlap between alcohol approach bias and the PIT effect assessed with our tasks. The association was stronger in patients with more severe alcohol dependence.

Distinct dynamic behavioural response to social exclusion in male patients with a history of alcohol dependence.

Social exclusion contributes to alcohol consumption, whereas the development of alcohol dependence (AD) can in turn lead to the social exclusion of people with AD. Previous research observed altered neural responses to experimentally induced social exclusion (i.e., Cyberball game) in patients with AD. In addition, inflammation has been associated with both social behaviours and AD. Our study aimed to investigate the dynamic behavioural response and the inflammatory effects of social exclusion in male patients with a history of AD. To this end, we analysed dynamic changes in ball tossing during a partial exclusion Cyberball game and the cytokine interleukin (IL)-1b in saliva in 31 male patients who had a history of AD and 29 gender-matched healthy controls without AD. Participants were included in the first 2 min of the Cyberball game and then excluded by one of the two co-players in the proceeding 5 min. Saliva was collected three times: one before and two after the Cyberball game. Across groups, participants passed the ball more often to the excluder during the partial exclusion period. Analysis using piece-wise linear mixed models showed that patients rapidly increased ball tosses to the excluder upon exclusion, which lasted to the late response phase, whereas the early behavioural response to exclusion took longer for controls. There was no significant change of salivary IL-1b level to exclusion in either patients or controls. The results indicate a distinct dynamic behavioural response to social exclusion in male patients with a history of AD.

Reduced sensitivity but intact motivation to monetary rewards and reversal learning in obesity.

BACKGROUND: Obesity has been linked to altered reward processing but little is known about which components of reward processing including motivation, sensitivity and learning are impaired in obesity. We examined whether obesity compared to healthy weight controls is associated with differences in distinct subdomains of reward processing. To this end, we used two established paradigms, namely the Effort Expenditure for Rewards task (EEfRT) and the Probabilistic Reversal Learning Task (PRLT). METHODS: 30 individuals with obesity (OBS) and 30 healthy weight control subjects (HC) were included in the study. Generalized estimating equation models were used to analyze EEfRT choice behavior. PRLT data was analyzed using both conventional behavioral variables of choices and computational models. RESULTS: Our findings from the different tasks speak in favor of a hyposensitivity to non-food rewards in obesity. OBS did not make fewer overall hard task selections compared to HC in the EEfRT suggesting generally intact non-food reward motivation. However, in highly rewarding trials (i.e.,trials with high reward magnitude and high reward probability),OBSmadefewer hard task selections compared to normal weight subjects suggesting decreased sensitivity to highly rewarding non-food reinforcers. Hyposensitivity to non-food rewards was also evident in OBS in the PRLT as evidenced by lower win-stay probability compared to HC. Our computational modelling analyses revealed decreased stochasticity but intact reward and punishment learning rates in OBS. CONCLUSIONS: Our findings provide evidence for intact reward motivation and learning in OBS but lower reward sensitivity which is linked to stochasticity of choices in a non-food context. These findings might provide further insight into the mechanism underlying dysfunctional choices in obesity.

The Association of Non-Drug-Related Pavlovian-to-Instrumental Transfer Effect in Nucleus Accumbens With Relapse in Alcohol Dependence: A Replication.

BACKGROUND: The Pavlovian-to-instrumental transfer (PIT) paradigm measures the effects of Pavlovian conditioned cues on instrumental behavior in the laboratory. A previous study conducted by our research group observed activity in the left nucleus accumbens (NAcc) elicited by a non-drug-related PIT task across patients with alcohol dependence (AD) and healthy control subjects, and the left NAcc PIT effect differentiated patients who subsequently relapsed from those who remained abstinent. In this study, we aimed to examine whether such effects were present in a larger sample collected at a later date. METHODS: A total of 129 recently detoxified patients with AD (21 females) and 74 healthy, age- and gender-matched control subjects (12 females) performing a PIT task during functional magnetic resonance imaging were examined. After task assessments, patients were followed for 6 months. Forty-seven patients relapsed and 37 remained abstinent. RESULTS: We found a significant behavioral non-drug-related PIT effect and PIT-related activity in the NAcc across all participants. Moreover, subsequent relapsers showed stronger behavioral and left NAcc PIT effects than abstainers. These findings are consistent with our previous findings. CONCLUSIONS: Behavioral non-drug-related PIT and neural PIT correlates are associated with prospective relapse risk in AD. This study replicated previous findings and provides evidence for the clinical relevance of PIT mechanisms to treatment outcome in AD. The observed difference between prospective relapsers and abstainers in the NAcc PIT effect in our study is small overall. Future studies are needed to further elucidate the mechanisms and the possible modulators of neural PIT in relapse in AD.

Computational analysis of probabilistic reversal learning deficits in male subjects with alcohol use disorder.

Background: Alcohol use disorder is characterized by perseverative alcohol use despite negative consequences. This hallmark feature of addiction potentially relates to impairments in behavioral flexibility, which can be measured by probabilistic reversal learning (PRL) paradigms. We here aimed to examine the cognitive mechanisms underlying impaired PRL task performance in patients with alcohol use disorder (AUDP) using computational models of reinforcement learning. Methods: Twenty-eight early abstinent AUDP and 27 healthy controls (HC) performed an extensive PRL paradigm. We compared conventional behavioral variables of choices (perseveration; correct responses) between groups. Moreover, we fitted Bayesian computational models to the task data to compare differences in latent cognitive variables including reward and punishment learning and choice consistency between groups. Results: AUDP and HC did not significantly differ with regard to direct perseveration rates after reversals. However, AUDP made overall less correct responses and specifically showed decreased win-stay behavior compared to HC. Interestingly, AUDP showed premature switching after no or little negative feedback but elevated proneness to stay when accumulation of negative feedback would make switching a more optimal option. Computational modeling revealed that AUDP compared to HC showed enhanced learning from punishment, a tendency to learn less from positive feedback and lower choice consistency. Conclusion: Our data do not support the assumption that AUDP are characterized by increased perseveration behavior. Instead our findings provide evidence that enhanced negative reinforcement and decreased non-drug-related reward learning as well as diminished choice consistency underlie dysfunctional choice behavior in AUDP.

Automatic Approach Behaviors in Alcohol Dependence: Does a Cognitive Bias Modification Training Affect Pavlovian-to-Instrumental Transfer Effects?

INTRODUCTION: Positively conditioned Pavlovian cues tend to promote approach and negative cues promote withdrawal in a Pavlovian-to-instrumental transfer (PIT) paradigm, and the strength of this PIT effect was associated with the subsequent relapse risk in alcohol-dependent (AD) patients. When investigating the effect of alcohol-related background cues, instrumental approach behavior was inhibited in subsequent abstainers but not relapsers. An automatic approach bias towards alcohol can be modified using a cognitive bias modification (CBM) intervention, which has previously been shown to reduce the relapse risk in AD patients. Here we examined the effects of such CBM training on PIT effects and explored its effect on the relapse risk in detoxified AD patients. METHODS: N = 81 recently detoxified AD patients performed non-drug-related and drug-related PIT tasks before and after CBM versus placebo training. In addition, an alcohol approach/avoidance task (aAAT) was performed before and after the training to assess the alcohol approach bias. Patients were followed up for 6 months. RESULTS: A stronger alcohol approach bias as well as a stronger non-drug-related PIT effect predicted relapse status in AD patients. No significant difference regarding relapse status or the number of heavy drinking days was found when comparing the CBM training group versus the placebo group. Moreover, there was no significant modulation effect of CBM training on any PIT effect or the aAAT. CONCLUSION: A higher alcohol approach bias in the aAAT and a stronger non-drug-related PIT effect both predicted relapse in AD patients, while treatment outcome was not associated with the drug-related PIT effect. Unlike expected, CBM training did not significantly interact with the non-drug-related or the drug-related PIT effects or the alcohol approach bias.

Association between DRD2/ANKK1 TaqIA Allele Status and Striatal Dopamine D2/3 Receptor Availability in Alcohol Use Disorder.

BACKGROUND: The association between blunted dopaminergic neurotransmission and alcohol use disorder (AUD) is well-known. In particular, the impairment of postsynaptic dopamine 2 and 3 receptors (DRD2/3) in the ventral and dorsal striatum during the development and maintenance of alcohol addiction has been investigated in several positron emission tomography (PET) studies. However, it is unclear whether these changes are the result of adaptation or genetic predisposition. METHODS: Here we investigated the association between DRD2/ankyrin repeat and kinase domain-containing 1 (ANKK1) TaqIA allele (rs1800497) status and striatal DRD2/3 availability measured by 18F-fallypride PET in 12 AUD patients and 17 sex-matched healthy controls. Age and smoking status were included as covariates. RESULTS: Contrary to our expectations, TaqIA allele status was not associated with striatal DRD2/3 availability in either group and there was no significant difference between groups, possibly due to the relatively small sample size (N = 29). CONCLUSIONS: Nonetheless, this is the first in vivo study investigating the relationship between dopamine receptor availability and genetic factors in AUD. The pitfalls of assessing such relationships in a relatively small sample are discussed. CLINICAL TRIAL REGISTRATION: The published analysis is an additional, post hoc analysis to the preregistered trial with clinical trial number NCT01679145 available on https://clinical-trials.gov/ct2/show/NCT01679145.

Computational Theories of Alcohol Use Disorder: Mapping Learning and Choice Mechanisms on Symptoms.

Alcohol use disorder (AUD) is characterized by a combination of symptoms including excessive craving, loss of control, and progressive neglect of alternative pleasures. A mechanistic understanding of what drives these symptoms is needed to improve diagnostic stratification and to develop new treatment and prevention strategies for AUD. To date, there is no consensus regarding a unifying mechanistic framework that accounts for the different symptoms of AUD. Reinforcement learning (RL) and economic choice theories may be key to elucidating the underlying processes of symptom development and maintenance in AUD. These algorithms may account for the different behavioral and physiological phenomena and are suited to dissect mechanisms linked to different symptoms of AUD. We here review different RL and economic choice models and how they map onto three symptoms of AUD: (1) cue-induced craving, (2) neglect of alternative rewards, and (3) consumption despite adverse consequences. For each symptom and theory, we describe findings from animal and human studies. In humans, we focus on empirical studies that investigated RL models in the context of treatment outcome in AUD. The review indicates important gaps to be addressed in the future by highlighting the challenges in transferring findings from RL and economic choice studies to clinical application. We also critically evaluate the potential and pitfalls of a symptom-oriented approach and highlight the importance of elucidating the role of learning and decision-making processes across diagnostic boundaries.

Fronto-striatal structures related with model-based control as an endophenotype for obsessive-compulsive disorder.

Recent theories suggest a shift from model-based goal-directed to model-free habitual decision-making in obsessive-compulsive disorder (OCD). However, it is yet unclear, whether this shift in the decision process is heritable. We investigated 32 patients with OCD, 27 unaffected siblings (SIBs) and 31 healthy controls (HCs) using the two-step task. We computed behavioral and reaction time analyses and fitted a computational model to assess the balance between model-based and model-free control. 80 subjects also underwent structural imaging. We observed a significant ordered effect for the shift towards model-free control in the direction OCD > SIB > HC in our computational parameter of interest. However less directed analyses revealed no shift towards model-free control in OCDs. Nonetheless, we found evidence for reduced model-based control in OCDs compared to HCs and SIBs via 2nd stage reaction time analyses. In this measure SIBs also showed higher levels of model-based control than HCs. Across all subjects these effects were associated with the surface area of the left medial/right dorsolateral prefrontal cortex. Moreover, correlations between bilateral putamen/right caudate volumes and these effects varied as a function of group: they were negative in SIBs and OCDs, but positive in HCs. Associations between fronto-striatal regions and model-based reaction time effects point to a potential endophenotype for OCD.

Association of the OPRM1 A118G polymorphism and Pavlovian-to-instrumental transfer: Clinical relevance for alcohol dependence.

BACKGROUND: Pavlovian-to-instrumental transfer (PIT) quantifies the extent to which a stimulus that has been associated with reward or punishment alters operant behaviour. In alcohol dependence (AD), the PIT effect serves as a paradigmatic model of cue-induced relapse. Preclinical studies have suggested a critical role of the opioid system in modulating Pavlovian-instrumental interactions. The A118G polymorphism of the OPRM1 gene affects opioid receptor availability and function. Furthermore, this polymorphism interacts with cue-induced approach behaviour and is a potential biomarker for pharmacological treatment response in AD. In this study, we tested whether the OPRM1 polymorphism is associated with the PIT effect and relapse in AD. METHODS: Using a PIT task, we examined three independent samples: young healthy subjects (N = 161), detoxified alcohol-dependent patients (N = 186) and age-matched healthy controls (N = 105). We used data from a larger study designed to assess the role of learning mechanisms in the development and maintenance of AD. Subjects were genotyped for the A118G (rs1799971) polymorphism of the OPRM1 gene. Relapse was assessed after three months. RESULTS: In all three samples, participants with the minor OPRM1 G-Allele (G+ carriers) showed increased expression of the PIT effect in the absence of learning differences. Relapse was not associated with the OPRM1 polymorphism. Instead, G+ carriers displaying increased PIT effects were particularly prone to relapse. CONCLUSION: These results support a role for the opioid system in incentive salience motivation. Furthermore, they inform a mechanistic model of aberrant salience processing and are in line with the pharmacological potential of opioid receptor targets in the treatment of AD.

Model-Based and Model-Free Control Predicts Alcohol Consumption Developmental Trajectory in Young Adults: A 3-Year Prospective Study.

BACKGROUND: A shift from goal-directed toward habitual control has been associated with alcohol dependence. Whether such a shift predisposes to risky drinking is not yet clear. We investigated how goal-directed and habitual control at age 18 predict alcohol use trajectories over the course of 3 years. METHODS: Goal-directed and habitual control, as informed by model-based (MB) and model-free (MF) learning, were assessed with a two-step sequential decision-making task during functional magnetic resonance imaging in 146 healthy 18-year-old men. Three-year alcohol use developmental trajectories were based on either a consumption score from the self-reported Alcohol Use Disorders Identification Test (assessed every 6 months) or an interview-based binge drinking score (grams of alcohol/occasion; assessed every year). We applied a latent growth curve model to examine how MB and MF control predicted the drinking trajectory. RESULTS: Drinking behavior was best characterized by a linear trajectory. MB behavioral control was negatively associated with the development of the binge drinking score; MF reward prediction error blood oxygen level-dependent signals in the ventromedial prefrontal cortex and the ventral striatum predicted a higher starting point and steeper increase of the Alcohol Use Disorders Identification Test consumption score over time, respectively. CONCLUSIONS: We found that MB behavioral control was associated with the binge drinking trajectory, while the MF reward prediction error signal was closely linked to the consumption score development. These findings support the idea that unbalanced MB and MF control might be an important individual vulnerability in predisposing to risky drinking behavior.

Stronger Prejudices Are Associated With Decreased Model-Based Control.

Background: Prejudices against minorities can be understood as habitually negative evaluations that are kept in spite of evidence to the contrary. Therefore, individuals with strong prejudices might be dominated by habitual or "automatic" reactions at the expense of more controlled reactions. Computational theories suggest individual differences in the balance between habitual/model-free and deliberative/model-based decision-making. Methods: 127 subjects performed the two Step task and completed the blatant and subtle prejudice scale. Results: By using analyses of choices and reaction times in combination with computational modeling, subjects with stronger blatant prejudices showed a shift away from model-based control. There was no association between these decision-making processes and subtle prejudices. Conclusion: These results support the idea that blatant prejudices toward minorities are related to a relative dominance of habitual decision-making. This finding has important implications for developing interventions that target to change prejudices across societies.

Dopamine D2/3 receptor availability in alcohol use disorder and individuals at high risk: Towards a dimensional approach.

Alcohol use disorder (AUD) is the most common substance use disorder worldwide. Although dopamine-related findings were often observed in AUD, associated neurobiological mechanisms are still poorly understood. Therefore, in the present study, we investigate D2/3 receptor availability in healthy participants, participants at high risk (HR) to develop addiction (not diagnosed with AUD), and AUD patients in a detoxified stage, applying 18 F-fallypride positron emission tomography (18 F-PET). Specifically, D2/3 receptor availability was investigated in (1) 19 low-risk (LR) controls, (2) 19 HR participants, and (3) 20 AUD patients after alcohol detoxification. Quality and severity of addiction were assessed with clinical questionnaires and (neuro)psychological tests. PET data were corrected for age of participants and smoking status. In the dorsal striatum, we observed significant reductions of D2/3 receptor availability in AUD patients compared with LR participants. Further, receptor availability in HR participants was observed to be intermediate between LR and AUD groups (linearly decreasing). Still, in direct comparison, no group difference was observed between LR and HR groups or between HR and AUD groups. Further, the score of the Alcohol Dependence Scale (ADS) was inversely correlated with D2/3 receptor availability in the combined sample. Thus, in line with a dimensional approach, striatal D2/3 receptor availability showed a linear decrease from LR participants to HR participants to AUD patients, which was paralleled by clinical measures. Our study shows that a core neurobiological feature in AUD seems to be detectable in an early, subclinical state, allowing more individualized alcohol prevention programs in the future.

The physiological responses to acute stress in alcohol-dependent patients: A systematic review.

Dysregulation of physiological stress reactivity plays a key role in the development and relapse risk of alcohol dependence. This article reviews studies investigating physiological responses to experimentally induced acute stress in patients with alcohol dependence. A systematic search from electronic databases resulted in 3641 articles found and after screening 62 articles were included in our review. Studies are analyzed based on stress types (i.e., social stress tasks and nonsocial stress tasks) and physiological markers (i.e., the nervous system, the endocrine system, somatic responses and the immune system). In studies applying nonsocial stress tasks, alcohol-dependent patients were reported to show a blunted stress response compared with healthy controls in the majority of studies applying markers of adrenocorticotropic hormone and cortisol. In studies applying social stress tasks, findings are inconsistent, with less than half of the studies reporting altered physiological stress responses in patients. We discuss the impact of duration of abstinence, comorbidities, baseline physiological arousal and intervention on the discrepancy of study findings. Furthermore, we review evidence for an association between blunted physiological stress responses and the relapse risk among patients with alcohol dependence.

A multimodal neuroimaging classifier for alcohol dependence.

With progress in magnetic resonance imaging technology and a broader dissemination of state-of-the-art imaging facilities, the acquisition of multiple neuroimaging modalities is becoming increasingly feasible. One particular hope associated with multimodal neuroimaging is the development of reliable data-driven diagnostic classifiers for psychiatric disorders, yet previous studies have often failed to find a benefit of combining multiple modalities. As a psychiatric disorder with established neurobiological effects at several levels of description, alcohol dependence is particularly well-suited for multimodal classification. To this aim, we developed a multimodal classification scheme and applied it to a rich neuroimaging battery (structural, functional task-based and functional resting-state data) collected in a matched sample of alcohol-dependent patients (N = 119) and controls (N = 97). We found that our classification scheme yielded 79.3% diagnostic accuracy, which outperformed the strongest individual modality - grey-matter density - by 2.7%. We found that this moderate benefit of multimodal classification depended on a number of critical design choices: a procedure to select optimal modality-specific classifiers, a fine-grained ensemble prediction based on cross-modal weight matrices and continuous classifier decision values. We conclude that the combination of multiple neuroimaging modalities is able to moderately improve the accuracy of machine-learning-based diagnostic classification in alcohol dependence.

Dissociating neural learning signals in human sign- and goal-trackers.

Individuals differ in how they learn from experience. In Pavlovian conditioning models, where cues predict reinforcer delivery at a different goal location, some animals-called sign-trackers-come to approach the cue, whereas others, called goal-trackers, approach the goal. In sign-trackers, model-free phasic dopaminergic reward-prediction errors underlie learning, which renders stimuli 'wanted'. Goal-trackers do not rely on dopamine for learning and are thought to use model-based learning. We demonstrate this double dissociation in 129 male humans using eye-tracking, pupillometry and functional magnetic resonance imaging informed by computational models of sign- and goal-tracking. We show that sign-trackers exhibit a neural reward prediction error signal that is not detectable in goal-trackers. Model-free value only guides gaze and pupil dilation in sign-trackers. Goal-trackers instead exhibit a stronger model-based neural state prediction error signal. This model-based construct determines gaze and pupil dilation more in goal-trackers.

Reduced model-based decision-making in gambling disorder.

Compulsive behaviors (e.g., addiction) can be viewed as an aberrant decision process where inflexible reactions automatically evoked by stimuli (habit) take control over decision making to the detriment of a more flexible (goal-oriented) behavioral learning system. These behaviors are thought to arise from learning algorithms known as "model-based" and "model-free" reinforcement learning. Gambling disorder, a form of addiction without the confound of neurotoxic effects of drugs, showed impaired goal-directed control but the way in which problem gamblers (PG) orchestrate model-based and model-free strategies has not been evaluated. Forty-nine PG and 33 healthy participants (CP) completed a two-step sequential choice task for which model-based and model-free learning have distinct and identifiable trial-by-trial learning signatures. The influence of common psychopathological comorbidities on those two forms of learning were investigated. PG showed impaired model-based learning, particularly after unrewarded outcomes. In addition, PG exhibited faster reaction times than CP following unrewarded decisions. Troubled mood, higher impulsivity (i.e., positive and negative urgency) and current and chronic stress reported via questionnaires did not account for those results. These findings demonstrate specific reinforcement learning and decision-making deficits in behavioral addiction that advances our understanding and may be important dimensions for designing effective interventions.