Dopamine regulates decision thresholds in human reinforcement learning in males.

Dopamine fundamentally contributes to reinforcement learning, but recent accounts also suggest a contribution to specific action selection mechanisms and the regulation of response vigour. Here, we examine dopaminergic mechanisms underlying human reinforcement learning and action selection via a combined pharmacological neuroimaging approach in male human volunteers (n = 31, within-subjects; Placebo, 150 mg of the dopamine precursor L-dopa, 2 mg of the D2 receptor antagonist Haloperidol). We found little credible evidence for previously reported beneficial effects of L-dopa vs. Haloperidol on learning from gains and altered neural prediction error signals, which may be partly due to differences experimental design and/or drug dosages. Reinforcement learning drift diffusion models account for learning-related changes in accuracy and response times, and reveal consistent decision threshold reductions under both drugs, in line with the idea that lower dosages of D2 receptor antagonists increase striatal DA release via an autoreceptor-mediated feedback mechanism. These results are in line with the idea that dopamine regulates decision thresholds during reinforcement learning, and may help to bridge action selection and response vigor accounts of dopamine.

Sex Differences and Exogenous Estrogen Influence Learning and Brain Responses to Prediction Errors.

Animal studies show marked sex differences as well as effects of estrogen (E2) in the mesocorticolimbic dopaminergic (DA) pathways, which play a critical role in reward processing and reinforcement learning and are also implicated in drug addiction. In this computational pharmacological fMRI study, we investigate the effects of both factors, sex and estrogen, on reinforcement learning and the dopaminergic system in humans; 67 male and 64 naturally cycling female volunteers, the latter in their low-hormone phase, were randomly assigned, double-blind, to take E2 or placebo. They completed a reinforcement learning task in the MRI scanner for which we have previously shown reward prediction error (RPE)-related activity to be dopaminergic. We found RPE-related brain activity to be enhanced in women compared with men and to a greater extent when E2 levels were elevated in both sexes. However, both factors, female sex and E2, slowed adaptation to RPEs (smaller learning rate). This discrepancy of larger RPE-related activity yet smaller learning rates can be explained by organizational sex differences and activational effects of circulating E2, which both affect DA release differently to DA receptor binding capacities.

Dopaminergic modulation of the exploration/exploitation trade-off in human decision-making.

Involvement of dopamine in regulating exploration during decision-making has long been hypothesized, but direct causal evidence in humans is still lacking. Here, we use a combination of computational modeling, pharmacological intervention and functional magnetic resonance imaging to address this issue. Thirty-one healthy male participants performed a restless four-armed bandit task in a within-subjects design under three drug conditions: 150 mg of the dopamine precursor L-dopa, 2 mg of the D2 receptor antagonist haloperidol, and placebo. Choices were best explained by an extension of an established Bayesian learning model accounting for perseveration, directed exploration and random exploration. Modeling revealed attenuated directed exploration under L-dopa, while neural signatures of exploration, exploitation and prediction error were unaffected. Instead, L-dopa attenuated neural representations of overall uncertainty in insula and dorsal anterior cingulate cortex. Our results highlight the computational role of these regions in exploration and suggest that dopamine modulates how this circuit tracks accumulating uncertainty during decision-making.

Region-specific effects of acute haloperidol in the human midbrain, striatum and cortex.

D2 autoreceptors provide an important regulatory mechanism of dopaminergic neurotransmission. However, D2 receptors are also expressed as heteroreceptors at postsynaptic membranes. The expression and the functional characteristics of both, D2 auto- and heteroreceptors, differ between brain regions. Therefore, one would expect that also the net response to a D2 antagonist, i.e. whether and to what degree overall neural activity increases or decreases, varies across brain areas. In the current study we systematically tested this hypothesis by parametrically increasing haloperidol levels (placebo, 2 and 3 mg) in healthy volunteers and measuring brain activity in the three major dopaminergic pathways. In particular, activity was assessed using fMRI while participants performed a working memory and a reinforcement learning task. Consistent with the hypothesis, across brain regions activity parametrically in- and decreased. Moreover, even within the same area there were function-specific concurrent de- and increases of activity, likely caused by input from upstream dopaminergic regions. In the ventral striatum, for instance, activity during reinforcement learning decreased for outcome processing while prediction error related activity increased. In conclusion, the current study highlights the intricacy of D2 neurotransmission which makes it difficult to predict the function-specific net response of a given area to pharmacological manipulations.

GPI-anchor signal sequence influences PrPC sorting, shedding and signalling, and impacts on different pathomechanistic aspects of prion disease in mice.

The cellular prion protein (PrPC) is a cell surface glycoprotein attached to the membrane by a glycosylphosphatidylinositol (GPI)-anchor and plays a critical role in transmissible, neurodegenerative and fatal prion diseases. Alterations in membrane attachment influence PrPC-associated signaling, and the development of prion disease, yet our knowledge of the role of the GPI-anchor in localization, processing, and function of PrPC in vivo is limited We exchanged the PrPC GPI-anchor signal sequence of for that of Thy-1 (PrPCGPIThy-1) in cells and mice. We show that this modifies the GPI-anchor composition, which then lacks sialic acid, and that PrPCGPIThy-1 is preferentially localized in axons and is less prone to proteolytic shedding when compared to PrPC. Interestingly, after prion infection, mice expressing PrPCGPIThy-1 show a significant delay to terminal disease, a decrease of microglia/astrocyte activation, and altered MAPK signaling when compared to wild-type mice. Our results are the first to demonstrate in vivo, that the GPI-anchor signal sequence plays a fundamental role in the GPI-anchor composition, dictating the subcellular localization of a given protein and, in the case of PrPC, influencing the development of prion disease.

A potential link between gambling addiction severity and central dopamine levels: Evidence from spontaneous eye blink rates.

Accumulating evidence points at similarities between substance use disorders (SUD) and gambling disorder on the behavioral and neural level. In SUD, attenuation of striatal D2/3-receptor availability is a consistent finding, at least for stimulating substances. For gambling disorder, no clear association with striatal D2/3-receptor availability has been unveiled so far. With its presumably negligible dopaminergic toxicity, possible differences in receptor availability in gambling disorder might constitute a vulnerability marker. Spontaneous eye blink rate (sEBR) is discussed as a potential proxy measure for striatal dopamine D2/3-receptor availability. Here we examined sEBR in 21 male problem gamblers and 20 healthy control participants. In addition, participants completed a screening questionnaire for overall psychopathology and self-reported measures of alcohol and nicotine consumption. We found no significant difference in sEBR between gamblers and controls. However, in gamblers, sEBR was negatively associated with gambling severity and positively associated with psychopathology. A final exploratory analysis revealed that healthy controls with low sEBR displayed higher alcohol and nicotine consumption than healthy participants with high sEBR. Although the exact association between dopamine transmission and sEBR is still debated, our findings reveal that sEBR is sensitive to inter-individual differences in gambling disorder severity in problem gamblers.

Secretory pathway retention of mutant prion protein induces p38-MAPK activation and lethal disease in mice.

Misfolding of proteins in the biosynthetic pathway in neurons may cause disturbed protein homeostasis and neurodegeneration. The prion protein (PrP(C)) is a GPI-anchored protein that resides at the plasma membrane and may be misfolded to PrP(Sc) leading to prion diseases. We show that a deletion in the C-terminal domain of PrP(C) (PrPΔ214-229) leads to partial retention in the secretory pathway causing a fatal neurodegenerative disease in mice that is partially rescued by co-expression of PrP(C). Transgenic (Tg(PrPΔ214-229)) mice show extensive neuronal loss in hippocampus and cerebellum and activation of p38-MAPK. In cell culture under stress conditions, PrPΔ214-229 accumulates in the Golgi apparatus possibly representing transit to the Rapid ER Stress-induced ExporT (RESET) pathway together with p38-MAPK activation. Here we describe a novel pathway linking retention of a GPI-anchored protein in the early secretory pathway to p38-MAPK activation and a neurodegenerative phenotype in transgenic mice.

TCR bias and HLA cross-restriction are strategies of human brain-infiltrating JC virus-specific CD4+ T cells during viral infection.

Virus-specific CD4(+) T cells play a central role in control of viral pathogens including JC polyoma virus (JCV) infection. JCV is a ubiquitous small DNA virus that leads to persistent infection of humans with no clinical consequences. However, under circumstances of immunocompromise, it is able to cause an opportunistic and often fatal infection of the brain called progressive multifocal leukoencephalopathy (PML). PML has emerged as a serious adverse event in multiple sclerosis patients treated with the anti-VLA-4 mAb natalizumab, which selectively inhibits cell migration across the blood-brain barrier and the gut's vascular endothelium thus compromising immune surveillance in the CNS and gut. In a multiple sclerosis patient who developed PML under natalizumab treatment and a vigorous immune response against JCV after Ab washout, we had the unique opportunity to characterize in detail JCV-specific CD4(+) T cell clones from the infected tissue during acute viral infection. The in-depth analysis of 14 brain-infiltrating, JCV-specific CD4(+) T cell clones demonstrated that these cells use an unexpectedly broad spectrum of different strategies to mount an efficient JCV-specific immune response including TCR bias, HLA cross-restriction that increases avidity and influences in vivo expansion, and a combination of Th1 and Th1-2 functional phenotypes. The level of combinatorial diversity in TCR- and HLA-peptide interactions used by brain-infiltrating, JCV-specific CD4(+) T cells has not, to our knowledge, been reported before in humans for other viral infections and confirms the exceptional plasticity that characterizes virus-specific immune responses.