Mesostriatal dopamine is sensitive to changes in specific cue-reward contingencies.

Learning causal relationships relies on understanding how often one event precedes another. To investigate how dopamine neuron activity and neurotransmitter release change when a retrospective relationship is degraded for a specific pair of events, we used outcome-selective Pavlovian contingency degradation in rats. Conditioned responding was attenuated for the cue-reward contingency that was degraded, as was dopamine neuron activity in the midbrain and dopamine release in the ventral striatum in response to the cue and subsequent reward. Contingency degradation also abolished the trial-by-trial history dependence of the dopamine responses at the time of trial outcome. This profile of changes in cue- and reward-evoked responding is not easily explained by a standard reinforcement learning model. An alternative model based on learning causal relationships was better able to capture dopamine responses during contingency degradation, as well as conditioned behavior following optogenetic manipulations of dopamine during noncontingent rewards. Our results suggest that mesostriatal dopamine encodes the contingencies between meaningful events during learning.

Chronic Ethanol Exposure Produces Persistent Impairment in Cognitive Flexibility and Decision Signals in the Striatum.

Lack of cognitive flexibility is a hallmark of substance use disorders and has been associated with drug-induced synaptic plasticity in the dorsomedial striatum (DMS). Yet the possible impact of altered plasticity on real-time striatal neural dynamics during decision-making is unclear. Here, we identified persistent impairments induced by chronic ethanol (EtOH) exposure on cognitive flexibility and striatal decision signals. After a substantial withdrawal period from prior EtOH vapor exposure, male, but not female, rats exhibited reduced adaptability and exploratory behavior during a dynamic decision-making task. Reinforcement learning models showed that prior EtOH exposure enhanced learning from rewards over omissions. Notably, neural signals in the DMS related to the decision outcome were enhanced, while those related to choice and choice-outcome conjunction were reduced, in EtOH-treated rats compared to the controls. These findings highlight the profound impact of chronic EtOH exposure on adaptive decision-making, pinpointing specific changes in striatal representations of actions and outcomes as underlying mechanisms for cognitive deficits.

Pramipexole restores behavioral inhibition in highly impulsive rats through a paradoxical modulation of frontostriatal networks.

Impulse control disorders (ICDs), a wide spectrum of maladaptive behaviors which includes pathological gambling, hypersexuality and compulsive buying, have been recently suggested to be triggered or aggravated by treatments with dopamine D2/3 receptor agonists, such as pramipexole (PPX). Despite evidence showing that impulsivity is associated with functional alterations in corticostriatal networks, the neural basis of the exacerbation of impulsivity by PPX has not been elucidated. Here we used a hotspot analysis to assess the functional recruitment of several corticostriatal structures by PPX in male rats identified as highly (HI), moderately impulsive (MI) or with low levels of impulsivity (LI) in the 5-choice serial reaction time task (5-CSRTT). PPX dramatically reduced impulsivity in HI rats. Assessment of the expression pattern of the two immediate early genes C-fos and Zif268 by in situ hybridization subsequently revealed that PPX resulted in a decrease in Zif268 mRNA levels in different striatal regions of both LI and HI rats accompanied by a high impulsivity specific reduction of Zif268 mRNA levels in prelimbic and cingulate cortices. PPX also decreased C-fos mRNA levels in all striatal regions of LI rats, but only in the dorsolateral striatum and nucleus accumbens core (NAc Core) of HI rats. Structural equation modeling further suggested that the anti-impulsive effect of PPX was mainly attributable to the specific downregulation of Zif268 mRNA in the NAc Core. Altogether, our results show that PPX restores impulse control in highly impulsive rats by modulation of limbic frontostriatal circuits.

Subthalamic Nucleus Stimulation Impairs Motivation: Implication for Apathy in Parkinson's Disease.

BACKGROUND: Apathy is one of the most disabling neuropsychiatric symptoms in Parkinson's disease (PD) patients and has a higher prevalence in patients under subthalamic nucleus deep brain stimulation. Indeed, despite its effectiveness for alleviating PD motor symptoms, its neuropsychiatric repercussions have not yet been fully uncovered. Because it can be alleviated by dopaminergic therapies, especially D2 and D3 dopaminergic receptor agonists, the commonest explanation proposed for apathy after subthalamic nucleus deep brain stimulation is a too-strong reduction in dopaminergic treatments. The objective of this study was to determine whether subthalamic nucleus deep brain stimulation can induce apathetic behaviors, which remains an important matter of concern. We aimed to unambiguously address this question of the motivational effects of chronic subthalamic nucleus deep brain stimulation. METHODS: We longitudinally assessed the motivational effects of chronic subthalamic nucleus deep brain stimulation by using innovative wireless microstimulators, allowing continuous stimulation of the subthalamic nucleus in freely moving rats and a pharmacological therapeutic approach. RESULTS: We showed for the first time that subthalamic nucleus deep brain stimulation induces a motivational deficit in naive rats and intensifies those existing in a rodent model of PD neuropsychiatric symptoms. As reported from clinical studies, this loss of motivation was fully reversed by chronic treatment with pramipexole, a D2 and D3 dopaminergic receptor agonist. CONCLUSIONS: Taken together, these data provide experimental evidence that chronic subthalamic nucleus deep brain stimulation by itself can induce loss of motivation, reminiscent of apathy, independently of the dopaminergic neurodegenerative process or reduction in dopamine replacement therapy, presumably reflecting a dopaminergic-driven deficit. Therefore, our data help to clarify and reconcile conflicting clinical observations by highlighting some of the mechanisms of the neuropsychiatric side effects induced by chronic subthalamic nucleus deep brain stimulation. © 2020 International Parkinson and Movement Disorder Society.

Nigrostriatal Dopaminergic Denervation Does Not Promote Impulsive Choice in the Rat: Implication for Impulse Control Disorders in Parkinson's Disease.

Impulse control disorders (ICDs) are frequent behavioral complications of dopaminergic (DA) replacement therapies (DRTs) in Parkinson's disease (PD). Impulsive choice, which refers to an inability to tolerate delays to reinforcement, has been identified as a core pathophysiological process of ICDs. Although impulsive choices are exacerbated in PD patients with ICDs under DRTs, some clinical and preclinical studies suggest that the DA denervation of the dorsal striatum induced by the neurodegenerative process as well as a pre-existing high impulsivity trait, may both contribute to the emergence of ICDs in PD. We therefore investigated in a preclinical model in rats, specifically designed to study PD-related non-motor symptoms, the effect of nigrostriatal DA denervation on impulsive choice, in relation to pre-existing levels of impulsivity, measured in a Delay Discounting Task (DDT). In this procedure, rats had the choice between responding for a small sucrose reinforcer delivered immediately, or a larger sucrose reinforcer, delivered after a 0, 5, 10 or 15 s delay. In two different versions of the task, the preference for the large reinforcer decreased as the delay increased. However, and in contrast to our initial hypothesis, this discounting effect was neither exacerbated by, or related to, the extent of the substantia nigra pars compacta (SNc) DA lesion, nor it was influenced by pre-existing variability in impulsive choice. These results therefore question the potential implication of the nigrostriatal DA system in impulsive choice, as well as the DA neurodegenerative process as a factor contributing significantly to the development of ICDs in PD.

Trait Impulsivity and Anhedonia: Two Gateways for the Development of Impulse Control Disorders in Parkinson's Disease?

Apathy and impulsivity are two major comorbid syndromes of Parkinson's disease (PD) that may represent two extremes of a behavioral spectrum modulated by dopamine-dependent processes. PD is characterized by a progressive loss of dopaminergic neurons in the substantia nigra pars compacta to which are attributed the cardinal motor symptoms of the disorder. Dopamine replacement therapy (DRT), used widely to treat these motor symptoms, is often associated with deficits in hedonic processing and motivation, including apathy and depression, as well as impulse control disorders (ICDs). ICDs comprise pathological gambling, hypersexuality, compulsive shopping, binge eating, compulsive overuse of dopaminergic medication, and punding. More frequently observed in males with early onset PD, ICDs are associated not only with comorbid affective symptoms, such as depression and anxiety, but also with behavioral traits, such as novelty seeking and impulsivity, as well as with personal or familial history of alcohol use. This constellation of associated risk factors highlights the importance of inter-individual differences in the vulnerability to develop comorbid psychiatric disorders in PD patients. Additionally, withdrawal from DRT in patients with ICDs frequently unmasks a severe apathetic state, suggesting that apathy and ICDs may be caused by overlapping neurobiological mechanisms within the cortico-striato-thalamo-cortical networks. We suggest that altered hedonic and impulse control processes represent distinct prodromal substrates for the development of these psychiatric symptoms, the etiopathogenic mechanisms of which remain unknown. Specifically, we argue that deficits in hedonic and motivational states and impulse control are mediated by overlapping, yet dissociable, neural mechanisms that differentially interact with DRT to promote the emergence of ICDs in vulnerable individuals. Thus, we provide a novel heuristic framework for basic and clinical research to better define and treat comorbid ICDs in PD.