Dopamine encodes real-time reward availability and transitions between reward availability states on different timescales.

Optimal behavior requires interpreting environmental cues that indicate when to perform actions. Dopamine is important for learning about reward-predicting events, but its role in adapting to inhibitory cues is unclear. Here we show that when mice can earn rewards in the absence but not presence of an auditory cue, dopamine level in the ventral striatum accurately reflects reward availability in real-time over a sustained period (80 s). In addition, unpredictable transitions between different states of reward availability are accompanied by rapid (~1-2 s) dopamine transients that deflect negatively at the onset and positively at the offset of the cue. This Dopamine encoding of reward availability and transitions between reward availability states is not dependent on reward or activity evoked dopamine release, appears before mice learn the task and is sensitive to motivational state. Our findings are consistent across different techniques including electrochemical recordings and fiber photometry with genetically encoded optical sensors for calcium and dopamine.

Striatal dopamine D2 receptors regulate effort but not value-based decision making and alter the dopaminergic encoding of cost.

Deficits in goal-directed motivation represent a debilitating symptom for many patients with schizophrenia. Impairments in motivation can arise from deficits in processing information about effort and or value, disrupting effective cost-benefit decision making. We have previously shown that upregulated dopamine D2 receptor expression within the striatum (D2R-OE mice) decreases goal-directed motivation. Here, we determine the behavioral and neurochemical mechanisms behind this deficit. Female D2R-OE mice were tested in several behavioral paradigms including recently developed tasks that independently assess the impact of Value or Effort manipulations on cost-benefit decision making. In vivo microdialysis was used to measure extracellular dopamine in the striatum during behavior. In a value-based choice task, D2R-OE mice show normal sensitivity to changes in reward value and used reward value to guide their actions. In an effort-based choice task, D2R-OE mice evaluate the cost of increasing the number of responses greater relative to the effort cost of longer duration responses compared to controls. This shift away from choosing to repeatedly execute a response is accompanied by a dampening of extracellular dopamine in the striatum during goal-directed behavior. In the ventral striatum, extracellular dopamine level negatively correlates with response cost in controls, but this relationship is lost in D2R-OE mice. These results show that D2R signaling in the striatum, as observed in some patients with schizophrenia, alters the relationship between effort expenditure and extracellular dopamine. This dysregulation produces motivation deficits that are specific to effort but not value-based decision making, paralleling the effort-based motivational deficits observed in schizophrenia.

An Interaction between Serotonin Receptor Signaling and Dopamine Enhances Goal-Directed Vigor and Persistence in Mice.

The functionally selective 5-HT2C receptor ligand SB242084 can increase motivation and have rapid onset anti-depressant-like effects. We sought to identify the specific behavioral effects of SB242084 treatment and elucidate the mechanism in female and male mice. Using a quantitative behavioral approach, we determined that SB242084 increases the vigor and persistence of goal-directed activity across different types of physical work, particularly when work requirements are demanding. We found this influence of SB242084 on effort, rather than reward to be reflected in striatal DA measured during behavior. Using in vivo fast scan cyclic voltammetry, we found that SB242084 has no effect on reward-related phasic DA release in the NAc. Using in vivo microdialysis to measure tonic changes in extracellular DA, we also found no changes in the NAc. In contrast, SB242084 treatment increases extracellular DA in the dorsomedial striatum, an area that plays a key role in response vigor. These findings have several implications. At the behavioral level, this work shows that the capacity to work in demanding situations can be increased, without a generalized increase in motor activity or reward value. At the circuit level, we identified a pathway restricted potentiation of DA release and showed that this was the reason for the increased response vigor. At the cellular level, we show that a specific serotonin receptor cross talks to the DA system. Together, this information provides promise for the development of treatments for apathy, a serious clinical condition that can afflict patients with psychiatric and neurological disorders.SIGNIFICANCE STATEMENT Motivated behaviors are modulated by reward value, effort demands, and cost-benefit computations. This information drives the decision to act, which action to select, and the intensity with which the selected action is performed. Because these behavioral processes are all regulated by DA signaling, it is very difficult to influence selected aspects of motivated behavior without affecting others. Here we identify a pharmacological treatment that increases the vigor and persistence of responding in mice, without increasing generalized activity or changing reactions to rewards. We show that the 5-HT2C-selective ligand boosts motivation by potentiating activity-dependent DA release in the dorsomedial striatum. These results reveal a novel strategy for treating patients with motivational deficits, avolition, or apathy.

The effects of pharmacological modulation of the serotonin 2C receptor on goal-directed behavior in mice.

RATIONALE: Impaired goal-directed motivation represents a debilitating class of symptoms common to psychological disorders including schizophrenia and some affective disorders. Despite the known negative impact of impaired motivation, there are currently no effective pharmacological interventions to treat these symptoms. OBJECTIVES: Here, we evaluate the effectiveness of the serotonin 2C (5-HT2C) receptor selective ligand, SB242084, as a potential pharmacological intervention for enhancing goal-directed motivation in mice. The studies were designed to identify not only efficacy but also the specific motivational processes that were affected by the drug treatment. METHODS: We tested subjects following treatment with SB242084 (0.75 mg/kg) in several operant lever pressing assays including the following: a progressive ratio (PR) schedule of reinforcement, an effort-based choice task, a progressive hold down task (PHD), and various food intake tests. RESULTS: Acute SB242084 treatment leads to an increase in instrumental behavior. Using a battery of behavioral tasks, we demonstrate that the major effect of SB242084 is an increase in the amount of responses and duration of effort that subjects will make for food rewards. This enhancement of behavior is not the result of non-specific hyperactivity or arousal nor is it due to changes in food consumption. CONCLUSIONS: Because of this specificity of action, we suggest that the 5-HT2C receptor warrants further attention as a novel therapeutic target for treating pathological impairments in goal-directed motivation.

Correction to Ward et al. (2015).

Reports an error in "The impact of motivation on cognitive performance in an animal model of the negative and cognitive symptoms of schizophrenia" by Ryan D. Ward, Vanessa Winiger, Kerin K. Higa, Julia B. Kahn, Eric R. Kandel, Peter D. Balsam and Eleanor H. Simpson (Behavioral Neuroscience, 2015[Jun], Vol 129[3], 292-299). There is a text error in the 4th paragraph of the Discussion section. The explanation for the abbreviation OFC was incorrectly listed as occipitofrontal circumference. It should have been orbitofrontal cortex. (The following abstract of the original article appeared in record 2015-18639-001.) Interactions between motivation and cognition are implicated in producing functional impairments and poor quality of life in psychiatric patients. This interaction, however, is not well understood at either the behavioral or neural level. We developed a procedure for mice in which a cognitive measure, sustained attention, is modulated by a motivationally relevant signal that predicts reward probability on a trial-by-trial basis. Using this paradigm, we tested the interaction between motivation and cognition in mice that model the increased striatal D2 receptor activity observed in schizophrenia patients (D2R-OE mice). In control mice, attention was modulated by signaled-reward probability. In D2R-OE mice, however, attention was not modulated by reward-related cues. This impairment was not due to any global deficits in attention or maintenance of the trial-specific information in working memory. Turning off the transgene in D2R-OE mice rescued the motivational modulation of attention. These results indicate that deficits in motivation impair the ability to use reward-related cues to recruit attention and that improving motivation improves functional cognitive performance. These results further suggest that addressing motivational impairments in patients is critical to achieving substantive cognitive and functional gains.

Orbitofrontal cortex mediates the differential impact of signaled-reward probability on discrimination accuracy.

Orbitofrontal cortex (OFC) function is critical to decision making and behavior based on the value of expected outcomes. While some of the roles the OFC plays in value computations and behavior have been identified, the role of the OFC in modulating cognitive resources based on reward expectancy has not been explored. Here we assessed the involvement of OFC in the interaction between motivation and attention. We tested mice in a sustained-attention task in which explicitly signaling the probability of reward differentially modulates discrimination accuracy. Using pharmacogenetic methods, we generated mice in which neuronal activity in the OFC could be transiently and reversibly inhibited during performance of our signaled-probability task. We found that inhibiting OFC neuronal activity abolished the ability of reward-associated cues to differentially impact accuracy of sustained-attention performance. This failure to modulate attention occurred despite evidence that mice still processed the differential value of the reward-associated cues. These data indicate that OFC function is critical for the ability of a reward-related signal to impact other cognitive and decision-making processes and begin to delineate the neural circuitry involved in the interaction between motivation and attention.

The impact of motivation on cognitive performance in an animal model of the negative and cognitive symptoms of schizophrenia.

Interactions between motivation and cognition are implicated in producing functional impairments and poor quality of life in psychiatric patients. This interaction, however, is not well understood at either the behavioral or neural level. We developed a procedure for mice in which a cognitive measure, sustained attention, is modulated by a motivationally relevant signal that predicts reward probability on a trial-by-trial basis. Using this paradigm, we tested the interaction between motivation and cognition in mice that model the increased striatal D2 receptor activity observed in schizophrenia patients (D2R-OE mice). In control mice, attention was modulated by signaled-reward probability. In D2R-OE mice, however, attention was not modulated by reward-related cues. This impairment was not due to any global deficits in attention or maintenance of the trial-specific information in working memory. Turning off the transgene in D2R-OE mice rescued the motivational modulation of attention. These results indicate that deficits in motivation impair the ability to use reward-related cues to recruit attention and that improving motivation improves functional cognitive performance. These results further suggest that addressing motivational impairments in patients is critical to achieving substantive cognitive and functional gains.

Genetic variation in COMT activity impacts learning and dopamine release capacity in the striatum.

A common genetic polymorphism that results in increased activity of the dopamine regulating enzyme COMT (the COMT Val(158) allele) has been found to associate with poorer cognitive performance and increased susceptibility to develop psychiatric disorders. It is generally assumed that this increase in COMT activity influences cognitive function and psychiatric disease risk by increasing dopamine turnover in cortical synapses, though this cannot be directly measured in humans. Here we explore a novel transgenic mouse model of increased COMT activity, equivalent to the relative increase in activity observed with the human COMT Val(158) allele. By performing an extensive battery of behavioral tests, we found that COMT overexpressing mice (COMT-OE mice) exhibit cognitive deficits selectively in the domains that are affected by the COMT Val(158) allele, stimulus-response learning and working memory, functionally validating our model of increased COMT activity. Although we detected no changes in the level of markers for dopamine synthesis and dopamine transport, we found that COMT-OE mice display an increase in dopamine release capacity in the striatum. This result suggests that increased COMT activity may not only affect dopamine signaling by enhancing synaptic clearance in the cortex, but may also cause changes in presynaptic dopamine function in the striatum. These changes may underlie the behavioral deficits observed in the mice and might also play a role in the cognitive deficits and increased psychiatric disease risk associated with genetic variation in COMT activity in humans.

Selective overexpression of dopamine D3 receptors in the striatum disrupts motivation but not cognition.

BACKGROUND: Evidence indicating an increase in dopamine D2 receptor (D2R) density and occupancy in patients with schizophrenia comes from positron emission tomography studies using ligands that bind both D2Rs and dopamine D3 receptors (D3Rs), questioning the role of D3Rs in the pathophysiology of the disease. Dopamine D3 receptor positron emission tomography ligands have recently been developed and antagonists with preferential affinity for D3R versus D2R are undergoing clinical evaluation. To determine if an increase in D3Rs in the striatum could produce phenotypes relevant to schizophrenia, we generated a transgenic model of striatal D3R overexpression. METHODS: A bi-transgenic system was used to generate mice with increased D3Rs selectively in the striatum. Mice with overexpression of D3R were subjected to an extensive battery of behavioral tests, including several relevant to schizophrenia. Ligand binding and quantitative reverse transcription polymerase chain reaction methods were used to quantify the effect of D3R overexpression on dopamine D1 receptors (D1Rs) in the striatum. RESULTS: Mice with overexpression of D3R show no abnormalities in basic behavioral functions or cognitive tests but do display a deficit in incentive motivation. This was associated with a reduction in striatal D1R ligand binding, driven by a downregulation at the level of transcription. Both motivation and D1R expression were rescued by switching off the transgene in adulthood. CONCLUSIONS: Overexpression of D3Rs in the striatum of mice does not elicit cognitive deficits but disrupts motivation, suggesting that changes in D3Rs may be involved in the negative symptoms of schizophrenia. These data imply that it will be important to evaluate the effects of D3R antagonists on motivational symptoms, which are not improved by currently available antipsychotic medications.

The effects of selective breeding for infant ultrasonic vocalizations on play behavior in juvenile rats.

For over 25 generations, two lines of rats (High and Low USV lines) have been selectively bred for extreme rates of infantile (45 kHz) ultrasonic vocalizations (USV) in response to maternal separation at postnatal day (P)10. High and low line juveniles (P30-P40) were socially isolated and allowed to play in same-sex sibling pairs for 10 min per day over three days. Measures of play were nape contacts and pinning. Other social and nonsocial behaviors were also scored during the three sessions; two of these, 55 kHz USV and walk-overs, were statistically associated with play. Compared to the Random control line, both High and Low line juveniles showed deficits in play behavior. In the High line, play initiatory behavior (nape contacts) was reduced, but pinning, USV and walk-overs were relatively unchanged. In contrast, nape contacts, pinning, USV and walk-overs were all reduced in Low line juveniles compared to Random line controls. The results suggest that selection for extremes of infant USV rates has produced temperamental differences that are expressed in juvenile play in the High and Low USV lines.

Transient and selective overexpression of dopamine D2 receptors in the striatum causes persistent abnormalities in prefrontal cortex functioning.

Increased activity of D2 receptors (D2Rs) in the striatum has been linked to the pathophysiology of schizophrenia. To determine directly the behavioral and physiological consequences of increased D2R function in the striatum, we generated mice with reversibly increased levels of D2Rs restricted to the striatum. D2 transgenic mice exhibit selective cognitive impairments in working memory tasks and behavioral flexibility without more general cognitive deficits. The deficit in the working memory task persists even after the transgene has been switched off, indicating that it results not from continued overexpression of D2Rs but from excess expression during development. To determine the effects that may mediate the observed cognitive deficits, we analyzed the prefrontal cortex, the brain structure mainly associated with working memory. We found that D2R overexpression in the striatum impacts dopamine levels, rates of dopamine turnover, and activation of D1 receptors in the prefrontal cortex, measures that are critical for working memory.