Dissociating the effects of dopamine D2 receptors on effort-based versus value-based decision making using a novel behavioral approach.

Cost-benefit decision making is essential for organisms to adapt to their ever-changing environment. Most studies of cost-benefit decision making involve choice conditions in which effort and value are varied simultaneously. This prevents identification of the aspects of cost-benefit decision making that are affected by experimental manipulations. We developed operant assays to isolate the individual impacts of effort and value manipulations on cost-benefit decision making. In the concurrent effort choice (CEC) task, mice choose between exerting two distinct types of effort: the number of responses and the duration of a response, to earn the same reward. By parametrically varying response cost, psychometric functions are obtained that reflect how the two types of effort scale against one another. Direct manipulations of effort shift the functions. Because reward value is held constant in this task, differences in scaling of the two response types must be related to the effort manipulations. In the concurrent value choice (CVC) task, mice make the same type of response to earn rewards of different value (e.g., pellets vs. sucrose solutions). Here the effort required to earn one reward type is parametrically varied to obtain the psychometric function that scales the value of the two rewards into the number of responses subjects will pay to earn one reward over the other. Direct value manipulations shift these functions. We tested the effect of the dopamine D2 receptor antagonist, haloperidol, on performance in the CEC and CVC assays and found that D2R signaling is important for effort-based, but not value-based decision making. (PsycINFO Database Record (c) 2020 APA, all rights reserved).

Evidence for a Mixed Timing and Counting Strategy in Mice Performing a Mechner Counting Task.

Numerosity, or the ability to understand and distinguish between discrete quantities, was first formalized for study in animals by Mechner (1958a). Rats had to press one lever (the counting lever) n times to arm food release from pressing a second lever (the reward lever). The only cue that n presses had been made to the counting lever was the animal's representation of how many times it had pressed it. In the years that have passed since, many researchers have modified the task in meaningful ways to attempt to tease apart timing-based and count-based strategies. Strong evidence has amassed that the two are fundamentally different and separable skills but, to date, no study has effectively examined the differential contributions of the two strategies in Mechner's original task. By examining performance mid-trial and correlating it with whole-trial performance, we were able to identify patterns of correlation consistent with counting and timing strategies. Due to the independent nature of these correlation patterns, this technique was uniquely able to provide evidence for strategies that combined both timing and counting components. The results show that most mice demonstrated this combined strategy. This provides direct evidence that mice can and do use numerosity to complete Mechner's original task. A rational agent with fallible estimates of both counts made and time elapsed in making them should use both estimates when deciding when to switch to the second lever.

Striatal dopamine D2 receptors regulate effort but not value-based decision making and alter the dopaminergic encoding of cost.

Deficits in goal-directed motivation represent a debilitating symptom for many patients with schizophrenia. Impairments in motivation can arise from deficits in processing information about effort and or value, disrupting effective cost-benefit decision making. We have previously shown that upregulated dopamine D2 receptor expression within the striatum (D2R-OE mice) decreases goal-directed motivation. Here, we determine the behavioral and neurochemical mechanisms behind this deficit. Female D2R-OE mice were tested in several behavioral paradigms including recently developed tasks that independently assess the impact of Value or Effort manipulations on cost-benefit decision making. In vivo microdialysis was used to measure extracellular dopamine in the striatum during behavior. In a value-based choice task, D2R-OE mice show normal sensitivity to changes in reward value and used reward value to guide their actions. In an effort-based choice task, D2R-OE mice evaluate the cost of increasing the number of responses greater relative to the effort cost of longer duration responses compared to controls. This shift away from choosing to repeatedly execute a response is accompanied by a dampening of extracellular dopamine in the striatum during goal-directed behavior. In the ventral striatum, extracellular dopamine level negatively correlates with response cost in controls, but this relationship is lost in D2R-OE mice. These results show that D2R signaling in the striatum, as observed in some patients with schizophrenia, alters the relationship between effort expenditure and extracellular dopamine. This dysregulation produces motivation deficits that are specific to effort but not value-based decision making, paralleling the effort-based motivational deficits observed in schizophrenia.

An Interaction between Serotonin Receptor Signaling and Dopamine Enhances Goal-Directed Vigor and Persistence in Mice.

The functionally selective 5-HT2C receptor ligand SB242084 can increase motivation and have rapid onset anti-depressant-like effects. We sought to identify the specific behavioral effects of SB242084 treatment and elucidate the mechanism in female and male mice. Using a quantitative behavioral approach, we determined that SB242084 increases the vigor and persistence of goal-directed activity across different types of physical work, particularly when work requirements are demanding. We found this influence of SB242084 on effort, rather than reward to be reflected in striatal DA measured during behavior. Using in vivo fast scan cyclic voltammetry, we found that SB242084 has no effect on reward-related phasic DA release in the NAc. Using in vivo microdialysis to measure tonic changes in extracellular DA, we also found no changes in the NAc. In contrast, SB242084 treatment increases extracellular DA in the dorsomedial striatum, an area that plays a key role in response vigor. These findings have several implications. At the behavioral level, this work shows that the capacity to work in demanding situations can be increased, without a generalized increase in motor activity or reward value. At the circuit level, we identified a pathway restricted potentiation of DA release and showed that this was the reason for the increased response vigor. At the cellular level, we show that a specific serotonin receptor cross talks to the DA system. Together, this information provides promise for the development of treatments for apathy, a serious clinical condition that can afflict patients with psychiatric and neurological disorders.SIGNIFICANCE STATEMENT Motivated behaviors are modulated by reward value, effort demands, and cost-benefit computations. This information drives the decision to act, which action to select, and the intensity with which the selected action is performed. Because these behavioral processes are all regulated by DA signaling, it is very difficult to influence selected aspects of motivated behavior without affecting others. Here we identify a pharmacological treatment that increases the vigor and persistence of responding in mice, without increasing generalized activity or changing reactions to rewards. We show that the 5-HT2C-selective ligand boosts motivation by potentiating activity-dependent DA release in the dorsomedial striatum. These results reveal a novel strategy for treating patients with motivational deficits, avolition, or apathy.

A corticostriatal deficit promotes temporal distortion of automatic action in ageing.

The acquisition of motor skills involves implementing action sequences that increase task efficiency while reducing cognitive loads. This learning capacity depends on specific cortico-basal ganglia circuits that are affected by normal ageing. Here, combining a series of novel behavioural tasks with extensive neuronal mapping and targeted cell manipulations in mice, we explored how ageing of cortico-basal ganglia networks alters the microstructure of action throughout sequence learning. We found that, after extended training, aged mice produced shorter actions and displayed squeezed automatic behaviours characterised by ultrafast oligomeric action chunks that correlated with deficient reorganisation of corticostriatal activity. Chemogenetic disruption of a striatal subcircuit in young mice reproduced age-related within-sequence features, and the introduction of an action-related feedback cue temporarily restored normal sequence structure in aged mice. Our results reveal static properties of aged cortico-basal ganglia networks that introduce temporal limits to action automaticity, something that can compromise procedural learning in ageing.

Dopamine D2 Receptors in the Paraventricular Thalamus Attenuate Cocaine Locomotor Sensitization.

Alterations in thalamic dopamine (DA) or DA D2 receptors (D2Rs) have been measured in drug addiction and schizophrenia, but the relevance of thalamic D2Rs for behavior is largely unknown. Using in situ hybridization and mice expressing green fluorescent protein (GFP) under the Drd2 promoter, we found that D2R expression within the thalamus is enriched in the paraventricular nucleus (PVT) as well as in more ventral midline thalamic nuclei. Within the PVT, D2Rs are inhibitory as their activation inhibits neuronal action potentials in brain slices. Using Cre-dependent anterograde and retrograde viral tracers, we further determined that PVT neurons are reciprocally interconnected with multiple areas of the limbic system including the amygdala and the nucleus accumbens (NAc). Based on these anatomical findings, we analyzed the role of D2Rs in the PVT in behaviors that are supported by these areas and that also have relevance for schizophrenia and drug addiction. Male and female mice with selective overexpression of D2Rs in the PVT showed attenuated cocaine locomotor sensitization, whereas anxiety levels, fear conditioning, sensorimotor gating, and food-motivated behaviors were not affected. These findings suggest the importance of PVT inhibition by D2Rs in modulating the sensitivity to cocaine, a finding that may have novel implications for human drug use.