Heterogeneity in striatal dopamine circuits: Form and function in dynamic reward seeking.

The striatal dopamine system has long been studied in the context of reward learning, motivation, and movement. Given the prominent role dopamine plays in a variety of adaptive behavioral states, as well as diseases like addiction, it is essential to understand the full complexity of dopamine neurons and the striatal systems they target. A growing number of studies are uncovering details of the heterogeneity in dopamine neuron subpopulations. Here, we review that work to synthesize current understanding of dopamine system heterogeneity across three levels, anatomical organization, functions in behavior, and modes of action, wherein we focus on signaling profiles and local mechanisms for modulation of dopamine release. Together, these studies reveal new and emerging dimensions of the striatal dopamine system, informing its contribution to dynamic motivational and decision-making processes.

Dopamine encoding of Pavlovian incentive stimuli diminishes with extended training.

Dopamine is highly implicated both as a teaching signal in reinforcement learning and in motivating actions to obtain rewards. However, theoretical disconnects remain between the temporal encoding properties of dopamine neurons and the behavioral consequences of its release. Here, we demonstrate in rats that dopamine evoked by Pavlovian cues increases during acquisition, but dissociates from stable conditioned appetitive behavior as this signal returns to preconditioning levels with extended training. Experimental manipulation of the statistical parameters of the behavioral paradigm revealed that this attenuation of cue-evoked dopamine release during the postasymptotic period was attributable to acquired knowledge of the temporal structure of the task. In parallel, conditioned behavior became less dopamine dependent after extended training. Thus, the current work demonstrates that as the presentation of reward-predictive stimuli becomes anticipated through the acquisition of task information, there is a shift in the neurobiological substrates that mediate the motivational properties of these incentive stimuli.

Ring of Power: A Band of Peptidergic Midbrain Neurons that Binds Motivation.

A recent Cell paper identifies a novel population of neurons within the ventral tegmental area producing the endogenous opioid nociceptin that regulates dopamine neuron firing and acts uniquely to gate motivation in reward seeking. These results highlight neuropeptidergic signaling as a critical component of functional heterogeneity in the midbrain.

Nucleus Accumbens Cholinergic Interneurons Oppose Cue-Motivated Behavior.

BACKGROUND: Environmental reward-predictive stimuli provide a major source of motivation for adaptive reward pursuit behavior. This cue-motivated behavior is known to be mediated by the nucleus accumbens (NAc) core. The cholinergic interneurons in the NAc are tonically active and densely arborized and thus well suited to modulate NAc function. However, their causal contribution to adaptive behavior remains unknown. Here we investigated the function of NAc cholinergic interneurons in cue-motivated behavior. METHODS: We used chemogenetics, optogenetics, pharmacology, and a translationally analogous Pavlovian-to-instrumental transfer behavioral task designed to assess the motivating influence of a reward-predictive cue over reward-seeking actions in male and female rats. RESULTS: The data show that NAc cholinergic interneuron activity critically opposes the motivating influence of appetitive cues. Chemogenetic inhibition of NAc cholinergic interneurons augmented cue-motivated behavior. Optical stimulation of acetylcholine release from NAc cholinergic interneurons prevented cues from invigorating reward-seeking behavior, an effect that was mediated by activation of ß2-containing nicotinic acetylcholine receptors. CONCLUSIONS: NAc cholinergic interneurons provide a critical regulatory influence over adaptive cue-motivated behavior and therefore are a potential therapeutic target for the maladaptive cue-motivated behavior that marks many psychiatric conditions, including addiction and depression.

Nucleus Accumbens Acetylcholine Receptors Modulate Dopamine and Motivation.

Environmental reward-predictive cues can motivate reward-seeking behaviors. Although this influence is normally adaptive, it can become maladaptive in disordered states, such as addiction. Dopamine release in the nucleus accumbens core (NAc) is known to mediate the motivational impact of reward-predictive cues, but little is known about how other neuromodulatory systems contribute to cue-motivated behavior. Here, we examined the role of the NAc cholinergic receptor system in cue-motivated behavior using a Pavlovian-to-instrumental transfer task designed to assess the motivating influence of a reward-predictive cue over an independently-trained instrumental action. Disruption of NAc muscarinic acetylcholine receptor activity attenuated, whereas blockade of nicotinic receptors augmented cue-induced invigoration of reward seeking. We next examined a potential dopaminergic mechanism for this behavioral effect by combining fast-scan cyclic voltammetry with local pharmacological acetylcholine receptor manipulation. The data show evidence of opposing modulation of cue-evoked dopamine release, with muscarinic and nicotinic receptor antagonists causing suppression and augmentation, respectively, consistent with the behavioral effects of these manipulations. In addition to demonstrating cholinergic modulation of naturally-evoked and behaviorally-relevant dopamine signaling, these data suggest that NAc cholinergic receptors may gate the expression of cue-motivated behavior through modulation of phasic dopamine release.

Dynamic mesolimbic dopamine signaling during action sequence learning and expectation violation.

Prolonged mesolimbic dopamine concentration changes have been detected during spatial navigation, but little is known about the conditions that engender this signaling profile or how it develops with learning. To address this, we monitored dopamine concentration changes in the nucleus accumbens core of rats throughout acquisition and performance of an instrumental action sequence task. Prolonged dopamine concentration changes were detected that ramped up as rats executed each action sequence and declined after earned reward collection. With learning, dopamine concentration began to rise increasingly earlier in the execution of the sequence and ultimately backpropagated away from stereotyped sequence actions, becoming only transiently elevated by the most distal and unexpected reward predictor. Action sequence-related dopamine signaling was reactivated in well-trained rats if they became disengaged in the task and in response to an unexpected change in the value, but not identity of the earned reward. Throughout training and test, dopamine signaling correlated with sequence performance. These results suggest that action sequences can engender a prolonged mode of dopamine signaling in the nucleus accumbens core and that such signaling relates to elements of the motivation underlying sequence execution and is dynamic with learning, overtraining and violations in reward expectation.

Altered risk-based decision making following adolescent alcohol use results from an imbalance in reinforcement learning in rats.

Alcohol use during adolescence has profound and enduring consequences on decision-making under risk. However, the fundamental psychological processes underlying these changes are unknown. Here, we show that alcohol use produces over-fast learning for better-than-expected, but not worse-than-expected, outcomes without altering subjective reward valuation. We constructed a simple reinforcement learning model to simulate altered decision making using behavioral parameters extracted from rats with a history of adolescent alcohol use. Remarkably, the learning imbalance alone was sufficient to simulate the divergence in choice behavior observed between these groups of animals. These findings identify a selective alteration in reinforcement learning following adolescent alcohol use that can account for a robust change in risk-based decision making persisting into later life.

Health service attendance patterns in an urban Aboriginal health service.

OBJECTIVES: To describe the health service attendance patterns of urban Aboriginal and Torres Strait Islander (Aboriginal) Australians and make comparisons with those of the general Australian population. DESIGN AND SETTING: General practitioner-completed survey of all attendances over two separate 2-week periods in 2006 at an urban Aboriginal health service in Canberra, which provides services for about 3500 patients per annum. MAIN OUTCOME MEASURES: Standardised attendance ratios (SARs) for a range of health problems, using patients attending Australian general practice for the same reasons as the reference population. RESULTS: Patients attending the Aboriginal health service were significantly younger than the Australian general practice patient reference population. The most common conditions managed were psychological, encompassing substance misuse; psychological problems accounted for 24% of all attendances. Patients attending the Aboriginal health service had higher rates of attendance for psychological conditions (SAR, 2.14; 95% CI, 2.01-2.28), endocrine conditions (SAR, 2.44; 95% CI, 2.29-2.60) and neurological conditions (SAR, 2.90; 95% CI, 2.71-3.09), as well as for circulatory, digestive and male and female genital conditions, than the reference population. Patients attending the Aboriginal health service had significantly lower attendance rates than the Australian population for respiratory illnesses, and conditions related to eyes or ears. CONCLUSIONS: At this urban Aboriginal health service, attendance patterns reflected complex health care needs that are different from those expected of a population of this age. Urban Aboriginal health service attendance appears to reflect significant ill health among the patients, aligning more with Aboriginal health statistics nationally rather than health statistics for urban non-Aboriginal Australians.

A mutant form of MeCP2 protein associated with human Rett syndrome cannot be displaced from methylated DNA by notch in Xenopus embryos.

MeCP2 is a DNA binding protein that represses transcription of methylated genes in vitro, but the endogenous function of MeCP2 in vivo is unclear. Here, we demonstrate that in Xenopus laevis embryos MeCP2 is a partner of the SMRT corepressor complex that regulates the expression of a neuronal repressor xHairy2a in differentiating neuroectoderm. The MeCP2/SMRT complex is bound to the promoter of the silenced xHairy2a gene and is displaced upon activation by the Notch intracellular domain (NICD). A truncated form of MeCP2 (R168X) found in patients with Rett syndrome cannot interact with the SMRT complex or fully activate xHairy2a during primary neurogenesis. This disruption of MeCP2 activity results in abnormal patterning of primary neurons during neuronal differentiation. Our results support a model whereby the dynamic association of MeCP2 with methylated DNA and the SMRT complex regulates a gene involved in cell fate decisions during primary neurogenesis in Xenopus.