Opposing Motor Memories in the Direct and Indirect Pathways of the Basal Ganglia.

Loss of dopamine neurons causes motor deterioration in Parkinson's disease patients. We have previously reported that in addition to acute motor impairment, the impaired motor behavior is encoded into long-term memory in an experience-dependent and task-specific manner, a phenomenon we refer to as aberrant inhibitory motor learning. Although normal motor learning and aberrant inhibitory learning oppose each other and this is manifested in apparent motor performance, in the present study, we found that normal motor memory acquired prior to aberrant inhibitory learning remains preserved in the brain, suggesting the existence of independent storage. To investigate the neuronal circuits underlying these two opposing memories, we took advantage of the RNA-binding protein YTHDF1, an m 6 A RNA methylation reader involved in the regulation of protein synthesis and learning/memory. Conditional deletion of Ythdf1 in either D1 or D2 receptor-expressing neurons revealed that normal motor memory is stored in the D1 (direct) pathway of the basal ganglia, while inhibitory memory is stored in the D2 (indirect) pathway. Furthermore, fiber photometry recordings of GCaMP signals from striatal D1 (dSPN) and D2 (iSPN) receptor-expressing neurons support the preservation of normal memory in the direct pathway after aberrant inhibitory learning, with activities of dSPN predictive of motor performance. Finally, a computational model based on activities of motor cortical neurons, dSPN and iSPN neurons, and their interactions through the basal ganglia loops supports the above observations. These findings have important implications for novel approaches in treating Parkinson's disease by reactivating preserved normal memory, and in treating hyperkinetic movement disorders such as chorea or tics by erasing aberrant motor memories.

Chronic food restriction enhances dopamine-mediated intracranial self-stimulation.

Dopamine-mediated reinforcement and behavioral adaptation is essential to survival. Here, we test the effects of food restriction on dopamine-mediated learning and reinforcement using optical intracranial self-stimulation (oICSS), an optogenetic version of conventional electrical ICSS (also known as brain stimulation reward, BSR). Using mouse genetic lines to express channelrhodopsin selectively in midbrain dopamine neurons, we demonstrate that genetically expressed channelrhodopsin can mediate optically evoked dopamine release and support self-stimulation in a lever-pressing paradigm. Using this midbrain dopamine oICSS preparation, we compare acquisition and rate of pressing in ad libitum versus food restricted mice. Food restriction facilitated both more rapid acquisition of self-stimulation behavior and higher rates of responding; reversing food status after acquisition modulated response vigor in already established behavior. These data suggest that food restriction enhances both the acquisition and expression of dopamine-reinforced self-stimulation responding. These data demonstrate the utility of oICSS for examining changes in reinforcement learning concomitant to neuroadaptations induced in dopamine signaling by experimental manipulations such as food restriction.

Activity-based Anorexia for Modeling Vulnerability and Resilience in Mice.

Activity-based anorexia (ABA) is a widely used rodent model of anorexia nervosa. It involves combining limited access to food with unlimited access to a running wheel, leading to a paradoxical decrease in food intake, hyperactivity, and life-threatening weight loss. Although initially characterized in rats, ABA has been tested in mice with results that vary based on strain, sex, age, the amount of time food is available, and the number of days of food restriction. Here, we present our ABA protocol for modeling both vulnerability and resilience to diet and exercise in C57BL/6 female mice. While vulnerable mice exhibit the expected increase in running, reduction in food intake, and excessive weight loss, resilient mice exhibit an adaptive increase in food intake, decrease in total wheel running, and weight stabilization. In contrast to previous ABA studies in which resilience is defined by the relative rate of weight loss, our protocol leads to a resilient phenotype that more closely resembles the maintenance of a stable bodyweight exhibited by most humans who diet and exercise without developing anorexia nervosa. This protocol will be useful for future studies aimed at identifying the physiological and neural adaptations underlying both resilience and vulnerability to this eating disorder.

Commentary on Vulnerability and Resilience to Activity-Based Anorexia and the Role of Dopamine.

Activity-based anorexia (ABA) is a commonly used rodent model of anorexia nervosa that is based on observations made in rats decades ago. In recently published work, we describe using this paradigm to model vulnerability and resilience to anorexia nervosa in mice, where vulnerability is characterized by hyperactivity and life-threatening weight loss and resilience is characterized by adaptation and weight stabilization. Using genetically modified hyperdopaminergic mice, we also demonstrate that increased dopamine augments vulnerability to ABA. Here, we briefly review our findings and discuss how obtaining vulnerable and resilient phenotypes enhances utility of the ABA model for understanding the neurobiological basis of anorexia nervosa. We comment on our dopamine findings and close by discussing implications for clinical treatment.

The Rise and Fall of Dopamine: A Two-Stage Model of the Development and Entrenchment of Anorexia Nervosa.

Dopamine has long been implicated as a critical neural substrate mediating anorexia nervosa (AN). Despite nearly 50 years of research, the putative direction of change in dopamine function remains unclear and no consensus on the mechanistic role of dopamine in AN has been achieved. We hypothesize two stages in AN- corresponding to initial development and entrenchment- characterized by opposite changes in dopamine. First, caloric restriction, particularly when combined with exercise, triggers an escalating spiral of increasing dopamine that facilitates the behavioral plasticity necessary to establish and reinforce weight-loss behaviors. Second, chronic self-starvation reverses this escalation to reduce or impair dopamine which, in turn, confers behavioral inflexibility and entrenchment of now established AN behaviors. This pattern of enhanced, followed by impaired dopamine might be a common path to many behavioral disorders characterized by reinforcement learning and subsequent behavioral inflexibility. If correct, our hypothesis has significant clinical and research implications for AN and other disorders, such as addiction and obesity.

Vulnerable and Resilient Phenotypes in a Mouse Model of Anorexia Nervosa.

BACKGROUND: Increased physical activity is a common feature of anorexia nervosa (AN). Although high activity levels are associated with greater risk of developing AN, particularly when combined with dieting, most individuals who diet and exercise maintain a healthy body weight. It is unclear why some individuals develop AN while most do not. A rodent model of resilience and vulnerability to AN would be valuable to research. Dopamine, which is believed to play a crucial role in AN, regulates both reward and activity and may modulate vulnerability. METHODS: Adolescent and young adult female C57BL/6N mice were tested in the activity-based anorexia (ABA) model, with an extended period of food restriction in adult mice. ABA was also tested in dopamine transporter knockdown mice and wild-type littermates. Mice that adapted to conditions and maintained a stable body weight were characterized as resilient. RESULTS: In adults, vulnerable and resilient phenotypes emerged in both the ABA and food-restricted mice without wheels. Vulnerable mice exhibited a pronounced increase in running throughout the light cycle, which dramatically peaked prior to requiring removal from the experiment. Resilient mice exhibited an adaptive decrease in total running, appropriate food anticipatory activity, and increased consumption, thereby achieving stable body weight. Hyperdopaminergia accelerated progression of the vulnerable phenotype. CONCLUSIONS: Our demonstration of distinct resilient and vulnerable phenotypes in mouse ABA significantly advances the utility of the model for identifying genes and neural substrates mediating AN risk and resilience. Modulation of dopamine may play a central role in the underlying circuit.

Striatal Dopamine D2 Receptors Regulate Cost Sensitivity and Behavioral Thrift.

The role of the dopamine D2 receptor (D2R) in regulating appetitive behavior continues to be controversial. Earlier literature suggests that reduced D2R signaling diminishes motivated behavior while more recent theories suggest that reduced D2R, as has been putatively observed in obesity, facilitates compulsive appetitive behavior and promotes overeating. Using a homecage foraging paradigm with mice, we revisit classic neuroleptic pharmacological studies from the 1970s that led to the 'extinction mimicry' hypothesis: that dopamine blockade reduces reinforcement leading to an extinction-like reduction in a learned, motivated behavior. We complement this with a selective genetic deletion of D2R in indirect pathway medium spiny neurons (iMSNs). Administration of haloperidol shifts foraging strategy toward less effortful, more thrifty pursuit of food without altering consumption or bodyweight. D2R deletion in iMSNs also reduces effort and energy expended toward food pursuit, but without a compensatory shift in foraging strategy, resulting in loss of body weight, an effect more pronounced under conditions of escalating costs as the knockouts fail to adequately increase effort. The selective knockouts exhibit no change in sucrose preference or sucrose reinforcement. These data suggest that striatal D2R regulates effort in response to costs, mediating cost sensitivity and behavioral thrift. In the context of obesity, these data suggest that reduced D2R is more likely to diminish effort and behavioral energy expenditure rather than increase appetitive motivation and consumption, possibly contributing to reduced physical activity commonly observed in obesity.

Synchronicity: The Role of Midbrain Dopamine in Whole-Brain Coordination.

Midbrain dopamine seems to play an outsized role in motivated behavior and learning. Widely associated with mediating reward-related behavior, decision making, and learning, dopamine continues to generate controversies in the field. While many studies and theories focus on what dopamine cells encode, the question of how the midbrain derives the information it encodes is poorly understood and comparatively less addressed. Recent anatomical studies suggest greater diversity and complexity of afferent inputs than previously appreciated, requiring rethinking of prior models. Here, we elaborate a hypothesis that construes midbrain dopamine as implementing a Bayesian selector in which individual dopamine cells sample afferent activity across distributed brain substrates, comprising evidence to be evaluated on the extent to which stimuli in the on-going sensorimotor stream organizes distributed, parallel processing, reflecting implicit value. To effectively generate a temporally resolved phasic signal, a population of dopamine cells must exhibit synchronous activity. We argue that synchronous activity across a population of dopamine cells signals consensus across distributed afferent substrates, invigorating responding to recognized opportunities and facilitating further learning. In framing our hypothesis, we shift from the question of how value is computed to the broader question of how the brain achieves coordination across distributed, parallel processing. We posit the midbrain is part of an "axis of agency" in which the prefrontal cortex (PFC), basal ganglia (BGS), and midbrain form an axis mediating control, coordination, and consensus, respectively.

To Do or Not to Do: Dopamine, Affordability and the Economics of Opportunity.

Five years ago, we introduced the thrift hypothesis of dopamine (DA), suggesting that the primary role of DA in adaptive behavior is regulating behavioral energy expenditure to match the prevailing economic conditions of the environment. Here we elaborate that hypothesis with several new ideas. First, we introduce the concept of affordability, suggesting that costs must necessarily be evaluated with respect to the availability of resources to the organism, which computes a value not only for the potential reward opportunity, but also the value of resources expended. Placing both costs and benefits within the context of the larger economy in which the animal is functioning requires consideration of the different timescales against which to compute resource availability, or average reward rate. Appropriate windows of computation for tracking resources requires corresponding neural substrates that operate on these different timescales. In discussing temporal patterns of DA signaling, we focus on a neglected form of DA plasticity and adaptation, changes in the physical substrate of the DA system itself, such as up- and down-regulation of receptors or release probability. We argue that changes in the DA substrate itself fundamentally alter its computational function, which we propose mediates adaptations to longer temporal horizons and economic conditions. In developing our hypothesis, we focus on DA D2 receptors (D2R), arguing that D2R implements a form of "cost control" in response to the environmental economy, serving as the "brain's comptroller". We propose that the balance between the direct and indirect pathway, regulated by relative expression of D1 and D2 DA receptors, implements affordability. Finally, as we review data, we discuss limitations in current approaches that impede fully investigating the proposed hypothesis and highlight alternative, more semi-naturalistic strategies more conducive to neuroeconomic investigations on the role of DA in adaptive behavior.

High fructose corn syrup induces metabolic dysregulation and altered dopamine signaling in the absence of obesity.

The contribution of high fructose corn syrup (HFCS) to metabolic disorder and obesity, independent of high fat, energy-rich diets, is controversial. While high-fat diets are widely accepted as a rodent model of diet-induced obesity (DIO) and metabolic disorder, the value of HFCS alone as a rodent model of DIO is unclear. Impaired dopamine function is associated with obesity and high fat diet, but the effect of HFCS on the dopamine system has not been investigated. The objective of this study was to test the effect of HFCS on weight gain, glucose regulation, and evoked dopamine release using fast-scan cyclic voltammetry. Mice (C57BL/6) received either water or 10% HFCS solution in combination with ad libitum chow for 15 weeks. HFCS consumption with chow diet did not induce weight gain compared to water, chow-only controls but did induce glucose dysregulation and reduced evoked dopamine release in the dorsolateral striatum. These data show that HFCS can contribute to metabolic disorder and altered dopamine function independent of weight gain and high-fat diets.

Chronic Nicotine Alters Corticostriatal Plasticity in the Striatopallidal Pathway Mediated By NR2B-Containing Silent Synapses.

Smoking is the leading cause of preventable death in the United States and success rates for quitting remain low. High relapse rates are attributed to pervasive nicotine-reinforced associative learning of incentive cues that is highly resistant to extinction. Why such learning is so persistent is poorly understood but may arise as a consequence of neuroadaptations in synaptic plasticity induced by chronic nicotine. We used whole-cell patch clamp recording to investigate the effect of chronic nicotine (cNIC) on synaptic plasticity in dopamine D2 receptor-expressing medium-spiny neurons in the indirect, striatopallidal pathway in dorsolateral striatum. Mice exposed to cNIC exhibited long-term potentiation in response to high-frequency stimulation instead of the expected depression. cNIC decreased baseline AMPA/NMDA ratio, arising from increased NMDA currents enriched in the NR2B subunit with a concomitant upregulation of NMDA-only, silent synapses. These data demonstrate that cNIC can increase silent synapses in MSNs, as observed with cocaine and opiates, and alter the regulation of corticostriatal plasticity. Prior work has characterized cocaine- and morphine-induced upregulation of silent synapses in the ventral striatum; we show it can occur in the dorsal striatum, a region associated with later stages of addiction, craving, and cue-induced relapse.

Chronic Nicotine Mitigates Aberrant Inhibitory Motor Learning Induced by Motor Experience under Dopamine Deficiency.

UNLABELLED: Although dopamine receptor antagonism has long been associated with impairments in motor performance, more recent studies have shown that dopamine D2 receptor (D2R) antagonism, paired with a motor task, not only impairs motor performance concomitant with the pharmacodynamics of the drug, but also impairs future motor performance once antagonism has been relieved. We have termed this phenomenon "aberrant motor learning" and have suggested that it may contribute to motor symptoms in movement disorders such as Parkinson's disease (PD). Here, we show that chronic nicotine (cNIC), but not acute nicotine, treatment mitigates the acquisition of D2R-antagonist-induced aberrant motor learning in mice. Although cNIC mitigates D2R-mediated aberrant motor learning, cNIC has no effect on D1R-mediated motor learning. ß2-containing nicotinic receptors in dopamine neurons likely mediate the protective effect of cNIC against aberrant motor learning, because selective deletion of ß2 nicotinic subunits in dopamine neurons reduced D2R-mediated aberrant motor learning. Finally, both cNIC treatment and ß2 subunit deletion blunted postsynaptic responses to D2R antagonism. These results suggest that a chronic decrease in function or a downregulation of ß2-containing nicotinic receptors protects the striatal network against aberrant plasticity and aberrant motor learning induced by motor experience under dopamine deficiency. SIGNIFICANCE STATEMENT: Increasingly, aberrant plasticity and aberrant learning are recognized as contributing to the development and progression of movement disorders. Here, we show that chronic nicotine (cNIC) treatment or specific deletion of ß2 nicotinic receptor subunits in dopamine neurons mitigates aberrant motor learning induced by dopamine D2 receptor (D2R) blockade in mice. Moreover, both manipulations also reduced striatal dopamine release and blunt postsynaptic responses to D2R antagonists. These results suggest that chronic downregulation of function and/or receptor expression of ß2-containing nicotinic receptors alters presynaptic and postsynaptic striatal signaling to protect against aberrant motor learning. Moreover, these results suggest that cNIC treatment may alleviate motor symptoms and/or delay the deterioration of motor function in movement disorders by blocking aberrant motor learning.

Low Dopamine D2 Receptor Increases Vulnerability to Obesity Via Reduced Physical Activity, Not Increased Appetitive Motivation.

BACKGROUND: The dopamine D2 receptor (D2R) has received much attention in obesity studies. Data indicate that D2R is reduced in obesity and that the TaqA1 D2R variant may be more prevalent among obese persons. It is often suggested that reduced D2R generates a reward deficiency and altered appetitive motivation that induces compulsive eating and contributes to obesity. Although dopamine is known to regulate physical activity, it is often neglected in these studies, leaving open the question of whether reduced D2R contributes to obesity through alterations in energy expenditure and activity. METHODS: We generated a D2R knockdown (KD) mouse line and assessed both energy expenditure and appetitive motivation under conditions of diet-induced obesity. RESULTS: The KD mice did not gain more weight or show increased appetitive motivation compared with wild-type mice in a standard environment; however, in an enriched environment with voluntary exercise opportunities, KD mice exhibited dramatically lower activity and became more obese than wild-type mice, obtaining no protective benefit from exercise opportunities. CONCLUSIONS: These data suggest the primary contribution of altered D2R signaling to obesity lies in altered energy expenditure rather than the induction of compulsive overeating.

Cyclic AMP and afferent activity govern bidirectional synaptic plasticity in striatopallidal neurons.

Recent experimental evidence suggests that the low dopamine conditions in Parkinson's disease (PD) cause motor impairment through aberrant motor learning. Those data, along with computational models, suggest that this aberrant learning results from maladaptive corticostriatal plasticity and learned motor inhibition. Dopaminergic modulation of both corticostriatal long-term depression (LTD) and long-term potentiation (LTP) is proposed to be critical for these processes; however, the regulatory mechanisms underlying bidirectional corticostriatal plasticity are not fully understood. Previously, we demonstrated a key role for cAMP signaling in corticostriatal LTD. In this study, mouse brain slices were used to perform a parametric experiment that tested the impact of varying both intracellular cAMP levels and the strength of excitatory inputs on corticostriatal plasticity. Using slice electrophysiology in the dorsolateral striatum, we demonstrate that both LTP and LTD can be sequentially induced in the same D2-expressing neuron and that LTP was strongest with high intracellular cAMP and LFS, whereas LTD required low intracellular cAMP and high-frequency stimulation. Our results provide a molecular and cellular basis for regulating bidirectional corticostriatal synaptic plasticity and may help to identify novel therapeutic targets for blocking or reversing the aberrant synaptic plasticity that likely contributes to motor deficits in PD.

Nicotinic receptors regulate the dynamic range of dopamine release in vivo.

Nicotinic acetylcholine receptors (nAChRs) are expressed presynaptically on dopamine axon terminals, and their activation by endogenous acetylcholine from striatal cholinergic interneurons enhances dopamine release both independently of and in concert with dopamine neuron activity. Acute nAChR inactivation is believed to enhance the contrast between low- and high-frequency dopamine cell activity. Although these studies reveal a key role for acute activation and inactivation of nAChRs in striatal microcircuitry, it remains unknown if chronic inactivation/desensitization of nAChRs can alter dopamine release dynamics. Using in vivo cyclic voltammetry in anaesthetized mice, we examined whether chronic inactivation of nAChRs modulates dopamine release across a parametric range of stimulation, varying both frequency and pulse number. Deletion of ß2*nAChRs and chronic nicotine exposure greatly diminished dopamine release across the entire range of stimulation parameters. In addition, we observed a facilitation of dopamine release at low frequency and pulse number in wild-type mice that is absent in the ß2* knockout and chronic nicotine mice. These data suggest that deletion or chronic desensitization of nAChRs reduces the dynamic range of dopamine release in response to dopamine cell activity, decreasing rather than increasing contrast between high and low dopamine activity.

The Enemy within: Propagation of Aberrant Corticostriatal Learning to Cortical Function in Parkinson's Disease.

Motor dysfunction in Parkinson's disease is believed to arise primarily from pathophysiology in the dorsal striatum and its related corticostriatal and thalamostriatal circuits during progressive dopamine denervation. One function of these circuits is to provide a filter that selectively facilitates or inhibits cortical activity to optimize cortical processing, making motor responses rapid and efficient. Corticostriatal synaptic plasticity mediates the learning that underlies this performance-optimizing filter. Under dopamine denervation, corticostriatal plasticity is altered, resulting in aberrant learning that induces inappropriate basal ganglia filtering that impedes rather than optimizes cortical processing. Human imaging suggests that increased cortical activity may compensate for striatal dysfunction in PD patients. In this Perspective article, we consider how aberrant learning at corticostriatal synapses may impair cortical processing and learning and undermine potential cortical compensatory mechanisms. Blocking or remediating aberrant corticostriatal plasticity may protect cortical function and support cortical compensatory mechanisms mitigating the functional decline associated with progressive dopamine denervation.

Exercise-enhanced neuroplasticity targeting motor and cognitive circuitry in Parkinson's disease.

Exercise interventions in individuals with Parkinson's disease incorporate goal-based motor skill training to engage cognitive circuitry important in motor learning. With this exercise approach, physical therapy helps with learning through instruction and feedback (reinforcement) and encouragement to perform beyond self-perceived capability. Individuals with Parkinson's disease become more cognitively engaged with the practice and learning of movements and skills that were previously automatic and unconscious. Aerobic exercise, regarded as important for improvement of blood flow and facilitation of neuroplasticity in elderly people, might also have a role in improvement of behavioural function in individuals with Parkinson's disease. Exercises that incorporate goal-based training and aerobic activity have the potential to improve both cognitive and automatic components of motor control in individuals with mild to moderate disease through experience-dependent neuroplasticity. Basic research in animal models of Parkinson's disease is beginning to show exercise-induced neuroplastic effects at the level of synaptic connections and circuits.

A role for dopamine-mediated learning in the pathophysiology and treatment of Parkinson's disease.

Dopamine contributes to corticostriatal plasticity and motor learning. Dopamine denervation profoundly alters motor performance, as in Parkinson's disease (PD); however, the extent to which these symptoms reflect impaired motor learning is unknown. Here, we demonstrate a D2 receptor blockade-induced aberrant learning that impedes future motor performance when dopamine signaling is restored, an effect diminished by coadministration of adenosine antagonists during blockade. We hypothesize that an inappropriate corticostriatal potentiation in striatopallidal cells of the indirect pathway underlies aberrant learning. We demonstrate synaptic potentiation in striatopallidal neurons induced by D2 blockade and diminished by application of an adenosine antagonist, consistent with behavioral observations. A neurocomputational model of the basal ganglia recapitulates the behavioral pattern and further links aberrant learning to plasticity in the indirect pathway. Thus, D2-mediated aberrant learning may contribute to motor deficits in PD, suggesting new avenues for the development of therapeutics.

Thorndike's Law 2.0: Dopamine and the Regulation of Thrift.

Dopamine is widely associated with reward, motivation, and reinforcement learning. Research on dopamine has emphasized its contribution to compulsive behaviors, such as addiction and overeating, with less examination of its potential role in behavioral flexibility in normal, non-pathological states. In the study reviewed here, we investigated the effect of increased tonic dopamine in a two-lever homecage operant paradigm where the relative value of the levers was dynamic, requiring the mice to constantly monitor reward outcome and adapt their behavior. The data were fit to a temporal difference learning model that showed that mice with elevated dopamine exhibited less coupling between reward history and behavioral choice. This work suggests a way to integrate motivational and learning theories of dopamine into a single formal model where tonic dopamine regulates the expression of prior reward learning by controlling the degree to which learned reward values bias behavioral choice. Here I place these results in a broader context of dopamine's role in instrumental learning and suggest a novel hypothesis that tonic dopamine regulates thrift, the degree to which an animal needs to exploit its prior reward learning to maximize return on energy expenditure. Our data suggest that increased dopamine decreases thriftiness, facilitating energy expenditure, and permitting greater exploration. Conversely, this implies that decreased dopamine increases thriftiness, favoring the exploitation of prior reward learning, and diminishing exploration. This perspective provides a different window onto the role dopamine may play in behavioral flexibility and its failure, compulsive behavior.