Chronic Nicotine Mitigates Aberrant Inhibitory Motor Learning Induced by Motor Experience under Dopamine Deficiency.

UNLABELLED: Although dopamine receptor antagonism has long been associated with impairments in motor performance, more recent studies have shown that dopamine D2 receptor (D2R) antagonism, paired with a motor task, not only impairs motor performance concomitant with the pharmacodynamics of the drug, but also impairs future motor performance once antagonism has been relieved. We have termed this phenomenon "aberrant motor learning" and have suggested that it may contribute to motor symptoms in movement disorders such as Parkinson's disease (PD). Here, we show that chronic nicotine (cNIC), but not acute nicotine, treatment mitigates the acquisition of D2R-antagonist-induced aberrant motor learning in mice. Although cNIC mitigates D2R-mediated aberrant motor learning, cNIC has no effect on D1R-mediated motor learning. ß2-containing nicotinic receptors in dopamine neurons likely mediate the protective effect of cNIC against aberrant motor learning, because selective deletion of ß2 nicotinic subunits in dopamine neurons reduced D2R-mediated aberrant motor learning. Finally, both cNIC treatment and ß2 subunit deletion blunted postsynaptic responses to D2R antagonism. These results suggest that a chronic decrease in function or a downregulation of ß2-containing nicotinic receptors protects the striatal network against aberrant plasticity and aberrant motor learning induced by motor experience under dopamine deficiency. SIGNIFICANCE STATEMENT: Increasingly, aberrant plasticity and aberrant learning are recognized as contributing to the development and progression of movement disorders. Here, we show that chronic nicotine (cNIC) treatment or specific deletion of ß2 nicotinic receptor subunits in dopamine neurons mitigates aberrant motor learning induced by dopamine D2 receptor (D2R) blockade in mice. Moreover, both manipulations also reduced striatal dopamine release and blunt postsynaptic responses to D2R antagonists. These results suggest that chronic downregulation of function and/or receptor expression of ß2-containing nicotinic receptors alters presynaptic and postsynaptic striatal signaling to protect against aberrant motor learning. Moreover, these results suggest that cNIC treatment may alleviate motor symptoms and/or delay the deterioration of motor function in movement disorders by blocking aberrant motor learning.

Cyclic AMP and afferent activity govern bidirectional synaptic plasticity in striatopallidal neurons.

Recent experimental evidence suggests that the low dopamine conditions in Parkinson's disease (PD) cause motor impairment through aberrant motor learning. Those data, along with computational models, suggest that this aberrant learning results from maladaptive corticostriatal plasticity and learned motor inhibition. Dopaminergic modulation of both corticostriatal long-term depression (LTD) and long-term potentiation (LTP) is proposed to be critical for these processes; however, the regulatory mechanisms underlying bidirectional corticostriatal plasticity are not fully understood. Previously, we demonstrated a key role for cAMP signaling in corticostriatal LTD. In this study, mouse brain slices were used to perform a parametric experiment that tested the impact of varying both intracellular cAMP levels and the strength of excitatory inputs on corticostriatal plasticity. Using slice electrophysiology in the dorsolateral striatum, we demonstrate that both LTP and LTD can be sequentially induced in the same D2-expressing neuron and that LTP was strongest with high intracellular cAMP and LFS, whereas LTD required low intracellular cAMP and high-frequency stimulation. Our results provide a molecular and cellular basis for regulating bidirectional corticostriatal synaptic plasticity and may help to identify novel therapeutic targets for blocking or reversing the aberrant synaptic plasticity that likely contributes to motor deficits in PD.

Nicotinic receptors regulate the dynamic range of dopamine release in vivo.

Nicotinic acetylcholine receptors (nAChRs) are expressed presynaptically on dopamine axon terminals, and their activation by endogenous acetylcholine from striatal cholinergic interneurons enhances dopamine release both independently of and in concert with dopamine neuron activity. Acute nAChR inactivation is believed to enhance the contrast between low- and high-frequency dopamine cell activity. Although these studies reveal a key role for acute activation and inactivation of nAChRs in striatal microcircuitry, it remains unknown if chronic inactivation/desensitization of nAChRs can alter dopamine release dynamics. Using in vivo cyclic voltammetry in anaesthetized mice, we examined whether chronic inactivation of nAChRs modulates dopamine release across a parametric range of stimulation, varying both frequency and pulse number. Deletion of ß2*nAChRs and chronic nicotine exposure greatly diminished dopamine release across the entire range of stimulation parameters. In addition, we observed a facilitation of dopamine release at low frequency and pulse number in wild-type mice that is absent in the ß2* knockout and chronic nicotine mice. These data suggest that deletion or chronic desensitization of nAChRs reduces the dynamic range of dopamine release in response to dopamine cell activity, decreasing rather than increasing contrast between high and low dopamine activity.

Opposing Motor Memories in the Direct and Indirect Pathways of the Basal Ganglia.

Loss of dopamine neurons causes motor deterioration in Parkinson's disease patients. We have previously reported that in addition to acute motor impairment, the impaired motor behavior is encoded into long-term memory in an experience-dependent and task-specific manner, a phenomenon we refer to as aberrant inhibitory motor learning. Although normal motor learning and aberrant inhibitory learning oppose each other and this is manifested in apparent motor performance, in the present study, we found that normal motor memory acquired prior to aberrant inhibitory learning remains preserved in the brain, suggesting the existence of independent storage. To investigate the neuronal circuits underlying these two opposing memories, we took advantage of the RNA-binding protein YTHDF1, an m 6 A RNA methylation reader involved in the regulation of protein synthesis and learning/memory. Conditional deletion of Ythdf1 in either D1 or D2 receptor-expressing neurons revealed that normal motor memory is stored in the D1 (direct) pathway of the basal ganglia, while inhibitory memory is stored in the D2 (indirect) pathway. Furthermore, fiber photometry recordings of GCaMP signals from striatal D1 (dSPN) and D2 (iSPN) receptor-expressing neurons support the preservation of normal memory in the direct pathway after aberrant inhibitory learning, with activities of dSPN predictive of motor performance. Finally, a computational model based on activities of motor cortical neurons, dSPN and iSPN neurons, and their interactions through the basal ganglia loops supports the above observations. These findings have important implications for novel approaches in treating Parkinson's disease by reactivating preserved normal memory, and in treating hyperkinetic movement disorders such as chorea or tics by erasing aberrant motor memories.

Dopaminergic enhancement of local food-seeking is under global homeostatic control.

Recent work has implicated dopaminergic mechanisms in overeating and obesity with some researchers suggesting parallels between the dopamine dysregulation associated with addiction and an analogous dysregulation in obesity. The precise role of dopamine in mediating reward and reinforcement, however, remains controversial. In contrast to drugs of abuse, pursuit of a natural reward, such as food, is regulated by homeostatic processes that putatively maintain a stable energy balance keeping unrestrained consumption and reward pursuit in check. Understanding how the reward system is constrained by or escapes homeostatic regulation is a critical question. The widespread use of food restriction to motivate animal subjects in behavior paradigms precludes investigation of this relationship as the homeostatic system is locked into deficit mode. In the present study, we examined the role of dopamine in modulating adaptive feeding behavior in semi-naturalistic homecage paradigms where mice earn all of their food from lever pressing. We compared consumption and meal patterning between hyperdopaminergic dopamine transporter knock-down and wild-type mice in two paradigms that introduce escalating costs for procuring food. We found that hyperdopaminergic mice exhibited similar demand elasticity, weight loss and energy balance in response to cost. However, the dopamine transporter knock-down mice showed clear differences in meal patterning. Consistent with expectations of enhanced motivation, elevated dopamine increased the meal size and reduced intrameal cost sensitivity. Nonetheless, this did not alter the overall energy balance. We conclude that elevated dopamine enhances the incentive or willingness to work locally within meals without shifting the energy balance, enhancing global food-seeking or generating an energy surplus.

Taste uncoupled from nutrition fails to sustain the reinforcing properties of food.

Recent findings suggest the reward system encodes metabolic value independent of taste, provoking speculation that the hedonic value of taste could be derived from nutritional value as a secondary appetitive property. We therefore dissociated and compared the impact of nutrition and taste on appetitive behavior in several paradigms. Though taste alone induces preference and increased consumption, in the absence of nutritional value its reinforcing properties are greatly diminished and it does not, like sucrose, induce increased responding over time. In agreement with behavioral data, saccharin-evoked (but not sucrose-evoked) dopamine release is greatly attenuated following pre-exposure, suggesting that nutritional value is critical for dopamine-mediated reward and reinforcement. Further supporting the primacy of nutrition over taste, genetically increased dopaminergic tone enhances incentive associated with nutritional value with minimal impact on taste-based, hedonic incentive. Overall, we suggest that the sensory-hedonic incentive value associated with taste functions as a conditioned stimulus that requires nutritional value to sustainably organize appetitive behavior.

Sucrose-predictive cues evoke greater phasic dopamine release than saccharin-predictive cues.

Cues that have been paired with food evoke dopamine in nucleus accumbens (NAc) and drive approach behavior. This cue-evoked dopamine signaling could contribute to overconsumption of food. One manner in which individuals try to restrict caloric intake is through the consumption of foods containing artificial (non-nutritive) sweeteners. We were interested in whether cues paired with a non-nutritive sweetener (saccharin) would evoke similar dopamine release as cues paired with a nutritive sweetener (sucrose). We trained food-restricted rats to associate distinct cues with sucrose or saccharin pellets. In the first group of rats, training sessions with each pellet took place on different days, maximizing the opportunity for rats to detect nutritional differences. After training, voltammetry recordings in NAc core revealed that sucrose cues evoked greater phasic dopamine release than saccharin cues. In a second group of rats, on each training day, sucrose and saccharin pellets were presented in pseudorandom order within the same session, to mask nutritional differences. In this condition, the difference in dopamine between sucrose and saccharin cues was attenuated, but not abolished. These results suggest that sucrose-paired cues will more powerfully motivate behavior than saccharin-paired cues. The differing responses to each cue seem to be driven by overall preference with both the nutritional value that the pellets predict as well as other factors, such as taste, contributing.

Previous exposure to delta9-tetrahydrocannibinol enhances locomotor responding to but not self-administration of amphetamine.

Previous exposure to amphetamine leads to enhanced locomotor and nucleus accumbens (NAcc) dopamine (DA) responding to the drug as well as enhanced amphetamine self-administration. Here, we investigated the effects of exposure to Δ(9)-tetrahydrocannibinol (Δ(9)-THC) on behavioral and biochemical responding to amphetamine. Rats in different groups received five exposure injections of vehicle or one of five doses of Δ(9)-THC (0.4, 0.75, 1.5, 3.0, and 6.0 mg/kg i.p.) and were tested 2 days and 2 weeks later. Exposure to all but the lowest and highest doses of Δ(9)-THC enhanced the locomotor response to amphetamine (0.75 mg/kg i.p.), but all failed to enhance NAcc DA overflow in response to the drug. Moreover, exposure to 3.0 mg/kg i.p. Δ(9)-THC increased forskolin-evoked adenylyl cyclase activity in the NAcc and rats' locomotor response to the direct DA receptor agonist apomorphine (1.0 mg/kg s.c.), suggesting that Δ(9)-THC sensitized locomotor responding to amphetamine by up-regulating postsynaptic DA receptor signaling in the NAcc. Finally, amphetamine self-administration (200 µg/kg/infusion i.v.) was enhanced in amphetamine (5 × 1.5 mg/kg i.p.)-exposed rats, but not in rats exposed to Δ(9)-THC (5 × 3.0 mg/kg i.p.). Previous exposure to this dose of Δ(9)-THC modestly increased apomorphine SA (0.5 mg/kg/infusion i.v.). Thus, unlike amphetamine exposure, exposure to Δ(9)-THC does not enhance the subsequent NAcc DA response to amphetamine or promote amphetamine self-administration. Although Δ(9)-THC leads to alterations in postsynaptic DA receptor signaling in the NAcc and these can affect the generation of locomotion, these neuroadaptations do not seem to be linked to the expression of enhanced amphetamine self-administration.

Dopamine-dependent motor learning: insight into levodopa's long-duration response.

OBJECTIVE: Dopamine (DA) is critical for motor performance, motor learning, and corticostriatal plasticity. The relationship between motor performance and learning, and the role of DA in the mediation of them, however, remain unclear. METHODS: To examine this question, we took advantage of PITx3-deficient mice (aphakia mice), in which DA in the dorsal striatum is reduced by 90%. PITx3-deficient mice do not display obvious motor deficits in their home cage, but are impaired in motor tasks that require new motor skills. We used the accelerating rotarod as a motor learning task. RESULTS: We show that the deficiency in motor skill learning in PITx3(-/-) is dramatic and can be rescued with levodopa treatment. In addition, cessation of levodopa treatment after acquisition of the motor skill does not result in an immediate drop in performance. Instead, there is a gradual decline of performance that lasts for a few days, which is not related to levodopa pharmacokinetics. We show that this gradual decline is dependent on the retesting experience. INTERPRETATION: This observation resembles the long-duration response to levodopa therapy in its slow buildup of improvement after the initiation of therapy and gradual degradation. We hypothesize that motor learning may play a significant, underappreciated role in the symptomatology of Parkinson disease as well as in the therapeutic effects of levodopa. We suggest that the important, yet enigmatic long-duration response to chronic levodopa treatment is a manifestation of rescued motor learning.

A molecular dissociation between cued and contextual appetitive learning.

In appetitive Pavlovian learning, animals learn to associate discrete cues or environmental contexts with rewarding outcomes, and these cues and/or contexts can potentiate an ongoing instrumental response for reward. Although anatomical substrates underlying cued and contextual learning have been proposed, it remains unknown whether specific molecular signaling pathways within the striatum underlie one form of learning or the other. Here, we show that while the striatum-enriched isoform of adenylyl cyclase (AC5) is required for cued appetitive Pavlovian learning, it is not required for contextual appetitive learning. Mice lacking AC5 (AC5KO) could not learn an appetitive Pavlovian learning task in which a discrete signal light predicted reward delivery, yet they could form associations between context and either natural or drug reward, which could in turn elicit Pavlovian approach behavior. However, unlike wild-type (WT) mice, AC5KO mice could not use these Pavlovian conditioned stimuli to potentiate ongoing instrumental behavior in a Pavlovian-to-instrumental transfer paradigm. These data suggest that AC5 is specifically required for learning associations between discrete cues and outcomes in which the temporal relationship between conditioned stimulus (CS) and unconditioned stimulus (US) is essential, while alternative signaling mechanisms may underlie the formation of associations between context and reward. In addition, loss of AC5 compromises the ability of both contextual and discrete cues to modulate instrumental behavior.

Commentary on Vulnerability and Resilience to Activity-Based Anorexia and the Role of Dopamine.

Activity-based anorexia (ABA) is a commonly used rodent model of anorexia nervosa that is based on observations made in rats decades ago. In recently published work, we describe using this paradigm to model vulnerability and resilience to anorexia nervosa in mice, where vulnerability is characterized by hyperactivity and life-threatening weight loss and resilience is characterized by adaptation and weight stabilization. Using genetically modified hyperdopaminergic mice, we also demonstrate that increased dopamine augments vulnerability to ABA. Here, we briefly review our findings and discuss how obtaining vulnerable and resilient phenotypes enhances utility of the ABA model for understanding the neurobiological basis of anorexia nervosa. We comment on our dopamine findings and close by discussing implications for clinical treatment.

Activity-based Anorexia for Modeling Vulnerability and Resilience in Mice.

Activity-based anorexia (ABA) is a widely used rodent model of anorexia nervosa. It involves combining limited access to food with unlimited access to a running wheel, leading to a paradoxical decrease in food intake, hyperactivity, and life-threatening weight loss. Although initially characterized in rats, ABA has been tested in mice with results that vary based on strain, sex, age, the amount of time food is available, and the number of days of food restriction. Here, we present our ABA protocol for modeling both vulnerability and resilience to diet and exercise in C57BL/6 female mice. While vulnerable mice exhibit the expected increase in running, reduction in food intake, and excessive weight loss, resilient mice exhibit an adaptive increase in food intake, decrease in total wheel running, and weight stabilization. In contrast to previous ABA studies in which resilience is defined by the relative rate of weight loss, our protocol leads to a resilient phenotype that more closely resembles the maintenance of a stable bodyweight exhibited by most humans who diet and exercise without developing anorexia nervosa. This protocol will be useful for future studies aimed at identifying the physiological and neural adaptations underlying both resilience and vulnerability to this eating disorder.

The Rise and Fall of Dopamine: A Two-Stage Model of the Development and Entrenchment of Anorexia Nervosa.

Dopamine has long been implicated as a critical neural substrate mediating anorexia nervosa (AN). Despite nearly 50 years of research, the putative direction of change in dopamine function remains unclear and no consensus on the mechanistic role of dopamine in AN has been achieved. We hypothesize two stages in AN- corresponding to initial development and entrenchment- characterized by opposite changes in dopamine. First, caloric restriction, particularly when combined with exercise, triggers an escalating spiral of increasing dopamine that facilitates the behavioral plasticity necessary to establish and reinforce weight-loss behaviors. Second, chronic self-starvation reverses this escalation to reduce or impair dopamine which, in turn, confers behavioral inflexibility and entrenchment of now established AN behaviors. This pattern of enhanced, followed by impaired dopamine might be a common path to many behavioral disorders characterized by reinforcement learning and subsequent behavioral inflexibility. If correct, our hypothesis has significant clinical and research implications for AN and other disorders, such as addiction and obesity.

Chronic food restriction enhances dopamine-mediated intracranial self-stimulation.

Dopamine-mediated reinforcement and behavioral adaptation is essential to survival. Here, we test the effects of food restriction on dopamine-mediated learning and reinforcement using optical intracranial self-stimulation (oICSS), an optogenetic version of conventional electrical ICSS (also known as brain stimulation reward, BSR). Using mouse genetic lines to express channelrhodopsin selectively in midbrain dopamine neurons, we demonstrate that genetically expressed channelrhodopsin can mediate optically evoked dopamine release and support self-stimulation in a lever-pressing paradigm. Using this midbrain dopamine oICSS preparation, we compare acquisition and rate of pressing in ad libitum versus food restricted mice. Food restriction facilitated both more rapid acquisition of self-stimulation behavior and higher rates of responding; reversing food status after acquisition modulated response vigor in already established behavior. These data suggest that food restriction enhances both the acquisition and expression of dopamine-reinforced self-stimulation responding. These data demonstrate the utility of oICSS for examining changes in reinforcement learning concomitant to neuroadaptations induced in dopamine signaling by experimental manipulations such as food restriction.

Vulnerable and Resilient Phenotypes in a Mouse Model of Anorexia Nervosa.

BACKGROUND: Increased physical activity is a common feature of anorexia nervosa (AN). Although high activity levels are associated with greater risk of developing AN, particularly when combined with dieting, most individuals who diet and exercise maintain a healthy body weight. It is unclear why some individuals develop AN while most do not. A rodent model of resilience and vulnerability to AN would be valuable to research. Dopamine, which is believed to play a crucial role in AN, regulates both reward and activity and may modulate vulnerability. METHODS: Adolescent and young adult female C57BL/6N mice were tested in the activity-based anorexia (ABA) model, with an extended period of food restriction in adult mice. ABA was also tested in dopamine transporter knockdown mice and wild-type littermates. Mice that adapted to conditions and maintained a stable body weight were characterized as resilient. RESULTS: In adults, vulnerable and resilient phenotypes emerged in both the ABA and food-restricted mice without wheels. Vulnerable mice exhibited a pronounced increase in running throughout the light cycle, which dramatically peaked prior to requiring removal from the experiment. Resilient mice exhibited an adaptive decrease in total running, appropriate food anticipatory activity, and increased consumption, thereby achieving stable body weight. Hyperdopaminergia accelerated progression of the vulnerable phenotype. CONCLUSIONS: Our demonstration of distinct resilient and vulnerable phenotypes in mouse ABA significantly advances the utility of the model for identifying genes and neural substrates mediating AN risk and resilience. Modulation of dopamine may play a central role in the underlying circuit.

Dopamine scales performance in the absence of new learning.

Learning and motivation are integral in shaping an organism's adaptive behavior. The dopamine system has been implicated in both processes; however, dissociating the two, both experimentally and conceptually, has posed significant challenges. We have developed an animal model that dissociates expression or scaling of a learned behavior from learning itself. An inducible dopamine transporter (DAT) knockdown mouse line has been generated, which exhibits significantly slower reuptake of released dopamine and increased tonic firing of dopamine neurons without altering phasic burst firing. Mice were trained in experimental tasks prior to inducing a hyperdopaminergic tone and then retested. Elevated dopamine enhanced performance in goal-directed operant responses. These data demonstrate that alterations in dopaminergic tone can scale the performance of a previously learned behavior in the absence of new learning.

Adenylyl cyclase type 5 contributes to corticostriatal plasticity and striatum-dependent learning.

Dopamine (DA)-dependent corticostriatal plasticity is thought to underlie incremental procedural learning. A primary effector of striatal DA signaling is cAMP, yet its role in corticostriatal plasticity and striatum-dependent learning remains unclear. Here, we show that genetic deletion of a striatum-enriched isoform of adenylyl cyclase, AC5 knock-out (AC5KO), impairs two forms of striatum-dependent learning and corticostriatal synaptic plasticity. AC5KO mice were severely impaired in acquisition of a response strategy in the cross maze, a striatum-dependent task requiring a correct body turn to find a goal arm. In addition, AC5KO mice were impaired in acquisition of a motor skill, as assessed by the accelerated rotarod. Slice electrophysiology revealed a deficit in corticostriatal long-term depression (LTD) after high-frequency stimulation of tissue from AC5KO mice. LTD was rescued by activation of either presynaptic cannabinoid type 1 (CB(1)) receptors or postsynaptic metabotropic glutamate receptors (mGluRs), suggesting a postsynaptic role of AC5-cAMP, upstream of endocannabinoid release. In striatopallidal-projecting medium spiny neurons, DA D(2) receptors are negatively coupled to cAMP production, and activation of these receptors is required for endocannabinoid release and corticostriatal LTD. Recordings from striatopallidal neurons indicated that this is mediated by AC5, because coactivation of D(2) and mGluRs could induce LTD in wild-type but not in AC5KO neurons. To further examine the role of cAMP in corticostriatal plasticity, we elevated cAMP in striatal neurons of wild-type mice via the recording electrode. Under these conditions, corticostriatal LTD was eliminated. Together, these data suggest an AC5-cAMP-endocannabinoid-CB(1) signaling pathway in corticostriatal plasticity and striatum-dependent learning.

Striatal Dopamine D2 Receptors Regulate Cost Sensitivity and Behavioral Thrift.

The role of the dopamine D2 receptor (D2R) in regulating appetitive behavior continues to be controversial. Earlier literature suggests that reduced D2R signaling diminishes motivated behavior while more recent theories suggest that reduced D2R, as has been putatively observed in obesity, facilitates compulsive appetitive behavior and promotes overeating. Using a homecage foraging paradigm with mice, we revisit classic neuroleptic pharmacological studies from the 1970s that led to the 'extinction mimicry' hypothesis: that dopamine blockade reduces reinforcement leading to an extinction-like reduction in a learned, motivated behavior. We complement this with a selective genetic deletion of D2R in indirect pathway medium spiny neurons (iMSNs). Administration of haloperidol shifts foraging strategy toward less effortful, more thrifty pursuit of food without altering consumption or bodyweight. D2R deletion in iMSNs also reduces effort and energy expended toward food pursuit, but without a compensatory shift in foraging strategy, resulting in loss of body weight, an effect more pronounced under conditions of escalating costs as the knockouts fail to adequately increase effort. The selective knockouts exhibit no change in sucrose preference or sucrose reinforcement. These data suggest that striatal D2R regulates effort in response to costs, mediating cost sensitivity and behavioral thrift. In the context of obesity, these data suggest that reduced D2R is more likely to diminish effort and behavioral energy expenditure rather than increase appetitive motivation and consumption, possibly contributing to reduced physical activity commonly observed in obesity.

A cAMP pathway underlying reward prediction in associative learning.

In associative learning, animals learn to associate external cues or their own actions with appetitive or aversive outcomes. Although the dopamine (DA) system and the striatum/nucleus accumbens have been implicated in both the pavlovian and instrumental form of associative learning, whether specific neuronal signaling mechanisms underlie one form or the other is unknown. Here, we report that the striatum-enriched isoform of adenylyl cyclase (AC), AC5, is selectively required for appetitive pavlovian learning. Mice with genetic deletion of AC5 (AC5KO) acquired instrumental responding yet were unable to use cues that predicted reward delivery. The specificity of this deficit was confirmed by an inability of AC5KO mice to learn a simple appetitive pavlovian conditioning task. Conversely, AC5KO mice showed intact aversive pavlovian learning, suggesting the deficit was specific for learning about appetitive outcomes. Our results suggest that AC5 is a critical component of DA-dependent strengthening of stimulus-reward contingencies.

Synchronicity: The Role of Midbrain Dopamine in Whole-Brain Coordination.

Midbrain dopamine seems to play an outsized role in motivated behavior and learning. Widely associated with mediating reward-related behavior, decision making, and learning, dopamine continues to generate controversies in the field. While many studies and theories focus on what dopamine cells encode, the question of how the midbrain derives the information it encodes is poorly understood and comparatively less addressed. Recent anatomical studies suggest greater diversity and complexity of afferent inputs than previously appreciated, requiring rethinking of prior models. Here, we elaborate a hypothesis that construes midbrain dopamine as implementing a Bayesian selector in which individual dopamine cells sample afferent activity across distributed brain substrates, comprising evidence to be evaluated on the extent to which stimuli in the on-going sensorimotor stream organizes distributed, parallel processing, reflecting implicit value. To effectively generate a temporally resolved phasic signal, a population of dopamine cells must exhibit synchronous activity. We argue that synchronous activity across a population of dopamine cells signals consensus across distributed afferent substrates, invigorating responding to recognized opportunities and facilitating further learning. In framing our hypothesis, we shift from the question of how value is computed to the broader question of how the brain achieves coordination across distributed, parallel processing. We posit the midbrain is part of an "axis of agency" in which the prefrontal cortex (PFC), basal ganglia (BGS), and midbrain form an axis mediating control, coordination, and consensus, respectively.