Functional diversity of dopamine axons in prefrontal cortex during classical conditioning.

Midbrain dopamine neurons impact neural processing in the prefrontal cortex (PFC) through mesocortical projections. However, the signals conveyed by dopamine projections to the PFC remain unclear, particularly at the single-axon level. Here, we investigated dopaminergic axonal activity in the medial PFC (mPFC) during reward and aversive processing. By optimizing microprism-mediated two-photon calcium imaging of dopamine axon terminals, we found diverse activity in dopamine axons responsive to both reward and aversive stimuli. Some axons exhibited a preference for reward, while others favored aversive stimuli, and there was a strong bias for the latter at the population level. Long-term longitudinal imaging revealed that the preference was maintained in reward- and aversive-preferring axons throughout classical conditioning in which rewarding and aversive stimuli were paired with preceding auditory cues. However, as mice learned to discriminate reward or aversive cues, a cue activity preference gradually developed only in aversive-preferring axons. We inferred the trial-by-trial cue discrimination based on machine learning using anticipatory licking or facial expressions, and found that successful discrimination was accompanied by sharper selectivity for the aversive cue in aversive-preferring axons. Our findings indicate that a group of mesocortical dopamine axons encodes aversive-related signals, which are modulated by both classical conditioning across days and trial-by-trial discrimination within a day.

A dopamine mechanism for reward maximization.

Individual survival and evolutionary selection require biological organisms to maximize reward. Economic choice theories define the necessary and sufficient conditions, and neuronal signals of decision variables provide mechanistic explanations. Reinforcement learning (RL) formalisms use predictions, actions, and policies to maximize reward. Midbrain dopamine neurons code reward prediction errors (RPE) of subjective reward value suitable for RL. Electrical and optogenetic self-stimulation experiments demonstrate that monkeys and rodents repeat behaviors that result in dopamine excitation. Dopamine excitations reflect positive RPEs that increase reward predictions via RL; against increasing predictions, obtaining similar dopamine RPE signals again requires better rewards than before. The positive RPEs drive predictions higher again and thus advance a recursive reward-RPE-prediction iteration toward better and better rewards. Agents also avoid dopamine inhibitions that lower reward prediction via RL, which allows smaller rewards than before to elicit positive dopamine RPE signals and resume the iteration toward better rewards. In this way, dopamine RPE signals serve a causal mechanism that attracts agents via RL to the best rewards. The mechanism improves daily life and benefits evolutionary selection but may also induce restlessness and greed.

Convergence of oxytocin and dopamine signalling in neuronal circuits: Insights into the neurobiology of social interactions across species.

Social behaviour is essential for animal survival, and the hypothalamic neuropeptide oxytocin (OXT) critically impacts bonding, parenting, and decision-making. Dopamine (DA), is released by ventral tegmental area (VTA) dopaminergic neurons, regulating social cues in the mesolimbic system. Despite extensive exploration of OXT and DA roles in social behaviour independently, limited studies investigate their interplay. This narrative review integrates insights from human and animal studies, particularly rodents, emphasising recent research on pharmacological manipulations of OXT or DA systems in social behaviour. Additionally, we review studies correlating social behaviour with blood/cerebral OXT and DA levels. Behavioural facets include sociability, cooperation, pair bonding and parental care. In addition, we provide insights into OXT-DA interplay in animal models of social stress, autism, and schizophrenia. Emphasis is placed on the complex relationship between the OXT and DA systems and their collective influence on social behaviour across physiological and pathological conditions. Understanding OXT and DA imbalance is fundamental for unravelling the neurobiological underpinnings of social interaction and reward processing deficits observed in psychiatric conditions.

Dopamine encoding of novelty facilitates efficient uncertainty-driven exploration.

When facing an unfamiliar environment, animals need to explore to gain new knowledge about which actions provide reward, but also put the newly acquired knowledge to use as quickly as possible. Optimal reinforcement learning strategies should therefore assess the uncertainties of these action-reward associations and utilise them to inform decision making. We propose a novel model whereby direct and indirect striatal pathways act together to estimate both the mean and variance of reward distributions, and mesolimbic dopaminergic neurons provide transient novelty signals, facilitating effective uncertainty-driven exploration. We utilised electrophysiological recording data to verify our model of the basal ganglia, and we fitted exploration strategies derived from the neural model to data from behavioural experiments. We also compared the performance of directed exploration strategies inspired by our basal ganglia model with other exploration algorithms including classic variants of upper confidence bound (UCB) strategy in simulation. The exploration strategies inspired by the basal ganglia model can achieve overall superior performance in simulation, and we found qualitatively similar results in fitting model to behavioural data compared with the fitting of more idealised normative models with less implementation level detail. Overall, our results suggest that transient dopamine levels in the basal ganglia that encode novelty could contribute to an uncertainty representation which efficiently drives exploration in reinforcement learning.

Distributional coding of associative learning in discrete populations of midbrain dopamine neurons.

Midbrain dopamine neurons are thought to play key roles in learning by conveying the difference between expected and actual outcomes. Recent evidence suggests diversity in dopamine signaling, yet it remains poorly understood how heterogeneous signals might be organized to facilitate the role of downstream circuits mediating distinct aspects of behavior. Here, we investigated the organizational logic of dopaminergic signaling by recording and labeling individual midbrain dopamine neurons during associative behavior. Our findings show that reward information and behavioral parameters are not only heterogeneously encoded but also differentially distributed across populations of dopamine neurons. Retrograde tracing and fiber photometry suggest that populations of dopamine neurons projecting to different striatal regions convey distinct signals. These data, supported by computational modeling, indicate that such distributional coding can maximize dynamic range and tailor dopamine signals to facilitate specialized roles of different striatal regions.

The dynamic state of a prefrontal-hypothalamic-midbrain circuit commands behavioral transitions.

Innate behaviors meet multiple needs adaptively and in a serial order, suggesting the existence of a hitherto elusive brain dynamics that brings together representations of upcoming behaviors during their selection. Here we show that during behavioral transitions, possible upcoming behaviors are encoded by specific signatures of neuronal populations in the lateral hypothalamus (LH) that are active near beta oscillation peaks. Optogenetic recruitment of intrahypothalamic inhibition at this phase eliminates behavioral transitions. We show that transitions are elicited by beta-rhythmic inputs from the prefrontal cortex that spontaneously synchronize with LH 'transition cells' encoding multiple behaviors. Downstream of the LH, dopamine neurons increase firing during beta oscillations and also encode behavioral transitions. Thus, a hypothalamic transition state signals alternative future behaviors, encodes the one most likely to be selected and enables rapid coordination with cognitive and reward-processing circuitries, commanding adaptive social contact and eating behaviors.

Ultrasound Stimulation Attenuates CRS-Induced Depressive Behavior by Modulating Dopamine Release in the Prefrontal Cortex.

Depression is one of the most serious mental disorders affecting modern human life and is often caused by chronic stress. Dopamine system dysfunction is proposed to contribute to the pathophysiology of chronic stress, especially the ventral tegmental area (VTA) which mainly consists of dopaminergic neurons. Focused ultrasound stimulation (FUS) is a promising neuromodulation modality and multiple studies have demonstrated effective ultrasonic activation of cortical, subcortical, and related networks. However, the effects of FUS on the dopamine system and the potential link to chronic stress-induced depressive behaviors are relatively unknown. Here, we measured the effects of FUS targeting VTA on the improvement of depression-like behavior and evaluated the dopamine concentration in the downstream region - medial prefrontal cortex (mPFC). We found that targeting VTA FUS treatment alleviated chronic restraint stress (CRS) -induced anhedonia and despair behavior. Using an in vivo photometry approach, we analyzed the dopamine signal of mPFC and revealed a significant increase following the FUS, positively associated with the improvement of anhedonia behavior. FUS also protected the dopaminergic neurons in VTA from the damage caused by CRS exposure. Thus, these results demonstrated that targeting VTA FUS treatment significantly rescued the depressive-like behavior and declined dopamine level of mPFC induced by CRS. These beneficial effects of FUS might be due to protection in the DA neuron of VTA. Our findings suggest that FUS treatment could serve as a new therapeutic strategy for the treatment of stress-related disorders.

Association between RMTg Neuropeptide Genes and Negative Effect during Alcohol Withdrawal in Mice.

Alcohol use disorders (AUDs) frequently co-occur with negative mood disorders, such as anxiety and depression, exacerbating relapse through dopaminergic dysfunction. Stress-related neuropeptides play a crucial role in AUD pathophysiology by modulating dopamine (DA) function. The rostromedial tegmental nucleus (RMTg), which inhibits midbrain dopamine neurons and signals aversion, has been shown to increase ethanol consumption and negative emotional states during abstinence. Despite some stress-related neuropeptides acting through the RMTg to affect addiction behaviors, their specific roles in alcohol-induced contexts remain underexplored. This study utilized an intermittent voluntary drinking model in mice to induce negative effect behavior 24 h into ethanol (EtOH) abstinence (post-EtOH). It examined changes in pro-stress (Pnoc, Oxt, Npy) and anti-stress (Crf, Pomc, Avp, Orx, Pdyn) neuropeptide-coding genes and analyzed their correlations with aversive behaviors. We observed that adult male C57BL/6J mice displayed evident anxiety, anhedonia, and depression-like symptoms at 24 h post-EtOH. The laser-capture microdissection technique, coupled with or without retrograde tracing, was used to harvest total ventral tegmental area (VTA)-projecting neurons or the intact RMTg area. The findings revealed that post-EtOH consistently reduced Pnoc and Orx levels while elevating Crf levels in these neuronal populations. Notably, RMTg Pnoc and Npy levels counteracted ethanol consumption and depression severity, while Crf levels were indicative of the mice's anxiety levels. Together, these results underscore the potential role of stress-related neuropeptides in the RMTg in regulating the negative emotions related to AUDs, offering novel insights for future research.

Dopamine neuron activity encodes the length of upcoming contralateral movement sequences.

Dopaminergic neurons (DANs) in the substantia nigra pars compacta (SNc) have been related to movement speed, and loss of these neurons leads to bradykinesia in Parkinson's disease (PD). However, other aspects of movement vigor are also affected in PD; for example, movement sequences are typically shorter. However, the relationship between the activity of DANs and the length of movement sequences is unknown. We imaged activity of SNc DANs in mice trained in a freely moving operant task, which relies on individual forelimb sequences. We uncovered a similar proportion of SNc DANs increasing their activity before either ipsilateral or contralateral sequences. However, the magnitude of this activity was higher for contralateral actions and was related to contralateral but not ipsilateral sequence length. In contrast, the activity of reward-modulated DANs, largely distinct from those modulated by movement, was not lateralized. Finally, unilateral dopamine depletion impaired contralateral, but not ipsilateral, sequence length. These results indicate that movement-initiation DANs encode more than a general motivation signal and invigorate aspects of contralateral movements.

Heterogeneity of mesencephalic dopaminergic neurons: From molecular classifications, electrophysiological properties to functional connectivity.

The mesencephalic dopamine (DA) system is composed of neuronal subtypes that are molecularly and functionally distinct, are responsible for specific behaviors, and are closely associated with numerous brain disorders. Existing research has made significant advances in identifying the heterogeneity of mesencephalic DA neurons, which is necessary for understanding their diverse physiological functions and disease susceptibility. Moreover, there is a conflict regarding the electrophysiological properties of the distinct subsets of midbrain DA neurons. This review aimed to elucidate recent developments in the heterogeneity of midbrain DA neurons, including subpopulation categorization, electrophysiological characteristics, and functional connectivity to provide new strategies for accurately identifying distinct subtypes of midbrain DA neurons and investigating the underlying mechanisms of these neurons in various diseases.

Local regulation of striatal dopamine: A diversity of circuit mechanisms for a diversity of behavioral functions?

Striatal dopamine governs a wide range of behavioral functions, yet local dopamine concentrations can be dissociated from somatic activity. Here, we discuss how dopamine's diverse roles in behavior may be driven by local circuit mechanisms shaping dopamine release. We first look at historical and recent work demonstrating that striatal circuits interact with dopaminergic terminals to either initiate the release of dopamine or modulate the release of dopamine initiated by spiking in midbrain dopamine neurons, with particular attention to GABAergic and cholinergic local circuit mechanisms. Then we discuss some of the first in vivo studies of acetylcholine-dopamine interactions in striatum and broadly discuss necessary future work in understanding the roles of midbrain versus striatal dopamine regulation.

State and rate-of-change encoding in parallel mesoaccumbal dopamine pathways.

The nervous system uses fast- and slow-adapting sensory detectors in parallel to enable neuronal representations of external states and their temporal dynamics. It is unknown whether this dichotomy also applies to internal representations that have no direct correlation in the physical world. Here we find that two distinct dopamine (DA) neuron subtypes encode either a state or its rate-of-change. In mice performing a reward-seeking task, we found that the animal's behavioral state and rate-of-change were encoded by the sustained activity of DA neurons in medial ventral tegmental area (VTA) DA neurons and transient activity in lateral VTA DA neurons, respectively. The neural activity patterns of VTA DA cell bodies matched DA release patterns within anatomically defined mesoaccumbal pathways. Based on these results, we propose a model in which the DA system uses two parallel lines for proportional-differential encoding of a state variable and its temporal dynamics.

PI4KIIIß-Mediated Phosphoinositides Metabolism Regulates Function of the VTA Dopaminergic Neurons and Depression-Like Behavior.

Phosphoinositides, including phosphatidylinositol-4,5-bisphosphate (PIP2), play a crucial role in controlling key cellular functions such as membrane and vesicle trafficking, ion channel, and transporter activity. Phosphatidylinositol 4-kinases (PI4K) are essential enzymes in regulating the turnover of phosphoinositides. However, the functional role of PI4Ks and mediated phosphoinositide metabolism in the central nervous system has not been fully revealed. In this study, we demonstrated that PI4KIIIß, one of the four members of PI4Ks, is an important regulator of VTA dopaminergic neuronal activity and related depression-like behavior of mice by controlling phosphoinositide turnover. Our findings provide new insights into possible mechanisms and potential drug targets for neuropsychiatric diseases, including depression. Both sexes were studied in basic behavior tests, but only male mice could be used in the social defeat depression model.

Glutamate inputs send prediction error of reward, but not negative value of aversive stimuli, to dopamine neurons.

Midbrain dopamine neurons are thought to signal reward prediction errors (RPEs), but the mechanisms underlying RPE computation, particularly the contributions of different neurotransmitters, remain poorly understood. Here, we used a genetically encoded glutamate sensor to examine the pattern of glutamate inputs to dopamine neurons in mice. We found that glutamate inputs exhibit virtually all of the characteristics of RPE rather than conveying a specific component of RPE computation, such as reward or expectation. Notably, whereas glutamate inputs were transiently inhibited by reward omission, they were excited by aversive stimuli. Opioid analgesics altered dopamine negative responses to aversive stimuli into more positive responses, whereas excitatory responses of glutamate inputs remained unchanged. Our findings uncover previously unknown synaptic mechanisms underlying RPE computations; dopamine responses are shaped by both synergistic and competitive interactions between glutamatergic and GABAergic inputs to dopamine neurons depending on valences, with competitive interactions playing a role in responses to aversive stimuli.

An ACC-VTA-ACC positive-feedback loop mediates the persistence of neuropathic pain and emotional consequences.

The central mechanisms underlying pain chronicity remain elusive. Here, we identify a reciprocal neuronal circuit in mice between the anterior cingulate cortex (ACC) and the ventral tegmental area (VTA) that mediates mutual exacerbation between hyperalgesia and allodynia and their emotional consequences and, thereby, the chronicity of neuropathic pain. ACC glutamatergic neurons (ACCGlu) projecting to the VTA indirectly inhibit dopaminergic neurons (VTADA) by activating local GABAergic interneurons (VTAGABA), and this effect is reinforced after nerve injury. VTADA neurons in turn project to the ACC and synapse to the initial ACCGlu neurons to convey feedback information from emotional changes. Thus, an ACCGlu-VTAGABA-VTADA-ACCGlu positive-feedback loop mediates the progression to and maintenance of persistent pain and comorbid anxiodepressive-like behavior. Disruption of this feedback loop relieves hyperalgesia and anxiodepressive-like behavior in a mouse model of neuropathic pain, both acutely and in the long term.

Sensory Cues Potentiate VTA Dopamine Mediated Reinforcement.

Sensory cues are critical for shaping decisions and invigorating actions during reward seeking. Dopamine neurons in the ventral tegmental area (VTA) are central in this process, supporting associative learning in Pavlovian and instrumental settings. Studies of intracranial self-stimulation (ICSS) behavior, which show that animals will work hard to receive stimulation of dopamine neurons, support the notion that dopamine transmits a reward or value signal to support learning. Recent studies have begun to question this, however, emphasizing dopamine's value-free functions, leaving its contribution to behavioral reinforcement somewhat muddled. Here, we investigated the role of sensory stimuli in dopamine-mediated reinforcement, using an optogenetic ICSS paradigm in tyrosine hydroxylase (TH)-Cre rats. We find that while VTA dopamine neuron activation in the absence of explicit external cues is sufficient to maintain robust self-stimulation, the presence of cues dramatically potentiates ICSS behavior. Our results support a framework where dopamine can have some base value as a reinforcer, but the impact of this signal is modulated heavily by the sensory learning context.

Dopamine regulates attitude toward risk.

Specific brain pathways can lower or raise the willingness of monkeys to take risks.

Combining physical & cognitive training with iPSC-derived dopaminergic neuron transplantation promotes graft integration & better functional outcome in parkinsonian marmosets.

Parkinson's disease (PD) is a relentlessly progressive and currently incurable neurodegenerative disease with significant unmet medical needs. Since PD stems from the degeneration of midbrain dopaminergic (DA) neurons in a defined brain location, PD patients are considered optimal candidates for cell replacement therapy. Clinical trials for cell transplantation in PD are beginning to re-emerge worldwide with a new focus on induced pluripotent stem cells (iPSCs) as a source of DA neurons since they can be derived from adult somatic cells and produced in large quantities under current good manufacturing practices. However, for this therapeutic strategy to be realized as a viable clinical option, fundamental translational challenges need to be addressed including the manufacturing process, purity and efficacy of the cells, the method of delivery, the extent of host reinnervation and the impact of patient-centered adjunctive interventions. In this study we report on the impact of physical and cognitive training (PCT) on functional recovery in the nonhuman primate (NHP) model of PD after cell transplantation. We observed that at 6 months post-transplant, the PCT group returned to normal baseline in their daily activity measured by actigraphy, significantly improved in their sensorimotor and cognitive tasks, and showed enhanced synapse formation between grafted cells and host cells. We also describe a robust, simple, efficient, scalable, and cost-effective manufacturing process of engraftable DA neurons derived from iPSCs. This study suggests that integrating PCT with cell transplantation therapy could promote optimal graft functional integration and better outcome for patients with PD.

Progress in direct reprogramming of dopaminergic cell replacement therapy.

Parkinson's disease (PD) is a gradual neurodegenerative disease. While drug therapy and surgical treatments have been the primary means of addressing PD, they do not offer a cure, and the risks associated with surgical treatment are high. Recent advances in cell reprogramming have given rise to new prospects for the treatment of Parkinson's disease (PD), with induced pluripotent stem cells (iPSCs), induced dopamine neurons (iDNs), and induced neural stem cells (iNSCs) being created. These cells can potentially be used in the treatment of Parkinson's disease. On the other hand, this article emphasizes the limits of iPSCs and iNSCs in the context of Parkinson's disease treatment, as well as approaches for direct reprogramming of somatic cells into iDNs. The paper will examine the benefits and drawbacks of directly converting somatic cells into iDNs.

Does phasic dopamine release cause policy updates?

Phasic dopamine activity is believed to both encode reward-prediction errors (RPEs) and to cause the adaptations that these errors engender. If so, a rat working for optogenetic stimulation of dopamine neurons will repeatedly update its policy and/or action values, thus iteratively increasing its work rate. Here, we challenge this view by demonstrating stable, non-maximal work rates in the face of repeated optogenetic stimulation of midbrain dopamine neurons. Furthermore, we show that rats learn to discriminate between world states distinguished only by their history of dopamine activation. Comparison of these results to reinforcement learning simulations suggests that the induced dopamine transients acted more as rewards than RPEs. However, pursuit of dopaminergic stimulation drifted upwards over a time scale of days and weeks, despite its stability within trials. To reconcile the results with prior findings, we consider multiple roles for dopamine signalling.