Cell-type-specific asynchronous modulation of PKA by dopamine in learning.

Reinforcement learning models postulate that neurons that release dopamine encode information about action and action outcome, and provide a teaching signal to striatal spiny projection neurons in the form of dopamine release1. Dopamine is thought to guide learning via dynamic and differential modulation of protein kinase A (PKA) in each class of spiny projection neuron2. However, the real-time relationship between dopamine and PKA in spiny projection neurons remains untested in behaving animals. Here we monitor the activity of dopamine-releasing neurons, extracellular levels of dopamine and net PKA activity in spiny projection neurons in the nucleus accumbens of mice during learning. We find positive and negative modulation of dopamine that evolves across training and is both necessary and sufficient to explain concurrent fluctuations in the PKA activity of spiny projection neurons. Modulations of PKA in spiny projection neurons that express type-1 and type-2 dopamine receptors are dichotomous, such that these neurons are selectively sensitive to increases and decreases, respectively, in dopamine that occur at different phases of learning. Thus, PKA-dependent pathways in each class of spiny projection neuron are asynchronously engaged by positive or negative dopamine signals during learning.

Cue and Reward Evoked Dopamine Activity Is Necessary for Maintaining Learned Pavlovian Associations.

Associating natural rewards with predictive environmental cues is crucial for survival. Dopamine (DA) neurons of the ventral tegmental area (VTA) are thought to play a crucial role in this process by encoding reward prediction errors (RPEs) that have been hypothesized to play a role in associative learning. However, it is unclear whether this signal is still necessary after animals have acquired a cue-reward association. In order to investigate this, we trained mice to learn a Pavlovian cue-reward association. After learning, mice show robust anticipatory and consummatory licking behavior. As expected, calcium activity of VTA DA neurons goes up for cue presentation as well as reward delivery. Optogenetic inhibition during the moment of reward delivery disrupts learned behavior, even in the continued presence of reward. This effect is more pronounced over trials and persists on the next training day. Moreover, outside of the task licking behavior and locomotion are unaffected. Similarly to inhibitions during the reward period, we find that inhibiting cue-induced dopamine (DA) signals robustly decreases learned licking behavior, indicating that cue-related DA signals are a potent driver for learned behavior. Overall, we show that inhibition of either of these DA signals directly impairs the expression of learned associative behavior. Thus, continued DA signaling in a learned state is necessary for consolidating Pavlovian associations.SIGNIFICANCE STATEMENT Dopamine (DA) neurons of the ventral tegmental area (VTA) have long been suggested to be necessary for animals to associate environmental cues with rewards that they predict. Here, we use time-locked optogenetic inhibition of these neurons to show that the activity of these neurons is directly necessary for performance on a Pavlovian conditioning task, without affecting locomotor per se These findings provide further support for the direct importance of second-by-second DA neuron activity in associative learning.

Real-Time, In Vivo Measurement of Protein Kinase A Activity in Deep Brain Structures Using Fluorescence Lifetime Photometry (FLiP).

The biochemical state of neurons, and of cells in general, is regulated by extracellular factors, including neurotransmitters, neuromodulators, and growth hormones. Interactions of an animal with its environment trigger neuromodulator release and engage biochemical transduction cascades to modulate synapse and cell function. Although these processes are thought to enact behavioral adaption to changing environments, when and where in the brain they are induced has been mysterious because of the challenge of monitoring biochemical state in real time in defined neurons in behaving animals. Here, we describe a method allowing measurement of activity of protein kinase A (PKA), an important intracellular effector for neuromodulators, in freely moving mice. To monitor PKA activity in vivo, we use a genetically targeted sensor (FLIM-AKAR) and fluorescence lifetime photometry (FLiP). This article describes how to set up a FLiP system and obtain robust recordings of net PKA phosphorylation state in vivo. The methods should be generally useful to monitor other pathways for which fluorescence lifetime reporters exist. © 2021 Wiley Periodicals LLC. Basic Protocol 1: Building a FLiP system Basic Protocol 2: FLIM-AKAR viral injection and fiber implantation for FLiP measurement Basic Protocol 3: Performing measurements using FLiP.

Identification of Novel Neurocircuitry Through Which Leptin Targets Multiple Inputs to the Dopamine System to Reduce Food Reward Seeking.

BACKGROUND: Leptin reduces the motivation to obtain food by modulating activity of the mesolimbic dopamine (DA) system upon presentation of cues that predict a food reward. Although leptin directly reduces the activity of ventral tegmental area (VTA) DA neurons, the majority of leptin receptor (LepR)-expressing DA neurons do not project to the nucleus accumbens, the projection implicated in driving food reward seeking. Therefore, the precise locus of leptin action to modulate motivation for a food reward is unresolved. METHODS: We used transgenic mice expressing Cre recombinase under the control of the LepR promoter, anatomical tracing, optogenetics-assisted patch-clamp electrophysiology, in vivo optogenetics with fiber photometric calcium measurements, and chemogenetics to unravel how leptin-targeted neurocircuitry inhibits food reward seeking. RESULTS: A large number of DA neurons projecting to the nucleus accumbens are innervated by local VTA LepR-expressing GABA (gamma-aminobutyric acid) neurons. Leptin enhances the activity of these GABA neurons and thereby inhibits nucleus accumbens-projecting DA neurons. In addition, we find that lateral hypothalamic LepR-expressing neurons projecting to the VTA are inhibited by leptin and that these neurons modulate DA neurons indirectly via inhibition of VTA GABA neurons. In accordance with such a disinhibitory function, optogenetically stimulating lateral hypothalamic LepR projections to the VTA potently activates DA neurons in vivo. Moreover, we found that chemogenetic activation of lateral hypothalamic LepR neurons increases the motivation to obtain a food reward only when mice are in a positive energy balance. CONCLUSIONS: We identify neurocircuitry through which leptin targets multiple inputs to the DA system to reduce food reward seeking.

Monitoring Behaviorally Induced Biochemical Changes Using Fluorescence Lifetime Photometry.

All cells respond to extracellular signals by altering their intracellular biochemical state. In neurons, such signaling regulates many aspects of cell and synapse biology and induces changes that are thought to be important for nervous system development, its adaptation in the face of a changing environment, and ongoing homeostatic maintenance. Although great advances have been made in developing novel fluorescent reporters of intracellular signaling as well as in methods of fluorescence detection for use in freely moving animals, these approaches have generally not been combined. Thus, we know relatively little about how the intracellular biochemical state of neurons, and other cell classes, is dynamically regulated during animals' behavior. Here we describe a single multi-mode fiber based fluorescence lifetime photometry system (FLiP) designed to monitor the state of fluorescence reporters of biochemical state in freely moving animals. We demonstrate the utility of FLiP by monitoring the lifetime of FLIM-AKAR, a genetically encoded fluorescent reporter of PKA phosphorylation, in populations of direct and indirect pathway striatal projection neurons in mice receiving food rewards. We find that the activity of PKA in each pathway is transiently regulated by reward acquisition, with PKA phosphorylation being enhanced and repressed in direct and indirect pathway neurons, respectively. This study demonstrates the power of FLiP to detect changes in biochemical state induced by naturalistic experiences in behaving animals.