Hypothalamic-Extended Amygdala Circuit Regulates Temporal Discounting.

Choice behavior is characterized by temporal discounting, i.e., preference for immediate rewards given a choice between immediate and delayed rewards. Agouti-related peptide (AgRP)-expressing neurons located in the arcuate nucleus of the hypothalamus (ARC) regulate food intake and energy homeostasis, yet whether AgRP neurons influence choice behavior and temporal discounting is unknown. Here, we demonstrate that motivational state potently modulates temporal discounting. Hungry mice (both male and female) strongly preferred immediate food rewards, yet sated mice were largely indifferent to reward delay. More importantly, selective optogenetic activation of AgRP-expressing neurons or their axon terminals within the posterior bed nucleus of stria terminalis (BNST) produced temporal discounting in sated mice. Furthermore, activation of neuropeptide Y (NPY) type 1 receptors (Y1Rs) within the BNST is sufficient to produce temporal discounting. These results demonstrate a profound influence of hypothalamic signaling on temporal discounting for food rewards and reveal a novel circuit that determine choice behavior.SIGNIFICANCE STATEMENT Temporal discounting is a universal phenomenon found in many species, yet the underlying neurocircuit mechanisms are still poorly understood. Our results revealed a novel neural pathway from agouti-related peptide (AgRP) neurons in the hypothalamus to the bed nucleus of stria terminalis (BNST) that regulates temporal discounting in decision-making.

A one-photon endoscope for simultaneous patterned optogenetic stimulation and calcium imaging in freely behaving mice.

Optogenetics and calcium imaging can be combined to simultaneously stimulate and record neural activity in vivo. However, this usually requires two-photon microscopes, which are not portable nor affordable. Here we report the design and implementation of a miniaturized one-photon endoscope for performing simultaneous optogenetic stimulation and calcium imaging. By integrating digital micromirrors, the endoscope makes it possible to activate any neuron of choice within the field of view, and to apply arbitrary spatiotemporal patterns of photostimulation while imaging calcium activity. We used the endoscope to image striatal neurons from either the direct pathway or the indirect pathway in freely moving mice while activating any chosen neuron in the field of view. The endoscope also allows for the selection of neurons based on their relationship with specific animal behaviour, and to recreate the behaviour by mimicking the natural neural activity with photostimulation. The miniaturized endoscope may facilitate the study of how neural activity gives rise to behaviour in freely moving animals.

The role of the parafascicular thalamic nucleus in action initiation and steering.

The parafascicular (Pf) nucleus of the thalamus has been implicated in arousal and attention, but its contributions to behavior remain poorly characterized. Here, using in vivo and in vitro electrophysiology, optogenetics, and 3D motion capture, we studied the role of the Pf nucleus in behavior using a continuous reward-tracking task in freely moving mice. We found that many Pf neurons precisely represent vector components of velocity, with a strong preference for ipsiversive movements. Their activity usually leads velocity, suggesting that Pf output is critical for self-initiated orienting behavior. To test this hypothesis, we expressed excitatory or inhibitory opsins in VGlut2+ Pf neurons to manipulate neural activity bidirectionally. We found that selective optogenetic stimulation of these neurons consistently produced ipsiversive head turning, whereas inhibition stopped turning and produced downward movements. Taken together, our results suggest that the Pf nucleus can send continuous top-down commands that specify detailed action parameters (e.g., direction and speed of the head), thus providing guidance for orienting and steering during behavior.

Force tuning explains changes in phasic dopamine signaling during stimulus-reward learning.

According to a popular hypothesis, phasic dopamine (DA) activity encodes a reward prediction error (RPE) necessary for reinforcement learning. However, recent work showed that DA neurons are necessary for performance rather than learning. One limitation of previous work on phasic DA signaling and RPE is the limited behavioral measures. Here, we measured subtle force exertion while recording and manipulating DA activity in the ventral tegmental area (VTA) during stimulus-reward learning. We found two major populations of DA neurons that increased firing before forward and backward force exertion. Force tuning is the same regardless of learning, reward predictability, or outcome valence. Changes in the pattern of force exertion can explain results traditionally used to support the RPE hypothesis, such as modulation by reward magnitude, probability, and unpredicted reward delivery or omission. Thus VTA DA neurons are not used to signal RPE but to regulate force exertion during motivated behavior.

Elucidating a locus coeruleus-dentate gyrus dopamine pathway for operant reinforcement.

Animals can learn to repeat behaviors to earn desired rewards, a process commonly known as reinforcement learning. While previous work has implicated the ascending dopaminergic projections to the basal ganglia in reinforcement learning, little is known about the role of the hippocampus. Here, we report that a specific population of hippocampal neurons and their dopaminergic innervation contribute to operant self-stimulation. These neurons are located in the dentate gyrus, receive dopaminergic projections from the locus coeruleus, and express D1 dopamine receptors. Activation of D1 + dentate neurons is sufficient for self-stimulation: mice will press a lever to earn optogenetic activation of these neurons. A similar effect is also observed with selective activation of the locus coeruleus projections to the dentate gyrus, and blocked by D1 receptor antagonism. Calcium imaging of D1 + dentate neurons revealed significant activity at the time of action selection, but not during passive reward delivery. These results reveal the role of dopaminergic innervation of the dentate gyrus in supporting operant reinforcement.

Thalamic projections to the subthalamic nucleus contribute to movement initiation and rescue of parkinsonian symptoms.

The parafascicular nucleus (Pf) of the thalamus provides major projections to the basal ganglia, a set of subcortical nuclei involved in action initiation. Here, we show that Pf projections to the subthalamic nucleus (STN), but not to the striatum, are responsible for movement initiation. Because the STN is a major target of deep brain stimulation treatments for Parkinson's disease, we tested the effect of selective stimulation of Pf-STN projections in a mouse model of PD. Bilateral dopamine depletion with 6-OHDA created complete akinesia in mice, but Pf-STN stimulation immediately and markedly restored a variety of natural behaviors. Our results therefore revealed a functionally novel neural pathway for the initiation of movements that can be recruited to rescue movement deficits after dopamine depletion. They not only shed light on the clinical efficacy of conventional STN DBS but also suggest more selective and improved stimulation strategies for the treatment of parkinsonian symptoms.

Protocol for Recording from Ventral Tegmental Area Dopamine Neurons in Mice while Measuring Force during Head-Fixation.

Many studies in systems neuroscience use head-fixation preparations for in vivo experimentation. While head-fixation confers several advantages, one major limitation is the lack of behavioral measures that quantify whole-body movements. Here, we detail a step-by-step protocol for using a novel head-fixation device that measures the forces exerted by head-fixed mice in multiple dimensions. We further detail how this system can be used in conjunction with in vivo electrophysiology and optogenetics to study dopamine neurons in the ventral tegmental area. For complete details on the use and execution of this protocol, please refer to Hughes et al. (2020a, 2020b).

A Head-Fixation System for Continuous Monitoring of Force Generated During Behavior.

Many studies in neuroscience use head-fixed behavioral preparations, which confer a number of advantages, including the ability to limit the behavioral repertoire and use techniques for large-scale monitoring of neural activity. But traditional studies using this approach use extremely limited behavioral measures, in part because it is difficult to detect the subtle movements and postural adjustments that animals naturally exhibit during head fixation. Here we report a new head-fixed setup with analog load cells capable of precisely monitoring the continuous forces exerted by mice. The load cells reveal the dynamic nature of movements generated not only around the time of task-relevant events, such as presentation of stimuli and rewards, but also during periods in between these events, when there is no apparent overt behavior. It generates a new and rich set of behavioral measures that have been neglected in previous experiments. We detail the construction of the system, which can be 3D-printed and assembled at low cost, show behavioral results collected from head-fixed mice, and demonstrate that neural activity can be highly correlated with the subtle, whole-body movements continuously produced during head restraint.

Ventral Tegmental Dopamine Neurons Control the Impulse Vector during Motivated Behavior.

The ventral tegmental area (VTA) is a major source of dopamine, especially to the limbic brain regions. Despite decades of research, the function of VTA dopamine neurons remains controversial. Here, using a novel head-fixed behavioral system with five orthogonal force sensors, we show for the first time that the activity of dopamine neurons precisely represents the impulse vector (force exerted over time) generated by the animal. Distinct populations of VTA dopamine neurons contribute to components of the impulse vector in different directions. Optogenetic excitation of these neurons shows a linear relationship between signal injected and impulse generated. Optogenetic inhibition paused force generation or produced force in the backward direction. At the same time, these neurons also regulate the initiation and execution of anticipatory licking. Our results indicate that VTA dopamine controls the magnitude, direction, and duration of force used to move toward or away from any motivationally relevant stimuli.

Precise Coordination of Three-Dimensional Rotational Kinematics by Ventral Tegmental Area GABAergic Neurons.

The ventral tegmental area (VTA) is a midbrain region implicated in a variety of motivated behaviors. However, the function of VTA GABAergic (Vgat+) neurons remains poorly understood. Here, using three-dimensional motion capture, in vivo electrophysiology, calcium imaging, and optogenetics, we demonstrate a novel function of VTAVgat+ neurons. We found three distinct populations of neurons, each representing head angle about a principal axis of rotation: yaw, roll, and pitch. For each axis, opponent cell groups were found that increase firing when the head moves in one direction and decrease firing in the opposite direction. Selective excitation and inhibition of VTAVgat+ neurons generate opposite rotational movements. Thus, VTAVgat+ neurons serve a critical role in the control of rotational kinematics while pursuing a moving target. This general-purpose steering function can guide animals toward desired spatial targets in any motivated behavior.

A striatal interneuron circuit for continuous target pursuit.

Most adaptive behaviors require precise tracking of targets in space. In pursuit behavior with a moving target, mice use distance to target to guide their own movement continuously. Here, we show that in the sensorimotor striatum, parvalbumin-positive fast-spiking interneurons (FSIs) can represent the distance between self and target during pursuit behavior, while striatal projection neurons (SPNs), which receive FSI projections, can represent self-velocity. FSIs are shown to regulate velocity-related SPN activity during pursuit, so that movement velocity is continuously modulated by distance to target. Moreover, bidirectional manipulation of FSI activity can selectively disrupt performance by increasing or decreasing the self-target distance. Our results reveal a key role of the FSI-SPN interneuron circuit in pursuit behavior and elucidate how this circuit implements distance to velocity transformation required for the critical underlying computation.