Dopaminergic error signals retune to social feedback during courtship.

Hunger, thirst, loneliness and ambition determine the reward value of food, water, social interaction and performance outcome1. Dopamine neurons respond to rewards meeting these diverse needs2-8, but it remains unclear how behaviour and dopamine signals change as priorities change with new opportunities in the environment. One possibility is that dopamine signals for distinct drives are routed to distinct dopamine pathways9,10. Another possibility is that dopamine signals in a given pathway are dynamically tuned to rewards set by the current priority. Here we used electrophysiology and fibre photometry to test how dopamine signals associated with quenching thirst, singing a good song and courting a mate change as male zebra finches (Taeniopygia guttata) were provided with opportunities to retrieve water, evaluate song performance or court a female. When alone, water reward signals were observed in two mesostriatal pathways but singing-related performance error signals were routed to Area X, a striatal nucleus specialized for singing. When courting a female, water seeking was reduced and dopamine responses to both water and song performance outcomes diminished. Instead, dopamine signals in Area X were driven by female calls timed with the courtship song. Thus the dopamine system handled coexisting drives by routing vocal performance and social feedback signals to a striatal area for communication and by flexibly re-tuning to rewards set by the prioritized drive.

Cortex-dependent corrections as the tongue reaches for and misses targets.

Precise tongue control is necessary for drinking, eating and vocalizing1-3. However, because tongue movements are fast and difficult to resolve, neural control of lingual kinematics remains poorly understood. Here we combine kilohertz-frame-rate imaging and a deep-learning-based neural network to resolve 3D tongue kinematics in mice drinking from a water spout. Successful licks required corrective submovements that-similar to online corrections during primate reaches4-11-occurred after the tongue missed unseen, distant or displaced targets. Photoinhibition of anterolateral motor cortex impaired corrections, which resulted in hypometric licks that missed the spout. Neural activity in anterolateral motor cortex reflected upcoming, ongoing and past corrective submovements, as well as errors in predicted spout contact. Although less than a tenth of a second in duration, a single mouse lick exhibits the hallmarks of online motor control associated with a primate reach, including cortex-dependent corrections after misses.

Songbird subthalamic neurons project to dopaminergic midbrain and exhibit singing-related activity.

Skill learning requires motor output to be evaluated against internal performance benchmarks. In songbirds, ventral tegmental area (VTA) dopamine neurons (DA) signal performance errors important for learning, but it remains unclear which brain regions project to VTA and how these inputs may contribute to DA error signaling. Here, we find that the songbird subthalamic nucleus (STN) projects to VTA and that STN microstimulation can excite VTA neurons. We also discover that STN receives inputs from motor cortical, auditory cortical, and ventral pallidal brain regions previously implicated in song evaluation. In the first neural recordings from songbird STN, we discover that the activity of most STN neurons is associated with body movements and not singing, but a small fraction of neurons exhibits precise song timing and performance error signals. Our results place the STN in a pathway important for song learning, but not song production, and expand the territories of songbird brain potentially associated with song learning.NEW & NOTEWORTHY Songbird subthalamic (STN) neurons exhibit singing-related signals and are interconnected with the motor cortical nucleus, auditory pallium, ventral pallidum, and ventral tegmental area, areas important for song generation and learning.

Movement signaling in ventral pallidum and dopaminergic midbrain is gated by behavioral state in singing birds.

Movement-related neuronal discharge in ventral tegmental area (VTA) and ventral pallidum (VP) is inconsistently observed across studies. One possibility is that some neurons are movement related and others are not. Another possibility is that the precise behavioral conditions matter-that a single neuron can be movement related under certain behavioral states but not others. We recorded single VTA and VP neurons in birds transitioning between singing and nonsinging states while monitoring body movement with microdrive-mounted accelerometers. Many VP and VTA neurons exhibited body movement-locked activity exclusively when the bird was not singing. During singing, VP and VTA neurons could switch off their tuning to body movement and become instead precisely time-locked to specific song syllables. These changes in neuronal tuning occurred rapidly at state boundaries. Our findings show that movement-related activity in limbic circuits can be gated by behavioral context.NEW & NOTEWORTHY Neural signals in the limbic system have long been known to represent body movements as well as reward. Here, we show that single neurons dramatically change their tuning from movement to song timing when a bird starts to sing.

Fabrication of Injectable Micro-Scale Opto-Electronically Transduced Electrodes (MOTEs) for Physiological Monitoring.

In vivo, chronic neural recording is critical to understand the nervous system, while a tetherless, miniaturized recording unit can render such recording minimally invasive. We present a tetherless, injectable micro-scale opto-electronically transduced electrode (MOTE) that is ~60µm × 30µm × 330µm, the smallest neural recording unit to date. The MOTE consists of an AlGaAs micro-scale light emitting diode (µLED) heterogeneously integrated on top of conventional 180nm complementary metal-oxide-semiconductor (CMOS) circuit. The MOTE combines the merits of optics (AlGaAs µLED for power and data uplink), and of electronics (CMOS for signal amplification and encoding). The optical powering and communication enable the extreme scaling while the electrical circuits provide a high temporal resolution (<100µs). This paper elaborates on the heterogeneous integration in MOTEs, a topic that has been touted without much demonstration on feasibility or scalability. Based on photolithography, we demonstrate how to build heterogenous systems that are scalable as well as biologically stable - the MOTEs can function in saline water for more than six months, and in a mouse brain for two months (and counting). We also present handling/insertion techniques for users (i.e. biologists) to deploy MOTEs with little or no extra training.

Automated home cage training of mice in a hold-still center-out reach task.

An obstacle to understanding neural mechanisms of movement is the complex, distributed nature of the mammalian motor system. Here we present a novel behavioral paradigm for high-throughput dissection of neural circuits underlying mouse forelimb control. Custom touch-sensing joysticks were used to quantify mouse forelimb trajectories with micron-millisecond spatiotemporal resolution. Joysticks were integrated into computer-controlled, rack-mountable home cages, enabling batches of mice to be trained in parallel. Closed loop behavioral analysis enabled online control of reward delivery for automated training. We used this system to show that mice can learn, with no human handling, a direction-specific hold-still center-out reach task in which a mouse first held its right forepaw still before reaching out to learned spatial targets. Stabilogram diffusion analysis of submillimeter-scale micromovements produced during the hold demonstrate that an active control process, akin to upright balance, was implemented to maintain forepaw stability. Trajectory decomposition methods, previously used in primates, were used to segment hundreds of thousands of forelimb trajectories into millions of constituent kinematic primitives. This system enables rapid dissection of neural circuits for controlling motion primitives from which forelimb sequences are built. NEW & NOTEWORTHY A novel joystick design resolves mouse forelimb kinematics with micron-millisecond precision. Home cage training is used to train mice in a hold-still center-out reach task. Analytical methods, previously used in primates, are used to decompose mouse forelimb trajectories into kinematic primitives.

Vocal learning in songbirds requires cholinergic signaling in a motor cortex-like nucleus.

Cholinergic inputs to cortex modulate plasticity and sensory processing, yet little is known about their role in motor control. Here, we show that cholinergic signaling in a songbird vocal motor cortical area, the robust nucleus of the arcopallium (RA), is required for song learning. Reverse microdialysis of nicotinic and muscarinic receptor antagonists into RA in juvenile birds did not significantly affect syllable timing or acoustic structure during vocal babbling. However, chronic blockade over weeks reduced singing quantity and impaired learning, resulting in an impoverished song with excess variability, abnormal acoustic features, and reduced similarity to tutor song. The demonstration that cholinergic signaling in a motor cortical area is required for song learning motivates the songbird as a tractable model system to identify roles of the basal forebrain cholinergic system in motor control. NEW & NOTEWORTHY Cholinergic inputs to cortex are evolutionarily conserved and implicated in sensory processing and synaptic plasticity. However, functions of cholinergic signals in motor areas are understudied and poorly understood. Here, we show that cholinergic signaling in a songbird vocal motor cortical area is not required for normal vocal variability during babbling but is essential for developmental song learning. Cholinergic modulation of motor cortex is thus required for learning but not for the ability to sing.

Origins of basal ganglia output signals in singing juvenile birds.

Across species, complex circuits inside the basal ganglia (BG) converge on pallidal output neurons that exhibit movement-locked firing patterns. Yet the origins of these firing patterns remain poorly understood. In songbirds during vocal babbling, BG output neurons homologous to those found in the primate internal pallidal segment are uniformly activated in the tens of milliseconds prior to syllable onsets. To test the origins of this remarkably homogenous BG output signal, we recorded from diverse upstream BG cell types during babbling. Prior to syllable onsets, at the same time that internal pallidal segment-like neurons were activated, putative medium spiny neurons, fast spiking and tonically active interneurons also exhibited transient rate increases. In contrast, pallidal neurons homologous to those found in primate external pallidal segment exhibited transient rate decreases. To test origins of these signals, we performed recordings following lesion of corticostriatal inputs from premotor nucleus HVC. HVC lesions largely abolished these syllable-locked signals. Altogether, these findings indicate a striking homogeneity of syllable timing signals in the songbird BG during babbling and are consistent with a role for the indirect and hyperdirect pathways in transforming cortical inputs into BG outputs during an exploratory behavior.

Petilla terminology: nomenclature of features of GABAergic interneurons of the cerebral cortex.

Neuroscience produces a vast amount of data from an enormous diversity of neurons. A neuronal classification system is essential to organize such data and the knowledge that is derived from them. Classification depends on the unequivocal identification of the features that distinguish one type of neuron from another. The problems inherent in this are particularly acute when studying cortical interneurons. To tackle this, we convened a representative group of researchers to agree on a set of terms to describe the anatomical, physiological and molecular features of GABAergic interneurons of the cerebral cortex. The resulting terminology might provide a stepping stone towards a future classification of these complex and heterogeneous cells. Consistent adoption will be important for the success of such an initiative, and we also encourage the active involvement of the broader scientific community in the dynamic evolution of this project.

Dopaminergic signals for improved parental behavior.

In this issue of Neuron, Xie et al.1 record and manipulate dopaminergic activity as mice engage in parental care. Dopaminergic prediction error signals previously implicated in food rewards were associated with retrieving isolated pups to the nest, showing that neural mechanisms long associated with reinforcement learning can be repurposed for aspects of parenting.

Songbird mesostriatal dopamine pathways are spatially segregated before the onset of vocal learning.

Diverse dopamine (DA) pathways send distinct reinforcement signals to different striatal regions. In adult songbirds, a DA pathway from the ventral tegmental area (VTA) to Area X, the striatal nucleus of the song system, carries singing-related performance error signals important for learning. Meanwhile, a parallel DA pathway to a medial striatal area (MST) arises from a distinct group of neighboring DA neurons that lack connectivity to song circuits and do not encode song error. To test if the structural and functional segregation of these two pathways depends on singing experience, we carried out anatomical studies early in development before the onset of song learning. We find that distinct VTA neurons project to either Area X or MST in juvenile birds before the onset of substantial vocal practice. Quantitative comparisons of early juveniles (30-35 days post hatch), late juveniles (60-65 dph), and adult (>90 dph) brains revealed an outsized expansion of Area X-projecting neurons relative to MST-projecting neurons in VTA over development. These results show that a mesostriatal DA system dedicated to social communication can exist and be spatially segregated before the onset of vocal practice and associated sensorimotor experience.

Anterior forebrain pathway in parrots is necessary for producing learned vocalizations with individual signatures.

Parrots have enormous vocal imitation capacities and produce individually unique vocal signatures. Like songbirds, parrots have a nucleated neural song system with distinct anterior (AFP) and posterior forebrain pathways (PFP). To test if song systems of parrots and songbirds, which diverged over 50 million years ago, have a similar functional organization, we first established a neuroscience-compatible call-and-response behavioral paradigm to elicit learned contact calls in budgerigars (Melopsittacus undulatus). Using variational autoencoder-based machine learning methods, we show that contact calls within affiliated groups converge but that individuals maintain unique acoustic features, or vocal signatures, even after call convergence. Next, we transiently inactivated the outputs of AFP to test if learned vocalizations can be produced by the PFP alone. As in songbirds, AFP inactivation had an immediate effect on vocalizations, consistent with a premotor role. But in contrast to songbirds, where the isolated PFP is sufficient to produce stereotyped and acoustically normal vocalizations, isolation of the budgerigar PFP caused a degradation of call acoustic structure, stereotypy, and individual uniqueness. Thus, the contribution of AFP and the capacity of isolated PFP to produce learned vocalizations have diverged substantially between songbirds and parrots, likely driven by their distinct behavioral ecology and neural connectivity.

Two distinct modes of forebrain circuit dynamics underlie temporal patterning in the vocalizations of young songbirds.

Accurate timing is a critical aspect of motor control, yet the temporal structure of many mature behaviors emerges during learning from highly variable exploratory actions. How does a developing brain acquire the precise control of timing in behavioral sequences? To investigate the development of timing, we analyzed the songs of young juvenile zebra finches. These highly variable vocalizations, akin to human babbling, gradually develop into temporally stereotyped adult songs. We find that the durations of syllables and silences in juvenile singing are formed by a mixture of two distinct modes of timing: a random mode producing broadly distributed durations early in development, and a stereotyped mode underlying the gradual emergence of stereotyped durations. Using lesions, inactivations, and localized brain cooling, we investigated the roles of neural dynamics within two premotor cortical areas in the production of these temporal modes. We find that LMAN (lateral magnocellular nucleus of the nidopallium) is required specifically for the generation of the random mode of timing and that mild cooling of LMAN causes an increase in the durations produced by this mode. On the contrary, HVC (used as a proper name) is required specifically for producing the stereotyped mode of timing, and its cooling causes a slowing of all stereotyped components. These results show that two neural pathways contribute to the timing of juvenile songs and suggest an interesting organization in the forebrain, whereby different brain areas are specialized for the production of distinct forms of neural dynamics.

Integration of cortical and pallidal inputs in the basal ganglia-recipient thalamus of singing birds.

The basal ganglia-recipient thalamus receives inhibitory inputs from the pallidum and excitatory inputs from cortex, but it is unclear how these inputs interact during behavior. We recorded simultaneously from thalamic neurons and their putative synaptically connected pallidal inputs in singing zebra finches. We find, first, that each pallidal spike produces an extremely brief (∼5 ms) pulse of inhibition that completely suppresses thalamic spiking. As a result, thalamic spikes are entrained to pallidal spikes with submillisecond precision. Second, we find that the number of thalamic spikes that discharge within a single pallidal interspike interval (ISI) depends linearly on the duration of that interval but does not depend on pallidal activity prior to the interval. In a detailed biophysical model, our results were not easily explained by the postinhibitory "rebound" mechanism previously observed in anesthetized birds and in brain slices, nor could most of our data be characterized as "gating" of excitatory transmission by inhibitory pallidal input. Instead, we propose a novel "entrainment" mechanism of pallidothalamic transmission that highlights the importance of an excitatory conductance that drives spiking, interacting with brief pulses of pallidal inhibition. Building on our recent finding that cortical inputs can drive syllable-locked rate modulations in thalamic neurons during singing, we report here that excitatory inputs affect thalamic spiking in two ways: by shortening the latency of a thalamic spike after a pallidal spike and by increasing thalamic firing rates within individual pallidal ISIs. We present a unifying biophysical model that can reproduce all known modes of pallidothalamic transmission--rebound, gating, and entrainment--depending on the amount of excitation the thalamic neuron receives.

Dopamine neurons evaluate natural fluctuations in performance quality.

Many motor skills are learned by comparing ongoing behavior to internal performance benchmarks. Dopamine neurons encode performance error in behavioral paradigms where error is externally induced, but it remains unknown whether dopamine also signals the quality of natural performance fluctuations. Here, we record dopamine neurons in singing birds and examine how spontaneous dopamine spiking activity correlates with natural fluctuations in ongoing song. Antidromically identified basal ganglia-projecting dopamine neurons correlate with recent, and not future, song variations, consistent with a role in evaluation, not production. Furthermore, maximal dopamine spiking occurs at a single vocal target, consistent with either actively maintaining the existing song or shifting the song to a nearby form. These data show that spontaneous dopamine spiking can evaluate natural behavioral fluctuations unperturbed by experimental events such as cues or rewards.

Singing-related neural activity distinguishes two putative pallidal cell types in the songbird basal ganglia: comparison to the primate internal and external pallidal segments.

The songbird area X is a basal ganglia homolog that contains two pallidal cell types-local neurons that project within the basal ganglia and output neurons that project to the thalamus. Based on these projections, it has been proposed that these classes are structurally homologous to the primate external (GPe) and internal (GPi) pallidal segments. To test the hypothesis that the two area X pallidal types are functionally homologous to GPe and GPi neurons, we recorded from neurons in area X of singing juvenile male zebra finches, and directly compared their firing patterns to neurons recorded in the primate pallidus. In area X, we found two cell classes that exhibited high firing (HF) rates (>60 Hz) characteristic of pallidal neurons. HF-1 neurons, like most GPe neurons we examined, exhibited large firing rate modulations, including bursts and long pauses. In contrast, HF-2 neurons, like GPi neurons, discharged continuously without bursts or long pauses. To test whether HF-2 neurons were the output neurons that project to the thalamus, we next recorded directly from pallidal axon terminals in thalamic nucleus DLM, and found that all terminals exhibited singing-related firing patterns indistinguishable from HF-2 neurons. Our data show that singing-related neural activity distinguishes two putative pallidal cell types in area X: thalamus-projecting neurons that exhibit activity similar to the primate GPi, and non-thalamus-projecting neurons that exhibit activity similar to the primate GPe. These results suggest that song learning in birds and motor learning in mammals use conserved basal ganglia signaling strategies.

Vocal babbling in songbirds requires the basal ganglia-recipient motor thalamus but not the basal ganglia.

Young songbirds produce vocal "babbling," and the variability of their songs is thought to underlie a process of trial-and-error vocal learning. It is known that this exploratory variability requires the "cortical" component of a basal ganglia (BG) thalamocortical loop, but less understood is the role of the BG and thalamic components in this behavior. We found that large bilateral lesions to the songbird BG homolog Area X had little or no effect on song variability during vocal babbling. In contrast, lesions to the BG-recipient thalamic nucleus DLM (medial portion of the dorsolateral thalamus) largely abolished normal vocal babbling in young birds and caused a dramatic increase in song stereotypy. These findings support the idea that the motor thalamus plays a key role in the expression of exploratory juvenile behaviors during learning.

Changes in the neural control of a complex motor sequence during learning.

The acquisition of complex motor sequences often proceeds through trial-and-error learning, requiring the deliberate exploration of motor actions and the concomitant evaluation of the resulting performance. Songbirds learn their song in this manner, producing highly variable vocalizations as juveniles. As the song improves, vocal variability is gradually reduced until it is all but eliminated in adult birds. In the present study we examine how the motor program underlying such a complex motor behavior evolves during learning by recording from the robust nucleus of the arcopallium (RA), a motor cortex analog brain region. In young birds, neurons in RA exhibited highly variable firing patterns that throughout development became more precise, sparse, and bursty. We further explored how the developing motor program in RA is shaped by its two main inputs: LMAN, the output nucleus of a basal ganglia-forebrain circuit, and HVC, a premotor nucleus. Pharmacological inactivation of LMAN during singing made the song-aligned firing patterns of RA neurons adultlike in their stereotypy without dramatically affecting the spike statistics or the overall firing patterns. Removing the input from HVC, on the other hand, resulted in a complete loss of stereotypy of both the song and the underlying motor program. Thus our results show that a basal ganglia-forebrain circuit drives motor exploration required for trial-and-error learning by adding variability to the developing motor program. As learning proceeds and the motor circuits mature, the relative contribution of LMAN is reduced, allowing the premotor input from HVC to drive an increasingly stereotyped song.

Singing-related neural activity distinguishes four classes of putative striatal neurons in the songbird basal ganglia.

The striatum-the primary input nucleus of the basal ganglia-plays a major role in motor control and learning. Four main classes of striatal neuron are thought to be essential for normal striatal function: medium spiny neurons, fast-spiking interneurons, cholinergic tonically active neurons, and low-threshold spiking interneurons. However, the nature of the interaction of these neurons during behavior is poorly understood. The songbird area X is a specialized striato-pallidal basal ganglia nucleus that contains two pallidal cell types as well as the same four cell types found in the mammalian striatum. We recorded 185 single units in Area X of singing juvenile birds and, based on singing-related firing patterns and spike waveforms, find six distinct cell classes--two classes of putative pallidal neuron that exhibited a high spontaneous firing rate (> 60 Hz), and four cell classes that exhibited low spontaneous firing rates characteristic of striatal neurons. In this study, we examine in detail the four putative striatal cell classes. Type-1 neurons were the most frequently encountered and exhibited sparse temporally precise singing-related activity. Type-2 neurons were distinguished by their narrow spike waveforms and exhibited brief, high-frequency bursts during singing. Type-3 neurons were tonically active and did not burst, whereas type-4 neurons were inactive outside of singing and during singing generated long high-frequency bursts that could reach firing rates over 1 kHz. Based on comparison to the mammalian literature, we suggest that these four putative striatal cell classes correspond, respectively, to the medium spiny neurons, fast-spiking interneurons, tonically active neurons, and low-threshold spiking interneurons that are known to reside in area X.

Protein kinase A regulates calcium permeability of NMDA receptors.

Calcium (Ca2+) influx through NMDA receptors (NMDARs) is essential for synaptogenesis, experience-dependent synaptic remodeling and plasticity. The NMDAR-mediated rise in postsynaptic Ca2+ activates a network of kinases and phosphatases that promote persistent changes in synaptic strength, such as long-term potentiation (LTP). Here we show that the Ca2+ permeability of neuronal NMDARs is under the control of the cyclic AMP-protein kinase A (cAMP-PKA) signaling cascade. PKA blockers reduced the relative fractional Ca2+ influx through NMDARs as determined by reversal potential shift analysis and by a combination of electrical recording and Ca2+ influx measurements in rat hippocampal neurons in culture and hippocampal slices from mice. In slices, PKA blockers markedly inhibited NMDAR-mediated Ca2+ rises in activated dendritic spines, with no significant effect on synaptic current. Consistent with this, PKA blockers depressed the early phase of NMDAR-dependent LTP at hippocampal Schaffer collateral-CA1 (Sch-CA1) synapses. Our data link PKA-dependent synaptic plasticity to Ca2+ signaling in spines and thus provide a new mechanism whereby PKA regulates the induction of LTP.