Daily singing of adult songbirds functions to maintain song performance independently of auditory feedback and age.

Many songbirds learn to produce songs through vocal practice in early life and continue to sing daily throughout their lifetime. While it is well-known that adult songbirds sing as part of their mating rituals, the functions of singing behavior outside of reproductive contexts remain unclear. Here, we investigated this issue in adult male zebra finches by suppressing their daily singing for two weeks and examining the effects on song performance. We found that singing suppression decreased the pitch, amplitude, and duration of songs, and that those song features substantially recovered through subsequent free singing. These reversible song changes were not dependent on auditory feedback or the age of the birds, contrasting with the adult song plasticity that has been reported previously. These results demonstrate that adult song structure is not stable without daily singing, and suggest that adult songbirds maintain song performance by preventing song changes through physical act of daily singing throughout their life. Such daily singing likely functions as vocal training to maintain the song production system in optimal conditions for song performance in reproductive contexts, similar to how human singers and athletes practice daily to maintain their performance.

Effect of Darkness on Intrinsic Motivation for Undirected Singing in Bengalese Finch (Lonchura striata Domestica): A Comparative Study With Zebra Finch (Taeniopygia guttata).

The zebra finch (ZF) and the Bengalese finch (BF) are animal models that have been commonly used for neurobiological studies on vocal learning. Although they largely share the brain structure for vocal learning and production, BFs produce more complex and variable songs than ZFs, providing a great opportunity for comparative studies to understand how animals learn and control complex motor behaviors. Here, we performed a comparative study between the two species by focusing on intrinsic motivation for non-courtship singing ("undirected singing"), which is critical for the development and maintenance of song structure. A previous study has demonstrated that ZFs dramatically increase intrinsic motivation for undirected singing when singing is temporarily suppressed by a dark environment. We found that the same procedure in BFs induced the enhancement of intrinsic singing motivation to much smaller degrees than that in ZFs. Moreover, unlike ZFs that rarely sing in dark conditions, substantial portion of BFs exhibited frequent singing in darkness, implying that such "dark singing" may attenuate the enhancement of intrinsic singing motivation during dark periods. In addition, measurements of blood corticosterone levels in dark and light conditions provided evidence that although BFs have lower stress levels than ZFs in dark conditions, such lower stress levels in BFs are not the major factor responsible for their frequent dark singing. Our findings highlight behavioral and physiological differences in spontaneous singing behaviors of BFs and ZFs and provide new insights into the interactions between singing motivation, ambient light, and environmental stress.

Contribution of Endocannabinoids to Intrinsic Motivation for Undirected Singing in Adult Zebra Finches.

Songbirds, such as zebra finches, spontaneously produce many song renditions for vocal practice even in the absence of apparent recipients throughout their lives. Such "undirected singing" is driven by intrinsic motivation, which arises within individuals for internal satisfaction without immediate external rewards. Intrinsic motivation for undirected singing in adult zebra finches was previously demonstrated to be critically regulated by dopamine through D2 receptors. Here, we further investigate the mechanisms of intrinsic motivation for undirected singing by focusing on endocannabinoids, which modulate dopamine signaling and contribute to motivation and reward in mammals. In songbirds, endocannabinoids have been shown to be involved in the production of undirected songs, but whether they are involved in the intrinsic motivation for undirected singing remains unknown. Using latencies of the first song production following temporary singing suppression as a measure of intrinsic motivation for undirected singing, we demonstrate that systemic administration of the direct cannabinoid agonist WIN55212-2 decreases intrinsic motivation for singing and that those effects are largely reversed by the cannabinoid antagonist SR141716A co-administered with WIN55212-2. Administration of SR141716A alone or that of two indirect cannabinoid agonists did not significantly affect intrinsic singing motivation. These results suggest that endocannabinoids are critically involved in regulating intrinsic motivation for undirected singing and provide new insights into the neural mechanisms of intrinsically motivated motor behaviors.

Intrinsic motivation for singing in songbirds is enhanced by temporary singing suppression and regulated by dopamine.

Behaviors driven by intrinsic motivation are critical for development and optimization of physical and brain functions, but their underlying mechanisms are not well studied due to the complexity and autonomy of the behavior. Songbirds, such as zebra finches, offer a unique opportunity to study neural substrates of intrinsic motivation because they spontaneously produce many renditions of songs with highly-quantifiable structure for vocal practice, even in the absence of apparent recipients ("undirected singing"). Neural substrates underlying intrinsic motivation for undirected singing are still poorly understood partly because singing motivation cannot be easily manipulated due to its autonomy. Also, undirected singing itself acts as an internal reward, which could increase singing motivation, leading to difficulty in measuring singing motivation independent of singing-associated reward. Here, we report a simple procedure to easily manipulate and quantify intrinsic motivation for undirected singing independent of singing-associated reward. We demonstrate that intrinsic motivation for undirected singing is dramatically enhanced by temporary suppression of singing behavior and the degree of enhancement depends on the duration of suppression. Moreover, by examining latencies to the first song following singing suppression as a measure of singing motivation independent of singing-associated reward, we demonstrate that intrinsic singing motivation is critically regulated by dopamine through D2 receptors. These results provide a simple experimental tool to manipulate and measure the intrinsic motivation for undirected singing and illustrate the importance of zebra finches as a model system to study the neural basis of intrinsically-motivated behaviors.

Long-term Devocalization of Zebra Finches.

Songbirds, such as the zebra finch, are a popular animal model for studying the neural basis of vocal and complex skill learning. Adult male zebra finches produce courtship song toward females (referred to as 'directed song') and recording and analyzing sounds of directed song along with underlying neural activity is important for investigating behavioral and neural mechanisms of song production and learning. However, recording of directed song is easily contaminated by calls that are often as loud as directed songs and frequently produced by a female bird is presented in the same sound-recording chamber to elicit directed song. We developed a new surgical procedure to relatively easily and almost completely devocalize female zebra finches semi-permanently, without affecting other behaviors. This procedure enables researchers to record directed songs with almost no contamination by female calls. The procedure can also be used to devocalize male birds as well and, thus, has great potential for a variety of experimental purposes, such as long-term elimination of auditory feedback during singing in male birds.

Adaptive Encoding of Outcome Prediction by Prefrontal Cortex Ensembles Supports Behavioral Flexibility.

The prefrontal cortex (PFC) is thought to play a critical role in behavioral flexibility by monitoring action-outcome contingencies. How PFC ensembles represent shifts in behavior in response to changes in these contingencies remains unclear. We recorded single-unit activity and local field potentials in the dorsomedial PFC (dmPFC) of male rats during a set-shifting task that required them to update their behavior, among competing options, in response to changes in action-outcome contingencies. As behavior was updated, a subset of PFC ensembles encoded the current trial outcome before the outcome was presented. This novel outcome-prediction encoding was absent in a control task, in which actions were rewarded pseudorandomly, indicating that PFC neurons are not merely providing an expectancy signal. In both control and set-shifting tasks, dmPFC neurons displayed postoutcome discrimination activity, indicating that these neurons also monitor whether a behavior is successful in generating rewards. Gamma-power oscillatory activity increased before the outcome in both tasks but did not differentiate between expected outcomes, suggesting that this measure is not related to set-shifting behavior but reflects expectation of an outcome after action execution. These results demonstrate that PFC neurons support flexible rule-based action selection by predicting outcomes that follow a particular action.SIGNIFICANCE STATEMENT Tracking action-outcome contingencies and modifying behavior when those contingencies change is critical to behavioral flexibility. We find that ensembles of dorsomedial prefrontal cortex neurons differentiate between expected outcomes when action-outcome contingencies change. This predictive mode of signaling may be used to promote a new response strategy at the service of behavioral flexibility.

Reward Anticipation Is Encoded Differently by Adolescent Ventral Tegmental Area Neurons.

BACKGROUND: Elucidating the neurobiology of the adolescent brain is fundamental to our understanding of the etiology of psychiatric disorders such as schizophrenia and addiction, the symptoms of which often manifest during this developmental period. Dopamine neurons in the ventral tegmental area (VTA) are strongly implicated in adolescent behavioral and psychiatric vulnerabilities, but little is known about how adolescent VTA neurons encode information during motivated behavior. METHODS: We recorded daily from VTA neurons in adolescent and adult rats during learning and maintenance of a cued, reward-motivated instrumental task and extinction from this task. RESULTS: During performance of the same motivated behavior, identical events were encoded differently by adult and adolescent VTA neurons. Adolescent VTA neurons with dopamine-like characteristics lacked a reward anticipation signal and showed a smaller response to reward delivery compared with adults. After extinction, however, these neurons maintained a strong phasic response to cues formerly predictive of reward opportunity. CONCLUSIONS: Anticipatory neuronal activity in the VTA supports preparatory attention and is implicated in error prediction signaling. Absence of this activity, combined with persistent representations of previously rewarded experiences, may provide a mechanism for rash decision making in adolescents.

New insights into the specificity and plasticity of reward and aversion encoding in the mesolimbic system.

The mesocorticolimbic system, consisting, at its core, of the ventral tegmental area, the nucleus accumbens, and medial prefrontal cortex, has historically been investigated primarily for its role in positively motivated behaviors and reinforcement learning, and its dysfunction in addiction, schizophrenia, depression, and other mood disorders. Recently, researchers have undertaken a more comprehensive analysis of this system, including its role in not only reward but also punishment, as well as in both positive and negative reinforcement. This focus has been facilitated by new anatomical, physiological, and behavioral approaches to delineate functional circuits underlying behaviors and to determine how this system flexibly encodes and responds to positive and negative states and events, beyond simple associative learning. This review is a summary of topics covered in a mini-symposium at the 2013 Society for Neuroscience annual meeting.

Distinct prestimulus and poststimulus activation of VTA neurons correlates with stimulus detection.

Dopamine neurons of the ventral tegmental area (VTA) signal the occurrence of a reward-predicting conditioned stimulus (CS) with a subsecond duration increase in post-CS firing rate. Important theories about reward-prediction error and reward expectancy have been informed by the substantial number of studies that have examined post-CS phasic VTA neuron activity. On the other hand, the role of VTA neurons in anticipation of a reward-predicting CS and analysis of prestimulus spike rate rarely has been studied. We recorded from the VTA in rats during the 3-choice reaction time task, which has a fixed-duration prestimulus period and a difficult-to-detect stimulus. Use of a stimulus that was difficult to detect led to behavioral errors, which allowed us to compare VTA activity between trials with correct and incorrect stimulus-guided choices. We found a sustained increase in firing rate of both putative dopamine and GABA neurons during the pre-CS period of correct and incorrect trials. The poststimulus phasic response, however, was absent on incorrect trials, suggesting that the stimulus-evoked phasic response of dopamine neurons may relate to stimulus detection. The prestimulus activation of VTA neurons may modulate cortical systems that represent internal states of stimulus expectation and provide a mechanism for dopamine neurotransmission to influence preparatory attention to an expected stimulus.

Disruption of prefrontal cortex large scale neuronal activity by different classes of psychotomimetic drugs.

In the absence of overt cellular pathology but profound perceptual disorganization and cognitive deficits, schizophrenia is increasingly considered a disorder of neural coordination. Thus, different causal factors can similarly interrupt the dynamic function of neuronal ensembles and networks, in particular in the prefrontal cortex (PFC), leading to behavioral disorganization. The importance of establishing preclinical biomarkers for this aberrant function has prompted investigations into the nature of psychotomimetic drug effects on PFC neuronal activity. The drugs used in this context include serotonergic hallucinogens, amphetamine, and NMDA receptor antagonists. A prominent line of thinking is that these drugs create psychotomimetic states by similarly disinhibiting the activity of PFC pyramidal neurons. In the present study we did not find evidence in support of this mechanism in PFC subregions of freely moving rats. Whereas the NMDA receptor antagonist MK801 increased PFC population activity, the serotonergic hallucinogen DOI dose-dependently decreased population activity. Amphetamine did not strongly affect this measure. Despite different effects on the direction of change in activity, all three drugs caused similar net disruptions of population activity and modulated gamma oscillations. We also observed reduced correlations between spike-rate and local field potential power selectively in the gamma band suggesting that these drugs disconnect spike-discharge from PFC gamma oscillators. Gamma band oscillations support cognitive functions affected in schizophrenia. These findings provide insight into mechanisms that may lead to cortical processing deficits in schizophrenia and provide a novel electrophysiological approach for phenotypic characterization of animal models of this disease.

Coordinated activity of ventral tegmental neurons adapts to appetitive and aversive learning.

Our understanding of how value-related information is encoded in the ventral tegmental area (VTA) is based mainly on the responses of individual putative dopamine neurons. In contrast to cortical areas, the nature of coordinated interactions between groups of VTA neurons during motivated behavior is largely unknown. These interactions can strongly affect information processing, highlighting the importance of investigating network level activity. We recorded the activity of multiple single units and local field potentials (LFP) in the VTA during a task in which rats learned to associate novel stimuli with different outcomes. We found that coordinated activity of VTA units with either putative dopamine or GABA waveforms was influenced differently by rewarding versus aversive outcomes. Specifically, after learning, stimuli paired with a rewarding outcome increased the correlation in activity levels between unit pairs whereas stimuli paired with an aversive outcome decreased the correlation. Paired single unit responses also became more redundant after learning. These response patterns flexibly tracked the reversal of contingencies, suggesting that learning is associated with changing correlations and enhanced functional connectivity between VTA neurons. Analysis of LFP recorded simultaneously with unit activity showed an increase in the power of theta oscillations when stimuli predicted reward but not an aversive outcome. With learning, a higher proportion of putative GABA units were phase locked to the theta oscillations than putative dopamine units. These patterns also adapted when task contingencies were changed. Taken together, these data demonstrate that VTA neurons organize flexibly as functional networks to support appetitive and aversive learning.

Putative γ-aminobutyric acid neurons in the ventral tegmental area have a similar pattern of plasticity as dopamine neurons during appetitive and aversive learning.

Dopamine influences affective, motor and cognitive processing, and multiple forms of learning and memory. This multifaceted functionality, which operates across long temporal windows, is broader than the narrow and temporally constrained role often ascribed to dopamine neurons as reward prediction error detectors. Given the modulatory nature of dopamine neurotransmission, that dopamine release is activated by both aversive and appetitive stimuli, and that dopamine receptors are often localized extrasynaptically, a role for dopamine in transmitting precise error signals has been questioned. Here we recorded from ventral tegmental area (VTA) neurons, while exposing rats to novel stimuli that were predictive of an appetitive or aversive outcome in the same behavioral session. The VTA contains dopamine and -aminobutyric acid (GABA) neurons that project to striatal and cortical regions and are strongly implicated in learning and affective processing. The response of VTA neurons, regardless of whether they had putative dopamine or GABA waveforms, transformed flexibly as animals learned to associate novel stimuli from different sensory modalities to appetitive or aversive outcomes. Learning the appetitive association led to larger excitatory VTA responses, whereas acquiring the aversive association led to a biphasic response of brief excitation followed by sustained inhibition. These responses shifted rapidly as outcome contingencies changed. These data suggest that VTA neurons interface sensory information with representational memory of aversive and appetitive events. This pattern of plasticity was not selective for putative dopamine neurons and generalized to other cells, suggesting that the temporally precise information transfer from the VTA may be mediated by faster acting GABA neurons.