Discriminating goal-directed and habitual cocaine seeking in rats using a novel outcome devaluation procedure.

Habits are theorized to play a key role in compulsive cocaine seeking, yet there is limited methodology for assessing habitual responding for intravenous (IV) cocaine. We developed a novel outcome devaluation procedure to discriminate goal-directed from habitual responding in cocaine-seeking rats. This procedure elicits devaluation temporarily and requires no additional training, allowing repeated testing at different time points. After training male rats to self-administer IV cocaine, we devalued the drug outcome via experimenter-administered IV cocaine (a "satiety" procedure) prior to a 10-min extinction test. Many rats were sensitive to outcome devaluation, a hallmark of goal-directed responding. These animals reduced responding when given a dose of experimenter-administered cocaine that matched or exceeded satiety levels during self-administration. However, other rats were insensitive to experimenter-administered cocaine, suggesting their responding was habitual. Importantly, reinforcement schedules and neural manipulations that produce goal-directed responding (i.e., ratio schedules or dorsolateral striatum lesions) caused sensitivity to outcome devaluation, whereas reinforcement schedules and neural manipulations that produce habitual responding (i.e., interval schedules or dorsomedial striatum lesions) caused insensitivity. Satiety-based outcome devaluation is an innovative new tool to dissect the neural and behavioral mechanisms underlying IV cocaine-seeking behavior.

Early life manipulations of vasopressin-family peptides alter vocal learning.

Vocal learning from social partners is crucial for the successful development of communication in a wide range of species. Social interactions organize attention and enhance motivation to learn species-typical behaviour. However, the neurobiological mechanisms connecting social motivation and vocal learning are unknown. Using zebra finches (Taeniopygia guttata), a ubiquitous model for vocal learning, we show that manipulations of nonapeptide hormones in the vasopressin family (arginine vasotocin, AVT) early in development can promote or disrupt both song and social motivation. Young male zebra finches, like human infants, are socially gregarious and require interactive feedback from adult tutors to learn mature vocal forms. To investigate the role of social motivational mechanisms in song learning, in two studies, we injected hatchling males with AVT or Manning compound (MC, a nonapeptide receptor antagonist) on days 2-8 post-hatching and recorded song at maturity. In both studies, MC males produced a worse match to tutor song than controls. In study 2, which experimentally controlled for tutor and genetic factors, AVT males also learned song significantly better compared with controls. Furthermore, song similarity correlated with several measures of social motivation throughout development. These findings provide the first evidence that nonapeptides are critical to the development of vocal learning.

Encoding and context-dependent control of reward consumption within the central nucleus of the amygdala.

Dysregulation of the central amygdala is thought to underlie aberrant choice in alcohol use disorder, but the role of central amygdala neural activity during reward choice and consumption is unclear. We recorded central amygdala neurons in male rats as they consumed alcohol or sucrose. We observed activity changes at the time of reward approach, as well as lick-entrained activity during ongoing consumption of both rewards. In choice scenarios where rats could drink sucrose, alcohol, or quinine-adulterated alcohol with or without central amygdala optogenetic stimulation, rats drank more of stimulation-paired options when the two bottles contained identical options. Given a choice among different options, central amygdala stimulation usually enhanced consumption of stimulation-paired rewards. However, optogenetic stimulation during consumption of the less-preferred option, alcohol, was unable to enhance alcohol intake while sucrose was available. These findings indicate that the central amygdala contributes to refining motivated pursuit toward the preferred available option.

Encoding and context-dependent control of reward consumption within the central nucleus of the amygdala.

The ability to evaluate and select a preferred option among a variety of available offers is an essential aspect of goal-directed behavior. Dysregulation of this valuation process is characteristic of alcohol use disorder, with the central amygdala being implicated in persistent alcohol pursuit. However, the mechanism by which the central amygdala encodes and promotes the motivation to seek and consume alcohol remains unclear. We recorded single-unit activity in male Long-Evans rats as they consumed 10% ethanol or 14.2% sucrose. We observed significant activity at the time of approach to alcohol or sucrose, as well as lick-entrained activity during the ongoing consumption of both alcohol and sucrose. We then evaluated the ability of central amygdala optogenetic manipulation time-locked to consumption to alter ongoing intake of alcohol or sucrose, a preferred non-drug reward. In closed two-choice scenarios where rats could drink only sucrose, alcohol, or quinine-adulterated alcohol with or without central amygdala stimulation, rats drank more of stimulation-paired options. Microstructural analysis of licking patterns suggests these effects were mediated by changes in motivation, not palatability. Given a choice among different options, central amygdala stimulation enhanced consumption if the stimulation was associated with the preferred reward while closed-loop inhibition only decreased consumption if the options were equally valued. However, optogenetic stimulation during consumption of the less-preferred option, alcohol, was unable to enhance overall alcohol intake while sucrose was available. Collectively, these findings indicate that the central amygdala processes the motivational value of available offers to promote pursuit of the most preferred available option.

Monosynaptic Retrograde Tracing From Prelimbic Neuron Subpopulations Projecting to Either Nucleus Accumbens Core or Rostromedial Tegmental Nucleus.

The prelimbic (PL) region of the medial prefrontal cortex (mPFC) has been implicated in both driving and suppressing motivated behaviors, including cocaine-seeking in rats. These seemingly opposing functions may be mediated by different efferent targets of PL projections, such as the nucleus accumbens (NAc) core and rostromedial tegmental nucleus (RMTg), which have contrasting roles in reward-seeking behaviors. We sought to characterize the anatomical connectivity differences between PL neurons projecting to NAc core and RMTg. We used conventional retrograde tracers to reveal distinct subpopulations of PL neurons projecting to NAc core vs. RMTg in rats, with very little overlap. To examine potential differences in input specificity for these two PL subpopulations, we then used Cre-dependent rabies virus (EnvA-RV-EGFP) as a monosynaptic retrograde tracer and targeted specific PL neurons via injections of retrograde CAV2-Cre in either NAc core or RMTg. We observed a similar catalog of cortical, thalamic, and limbic afferents for both NAc- and RMTg-projecting populations, with the primary source of afferent information arising from neighboring prefrontal neurons in ipsilateral PL and infralimbic cortex (IL). However, when the two subpopulations were directly compared, we found that RMTg-projecting PL neurons received a greater proportion of input from ipsilateral PL and IL, whereas NAc-projecting PL neurons received a greater proportion of input from most other cortical areas, mediodorsal thalamic nucleus, and several other subcortical areas. NAc-projecting PL neurons also received a greater proportion of contralateral cortical input. Our findings reveal that PL subpopulations differ not only in their efferent target but also in the input specificity from afferent structures. These differences in connectivity are likely to be critical to functional differences of PL subpopulations.

Prelimbic cortical projections to rostromedial tegmental nucleus play a suppressive role in cue-induced reinstatement of cocaine seeking.

The prelimbic (PL) region of prefrontal cortex has been implicated in both driving and suppressing cocaine seeking in animal models of addiction. We hypothesized that these opposing roles for PL may be supported by distinct efferent projections. While PL projections to nucleus accumbens core have been shown to be involved in driving reinstatement of cocaine seeking, PL projections to the rostromedial tegmental nucleus (RMTg) may instead suppress reinstatement of cocaine seeking, due to the role of RMTg in behavioral inhibition. Here, we used a functional disconnection approach to temporarily disrupt the PL-RMTg pathway during cue- or cocaine-induced reinstatement. Male Sprague Dawley rats self-administered cocaine during daily 2-h sessions for ≥10 days and then underwent extinction training. Reinstatement of extinguished cocaine seeking was elicited by cocaine-associated cues or cocaine prime. Prior to reinstatement, rats received microinjections of the GABA agonists baclofen/muscimol (1/0.1 mM) into unilateral PL and the AMPA receptor antagonist NBQX (1 mM) into contralateral or ipsilateral RMTg. Functional disconnection of PL-RMTg via contralateral inactivation markedly increased cue-induced reinstatement, but did not increase cocaine-induced reinstatement or drive reinstatement of extinguished cocaine seeking in the absence of cues or cocaine. Enhanced cue-induced reinstatement was also observed with ipsilateral inactivation of PL and RMTg, but not with unilateral inactivation of PL or RMTg alone, indicating that both ipsilateral and contralateral projections from PL to RMTg have an inhibitory influence on behavior. These data further support a suppressive role for PL in cocaine seeking by implicating PL efferent projections to RMTg in inhibiting cue-induced reinstatement.

A quantitative reward prediction error signal in the ventral pallidum.

The nervous system is hypothesized to compute reward prediction errors (RPEs) to promote adaptive behavior. Correlates of RPEs have been observed in the midbrain dopamine system, but the extent to which RPE signals exist in other reward-processing regions is less well understood. In the present study, we quantified outcome history-based RPE signals in the ventral pallidum (VP), a basal ganglia region functionally linked to reward-seeking behavior. We trained rats to respond to reward-predicting cues, and we fit computational models to predict the firing rates of individual neurons at the time of reward delivery. We found that a subset of VP neurons encoded RPEs and did so more robustly than the nucleus accumbens, an input to the VP. VP RPEs predicted changes in task engagement, and optogenetic manipulation of the VP during reward delivery bidirectionally altered rats' subsequent reward-seeking behavior. Our data suggest a pivotal role for the VP in computing teaching signals that influence adaptive reward seeking.