Random interval schedule of reinforcement influences punishment resistance for cocaine in rats.

In an animal model of compulsive drug use, a subset of rats continues to self-administer cocaine despite footshock consequences and is considered punishment resistant. We recently found that punishment resistance is associated with habits that persist under conditions that typically encourage a transition to goal-directed control. Given that random ratio (RR) and random interval (RI) schedules of reinforcement influence whether responding is goal-directed or habitual, we investigated the influence of these schedules on punishment resistance for cocaine or food. Male and female Sprague Dawley rats were trained to self-administer either intravenous cocaine or food pellets on a seeking-taking chained schedule of reinforcement, with the seeking lever requiring completion of either an RR20 or RI60 schedule. Rats were then given four days of punishment testing with footshock administered at the completion of seeking on a random one-third of trials. For cocaine-trained rats, the RI60 schedule led to greater punishment resistance (i.e., more trials completed) than the RR20 schedule in males and females. For food-trained rats, the RI60 schedule led to greater punishment resistance (i.e., higher reward rates) than the RR20 schedule in female rats, although male rats showed punishment resistance on both RR20 and RI60 schedules. For both cocaine and food, we found that seeking responses were suppressed to a greater degree than reward rate with the RI60 schedule, whereas response rate and reward rate were equally suppressed with the RR20 schedule. This dissociation between punishment effects on reward rate and response rate with the RI60 schedule can be explained by the nonlinear relation between these variables on RI schedules, but it does not account for the enhanced resistance to punishment. Overall, the results show greater punishment resistance with the RI60 schedule as compared to the RR20 schedule, indicating that schedules of reinforcement are an influencing factor on resistance to negative consequences.

Discriminating goal-directed and habitual cocaine seeking in rats using a novel outcome devaluation procedure.

Habits are theorized to play a key role in compulsive cocaine seeking, yet there is limited methodology for assessing habitual responding for intravenous (IV) cocaine. We developed a novel outcome devaluation procedure to discriminate goal-directed from habitual responding in cocaine-seeking rats. This procedure elicits devaluation temporarily and requires no additional training, allowing repeated testing at different time points. After training male rats to self-administer IV cocaine, we devalued the drug outcome via experimenter-administered IV cocaine (a "satiety" procedure) prior to a 10-min extinction test. Many rats were sensitive to outcome devaluation, a hallmark of goal-directed responding. These animals reduced responding when given a dose of experimenter-administered cocaine that matched or exceeded satiety levels during self-administration. However, other rats were insensitive to experimenter-administered cocaine, suggesting their responding was habitual. Importantly, reinforcement schedules and neural manipulations that produce goal-directed responding (i.e., ratio schedules or dorsolateral striatum lesions) caused sensitivity to outcome devaluation, whereas reinforcement schedules and neural manipulations that produce habitual responding (i.e., interval schedules or dorsomedial striatum lesions) caused insensitivity. Satiety-based outcome devaluation is an innovative new tool to dissect the neural and behavioral mechanisms underlying IV cocaine-seeking behavior.

Punishment resistance for cocaine is associated with inflexible habits in rats.

Addiction is characterized by continued drug use despite negative consequences. In an animal model, a subset of rats continues to self-administer cocaine despite footshock consequences, showing punishment resistance. We sought to test the hypothesis that punishment resistance arises from failure to exert goal-directed control over habitual cocaine seeking. While habits are not inherently permanent or maladaptive, continued use of habits under conditions that should encourage goal-directed control makes them maladaptive and inflexible. We trained male and female Sprague Dawley rats on a seeking-taking chained schedule of cocaine self-administration. We then exposed them to four days of punishment testing in which footshock was delivered randomly on one-third of trials. Before and after punishment testing (four days pre-punishment and ≥ four days post-punishment), we assessed whether cocaine seeking was goal-directed or habitual using outcome devaluation via cocaine satiety. We found that punishment resistance was associated with continued use of habits, whereas punishment sensitivity was associated with increased goal-directed control. Although punishment resistance for cocaine was not predicted by habitual responding pre-punishment, it was associated with habitual responding post-punishment. In parallel studies of food self-administration, we similarly observed that punishment resistance was associated with habitual responding post-punishment but not pre-punishment in males, although it was associated with habitual responding both pre- and post-punishment in females, indicating that punishment resistance was predicted by habitual responding in food-seeking females. These findings indicate that punishment resistance is related to habits that have become inflexible and persist under conditions that should encourage a transition to goal-directed behavior.

Punishment resistance for cocaine is associated with inflexible habits in rats.

Addiction is characterized by continued drug use despite negative consequences. In an animal model, a subset of rats continues to self-administer cocaine despite footshock consequences, showing punishment resistance. We sought to test the hypothesis that punishment resistance arises from failure to exert goal-directed control over habitual cocaine seeking. While habits are not inherently permanent or maladaptive, continued use of habits under conditions that should encourage goal-directed control makes them maladaptive and inflexible. We trained male and female Sprague Dawley rats on a seeking-taking chained schedule of cocaine self-administration (2 h/day). We then exposed them to 4 days of punishment testing, in which footshock (0.4 mA, 0.3 s) was delivered randomly on one-third of trials, immediately following completion of seeking and prior to extension of the taking lever. Before and after punishment testing (4 days pre-punishment and ≥4 days post-punishment), we assessed whether cocaine seeking was goal-directed or habitual using outcome devaluation via cocaine satiety. We found that punishment resistance was associated with continued use of habits, whereas punishment sensitivity was associated with increased goal-directed control. Although punishment resistance was not predicted by habitual responding pre-punishment, it was associated with habitual responding post-punishment. In parallel studies of food self-administration, we similarly observed that punishment resistance was associated with habitual responding post-punishment but not pre-punishment. These findings indicate that punishment resistance is related to habits that have become inflexible and persist under conditions that should encourage a transition to goal-directed behavior.

Monosynaptic Retrograde Tracing From Prelimbic Neuron Subpopulations Projecting to Either Nucleus Accumbens Core or Rostromedial Tegmental Nucleus.

The prelimbic (PL) region of the medial prefrontal cortex (mPFC) has been implicated in both driving and suppressing motivated behaviors, including cocaine-seeking in rats. These seemingly opposing functions may be mediated by different efferent targets of PL projections, such as the nucleus accumbens (NAc) core and rostromedial tegmental nucleus (RMTg), which have contrasting roles in reward-seeking behaviors. We sought to characterize the anatomical connectivity differences between PL neurons projecting to NAc core and RMTg. We used conventional retrograde tracers to reveal distinct subpopulations of PL neurons projecting to NAc core vs. RMTg in rats, with very little overlap. To examine potential differences in input specificity for these two PL subpopulations, we then used Cre-dependent rabies virus (EnvA-RV-EGFP) as a monosynaptic retrograde tracer and targeted specific PL neurons via injections of retrograde CAV2-Cre in either NAc core or RMTg. We observed a similar catalog of cortical, thalamic, and limbic afferents for both NAc- and RMTg-projecting populations, with the primary source of afferent information arising from neighboring prefrontal neurons in ipsilateral PL and infralimbic cortex (IL). However, when the two subpopulations were directly compared, we found that RMTg-projecting PL neurons received a greater proportion of input from ipsilateral PL and IL, whereas NAc-projecting PL neurons received a greater proportion of input from most other cortical areas, mediodorsal thalamic nucleus, and several other subcortical areas. NAc-projecting PL neurons also received a greater proportion of contralateral cortical input. Our findings reveal that PL subpopulations differ not only in their efferent target but also in the input specificity from afferent structures. These differences in connectivity are likely to be critical to functional differences of PL subpopulations.

Prelimbic cortical projections to rostromedial tegmental nucleus play a suppressive role in cue-induced reinstatement of cocaine seeking.

The prelimbic (PL) region of prefrontal cortex has been implicated in both driving and suppressing cocaine seeking in animal models of addiction. We hypothesized that these opposing roles for PL may be supported by distinct efferent projections. While PL projections to nucleus accumbens core have been shown to be involved in driving reinstatement of cocaine seeking, PL projections to the rostromedial tegmental nucleus (RMTg) may instead suppress reinstatement of cocaine seeking, due to the role of RMTg in behavioral inhibition. Here, we used a functional disconnection approach to temporarily disrupt the PL-RMTg pathway during cue- or cocaine-induced reinstatement. Male Sprague Dawley rats self-administered cocaine during daily 2-h sessions for ≥10 days and then underwent extinction training. Reinstatement of extinguished cocaine seeking was elicited by cocaine-associated cues or cocaine prime. Prior to reinstatement, rats received microinjections of the GABA agonists baclofen/muscimol (1/0.1 mM) into unilateral PL and the AMPA receptor antagonist NBQX (1 mM) into contralateral or ipsilateral RMTg. Functional disconnection of PL-RMTg via contralateral inactivation markedly increased cue-induced reinstatement, but did not increase cocaine-induced reinstatement or drive reinstatement of extinguished cocaine seeking in the absence of cues or cocaine. Enhanced cue-induced reinstatement was also observed with ipsilateral inactivation of PL and RMTg, but not with unilateral inactivation of PL or RMTg alone, indicating that both ipsilateral and contralateral projections from PL to RMTg have an inhibitory influence on behavior. These data further support a suppressive role for PL in cocaine seeking by implicating PL efferent projections to RMTg in inhibiting cue-induced reinstatement.