Circuit selectivity in drug versus natural reward seeking behaviors.

Substance use disorder (SUD) is characterized, in part by behavior biased toward drug use and away from natural sources of reward (e.g., social interaction, food, sex). The neurobiological underpinnings of SUDs reveal distinct brain regions where neuronal activity is necessary for the manifestation of SUD-characteristic behaviors. Studies that specifically examine how these regions are involved in behaviors motivated by drug versus natural reward allow determinations of which regions are necessary for regulating seeking of both reward types, and appraisals of novel SUD therapies for off-target effects on behaviors motivated by natural reward. Here, we evaluate studies directly comparing regulatory roles for specific brain regions in drug versus natural reward. While it is clear that many regions drive behaviors motivated by all reward types, based on the literature reviewed we propose a set of interconnected regions that become necessary for behaviors motivated by drug, but not natural rewards. The circuitry is selectively necessary for drug seeking includes an Action/Reward subcircuit, comprising nucleus accumbens, ventral pallidum, and ventral tegmental area, a Prefrontal subcircuit comprising prelimbic, infralimbic, and insular cortices, a Stress subcircuit comprising the central nucleus of the amygdala and the bed nucleus of the stria terminalis, and a Diencephalon circuit including lateral hypothalamus. Evidence was mixed for nucleus accumbens shell, insular cortex, and ventral pallidum. Studies for all other brain nuclei reviewed supported a necessary role in regulating both drug and natural reward seeking. Finally, we discuss emerging strategies to further disambiguate the necessity of brain regions in drug- versus natural reward-associated behaviors.

Cocaine and sucrose rewards recruit different seeking ensembles in the nucleus accumbens core.

Poorly regulated reward seeking is a central feature of substance use disorder. Recent research shows that rewarding drug-related experiences induce synchronous activation of a discrete number of neurons in the nucleus accumbens that are causally linked to reward-related contexts. Here we comprehensively characterize the specific ensemble of neurons built through experience that are linked to seeking behavior. We additionally address the question of whether or not addictive drugs usurp the neuronal networks recruited by natural rewards by evaluating cocaine- and sucrose-associated ensembles within the same mouse. We used FosCreERT2/+/Ai14 transgenic mice to tag cells activated by and potentially encoding cocaine and sucrose seeking. We tagged ~1% of neurons in the core subregion of the accumbens (NAcore) activated during cue-induced seeking for cocaine or sucrose. The majority of tagged cells in the seeking ensembles were D1-MSNs, and specifically activated during seeking, not during extinction or when mice remained in the home cage. To compare different reward-specific ensembles within the same mouse, we used a dual cocaine and sucrose self-administration protocol allowing reward-specific seeking. Using this model, we found ~70% distinction between the cells constituting the cocaine- compared to the sucrose-seeking ensemble. Establishing that cocaine recruits an ensemble of NAcore neurons largely distinct from neurons recruited into an ensemble coding for sucrose seeking suggest a finely tuned specificity of ensembles. The findings allow further exploration of the mechanisms that transform reward-based positive reinforcement into maladaptive drug seeking.

Ventral Pallidum Is the Primary Target for Accumbens D1 Projections Driving Cocaine Seeking.

Outputs from the nucleus accumbens (NAc) include projections to the ventral pallidum and the ventral tegmental area and subtantia nigra in the ventral mesencephalon. The medium spiny neurons (MSN) that give rise to these pathways are GABAergic and consist of two populations of equal number that are segregated by differentially expressed proteins, including D1- and D2-dopamine receptors. Afferents to the ventral pallidum arise from both D1- and D2-MSNs, whereas the ventral mesencephalon is selectively innervated by D1-MSN. To determine the extent of collateralization of D1-MSN to these axon terminal fields we used retrograde labeling in transgenic mice expressing tdTomato selectively in D1-MSN, and found that a large majority of D1-MSN in either the shell or core subcompartments of the accumbens collateralized to both output structures. Approximately 70% of D1-MSNs projecting to the ventral pallidum collateralized to the ventral mesencephalon, whereas >90% of mesencephalic D1-MSN afferents collateralized to the ventral pallidum. In contrast, <10% of dorsal striatal D1-MSNs collateralized to both the globus pallidus and ventral mesencephalon. D1-MSN activation is required for conditioned cues to induce cocaine seeking. To determine which D1-MSN projection mediates cued cocaine seeking, we selectively transfected D1-MSNs in transgenic rats with an inhibitory Gi-coupled DREADD. Activation of the transfected Gi-DREADD with clozapine-N-oxide administered into the ventral pallidum, but not into the ventral mesencephalon, blocked cue-induced cocaine seeking. These data show that, although accumbens D1-MSNs largely collateralize to both the ventral pallidum and ventral mesencephalon, only D1-MSN innervation of the ventral pallidum is necessary for cue-induced cocaine seeking.SIGNIFICANCE STATEMENT Activity in D1 dopamine receptor-expressing neurons in the NAc is required for rodents to respond to cocaine-conditioned cues and relapse to drug seeking behaviors. The D1-expressing neurons project to both the ventral pallidum and ventral mesencephalon, and we found that a majority of the neurons that innervate the ventral pallidum also collateralize to the ventral mesencephalon. However, despite innervating both structures, only D1 innervation of the ventral pallidum mediates cue-induced cocaine seeking.

Transient synaptic potentiation in nucleus accumbens shell during refraining from cocaine seeking.

Repeated exposure to drug-associated cues without reward (extinction) leads to refraining from drug seeking in rodents. We determined if refraining is associated with transient synaptic plasticity (t-SP) in nucleus accumbens shell (NAshell), akin to the t-SP measured in the NAcore during cue-induced reinstatement of drug seeking. Using whole cell patch electrophysiology, we found that medium spiny neurons (MSNs) in NAshell expressed increased ratio of AMPA to NMDA glutamate receptor currents during refraining, which normalized to baseline levels by the end of the 2-hour extinction session. Unlike t-SP observed in NAcore during reinstated drug seeking, neither dendrite spine head enlargement nor activation of matrix metalloproteases (MMP2/9) accompanied the increased AMPA:NMDA in NAshell during refraining. Refraining was also not associated with changes in paired pulse ratio, NMDA receptor current decay time, or AMPA receptor rectification index in NAshell MSNs. Our preliminary data in transgenic mice suggest that t-SP may increase D2-MSN inputs relative to D1-MSN inputs.

Drug Refraining and Seeking Potentiate Synapses on Distinct Populations of Accumbens Medium Spiny Neurons.

Cocaine-associated cues and contexts can precipitate drug seeking in humans and in experimental animals. Glutamatergic synapses in the core subcompartment of the nucleus accumbens (NAcore) undergo transient potentiation in response to presenting drug-associated cues. The NAcore contains two populations of medium spiny neurons (MSNs) that differentially express D1 or D2 dopamine receptors. By recording the ratio of AMPA and NMDA glutamate receptor currents (AMPA/NMDA ratio) from MSNs in NAcore tissue slices, we endeavored to understand which subpopulation of MSNs was undergoing transient potentiation. Transgenic female and male mice differentially expressing fluorescent reporters in D1 or D2 MSNs were withdrawn for 2-3 weeks after being trained to self-administer cocaine. In some mice, discrete cocaine-conditioned cues were isolated from the drug-associated context via extinction training, which causes rodents to refrain from drug seeking in the extinguished context. By measuring AMPA/NMDA ratios in the drug context with or without contextual or discrete cues, and with or without extinction training, we made the following three discoveries: (1) mice refraining from cocaine seeking in the extinguished context showed selective elevation in AMPA/NMDA ratios in D2 MSNs; (2) without extinction training, the drug-associated context selectively increased AMPA/NMDA ratios in D1 MSNs; (3) mice undergoing cue-induced cocaine seeking after extinction training in the drug-associated context showed AMPA/NMDA ratio increases in both D1 and D2 MSNs. These findings reveal that the NAcore codes drug seeking through transient potentiation of D1 MSNs, and that refraining from cocaine seeking in an extinguished context is coded through transient potentiation of D2 MSNs.SIGNIFICANCE STATEMENT Relapse is a primary symptom of addiction that can involve competition between the desire to use drugs and the desire to refrain from using drugs. Drug-associated cues induce relapse, which is correlated with transiently potentiated glutamatergic synapses in the nucleus accumbens core. We determined which of two cell populations in the accumbens core, D1-expressing or D2-expressing neurons, undergo transient synaptic potentiation. After being trained to self-administer cocaine, mice underwent withdrawal, some with and others without extinguishing responding in the drug-associated context. Extinguished mice showed transient potentiation in D2-expressing neurons in the extinguished environment, and all mice engaged in context-induced or cue-induced drug seeking showed transient potentiation of D1-expressing neurons. A simple binary engram in accumbens for seeking drugs and refraining from drugs offers opportunities for cell-specific therapies.

Accumbens brain-derived neurotrophic factor (BDNF) transmission inhibits cocaine seeking.

Brain-derived neurotrophic factor (BDNF) regulates a variety of physiological processes, and several studies have explored the role of BDNF in addiction-related brain regions like the nucleus accumbens core (NAcore). We sought to understand the rapid effects of endogenous BDNF on cocaine seeking. Rats were trained to self-administer cocaine and extinguished. We then microinjected two inhibitors of BDNF stimulation of tropomyosin receptor kinase B (TrkB), the non-competitive receptor antagonist ANA-12 and TrkB/Fc, a fusion protein that binds BDNF and prevents TrkB stimulation. Blocking TrkB or inactivating BDNF in NAcore potentiated active lever pressing, showing that endogenous BDNF tone was present and supplying inhibitory tone on cue-induced reinstatement. To determine if exogenous BDNF also negatively regulated reinstatement, BDNF was microinjected into NAcore 15 minutes before cue-induced reinstatement. BDNF decreased cocaine seeking through TrkB receptor binding, but had no effect on inactive lever pressing, spontaneous or cocaine-induced locomotion, or on reinstated sucrose seeking. BDNF-infusion potentiated within trial extinction when microinjected in the NAcore during cue- and context + cue induced reinstatement, and the inhibition of lever pressing lasted at least 3 days post injection. Although decreased reinstatement endured for 3 days when BDNF was administered prior to a reinstatement session, when microinjected before an extinction session or in the home cage, BDNF did not alter subsequent cued-reinstatement. Together, these data show that endogenous BDNF acts on TrKB to provide inhibitory tone on reinstated cocaine seeking, and this effect was recapitulated by exogenous BDNF.

Loss of Plasticity in the D2-Accumbens Pallidal Pathway Promotes Cocaine Seeking.

Distinct populations of D1- and D2-dopamine receptor-expressing medium spiny neurons (D1-/D2-MSNs) comprise the nucleus accumbens, and activity in D1-MSNs promotes, whereas activity in D2-MSNs inhibits, motivated behaviors. We used chemogenetics to extend D1-/D2-MSN cell specific regulation to cue-reinstated cocaine seeking in a mouse model of self-administration and relapse, and found that either increasing activity in D1-MSNs or decreasing activity in D2-MSNs augmented cue-induced reinstatement. Both D1- and D2-MSNs provide substantial GABAergic innervation to the ventral pallidum, and chemogenetic inhibition of ventral pallidal neurons blocked the augmented reinstatement elicited by chemogenetic regulation of either D1- or D2-MSNs. Because D1- and D2-MSNs innervate overlapping populations of ventral pallidal neurons, we next used optogenetics to examine whether changes in synaptic plasticity in D1- versus D2-MSN GABAergic synapses in the ventral pallidum could explain the differential regulation of VP activity. In mice trained to self-administer cocaine, GABAergic LTD was abolished in D2-, but not in D1-MSN synapses. A µ opioid receptor antagonist restored GABA currents in D2-, but not D1-MSN synapses of cocaine-trained mice, indicating that increased enkephalin tone on presynaptic µ opioid receptors was responsible for occluding the LTD. These results identify a behavioral function for D1-MSN innervation of the ventral pallidum, and suggest that losing LTDGABA in D2-MSN, but not D1-MSN input to ventral pallidum may promote cue-induced reinstatement of cocaine-seeking. SIGNIFICANCE STATEMENT: More than 90% of ventral striatum is composed of two cell types, those expressing dopamine D1 or D2 receptors, which exert opposing roles on motivated behavior. Both cell types send GABAergic projections to the ventral pallidum and were found to differentially promote cue-induced reinstatement of cocaine seeking via the ventral pallidum. Furthermore, after cocaine self-administration, synaptic plasticity was selectively lost in D2, but not D1 inputs to the ventral pallidum. The selective impairment in D2 afferents may promote the influence of D1 inputs to drive relapse to cocaine seeking.

Accumbens nNOS Interneurons Regulate Cocaine Relapse.

Relapse to drug use can be initiated by drug-associated cues. The intensity of cue-induced relapse is correlated with the induction of transient synaptic potentiation (t-SP) at glutamatergic synapses on medium spiny neurons (MSNs) in the nucleus accumbens core (NAcore) and requires spillover of glutamate from prefrontal cortical afferents. We used a rodent self-administration/reinstatement model of relapse to show that cue-induced t-SP and reinstated cocaine seeking result from glutamate spillover, initiating a metabotropic glutamate receptor 5 (mGluR5)-dependent increase in nitric oxide (NO) production. Pharmacological stimulation of mGluR5 in NAcore recapitulated cue-induced reinstatement in the absence of drug-associated cues. Using NO-sensitive electrodes, mGluR5 activation by glutamate was shown to stimulate NO production that depended on activation of neuronal nitric oxide synthase (nNOS). nNOS is expressed in ∼1% of NAcore neurons. Using a transgene strategy to express and stimulate designer receptors that mimicked mGluR5 signaling through Gq in nNOS interneurons, we recapitulated cue-induced reinstatement in the absence of cues. Conversely, using a transgenic caspase strategy, the intensity of cue-induced reinstatement was correlated with the extent of selective elimination of nNOS interneurons. The induction of t-SP during cued reinstatement depends on activating matrix metalloproteinases (MMPs) and selective chemogenetic stimulation of nNOS interneurons recapitulated MMP activation and t-SP induction (increase in AMPA currents in MSNs). These data demonstrate critical involvement of a sparse population of nNOS-expressing interneurons in cue-induced cocaine seeking, revealing a bottleneck in brain processing of drug-associated cues where therapeutic interventions could be effective in treating drug addiction. SIGNIFICANCE STATEMENT: Relapse to cocaine use in a rat model is associated with transient increases in synaptic strength at prefrontal cortex synapses in the nucleus accumbens. We demonstrate the sequence of events that mediates synaptic potentiation and reinstated cocaine seeking induced by cocaine-conditioned cues. Activation of prefrontal inputs to the accumbens by cues initiates spillover of synaptic glutamate, which stimulates metabotropic glutamate receptor 5 (mGluR5) on a small population of interneurons (∼1%) expressing neuronal nitric oxide synthase. Stimulating these glutamate receptors increases nitric oxide (NO) production, which stimulates matrix metalloprotease-2 (MMP-2) and MMP-9 activity in the extracellular space. Manipulating the interaction between mGluR5, NO production, or MMP-2 and MMP-9 pharmacologically or genetically is sufficient to recapitulate transient synaptic potentiation and reinstate cocaine seeking.

Ventromedial prefrontal cortex pyramidal cells have a temporal dynamic role in recall and extinction of cocaine-associated memory.

In addicts, associative memories related to the rewarding effects of drugs of abuse can evoke powerful craving and drug seeking urges, but effective treatment to suppress these memories is not available. Detailed insight into the neural circuitry that mediates expression of drug-associated memory is therefore of crucial importance. Substantial evidence from rodent models of addictive behavior points to the involvement of the ventromedial prefrontal cortex (vmPFC) in conditioned drug seeking, but specific knowledge of the temporal role of vmPFC pyramidal cells is lacking. To this end, we used an optogenetics approach to probe the involvement of vmPFC pyramidal cells in expression of a recent and remote conditioned cocaine memory. In mice, we expressed Channelrhodopsin-2 (ChR2) or Halorhodopsin (eNpHR3.0) in pyramidal cells of the vmPFC and studied the effect of activation or inhibition of these cells during expression of a cocaine-contextual memory on days 1-2 (recent) and ∼3 weeks (remote) after conditioning. Whereas optical activation of pyramidal cells facilitated extinction of remote memory, without affecting recent memory, inhibition of pyramidal cells acutely impaired recall of recent cocaine memory, without affecting recall of remote memory. In addition, we found that silencing pyramidal cells blocked extinction learning at the remote memory time-point. We provide causal evidence of a critical time-dependent switch in the contribution of vmPFC pyramidal cells to recall and extinction of cocaine-associated memory, indicating that the circuitry that controls expression of cocaine memories reorganizes over time.

The psychedelic drug DOI reduces heroin motivation by targeting 5-HT2A receptors in a heroin and alcohol co-use model.

There has been a recent renewed interest in the potential use of psychedelic drugs as therapeutics for certain neuropsychiatric disorders, including substance use disorders. The psychedelic drug 2,5-dimethoxy-4-iodoamphetamine (DOI) has demonstrated therapeutic efficacy in preclinical models of opioid use disorder (OUD). Alcohol is commonly co-used in individuals with OUD, but preclinical models that recapitulate this comorbidity are lacking. We developed a polydrug model wherein male and female rats were allowed to self-administer intravenous heroin and oral alcohol (or saccharin control solution) over weeks of behavioral training, and then we conducted a series of progressive ratio tests to assess the animals' motivational state for heroin and alcohol. In this model, motivation for heroin is higher than alcohol, and DOI (0.4 mg/kg) administered prior to testing significantly reduced heroin motivation measured as the animals' break point, or maximum effort the animal is willing to expend to obtain a single infusion of heroin. The 5-HT2A receptor antagonist MDL 100,907 (0.3 mg/kg), but not the 5-HT2C receptor antagonist SB-242084 (0.5 mg/kg), blocked the therapeutic effect of DOI on heroin motivation. No significant effects on alcohol break points were observed, nor did MDL 100,907 or SB-242084 have any effect on break points on their own. These data support the view that psychedelic drugs like DOI may have therapeutic effects on opioid use in individuals with OUD and comorbid alcohol use, by acting as a 5-HT2A receptor agonist.