The Recruitment of a Neuronal Ensemble in the Central Nucleus of the Amygdala During the First Extinction Episode Has Persistent Effects on Extinction Expression.

BACKGROUND: Adaptive behavior depends on the delicate and dynamic balance between acquisition and extinction memories. Disruption of this balance, particularly when the extinction of memory loses control over behavior, is the root of treatment failure of maladaptive behaviors such as substance abuse or anxiety disorders. Understanding this balance requires a better understanding of the underlying neurobiology and its contribution to behavioral regulation. METHODS: We microinjected Daun02 in Fos-lacZ transgenic rats following a single extinction training episode to delete extinction-recruited neuronal ensembles in the basolateral amygdala (BLA) and central nucleus of the amygdala (CN) and examined their contribution to behavior in an appetitive Pavlovian task. In addition, we used immunohistochemistry and neuronal staining methods to identify the molecular markers of activated neurons in the BLA and CN during extinction learning or retrieval. RESULTS: CN neurons were preferentially engaged following extinction, and deletion of these extinction-activated ensembles in the CN but not the BLA impaired the retrieval of extinction despite additional extinction training and promoted greater levels of behavioral restoration in spontaneous recovery and reinstatement. Disrupting extinction processing in the CN in turn increased activity in the BLA. Our results also show a specific role for CN PKCδ+ neurons in behavioral inhibition but not during initial extinction learning. CONCLUSIONS: We showed that the initial extinction-recruited CN ensemble is critical to the acquisition-extinction balance and that greater behavioral restoration does not mean weaker extinction contribution. These findings provide a novel avenue for thinking about the neural mechanisms of extinction and for developing treatments for cue-triggered appetitive behaviors.

Linking drug and food addiction via compulsive appetite.

BACKGROUND AND PURPOSE: 'Food addiction' is the subject of intense public and research interest. However, this nosology based on neurobehavioural similarities among obese individuals, patients with eating disorders and those with substance use disorders (drug addiction) remains controversial. We thus sought to determine which aspects of disordered eating are causally linked to preclinical models of drug addiction. We hypothesized that extensive drug histories, known to cause addiction-like brain changes and drug motivation in rats, would also cause addiction-like food motivation. EXPERIMENTAL APPROACH: Rats underwent extensive cocaine, alcohol, caffeine or obesogenic diet histories and were subsequently tested for punishment-resistant food self-administration or 'compulsive appetite', as a measure of addiction-like food motivation. KEY RESULTS: Extensive cocaine and alcohol (but not caffeine) histories caused compulsive appetite that persisted long after the last drug exposure. Extensive obesogenic diet histories also caused compulsive appetite, although neither cocaine nor alcohol histories caused excess calorie intake and bodyweight during abstinence. Hence, compulsive appetite and obesity appear to be dissociable, with the former sharing common mechanisms with preclinical drug addiction models. CONCLUSION AND IMPLICATIONS: Compulsive appetite, as seen in subsets of obese individuals and patients with binge-eating disorder and bulimia nervosa (eating disorders that do not necessarily result in obesity), appears to epitomize 'food addiction'. Because different drug and obesogenic diet histories caused compulsive appetite, overlapping dysregulations in the reward circuits, which control drug and food motivation independently of energy homeostasis, may offer common therapeutic targets for treating addictive behaviours across drug addiction, eating disorders and obesity.

Acute, but not longer-term, exposure to environmental enrichment attenuates Pavlovian cue-evoked conditioned approach and Fos expression in the prefrontal cortex in mice.

Exposure to environmental enrichment can modify the impact of motivationally relevant stimuli. For instance, previous studies in rats have found that even a brief, acute (~1 day), but not chronic, exposure to environmentally enriched (EE) housing attenuates instrumental lever pressing for sucrose-associated cues in a conditioned reinforcement setup. Moreover, acute EE reduces corticoaccumbens activity, as measured by decreases in expression of the neuronal activity marker "Fos." Currently, it is not known whether acute EE also reduces sucrose seeking and corticoaccumbens activity elicited by non-contingent or "forced" exposure to sucrose cues, which more closely resembles cue exposure encountered in daily life. We therefore measured the effects of acute/intermittent (1 day or 6 day of EE prior to test day) versus chronic (EE throughout conditioning lasting until test day) EE on the ability of a Pavlovian sucrose cue to elicit sucrose seeking (conditioned approach) and Fos expression in the medial prefrontal cortex (mPFC), orbitofrontal cortex (OFC), and nucleus accumbens (NAc) in mice. One day, but not 6 day or chronic EE , reduced sucrose seeking and Fos in the deep layers of the dorsal mPFC. By contrast, 1 day, 6 day, and chronic EE all reduced Fos in the shallow layers of the OFC. None of the EE manipulations modulated NAc Fos expression. We reveal how EE reduces behavioral reactivity to sucrose cues by reducing activity in select prefrontal cortical brain areas. Our work further demonstrates the robustness of EE in its ability to modulate various forms of reward-seeking across species.

Extinction of cue-evoked food-seeking recruits a GABAergic interneuron ensemble in the dorsal medial prefrontal cortex of mice.

Animals must quickly adapt food-seeking strategies to locate nutrient sources in dynamically changing environments. Learned associations between food and environmental cues that predict its availability promote food-seeking behaviors. However, when such cues cease to predict food availability, animals undergo "extinction" learning, resulting in the inhibition of food-seeking responses. Repeatedly activated sets of neurons, or "neuronal ensembles," in the dorsal medial prefrontal cortex (dmPFC) are recruited following appetitive conditioning and undergo physiological adaptations thought to encode cue-reward associations. However, little is known about how the recruitment and intrinsic excitability of such dmPFC ensembles are modulated by extinction learning. Here, we used in vivo 2-Photon imaging in male Fos-GFP mice that express green fluorescent protein (GFP) in recently behaviorally activated neurons to determine the recruitment of activated pyramidal and GABAergic interneuron dmPFC ensembles during extinction. During extinction, we revealed a persistent activation of a subset of interneurons which emerged from a wider population of interneurons activated during the initial extinction session. This activation pattern was not observed in pyramidal cells, and extinction learning did not modulate the excitability properties of activated pyramidal cells. Moreover, extinction learning reduced the likelihood of reactivation of pyramidal cells activated during the initial extinction session. Our findings illuminate novel neuronal activation patterns in the dmPFC underlying extinction of food-seeking, and in particular, highlight an important role for interneuron ensembles in this inhibitory form of learning.

Distinct Populations of Neurons Activated by Heroin and Cocaine in the Striatum as Assessed by catFISH.

Despite the still prevailing notion of a shared substrate of action for all addictive drugs, there is evidence suggesting that opioid and psychostimulant drugs differ substantially in terms of their neurobiological and behavioral effects. These differences may reflect separate neural circuits engaged by the two drugs. Here we used the catFISH (cellular compartment analysis of temporal activity by fluorescence in situ hybridization) technique to investigate the degree of overlap between neurons engaged by heroin versus cocaine in adult male Sprague Dawley rats. The catFISH technique is a within-subject procedure that takes advantage of the different transcriptional time course of the immediate-early genes homer 1a and arc to determine to what extent two stimuli separated by an interval of 25 min engage the same neuronal population. We found that throughout the striatal complex the neuronal populations activated by noncontingent intravenous injections of cocaine (800 µg/kg) and heroin (100 and 200 µg/kg), administered at an interval of 25 min from each other, overlapped to a much lesser extent than in the case of two injections of cocaine (800 µg/kg), also 25 min apart. The greatest reduction in overlap between populations activated by cocaine and heroin was in the dorsomedial and dorsolateral striatum (∼30% and ∼22%, respectively, of the overlap observed for the sequence cocaine-cocaine). Our results point toward a significant separation between neuronal populations activated by heroin and cocaine in the striatal complex. We propose that our findings are a proof of concept that these two drugs are encoded differently in a brain area believed to be a common neurobiological substrate to drug abuse.

The Emergence of a Stable Neuronal Ensemble from a Wider Pool of Activated Neurons in the Dorsal Medial Prefrontal Cortex during Appetitive Learning in Mice.

Animals selectively respond to environmental cues associated with food reward to optimize nutrient intake. Such appetitive conditioned stimulus-unconditioned stimulus (CS-US) associations are thought to be encoded in select, stable neuronal populations or neuronal ensembles, which undergo physiological modifications during appetitive conditioning. These ensembles in the medial prefrontal cortex (mPFC) control well-established, cue-evoked food seeking, but the mechanisms involved in the genesis of these ensembles are unclear. Here, we used male Fos-GFP mice that express green fluorescent protein (GFP) in recently behaviorally activated neurons, to reveal how dorsal mPFC neurons are recruited and modified to encode CS-US memory representations using an appetitive conditioning task. In the initial conditioning session, animals did not exhibit discriminated, cue-selective food seeking, but did so in later sessions indicating that a CS-US association was established. Using microprism-based in vivo 2-Photon imaging, we revealed that only a minority of neurons activated during the initial session was consistently activated throughout subsequent conditioning sessions and during cue-evoked memory recall. Notably, using ex vivo electrophysiology, we found that neurons activated following the initial session exhibited transient hyperexcitability. Chemogenetically enhancing the excitability of these neurons throughout subsequent conditioning sessions interfered with the development of reliable cue-selective food seeking, indicated by persistent, nondiscriminated performance. We demonstrate how appetitive learning consistently activates a subset of neurons to form a stable neuronal ensemble during the formation of a CS-US association. This ensemble may arise from a pool of hyperexcitable neurons activated during the initial conditioning session.SIGNIFICANCE STATEMENT Appetitive conditioning endows cues associated with food with the ability to guide food-seeking, through the formation of a food-cue association. Neuronal ensembles in the mPFC control established cue-evoked food-seeking. However, how neurons undergo physiological modifications and become part of an ensemble during conditioning remain unclear. We found that only a minority of dorsal mPFC neurons activated on the initial conditioning session became consistently activated during conditioning and memory recall. These initially activated neurons were also transiently hyperexcitable. We demonstrate the following: (1) how stable neuronal ensemble formation in the dorsal mPFC underlies appetitive conditioning; and (2) how this ensemble may arise from hyperexcitable neurons activated before the establishment of cue-evoked food seeking.

Reward Devaluation Attenuates Cue-Evoked Sucrose Seeking and Is Associated with the Elimination of Excitability Differences between Ensemble and Non-ensemble Neurons in the Nucleus Accumbens.

Animals must learn relationships between foods and the environmental cues that predict their availability for survival. Such cue-food associations are encoded in sparse sets of neurons or "neuronal ensembles" in the nucleus accumbens (NAc). For these ensemble-encoded, cue-controlled appetitive responses to remain adaptive, they must allow for their dynamic updating depending on acute changes in internal states such as physiological hunger or the perceived desirability of food. However, how these neuronal ensembles are recruited and physiologically modified following the update of such learned associations is unclear. To investigate this, we examined the effects of devaluation on ensemble plasticity at the levels of recruitment, intrinsic excitability, and synaptic physiology in sucrose-conditioned Fos-GFP mice that express green fluorescent protein (GFP) in recently activated neurons. Neuronal ensemble activation patterns and their physiology were examined using immunohistochemistry and slice electrophysiology, respectively. Reward-specific devaluation following 4 d of ad libitum sucrose consumption, but not general caloric devaluation, attenuated cue-evoked sucrose seeking. This suggests that changes in the hedonic and/or incentive value of sucrose, and not caloric need, drove this behavior. Moreover, devaluation attenuated the size of the neuronal ensemble recruited by the cue in the NAc shell. Finally, it eliminated the relative enhanced excitability of ensemble (GFP+) neurons against non-ensemble (GFP-) neurons observed under non-devalued conditions, and did not induce any ensemble-specific changes in excitatory synaptic physiology. Our findings provide new insights into neuronal ensemble mechanisms that underlie the changes in the incentive and/or hedonic impact of cues that support adaptive food seeking.

Anti-relapse neurons in the infralimbic cortex of rats drive relapse-suppression by drug omission cues.

Drug addiction is a chronic relapsing disorder of compulsive drug use. Studies of the neurobehavioral factors that promote drug relapse have yet to produce an effective treatment. Here we take a different approach and examine the factors that suppress-rather than promote-relapse. Adapting Pavlovian procedures to suppress operant drug response, we determined the anti-relapse action of environmental cues that signal drug omission (unavailability) in rats. Under laboratory conditions linked to compulsive drug use and heightened relapse risk, drug omission cues suppressed three major modes of relapse-promotion (drug-predictive cues, stress, and drug exposure) for cocaine and alcohol. This relapse-suppression is, in part, driven by omission cue-reactive neurons, which constitute small subsets of glutamatergic and GABAergic cells, in the infralimbic cortex. Future studies of such neural activity-based cellular units (neuronal ensembles/memory engram cells) for relapse-suppression can be used to identify alternate targets for addiction medicine through functional characterization of anti-relapse mechanisms.

Regional Differences in Striatal Neuronal Ensemble Excitability Following Cocaine and Extinction Memory Retrieval in Fos-GFP Mice.

Learned associations between drugs of abuse and the drug administration environment have an important role in addiction. In rodents, exposure to a drug-associated environment elicits conditioned psychomotor activation, which may be weakened following extinction (EXT) learning. Although widespread drug-induced changes in neuronal excitability have been observed, little is known about specific changes within neuronal ensembles activated during the recall of drug-environment associations. Using a cocaine-conditioned locomotion (CL) procedure, the present study assessed the excitability of neuronal ensembles in the nucleus accumbens core and shell (NAccore and NAcshell), and dorsal striatum (DS) following cocaine conditioning and EXT in Fos-GFP mice that express green fluorescent protein (GFP) in activated neurons (GFP+). During conditioning, mice received repeated cocaine injections (20 mg/kg) paired with a locomotor activity chamber (Paired) or home cage (Unpaired). Seven to 13 days later, both groups were re-exposed to the activity chamber under drug-free conditions and Paired, but not Unpaired, mice exhibited CL. In a separate group of mice, CL was extinguished by repeatedly exposing mice to the activity chamber under drug-free conditions. Following the expression and EXT of CL, GFP+ neurons in the NAccore (but not NAcshell and DS) displayed greater firing capacity compared to surrounding GFP- neurons. This difference in excitability was due to a generalized decrease in GFP- excitability following CL and a selective increase in GFP+ excitability following its EXT. These results suggest a role for both widespread and ensemble-specific changes in neuronal excitability following recall of drug-environment associations.

Changes in Appetitive Associative Strength Modulates Nucleus Accumbens, But Not Orbitofrontal Cortex Neuronal Ensemble Excitability.

Cues that predict the availability of food rewards influence motivational states and elicit food-seeking behaviors. If a cue no longer predicts food availability, then animals may adapt accordingly by inhibiting food-seeking responses. Sparsely activated sets of neurons, coined "neuronal ensembles," have been shown to encode the strength of reward-cue associations. Although alterations in intrinsic excitability have been shown to underlie many learning and memory processes, little is known about these properties specifically on cue-activated neuronal ensembles. We examined the activation patterns of cue-activated orbitofrontal cortex (OFC) and nucleus accumbens (NAc) shell ensembles using wild-type and Fos-GFP mice, which express green fluorescent protein (GFP) in activated neurons, after appetitive conditioning with sucrose and extinction learning. We also investigated the neuronal excitability of recently activated, GFP+ neurons in these brain areas using whole-cell electrophysiology in brain slices. Exposure to a sucrose cue elicited activation of neurons in both the NAc shell and OFC. In the NAc shell, but not the OFC, these activated GFP+ neurons were more excitable than surrounding GFP- neurons. After extinction, the number of neurons activated in both areas was reduced and activated ensembles in neither area exhibited altered excitability. These data suggest that learning-induced alterations in the intrinsic excitability of neuronal ensembles is regulated dynamically across different brain areas. Furthermore, we show that changes in associative strength modulate the excitability profile of activated ensembles in the NAc shell.SIGNIFICANCE STATEMENT Sparsely distributed sets of neurons called "neuronal ensembles" encode learned associations about food and cues predictive of its availability. Widespread changes in neuronal excitability have been observed in limbic brain areas after associative learning, but little is known about the excitability changes that occur specifically on neuronal ensembles that encode appetitive associations. Here, we reveal that sucrose cue exposure recruited a more excitable ensemble in the nucleus accumbens, but not orbitofrontal cortex, compared with their surrounding neurons. This excitability difference was not observed when the cue's salience was diminished after extinction learning. These novel data provide evidence that the intrinsic excitability of appetitive memory-encoding ensembles is regulated differentially across brain areas and adapts dynamically to changes in associative strength.

Distinct memory engrams in the infralimbic cortex of rats control opposing environmental actions on a learned behavior.

Conflicting evidence exists regarding the role of infralimbic cortex (IL) in the environmental control of appetitive behavior. Inhibition of IL, irrespective of its intrinsic neural activity, attenuates not only the ability of environmental cues predictive of reward availability to promote reward seeking, but also the ability of environmental cues predictive of reward omission to suppress this behavior. Here we report that such bidirectional behavioral modulation in rats is mediated by functionally distinct units of neurons (neural ensembles) that are concurrently localized within the same IL brain area but selectively reactive to different environmental cues. Ensemble-specific neural activity is thought to function as a memory engram representing a learned association between environment and behavior. Our findings establish the causal evidence for the concurrent existence of two distinct engrams within a single brain site, each mediating opposing environmental actions on a learned behavior.

Daun02 Inactivation of Behaviorally Activated Fos-Expressing Neuronal Ensembles.

Learned associations about salient experiences (e.g., drug exposure, stress) and their associated environmental stimuli are mediated by a minority of sparsely distributed, behaviorally activated neurons coined 'neuronal ensembles.' For many years, it was not known whether these neuronal ensembles played causal roles in mediating learned behaviors. However, in the last several years the 'Daun02 inactivation technique' in Fos-lacZ transgenic rats has proved very useful in establishing causal links between neuronal ensembles that express the activity-regulated protein Fos and learned behaviors. Fos-expressing neurons in these rats also express the bacterial protein ß-galactosidase (ß-gal) in strongly activated neurons. When the prodrug Daun02 is injected into the brains of these rats 90 min after a behavior (e.g., drug-seeking) or cue exposure, then Daun02 is converted into daunorubicin by ß-gal, which selectively inactivates Fos- and ß-gal-expressing neurons that were activated 90 min before the Daun02 injection. This unit presents protocols for breeding the Fos-lacZ rats and conducting appropriate Daun02 inactivation experiments. © 2016 by John Wiley & Sons, Inc.

New technologies for examining the role of neuronal ensembles in drug addiction and fear.

Correlational data suggest that learned associations are encoded within neuronal ensembles. However, it has been difficult to prove that neuronal ensembles mediate learned behaviours because traditional pharmacological and lesion methods, and even newer cell type-specific methods, affect both activated and non-activated neurons. In addition, previous studies on synaptic and molecular alterations induced by learning did not distinguish between behaviourally activated and non-activated neurons. Here, we describe three new approaches--Daun02 inactivation, FACS sorting of activated neurons and Fos-GFP transgenic rats--that have been used to selectively target and study activated neuronal ensembles in models of conditioned drug effects and relapse. We also describe two new tools--Fos-tTA transgenic mice and inactivation of CREB-overexpressing neurons--that have been used to study the role of neuronal ensembles in conditioned fear.

Silent synapses in selectively activated nucleus accumbens neurons following cocaine sensitization.

Cocaine-induced alterations in synaptic glutamate function in nucleus accumbens are thought to mediate drug-related behaviors such as psychomotor sensitization. However, previous studies have examined global alterations in randomly selected accumbens neurons regardless of their activation state during cocaine-induced behavior. We recently found that a minority of strongly activated Fos-expressing accumbens neurons are necessary for cocaine-induced psychomotor sensitization, whereas the majority of accumbens neurons are less directly involved. We assessed synaptic alterations in these strongly activated accumbens neurons in Fos-GFP mice, which express a fusion protein of Fos and GFP in strongly activated neurons, and compared these alterations with those in surrounding non-activated neurons. Cocaine sensitization produced higher levels of 'silent synapses', which contained functional NMDA receptors and nonfunctional AMPA receptors only in GFP-positive neurons, 6-11 d after sensitization. Thus, distinct synaptic alterations are induced in the most strongly activated accumbens neurons that mediate psychomotor sensitization.

Medial prefrontal cortex neuronal activation and synaptic alterations after stress-induced reinstatement of palatable food seeking: a study using c-fos-GFP transgenic female rats.

Relapse to maladaptive eating habits during dieting is often provoked by stress and there is evidence for a role of ovarian hormones in stress responses and feeding. We studied the role of these hormones in stress-induced reinstatement of food seeking and medial prefrontal cortex (mPFC) neuronal activation in c-fos-GFP transgenic female rats, which express GFP in strongly activated neurons. Food-restricted ovariectomized or sham-operated c-fos-GFP rats were trained to lever-press for palatable food pellets. Subsequently, lever-pressing was extinguished and reinstatement of food seeking and mPFC neuronal activation was assessed after injections of the pharmacological stressor yohimbine (0.5-2 mg/kg) or pellet priming (1-4 noncontingent pellets). Estrous cycle effects on reinstatement were also assessed in wild-type rats. Yohimbine- and pellet-priming-induced reinstatement was associated with Fos and GFP induction in mPFC; both reinstatement and neuronal activation were minimally affected by ovarian hormones in both c-fos-GFP and wild-type rats. c-fos-GFP transgenic rats were then used to assess glutamatergic synaptic alterations within activated GFP-positive and nonactivated GFP-negative mPFC neurons following yohimbine-induced reinstatement of food seeking. This reinstatement was associated with reduced AMPA receptor/NMDA receptor current ratios and increased paired-pulse facilitation in activated GFP-positive but not GFP-negative neurons. While ovarian hormones do not appear to play a role in stress-induced relapse of food seeking in our rat model, this reinstatement was associated with unique synaptic alterations in strongly activated mPFC neurons. Our paper introduces the c-fos-GFP transgenic rat as a new tool to study unique synaptic changes in activated neurons during behavior.