Devaluation of response-produced safety signals reveals circuits for goal-directed versus habitual avoidance in dorsal striatum.

Active avoidance responses (ARs) are instrumental behaviors that prevent harm. Adaptive ARs may contribute to active coping, whereas maladaptive avoidance habits are implicated in anxiety and obsessive-compulsive disorders. The AR learning mechanism has remained elusive, as successful avoidance trials produce no obvious reinforcer. We used a novel outcome-devaluation procedure in rats to show that ARs are positively reinforced by response-produced feedback (FB) cues that develop into safety signals during training. Males were sensitive to FB-devaluation after moderate training, but not overtraining, consistent with a transition from goal-directed to habitual avoidance. Using chemogenetics and FB-devaluation, we also show that goal-directed vs. habitual ARs depend on dorsomedial vs. dorsolateral striatum, suggesting a significant overlap between the mechanisms of avoidance and rewarded instrumental behavior. Females were insensitive to FB-devaluation due to a remarkable context-dependence of counterconditioning. However, degrading the AR-FB contingency suggests that both sexes rely on safety signals to perform goal-directed ARs.

Reducing shock imminence eliminates poor avoidance in rats.

In signaled active avoidance (SigAA), rats learn to suppress Pavlovian freezing and emit actions to remove threats and prevent footshocks. SigAA is critical for understanding aversively motivated instrumental behavior and anxiety-related active coping. However, with standard protocols ∼25% of rats exhibit high freezing and poor avoidance. This has dampened enthusiasm for the paradigm and stalled progress. We demonstrate that reducing shock imminence with long-duration warning signals leads to greater freezing suppression and perfect avoidance in all subjects. This suggests that instrumental SigAA mechanisms evolved to cope with distant harm and protocols that promote inflexible Pavlovian reactions are poorly designed to study avoidance.

A brainstem-central amygdala circuit underlies defensive responses to learned threats.

Norepinephrine (NE) plays a central role in the acquisition of aversive learning via actions in the lateral nucleus of the amygdala (LA) [1, 2]. However, the function of NE in expression of aversively-conditioned responses has not been established. Given the role of the central nucleus of the amygdala (CeA) in the expression of such behaviors [3-5], and the presence of NE axons projections in this brain nucleus [6], we assessed the effects of NE activity in the CeA on behavioral expression using receptor-specific pharmacology and cell- and projection-specific chemogenetic manipulations. We found that inhibition and activation of locus coeruleus (LC) neurons decreases and increases freezing to aversively conditioned cues, respectively. We then show that locally inhibiting or activating LC terminals in CeA is sufficient to achieve this bidirectional modulation of defensive reactions. These findings support the hypothesis that LC projections to CeA are critical for the expression of defensive responses elicited by conditioned threats.

A principled method to identify individual differences and behavioral shifts in signaled active avoidance.

Signaled active avoidance (SigAA) is the key experimental procedure for studying the acquisition of instrumental responses toward conditioned threat cues. Traditional analytic approaches (e.g., general linear model) often obfuscate important individual differences, although individual differences in learned responses characterize both animal and human learning data. However, individual differences models (e.g., latent growth curve modeling) typically require large samples and onerous computational methods. Here, we present an analytic methodology that enables the detection of individual differences in SigAA performance at a high accuracy, even when a single animal is included in the data set (i.e., n = 1 level). We further show an online software that enables the easy application of our method to any SigAA data set.

Noradrenergic Regulation of Central Amygdala in Aversive Pavlovian-to-Instrumental Transfer.

The neural mechanisms through which a Pavlovian conditioned stimulus (CS) elicits innate defense responses are well understood. But a Pavlovian CS can also invigorate ongoing instrumental responding, as shown by studies of aversive Pavlovian-to-instrumental transfer (PIT). While the neural circuitry of appetitive PIT has been studied extensively, little is known about the brain mechanisms of aversive PIT. We recently showed the central amygdala (CeA) is essential for aversive PIT. In the current studies, using pharmacology and designer receptors in rodents, we demonstrate that noradrenergic (NE) activity negatively regulates PIT via brainstem locus coeruleus (LC) activity and LC projections to CeA. Our results provide evidence for a novel pathway through which response modulation occurs between brainstem neuromodulatory systems and CeA to invigorate adaptive behavior in the face of threat.

Characterization of the amplificatory effect of norepinephrine in the acquisition of Pavlovian threat associations.

The creation of auditory threat Pavlovian memory requires an initial learning stage in which a neutral conditioned stimulus (CS), such as a tone, is paired with an aversive one (US), such as a shock. In this phase, the CS acquires the capacity of predicting the occurrence of the US and therefore elicits conditioned defense responses. Norepinephrine (NE), through ß-adrenergic receptors in the amygdala, enhances threat memory by facilitating the acquisition of the CS-US association, but the nature of this effect has not been described. Here we show that NE release, induced by the footshock of the first conditioning trial, promotes the subsequent enhancement of learning. Consequently, blocking NE transmission disrupts multitrial but not one-trial conditioning. We further found that increasing the time between the conditioning trials eliminates the amplificatory effect of NE. Similarly, an unsignaled footshock delivered in a separate context immediately before conditioning can enhance learning. These results help define the conditions under which NE should and should not be expected to alter threat processing and fill an important gap in the understanding of the neural processes relevant to the pathophysiology of stress and anxiety disorders.

Primary auditory cortex regulates threat memory specificity.

Distinguishing threatening from nonthreatening stimuli is essential for survival and stimulus generalization is a hallmark of anxiety disorders. While auditory threat learning produces long-lasting plasticity in primary auditory cortex (Au1), it is not clear whether such Au1 plasticity regulates memory specificity or generalization. We used muscimol infusions in rats to show that discriminatory threat learning requires Au1 activity specifically during memory acquisition and retrieval, but not during consolidation. Memory specificity was similarly disrupted by infusion of PKMζ inhibitor peptide (ZIP) during memory storage. Our findings show that Au1 is required at critical memory phases and suggest that Au1 plasticity enables stimulus discrimination.

ß-Adrenergic Receptors Regulate the Acquisition and Consolidation Phases of Aversive Memory Formation Through Distinct, Temporally Regulated Signaling Pathways.

Memory formation requires the temporal coordination of molecular events and cellular processes following a learned event. During Pavlovian threat (fear) conditioning (PTC), sensory and neuromodulatory inputs converge on post-synaptic neurons within the lateral nucleus of the amygdala (LA). By activating an intracellular cascade of signaling molecules, these G-protein-coupled neuromodulatory receptors are capable of recruiting a diverse profile of plasticity-related proteins. Here we report that norepinephrine, through its actions on ß-adrenergic receptors (ßARs), modulates aversive memory formation following PTC through two molecularly and temporally distinct signaling mechanisms. Specifically, using behavioral pharmacology and biochemistry in adult rats, we determined that ßAR activity during, but not after PTC training initiates the activation of two plasticity-related targets: AMPA receptors (AMPARs) for memory acquisition and short-term memory and extracellular regulated kinase (ERK) for consolidating the learned association into a long-term memory. These findings reveal that ßAR activity during, but not following PTC sets in motion cascading molecular events for the acquisition (AMPARs) and subsequent consolidation (ERK) of learned associations.

The Neural Foundations of Reaction and Action in Aversive Motivation.

Much of the early research in aversive learning concerned motivation and reinforcement in avoidance conditioning and related paradigms. When the field transitioned toward the focus on Pavlovian threat conditioning in isolation, this paved the way for the clear understanding of the psychological principles and neural and molecular mechanisms responsible for this type of learning and memory that has unfolded over recent decades. Currently, avoidance conditioning is being revisited, and with what has been learned about associative aversive learning, rapid progress is being made. We review, below, the literature on the neural substrates critical for learning in instrumental active avoidance tasks and conditioned aversive motivation.

Serotonin (5-HT) 5-HT2A Receptor (5-HT2AR):5-HT2CR Imbalance in Medial Prefrontal Cortex Associates with Motor Impulsivity.

A feature of multiple neuropsychiatric disorders is motor impulsivity. Recent studies have implicated serotonin (5-HT) systems in medial prefrontal cortex (mPFC) in mediating individual differences in motor impulsivity, notably the 5-HT2AR receptor (5-HT2AR) and 5-HT2CR. We investigated the hypothesis that differences in the ratio of 5-HT2AR:5-HT2CR protein expression in mPFC would predict the individual level of motor impulsivity and that the engineered loss of the 5-HT2CR would result in high motor impulsivity concomitant with elevated 5-HT2AR expression and pharmacological sensitivity to the selective 5-HT2AR antagonist M100907. High and low impulsive rats were identified in a 1-choice serial reaction time task. Native protein levels of the 5-HT2AR and the 5-HT2CR predicted the intensity of motor impulsivity and the 5-HT2AR:5-HT2CR ratio in mPFC positively correlated with levels of premature responses in individual outbred rats. The possibility that the 5-HT2AR and 5-HT2CR act in concert to control motor impulsivity is supported by the observation that high phenotypic motor impulsivity associated with a diminished mPFC synaptosomal 5-HT2AR:5-HT2CR protein:protein interaction. Knockdown of mPFC 5-HT2CR resulted in increased motor impulsivity and triggered a functional disruption of the local 5-HT2AR:5-HT2CR balance as evidenced by a compensatory upregulation of 5-HT2AR protein expression and a leftward shift in the potency of M100907 to suppress impulsive behavior. We infer that there is an interactive relationship between the mPFC 5-HT2AR and 5-HT2CR, and that a 5-HT2AR:5-HT2CR imbalance may be a functionally relevant mechanism underlying motor impulsivity.

Active avoidance requires a serial basal amygdala to nucleus accumbens shell circuit.

Freezing is a species-typical defensive reaction to conditioned threats. While the neural circuitry of aversive Pavlovian behavior has been extensively studied, less is known about the circuitry underlying more active responses to danger. Here we show that the flow of information between the basal amygdala (BA) and the nucleus accumbens (NAcc) is necessary for signaled active avoidance behavior. Rats trained to avoid shock by shuttling during an auditory conditioned stimulus showed increased expression of the activity-dependent protein c-Fos in the NAcc, specifically the shell subregion (NAccSh). Silencing neural activity in the NAccSh, but not in the adjacent NAcc core, disrupted avoidance behavior. Disconnection of the BA and the NAccSh was just as effective at disrupting avoidance behavior as bilateral NAccSh inactivations, suggesting learned avoidance behavior requires an intact BA-NAccSh circuit. Together, these data highlight an essential role for the amygdalar projection to the ventral striatum in aversively motivated actions.

Molecular mechanisms of threat learning in the lateral nucleus of the amygdala.

Pavlovian threat conditioning is a behavioral paradigm that has been successfully utilized to define the mechanisms underlying threat (fear) memory formation. The amygdala is a temporal lobe structure required for the acquisition, consolidation, and expression of threat (fear) memories. In particular, the lateral nucleus of the amygdala (LA) is the major input structure of the amygdala and is required for all aspects of threat learning and memory. The LA expresses many neurotransmitter and neuromodulator receptors. This chapter covers the molecular mechanisms that occur downstream of these receptors and how they influence LA-dependent Pavlovian threat learning.

Functional status of the serotonin 5-HT2C receptor (5-HT2CR) drives interlocked phenotypes that precipitate relapse-like behaviors in cocaine dependence.

Relapse vulnerability in cocaine dependence is rooted in genetic and environmental determinants, and propelled by both impulsivity and the responsivity to cocaine-linked cues ('cue reactivity'). The serotonin (5-hydroxytryptamine, 5-HT) 5-HT2C receptor (5-HT2CR) within the medial prefrontal cortex (mPFC) is uniquely poised to serve as a strategic nexus to mechanistically control these behaviors. The 5-HT2CR functional capacity is regulated by a number of factors including availability of active membrane receptor pools, the composition of the 5-HT2CR macromolecular protein complex, and editing of the 5-HT2CR pre-mRNA. The one-choice serial reaction time (1-CSRT) task was used to identify impulsive action phenotypes in an outbred rat population before cocaine self-administration and assessment of cue reactivity in the form of lever presses reinforced by the cocaine-associated discrete cue complex during forced abstinence. The 1-CSRT task reliably and reproducibly identified high impulsive (HI) and low impulsive (LI) action phenotypes; HI action predicted high cue reactivity. Lower cortical 5-HT2CR membrane protein levels concomitant with higher levels of 5-HT2CR:postsynaptic density 95 complex distinguished HI rats from LI rats. The frequency of edited 5-HT2CR mRNA variants was elevated with the prediction that the protein population in HI rats favors those isoforms linked to reduced signaling capacity. Genetic loss of the mPFC 5-HT2CR induced aggregate impulsive action/cue reactivity, suggesting that depressed cortical 5-HT2CR tone confers vulnerability to these interlocked behaviors. Thus, impulsive action and cue reactivity appear to neuromechanistically overlap in rodents, with the 5-HT2CR functional status acting as a neural rheostat to regulate, in part, the intersection between these vulnerability behaviors.

Orexin/hypocretin system modulates amygdala-dependent threat learning through the locus coeruleus.

Survival in a dangerous environment requires learning about stimuli that predict harm. Although recent work has focused on the amygdala as the locus of aversive memory formation, the hypothalamus has long been implicated in emotional regulation, and the hypothalamic neuropeptide orexin (hypocretin) is involved in anxiety states and arousal. Nevertheless, little is known about the role of orexin in aversive memory formation. Using a combination of behavioral pharmacology, slice physiology, and optogenetic techniques, we show that orexin acts upstream of the amygdala via the noradrenergic locus coeruleus to enable threat (fear) learning, specifically during the aversive event. Our results are consistent with clinical studies linking orexin levels to aversive learning and anxiety in humans and dysregulation of the orexin system may contribute to the etiology of fear and anxiety disorders.

Active vs. reactive threat responding is associated with differential c-Fos expression in specific regions of amygdala and prefrontal cortex.

Active avoidance (AA) is an important paradigm for studying mechanisms of aversive instrumental learning, pathological anxiety, and active coping. Unfortunately, AA neurocircuits are poorly understood, partly because behavior is highly variable and reflects a competition between Pavlovian reactions and instrumental actions. Here we exploited the behavioral differences between good and poor avoiders to elucidate the AA neurocircuit. Rats received Sidman AA training and expression of the activity-dependent immediate-early gene c-fos was measured after a shock-free AA test. Six brain regions with known or putative roles in AA were evaluated: amygdala, periaqueductal gray, nucleus accumbens, dorsal striatum, prefrontal cortex (PFC), and hippocampus. Good avoiders showed little Pavlovian freezing and high AA rates at test, the opposite of poor avoiders. Although c-Fos activation was observed throughout the brain, differential activation was found only in subregions of amygdala and PFC. Interestingly, c-Fos correlated with avoidance and freezing in only five of 20 distinct areas evaluated: lateral amygdala, central amygdala, medial amygdala, basal amygdala, and infralimbic PFC. Thus, activity in specific amygdala-PFC circuits likely mediates the competition between instrumental actions and Pavlovian reactions after AA training. Individual differences in AA behavior, long considered a nuisance by researchers, may be the key to elucidating the AA neurocircuit and understanding pathological response profiles.

Erk1/2 mediates leptin receptor signaling in the ventral tegmental area.

Leptin acts on the ventral tegmental area (VTA) to modulate neuronal function and feeding behavior in rats and mice. To identify the intracellular effectors of the leptin receptor (Lepr), downstream signal transduction events were assessed for regulation by direct leptin infusion. Phosphorylated signal transducer and activator of transcription 3 (pSTAT3) and phosphorylated extracellular signal-regulated kinase-1 and -2 (pERK1/2) were increased in the VTA while phospho-AKT (pAKT) was unaffected. Pretreatment of brain slices with the mitogen-activated protein kinase kinase -1 and -2 (MEK1/2) inhibitor U0126 blocked the leptin-mediated decrease in firing frequency of VTA dopamine neurons. The anorexigenic effects of VTA-administered leptin were also blocked by pretreatment with U0126, which effectively blocked phosphorylation of ERK1/2 but not STAT3. These data demonstrate that pERK1/2 may have a critical role in mediating both the electrophysiogical and behavioral effects of leptin receptor signaling in the VTA.

Chronic loss of melanin-concentrating hormone affects motivational aspects of feeding in the rat.

Current epidemic obesity levels apply great medical and financial pressure to the strenuous economy of obesity-prone cultures, and neuropeptides involved in body weight regulation are regarded as attractive targets for a possible treatment of obesity in humans. The lateral hypothalamus and the nucleus accumbens shell (AcbSh) form a hypothalamic-limbic neuropeptide feeding circuit mediated by Melanin-Concentrating Hormone (MCH). MCH promotes feeding behavior via MCH receptor-1 (MCH1R) in the AcbSh, although this relationship has not been fully characterized. Given the AcbSh mediates reinforcing properties of food, we hypothesized that MCH modulates motivational aspects of feeding.Here we show that chronic loss of the rat MCH-precursor Pmch decreased food intake predominantly via a reduction in meal size during rat development and reduced high-fat food-reinforced operant responding in adult rats. Moreover, acute AcbSh administration of Neuropeptide-GE and Neuropeptide-EI (NEI), both additional neuropeptides derived from Pmch, or chronic intracerebroventricular infusion of NEI, did not affect feeding behavior in adult pmch(+/+) or pmch(-/-) rats. However, acute administration of MCH to the AcbSh of adult pmch(-/-) rats elevated feeding behavior towards wild type levels. Finally, adult pmch(-/-) rats showed increased ex vivo electrically evoked dopamine release and increased limbic dopamine transporter levels, indicating that chronic loss of Pmch in the rat affects the limbic dopamine system.Our findings support the MCH-MCH1R system as an amplifier of consummatory behavior, confirming this system as a possible target for the treatment of obesity. We propose that MCH-mediated signaling in the AcbSh positively mediates motivational aspects of feeding behavior. Thereby it provides a crucial signal by which hypothalamic neural circuits control energy balance and guide limbic brain areas to enhance motivational or incentive-related aspects of food consumption.

Regulation of nucleus accumbens activity by the hypothalamic neuropeptide melanin-concentrating hormone.

The lateral hypothalamus and the nucleus accumbens shell (AcbSh) are brain regions important for food intake. The AcbSh contains high levels of receptor for melanin-concentrating hormone (MCH), a lateral hypothalamic peptide critical for feeding and metabolism. MCH receptor (MCHR1) activation in the AcbSh increases food intake, while AcbSh MCHR1 blockade reduces feeding. Here biochemical and cellular mechanisms of MCH action in the rodent AcbSh are described. A reduction of phosphorylation of GluR1 at serine 845 (pSer(845)) is shown to occur after both pharmacological and genetic manipulations of MCHR1 activity. These changes depend upon signaling through G(i/o), and result in decreased surface expression of GluR1-containing AMPA receptors (AMPARs). Electrophysiological analysis of medium spiny neurons (MSNs) in the AcbSh revealed decreased amplitude of AMPAR-mediated synaptic events (mEPSCs) with MCH treatment. In addition, MCH suppressed action potential firing MSNs through K(+) channel activation. Finally, in vivo recordings confirmed that MCH reduces neuronal cell firing in the AcbSh in freely moving animals. The ability of MCH to reduce cell firing in the AcbSh is consistent with a general model from other pharmacological and electrophysiological studies whereby reduced AcbSh neuronal firing leads to food intake. The current work integrates the hypothalamus into this model, providing biochemical and cellular mechanisms whereby metabolic and limbic signals converge to regulate food intake.

Neural mechanisms underlying obesity and drug addiction.

Increasing rates of obesity have alarmed health officials and prompted much public dialogue. While the factors leading to obesity are numerous, an inability to control intake of freely available food is central to the problem. In order to understand this, we need to better define the mechanisms by which the brain regulates food intake, and why it is often difficult to control consumption. From this point of view, it seems valuable to consider the commonalities between food intake and drug abuse. While research in the two fields has historically emphasized different neural substrates, recent data have increased interest in better defining elements that may underlie both drug addiction and obesity. Here we discuss some of these shared elements with an emphasis on emerging areas of research that better define common mechanisms leading to overconsumption.

Leptin receptor signaling in midbrain dopamine neurons regulates feeding.

The leptin hormone is critical for normal food intake and metabolism. While leptin receptor (Lepr) function has been well studied in the hypothalamus, the functional relevance of Lepr expression in the ventral tegmental area (VTA) has not been investigated. The VTA contains dopamine neurons that are important in modulating motivated behavior, addiction, and reward. Here, we show that VTA dopamine neurons express Lepr mRNA and respond to leptin with activation of an intracellular JAK-STAT pathway and a reduction in firing rate. Direct administration of leptin to the VTA caused decreased food intake while long-term RNAi-mediated knockdown of Lepr in the VTA led to increased food intake, locomotor activity, and sensitivity to highly palatable food. These data support a critical role for VTA Lepr in regulating feeding behavior and provide functional evidence for direct action of a peripheral metabolic signal on VTA dopamine neurons.