BEHAVIORAL AND NEUROBIOLOGICAL MECHANISMS OF PAVLOVIAN AND INSTRUMENTAL EXTINCTION LEARNING.

This article reviews the behavioral neuroscience of extinction, the phenomenon in which a behavior that has been acquired through Pavlovian or instrumental (operant) learning decreases in strength when the outcome that reinforced it is removed. Behavioral research indicates that neither Pavlovian nor operant extinction depends substantially on erasure of the original learning but instead depends on new inhibitory learning that is primarily expressed in the context in which it is learned, as exemplified by the renewal effect. Although the nature of the inhibition may differ in Pavlovian and operant extinction, in either case the decline in responding may depend on both generalization decrement and the correction of prediction error. At the neural level, Pavlovian extinction requires a tripartite neural circuit involving the amygdala, prefrontal cortex, and hippocampus. Synaptic plasticity in the amygdala is essential for extinction learning, and prefrontal cortical inhibition of amygdala neurons encoding fear memories is involved in extinction retrieval. Hippocampal-prefrontal circuits mediate fear relapse phenomena, including renewal. Instrumental extinction involves distinct ensembles in corticostriatal, striatopallidal, and striatohypothalamic circuits as well as their thalamic returns for inhibitory (extinction) and excitatory (renewal and other relapse phenomena) control over operant responding. The field has made significant progress in recent decades, although a fully integrated biobehavioral understanding still awaits.

A cognitive pathway to punishment insensitivity.

Individuals differ in their sensitivity to the adverse consequences of their actions, leading some to persist in maladaptive behaviors. Two pathways have been identified for this insensitivity: a motivational pathway based on excessive reward valuation and a behavioral pathway based on autonomous stimulus-response mechanisms. Here, we identify a third, cognitive pathway based on differences in punishment knowledge and use of that knowledge to suppress behavior. We show that distinct phenotypes of punishment sensitivity emerge from differences in what people learn about their actions. Exposed to identical punishment contingencies, some people (sensitive phenotype) form correct causal beliefs that they use to guide their behavior, successfully obtaining rewards and avoiding punishment, whereas others form incorrect but internally coherent causal beliefs that lead them to earn punishment they do not like. Incorrect causal beliefs were not inherently problematic because we show that many individuals benefit from information about why they are being punished, revaluing their actions and changing their behavior to avoid further punishment (unaware phenotype). However, one condition where incorrect causal beliefs were problematic was when punishment is infrequent. Under this condition, more individuals show punishment insensitivity and detrimental patterns of behavior that resist experience and information-driven updating, even when punishment is severe (compulsive phenotype). For these individuals, rare punishment acted as a "trap," inoculating maladaptive behavioral preferences against cognitive and behavioral updating.

Pathways to the persistence of drug use despite its adverse consequences.

The persistence of drug taking despite its adverse consequences plays a central role in the presentation, diagnosis, and impacts of addiction. Eventual recognition and appraisal of these adverse consequences is central to decisions to reduce or cease use. However, the most appropriate ways of conceptualizing persistence in the face of adverse consequences remain unclear. Here we review evidence that there are at least three pathways to persistent use despite the negative consequences of that use. A cognitive pathway for recognition of adverse consequences, a motivational pathway for valuation of these consequences, and a behavioral pathway for responding to these adverse consequences. These pathways are dynamic, not linear, with multiple possible trajectories between them, and each is sufficient to produce persistence. We describe these pathways, their characteristics, brain cellular and circuit substrates, and we highlight their relevance to different pathways to self- and treatment-guided behavior change.

A Cognitive Pathway to Persistent, Maladaptive Choice.

BACKGROUND: Correctly recognising that alcohol or other substances are causing problems is a necessary condition for those problems to spur beneficial behaviour change. Yet such recognition is neither immediate nor straightforward. Recognition that one's alcohol or drug use is causing negative consequences often occurs gradually. Contemporary addiction neuroscience has yet to make progress in understanding and addressing these recognition barriers, despite evidence that a lack of problem recognition is a primary impediment to seeking treatment. SUMMARY: Based on our recent empirical work, this article shows how recognition barriers can emerge from dual constraints on how we learn about the negative consequences of our actions. One constraint is imposed by the characteristics of negative consequences themselves. A second constraint is imposed by the characteristics of human cognition and information processing. In some people, the joint action of these constraints causes a lack of correct awareness of the consequences of their behaviour and reduced willingness to update that knowledge and behaviour when confronted with counterevidence. KEY MESSAGES: This "cognitive pathway" can drive persistent, maladaptive choice.

A Corticothalamic Circuit Trades off Speed for Safety during Decision-Making under Motivational Conflict.

Decisions to act while pursuing goals in the presence of danger must be made quickly but safely. Premature decisions risk injury or death, whereas postponing decisions risk goal loss. Here we show how mice resolve these competing demands. Using microstructural behavioral analyses, we identified the spatiotemporal dynamics of approach-avoidance decisions under motivational conflict in male mice. Then we used cognitive modeling to show that these dynamics reflect the speeded decision-making mechanisms used by humans and nonhuman primates, with mice trading off decision speed for safety of choice when danger loomed. Using calcium imaging in paraventricular thalamus and optogenetic inhibition of the prelimbic cortex to paraventricular thalamus pathway, we show that this speed-safety trade off occurs because increases in paraventricular thalamus activity increase decision caution, thereby increasing approach-avoid decision times in the presence of danger. Our findings demonstrate that a discrete brain circuit involving the paraventricular thalamus and its prefrontal input adjusts decision caution during motivational conflict, trading off decision speed for decision safety when danger is close. We identify the corticothalamic pathway as central to cognitive control during decision-making under conflict.SIGNIFICANCE STATEMENT Foraging animals balance the need to seek food and energy against the conflicting needs to avoid injury and predation. This competition is fundamental to survival but rarely has a stable, correct solution. Here we show that approach-avoid decisions under motivational conflict involve strategic adjustments in decision caution controlled via a top-down corticothalamic pathway from the prelimbic cortex to the paraventricular thalamus. We identify a novel corticothalamic mechanism for cognitive control that is applicable across a range of motivated behaviors and mark paraventricular thalamus and its prefrontal cortical input as targets to remediate the deficits in decision caution characteristic of unsafe and impulsive choices.

The Rescorla-Wagner model, prediction error, and fear learning.

The Rescorla-Wagner model remains one of the most important and influential theoretical accounts of the conditions under which Pavlovian learning occurs. Moreover, the experimental approaches that inspired the model continue to provide powerful behavioral tools to advance mechanistic understanding of how we and other animals learn to fear and learn to reduce fear. Here we consider key features of the Rescorla-Wagner model as applied to study of fear learning. We review evidence for key insights of the model. First, learning to fear and learning to reduce fear are governed by a common, signed prediction error. Second, this error drives variations in effectiveness of the shock US that are causal to whether and how much fear is learned or lost during a conditioning trial. We also consider behavioral and neural findings inconsistent with the model and which will be essential to understand and advance understanding of fear learning.

The Roles of Basolateral Amygdala Parvalbumin Neurons in Fear Learning.

The basolateral amygdala (BLA) is obligatory for fear learning. This learning is linked to BLA excitatory projection neurons whose activity is regulated by complex networks of inhibitory interneurons, dominated by parvalbumin (PV)-expressing GABAergic neurons. The roles of these GABAergic interneurons in learning to fear and learning not to fear, activity profiles of these interneurons across the course of fear learning, and whether or how these change across the course of learning all remain poorly understood. Here, we used PV cell-type-specific recording and manipulation approaches in male transgenic PV-Cre rats during pavlovian fear conditioning to address these issues. We show that activity of BLA PV neurons during the moments of aversive reinforcement controls fear learning about aversive events, but activity during moments of nonreinforcement does not control fear extinction learning. Furthermore, we show expectation-modulation of BLA PV neurons during fear learning, with greater activity to an unexpected than expected aversive unconditioned stimulus (US). This expectation-modulation was specifically because of BLA PV neuron sensitivity to aversive prediction error. Finally, we show that BLA PV neuron function in fear learning is conserved across these variations in prediction error. We suggest that aversive prediction-error modulation of PV neurons could enable BLA fear-learning circuits to retain selectivity for specific sensory features of aversive USs despite variations in the strength of US inputs, thereby permitting the rapid updating of fear associations when these sensory features change.SIGNIFICANCE STATEMENT The capacity to learn about sources of danger in the environment is essential for survival. This learning depends on complex microcircuitries of inhibitory interneurons in the basolateral amygdala. Here, we show that parvalbumin-positive GABAergic interneurons in the rat basolateral amygdala are important for fear learning during moments of danger, but not for extinction learning during moments of safety, and that the activity of these neurons is modulated by expectation of danger. This may enable fear-learning circuits to retain selectivity for specific aversive events across variations in expectation, permitting the rapid updating of learning when aversive events change.

Complementary Roles for Ventral Pallidum Cell Types and Their Projections in Relapse.

The ventral pallidum (VP) is a key node in the neural circuits controlling relapse to drug seeking. How this role relates to different VP cell types and their projections is poorly understood. Using male rats, we show how different forms of relapse to alcohol-seeking are assembled from VP cell types and their projections to lateral hypothalamus (LH) and ventral tegmental area (VTA). Using RNAScope in situ hybridization to characterize activity of different VP cell types during relapse to alcohol-seeking provoked by renewal (context-induced reinstatement), we found that VP Gad1 and parvalbumin (PV), but not vGlut2, neurons show relapse-associated changes in c-Fos expression. Next, we used retrograde tracing, chemogenetic, and electrophysiological approaches to study the roles of VPGad1 and VPPV neurons in relapse. We show that VPGad1 neurons contribute to contextual control over relapse (renewal), but not to relapse during reacquisition, via projections to LH, where they converge with ventral striatal inputs onto LHGad1 neurons. This convergence of striatopallidal inputs at the level of individual LHGad1 neurons may be critical to balancing propensity for relapse versus abstinence. In contrast, VPPV neurons contribute to relapse during both renewal and reacquisition via projections to VTA. These findings identify a double dissociation in the roles for different VP cell types and their projections in relapse. VPGad1 neurons control relapse during renewal via projections to LH. VPPV neurons control relapse during both renewal and reacquisition via projections to VTA. Targeting these different pathways may provide tailored interventions for different forms of relapse.SIGNIFICANCE STATEMENT Relapse to drug or reward seeking after a period of extinction or abstinence remains a key impediment to successful treatment. The ventral pallidum, located in the ventral basal ganglia, has long been recognized as an obligatory node in a 'final common pathway' for relapse. Yet how this role relates to the considerable VP cellular and circuit heterogeneity is not well understood. We studied the cellular and circuit architecture for VP in relapse control. We show that different forms of relapse have complementary VP cellular and circuit architectures, raising the possibility that targeting these different neural architectures may provide tailored interventions for different forms of relapse.

The Mesolimbic Dopamine Activity Signatures of Relapse to Alcohol-Seeking.

The mesolimbic dopamine system comprises distinct compartments supporting different functions in learning and motivation. Less well understood is how complex addiction-related behaviors emerge from activity patterns across these compartments. Here we show how different forms of relapse to alcohol-seeking in male rats are assembled from activity across the VTA and the nucleus accumbens. First, we used chemogenetic approaches to show a causal role for VTA TH neurons in two forms of relapse to alcohol-seeking: renewal (context-induced reinstatement) and reacquisition. Then, using gCaMP fiber photometry of VTA TH neurons, we identified medial and lateral VTA TH neuron activity profiles during self-administration, renewal, and reacquisition. Next, we used optogenetic inhibition of VTA TH neurons to show distinct causal roles for VTA subregions in distinct forms of relapse. We then used dLight fiber photometry to measure dopamine binding across the ventral striatum (medial accumbens shell, accumbens core, lateral accumbens shell) and showed complex and heterogeneous profiles of dopamine binding during self-administration and relapse. Finally, we used representational similarity analysis to identify mesolimbic dopamine signatures of self-administration, extinction, and relapse. Our results show that signatures of relapse can be identified from heterogeneous activity profiles across the mesolimbic dopamine system and that these signatures are unique for different forms of relapse.SIGNIFICANCE STATEMENT It is axiomatic that the actions of dopamine are critical to drug addiction. Yet how relapse to drug-seeking is assembled from activity across the mesolimbic dopamine system is poorly understood. Here we show how relapse to alcohol-seeking relates to activity in specific VTA and accumbens compartments, how these change for different forms of relapse, and how relapse-associated activity relates to activity during self-administration and extinction. We report the mesolimbic dopamine activity signatures for relapse and show that these signatures are unique for different forms of relapse.

Dopamine and relapse to drug seeking.

The actions of dopamine are essential to relapse to drug seeking but we still lack a precise understanding of how dopamine achieves these effects. Here we review recent advances from animal models in understanding how dopamine controls relapse to drug seeking. These advances have been enabled by important developments in understanding the basic neurochemical, molecular, anatomical, physiological and functional properties of the major dopamine pathways in the mammalian brain. The literature shows that although different forms of relapse to seeking different drugs of abuse each depend on dopamine, there are distinct dopamine mechanisms for relapse. Different circuit-level mechanisms, different populations of dopamine neurons and different activity profiles within these dopamine neurons, are important for driving different forms of relapse. This diversity highlights the need to better understand when, where and how dopamine contributes to relapse behaviours.

Paraventricular Thalamus Controls Behavior during Motivational Conflict.

Decision-making often involves motivational conflict because of the competing demands of approach and avoidance for a common resource: behavior. This conflict must be resolved as a necessary precursor for adaptive behavior. Here we show a role for the paraventricular thalamus (PVT) in behavioral control during motivational conflict. We used Pavlovian counterconditioning in male rats to establish a conditioned stimulus (CS) as a signal for reward (or danger) and then transformed the same CS into a signal for danger (or reward). After such training, the CS controls conflicting appetitive and aversive behaviors. To assess PVT involvement in conflict, we injected an adeno-associated virus (AAV) expressing the genetically encoded Ca2+ indicator GCaMP and used fiber photometry to record population PVT Ca2+ signals. We show distinct profiles of responsivity across the anterior-posterior axis of PVT during conflict, including an ordinal relationship between posterior PVT CS responses and behavior strength. To study the causal role of PVT in behavioral control during conflict, we injected AAV expressing the inhibitory hM4Di DREADD and determined the effects of chemogenetic PVT inhibition on behavior. We show that chemogenetic inhibition across the anterior-posterior axis of the PVT, but not anterior or posterior PVT alone, disrupts arbitration between appetitive and aversive behaviors when they are in conflict but has no effect when these behaviors are assessed in isolation. Together, our findings identify PVT as central to behavioral control during motivational conflict.SIGNIFICANCE STATEMENT Animals, including humans, approach attractive stimuli and avoid aversive ones. However, they frequently face conflict when the demands of approach and avoidance are incompatible. Resolution of this conflict is fundamental to adaptive behavior. Here we show a role for the paraventricular thalamus, a nucleus of the dorsal midline thalamus, in the arbitration of appetitive and aversive behavior during motivational conflict.

Glucagon-Like Peptide-1 Receptor Signaling in the Ventral Tegmental Area Reduces Alcohol Self-Administration in Male Rats.

BACKGROUND: The misuse and abuse of alcohol is a major public health issue. However, available treatments are limited with variable efficacy. Recently, preclinical studies show that glucagon-like-peptide-1 (GLP-1) and its analogue Exendin-4 (Ex4) potently reduce a range of alcohol intake behaviors, thus highlighting its potential as a treatment for alcohol use disorders. However, the neural mechanisms and sites of action mediating the effects of Ex4 on alcohol intake behaviors remain to be characterized. This study examined the ventral tegmental area (VTA) as a site of action for the effects of GLP-1 on alcohol intake. METHODS: Male Long-Evans rats were given intermittent access to 20% alcohol and trained to nose poke for 20% alcohol. Rats received intra-VTA injections of Ex4 (vehicle, 0.01, 0.05 µg), and the effects of VTA Ex4 on alcohol self-administration, motivation, and relapse were assessed. RESULTS: When compared to vehicle treatment, intra-VTA Ex4 (0.01, 0.05 µg) delivery significantly reduced alcohol self-administration, an effect that was particularly prominent in high alcohol drinkers. However, VTA Ex4 did not reduce reacquisition of alcohol self-administration after extinction nor the motivation to obtain alcohol. Importantly, the lower dose of Ex4 (0.01 µg) used had no effect on food intake or locomotor activity, suggesting that the reduction in alcohol self-administration observed was not secondary to caloric intake or motor deficits. CONCLUSIONS: Together, these findings provide support for the VTA as a key site of action for GLP-1 on alcohol self-administration but not the reacquisition of alcohol self-administration or motivation to work for alcohol.

Basolateral Amygdala Neurons Maintain Aversive Emotional Salience.

BLA neurons serve a well-accepted role in fear conditioning and fear extinction. However, the specific learning processes related to their activity at different times during learning remain poorly understood. We addressed this using behavioral tasks isolating distinct aspects of fear learning in male rats. We show that brief optogenetic inhibition of BLA neurons around moments of aversive reinforcement or nonreinforcement causes reductions in the salience of conditioned stimuli, rendering these stimuli less able to be learned about and less able to control fear or safety behaviors. This salience reduction was stimulus-specific, long-lasting, and specific to learning about, or responding to, the same aversive outcome, precisely the goals of therapeutic interventions in human anxiety disorders. Our findings identify a core learning process disrupted by brief BLA optogenetic inhibition. They show that a primary function of the unconditioned stimulus-evoked activity of BLA neurons is to maintain the salience of conditioned stimuli that precede it. This maintenance of salience is a necessary precursor for these stimuli to gain and maintain control over fear and safety behavior.SIGNIFICANCE STATEMENT The amygdala is essential for learning to fear and learning to reduce fear. However, the specific roles served by activity of different amygdala neurons at different times during learning is poorly understood. We used behavioral tasks isolating distinct aspects of learning in rats to show that brief optogenetic inhibition of BLA neurons around moments of reinforcement or nonreinforcement disrupts maintenance of conditioned stimulus salience. This causes a stimulus-specific and long-lasting deficit in the ability of the conditioned stimulus to be learned about or control fear responses. These consequences are the precisely goals of therapeutic interventions in human anxiety disorders. Our findings identify a core learning process disrupted by brief BLA optogenetic inhibition.

The nucleus accumbens shell in reinstatement and extinction of drug seeking.

The contexts where drugs are self-administered have important control over relapse and extinction of drug-seeking behavior. The nucleus accumbens shell (AcbSh) is essential to this contextual control over drug-seeking behavior. It has been consistently implicated in both the expression of context-induced reinstatement and the expression of extinction, across a variety of drug classes and other rewards. Here, we review the evidence linking AcbSh to the extinction and reinstatement of drug seeking. We consider whether this dual role can be linked to known heterogeneities in AcbSh cell types, their major afferents, and their major efferents. We show that although these heterogeneities are each important and can determine extinction vs. reinstatement, they do not seem adequate to explain the body of findings from the behavioral literature. Rather, we suggest that this functional specialization of AcbSh may be more profitably viewed in terms of the segregation and compartmentalization of AcbSh channels.

Paraventricular Thalamus Balances Danger and Reward.

Foraging animals balance the need to seek food and energy against the accompanying dangers of injury and predation. To do so, they rely on learning systems encoding reward and danger. Whereas much is known about these separate learning systems, little is known about how they interact to shape and guide behavior. Here we show a key role for the rat paraventricular nucleus of the thalamus (PVT), a nucleus of the dorsal midline thalamus, in this interaction. First, we show behavioral competition between reward and danger: the opportunity to seek food reward negatively modulates expression of species-typical defensive behavior. Then, using a chemogenetic approach expressing the inhibitory hM4Di designer receptor exclusively activated by a designer drug in PVT neurons, we show that the PVT is central to this behavioral competition. Chemogenetic PVT silencing biases behavior toward either defense or reward depending on the experimental conditions, but does not consistently favor expression of one over the other. This bias could not be attributed to changes in fear memory retrieval, learned safety, or memory interference. Rather, our results demonstrate that the PVT is essential for balancing conflicting behavioral tendencies toward danger and reward, enabling adaptive responding under this basic selection pressure.SIGNIFICANCE STATEMENT Among the most basic survival problems faced by animals is balancing the need to seek food and energy against the accompanying dangers of injury and predation. Although much is known about the brain mechanisms that underpin learning about reward and danger, little is known about how these interact to solve basic survival problems. Here we show competition between defensive (to avoid predatory detection) and approach (to obtain food) behavior. We show that the paraventricular thalamus, a nucleus of the dorsal midline thalamus, is integral to this behavioral competition. The paraventricular thalamus balances the competing behavioral demands of danger and reward, enabling adaptive responding under this selection pressure.

Ventral Pallidum Output Pathways in Context-Induced Reinstatement of Alcohol Seeking.

Ventral pallidum (VP) is a well-established locus for the reinforcing effects of drugs of abuse and reinstatement of drug seeking. However, VP neurons are at the origin of multiple output pathways, with strong projections to ventral tegmental area (VTA), subthalamic nucleus (STN), lateral hypothalamus, among others, and the roles of these VP output pathways in reinstatement of drug seeking remain poorly understood. Here we addressed these issues using a combination of neuroanatomical tracing and chemogenetic approaches. First, using dual-retrograde tracing, we show that VP neurons projecting to either VTA or STN are recruited during context-induced reinstatement of extinguished alcohol seeking in rats. Then, using chemogenetics, we show modulation of context-induced reinstatement and reacquisition of alcohol seeking via designer receptors exclusively activated by designer drugs excitation or inhibition of the VP. To determine the causal roles of VP → VTA and VP → STN pathways in context-induced reinstatement and reacquisition we used a chemogenetic disconnection approach and show that silencing either the VP → VTA or VP → STN pathways is sufficient to reduce both reinstatement and reacquisition of alcohol seeking. Moreover, these disconnections also each reduced responding and motivation during a progressive ratio test but had no effect on locomotor activity. Together, these results show that multiple ventral pallidal output pathways contribute to relapse to alcohol seeking. SIGNIFICANCE STATEMENT: Ventral pallidum (VP) serves important roles in reward and motivation and is a critical node in the neural circuitry for reinstatement of drug seeking. Despite being a common locus for different forms of reinstatement, fundamental aspects of neural circuitry for these VP contributions to reinstatement of drug seeking remain unknown. Here we used a combination of neuroanatomical tracing and chemogenetic approaches to map the VP output pathways for context-induced reinstatement and reacquisition of alcohol seeking. We show that VP output pathways to the subthalamic nucleus and also to the ventral tegmental area are necessary for these forms of reinstatement.

Disrupted Prediction Error Links Excessive Amygdala Activation to Excessive Fear.

Basolateral amygdala (BLA) is critical for fear learning, and its heightened activation is widely thought to underpin a variety of anxiety disorders. Here we used chemogenetic techniques in rats to study the consequences of heightened BLA activation for fear learning and memory, and to specifically identify a mechanism linking increased activity of BLA glutamatergic neurons to aberrant fear. We expressed the excitatory hM3Dq DREADD in rat BLA glutamatergic neurons and showed that CNO acted selectively to increase their activity, depolarizing these neurons and increasing their firing rates. This chemogenetic excitation of BLA glutamatergic neurons had no effect on the acquisition of simple fear learning, regardless of whether this learning led to a weak or strong fear memory. However, in an associative blocking task, chemogenetic excitation of BLA glutamatergic neurons yielded significant learning to a blocked conditioned stimulus, which otherwise should not have been learned about. Moreover, in an overexpectation task, chemogenetic manipulation of BLA glutamatergic neurons prevented use of negative prediction error to reduce fear learning, leading to significant impairments in fear inhibition. These effects were not attributable to the chemogenetic manipulation enhancing arousal, increasing asymptotic levels of fear learning or fear memory consolidation. Instead, chemogenetic excitation of BLA glutamatergic neurons disrupted use of prediction error to regulate fear learning. SIGNIFICANCE STATEMENT: Several neuropsychiatric disorders are characterized by heightened activation of the amygdala. This heightened activation has been hypothesized to underlie increased emotional reactivity, fear over generalization, and deficits in fear inhibition. Yet the mechanisms linking heightened amygdala activation to heightened emotional learning are elusive. Here we combined chemogenetic excitation of rat basolateral amygdala glutamatergic neurons with a variety of behavioral approaches to show that, although simple fear learning is unaffected, the use of prediction error to regulate this learning is profoundly disrupted, leading to formation of inappropriate fear associations and impaired fear inhibition.

Effects of chemogenetic excitation or inhibition of the ventrolateral periaqueductal gray on the acquisition and extinction of Pavlovian fear conditioning.

The midbrain periaqueductal gray (PAG) has been implicated in the generation and transmission of a prediction error signal that instructs amygdala-based fear and extinction learning. However, the PAG also plays a key role in the expression of conditioned fear responses. The evidence for a role of the PAG in fear learning and extinction learning has been obtained almost exclusively using PAG-dependent fear responses. It is less clear whether the PAG regulates fear learning when other measures of learned fear are used. Here we combined a chemogenetic approach, permitting excitation or inhibition of neurons in the ventrolateral PAG (VLPAG), with conditioned suppression as the measure of learned fear to assess the role of VLPAG in the acquisition and extinction of fear learning. We show that chemogenetic excitation of VLPAG (with some encroachment on lateral PAG [LPAG]) impairs acquisition of fear and, conversely, chemogenetic inhibition impairs extinction of fear. These effects on fear and extinction learning were specific to the combination of DREADD expression and injection of CNO because they were observed relative to both eYFP controls injected with CNO as well as DREADD expressing controls injected with vehicle. Taken together, these results show that activity of L/VLPAG neurons regulates both the acquisition and extinction of Pavlovian fear learning.

Lateral, not medial, prefrontal cortex contributes to punishment and aversive instrumental learning.

Aversive outcomes punish behaviors that cause their occurrence. The prefrontal cortex (PFC) has been implicated in punishment learning and behavior, although the exact roles for different PFC regions in instrumental aversive learning and decision-making remain poorly understood. Here, we assessed the role of the orbitofrontal (OFC), rostral agranular insular (RAIC), prelimbic (PL), and infralimbic (IL) cortex in instrumental aversive learning and decision-making. Rats that pressed two individually presented levers for pellet rewards rapidly suppressed responding to one lever if it also caused mild punishment (punished lever) but continued pressing the other lever that did not cause punishment (unpunished lever). Inactivations of OFC, RAIC, IL, or PL via the GABA agonists baclofen and muscimol (BM) had no effect on the acquisition of instrumental learning. OFC inactivations increased responding on the punished lever during expression of well-learned instrumental aversive learning, whereas RAIC inactivations increased responding on the punished lever when both levers were presented simultaneously in an unpunished choice test. There were few effects of medial PFC (PL and IL) inactivation. These results suggest that lateral PFC, notably OFC and RAIC, have complementary functions in aversive instrumental learning and decision-making; OFC is important for using established aversive instrumental memories to guide behavior away from actions that cause punishment, whereas RAIC is important for aversive decision-making under conditions of choice.