Behavioral outputs and overlapping circuits between conditional fear and active avoidance.

Aversive learning can produce a wide variety of defensive behavioral responses depending on the circumstances, ranging from reactive responses like freezing to proactive avoidance responses. While most of this initial learning is behaviorally supported by an expectancy of an aversive outcome and neurally supported by activity within the basolateral amygdala, activity in other brain regions become necessary for the execution of defensive strategies that emerge in other aversive learning paradigms such as active avoidance. Here, we review the neural circuits that support both reactive and proactive defensive behaviors that are motivated by aversive learning, and identify commonalities between the neural substrates of these distinct (and often exclusive) behavioral strategies.

Maturation of a cortical-amygdala circuit limits sociability in male rats.

Prefrontal cortical maturation coincides with adolescent transitions in social engagement, suggesting that it influences social development. The anterior cingulate cortex (ACC) is important for social interaction, including ACC outputs to the basolateral amygdala (BLA). However, little is known about ACC-BLA sensitivity to the social environment and if this changes during maturation. Here, we used brief (2-hour) isolation to test the immediate impact of changing the social environment on the ACC-BLA circuit and subsequent shifts in social behavior of adolescent and adult rats. We found that optogenetic inhibition of the ACC during brief isolation reduced isolation-driven facilitation of social interaction across ages. Isolation increased activity of ACC-BLA neurons across ages, but altered the influence of ACC on BLA activity in an age-dependent manner. Isolation reduced the inhibitory impact of ACC stimulation on BLA neurons in a frequency-dependent manner in adults, but uniformly suppressed ACC-driven BLA activity in adolescents. This work identifies isolation-driven alterations in an ACC-BLA circuit, and the ACC itself as an essential region sensitive to social environment and regulates its impact on social behavior in both adults and adolescents.

Unique roles for the anterior and posterior retrosplenial cortices in encoding and retrieval of memory for context.

The rat retrosplenial cortex (RSC) makes critical contributions to learning and memory but these contributions may not be uniform along its rostro-caudal axis. Previous work suggests that event-related and context-related information are differentially encoded by anterior and posterior RSC subregions. Here, we further test this idea using a procedure in which spatial/environmental cues (context) and discrete event memories are acquired separately. All animals received a 5-min pre-exposure to the training context 24 h before contextual fear conditioning where shock was delivered immediately upon being placed in the chamber. Rats were tested for memory for the context the next day. We found that optogenetic inhibition of cells in only the posterior RSC during the pre-exposure phase, when spatial information is encoded, reduced behavioral responding during the subsequent memory test. However, similar inhibition of either the anterior or posterior RSC during shock delivery, when information about both the context and the shock become integrated, impaired memory. Finally, inhibiting cellular activity in only the posterior RSC during memory retrieval during testing reduced responding. Together, these results suggest that while activity in both subregions is needed during the period in which the event-related information becomes integrated with the context representation, the posterior RSC is important for both memory formation and retrieval or expression of memory for information about the context. These results add to a growing literature demonstrating a role for the RSC in integration of multiple aspects of memory, and provide information on how spatial representations reliant on the retrosplenial cortex interact with associative learning.

Developmental Shifts in Amygdala Activity during a High Social Drive State.

Amygdala abnormalities characterize several psychiatric disorders with prominent social deficits and often emerge during adolescence. The basolateral amygdala (BLA) bidirectionally modulates social behavior and has increased sensitivity during adolescence. We tested how an environmentally-driven social state is regulated by the BLA in adults and adolescent male rats. We found that a high social drive state caused by brief social isolation increases age-specific social behaviors and increased BLA neuronal activity. Chemogenetic inactivation of BLA decreased the effect of high social drive on social engagement. High social drive preferentially enhanced BLA activity during social engagement; however, the effect of social opportunity on BLA activity was greater during adolescence. While this identifies a substrate underlying age differences in social drive, we then determined that high social drive increased BLA NMDA GluN2B expression and sensitivity to antagonism increased with age. Further, the effect of a high social drive state on BLA activity during social engagement was diminished by GluN2B blockade in an age-dependent manner. These results demonstrate the necessity of the BLA for environmentally driven social behavior, its sensitivity to social opportunity, and uncover a maturing role for BLA and its GluN2B receptors in social engagement.SIGNIFICANCE STATEMENT Social engagement during adolescence is a key component of healthy development. Social drive provides the impetus for social engagement and abnormalities underlie social symptoms of depression and anxiety. While adolescence is characterized by transitions in social drive and social environment sensitivity, little is known about the neural basis for these changes. We found that amygdala activity is uniquely sensitive to social environment during adolescence compared with adulthood, and is required for expression of heightened social drive. In addition, the neural substrates shift toward NMDA dependence in adulthood. These results are the first to demonstrate a unique neural signature of higher social drive and begin to uncover the underlying factors that heighten social engagement during adolescence.

Examining a role for the retrosplenial cortex in age-related memory impairment.

Aging is often characterized by changes in the ability to form and accurately recall episodic memories, and this is especially evident in neuropsychiatric conditions including Alzheimer's disease and dementia. Memory impairments and cognitive decline associated with aging mirror the impairments observed following damage to the retrosplenial cortex, suggesting that this region might be important for continued cognitive function throughout the lifespan. Here, we review lines of evidence demonstrating that degeneration of the retrosplenial cortex is critically involved in age-related memory impairment and suggest that preservation of function in this region as part of a larger circuit that supports memory maintenance will decrease the deleterious effects of aging on memory processing.

Isolation driven changes in Iba1-positive microglial morphology are associated with social recognition memory in adults and adolescents.

Microglia are critical for regulation of neuronal circuits that mature from adolescence to adulthood. The morphological complexity and process length of microglia can indicate different activation states. These states are sensitive to a variety of environmental and stress conditions. Microglia are sensitive to many factors that also regulate social behavior, and in turn, microglial manipulations can impact social function. Brief social isolation is one factor that can lead to robust social changes. Here, we explored the role of microglia in the effects of brief social isolation on social recognition memory. Using morphological measures of Iba1 to index microglial intensity, complexity, and process length, we identified different effects of brief isolation on microglial complexity in the basal region of the amygdala between adults and adolescents alongside overall increases in intensity of Iba1 in several cortical brain regions. Short-term social recognition memory is sensitive to the amount of social engagement, and provides an opportunity to test if social engagement produced by brief isolation enhances social learning in a manner that relies on microglia. We found that brief isolation facilitated social interaction across ages but had opposing effects on short-term social recognition. Isolation increased novel partner investigation in adolescents, which is consistent with better social recognition, but increased familiar partner investigation in adults. Depletion of microglia with PLX3397 prevented these effects of brief isolation in adolescents, and reduced them in adults. These results suggest that distinct changes in microglial function driven by the social environment may differentially contribute to subsequent social recognition memory during development.

Optogenetic inhibition of either the anterior or posterior retrosplenial cortex disrupts retrieval of a trace, but not delay, fear memory.

Previous work investigating the role of the retrosplenial cortex (RSC) in memory formation has demonstrated that its contributions are not uniform throughout the rostro-caudal axis. While the anterior region was necessary for encoding CS information in a trace conditioning procedure, the posterior retrosplenial cortex was needed to encode contextual information. Using the same behavioral procedure, we tested if there was a similar dissociation during memory retrieval. First, we found that memory retrieval following trace conditioning results in increased neural activity in both the anterior and posterior retrosplenial cortex, measured using the immediate early gene zif268. Similar increases were not found in either RSC subregion using a delay conditioning task. We then found that optogenetic inhibition of neural activity in either subregion impairs retrieval of a trace, but not delay, memory. Together these results add to a growing literature showing a role for the retrosplenial cortex in memory formation and retention. Further, they suggest that following formation, memory storage becomes distributed to a wider network than is needed for its initial consolidation.

Regulation of learned fear expression through the MgN-amygdala pathway.

Heightened fear responding is characteristic of fear- and anxiety-related disorders, including post-traumatic stress disorder. Neural plasticity in the amygdala is essential for both initial fear learning and fear expression, and strengthening of synaptic connections between the medial geniculate nucleus (MgN) and amygdala is critical for auditory fear learning. However, very little is known about what happens in the MgN-amygdala pathway during fear recall and extinction, in which conditional fear decreases with repeated presentations of the auditory stimulus alone. In the present study, we found that optogenetic inhibition of activity in the MgN-amygdala pathway during fear retrieval and extinction reduced expression of conditional fear. While this effect persisted for at least two weeks following pathway inhibition, it was specific to the context in which optogenetic inhibition occurred, linking MgN-BLA inhibition to facilitation of extinction-like processes. Reduced fear expression through inhibition of the MgN-amygdala pathway was further characterized by similar synaptic expression of GluA1 and GluA2 AMPA receptor subunits compared to what was seen in controls. Inhibition also decreased CREB phosphorylation in the amygdala, similar to what has been reported following auditory fear extinction. We then demonstrated that this effect was reduced by inhibition of GluN2B-containing NMDA receptors. These results demonstrate a new and important role for the MgN-amygdala pathway in extinction-like processes, and show that suppressing activity in this pathway results in a persistent decrease in fear behavior.

Decreased cued fear discrimination learning in female rats as a function of estrous phase.

Relative to males, female rats can show enhanced contextual fear generalization (demonstrating a fear response in a safe or neutral context) dependent on estrogen receptor activation. The current experiment aimed to extend this finding to cued fear conditioning. Females in low-estrogen phases of the estrous cycle showed good discrimination, similar to males, between a conditional stimulus that predicted shock (CS+) and an equally familiar one that did not (CS-), while females in the proestrus (high estrogen) phase demonstrated similar levels of fear between the CS+ and CS-. These results demonstrate that cued fear generalization is similarly influenced by endogenous estrogens.

Some factors that restore goal-direction to a habitual behavior.

Recent findings from our laboratory suggest that an extensively-practiced instrumental behavior can appear to be a goal-directed action (rather than a habit) when a second behavior is added and reinforced during intermixed final sessions (Shipman et al., 2018). The present experiments were designed to explore and understand this finding. All used the taste aversion method of devaluing the reinforcer to distinguish between goal-directed actions and habits. Experiment 1 confirmed that reinforcing a second response in a separate context (but not mere exposure to that context) can return an extensively-trained habit to the status of goal-directed action. Experiment 2 showed that training of the second response needs to be intermixed with training of the first response to produce this effect; training the second response after the first-response training was complete preserved the first response as a habit. Experiment 3 demonstrated that reinforcing the second response with a different reinforcer breaks the habit status of the first response. Experiment 4 found that free reinforcers (that were not response-contingent) were sufficient to restore goal-directed performance. Together, the results suggest that unexpected reinforcer delivery can render a habitual response goal-directed again.

Age-Related Memory Impairment Is Associated with Increased zif268 Protein Accumulation and Decreased Rpt6 Phosphorylation.

Aging is associated with cognitive decline, including impairments in the ability to accurately form and recall memories. Some behavioral and brain changes associated with aging are evident as early as middle age, making the understanding of associated neurobiological mechanisms essential to aid in efforts aimed at slowing cognitive decline throughout the lifespan. Here, we found that both 15-month-old and 22-month-old rats showed impaired memory recall following trace fear conditioning. This behavioral deficit was accompanied by increased zif268 protein accumulation relative to 3-month-old animals in the medial prefrontal cortex, the dorsal and ventral hippocampi, the anterior and posterior retrosplenial cortices, the lateral amygdala, and the ventrolateral periaqueductal gray. Elevated zif268 protein levels corresponded with decreases in phosphorylation of the Rpt6 proteasome regulatory subunit, which is indicative of decreased engagement of activity-driven protein degradation. Together, these results identify several brain regions differentially impacted by aging and suggest that the accumulation of proteins associated with memory retrieval, through reduced proteolytic activity, is associated with age-related impairments in memory retention.

The dorsal hippocampus mediates synaptic destabilization and memory lability in the amygdala in the absence of contextual novelty.

The recall of a previously formed fear memory triggers a process through which synapses in the amygdala become "destabilized". This labile state at retrieval may be critical for the plasticity required to modify, update, or disrupt long-term memories. One component of this process involves the rapid internalization of calcium impermeable AMPA receptors (CI-AMPAR). While some recent work has focused on the details of modifying amygdala synapses, much less is known about the environmental factors that control memory updating and the important circuit level processes. Synchrony between the hippocampus and amygdala increases during memory retrieval and stable memories can sometimes be made labile with hippocampal manipulations. Recent work shows that memory lability at retrieval is influenced by the novelty of the retrieval environment, and detection of this novelty likely relies on the dorsal hippocampus (DH). Our goal was to determine how local activity in the DH contributes to memory lability and synaptic destabilization in the amygdala during retrieval when contextual novelty is introduced. We found that contextual novelty during retrieval is necessary for alterations in amygdala activity and CI-AMPAR internalization. In the absence of novelty, suppression of local activity in the DH prior to learning allowed for retrieval-dependent CI-AMPAR internalization in the amygdala. We next tested whether the changes in AMPAR internalization were accompanied by differences in memory lability. We found that a memory was made labile when activity within the DH was disrupted in the absence of contextual novelty. These results suggest that the DH is important for encoding contextual information during learning that regulates retrieval-dependent memory modification in the amygdala.

Cues Associated with Alternative Reinforcement During Extinction Can Attenuate Resurgence of an Extinguished Instrumental Response.

In resurgence, a target behavior (R1) is acquired in an initial phase and extinguished in a second phase while an R2 behavior is reinforced. When R2 is extinguished, R1 behavior can return or resurge. Two experiments tested the effectiveness of a potential retrieval cue associated with extinction in attenuating resurgence. Experiment 1 established that a 2-s cue paired with outcome delivery in Phase 2 can attenuate resurgence when presented during testing. This effect depended on the cue being associated with the outcome, and it occurred if the cue was delivered contingently or noncontingently on responding during testing. Pairing the cue with reinforcement might be necessary to maintain attention to it during Phase 2. Experiment 2 demonstrated that the cue must be experienced in sessions that also include R1 extinction and that it does not reduce resurgence through a conditioned reinforcement mechanism. The results suggest that previously neutral stimuli can attenuate resurgence if they are first paired with alternative reinforcement and presented in sessions in which R1 is extinguished. They build on existing literature that suggests enhancing generalization between extinction and testing reduces resurgence. The results may have implications for reducing relapse following interventions in humans such as contingency management (CM), in which participants can earn vouchers contingent upon drug abstinence. A cue associated with CM might help reduce this relapse.

Inactivation of the Prelimbic Cortex Attenuates Context-Dependent Operant Responding.

Operant responding in rats provides an analog to voluntary behavior in humans and is used to study maladaptive behaviors, such as overeating, drug taking, or relapse. In renewal paradigms, extinguished behavior recovers when tested outside the context where extinction was learned. Inactivation of the prelimbic (PL) region of the medial prefrontal cortex by baclofen/muscimol (B/M) during testing attenuates renewal when tested in the original acquisition context after extinction in another context (ABA renewal). Two experiments tested the hypothesis that the PL is important in context-dependent responding learned during conditioning. In the first, rats learned to lever-press for a sucrose-pellet reward. Following acquisition, animals were infused with either B/M or vehicle in the PL and tested in the acquisition context (A) and in a different context (B). All rats showed a decrement in responding when switched from Context A to Context B, but PL inactivation decreased responding only in Context A. Experiment 2a examined the effects of PL inactivation on ABC renewal in the same rats. Here, following reacquisition of the response, responding was extinguished in a new context (C). Following infusions of B/M or vehicle in the PL, responding was tested in Context C and another new context (D). The rats exhibited ACD renewal regardless of PL inactivation. Experiment 2b demonstrated that PL inactivation attenuated the ABA renewal effect in the same animals, replicating earlier results and demonstrating that cannulae were still functional. The results suggest that, rather than attenuating renewal generally, PL inactivation specifically affects ABA renewal by reducing responding in the conditioning context.SIGNIFICANCE STATEMENT Extinguished operant behavior can recover ("renew") when tested outside the extinction context. This suggests that behaviors, such as overeating or drug taking, might be especially prone to relapse following treatment. In rats, inactivation of the prelimbic cortex (PL) attenuates renewal. However, we report that PL inactivation after training attenuates responding in the context in which responding was acquired, but not in another one. A similar inactivation has no impact on renewal when testing occurs in a new, rather than the original, context following extinction. The PL thus has a more specific role in controlling contextually dependent operant behavior than has been previously reported.

Inactivation of prelimbic and infralimbic cortex respectively affects minimally-trained and extensively-trained goal-directed actions.

Several studies have examined a role for the prelimbic cortex (PL) and infralimbic cortex (IL) in free operant behavior. The general conclusion has been that PL controls goal-directed actions (instrumental behaviors that are sensitive to reinforcer devaluation) whereas IL controls habits (instrumental behaviors that are not sensitive to reinforcer devaluation). To further examine the involvement of these regions in the expression of instrumental behavior, we first implanted male rats with bilateral guide cannulae into their PL, then trained two responses to produce a sucrose pellet reinforcer, R1 and R2, each in a distinct context. R1 received extensive training and R2 received minimal training. Rats then received lithium chloride injections either paired or unpaired with sucrose pellets in both contexts until paired rats rejected all pellets. Following acquisition, in Experiment 1, rats received either an infusion of saline or baclofen/muscimol into the PL and were tested (in extinction) on both R1 and R2. In vehicle controls, both responses were goal-directed actions, as indicated by their sensitivity to reinforcer devaluation. PL inactivation decreased expression of the minimally-trained action without affecting expression of the extensively-trained action. Experiment 2 utilized the same experimental design but with IL inactivation at test. The extensively-trained response was again a goal-directed action. However, now expression of the extensively-trained goal-directed action was suppressed by IL inactivation. The overall pattern of results suggests that the PL is involved in expression of minimally trained goal-directed behavior while the IL is involved in expression of extensively trained goal-directed behavior. This implies that the PL does not control all types of actions and the IL can control some types of actions. These results expand upon the traditional view that the PL controls action while the IL controls habit.

Retrieval practice after multiple context changes, but not long retention intervals, reduces the impact of a final context change on instrumental behavior.

Recent evidence from this laboratory suggests that a context switch after operant learning consistently results in a decrement in responding. One way to reduce this decrement is to train the response in multiple contexts. One interpretation of this result, rooted in stimulus sampling theory, is that conditioning of a greater number of common stimulus elements arising from more contexts causes better generalization to new contexts. An alternative explanation is that each change of context causes more effortful retrieval, and practice involving effortful retrieval results in learning that is better able to transfer to new situations. The current experiments were designed to differentiate between these two explanations for the first time in an animal learning and memory task. Experiment 1 demonstrated that the detrimental impact of a context change on an instrumental nose-poking response can be reduced by training the response in multiple contexts. Experiment 2 then found that a training procedure which inserted extended retention intervals between successive training sessions did not reduce the detrimental impact of a final context change. This occurred even though the inserted retention intervals had a detrimental impact on responding (and, thus, presumably retrieval) similar to the effect that context switches had in Experiment 1. Together, the results suggest that effortful retrieval practice may not be sufficient to reduce the negative impact of a context change on instrumental behavior. A common elements explanation which supposes that physical and temporal contextual cues do not overlap may account for the findings more readily.

Role of the discriminative properties of the reinforcer in resurgence.

In three experiments with rat subjects, we examined the effects of the discriminative effects of reinforcers that were presented during or after operant extinction. Experiments 1 and 2 examined resurgence, in which an extinguished operant response (R1) recovers when a second behavior (R2) that has been reinforced to replace it is also placed in extinction. The results of Experiment 1 suggest that the amount of R1's resurgence is a decreasing linear function of the interreinforcement interval used during the reinforcement of R2. In Experiment 2, R1 was reinforced with one outcome (O1), and R2 was then reinforced with a second outcome (O2) while R1 was extinguished. In resurgence tests, response-independent (noncontingent) presentations of O2 prevented resurgence of R1, which otherwise occurred when testing was conducted with either no reinforcers or noncontingent presentations of O1. In Experiment 3, we then examined the effects of noncontingent O1 and O2 presentations after simple extinction in either the presence or the absence of noncontingent presentations of O2. Overall, the results are consistent with a role for the discriminative properties of the reinforcer in controlling operant behavior. In resurgence, the reinforcer used during response elimination provides a distinct context that controls the inhibition of R1. The results are less consistent with an alternative view emphasizing the disrupting effects of alternative reinforcement.

Discriminative properties of the reinforcer can be used to attenuate the renewal of extinguished operant behavior.

Previous research on the resurgence effect has suggested that reinforcers that are presented during the extinction of an operant behavior can control inhibition of the response. To further test this hypothesis, in three experiments with rat subjects we examined the effectiveness of using reinforcers that were presented during extinction as a means of attenuating or inhibiting the operant renewal effect. In Experiment 1, lever pressing was reinforced in Context A, extinguished in Context B, and then tested in Context A. Renewal of responding that occurred during the final test was attenuated when a distinct reinforcer that had been presented independent of responding during extinction was also presented during the renewal test. Experiment 2 established that this effect depended on the reinforcer being featured as a part of extinction (and thus associated with response inhibition). Experiment 3 then showed that the reinforcers presented during extinction suppressed performance in both the extinction and renewal contexts; the effects of the physical and reinforcer contexts were additive. Together, the results further suggest that reinforcers associated with response inhibition can serve a discriminative role in suppressing behavior and may be an effective stimulus that can attenuate operant relapse.

Contextual control of operant behavior: evidence for hierarchical associations in instrumental learning.

Recent research has suggested that operant responses can be weakened when they are tested in new contexts. The present experiment was therefore designed to test whether animals can learn a context-(R-O) relation. Rats were given training sessions in context A, in which one response (R1; lever pressing or chain pulling) produced one outcome (O1) and another response (R2; chain pulling or lever pressing) produced another outcome (O2) on variable interval reinforcement schedules. These sessions were intermixed with training in context B, where R1 now produced O2 and R2 produced O1. Given the arrangement, it was possible for the animal to learn two distinct R-O associations in each specific context. To test for them, rats were then given aversion conditioning with O2 by pairing its presentation with lithium-chloride-induced illness. Following the aversion conditioning, the rats were given an extinction test with both R1 and R2 available in each context. During testing, rats showed a selective suppression in each context of the response that had been paired with the reinforcer subsequently associated with illness. Rats could not have performed this way without knowledge of the R-O associations in effect in each specific context, lending support to the hypothesis that rats learn context-(R-O) associations. However, despite a complete aversion to O2, responding was not completely suppressed, leaving the possibility open that rats form context-R associations in addition to context-(R-O) associations.