Decoding context memories for threat in large-scale neural networks.

Humans are often tasked with determining the degree to which a given situation poses threat. Salient cues present during prior events help bring online memories for context, which plays an informative role in this process. However, it is relatively unknown whether and how individuals use features of the environment to retrieve context memories for threat, enabling accurate inferences about the current level of danger/threat (i.e. retrieve appropriate memory) when there is a degree of ambiguity surrounding the present context. We leveraged computational neuroscience approaches (i.e. independent component analysis and multivariate pattern analyses) to decode large-scale neural network activity patterns engaged during learning and inferring threat context during a novel functional magnetic resonance imaging task. Here, we report that individuals accurately infer threat contexts under ambiguous conditions through neural reinstatement of large-scale network activity patterns (specifically striatum, salience, and frontoparietal networks) that track the signal value of environmental cues, which, in turn, allows reinstatement of a mental representation, primarily within a ventral visual network, of the previously learned threat context. These results provide novel insight into distinct, but overlapping, neural mechanisms by which individuals may utilize prior learning to effectively make decisions about ambiguous threat-related contexts as they navigate the environment.

Decoding neural reactivation of threat during fear learning, extinction, and recall in a randomized clinical trial of L-DOPA among women with PTSD.

BACKGROUND: Laboratory paradigms are widely used to study fear learning in posttraumatic stress disorder (PTSD). Recent basic science models demonstrate that, during fear learning, patterns of activity in large neuronal ensembles for the conditioned stimuli (CS) begin to reinstate neural activity patterns for the unconditioned stimuli (US), suggesting a direct way of quantifying fear memory strength for the CS. Here, we translate this concept to human neuroimaging and test the impact of post-learning dopaminergic neurotransmission on fear memory strength during fear acquisition, extinction, and recall among women with PTSD in a re-analysis of previously reported data. METHODS: Participants (N = 79) completed a context-dependent fear acquisition and extinction task on day 1 and extinction recall tests 24 h later. We decoded activity patterns in large-scale functional networks for the US, then applied this decoder to activity patterns toward the CS on day 1 and day 2. RESULTS: US decoder output for the CS+ increased during acquisition and decreased during extinction in networks traditionally implicated in human fear learning. The strength of US neural reactivation also predicted individuals skin conductance responses. Participants randomized to receive L-DOPA (n = 43) following extinction on day 1 demonstrated less US neural reactivation on day 2 relative to the placebo group (n = 28). CONCLUSION: These results support neural reactivation as a measure of memory strength between competing memories of threat and safety and further demonstrate the role of dopaminergic neurotransmission in the consolidation of fear extinction memories.

Pattern separation of fear extinction memory.

While fear generalizes widely, extinction is stimulus-specific. Using a hybrid conditioning/episodic memory paradigm, subjects encoded nonrepeating category exemplars during fear conditioning and extinction. Twenty-four hours later, a surprise memory test included old, similar, and novel category exemplars. Results showed strong dissociation between pattern completion (generalization) and pattern separation (discrimination) in episodic memory for items encoded during fear conditioning versus extinction, respectively. These data suggest that directly threat-conditioned stimuli are better recognized at the expense of mnemonic precision, whereas discrimination is enhanced for extinguished stimuli. Overly precise extinction memory may be a contributing factor to fear relapse.

Rewarded Extinction Increases Amygdalar Connectivity and Stabilizes Long-Term Memory Traces in the vmPFC.

Neurobiological evidence in rodents indicates that threat extinction incorporates reward neurocircuitry. Consequently, incorporating reward associations with an extinction memory may be an effective strategy to persistently attenuate threat responses. Moreover, while there is considerable research on the short-term effects of extinction strategies in humans, the long-term effects of extinction are rarely considered. In a within-subjects fMRI study with both female and male participants, we compared counterconditioning (CC; a form of rewarded-extinction) to standard extinction at recent (24 h) and remote (approximately one month) retrieval tests. Relative to standard extinction, rewarded extinction diminished 24-h relapse of arousal and threat expectancy, and reduced activity in brain regions associated with the appraisal and expression of threat (e.g., thalamus, insula, periaqueductal gray). The retrieval of reward-associated extinction memory was accompanied by functional connectivity between the amygdala and the ventral striatum, whereas the retrieval of standard-extinction memories was associated with connectivity between the amygdala and ventromedial prefrontal cortex (vmPFC). One month later, the retrieval of both standard-extinction and rewarded-extinction was associated with amygdala-vmPFC connectivity. However, only rewarded extinction created a stable memory trace in the vmPFC, identified through overlapping multivariate patterns of fMRI activity from extinction to 24-h and one-month retrieval. These findings provide new evidence that reward may generate a more stable and enduring memory trace of attenuated threat in humans.SIGNIFICANCE STATEMENT Prevalent treatments for pathologic fear and anxiety are based on the principles of Pavlovian extinction. Unfortunately, extinction forms weak memories that only temporarily inhibit the retrieval of threat associations. Thus, to increase the translational relevance of extinction research, it is critical to investigate whether extinction can be augmented to form a more enduring memory, especially after long intervals. Here, we used a multiday fMRI paradigm in humans to compare the short-term and long-term neurobehavioral effects of aversive-to-appetitive counterconditioning (CC), a form of augmented extinction. Our results provide novel evidence that including an appetitive stimulus during extinction can reduce short-term threat relapse and stabilize the memory trace of extinction in the ventromedial prefrontal cortex (vmPFC), for at least one month after learning.

Counterconditioning reduces contextual renewal in a novel context but not in the acquisition context.

As extinction is a context-dependent form of learning, conditioned responses tend to return when the conditioned stimulus (CS) is encountered outside the extinction context, known as contextual renewal. Counterconditioning is a technique that may lead to a more persistent reduction of the conditioned response. However, the effects of aversive-to-appetitive counterconditioning on contextual renewal in rodent studies are mixed. Further, research in humans is sparse, particularly direct statistical comparisons between counterconditioning and standard extinction techniques within the same study. Using a causal associative learning framework (the allergist task) implemented online, we compared the effectiveness of counterconditioning to standard extinction in preventing the renewal of judgements on the allergic properties of different food items (CSs). In a between-subjects design, 328 participants first learned that particular food items (CSs) lead to an allergic reaction in a specific restaurant (context A). Next, one CS was extinguished (no allergic reaction) while another CS was counterconditioned (positive outcome) in restaurant B. Causal judgements of the allergic properties of food items occurred in either the response acquisition context (ABA group, N = 112), the response reduction context where extinction and counterconditioning had occurred (ABB group, N = 107), or a novel context (ABC group, N = 109). Results showed that counterconditioning, compared to extinction, diminished the renewal of causal judgements to the CS in a novel context (ABC group). Still, casual judgements returned for both counter-conditioned and extinguished CSs in the response acquisition context (ABA group). Counterconditioning and extinction were similarly effective at preventing recovery of causal judgements in the response reduction context (ABB group); however, only in context B did participants choose the counter-conditioned CS as less likely to cause an allergic reaction in comparison to the extinguished CS. These findings indicate scenarios in which counterconditioning is more effective than standard extinction at diminishing the return of threat associations, with implications for improving the generalization of safety learning.

Does social rigidity predict cognitive rigidity? Profiles of socio-cognitive polarization.

Recent research has proposed a relationship between rigid political ideologies and underlying 'cognitive styles'. However, there remain discrepancies in how both social and cognitive rigidity are defined and measured. Problem-solving, or the ability to generate novel ideas by exploring unusual reasoning paths and challenging rigid perspectives around us, is often used to operationalize cognitive flexibility. Thus, we hypothesized a relation between forms of social rigidity, including Socio-cognitive polarization (i.e., a factor capturing conservative political ideology, absolutism/intolerance of ambiguity, and xenophobia), bullshit receptivity (i.e., overestimating pseudo-profound statements), overclaiming (tendency to self-enhance), and cognitive rigidity (i.e., problem-solving). Our results showed differences in performance on problem-solving tasks between four latent profiles of social rigidity identified in our sample. Specifically, those low in socio-cognitive polarization, bullshit, and overclaiming (i.e., less rigid) performed the best on problem-solving. Thus, we conclude that social and cognitive rigidity may share an underlying socio-cognitive construct, wherein those who are more socially rigid are also more likely to be also cognitively rigid when processing non-social information.

Large-scale neural network computations and multivariate representations during approach-avoidance conflict decision-making.

Many real-world situations require navigating decisions for both reward and threat. While there has been significant progress in understanding mechanisms of decision-making and mediating neurocircuitry separately for reward and threat, there is limited understanding of situations where reward and threat contingencies compete to create approach-avoidance conflict (AAC). Here, we leverage computational learning models, independent component analysis (ICA), and multivariate pattern analysis (MVPA) approaches to understand decision-making during a novel task that embeds concurrent reward and threat learning and manipulates congruency between reward and threat probabilities. Computational modeling supported a modified reinforcement learning model where participants integrated reward and threat value into a combined total value according to an individually varying policy parameter, which was highly predictive of decisions to approach reward vs avoid threat during trials where the highest reward option was also the highest threat option (i.e., approach-avoidance conflict). ICA analyses demonstrated unique roles for salience, frontoparietal, medial prefrontal, and inferior frontal networks in differential encoding of reward vs threat prediction error and value signals. The left frontoparietal network uniquely encoded degree of conflict between reward and threat value at the time of choice. MVPA demonstrated that delivery of reward and threat could accurately be decoded within salience and inferior frontal networks, respectively, and that decisions to approach reward vs avoid threat were predicted by the relative degree to which these reward vs threat representations were active at the time of choice. This latter result suggests that navigating AAC decisions involves generating mental representations for possible decision outcomes, and relative activation of these representations may bias subsequent decision-making towards approaching reward or avoiding threat accordingly.

Emotional learning retroactively enhances item memory but distorts source attribution.

An adaptive memory system should prioritize information surrounding a powerful learning event that may prove useful for predicting future meaningful events. The behavioral tagging hypothesis provides a mechanistic framework to interpret how weak experiences persist as durable memories through temporal association with a strong experience. Memories are composed of multiple elements, and different mnemonic aspects of the same experience may be uniquely affected by mechanisms that retroactively modulate a weakly encoded memory. Here, we investigated how emotional learning affects item and source memory for related events encoded close in time. Participants encoded trial-unique category exemplars before, during, and after Pavlovian fear conditioning. Selective retroactive enhancements in 24-h item memory were accompanied by a bias to misattribute items to the temporal context of fear conditioning. The strength of this source memory bias correlated with participants' retroactive item memory enhancement, and source misattribution to the emotional context predicted whether items were remembered overall. In the framework of behavioral tagging: Memory attribution was biased to the temporal context of the stronger event that provided the putative source of memory stabilization for the weaker event. We additionally found that fear conditioning selectively and retroactively enhanced stimulus typicality ratings for related items, and that stimulus typicality also predicted overall item memory. Collectively, these results provide new evidence that items related to emotional learning are misattributed to the temporal context of the emotional event and judged to be more representative of their semantic category. Both processes may facilitate memory retrieval for related events encoded close in time.

Elemental and configural threat learning bias extinction generalization.

Emotional experiences often contain a multitude of details that may be represented in memory as individual elements or integrated into a single representation. How details associated with a negative emotional event are represented in memory can have important implications for extinction strategies designed to reduce emotional responses. For example, is extinguishing one cue associated with an aversive outcome sufficient to reduce learned behavior to other cues present at the time of learning that were not directly extinguished? Here, we used a between-subjects multi-day threat conditioning and extinction task to assess whether participants generalize extinction from one cue to unextinguished cues. On Day 1, one group of participants learned that a compound conditioned stimulus, composed of a tone and colored square, predicted an uncomfortable shock to the wrist (Compound group). A second group learned that the tone and square separately predicted shock (Separate group). On Day 2, participants in both groups were exposed to the tone in the absence of shocks (cue extinction). On Day 3, we tested whether extinction generalized from the extinguished to the unextinguished cue, as well as to a compound composed of both cues. Results showed that configural and elemental learning had unique and opposite effects on extinction generalization. Subjects who initially learned that a compound cue predicted shock successfully generalized extinction learning from the tone to the square, but exhibited threat relapse to the compound cue. In contrast, subjects who initially learned that each cue individually predicted shock did not generalize extinction learning from the tone to the square, but threat responses to the compound were low. These results highlight the importance of whether details of an aversive event are represented as integrated or separated memories, as these representations affect the success or limits of extinction generalization.

Emotional learning selectively and retroactively strengthens memories for related events.

Neurobiological models of long-term memory propose a mechanism by which initially weak memories are strengthened through subsequent activation that engages common neural pathways minutes to hours later. This synaptic tag-and-capture model has been hypothesized to explain how inconsequential information is selectively consolidated following salient experiences. Behavioural evidence for tag-and-capture is provided by rodent studies in which weak early memories are strengthened by future behavioural training. Whether a process of behavioural tagging occurs in humans to transform weak episodic memories into stable long-term memories is unknown. Here we show, in humans, that information is selectively consolidated if conceptually related information, putatively represented in a common neural substrate, is made salient through an emotional learning experience. Memory for neutral objects was selectively enhanced if other objects from the same category were paired with shock. Retroactive enhancements as a result of emotional learning were observed following a period of consolidation, but were not observed in an immediate memory test or for items strongly encoded before fear conditioning. These findings provide new evidence for a generalized retroactive memory enhancement, whereby inconsequential information can be retroactively credited as relevant, and therefore selectively remembered, if conceptually related information acquires salience in the future.

Stimulus generalization as a mechanism for learning to trust.

How do humans learn to trust unfamiliar others? Decisions in the absence of direct knowledge rely on our ability to generalize from past experiences and are often shaped by the degree of similarity between prior experience and novel situations. Here, we leverage a stimulus generalization framework to examine how perceptual similarity between known individuals and unfamiliar strangers shapes social learning. In a behavioral study, subjects play an iterative trust game with three partners who exhibit highly trustworthy, somewhat trustworthy, or highly untrustworthy behavior. After learning who can be trusted, subjects select new partners for a second game. Unbeknownst to subjects, each potential new partner was parametrically morphed with one of the three original players. Results reveal that subjects prefer to play with strangers who implicitly resemble the original player they previously learned was trustworthy and avoid playing with strangers resembling the untrustworthy player. These decisions to trust or distrust strangers formed a generalization gradient that converged toward baseline as perceptual similarity to the original player diminished. In a second imaging experiment we replicate these behavioral gradients and leverage multivariate pattern similarity analyses to reveal that a tuning profile of activation patterns in the amygdala selectively captures increasing perceptions of untrustworthiness. We additionally observe that within the caudate adaptive choices to trust rely on neural activation patterns similar to those elicited when learning about unrelated, but perceptually familiar, individuals. Together, these findings suggest an associative learning mechanism efficiently deploys moral information encoded from past experiences to guide future choice.

The effects of aversive-to-appetitive counterconditioning on implicit and explicit fear memory.

Counterconditioning (CC) is a form of retroactive interference that inhibits expression of learned behavior. But similar to extinction, CC can be a fairly weak and impermanent form of interference, and the original behavior is prone to relapse. Research on CC is limited, especially in humans, but prior studies suggest it is more effective than extinction at modifying some behaviors (e.g., preference or valence ratings) than others (e.g., physiological arousal). Here, we used a within-subjects design to compare the effects of aversive-to-appetitive CC versus standard extinction on two separate tests of long-term memory in human adults: implicit physiological arousal and explicit episodic memory. Participants underwent Pavlovian fear conditioning to two semantic categories (animals, tools) paired with an electric shock. Conditioned stimuli (i.e., category exemplars) from one category were then extinguished, while stimuli from the other category were paired with a positive outcome. Participants returned 24-h later for a test of skin conductance responses (SCR) to the conditioned exemplars, as well as a surprise recognition memory test for stimuli encoded the previous day. Results showed reduced SCRs at a test for unique stimuli from a category that had undergone CC, relative to stimuli from a category that had undergone standard extinction. Additionally, participants selectively remembered more stimuli encoded during CC than extinction. These results provide new evidence that aversive-to-appetitive CC, as compared to extinction, strengthens memory for items directly associated with a positive outcome, which may provide stronger retrieval competition against a fear memory at test to help diminish fear relapse.

Role of Human Ventromedial Prefrontal Cortex in Learning and Recall of Enhanced Extinction.

Standard fear extinction relies on the ventromedial prefrontal cortex (vmPFC) to form a new memory given the omission of threat. Using fMRI in humans, we investigated whether replacing threat with novel neutral outcomes (instead of just omitting threat) facilitates extinction by engaging the vmPFC more effectively than standard extinction. Computational modeling of associability (indexing surprise strength and dynamically modulating learning rates) characterized skin conductance responses and vmPFC activity during novelty-facilitated but not standard extinction. Subjects who showed faster within-session updating of associability during novelty-facilitated extinction also expressed better extinction retention the next day, as expressed through skin conductance responses. Finally, separable patterns of connectivity between the amygdala and ventral versus dorsal mPFC characterized retrieval of novelty-facilitated versus standard extinction memories, respectively. These results indicate that replacing threat with novel outcomes stimulates vmPFC involvement on extinction trials, leading to a more durable long-term extinction memory.SIGNIFICANCE STATEMENT Psychiatric disorders characterized be excessive fear are a major public health concern. Popular clinical treatments, such as exposure therapy, are informed by principles of Pavlovian extinction. Thus, there is motivation to optimize extinction strategies in the laboratory so as to ultimately develop more effective clinical treatments. Here, we used functional neuroimaging in humans and found that replacing (rather than just omitting) expected aversive events with novel and neutral outcomes engages the ventromedial prefrontal cortex during extinction learning. Enhanced extinction also diminished activity in threat-related networks (e.g., the insula, thalamus) during immediate extinction and a 24 h extinction retention test. This is new evidence for how behavioral protocols designed to enhance extinction affects neurocircuitry underlying the learning and retention of extinction memories.

Threat-induced modulation of hippocampal and striatal memory systems during navigation of a virtual environment.

The brain is composed of multiple memory systems that mediate distinct types of navigation. The hippocampus is important for encoding and retrieving allocentric spatial cognitive maps, while the dorsal striatum mediates procedural memories based on stimulus-response (S-R) associations. These memory systems are differentially affected by emotional arousal. In particular, rodent studies show that stress typically impairs hippocampal spatial memory while it spares or sometimes enhances striatal S-R memory. The influence of emotional arousal on these separate navigational memory systems has received less attention in human subjects. We investigated the effect of dynamic changes in anticipatory anxiety on hippocampal spatial and dorsal striatal S-R memory systems while participants attempted to solve a virtual eight-arm radial maze. In Experiment 1, participants completed a hippocampus-dependent spatial version of the eight-arm radial maze that required allocentric spatial memory to successfully navigate the environment. In Experiment 2, participants completed a dorsal striatal S-R version of the maze where no allocentric spatial cues were present, requiring the use of S-R navigation. Anticipatory anxiety was modulated via threat of receiving an unpleasant electrical shock to the wrist during memory retrieval. Results showed that threat of shock was associated with more errors and increased use of non-spatial navigational strategies in the hippocampal spatial task, but did not influence memory performance in the striatal S-R task. Findings indicate a dissociation regarding the influence of anticipatory anxiety on memory systems that has implications for understanding how fear and anxiety contribute to memory-related symptoms in human psychopathologies.

Stress promotes generalization of older but not recent threat memories.

Stress broadly affects the ability to regulate emotions and may contribute to generalization of threat-related behaviors to harmless stimuli. Behavioral generalization also tends to increase over time as memory precision for recent events gives way to more gist-like representations. Thus, acute stress coupled with a delay in time from a negative experience may be a strong predictor of the transition from normal to generalized fear expression. Here, we investigated the effect of a single-episode acute stressor on generalization of aversive learning when stress is administered either immediately after an aversive learning event or following a delay. In a between-subjects design, healthy adult volunteers underwent threat (fear) conditioning using a tone-conditioned stimulus paired with an electric shock to the wrist and another tone not paired with shock. Behavioral generalization was tested to a range of novel tones either on the same day (experiment 1) or 24 h later (experiment 2) and was preceded by either an acute stress induction or a control task. Anticipatory sympathetic arousal [i.e., skin conductance responses (SCRs)] and explicit measures of shock expectancy served as dependent measures. Stress administered shortly after threat conditioning did not affect behavioral generalization. In contrast, stress administered following a delay led to heightened arousal and increased generalization of SCRs and explicit measures of shock expectancy. These findings show that acute stress increases generalization of older but not recent threat memories and have clinical relevance to understanding overgeneralization characteristics of anxiety and stress-related disorders.

Reward retroactively enhances memory consolidation for related items.

Reward motivation has been shown to modulate episodic memory processes in order to support future adaptive behavior. However, for a memory system to be truly adaptive, it should enhance memory for rewarded events as well as for neutral events that may seem inconsequential at the time of encoding but can gain importance later. Here, we investigated the influence of reward motivation on retroactive memory enhancement selectively for conceptually related information. We found behavioral evidence that reward retroactively enhances memory at a 24-h memory test, but not at an immediate memory test, suggesting a role for post-encoding mechanisms of consolidation.

Associative Learning of Social Value in Dynamic Groups.

Although humans live in societies that regularly demand engaging with multiple people simultaneously, little is known about social learning in group settings. In two experiments, we combined a Pavlovian learning framework with dyadic economic games to test whether blocking mechanisms support value-based social learning in the gain (altruistic dictators) and loss (greedy robbers) domains. Subjects first learned about an altruistic dictator, who subsequently made altruistic splits collectively with a partner. Results revealed that because the presence of the dictator already predicted the outcome, subjects did not learn to associate value with the partner. This social blocking effect was not observed in the loss domain: A kind robber's partner, who could steal all the subjects' money but stole little, acquired highly positive value-which biased subjects' subsequent behavior. These findings reveal how Pavlovian mechanisms support efficient social learning, while also demonstrating that violations of social expectations can attenuate how readily these mechanisms are recruited.

Adaptive memory systems for remembering the salient and the seemingly mundane.

In an adaptive memory system, events should be prioritized in memory based on their own significance, as well as the significance of preceding or following events. Here we argue that tag-and-capture models complement the GANE (glutamate amplifies noradrenergic effects) model by describing a mechanism that supports the transfer of memory benefits from one event to the next.

Compound stimulus extinction reduces spontaneous recovery in humans.

Fear-related behaviors are prone to relapse following extinction. We tested in humans a compound extinction design ("deepened extinction") shown in animal studies to reduce post-extinction fear recovery. Adult subjects underwent fear conditioning to a visual and an auditory conditioned stimulus (CSA and CSB, respectively) separately paired with an electric shock. The target CS (CSA) was extinguished alone followed by compound presentations of the extinguished CSA and nonextinguished CSB. Recovery of conditioned skin conductance responses to CSA was reduced 24 h after compound extinction, as compared with a group who received an equal number of extinction trials to the CSA alone.

Aversive learning modulates cortical representations of object categories.

Experimental studies of conditioned learning reveal activity changes in the amygdala and unimodal sensory cortex underlying fear acquisition to simple stimuli. However, real-world fears typically involve complex stimuli represented at the category level. A consequence of category-level representations of threat is that aversive experiences with particular category members may lead one to infer that related exemplars likewise pose a threat, despite variations in physical form. Here, we examined the effect of category-level representations of threat on human brain activation using 2 superordinate categories (animals and tools) as conditioned stimuli. Hemodynamic activity in the amygdala and category-selective cortex was modulated by the reinforcement contingency, leading to widespread fear of different exemplars from the reinforced category. Multivariate representational similarity analyses revealed that activity patterns in the amygdala and object-selective cortex were more similar among exemplars from the threat versus safe category. Learning to fear animate objects was additionally characterized by enhanced functional coupling between the amygdala and fusiform gyrus. Finally, hippocampal activity co-varied with object typicality and amygdala activation early during training. These findings provide novel evidence that aversive learning can modulate category-level representations of object concepts, thereby enabling individuals to express fear to a range of related stimuli.