Olfactory threat extinction in the piriform cortex: An age-dependent employment of NMDA receptor-dependent long-term depression.

Extinction of threat memory is a measure of behavioral flexibility. In the absence of additional reinforcement, the extinction of learned behaviors allows animals and humans to adapt to their changing environment. Extinction mechanisms and their therapeutic implications for maladaptive learning have been extensively studied. However, how aging affects extinction learning is much less understood. Using a rat model of olfactory threat extinction, we show that the extinction of olfactory threat memory is impaired in aged Sprague-Darley rats. Following extinction training, long-term depression (LTD) in the piriform cortex (PC) was inducible ex vivo in aged rats and was NMDA receptor (NMDAR)-independent. On the other hand, adult rats acquired successful olfactory threat extinction, and LTD was not inducible following extinction training. Neuronal cFos activation in the posterior PC correlated with learning and extinction performance in rats. NMDAR blockade either systemically or locally in the PC during extinction training prevented successful extinction in adult rats, following which NMDAR-dependent LTD became inducible ex vivo. This suggests that extinction learning employs NMDAR-dependent LTD mechanisms in the PC of adult rats, thus occluding further LTD induction ex vivo. The rescue of olfactory threat extinction in aged rats by D-cycloserine, a partial NMDAR agonist, suggests that the impairment in olfactory threat extinction of aged animals may relate to NMDAR hypofunctioning and a lack of NMDAR-dependent LTD. These findings are consistent with an age-related switch from NMDAR-dependent to NMDAR-independent LTD in the PC. Optimizing NMDAR function in sensory cortices may improve learning and flexible behavior in the aged population.

Spaced conditioned stimulus presentation facilitates the extinction of strong fear memory in mice.

Inducing fear memory extinction by re-presenting a conditioned stimulus (CS) is the foundation of exposure therapy for post-traumatic stress disorder (PTSD). Investigating differences in the ability of different CS presentation patterns to induce extinction learning is crucial for improving this type of therapy. Using a trace fear conditioning paradigm in mice, we demonstrate that spaced presentation of the CS facilitated the extinction of a strong fear memory to a greater extent than continuous CS presentation. These results lay the groundwork for developing more effective exposure therapy techniques for PTSD.

Neural underpinnings of preferential pain learning and the modulatory role of fear.

Due to its unique biological relevance, pain-related learning might differ from learning from other aversive experiences. This functional magnetic resonance imaging study compared neural mechanisms underlying the acquisition and extinction of different threats in healthy humans. We investigated whether cue-pain associations are acquired faster and extinguished slower than cue associations with an equally unpleasant tone. Additionally, we studied the modulatory role of stimulus-related fear. Therefore, we used a differential conditioning paradigm, in which somatic heat pain stimuli and unpleasantness-matched auditory stimuli served as US. Our results show stronger acquisition learning for pain- than tone-predicting cues, which was augmented in participants with relatively higher levels of fear of pain. These behavioral findings were paralleled by activation of brain regions implicated in threat processing (insula, amygdala) and personal significance (ventromedial prefrontal cortex). By contrast, extinction learning seemed to be less dependent on the threat value of the US, both on the behavioral and neural levels. Amygdala activity, however, scaled with pain-related fear during extinction learning. Our findings on faster and stronger (i.e. "preferential") pain learning and the role of fear of pain are consistent with the biological relevance of pain and may be relevant to the development or maintenance of chronic pain.

Cortisol decreases activation in extinction related brain areas resulting in an impaired recall of context-dependent extinction memory.

Conditioned responding gradually stops during successful extinction learning. The renewal effect is defined as the recovery of a extinguished conditioned response when the context of extinction is different from acquisition. The stress hormone cortisol is known to have an influence on extinction memory and associative learning. Different effects of cortisol on behaviour and brain activity have been observed with respect to stress timing, duration, and intensity. However, the influence of cortisol prior to the initial encoding of stimulus-outcome associations on extinction learning, renewal and its behavioural and neurobiological correlates is still largely unknown. In our study, 60 human participants received 20 mg cortisol or placebo and then learned, extinguished, and recalled the associations between food stimuli presented in distinct contexts and different outcomes in three subsequent task phases. Learning performance during acquisition and extinction phases was equally good for both treatment groups. In the cortisol group, significantly more participants showed renewal compared to placebo. In the subgroup of participants with renewal, cortisol treated participants showed significantly better extinction learning performance compared to placebo. Participants showing renewal had in general difficulties with recalling extinction memory, but in contrast to placebo, the cortisol group exhibited a context-dependent impairment of extinction memory recall. Imaging analyses revealed that cortisol decreased activation in the hippocampus during acquisition. The cortisol group also showed reduced dorsolateral prefrontal cortex activation when extinction learning took place in a different context, but enhanced activation in inferior frontal gyrus during extinction learning without context change. During recall, cortisol decreased ventromedial prefrontal cortex activation. Taken together, our findings illustrate cortisol as a potent modulator of extinction learning and recall of extinction memory which also promotes renewal.

Neuropharmacological Modulation of N-methyl-D-aspartate, Noradrenaline and Endocannabinoid Receptors in Fear Extinction Learning: Synaptic Transmission and Plasticity.

Learning to recognize and respond to potential threats is crucial for survival. Pavlovian threat conditioning represents a key paradigm for investigating the neurobiological mechanisms of fear learning. In this review, we address the role of specific neuropharmacological adjuvants that act on neurochemical synaptic transmission, as well as on brain plasticity processes implicated in fear memory. We focus on novel neuropharmacological manipulations targeting glutamatergic, noradrenergic, and endocannabinoid systems, and address how the modulation of these neurobiological systems affects fear extinction learning in humans. We show that the administration of N-methyl-D-aspartate (NMDA) agonists and modulation of the endocannabinoid system by fatty acid amide hydrolase (FAAH) inhibition can boost extinction learning through the stabilization and regulation of the receptor concentration. On the other hand, elevated noradrenaline levels dynamically modulate fear learning, hindering long-term extinction processes. These pharmacological interventions could provide novel targeted treatments and prevention strategies for fear-based and anxiety-related disorders.

Coordinated Prefrontal State Transition Leads Extinction of Reward-Seeking Behaviors.

Extinction learning suppresses conditioned reward responses and is thus fundamental to adapt to changing environmental demands and to control excessive reward seeking. The medial prefrontal cortex (mPFC) monitors and controls conditioned reward responses. Abrupt transitions in mPFC activity anticipate changes in conditioned responses to altered contingencies. It remains, however, unknown whether such transitions are driven by the extinction of old behavioral strategies or by the acquisition of new competing ones. Using in vivo multiple single-unit recordings of mPFC in male rats, we studied the relationship between single-unit and population dynamics during extinction learning, using alcohol as a positive reinforcer in an operant conditioning paradigm. To examine the fine temporal relation between neural activity and behavior, we developed a novel behavioral model that allowed us to identify the number, onset, and duration of extinction-learning episodes in the behavior of each animal. We found that single-unit responses to conditioned stimuli changed even under stable experimental conditions and behavior. However, when behavioral responses to task contingencies had to be updated, unit-specific modulations became coordinated across the whole population, pushing the network into a new stable attractor state. Thus, extinction learning is not associated with suppressed mPFC responses to conditioned stimuli, but is anticipated by single-unit coordination into population-wide transitions of the internal state of the animal.SIGNIFICANCE STATEMENT The ability to suppress conditioned behaviors when no longer beneficial is fundamental for the survival of any organism. While pharmacological and optogenetic interventions have shown a critical involvement of the mPFC in the suppression of conditioned responses, the neural dynamics underlying such a process are still largely unknown. Combining novel analysis tools to describe behavior, single-neuron response, and population activity, we found that widespread changes in neuronal firing temporally coordinate across the whole mPFC population in anticipation of behavioral extinction. This coordination leads to a global transition in the internal state of the network, driving extinction of conditioned behavior.

Robust BOLD Responses to Faces But Not to Conditioned Threat: Challenging the Amygdala's Reputation in Human Fear and Extinction Learning.

Most of our knowledge about human emotional memory comes from animal research. Based on this work, the amygdala is often labeled the brain's "fear center", but it is unclear to what degree neural circuitries underlying fear and extinction learning are conserved across species. Neuroimaging studies in humans yield conflicting findings, with many studies failing to show amygdala activation in response to learned threat. Such null findings are often treated as resulting from MRI-specific problems related to measuring deep brain structures. Here we test this assumption in a mega-analysis of three studies on fear acquisition (n = 98; 68 female) and extinction learning (n = 79; 53 female). The conditioning procedure involved the presentation of two pictures of faces and two pictures of houses: one of each pair was followed by an electric shock [a conditioned stimulus (CS+)], the other one was never followed by a shock (CS-), and participants were instructed to learn these contingencies. Results revealed widespread responses to the CS+ compared with the CS- in the fear network, including anterior insula, midcingulate cortex, thalamus, and bed nucleus of the stria terminalis, but not the amygdala, which actually responded stronger to the CS- Results were independent of spatial smoothing, and of individual differences in trait anxiety and conditioned pupil responses. In contrast, robust amygdala activation distinguished faces from houses, refuting the idea that a poor signal could account for the absence of effects. Moving forward, we suggest that, apart from imaging larger samples at higher resolution, alternative statistical approaches may be used to identify cross-species similarities in fear and extinction learning.SIGNIFICANCE STATEMENT The science of emotional memory provides the foundation of numerous theories on psychopathology, including stress and anxiety disorders. This field relies heavily on animal research, which suggests a central role of the amygdala in fear learning and memory. However, this finding is not strongly corroborated by neuroimaging evidence in humans, and null findings are too easily explained away by methodological limitations inherent to imaging deep brain structures. In a large nonclinical sample, we find widespread BOLD activation in response to learned fear, but not in the amygdala. A poor signal could not account for the absence of effects. While these findings do not disprove the involvement of the amygdala in human fear learning, they challenge its typical portrayals and illustrate the complexities of translational science.

Stress effects on memory retrieval of aversive and appetitive instrumental counterconditioning in men.

Extinction training creates a second inhibitory memory trace and effectively reduces conditioned responding. However, acute stress inhibits the retrieval of this extinction memory trace. It is not known whether this also applies to other forms of associative learning such as instrumental counterconditioning, where previously learned associations are reversed and paired with the opposite valence. Therefore, the current preregistered study investigates whether stress decreases the retrieval of instrumental counterconditioning memories with aversive and appetitive consequences. Fifty-two healthy men were randomly assigned to either a stress or control group and took part in a two-day instrumental learning paradigm. During a first phase, participants learned that pressing specific buttons in response to the presentation of four neutral stimuli either leads to gaining or losing money. During a second phase, two stimuli reversed their contingencies (counterconditioning). One day later, participants were exposed to acute stress or a control condition prior to the same task, which no longer included feedback about gains or losses. Stressed participants showed more approach behavior towards appetitive and less avoidance behavior towards aversive stimuli as compared to non-stressed participants. Our findings indicate that stress effects on memory retrieval differ depending on the associative learning approach in men. These differences might be related to stress effects on decision making and different motivational systems involved.

NMDA receptor-mediated processing in inferior frontal gyrus facilitates acquisition and extinction learning and strengthens renewal.

While the renewal effect of extinction is considered to be invoked by attention to context during the extinction phase, there is also evidence that processing during initial learning (acquisition) may be important for later renewal. A noradrenergic agonist and a dopaminergic antagonist, administered before acquisition, did not affect renewal, however, the effects of NMDAergic neurotransmission in this regard are as yet unknown. In a previous study, administration of a single dose of the NMDA agonist d-cycloserine (DCS) before extinction learning facilitated extinction in the context of acquisition (AAA), but had no effect upon renewal. In the present fMRI study, DCS was administered prior to the initial acquisition of a predictive learning task, in order to investigate whether NMDA receptor (NMDAR) stimulation at this timepoint will modulate overall learning as well as the level of renewal, while increasing activation in the extinction- and renewal-relevant brain regions of inferior frontal gyrus (iFG) and hippocampus (HC). DCS facilitated acquisition, as well as extinction learning in the context of acquisition (AAA), and raised the level of ABA renewal. While BOLD activation during acquisition did not differ between treatment groups, activation in bilateral iFG showed a double dissociation during processing of AAA extinction trials, with DCS-mediated higher activation in right iFG and deactivation in left iFG. In contrast, placebo showed higher activation in left iFG and deactivation in right iFG. During the test (recall) phase, left iFG and right anterior hippocampus activation was increased in DCS participants who showed renewal, with activation in this region correlating with the ABA renewal level. The results demonstrate that NMDA receptor stimulation can facilitate both initial learning and extinction of associations, and in this way has an impact upon the resultant level of renewal. In particular NMDAergic processing in iFG appears relevant for the facilitation of AAA extinction and ABA recall in the test phase.

The DA-antagonist Tiapride affects context-related extinction learning in a predictive learning task, but not initial forming of associations, or renewal.

Renewal describes the recovery of an extinguished response if the contexts of extinction and recall differ, highlighting the context dependency of extinction. Studies demonstrated dopaminergic (DA) signalling to be important for context-related extinction learning with and without a fear component. In a previous study in humans, administration of the dopamine D2/D3 antagonist tiapride prior to extinction impaired extinction learning in a novel, but not a familiar context, without affecting renewal. In a further study, context processing during initial acquisition of associations was shown to be related to renewal. In this human fMRI study we investigated the potential role of DA signalling during this initial conditioning for the learning process and for renewal. While tiapride, administered prior to the start of learning, did not affect initial acquisition and renewal, extinction learning in a novel context was impaired, associated with reduced BOLD activation in vmPFC, left iFG and ACC - regions mediating response inhibition and selection from competing options using contextual information. Thus, different timepoints of administration of tiapride (before initial conditioning or extinction) had largely similar effects upon extinction and renewal. In addition, retrieval of previously acquired associations was impaired, pointing towards weaker association forming during acquisition. Conceivably, effects of the DA blockade are associated with the challenge present in the respective task rather than the administration timepoint: the cognitive flexibility required for forming a new inhibitory association that includes a novel element clearly requires DA processing, while initial forming of associations, or of inhibitory associations without a new element, apparently rely less on the proper function of the DA system.

Fluoroethylnormemantine, A Novel Derivative of Memantine, Facilitates Extinction Learning Without Sensorimotor Deficits.

BACKGROUND: Memantine, a noncompetitive N-methyl-D-aspartate receptor antagonist, has been approved for use in Alzheimer's disease, but an increasing number of studies have investigated its utility for neuropsychiatric disorders. Here, we characterized a novel compound, fluoroethylnormemtantine (FENM), which was derived from memantine with an extra Fluor in an optimized position for in vivo biomarker labeling. We sought to determine if FENM produced similar behavioral effects as memantine and/or if FENM has beneficial effects against fear, avoidance, and behavioral despair. METHODS: We administered saline, FENM, or memantine prior to a number of behavioral assays, including paired-pulse inhibition, open field, light dark test, forced swim test, and cued fear conditioning in male Wistar rats. RESULTS: Unlike memantine, FENM did not produce nonspecific side effects and did not alter sensorimotor gating or locomotion. FENM decreased immobility in the forced swim test. Moreover, FENM robustly facilitated fear extinction learning when administered prior to either cued fear conditioning training or tone reexposure. CONCLUSIONS: These results suggest that FENM is a promising, novel compound that robustly reduces fear behavior and may be useful for further preclinical testing.

Latent cause inference during extinction learning in trauma-exposed individuals with and without PTSD.

BACKGROUND: Problems in learning that sights, sounds, or situations that were once associated with danger have become safe (extinction learning) may explain why some individuals suffer prolonged psychological distress following traumatic experiences. Although simple learning models have been unable to provide a convincing account of why this learning fails, it has recently been proposed that this may be explained by individual differences in beliefs about the causal structure of the environment. METHODS: Here, we tested two competing hypotheses as to how differences in causal inference might be related to trauma-related psychopathology, using extinction learning data collected from clinically well-characterised individuals with varying degrees of post-traumatic stress (N = 56). Model parameters describing individual differences in causal inference were related to multiple post-traumatic stress disorder (PTSD) and depression symptom dimensions via network analysis. RESULTS: Individuals with more severe PTSD were more likely to assign observations from conditioning and extinction stages to a single underlying cause. Specifically, greater re-experiencing symptom severity was associated with a lower likelihood of inferring that multiple causes were active in the environment. CONCLUSIONS: We interpret these results as providing evidence of a primary deficit in discriminative learning in participants with more severe PTSD. Specifically, a tendency to attribute a greater diversity of stimulus configurations to the same underlying cause resulted in greater uncertainty about stimulus-outcome associations, impeding learning both that certain stimuli were safe, and that certain stimuli were no longer dangerous. In the future, better understanding of the role of causal inference in trauma-related psychopathology may help refine cognitive therapies for these disorders.

Extinction learning alters the neural representation of conditioned fear.

Extinction learning is a primary means by which conditioned associations to threats are controlled and is a model system for emotion dysregulation in anxiety disorders. Recent work has called for new approaches to track extinction-related changes in conditioned stimulus (CS) representations. We applied a multivariate analysis to previously -collected functional magnetic resonance imaging data on extinction learning, in which healthy young adult participants (N = 43; 21 males, 22 females) encountered dynamic snake and spider CSs while passively navigating 3D virtual environments. We used representational similarity analysis to compare voxel-wise activation t-statistic maps for the shock-reinforced CS (CS+) from the late phase of fear acquisition to the early and late phases of extinction learning within subjects. These patterns became more dissimilar from early to late extinction in a priori regions of interest: subgenual and dorsal anterior cingulate gyrus, amygdala and hippocampus. A whole-brain searchlight analysis revealed similar findings in the insula, mid-cingulate cortex, ventrolateral prefrontal cortex, somatosensory cortex, cerebellum, and visual cortex. High state anxiety attenuated extinction-related changes to the CS+ patterning in the amygdala, which suggests an enduring threat representation. None of these effects generalized to an unreinforced control cue, nor were they evident in traditional univariate analyses. Our approach extends previous neuroimaging work by emphasizing how evoked neural patterns change from late acquisition through phases of extinction learning, including those in brain regions not traditionally implicated in animal models. Finally, the findings provide additional support for a role of the amygdala in anxiety-related persistence of conditioned fears.

Continuous exposure to α-glycosyl isoquercitrin from developmental stages to adulthood is necessary for facilitating fear extinction learning in rats.

We previously reported that exposure to α-glycosyl isoquercitrin (AGIQ) from the fetal stage to adulthood facilitated fear extinction learning in rats. The present study investigated the specific AGIQ exposure period sufficient for inducing this behavioral effect. Rats were dietarily exposed to 0.5% AGIQ from the postweaning stage to adulthood (PW-AGIQ), the fetal stage to postweaning stage (DEV-AGIQ), or the fetal stage to adulthood (WP-AGIQ). Fear memory, anxiety-like behavior, and object recognition memory were assessed during adulthood. Fear extinction learning was exclusively facilitated in the WP-AGIQ rats. Synaptic plasticity-related genes showed a similar pattern of constitutive expression changes in the hippocampal dentate gyrus and prelimbic medial prefrontal cortex (mPFC) between the DEV-AGIQ and WP-AGIQ rats. However, WP-AGIQ rats revealed more genes constitutively upregulated in the infralimbic mPFC and amygdala than DEV-AGIQ rats, as well as FOS-immunoreactive(+) neurons constitutively increased in the infralimbic cortex. Ninety minutes after the last fear extinction trial, many synaptic plasticity-related genes (encoding Ephs/Ephrins, glutamate receptors/transporters, and immediate-early gene proteins and their regulator, extracellular signal-regulated kinase 2 [ERK2]) were upregulated in the dentate gyrus and amygdala in WP-AGIQ rats. Additionally, WP-AGIQ rats exhibited increased phosphorylated ERK1/2+ neurons in both the prelimbic and infralimbic cortices. These results suggest that AGIQ exposure from the fetal stage to adulthood is necessary for facilitating fear extinction learning. Furthermore, constitutive and learning-dependent upregulation of synaptic plasticity-related genes/molecules may be differentially involved in brain regions that regulate fear memory. Thus, new learning-related neural circuits for facilitating fear extinction can be established in the mPFC.

Eye-Movement Intervention Enhances Extinction via Amygdala Deactivation.

Improving extinction learning is essential to optimize psychotherapy for persistent fear-related disorders. In two independent studies (both n = 24), we found that goal-directed eye movements activate a dorsal frontoparietal network and transiently deactivate the amygdala (η p2 = 0.17). Connectivity analyses revealed that this downregulation potentially engages a ventromedial prefrontal pathway known to be involved in cognitive regulation of emotion. Critically, when eye movements followed memory reactivation during extinction learning, it reduced spontaneous fear recovery 24 h later (η p2 = 0.21). Stronger amygdala deactivation furthermore predicted a stronger reduction in subsequent fear recovery after reinstatement (r = 0.39). In conclusion, we show that extinction learning can be improved with a noninvasive eye-movement intervention that triggers a transient suppression of the amygdala. Our finding that another task which taxes working memory leads to a similar amygdala suppression furthermore indicates that this effect is likely not specific to eye movements, which is in line with a large body of behavioral studies. This study contributes to the understanding of a widely used treatment for traumatic symptoms by providing a parsimonious account for how working-memory tasks and goal-directed eye movements can enhance extinction-based psychotherapy, namely through neural circuits (e.g., amygdala deactivation) similar to those that support cognitive control of emotion.SIGNIFICANCE STATEMENT Fear-related disorders represent a significant burden on individual sufferers and society. There is a high need to optimize treatment, in particular via noninvasive means. One potentially effective intervention is execution of eye movements following trauma recall. However, a neurobiological understanding of how eye movements reduce traumatic symptoms is lacking. We demonstrate that goal-directed eye-movements, like working-memory tasks, deactivate the amygdala, the core neural substrate of fear learning. Effective connectivity analyses revealed amygdala deactivation potentially engaged dorsolateral and ventromedial prefrontal pathways. When applied during safety learning, this deactivation predicts a reduction in later fear recovery. These findings provide a parsimonious and mechanistic account of how behavioral manipulations taxing working memory and suppressing amygdala activity can alter retention of emotional memories.

Transient inactivation of the visual-associative nidopallium frontolaterale (NFL) impairs extinction learning and context encoding in pigeons.

Extinction learning is a fundamental learning process that enables organisms to continuously update knowledge about their ever-changing environment. When using visual cues as conditioned stimuli (CS), visual cortical areas of mammals are known to participate in extinction learning. The aim of the present study was to test whether similar processes can also be observed in birds. With pigeons as an animal model, we therefore investigated the role of the nidopallium frontolaterale (NFL), a key avian visual associative area, in an extinction learning task. We adopted a within-subject extinction task design with context manipulation, and tested the animals for extinction memory retention and renewal. Before extinction, the NFL was transiently inactivated by intracerebral tetrodotoxin (TTX) injections. Our data suggest that inactivation of NFL indeed produces a slowing of extinction learning. Importantly, NFL also plays a key role in context encoding, as indicated by an abolishment of the renewal effect. This is not due to an overall perceptual decrement, since the ability to distinguish between the different visual stimuli was unaltered, but might be caused by an impaired formation of the context-CS-configuration during extinction. Taken together, our experiment not only reveals similarities of neural substrates of extinction learning in birds and mammals, but also provides strong evidence for a specific contribution of the NFL in context encoding.

An Inhibitory Learning Approach to Cognitive-Behavioral Therapy for Children and Adolescents.

Although exposure-based cognitive-behavioral therapy (CBT) is efficacious for childhood anxiety and obsessive-compulsive disorder (OCD), many youth do not adequately respond to treatment. Extinction learning is an important process in exposure-based CBT. However, youth with anxiety disorders and OCD exhibit impairments in extinction processes that are best characterized by deficits in inhibitory learning. Therefore, the utilization of strategies to optimize inhibitory learning during exposures may compensate for these deficits, thereby maximizing extinction processes and producing more robust treatment outcomes for exposure-based CBT. This paper reviews several strategies to optimize inhibitory learning in youth with anxiety disorders and OCD, and presents practical examples for each strategy. This paper also highlights the difference between inhibitory learning-based exposures and prior conceptual approaches to exposure therapy in clinical practice. It concludes with a discussion of future directions for clinical research on inhibitory learning and exposure-based CBT in youth.

Suppression of Striatal Prediction Errors by the Prefrontal Cortex in Placebo Hypoalgesia.

Classical learning theories predict extinction after the discontinuation of reinforcement through prediction errors. However, placebo hypoalgesia, although mediated by associative learning, has been shown to be resistant to extinction. We tested the hypothesis that this is mediated by the suppression of prediction error processing through the prefrontal cortex (PFC). We compared pain modulation through treatment cues (placebo hypoalgesia, treatment context) with pain modulation through stimulus intensity cues (stimulus context) during functional magnetic resonance imaging in 48 male and female healthy volunteers. During acquisition, our data show that expectations are correctly learned and that this is associated with prediction error signals in the ventral striatum (VS) in both contexts. However, in the nonreinforced test phase, pain modulation and expectations of pain relief persisted to a larger degree in the treatment context, indicating that the expectations were not correctly updated in the treatment context. Consistently, we observed significantly stronger neural prediction error signals in the VS in the stimulus context compared with the treatment context. A connectivity analysis revealed negative coupling between the anterior PFC and the VS in the treatment context, suggesting that the PFC can suppress the expression of prediction errors in the VS. Consistent with this, a participant's conceptual views and beliefs about treatments influenced the pain modulation only in the treatment context. Our results indicate that in placebo hypoalgesia contextual treatment information engages prefrontal conceptual processes, which can suppress prediction error processing in the VS and lead to reduced updating of treatment expectancies, resulting in less extinction of placebo hypoalgesia.SIGNIFICANCE STATEMENT In aversive and appetitive reinforcement learning, learned effects show extinction when reinforcement is discontinued. This is thought to be mediated by prediction errors (i.e., the difference between expectations and outcome). Although reinforcement learning has been central in explaining placebo hypoalgesia, placebo hypoalgesic effects show little extinction and persist after the discontinuation of reinforcement. Our results support the idea that conceptual treatment beliefs bias the neural processing of expectations in a treatment context compared with a more stimulus-driven processing of expectations with stimulus intensity cues. We provide evidence that this is associated with the suppression of prediction error processing in the ventral striatum by the prefrontal cortex. This provides a neural basis for persisting effects in reinforcement learning and placebo hypoalgesia.

Wakefulness rather than sleep benefits extinction of an inhibitory operant conditioning memory in Aplysia.

Sleep enhances memory consolidation which has been shown in mammals as well as in invertebrates, like bees and Drosophila. The current study is part of a series of experiments examining whether this memory function of sleep is preserved in Aplysia with an even simpler nervous system. Previous work showed that Aplysia sleep and that sleep after training supports memory on an inhibitory conditioning task ('learning that food is inedible', LFI). Here, we tested whether sleep in Aplysia would also support memory for an extinction learning on the LFI task. Following Acquisition in which animals learned that netted food is inedible, two groups of animals, a Sleep group (n = 15) and a Wake group (n = 16) underwent extinction training. After a 17-hour Retention interval which contained either regular nocturnal sleep or daytime wakefulness (supported by sleep deprivation) animals were retested on the LFI task. Contrary to our hypothesis, the Wake animals showed significantly prolonged food intake behavior on the LFI, indicating that extinction memory in these animals was better than in the Sleep animals. Performance of a control group not subjected to extinction training, ruled out that the superior extinction performance of Wake animals merely reflected forgetting over time of the LFI memory, and also excluding a possible circadian confound. We speculate that wakefulness mainly acts by accelerating active forgetting of the LFI memory after it was labialized through extinction training, thereby facilitating the re-emergence of the original innate behavior of food intake.

Enhanced extinction of aversive memories in mice lacking SPARC-related protein containing immunoglobulin domains 1 (SPIG1/FSTL4).

Brain-derived neurotrophic factor (BDNF) plays an important role in synaptic plasticity related to learning and memory. We previously reported that SPARC-related protein containing immunoglobulin domains 1 (SPIG1, also known as Follistatin-like protein 4, FSTL4) binds to pro-BDNF and negatively regulates BDNF maturation; however, its neurological functions, particularly in learning and memory, have not yet been elucidated. We herein examined the electrophysiological and behavioral phenotypes of Spig1-knockout (Spig1-KO) mice. Adult Spig1-KO mice exhibited greater excitability and facilitated long-term potentiation (LTP) in the CA1 region of hippocampal slices than age- and sex-matched wild-type (WT) mice. Facilitated LTP was reduced to the level of WT by the bath application of an anti-BDNF antibody to hippocampal slices. A step-through inhibitory avoidance learning paradigm revealed that the extinction of aversive memories was significantly enhanced in adult Spig1-KO mice, while they showed the normal acquisition of aversive memories; besides, spatial reference memory formation was also normal in the standard Morris water maze task. An intracerebroventricular (icv) injection of anti-BDNF in the process of extinction learning transiently induced the recurrence of aversive memories in Spig1-KO mice, but exerted no effects in WT mice. These results indicate a critical role for SPIG1 in BDNF-mediated synaptic plasticity in extinction of inhibitory avoidance memory.