Estradiol and progesterone in female reward-learning, addiction, and therapeutic interventions.

Sex steroid hormones like estradiol (E2) and progesterone (P4) guide the sexual organization and activation of the developing brain and control female reproductive behavior throughout the lifecycle; importantly, these hormones modulate functional activity of not just the endocrine system, but most of the nervous system including the brain reward system. The effects of E2 and P4 can be seen in the processing of and memory for rewarding stimuli and in the development of compulsive reward-seeking behaviors like those seen in substance use disorders. Women are at increased risk of developing substance use disorders; however, the origins of this sex difference are not well understood and therapeutic interventions targeting ovarian hormones have produced conflicting results. This article reviews the contribution of the E2 and P4 in females to functional modulation of the brain reward system, their possible roles in origins of addiction vulnerability, and the development and treatment of compulsive reward-seeking behaviors.

Postretrieval Extinction Attenuates Alcohol Cue Reactivity in Rats.

BACKGROUND: Conditioned responses to alcohol-associated cues can hinder recovery from alcohol use disorder (AUD). Cue exposure (extinction) therapy (CET) can reduce reactivity to alcohol cues, but its efficacy is limited by phenomena such as spontaneous recovery and reinstatement that can cause a return of conditioned responding after extinction. Using a preclinical model of alcohol cue reactivity in rats, we evaluated whether the efficacy of alcohol CET could be improved by conducting CET during the memory reconsolidation window after retrieval of cue-alcohol associations. METHODS: Rats were provided with intermittent access to unsweetened alcohol. Rats were then trained to predict alcohol access based on a visual cue. Next, rats were treated with either standard extinction (n = 14) or postretrieval extinction (n = 13). Rats were then tested for long-term memory of extinction and susceptibility to spontaneous recovery and reinstatement. RESULTS: Despite equivalent extinction, rats treated with postretrieval extinction exhibited reduced spontaneous recovery and reinstatement relative to rats treated with standard extinction. CONCLUSIONS: Postretrieval CET shows promise for persistently attenuating the risk to relapse posed by alcohol cues in individuals with AUD.

Time-course concentration of ethanol, acetaldehyde and acetate in rat brain dialysate following alcohol self-administration.

The unclear mechanisms of ethanol metabolism in the brain highlight the need for a deeper understanding of its metabolic pathways. This study used in vivo microdialysis to simultaneously sample ethanol and its metabolites, acetaldehyde and acetate, in the rat striatum following self-administration of ethanol, emphasizing the natural oral exposure route. To enhance the self-administration, rats underwent two-bottle-choice and limited access training. Dialysate samples, collected every 10 minutes for 2.5 hours, were analyzed using gas chromatography with flame ionization detection (GC-FID). The measured time courses of dialysate concentrations of ethanol, acetaldehyde, and acetate provided insights into dynamics of ethanol metabolism. Notably, in a subject with low ethanol consumption (0.29 g/kg), the concentration of acetaldehyde remained below the limit of detection throughout the experiment. However, the acetate concentration was clearly increased after ethanol consumption in this subject and was comparable to that of other rats with higher ethanol consumption. Compared with focusing only on peak values in the time-courses of concentrations of ethanol and its metabolites, calculating areas under curves provided better models of the relationships between ethanol intake and individual ethanol metabolites, as indicated by the r-square values for the linear regressions. This approach of using the area under the curve accounts for both the amplitude and duration of the concentration profiles, reducing the impact of variations in individual drinking patterns. In vivo microdialysis enables concurrent sampling of brain metabolites during oral ethanol administration, contributing insights into metabolite dynamics. To our knowledge, this paper is the first to report measurement of all three analytes in the brain following self-administration of ethanol. Future studies will explore regional variations and dynamics post-ethanol dependence, further advancing our understanding of ethanol metabolism in the brain.

Fear attenuation collaborations to optimize translation.

Here, we describe the efforts we dedicated to the challenge of modifying entrenched emotionally laden memories. In recent years, through a number of collaborations and using a combination of behavioral, molecular, and computational approaches, we: (a) developed novel approaches to fear attenuation that engage mechanisms that differ from those engaged during extinction (Monfils), (b) examined whether our approaches can generalize to other reinforcers (Lee, Gonzales, Chaudhri, Cofresi, and Monfils), (c) derived principled explanations for the differential outcomes of our approaches (Niv, Gershman, Song, and Monfils), (d) developed better assessment metrics to evaluate outcome success (Shumake and Monfils), (e) identified biomarkers that can explain significant variance in our outcomes of interest (Shumake and Monfils), and (f) developed better basic research assays and translated efforts to the clinic (Smits, Telch, Otto, Shumake, and Monfils). We briefly highlight each of these milestones and conclude with final remarks and extracted principles. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Carbon Dioxide Reactivity Differentially Predicts Fear Expression After Extinction and Retrieval-Extinction in Rats.

Background: Cues present during a traumatic event may result in persistent fear responses. These responses can be attenuated through extinction learning, a core component of exposure therapy. Exposure/extinction is effective for some people, but not all. We recently demonstrated that carbon dioxide (CO2) reactivity predicts fear extinction memory and orexin activation and that orexin activation predicts fear extinction memory, which suggests that a CO2 challenge may enable identification of whether an individual is a good candidate for an extinction-based approach. Another method to attenuate conditioned responses, retrieval-extinction, renders the original associative memory labile via distinct neural mechanisms. The purpose of the current study was to examine whether we could replicate previous findings that retrieval-extinction is more effective than extinction at preventing the return of fear and that CO2 reactivity predicts fear memory after extinction. We also examined whether CO2 reactivity predicts fear memory after retrieval-extinction. Methods: Male rats first underwent a CO2 challenge and fear conditioning and were assigned to receive either standard extinction (n = 28) or retrieval-extinction (n = 28). Then, they underwent a long-term memory (LTM) test and a reinstatement test. Results: We found that retrieval-extinction resulted in lower freezing during extinction, LTM, and reinstatement than standard extinction. Using the best subset approach to linear regression, we found that CO2 reactivity predicted LTM after extinction and also predicted LTM after retrieval-extinction, although to a lesser degree. Conclusions: CO2 reactivity could be used as a screening tool to determine whether an individual may be a good candidate for an extinction-based therapeutic approach.

Extinction learning underlies exposure therapy, a treatment for anxiety disorders. However, not everyone benefits from exposure therapy, highlighting the need in developing approaches that may help predict which individuals will respond. We tested whether extinction or an alternative treatment called retrieval-extinction would be more effective at reducing conditioned fear responses in rats and whether the response to a carbon dioxide (CO₂) challenge would predict treatment response. We found that retrieval-extinction was more effective at reducing fear, and CO₂ reactivity was better at predicting the response to extinction. These findings could help improve treatment strategies for anxiety disorders.

Observing a trained demonstrator influences associative appetitive learning in rats.

The ability to acquire information about the environment through social observation or instruction is an essential form of learning in humans and other animals. Here, we assessed the ability of rats to acquire an association between a light stimulus and the presentation of a reward that is either hidden (sucrose solution) or visible (food pellet) via observation of a trained demonstrator. Subsequent training of observers on the light-reward association indicated that while observation alone was not sufficient for observers to acquire the association, contact with the reward location was higher in observers that were paired with a demonstrator. However, this was only true when the light cue predicted a sucrose reward. Additionally, we found that in the visible reward condition, levels of demonstrator orienting and food cup contact during the observation period tended to be positively correlated with the corresponding behaviour of their observer. This relationship was only seen during later sessions of observer training. Together, these results suggest that while our models were not sufficient to induce associative learning through observation alone, demonstrator behaviour during observation did influence how their paired observer's behavioural response to the cue evolved over the course of direct individual training.

Patterns of Arc mRNA expression in the rat brain following dual recall of fear- and reward-based socially acquired information.

Learning can occur via direct experience or through observation of another individual (i.e., social learning). While research focused on understanding the neural mechanisms of direct learning is prevalent, less work has examined the brain circuitry mediating the acquisition and recall of socially acquired information. Here, we aimed to further elucidate the mechanisms underlying recall of socially acquired information by having male and female rats sequentially recall a socially transmitted food preference (STFP) and a fear association via fear conditioning by-proxy (FCbP). Brain tissue was processed for mRNA expression of the immediate early gene (IEG) Arc, which expresses in the nucleus following transcription before migrating to the cytoplasm over the next 25 min. Given this timeframe, we could identify whether Arc transcription was triggered by STFP recall, FCbP recall, or both. Contrary to past research, we found no differences in any Arc expression measures across a number of prefrontal regions and the ventral CA3 of the hippocampus between controls, demonstrators, and observers. We theorize that these results may indicate that relatively little Arc-dependent neural restructuring is taking place in the prefrontal cortices and ventral CA3 following recall of recently socially acquired information or directly acquired fear associations in these areas.

Estrous cycle state-dependent renewal of appetitive behavior recruits unique patterns of Arc mRNA in female rats.

Introduction: Renewal is a behavioral phenomenon wherein extinction learning fails to generalize between different contextual environments, thereby representing a significant challenge to extinction-based rehabilitative therapies. Previously, we have shown that renewal of extinguished appetitive behavior differs across the estrous cycle of the female rat. In this experiment that effect is replicated and extended upon to understand how the estrous cycle may modulate contextual representation at the neuronal population level to drive renewal. Methods: Estrous cycle stage [i.e., proestrus (P, high hormone) or metestrus/diestrus (M/D, low hormone)] was considered during two important learning and behavioral expression windows: at extinction training and during long-term memory (LTM)/renewal testing. Cellular compartment analysis of temporal activity using fluorescence in situ hybridization (catFISH) for Arc mRNA was conducted after the distinct context-stimulus exposures. Results: Rats in P during context-dependent extinction training but in a different stage of the estrous cycle during LTM and renewal testing (P-different) were shown to exhibit more renewal of conditioned foodcup (but not conditioned orienting) behavior compared to rats in other estrous cycle groups. Importantly, we discovered this depends on the order of tests. P-different rats showed differential Arc mRNA expression in regions of the prefrontal cortex (PFC), amygdala, and hippocampus (HPC). For each case P-different rats had more co-expression (i.e., expression of both nuclear and cytoplasmic) of Arc mRNA compared to other groups; specific to the dorsal HPC, P-different rats also had a more robust Arc mRNA response to the extinction context exposure. Conclusion: These data suggest female rats show estrous cycle state-dependent renewal of appetitive behavior, and differences in context and conditioned stimulus representation at the neuronal level may drive this effect.

CO2 reactivity is associated with individual differences in appetitive extinction memory.

Pavlovian conditioning can underly the maladaptive behaviors seen in psychiatric disorders such as anxiety and addiction. In both the lab and the clinic, these responses can be attenuated through extinction learning, but often return with the passage of time, stress, or a change in context. Extinction to fear and reward cues are both subject to these return of behavior phenomena and have overlap in neurocircuitry, yet it is unknown whether they share any common predictors. The orexin system has been implicated in both fear and appetitive extinction and can be activated through a CO2 challenge. We previously found that behavioral CO2 reactivity predicts fear extinction and orexin activation. Here, we sought to extend our previous findings to determine whether CO2 reactivity might also predict extinction memory for appetitive light-food conditioning. We find that the same subcomponent of behavioral CO2 reactivity that predicted fear extinction also predicts appetitive extinction, but in the opposite direction. We show evidence that this subcomponent remains stable across two CO2 challenges, suggesting it may be a stable trait of both behavioral CO2 reactivity and appetitive extinction phenotype. Our findings further the possibility for CO2 reactivity to be used as a transdiagnostic screening tool to determine whether an individual would be a good candidate for exposure therapy.

Friend recollections, and a collection of collaborations with Nadia.

In this selective review article, we showcase our collaborations with our colleague, Dr. Nadia Chaudhri. Dr. Chaudhri was an esteemed colleague and researcher who contributed greatly to our understanding of Pavlovian alcohol conditioning. From 2014 to 2019, we collaborated with Nadia. Here, we reflect on our friendship, the work we did together, and the continued impact on the field.

Appetitive Behavior in the Social Transmission of Food Preference Paradigm Predicts Activation of Orexin-A producing Neurons in a Sex-Dependent Manner.

Orexin-producing cells in the lateral hypothalamic area have been shown to be involved in a wide variety of behavioral and cognitive functions, including the recall of appetitive associations and a variety of social behaviors. Here, we investigated the role of orexin in the acquisition and recall of socially transmitted food preferences in the rat. Rats were euthanized following either acquisition, short-term recall, or long-term recall of a socially transmitted food preference and their brains were processed for orexin-A and c-Fos expression. We found that while there were no significant differences in c-Fos expression between control and experimental subjects at any of the tested timepoints, females displayed significantly more activity in both orexinergic and non-orexinergic cells in the lateral hypothalamus. In the infralimbic cortex, we found that social behavior was significantly predictive of c-Fos expression, with social behaviors related to olfactory exploration appearing to be particularly influential. We additionally found that appetitive behavior was significantly predictive of orexin-A activity in a sex-dependent matter, with the total amount eaten correlating negatively with orexin-A/c-Fos colocalization in male rats but not female rats. These findings suggest a potential sex-specific role for the orexin system in balancing the stimulation of feeding behavior with the sleep/wake cycle.

Hormonal contraceptives alter amphetamine place preference and responsivity in the intact female rat.

Hormonal contraceptives (HCs) containing synthetic ovarian hormones are commonly used among reproductive aged women; HCs alter the physiological state of the user by interfering with endogenous hormone concentrations and their actions on the reproductive tract. As ovarian hormones modulate the incidence of substance abuse disorders in women, this experiment explores how modulating female rat ovarian hormonal states with an HC containing the synthetic progestin levonorgestrel influences measures of drug preference and responsivity. First, rats underwent food-light Pavlovian conditioning to measure conditioned orienting, a known predictor of amphetamine (AMP) place preference. Then, rats were conditioned and tested for AMP place preference with either an HC implant or during estrous cycle stages associated with opposing ovarian hormone levels, that is, proestrus (P) or metestrus/diestrus (M/D), while recording ultrasonic vocalizations (USVs) as an index of he donic drug responsivity. Because of dopamine's (DA's) role in reward learning and memory, DA cell number and activity were examined using tyrosine hydroxylase and FOS immunohistochemistry after a final AMP challenge. Conditioned orienting did not differ between cycling and HC-implanted rats. HC rats emitted fewer USVs in response to AMP, showed marginally less AMP place preference, and had lower DA cell activity in the substantia nigra after AMP compared to P rats. M/D rats showed a similar behavioral profile and neural response as HC rats. This experiment suggests ovarian hormones affect drug preference and responsivity, while providing novel insight into how hormone-altering contraceptives may reduce these measures. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Sex differences in conditioned orienting and the role of estradiol in addiction-related behaviors.

Conditioned orienting response (OR) is a form of cue-directed behavior thought to indicate increased attentional and/or motivational processing of reward-associated stimuli. OR as a phenotype has been shown to predict both direct drug proclivity in female rats and behaviors indirectly related to drug proclivity in male rats, but no extant research has compared males and females in terms of their OR behavior or its notable substrates. As females are at increased risk for substance abuse, and the ovarian hormone estradiol is often cited as a driving factor for this predilection, it is important to characterize sex differences between males and females and explore what, if any, contribution estradiol has in behaviors which predict substance abuse. In these experiments, male and female rats [intact or ovariectomized (OVX) with/without estradiol replacement] were compared on a battery of behavioral tasks, including OR, novelty-seeking, attentional set-shifting, and ultrasonic vocalizations (USVs) to amphetamine treatment. Female rats, regardless of estradiol replacement, had higher OR scores than males. OR score was a predictor of attention impairments, and estradiol availability contributed to this relationship in females. Sex differences were not observed in novelty-seeking, attentional set-shifting, or USV response to amphetamine; however, estradiol replacement did alter the presentation of these behaviors. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Interactions between amygdala central nucleus and the ventral tegmental area in the acquisition of conditioned cue-directed behavior in rats.

Rats orient to and approach localizable visual cues paired with food delivery. Previous studies from this laboratory show that the acquisition and expression of these learned cue-directed responses depend on integrity of a system including the central nucleus of the amygdala (CeA), the substantia nigra pars compacta (SNc) and the dorsolateral striatum (DLS). Other investigators have suggested that cue-directed behaviors may also depend on interaction between CeA and the ventral striatum, perhaps via CeA projections to the ventral tegmental area (VTA). In Experiment 1, we examined the effects of unilateral lesions of CeA and/or VTA on rats' acquisition of conditioned responses to visual cues paired with food. Contrary to the results of previous studies that examined interactions of CeA with either SNc or DLS, rats with contralateral disconnection lesions of CeA and VTA were unimpaired in their acquisition of cue-directed responses. By contrast, rats with lesions of both structures in the same hemisphere failed to learn cue-directed responses, but were normal in their acquisition of conditioned responses directed to the food cup. In Experiment 2, we attempted to characterize the influence of VTA on CeA by examining FOS induction in CeA by a visual cue for food in rats with unilateral lesions of VTA. The results suggested an excitatory influence of VTA on CeA in the presence of food cues. Implications of these results for brain circuits involved in learned orienting and incentive motivation are discussed.

Rapid encoding of new information alters the profile of plasticity-related mRNA transcripts in the hippocampal CA3 region.

A theoretical framework for the function of the medial temporal lobe system in memory defines differential contributions of the hippocampal subregions with regard to pattern recognition retrieval processes and encoding of new information. To investigate molecular programs of relevance, we designed a spatial learning protocol to engage a pattern separation function to encode new information. After background training, two groups of animals experienced the same new training in a novel environment; however, only one group was provided spatial information and demonstrated spatial memory in a retention test. Global transcriptional analysis of the microdissected subregions of the hippocampus exposed a CA3 pattern that was sufficient to clearly segregate spatial learning animals from control. Individual gene and functional group analysis anchored these results to previous work in neural plasticity. From a multitude of expression changes, increases in camk2a, rasgrp1, and nlgn1 were confirmed by in situ hybridization. Furthermore, siRNA inhibition of nlgn1 within the CA3 subregion impaired spatial memory performance, pointing to mechanisms of synaptic remodeling as a basis for rapid encoding of new information in long-term memory.

The central amygdala projection to the substantia nigra reflects prediction error information in appetitive conditioning.

The central amygdala nucleus (CeA) plays a critical role in cognitive processes beyond fear conditioning. For example, intact CeA function is essential for enhancing attention to conditioned stimuli (CSs). Furthermore, this enhanced attention depends on the CeA's connections to the nigrostriatal system. In the current study, we examined the role of the CeA's connections to two midbrain dopamine regions, the substantia nigra pars compacta (SNc) and the ventral tegmental area (VTA), in processing CS information when predictions of reward or nonreward were confirmed or disconfirmed. Initially, two different retrograde tracers were injected into the SNc and the VTA of rats, to label CeA cells. Different groups of rats then received a visual CS either paired or unpaired with food. Finally, Fos induction was assessed after a test session in which rats were exposed to the visual CS alone or paired with food. Colabeling of Fos and the retrograde tracer(s) showed that CeA neurons projecting to the SNc, but not to the VTA, were engaged in processing CS information when the training and testing conditions differed. These results suggest that the CeA-nigral pathway represents prediction error information during appetitive conditioning.

Stress-induced alterations in hippocampal plasticity, place cells, and spatial memory.

Acute, inescapable, and unpredictable stress can profoundly modify brain and cognition in humans and animals. The present study investigated the ensuing effects of 2-h variable "audiogenic" stress on three related levels of hippocampal functions in rats: long-term potentiation, place cell activity, and spatial memory. In agreement with prior findings, we observed that stress reduced the magnitude of Schaffer collateral/commissural-Cornu Ammonis field 1 long-term potentiation in vitro, and selectively impaired spatial memory on a hidden platform version of the Morris water maze task. We also observed that stress impaired the stability of firing rates (but not firing locations) of place cells recorded from dorsal Cornu Ammonis field 1 in rats foraging freely on a novel open-field platform located in a familiar surrounding room. These findings suggest that stress-induced modifications in synaptic plasticity may prevent the storage of stable "rate maps" by hippocampal place cells, which in turn may contribute to spatial memory impairments associated with stress.

Early stress and waiting to respond versus waiting to receive.

Chronic social stress in early puberty results in enhanced impulsive action-in particular, decreased action inhibition. We address possible effects of early stress on the capacity to wait to respond, the other form of impulsive action. Male golden hamsters were exposed daily to aggressive adults from postnatal Day 28 to Day 42. Later in adulthood, animals were trained in a variable delay to respond task to nose-poke into a lit opening that triggered the delivery of food pellet rewards in response to a house light. During testing, we introduced random and varying delays between the house light presentation and illumination in the openings and examined premature nose-poking responses as an indicator of impulsive action. As delays grew longer, animals performed more premature responses. However, previously stressed animals were 25% less likely to perform such actions by the longest delay. As a control for this experiment, we conducted a separate study in which we introduced varying delays between the nose-poking response in the lit openings and the delivery of the reward. In this case, there were no significant differences between groups in repeated nose-poking after a correct response (repetitive responses). In summary, early stress has differential effects in response to introduction of delays in conditioning procedures: enhanced tolerance to delays between conditioning cues but no effect on responses when rewards are delayed. These studies confirm that early stress impacts the maturation of the neural systems mediating impulsive responses and provide a new perspective on the neuropsychology of waiting. (PsycINFO Database Record (c) 2020 APA, all rights reserved).

Cue-alcohol associative learning in female rats.

The ability of environmental cues to trigger alcohol-seeking behaviors is believed to facilitate problematic alcohol use. We previously showed that the development of this cue-evoked alcohol approach reflects cue-alcohol learning and memory in the adult male rat; however, we do not know whether the same is true for similarly aged female rats. Consequently, adult Long-Evans female rats were allowed to drink unsweetened alcohol in the home cage (Monday, Wednesday, Friday; 24-h two-bottle choice; 5 weeks) and were subsequently split into two experimental groups: Paired and Unpaired. Groups were matched for ingested doses and alcohol bottle preference across the pre-conditioning home cage period. Both groups were trained in conditioning chambers using a Pavlovian procedure. For the Paired group, the chamber houselight was illuminated to signal access to an alcohol sipper. Houselight onset was yoked for the Unpaired group, but access to the alcohol sipper was scheduled to occur only during the intervening periods (in the absence of light). We found that in the Paired, but not Unpaired group, an alcohol approach reaction was conditioned to houselight illumination, and the level of cue-conditioned reactivity predicted drinking behavior within trials. Groups experienced equivalently low but non-negligible blood alcohol concentrations over the course of conditioning sessions. We conclude that cue-triggered alcohol-seeking behavior in adult female rats reflects associative learning about the relationship between alcohol availability and houselight illumination.

Mapping the estrous cycle to context-specific extinction memory.

In Pavlovian renewal paradigms, intact female rats have previously failed to exhibit renewal of appetitive behavior after extinction. However, when treated with exogenous estradiol, female rats exhibit robust renewal behavior. The current study aims to investigate whether the estrous cycle can influence renewal of appetitive behaviors and activity in brain areas known to support the renewal effect. We further aimed to examine whether the estrous cycle would similarly affect renewal of two different types of appetitive behaviors. We first establish that rats in the proestrous stage of the estrous cycle during extinction exhibit elevated renewal behavior compared with rats in either metestrous/diestrous stages, and only rats in proestrus during extinction training (but not during the renewal test) exhibit elevated renewal behavior. Furthermore, we show that this estrous cycle dependent effect on renewal only applies to the conditioned approach behavior toward the food delivery site but not the conditioned approach behavior toward the light cue associated with food delivery. Finally, we examined FOS activity within the prelimbic and infralimbic areas of the medial prefrontal cortex, the dorsal and ventral hippocampal formation, the paraventricular nucleus of the thalamus, the nucleus accumbens, and areas of the amygdala. Particularly in the hippocampus and amygdala, FOS expression which corresponded to the behavioral differences between groups was observed. Results from this study suggest that context information processing may vary as a function of endogenous female hormones across the gonadal hormone cycle and that encoding and retrieval of this information is accomplished in a state-specific manner. (PsycINFO Database Record (c) 2019 APA, all rights reserved).