Cue-potentiated feeding in rodents: Implications for weight regulation in obesogenic environments.

Cue-potentiated feeding (CPF) describes instances where food intake is increased by exposure to conditioned cues associated with food, often in the absence of hunger. CPF effects have been reported in a range of experimental protocols developed by researchers working across diverse fields spanning behavioural neuroscience, social psychology and ecology. Here we review the evolution of research on cue-potentiated feeding in animal models to identify important behavioural parameters and key neural circuits and pharmacological systems underlying the effect. Overall, evidence indicates that social, discrete and contextual stimuli can be used to elicit CPF effects across multiple species, though effects are often subtle and sensitive to procedural variables. While regular exposure to food cues is thought to be a key risk factor for overeating in so-called 'obesogenic' environments, further work is needed to identify whether CPF promotes positive energy balance and weight gain over the longer term. We suggest several methodological and conceptual areas for inquiry to elucidate the contribution of CPF to the regulation of food choice and energy intake.

Manipulations of the context-response relationship reduce the expression of response habits.

Habitual instrumental behaviour is believed to rely on stimulus-response (S-R) associations. However, the method most commonly used to identify habitual behaviour, outcome devaluation, provides only indirect evidence of S-R control. Therefore, it is important to have a better understanding of the S-R association believed to underlie habitual responding. Under free-operant conditions, the context itself likely serves as at least part of the relevant stimuli in the association, and so modifications to the predictive power of the context should alter the expression of habits. The following experiments investigated how changes to the relationship between the training context and performance of the response, either by changing the context during testing or by exposing animals to the context alone, without the response lever present, impacted behavioural control during a devaluation test. We found evidence that the training context is important for the expression of habits; testing animals in a different context than where they were trained resulted in increased goal-directed control (Experiment 1). Furthermore, context alone exposure also increased goal-directed control with animals that received context alone exposure showing stronger devaluation effects, whether the context alone exposure happened on the last day of training (Experiment 2) or throughout training (Experiment 3). These findings are consistent with prior reports that the training context is important for the expression of habits and extends these findings by using sensory-specific satiety as a means for devaluation and by using context alone exposure to alter behavioural control.

Ghrelin receptor antagonism and satiety attenuate Pavlovian-instrumental transfer.

Animals rely on learned cues to guide their behaviour for rewards such as food. The Pavlovian-instrumental transfer (PIT) task can be used to investigate the influence of Pavlovian stimuli on instrumental responding. Ghrelin, an orexigenic peptide, and its receptor, growth hormone secretagogue receptor 1A (GHS-R1A), has received growing interest for its role in reward-motivated learning and behaviours. A significant population of GHS-R1A have been identified within the ventral tegmental area (VTA), a critical node in the mesolimbic reward circuit that is necessary for the expression of PIT. As ghrelin has been found to increase dopaminergic activity in the VTA, we predicted that GHS-R1A antagonism with JMV-2959 would attenuate PIT. Further, given the relationship between hunger levels and changes in ghrelin signalling, we sought to compare the effects GHS-R1A antagonism with those of satiety, hypothesizing parallel effects, with each attenuating PIT. Rats received daily sessions of Pavlovian and then instrumental training over 3 weeks. Across three experiments, we examined the effects of a shift to satiety, or treatment with the GHS-R1A antagonist JMV-2959, either peripherally or directly into the VTA. We found that presentations of a stimulus paired with food reward enhanced responding for food across all conditions, thus demonstrating the expected PIT effect. Further, GHS-R1A antagonism, both peripherally and within the VTA, as well as satiety significantly reduced the magnitude of the PIT effect compared to control conditions. These results clarify our understanding of ghrelin signalling in PIT and begin to elucidate the role of feeding-related peptides in the modulation of reward-related responding.

Serotonin and Dopamine Show Different Response Profiles to Acute Stress in the Nucleus Accumbens and Medial Prefrontal Cortex of Rats with Neuropathic Pain.

The ability to adaptively guide behaviour requires the integration of external information with internal motivational factors. Decision-making capabilities can be impaired by acute stress and is often exacerbated by chronic pain. Chronic neuropathic pain patients often present with cognitive dysfunction, including impaired decision-making. The mechanisms underlying these changes are not well understood but may include altered monoaminergic transmission in the brain. In this study we investigated the relationships between dopamine, serotonin, and their metabolites in key brain regions that regulate motivated behaviour and decision-making. The neurochemical profiles of the medial prefrontal cortex, orbital prefrontal cortex, and nucleus accumbens were analysed using HPLC in rats that received a chronic constriction injury (CCI) of the right sciatic nerve and an acute stress (15-min restraint), prior to an outcome devaluation task. CCI alone significantly decreased dopamine but not serotonin concentrations in the medial prefrontal cortex. By contrast, restraint stress acutely increased dopamine in the medial prefrontal cortex, and the nucleus accumbens; and increased serotonin in the medial prefrontal cortex 2 h later. The sustained dopaminergic and serotonergic responses to acute stress highlight the importance of an animal's ability to mount an effective coping response. In addition, these data suggest that the impact of nerve injury and acute stress on outcome-devaluation occurs independently of dopaminergic and serotonergic transmission in the medial prefrontal cortex, orbital prefrontal cortex and nucleus accumbens of rats.

Engram Size Varies with Learning and Reflects Memory Content and Precision.

Memories are rarely acquired under ideal conditions, rendering them vulnerable to profound omissions, errors, and ambiguities. Consistent with this, recent work using context fear conditioning has shown that memories formed after inadequate learning time display a variety of maladaptive properties, including overgeneralization to similar contexts. However, the neuronal basis of such poor learning and memory imprecision remains unknown. Using c-fos to track neuronal activity in male mice, we examined how these learning-dependent changes in context fear memory precision are encoded in hippocampal ensembles. We found that the total number of c-fos-encoding cells did not correspond with learning history but instead more closely reflected the length of the session immediately preceding c-fos measurement. However, using a c-fos-driven tagging method (TRAP2 mouse line), we found that the degree of learning and memory specificity corresponded with neuronal activity in a subset of dentate gyrus cells that were active during both learning and recall. Comprehensive memories acquired after longer learning intervals were associated with more double-labeled cells. These were preferentially reactivated in the conditioning context compared with a similar context, paralleling behavioral discrimination. Conversely, impoverished memories acquired after shorter learning intervals were associated with fewer double-labeled cells. These were reactivated equally in both contexts, corresponding with overgeneralization. Together, these findings provide two surprising conclusions. First, engram size varies with learning. Second, larger engrams support better neuronal and behavioral discrimination. These findings are incorporated into a model that describes how neuronal activity is influenced by previous learning and present experience, thus driving behavior.SIGNIFICANCE STATEMENT Memories are not always formed under ideal circumstances. This is especially true in traumatic situations, such as car accidents, where individuals have insufficient time to process what happened around them. Such memories have the potential to overgeneralize to irrelevant situations, producing inappropriate fear and contributing to disorders, such as post-traumatic stress disorder. However, it is unknown how such poorly formed fear memories are encoded within the brain. We find that restricting learning time results in fear memories that are encoded by fewer hippocampal cells. Moreover, these fewer cells are inappropriately reactivated in both dangerous and safe contexts. These findings suggest that fear memories formed at brief periods overgeneralize because they lack the detail-rich information necessary to support neuronal discrimination.

Altered monoamine levels in the dorsal striatum of the rat are associated with alterations in behavioural selection and motivation following peripheral nerve injury and acute stress.

Chronic neuropathic pain and psychological stress interact to compromise goal-directed control over behaviour following mild psychological stress. The dorsomedial (DMS) and dorsolateral (DLS) striatum in the rat are crucial for the expression of goal-directed and habitual behaviours, respectively. This study investigated whether changes in monoamine levels in the DMS and DLS following nerve injury and psychological stress reflect these behavioural differences. Neuropathic pain was induced by a chronic constriction injury (CCI) of the sciatic nerve in Sprague-Dawley rats. Acute stress was induced using a 15-min restraint. Behavioural flexibility was assessed using the outcome devaluation paradigm. Noradrenaline, serotonin, dopamine and associated metabolites were measured bilaterally from the DLS and DMS. In uninjured rats, restraint increased dopaminergic markers in the left and serotonergic markers in the right of both the DMS and DLS, indicating a possible left hemisphere-mediated dominance. CCI led to a slightly different lateralised effect, with a larger effect in the DMS than in the DLS. Individual differences in behavioural flexibility following CCI negatively correlated with dopaminergic markers in the right DLS, but positively correlated with these markers in the left DMS. A combination of CCI and restraint reduced behavioural flexibility, which was associated with the loss of the left/DMS dominance. These data suggest that behavioural flexibility following psychological stress or pain is associated with a left hemisphere dominance within the dorsal striatum. The loss of behavioural flexibility following the combined stressors is then associated with a transition from left to right, and DMS to DLS dominance.

Noradrenergic ß-receptor antagonism in the basolateral amygdala impairs reconsolidation, but not extinction, of alcohol self-administration: Intra-BLA propranolol impairs reconsolidation of alcohol self-administration.

A critical barrier to recovery from alcohol addiction is relapse propensity. Alcohol cues can trigger relapse, and pharmacologically facilitating processes such as extinction, which decreases cue associations, may help prevent relapse. The noradrenergic system mediates extinction learning for alcohol; however, the neural locus of this effect is unknown. This study sought to determine whether the basolateral amygdala (BLA), a region critical for fear extinction, also mediates extinction of alcohol seeking. Hooded Wistar rats (N = 12-15 per experiment) were implanted with bilateral cannula targeting the BLA and trained to lever press for 10% ethanol during auditory or visual cues. Infusions of the ß-receptor antagonist propranolol (2 µg/side) were administered prior to extinction (Experiment 1), and rats assessed for relapse-like behaviour two weeks later, thus allowing for spontaneous recovery. We expected intra-BLA propranolol to impair extinction learning; however, propranolol-treated rats exhibited reduced responding in the test of spontaneous recovery, suggesting enhanced extinction. We investigated this unexpected result by determining if propranolol treatment affected memory processes other than extinction. In a subsequent experiment, rats were infused with propranolol immediately after extinction to target consolidation of extinction (Experiment 2a), and assessed for spontaneous recovery. Propranolol was also infused after self-administration to target reconsolidation of the original learning (Experiment 2b). Propranolol treatment had no effect on consolidation of extinction learning, but impaired reconsolidation of self-administration. Propranolol administered prior to a self-administration session did not affect reinforced responding (Experiment 2c). Extinction and reconsolidation are opposing processes triggered by specific test conditions. We suggest our test conditions induced reconsolidation of self-administration memory by propranolol, rather than modulation of extinction. Thus, our data implicates intra-BLA noradrenergic ß-receptors in reconsolidation of alcohol self-administration memory.

Methamphetamine promotes habitual action and alters the density of striatal glutamate receptor and vesicular proteins in dorsal striatum.

Goal-directed actions are controlled by the value of the consequences they produce and so increase when what they produce is valuable and decrease when it is not. With continued invariant practice, however, goal-directed actions can become habits, controlled not by their consequences but by antecedent, reward-related states and stimuli. Here, we show that pre-exposure to methamphetamine (METH) caused abnormally rapid development of habitual control. Furthermore, these drug-induced habits differed strikingly from conventional habits; we found that they were insensitive both to changes in reward value and to the effects of negative feedback. In addition to these behavioral changes, METH exposure produced bidirectional changes to synaptic proteins in the dorsal striatum. In the dorsomedial striatum, a structure critical for goal-directed action, METH exposure was associated with a reduction in glutamate receptor and glutamate vesicular proteins, whereas in the dorsolateral striatum, a region that has previously been implicated in habit learning, there was an increase in these proteins. Together, these results indicate that METH exposure promotes habitual control of action that appears to be the result of bidirectional changes in glutamatergic transmission in the circuits underlying goal-directed and habit-based learning.

Recent developments in the behavioural and pharmacological enhancement of extinction of drug seeking.

One of the principal barriers to overcoming addiction is the propensity to relapse, even after months or years of abstinence. Relapse can be precipitated by cues and contexts associated with drug use; thus, decreasing the conditioned properties of these cues and contexts may assist in preventing relapse. The predictive power of drug cues and contexts can be reduced by repeatedly presenting them in the absence of the drug reinforcer, a process known as extinction. The potential of extinction to limit relapse has generated considerable interest and research over the past few decades. While pre-clinical animal models suggest extinction learning assists relapse prevention, treatment efficacy is often lacking when extinction learning principles are translated into clinical trials. Conklin and Tiffany (Addiction, 2002) suggest the lack of efficacy in clinical practice may be due to limited translation of procedures demonstrated through animal research and propose several methodological improvements to enhance extinction learning for drug addiction. This review will examine recent advances in the behavioural and pharmacological manipulation of extinction learning, based on research from pre-clinical models. In addition, the translation of pre-clinical findings-both those suggested by Conklin and Tiffany () and novel demonstrations from the past 13 years-into clinical trials and the efficacy of these methods in reducing craving and relapse, where available, will be discussed. Finally, we highlight areas where promising pre-clinical models have not yet been integrated into current clinical practice but, if applied, could improve upon existing behavioural and pharmacological methods.

Extinction of alcohol seeking is enhanced by compound extinction and the noradrenaline reuptake inhibitor atomoxetine.

Alcohol-related stimuli can trigger relapse of alcohol-seeking behaviors even after extended periods of abstinence. Extinction of such stimuli provides a means for reducing their impact on relapse. However, the expression of extinction can be disrupted by exposure to the previous reinforcer as well as the simple passage of time. We investigated whether augmentation of prediction error or of noradrenaline neurotransmission by the reuptake inhibitor atomoxetine would enhance long-term extinction of alcohol-seeking behavior. Rats received Pavlovian conditioning of multiple stimuli signaling the delivery of an alcohol reward before individual extinction was given to each of these stimuli. Further extinction was then given to a target stimulus presented in compound with another alcohol-predictive stimulus intended to augment prediction error (Experiment 1) or after a systemic injection of atomoxetine (1.0 mg/kg; Experiment 2). Experiment 3 examined whether the compound stimulus effect relied on noradrenergic activity by testing the effects of the ß-adrenergic antagonist propranolol, given prior to compound stimulus trials. Long-term retention of extinction learning was assessed a week later. Compound stimulus presentations enhanced long-term extinction as the stimulus extinguished in compound elicited less responding than a stimulus receiving equal extinction alone when tested a week later. This effect was mimicked by atomoxetine and blocked by propranolol given during extinction training. Thus, extinction of alcohol-seeking behavior can be improved by extinguishing multiple alcohol-predictive stimuli or enhancing noradrenaline neurotransmission during extinction training. Both behavioral and neurobiological processes could be exploited to enhance the outcome of extinction-based treatments for alcohol use disorders.

Pulling habits out of rats: adenosine 2A receptor antagonism in dorsomedial striatum rescues meth-amphetamine-induced deficits in goal-directed action.

Addiction is characterized by a persistent loss of behavioral control resulting in insensitivity to negative feedback and abnormal decision-making. Here, we investigated the influence of methamphetamine (METH)-paired contextual cues on decision-making in rats. Choice between goal-directed actions was sensitive to outcome devaluation in a saline-paired context but was impaired in the METH-paired context, a deficit that was also found when negative feedback was provided. Reductions in c-Fos-related immunoreactivity were found in dorsomedial striatum (DMS) but not dorsolateral striatum after exposure to the METH context suggesting this effect reflected a loss specifically in goal-directed control in the METH context. This reduction in c-Fos was localized to non-enkephalin-expressing neurons in the DMS, likely dopamine D1-expressing direct pathway neurons, suggesting a relative change in control by the D1-direct versus D2-indirect pathways originating in the DMS may have been induced by METH-context exposure. To test this suggestion, we infused the adenosine 2A receptor antagonist ZM241385 into the DMS prior to test to reduce activity in D2 neurons relative to D1 neurons in the hope of reducing the inhibitory output from this region of the striatum. We found that this treatment fully restored sensitivity to negative feedback in a test conducted in the METH-paired context. These results suggest that drug exposure alters decision-making by downregulation of the circuitry mediating goal-directed action, an effect that can be ameliorated by acute A2A receptor inhibition in this circuit.

Toluene inhalation in adolescent rats reduces flexible behaviour in adulthood and alters glutamatergic and GABAergic signalling.

Toluene is a commonly abused inhalant that is easily accessible to adolescents. Despite the increasing incidence of use, our understanding of its long-term impact remains limited. Here, we used a range of techniques to examine the acute and chronic effects of toluene exposure on glutameteric and GABAergic function, and on indices of psychological function in adult rats after adolescent exposure. Metabolomics conducted on cortical tissue established that acute exposure to toluene produces alterations in cellular metabolism indicative of a glutamatergic and GABAergic profile. Similarly, in vitro electrophysiology in Xenopus oocytes found that acute toluene exposure reduced NMDA receptor signalling. Finally, in an adolescent rodent model of chronic intermittent exposure to toluene (10 000 ppm), we found that, while toluene exposure did not affect initial learning, it induced a deficit in updating that learning when response-outcome relationships were reversed or degraded in an instrumental conditioning paradigm. There were also group differences when more effort was required to obtain the reward; toluene-exposed animals were less sensitive to progressive ratio schedules and to delayed discounting. These behavioural deficits were accompanied by changes in subunit expression of both NMDA and GABA receptors in adulthood, up to 10 weeks after the final exposure to toluene in the hippocampus, prefrontal cortex and ventromedial striatum; regions with recognized roles in behavioural flexibility and decision-making. Collectively, our data suggest that exposure to toluene is sufficient to induce adaptive changes in glutamatergic and GABAergic systems and in adaptive behaviour that may underlie the deficits observed following adolescent inhalant abuse, including susceptibility to further drug-use.

Nucleus accumbens core and shell are differentially involved in general and outcome-specific forms of Pavlovian-instrumental transfer with alcohol and sucrose rewards.

Alcohol-associated stimuli contribute to relapse risk. Therefore, understanding the behavioural and neural mechanisms underlying the ability of such stimuli to promote alcohol-seeking is important for developing effective treatments for alcohol-use disorders. The Pavlovian-instrumental transfer (PIT) paradigm can be used to study the influence of Pavlovian cues on independently-trained instrumental responses earning reward. The effects can be either general, increasing the vigour of reward-related behaviours, or specific to responses that earn a common outcome. These different forms of PIT are mediated by distinct neural circuits involving the nucleus accumbens (NAC) core and shell, respectively. Here we examined the effects of pharmacological inactivation of either the NAC core or shell on PIT generated by alcohol-predictive and sucrose-predictive stimuli in rats. We found that presentations of a stimulus predicting sucrose enhanced responding for sucrose but not alcohol, suggesting an outcome-specific effect. In contrast, presentations of an alcohol-predictive stimulus enhanced responding for both alcohol and sucrose, suggesting a generally arousing effect. Inactivation of the NAC core reduced PIT and, in particular, the effect of the alcohol stimulus. Inactivation of the NAC shell reduced the specificity of the stimulus effects but left the ability of the stimuli to non-specifically invigorate responding intact, consistent with a role in mediating the specificity of PIT. Together, these results suggest that the NAC core plays a particularly important role in mediating the influence of alcohol-predictive cues on reward-seeking behaviours.

Habitual Alcohol Seeking: Neural Bases and Possible Relations to Alcohol Use Disorders.

Loss of flexible control over alcohol use may contribute to the development of alcohol use disorders. An increased contribution of response habits to alcohol-related behaviors may help explain this loss of control. Focusing on data from outcome devaluation and Pavlovian-instrumental transfer procedures, we review evidence for loss of goal-directed control over alcohol seeking and consumption drawing from both preclinical findings and clinical data where they exist. Over the course of extended alcohol self-administration and exposure, the performance of alcohol-seeking responses becomes less sensitive to reduction in the value of alcohol and more vulnerable to the influences of alcohol-predictive stimuli. These behavioral changes are accompanied by a shift in the corticostriatal circuits that control responding from circuits centered on the dorsomedial to those centered on the dorsolateral striatum. These changes in behavioral and neural control could help explain failures to abstain from alcohol despite intention to do so. Understanding and ultimately ameliorating these changes will aid development of more effective treatment interventions.

Binge-like consumption of a palatable food accelerates habitual control of behavior and is dependent on activation of the dorsolateral striatum.

Access to highly palatable and calorically dense foods contributes to increasing rates of obesity worldwide. Some have made the controversial argument that consumption of such foods can lead to "food addiction," yet little is known about how long-term access to highly palatable foods might alter goal-directed learning and decision making. In the following experiments, rats were given 5 weeks of continuous or restricted daily access to sweetened condensed milk (SCM) before instrumental training for food reward. Subsequently we examined whether goal-directed performance was impaired in these groups using the outcome-devaluation task. Control rats reduced responding following devaluation of the earned outcome as did those with previous continuous access to SCM. Of interest, rats with previous restricted access to SCM responded similarly under the devalued and nondevalued conditions, indicating loss of goal-directed control of responding. To identify whether the loss of goal-directed control was accompanied by differences in neuronal activity, we used c-Fos immunohistochemistry to examine the patterns of activation during devaluation testing. We observed greater c-Fos immunoreactivity in the dorsolateral striatum (DLS) and associated cortical regions in the group that received previous restricted access to SCM and demonstrated a lack of sensitivity to outcome devaluation. Infusion of the AMPA-receptor antagonist CNQX or dopamine D1-receptor antagonist SCH-23390 into the DLS before testing restored goal-directed performance in the restricted SCM group, confirming that this region is essential for habit-based performance. These results indicate that previous diet can alter subsequent learning and activity in the neural circuits that support performance.

The role of the amygdala-striatal pathway in the acquisition and performance of goal-directed instrumental actions.

The posterior dorsomedial striatum (pDMS) is essential for the acquisition and expression of the specific response-outcome (R-O) associations that underlie goal-directed action. Here we examined the role of a pathway linking the basolateral amygdala (BLA) and pDMS in such goal-directed learning. In Experiment 1, rats received unilateral lesions of the BLA and were implanted with cannula targeting the pDMS in either the ipsilateral (control) or contralateral (disconnection) hemisphere. After initial training, rats received infusions of muscimol to inactivate the pDMS immediately before sessions in which novel R-O associations were introduced. Sensitivity to devaluation by specific satiety was then assessed. Whereas rats in the ipsilateral group used the recently acquired associations to direct performance following devaluation, those in the contralateral group could not, indicating that BLA-pDMS disconnection prevented the acquisition of the new R-O associations. Indeed, evidence suggested that these rats relied instead on learning acquired during prior training to direct performance following devaluation. In Experiment 2, rats underwent similar surgery and training except they received muscimol infusions immediately before devaluation testing. Those in the ipsilateral group showed a selective devaluation effect, again based on the most recently introduced R-O associations. In contrast, rats in the contralateral group showed nonselective performance after devaluation indicating that the BLA-DMS pathway is also required for the expression of selective R-O associations. Together these results suggest that input from the BLA is essential for specific R-O learning by the pDMS.

Optogenetic stimulation of the locus coeruleus enhances appetitive extinction in rats.

Extinction is a specific example of learning where a previously reinforced stimulus or response is no longer reinforced, and the previously learned behaviour is no longer necessary and must be modified. Current theories suggest extinction is not the erasure of the original learning but involves new learning that acts to suppress the original behaviour. Evidence for this can be found when the original behaviour recovers following the passage of time (spontaneous recovery) or reintroduction of the reinforcement (i.e. reinstatement). Recent studies have shown that pharmacological manipulation of noradrenaline (NA) or its receptors can influence appetitive extinction; however, the role and source of endogenous NA in these effects are unknown. Here, we examined the role of the locus coeruleus (LC) in appetitive extinction. Specifically, we tested whether optogenetic stimulation of LC neurons during extinction of a food-seeking behaviour would enhance extinction evidenced by reduced spontaneous recovery in future tests. LC stimulation during extinction trials did not change the rate of extinction but did serve to reduce subsequent spontaneous recovery, suggesting that stimulation of the LC can augment reward-related extinction. Optogenetic inhibition of the LC during extinction trials reduced responding during the trials where it was applied, but no long-lasting changes in the retention of extinction were observed. Since not all LC cells expressed halorhodopsin, it is possible that more complete LC inhibition or pathway-specific targeting would be more effective at suppressing extinction learning. These results provide further insight into the neural basis of appetitive extinction, and in particular the role of the LC. A deeper understanding of the physiological bases of extinction can aid development of more effective extinction-based therapies.

The role of dorsomedial striatum adenosine 2A receptors in the loss of goal-directed behaviour.

RATIONALE: Adenosine A2A receptors (A2AR) in the dorsal striatum have been implicated in goal-directed behaviour. While activation of these receptors with several methods has resulted in an insensitivity to outcome devaluation, particular explanations for how they disrupt behaviour have not been explored. We both confirm a role for A2A receptors in goal-directed responding and evaluate additional behavioural aspects of goal-directed control to more fully understand the role of A2A receptors in instrumental behaviour. OBJECTIVES: To examine the effects of the adenosine A2A agonist CGS-21680 in the DMS on response-outcome encoding, updating representations of outcome value and on the ability to inhibit behaviour when reward is not available. METHODS: Male rats were trained to lever press for food reward. The A2AR agonist CGS-21680 was infused into the dorsomedial striatum either before an outcome devaluation test, prior to training with two distinct response-outcome associations or prior to a test of discriminative stimulus control over instrumental performance. RESULTS: Intra-DMS administration of CGS-21680 impaired sensitivity to outcome devaluation. CGS-21680 treatment did not impair acquisition of specific response-outcome associations, selective control of responding based on the presence of stimuli that signaled when reward was or was not available, discrimination between stimuli or lever choices nor did it influence the effect of devaluation on the amounts of food eaten in a consumption test. CONCLUSIONS: CGS-21680 impairs the ability to modulate responding based on recent changes to outcome value, an effect that is not accounted for by impairments in behavioural inhibition, discrimination, encoding the specific outcome of a response or the effectiveness of specific satiety.

The general and outcome-specific forms of Pavlovian-instrumental transfer are differentially mediated by the nucleus accumbens core and shell.

Tests of Pavlovian-instrumental transfer (PIT) demonstrate that reward-predictive stimuli can exert a powerful motivational influence on the performance of instrumental actions. Recent evidence suggests that predictive stimuli produce this effect through either the general arousal (general PIT) or the specific predictions (outcome-specific PIT) produced by their association with reward. In two experiments, we examined the effects of pretraining lesions (Experiment 1) or muscimol-induced inactivation (Experiment 2) of either the core or shell regions of the nucleus accumbens (NAC) on these forms of PIT. Rats received Pavlovian training in which three auditory stimuli each predicted the delivery of a distinct food outcome. Separately, the rats were trained to perform two instrumental actions, each of which earned one of the outcomes used in Pavlovian conditioning. Finally, the effects of the three stimuli on performance of the two actions were assessed in extinction. Here we report evidence of a double dissociation between general and outcome-specific PIT at the level of the accumbens. Shell lesions eliminated outcome-specific PIT but spared general PIT, whereas lesions of the core abolished general PIT but spared outcome-specific PIT. Importantly, the infusion of muscimol into core or shell made immediately before the PIT tests produced a similar pattern of results. These results suggest that whereas the NAC core mediates the general excitatory effects of reward-related cues, the NAC shell mediates the effect of outcome-specific reward predictions on instrumental performance, and thereby serve to clarify reported discrepancies regarding the role of the NAC core and shell in PIT.

Deepened extinction following compound stimulus presentation: noradrenergic modulation.

Behavioral extinction is an active form of new learning involving the prediction of nonreward where reward has previously been present. The expression of extinction learning can be disrupted by the presentation of reward itself or reward-predictive stimuli (reinstatement) as well as the passage of time (spontaneous recovery) or contextual changes (renewal). The following experiments replicated the demonstration that presenting multiple previously rewarded stimuli in compound during extinction enhances extinction learning. To explore the pharmacological basis for this we next examined the effects of pharmacological treatments that either facilitated or blocked noradrenergic activity to test the hypothesis that increased noradrenergic activity at the time of extinction training would improve, whereas blockade of noradrenergic activity would impair the extinction of appetitive stimulus-reward memories. Different groups of rats were trained in a discriminative stimulus paradigm to lever-press for food reward. Once stable responding was achieved, responding was extinguished for 2 d. Prior to a third extinction session, rats received systemic administration of either saline, yohimbine (α2 antagonist), atomoxetine (norepinephrine reuptake inhibitor), or propranolol (ß-receptor antagonist). Spontaneous recovery of responding to the stimuli was tested 4 wk later. Our results indicate that increasing noradrenergic activity during extinction augments extinction learning resulting in less recovery of responding at test. These results have important implications for models of relapse to drug seeking and the development of extinction-based therapies.