The effect of corticosterone on the acquisition of Pavlovian conditioned approach behavior in rats is dependent on sex and vendor.

Cues in the environment become predictors of biologically relevant stimuli, such as food, through associative learning. These cues can not only act as predictors but can also be attributed with incentive motivational value and gain control over behavior. When a cue is imbued with incentive salience, it attains the ability to elicit maladaptive behaviors characteristic of psychopathology. We can capture the propensity to attribute incentive salience to a reward cue in rats using a Pavlovian conditioned approach paradigm, in which the presentation of a discrete lever-cue is followed by the delivery of a food reward. Upon learning the cue-reward relationship, some rats, termed sign-trackers, develop a conditioned response directed towards the lever-cue; whereas others, termed goal-trackers, approach the food cup upon lever-cue presentation. Here, we assessed the effects of systemic corticosterone (CORT) on the acquisition and expression of sign- and goal-tracking behaviors in male and female rats, while examining the role of the vendor (Charles River or Taconic) from which the rats originated in these effects. Treatment naïve male and female rats from Charles River had a greater tendency to sign-track than those from Taconic. Administration of CORT enhanced the acquisition of sign-tracking behavior in males from Charles River and females from both vendors. Conversely, administration of CORT had no effect on the expression of the conditioned response. These findings demonstrate a role for CORT in cue-reward learning and suggest that inherent tendencies towards sign- or goal-tracking may interact with this physiological mediator of motivated behavior.

Optogenetic Inhibition of Ventral Pallidum Neurons Impairs Context-Driven Salt Seeking.

Salt appetite, in which animals can immediately seek out salt when under a novel state of sodium deprivation, is a classic example of how homeostatic systems interface with learned associations to produce an on-the-fly updating of motivated behavior. Neural activity in the ventral pallidum (VP) has been shown to encode changes in the value of salt under such conditions, both the value of salt itself (Tindell et al., 2006) and the motivational value of its predictive cues (Tindell et al., 2009; Robinson and Berridge, 2013). However, it is not known whether the VP is necessary for salt appetite in terms of seeking out salt or consuming salt following sodium depletion. Here, we used a conditioned place-preference procedure to investigate the effects of optogenetically inhibiting the VP on context-driven salt seeking and the consumption of salt following deprivation. Male rats learned to associate one context with sucrose and another context with less-desirable salt. Following sodium depletion, and in the absence of either sucrose or salt, we found that inhibiting the VP selectively reduced the elevation in time spent in the salt-paired context. VP inhibition had minimal effects on the consumption of salt once it was made available. To our knowledge, this is the first evidence that the VP or any brain region is necessary for the ability to use contextual cues to guide salt seeking. These results highlight a dissociation between deficit-driven reward seeking and reward consumption to replenish those deficits, with the former process being particularly sensitive to on-line VP activity.SIGNIFICANCE STATEMENT Salt appetite, in which rats will immediately seek out a once-undesirable concentrated salt solution after being depleted of bodily sodium despite never having tasted salt as a positive reward, is a phenomenon showing how animals can update their motivational goals without any new learning or conditioning. This salt-seeking behavior is also observed when the animal is presented with salt-paired cues. The neural circuitry necessary for context-driven salt-seeking behavior is unknown. We used a novel conditioned place preference procedure to show that optogenetic inhibition of the ventral pallidum (VP), a region known for processing reward, impairs context-driven salt seeking and has minimal effects on the consumption of salt itself following sodium depletion. These results highlight the importance of the VP in context-driven reward-seeking behavior.

Paradoxical accentuation of motivation following accumbens-pallidum disconnection.

The nucleus accumbens (NAc) and ventral pallidum (VP) are reciprocally connected, and activity within this circuit is thought to promote reward learning. Inconsistent with this notion, we find that disconnecting NAc medial shell and VP greatly enhances the attribution of value to a cue that is paired with reward. This result suggests that medial NAc shell and VP are both needed for attributing value to cues yet can also oppose one-another's functional contribution.

An omission procedure reorganizes the microstructure of sign-tracking while preserving incentive salience.

Appetitive sign-tracking, in which reward-paired cues elicit approach that can result in cue interaction, demonstrates how cues acquire motivational value. For example, rats will approach and subsequently interact with a lever insertion cue that signals food delivery upon its retraction. However, lever deflections are rapidly reduced once rats are trained on an omission schedule in which lever interactions cancel food delivery. Here we evaluated the change in sign-tracking response topography in rats exposed to such an omission procedure. Lever deflections dropped precipitously when they canceled reward. However, rats that were on an omission schedule continued to approach, sniff, and contact the lever without pressing it, and did so at comparable rates to rats that were not under an omission schedule. Thus, sign-tracking was maintained, albeit in a different manner, following omission. Such findings show that the motivational attraction to reward cues can be expressed with remarkable persistence and flexibility.

Chemogenetic manipulation of ventral pallidal neurons impairs acquisition of sign-tracking in rats.

Cues associated with rewarding events acquire value themselves as a result of the incentive value of the reward being transferred to the cue. Consequently, presentation of a reward-paired cue can trigger reward-seeking behaviours towards the cue itself (i.e. sign-tracking). The ventral pallidum (VP) has been demonstrated to be involved in a number of motivated behaviours, both conditioned and unconditioned. However, its contribution to the acquisition of incentive value is unknown. Using a discriminative autoshaping procedure with levers, the effects of disrupting VP activity in rats on the emergence of sign-tracking was investigated using chemogenetics, i.e. Designer Receptors Exclusively Activated by Designer Drugs (DREADDs). Transient disruption of VP neurons [activation of the inhibitory hM4D(Gi) DREADD through systemic injections of clozapine N-oxide (CNO) prior to each autoshaping session] impaired acquisition of sign-tracking (lever press rate) without having any effect on approach to the site of reward delivery (i.e. goal-tracking) or on the expression of sign-tracking after it was acquired. In addition, electrophysiological recordings were conducted in freely behaving rats following VP DREADD activation. The majority of VP units that were responsive to CNO injections exhibited rapid inhibition relative to baseline, a subset of CNO-responsive units showed delayed excitation, and a smaller subset displayed a mixed response of inhibition and excitation following CNO injections. It is argued that disruption of VP during autoshaping specifically disrupted the transfer of incentive value that was attributed to the lever cue, suggesting a surprisingly fundamental role for the VP in acquiring, compared with expressing, Pavlovian incentive values.

The effect of corticosterone on the acquisition of Pavlovian conditioned approach behavior is dependent on sex and vendor.

Cues in the environment become predictors of biologically relevant stimuli, such as food, through associative learning. These cues can not only act as predictors but can also be attributed with incentive motivational value and gain control over behavior. When a cue is imbued with incentive salience, it attains the ability to elicit maladaptive behaviors characteristic of psychopathology. We can capture the propensity to attribute incentive salience to a reward cue in rats using a Pavlovian conditioned approach paradigm, in which the presentation of a discrete lever-cue is followed by the delivery of a food reward. Upon learning the cue-reward relationship, some rats, termed sign-trackers, develop a conditioned response directed towards the lever-cue; whereas others, termed goal-trackers, approach the food cup upon lever-cue presentation. Here, we assessed the effects of systemic corticosterone (CORT) on the acquisition and expression of sign- and goal-tracking behaviors in male and female rats, while examining the role of the vendor (Charles River or Taconic) from which the rats originated in these effects. Male and female rats from Charles River had a greater tendency to sign-track than those from Taconic. Administration of CORT enhanced the acquisition of sign-tracking behavior in males from Charles River and females from both vendors. Conversely, administration of CORT had no effect on the expression of the conditioned response. These findings demonstrate a role for CORT in cue-reward learning and suggest that inherent tendencies towards sign- or goal-tracking may interact with this physiological mediator of motivated behavior. Highlights: Male and female rats from Charles River exhibit more sign-tracking relative to those from Taconic.Corticosterone increases the acquisition of sign-tracking in male rats from Charles River.Corticosterone increases the acquisition of sign-tracking in female rats, regardless of vendor.There is no effect of corticosterone on the expression of sign-tracking behavior in either male or female rats.

Odor-mediated taste learning requires dorsal hippocampus, but not basolateral amygdala activity.

Mediated learning is a unique cognitive phenomenon in which mental representations of physically absent stimuli enter into associations with directly-activated representations of physically present stimuli. Three experiments investigated the functional physiology of mediated learning involving the use of odor-taste associations. In Experiments 1a and 1b, basolateral amygdala lesions failed to attenuate mediated taste aversion learning. In Experiment 2, dorsal hippocampus inactivation impaired mediated learning, but left direct learning intact. Considered with past studies, the results implicate the dorsal hippocampus in mediated learning generally, and suggest a limit on the importance of the basolateral amygdala.

Roles of nucleus accumbens and basolateral amygdala in autoshaped lever pressing.

Initially-neutral cues paired with rewards are thought to acquire motivational significance, as if the incentive motivational value of the reward is transferred to the cue. Such cues may serve as secondary reinforcers to establish new learning, modulate the performance of instrumental action (Pavlovian-instrumental transfer, PIT), and be the targets of approach and other cue-directed behaviors. Here we examined the effects of lesions of the ventral striatal nucleus accumbens (ACb) and the basolateral amygdala (BLA) on the acquisition of discriminative autoshaped lever-pressing in rats. Insertion of one lever into the experimental chamber was reinforced by sucrose delivery, but insertion of another lever was not reinforced. Although sucrose was delivered independently of the rats' behavior, sham-lesioned rats rapidly came to press the reinforced but not the nonreinforced lever. Bilateral ACb lesions impaired the initial acquisition of sign-tracking but not its terminal levels. In contrast, BLA lesions produced substantial deficits in terminal levels of sign-tracking. Furthermore, whereas ACb lesions primarily affected the probability of lever press responses, BLA lesions mostly affected the rate of responding once it occurred. Finally, disconnection lesions that disrupted communication between ACb and BLA produced both sets of deficits. We suggest that ACb is important for initial acquisition of consummatory-like responses that incorporate hedonic aspects of the reward, while BLA serves to enhance such incentive salience once it is acquired.

Investigating individual differences in opioid-taking and opioid-seeking behavior in male rats.

RATIONALE: Understanding the behavioral and neurobiological factors that render some individuals more susceptible than others to opioid addiction will be critical in combatting the opioid crisis. OBJECTIVE: The purpose of the current study was to determine if behavioral traits associated with an increased likelihood to take and seek cocaine are the same traits that render one more susceptible to opioid-taking and opioid-seeking behavior. Individual differences in the acquisition of remifentanil self-administration and subsequent cue-induced reinstatement of remifentanil-seeking behavior were investigated using two animal models: the high-responder (HR)/low-responder (LR) and sign-tracker (ST)/goal-tracker (GT) models. Relative to LR rats, HR rats show increased novelty-induced locomotion or "sensation-seeking" behavior, and are more likely to acquire cocaine-taking behavior and do so at a faster rate. Relative to GT rats, ST rats attribute greater incentive motivational value to reward cues and are more likely to exhibit reinstatement of cocaine-seeking behavior. RESULTS: In contrast to previous work using cocaine, we did not observe individual differences with respect to the acquisition of remifentanil self-administration- or cue-induced reinstatement of remifentanil-seeking behavior within the context of either the HR/LR or ST/GT model. Thus, neither the sensation-seeking trait nor the propensity to attribute incentive motivational value to reward cues predicts remifentanil-taking or remifentanil-seeking behavior. CONCLUSIONS: These findings suggest that different traits may confer the initiation of opioid- vs. cocaine-taking behavior, and the propensity to relapse to opioid- vs. cocaine-seeking. Additional studies are needed to identify which neurobehavioral constructs confer liability to opioid use and relapse.

Inhibition of a cortico-thalamic circuit attenuates cue-induced reinstatement of drug-seeking behavior in "relapse prone" male rats.

RATIONALE: Relapse often occurs when individuals are exposed to stimuli or cues previously associated with the drug-taking experience. The ability of drug cues to trigger relapse is believed to be a consequence of incentive salience attribution, a process by which the incentive value of reward is transferred to the reward-paired cue. Sign-tracker (ST) rats that attribute enhanced incentive value to reward cues are more prone to relapse compared to goal-tracker (GT) rats that primarily attribute predictive value to such cues. OBJECTIVES: The neurobiological mechanisms underlying this individual variation in relapse propensity remains largely unexplored. The paraventricular nucleus of the thalamus (PVT) has been identified as a critical node in the regulation of cue-elicited behaviors in STs and GTs, including cue-induced reinstatement of drug-seeking behavior. Here we used a chemogenetic approach to assess whether "top-down" cortical input from the prelimbic cortex (PrL) to the PVT plays a role in mediating individual differences in relapse propensity. RESULTS: Chemogenetic inhibition of the PrL-PVT pathway selectively decreased cue-induced reinstatement of drug-seeking behavior in STs, without affecting behavior in GTs. In contrast, cocaine-primed drug-seeking behavior was not affected in either phenotype. Furthermore, when rats were characterized based on a different behavioral phenotype-locomotor response to novelty-inhibition of the PrL-PVT pathway had no effect on either cue- or drug-induced reinstatement. CONCLUSIONS: These results highlight an important role for the PrL-PVT pathway in vulnerability to relapse that is consequent to individual differences in the propensity to attribute incentive salience to discrete reward cues.

Effects of Pair Housing on Patency of Jugular Catheters in Rats (Rattus norvegicus).

Chronic vascular access devices are widely used in a variety of species for repeated blood sampling or substance administration. Jugular catheters are commonly used for studying addiction-related behaviors in rats. Rats with catheters have historically been individually housed for the duration of the study to prevent cage mates from damaging the catheter. The 2 goals of this study were to determine 1) the effects of pair housing on catheter patency and 2) the effects of pair housing on catheter patency of rats in a study of opioid self-administration and cue-induced reinstatement of opioid-seeking behavior. The latter study also represented an opportunity for experimental refinement as it evaluated the temporary use of a barrier that allowed for pair-housed rats to be physically separated. Male Heterogeneous Stock (HS; n = 24) and Sprague-Dawley (SD; n = 121) rats were allocated to either single- or pair-housed condition. To assess the effect of social housing on catheter patency, rats (HS, n = 24; SD, n = 36) were monitored in their assigned housing condition for one month, with scheduled evaluation of catheter patency and structural damage. To examine the effect of social housing on catheter patency during a study of opioid self-administration and cue-induced reinstatement of opioid-seeking behavior, rats (SD, n = 85) were monitored in their assigned housing condition with similar routine patency evaluations. Catheter patency rates between single- and pairhoused rats were not statistically different in the first experiment, and pair-housed animals were successfully maintained on an infusion study in the second experiment. The use of a barrier between pair-housed rats after surgery allowed continued social contact with no observed adverse effects. These results suggest that, pair housing is a viable option for rats with chronic vascular implants, and may improve their wellbeing by allowing them to display species-typical social behaviors.

Context-driven Salt Seeking Test (Rats).

Changes in reward seeking behavior often occur through incremental learning based on the difference between what is expected and what actually happens. Behavioral flexibility of this sort requires experience with rewards as better or worse than expected. However, there are some instances in which behavior can change through non-incremental learning, which requires no further experience with an outcome. Such an example of non-incremental learning is the salt appetite phenomenon. In this case, animals such as rats will immediately seek out a highly-concentrated salt solution that was previously undesired when they are put in a novel state of sodium deprivation. Importantly, this adaptive salt-seeking behavior occurs despite the fact that the rats never tasted salt in the depleted state, and therefore never tasted it as a highly desirable reward. The following protocol is a method to investigate the neural circuitry mediating adaptive salt seeking using a conditioned place preference (CPP) procedure. The procedure is designed to provide an opportunity to discover possible dissociations between the neural circuitry mediating salt seeking and salt consumption to replenish the bodily deficit after sodium depletion. Additionally, this procedure is amenable to incorporating a number of neurobiological techniques for studying the brain basis of this behavior.

Effects of orbitofrontal cortex lesions on autoshaped lever pressing and reversal learning.

A cue associated with a rewarding event can trigger behavior towards the cue itself due to the cue acquiring incentive value through its pairing with the rewarding outcome (i.e., sign-tracking). For example, rats will approach, press, and attempt to "consume" a retractable lever conditioned stimulus (CS) that signals delivery of a food unconditioned stimulus (US). Attending to food-predictive CSs is important when seeking out food, and it is just as important to be able to modify one's behavior when the relationships between CSs and USs are changed. Using a discriminative autoshaping procedure with lever CSs, the present study investigated the effects of orbitofrontal cortex (OFC) lesions on sign-tracking and reversal learning. Insertion of one lever was followed by sucrose delivery upon retraction, and insertion of another lever was followed by nothing. After the acquisition phase, the contingencies between the levers and outcomes were reversed. Bilateral OFC lesions had no effect on the acquisition of sign-tracking. However, OFC-lesioned rats showed substantial deficits in acquiring sign-tracking compared to sham-lesioned rats once the stimulus-outcome contingencies were reversed. Over the course of reversal learning, OFC-lesioned rats were able to reach comparable levels of sign-tracking as sham-lesioned rats. These findings suggest that OFC is not necessary for the ability of a CS to acquire incentive value and provide more evidence that OFC is critical for modifying behavior appropriately following a change in stimulus-outcome contingencies.

Exposure to Kynurenic Acid during Adolescence Increases Sign-Tracking and Impairs Long-Term Potentiation in Adulthood.

Changes in brain reward systems are thought to contribute significantly to the cognitive and behavioral impairments of schizophrenia, as well as the propensity to develop co-occurring substance abuse disorders. Presently, there are few treatments for persons with a dual diagnosis and little is known about the neural substrates that underlie co-occurring schizophrenia and substance abuse. One goal of the present study was to determine if a change in the concentration of kynurenic acid (KYNA), a tryptophan metabolite that is increased in the brains of people with schizophrenia, affects reward-related behavior. KYNA is an endogenous antagonist of NMDA glutamate receptors and α7 nicotinic acetylcholine receptors, both of which are critically involved in neurodevelopment, plasticity, and behavior. In Experiment 1, rats were treated throughout adolescence with L-kynurenine (L-KYN), the precursor of KYNA. As adults, the rats were tested drug-free in an autoshaping procedure in which a lever was paired with food. Rats treated with L-KYN during adolescence exhibited increased sign-tracking behavior (lever pressing) when they were tested as adults. Sign-tracking is thought to reflect the lever acquiring incentive salience (motivational value) as a result of its pairing with reward. Thus, KYNA exposure may increase the incentive salience of cues associated with reward, perhaps contributing to an increase in sensitivity to drug-related cues in persons with schizophrenia. In Experiment 2, we tested the effects of exposure to KYNA during adolescence on hippocampal long-term potentiation (LTP). Rats treated with L-KYN exhibited no LTP after a burst of high-frequency stimulation that was sufficient to produce robust LTP in vehicle-treated rats. This finding represents the first demonstrated consequence of elevated KYNA concentration during development and provides insight into the basis for cognitive and behavioral deficits that result from exposure to KYNA during adolescence.

Effects of nucleus accumbens core and shell lesions on autoshaped lever-pressing.

Certain Pavlovian conditioned stimuli (CSs) paired with food unconditioned stimuli (USs) come to elicit approach and even consumption-like behaviors in rats (sign-tracking). We investigated the effects of lesions of the nucleus accumbens core (ACbC) or shell (ACbS) on the acquisition of sign-tracking in a discriminative autoshaping procedure in which presentation of one lever CS was followed by delivery of sucrose, and another was not. Although we previously found that bilateral lesions of the whole ACb disrupted the initial acquisition of sign-tracking, neither ACbC or ACbS lesions affected the rate or percentage of trials in which rats pressed the CS+. In addition, detailed video analysis showed no effect of either lesion on the topography of the sign-tracking conditioned response (CR). These and other results from lesion studies of autoshaping contrast with those from previous sign-tracking experiments that used purely visual cues (Parkinson et al., 2000a,b), suggesting that the neural circuitry involved in assigning incentive value depends upon the nature of the CS.

Effects of lesions of the amygdala central nucleus on autoshaped lever pressing.

Neutral cues paired with rewards often appear to acquire motivational significance, as if the incentive motivational value of the reward is transferred to the cue. Such cues have been reported to modulate the performance of instrumental action (Pavlovian-instrumental transfer, PIT), serve as conditioned reinforcers in the establishment of new learning, and be the targets of approach and other cue-directed behaviors. Here we examined the effects of lesions of the amygdala central nucleus (CeA) on the acquisition of discriminative autoshaped lever-pressing. Insertion of one lever into the experimental chamber was reinforced by sucrose delivery, but insertion of another lever was not reinforced. Although sucrose delivery was not contingent on lever pressing, both CeA- and sham-lesioned rats rapidly came to press the reinforced but not the nonreinforced lever. Despite their showing little evidence of impairments in autoshaped lever pressing, these same CeA-lesioned rats showed significant deficits in the expression of PIT in a subsequent phase of the experiment. The lack of impaired autoshaping in CeA-lesioned rats contrasts with effects previously reported for conditioned orienting responses (ORs) and for other putative measures of incentive learning including PIT and conditioned approach to visual cues.

The effects of basolateral amygdala lesions on unblocking.

Prior reinforcement of a neutral stimulus often blocks subsequent conditioning of a new stimulus if a compound of the original and new cues is paired with the same reinforcer. However, if the value of the reinforcer is altered when the compound is presented, the new cue typically acquires conditioning, a result called unblocking. Blocking, unblocking, and related phenomena have been attributed to variations in processing of either the reinforcer, for example, the Rescorla-Wagner (1972) model, or cues, for example, the Pearce-Hall (1980) model. Here, we examined the effects of lesions of the basolateral amygdala on the occurrence of unblocking when the food reinforcer was increased in quantity at the time of introduction of the new cue. The lesions had no effects on unblocking in a simple design (Experiment 1), which did not distinguish between unblocking produced by variations in reward or cue processing. However, in a procedure that distinguished between unblocking due to direct conditioning by the added reinforcer, consistent with the Rescorla-Wagner (1972) model, and that due to increases in conditioning to the original reinforcer, consistent with the Pearce-Hall (1980) and other models of learning, the lesions prevented unblocking of the latter type. These results were discussed in the context of roles of the basolateral amygdala in coding and using reward prediction error information in associative learning.