Effects of predictive and incentive value manipulation on sign- and goal-tracking behavior.

When a neutral stimulus is repeatedly paired with an appetitive reward, two different types of conditioned approach responses may develop: a sign-tracking response directed toward the neutral cue, or a goal-tracking response directed toward the location of impending reward delivery. Sign-tracking responses have been postulated to result from attribution of incentive value to conditioned cues, while goal-tracking reflects the assignment of only predictive value to the cue. We therefore hypothesized that sign-tracking rats would be more sensitive to manipulations of incentive value, while goal-tracking rats would be more responsive to changes in the predictive value of the cue. We tested sign- and goal-tracking before and after devaluation of a food reward using lithium chloride, and tested whether either response could be learned under negative contingency conditions that precluded any serendipitous reinforcement of the behavior that might support instrumental learning. We also tested the effects of blocking the predictive value of a cue using simultaneous presentation of a pre-conditioned cue. We found that sign-tracking was sensitive to outcome devaluation, while goal-tracking was not. We also confirmed that both responses are Pavlovian because they can be learned under negative contingency conditions. Goal-tracking was almost completely blocked by a pre-conditioned cue, while sign-tracking was much less sensitive to such interference. These results indicate that sign- and goal-tracking may follow different rules of reinforcement learning and suggest a need to revise current models of associative learning to account for these differences.

Nicotinic and muscarinic acetylcholine receptor antagonism dose-dependently decreases sign- but not goal-tracking behavior in male rats.

RATIONALE: Acetylcholinergic antagonists have shown some promise in reducing addiction-related behaviors in both preclinical and clinical studies. However, the psychological mechanisms by which these drugs are able to affect addictive behavior remain unclear. A particular key process for the development of addiction is the attribution of incentive salience to reward-related cues, which can be specifically measured in animals using a Pavlovian conditioned approach procedure. When confronted with a lever that predicts food delivery, some rats engage with the lever directly (i.e., they sign track), indicating attribution of incentive-motivational properties to the lever itself. In contrast, others treat the lever as a predictive cue and approach the location of impending food delivery (i.e., they goal track), without treating the lever itself as a reward. OBJECTIVES: We tested whether systemic antagonism of the either nicotinic or muscarinic acetylcholine receptors would selectively affect sign- or goal-tracking behavior, indicating a selective effect on incentive salience attribution. METHODS: A total of 98 male Sprague Dawley rats were either given the muscarinic antagonist scopolamine (100, 50, or 10 µg/kg i.p.) or the nicotinic antagonist mecamylamine (0.3, 1.0, or 3 mg/kg i.p.) before being trained on a Pavlovian conditioned approach procedure. RESULTS: Scopolamine dose-dependently decreased sign tracking behavior and increased goal-tracking behavior. Mecamylamine reduced sign-tracking but did not affect goal-tracking behavior. CONCLUSIONS: Antagonism of either muscarinic or nicotinic acetylcholine receptors can reduce incentive sign-tracking behavior in male rats. This effect appears to be specifically due to a reduction in incentive salience attribution since goal-tracking either increased or was not affected by these manipulations.

Genetic characterization of outbred Sprague Dawley rats and utility for genome-wide association studies.

Sprague Dawley (SD) rats are among the most widely used outbred laboratory rat populations. Despite this, the genetic characteristics of SD rats have not been clearly described, and SD rats are rarely used for experiments aimed at exploring genotype-phenotype relationships. In order to use SD rats to perform a genome-wide association study (GWAS), we collected behavioral data from 4,625 SD rats that were predominantly obtained from two commercial vendors, Charles River Laboratories and Harlan Sprague Dawley Inc. Using double-digest genotyping-by-sequencing (ddGBS), we obtained dense, high-quality genotypes at 291,438 SNPs across 4,061 rats. This genetic data allowed us to characterize the variation present in Charles River vs. Harlan SD rats. We found that the two populations are highly diverged (FST > 0.4). Furthermore, even for rats obtained from the same vendor, there was strong population structure across breeding facilities and even between rooms at the same facility. We performed multiple separate GWAS by fitting a linear mixed model that accounted for population structure and using meta-analysis to jointly analyze all cohorts. Our study examined Pavlovian conditioned approach (PavCA) behavior, which assesses the propensity for rats to attribute incentive salience to reward-associated cues. We identified 46 significant associations for the various metrics used to define PavCA. The surprising degree of population structure among SD rats from different sources has important implications for their use in both genetic and non-genetic studies.

Effects of the cannabinoid receptor agonist CP-55,940 on incentive salience attribution.

RATIONALE: Pavlovian conditioned approach paradigms are used to characterize the nature of motivational behaviors in response to stimuli as either directed toward the cue (i.e., sign-tracking) or the site of reward delivery (i.e., goal-tracking). Recent evidence has shown that activity of the endocannabinoid system increases dopaminergic activity in the mesocorticolimbic system, and other studies have shown that sign-tracking behaviors are dependent on dopamine. OBJECTIVES: Therefore, we hypothesized that administration of a cannabinoid agonist would increase sign-tracking and decrease goal-tracking behaviors. METHODS: Forty-seven adult male Sprague-Dawley rats were given a low, medium, or high dose of the cannabinoid agonist CP-55,940 (N = 12 per group) or saline (N = 11) before Pavlovian conditioned approach training. A separate group of rats (N = 32) were sacrificed after PCA training for measurement of cannabinoid receptor type 1 (CB1) and fatty acid amide hydrolase (FAAH) using in situ hybridization. RESULTS: Contrary to our initial hypothesis, CP-55,940 dose-dependently decreased sign-tracking and increased goal-tracking behavior. CB1 expression was higher in sign-trackers compared with that in goal-trackers in the prelimbic cortex, but there were no significant differences in CB1 or FAAH expression in the infralimbic cortex, dorsal or ventral CA1, dorsal or ventral CA3, dorsal or ventral dentate gyrus, or amygdala. CONCLUSIONS: These results demonstrate that cannabinoid signaling can specifically influence behavioral biases toward sign- or goal-tracking. Pre-existing differences in CB1 expression patterns, particularly in the prelimbic cortex, could contribute to individual differences in the tendency to attribute incentive salience to reward cues.

Individual variation in the attribution of incentive salience to social cues.

Research on the attribution of incentive salience to drug cues has furthered our understanding of drug self-administration in animals and addiction in humans. The influence of social cues on drug-seeking behavior has garnered attention recently, but few studies have investigated how social cues gain incentive-motivational value. In the present study, a Pavlovian conditioned approach (PCA) procedure was used to identify rats that are more (sign-trackers; STs) or less (goal-trackers; GTs) prone to attribute incentive salience to food reward cues. In Experiment 1, a novel procedure employed social 'peers' to compare the tendency of STs and GTs to attribute incentive salience to social reward cues as well as form a social-conditioned place preference. In Experiment 2, social behavior of STs and GTs was compared using social interaction and choice tests. Finally, in Experiment 3, levels of plasma oxytocin were measured in STs and GTs seven days after the last PCA training session, because oxytocin is known to modulate the mesolimbic reward system and social behavior. Compared to GTs, STs attributed more incentive salience to social-related cues and exhibited prosocial behaviors (e.g., social-conditioned place preference, increased social interaction, and social novelty-seeking). No group differences were observed in plasma oxytocin levels. Taken together, these experiments demonstrate individual variation in the attribution of incentive salience to both food- and social-related cues, which has important implications for the pathophysiology of addiction.

Sign-tracking behavior is difficult to extinguish and resistant to multiple cognitive enhancers.

The attribution of incentive-motivational value to drug-related cues underlies relapse and craving in drug addiction. One method of addiction treatment, cue-exposure therapy, utilizes repeated presentations of drug-related cues in the absence of drug (i.e., extinction learning); however, its efficacy has been limited due to an incomplete understanding of extinction and relapse processes after cues have been imbued with incentive-motivational value. To investigate this, we used a Pavlovian conditioned approach procedure to screen for rats that attribute incentive-motivational value to reward-related cues (sign-trackers; STs) or those that do not (goal-trackers; GTs). In Experiment 1, rats underwent Pavlovian extinction followed by reinstatement and spontaneous recovery tests. For comparison, a separate group of rats underwent PCA training followed by operant conditioning, extinction, and tests of reinstatement and spontaneous recovery. In Experiment 2, three cognitive enhancers (sodium butyrate, D-cycloserine, and fibroblast growth factor 2) were administered following extinction training to facilitate extinction learning. STs but not GTs displayed enduring resistance to Pavlovian, but not operant, extinction and were more susceptible to spontaneous recovery. In addition, none of the cognitive enhancers tested affected extinction learning. These results expand our understanding of extinction learning by demonstrating that there is individual variation in extinction and relapse processes and highlight potential difficulties in applying extinction-based therapies to drug addiction treatment in the clinic.

Single prolonged stress decreases sign-tracking and cue-induced reinstatement of cocaine-seeking.

Exposure to prolonged, uncontrollable stress reduces reward-seeking behavior, resulting in anhedonia in neuropsychiatric disorders, such as posttraumatic stress disorder. However, it is unclear to what degree stressed subjects lose interest in rewards themselves or in reward-related cues that instigate reward-seeking behavior. In the present study, we investigated the effects of single prolonged stress (SPS) on cue-directed behavior in two different procedures: Pavlovian conditioned approach (PCA) and cue-induced reinstatement of cocaine-seeking. In Experiment 1, rats were exposed to SPS and tested for the acquisition of sign-tracking (cue-directed) and goal-tracking (reward-directed) behaviors during a PCA procedure. In Experiment 2, rats were exposed to SPS and tested for the expression of sign- and goal-tracking as well as cue-induced reinstatement of cocaine-seeking. Because dopaminergic activity in the nucleus accumbens is known to play a central role in many cue-directed behaviors, including both sign-tracking and cue-induced reinstatement, Experiment 3 used in vivo microdialysis to measure the effect of SPS on baseline and evoked dopamine levels in the nucleus accumbens. SPS decreased sign-tracking and increased goal-tracking during the acquisition of PCA behavior without affecting reward consumption. In addition, SPS decreased cue-induced reinstatement without affecting cocaine self-administration. Finally, SPS decreased evoked but not baseline levels of dopamine in the nucleus accumbens. These results suggest that SPS decreases the motivational, but not consummatory, aspects of reward-seeking behavior, which may result from long-term, SPS-induced reductions in dopamine release in the nucleus accumbens.

Thalamic mast cell activity is associated with sign-tracking behavior in rats.

Mast cells are resident immune cells in the thalamus that can degranulate and release hundreds of signaling molecules (i.e., monoamines, growth factors, and cytokines) both basally and in response to environmental stimuli. Interestingly, mast cell numbers in the brain show immense individual variation in both rodents and humans. We used a Pavlovian conditioned approach (PCA) procedure to examine whether mast cells are associated with individual variation in the attribution of incentive-motivational value to reward-related cues. During the PCA procedure, a lever response-independently predicts the delivery of a food pellet into a magazine, and over training sessions three conditioned responses (CRs) develop: sign-tracking (lever-directed CRs), goal-tracking (magazine-directed CRs), and an intermediate response (both CRs). In Experiment 1, we measured thalamic mast cell number/activation using toluidine blue and demonstrated that sign-trackers have increased degranulated (activated) but not granulated (inactive) mast cells. In Experiment 2, we infused the mast cell inhibitor, cromolyn (200µg/rat; i.c.v.), immediately before five daily PCA training sessions and demonstrated that mast cell inhibition selectively impairs the acquisition of sign-tracking behavior. Taken together, these results demonstrate that thalamic mast cells contribute to the attribution of incentive-motivational value to reward-related cues and suggest that mast cell inhibition may be a novel target for addiction treatment.

Subanesthetic ketamine decreases the incentive-motivational value of reward-related cues.

The attribution of incentive-motivational value to reward-related cues contributes to cue-induced craving and relapse in addicted patients. Recently, it was demonstrated that subanesthetic ketamine increases motivation to quit and decreases cue-induced craving in cocaine-dependent individuals. Although the underlying mechanism of this effect is currently unknown, one possibility is that subanesthetic ketamine decreases the incentive-motivational value of reward-related cues. In the present study, we used a Pavlovian conditioned approach procedure to identify sign-trackers, rats that attribute incentive-motivational value to reward-related cues, and goal-trackers, rats that assign only predictive value to reward-related cues. This model is of interest because sign-trackers are more vulnerable to cue-induced reinstatement of drug-seeking behavior and will persist in this drug-seeking behavior despite adverse consequences. We tested the effect of subanesthetic ketamine on the expression of Pavlovian conditioned approach behavior and the conditioned reinforcing properties of a reward-related cue in sign- and goal-trackers. We found that subanesthetic ketamine decreased sign-tracking and increased goal-tracking behavior in sign-trackers, though it had no effect on conditioned reinforcement. These results suggest that subanesthetic ketamine may be a promising pharmacotherapy for addiction that acts by decreasing the incentive-motivational value of reward-related cues.

Lesions of the ventral hippocampus attenuate the acquisition but not expression of sign-tracking behavior in rats.

Individual variation in the attribution of motivational salience to reward-related cues is believed to underlie addiction vulnerability. Pavlovian conditioned approach measures individual variation in motivational salience by identifying rats that are attracted to and motivated by reward cues (sign-trackers) or motivationally fixed on the reward itself (goal-trackers). Previously, it has been demonstrated that sign-trackers are more vulnerable to addiction-like behavior. Moreover, sign-trackers release more dopamine in the nucleus accumbens than goal-trackers in response to reward-related cues, and sign- but not goal-tracking behavior is dopamine-dependent. In the present study, we investigated whether the ventral hippocampus, a potent driver of dopaminergic activity in the nucleus accumbens, modulates the acquisition and expression of Pavlovian conditioned approach behavior. In Experiment 1, lesions of the ventral, but not dorsal or total hippocampus, decreased sign-tracking behavior. In Experiment 2, lesions of the ventral hippocampus did not affect the expression of sign- or goal-tracking behaviors nor conditioned reinforcement. In addition, temporary inactivation of the ventral subiculum, the main output pathway of the ventral hippocampus, did not affect the expression of sign- or goal-tracking behaviors. High-pressure liquid chromatography of nucleus accumbens tissue punches revealed that ventral hippocampal lesions decreased levels of homovanillic acid and the homovanillic acid/dopamine ratio (a marker of dopamine release and metabolism) in only sign-trackers, and decreased accumbal norepinephrine levels in both sign- and goal-trackers. These results suggest that the ventral hippocampus is important for the acquisition but not expression of sign-tracking behavior, possibly as a result of altered dopamine and norepinephrine in the nucleus accumbens. © 2016 Wiley Periodicals, Inc.

Pavlovian Conditioned Approach Training in Rats.

Cues that are contingently paired with unconditioned, rewarding stimuli can acquire rewarding properties themselves through a process known as the attribution of incentive salience, or the transformation of neutral stimuli into attractive, "wanted' stimuli capable of motivating behavior. Pavlovian conditioned approach (PCA) develops after the response-independent presentation of a conditioned stimulus (CS; e.g., a lever) that predicts the delivery of an unconditioned stimulus (US; e.g., a food pellet) and can be used to measure incentive salience. During training, three patterns of conditioned responses (CRs) can develop: sign-tracking behavior (CS-directed CR), goal-tracking behavior (US-directed CR), and an intermediate response (both CRs). Sign-trackers attribute incentive salience to reward-related cues and are more vulnerable to cue-induced reinstatement of drug-seeking as well as other addiction-related behaviors, making PCA a potentially valuable procedure for studying addiction vulnerability. Here, we describe materials and methods used to elicit PCA behavior from rats as well as analyze and interpret PCA behavior in individual experiments.

Sign-trackers have elevated myo-inositol in the nucleus accumbens and ventral hippocampus following Pavlovian conditioned approach.

Pavlovian conditioned approach (PCA) is a behavioral procedure that can be used to assess individual differences in the addiction vulnerability of drug-naïve rats and identify addiction vulnerability factors. Using proton magnetic resonance spectroscopy (1 H-MRS) ex vivo, we simultaneously analyzed concentrations of multiple neurochemicals throughout the mesocorticolimbic system 2 weeks after PCA training in order to identify potential vulnerability factors to addiction in drug-naïve rats for future investigations. Levels of myo-inositol (Ins), a 1 H-MRS-detectable marker of glial activity/proliferation, were increased in the nucleus accumbens (NAc) and ventral hippocampus, but not dorsal hippocampus or medial prefrontal cortex, of sign-trackers compared to goal-trackers or intermediate responders. In addition, Ins levels positively correlated with PCA behavior in the NAc and ventral hippocampus. Because the sign-tracker phenotype is associated with increased drug-seeking behavior, these results observed in drug-naïve rats suggest that alterations in glial activity/proliferation within these regions may represent an addiction vulnerability factor. Sign-tracking rats preferentially approach reward cues during Pavlovian conditioning, while goal-trackers instead approach the location of impending reward. Sign-trackers are also more prone to cue-induced drug-seeking behavior. We used magnetic resonance spectroscopy to show that myo-inositol levels are higher in the ventral hippocampus and nucleus accumbens of sign-trackers relative to goal-trackers. Thus, elevated myo-inositol may be a vulnerability factor for addiction.

Rats that sign-track are resistant to Pavlovian but not instrumental extinction.

Individuals vary in the extent to which they attribute incentive salience to a discrete cue (conditioned stimulus; CS) that predicts reward delivery (unconditioned stimulus; US), which results in some individuals approaching and interacting with the CS (sign-trackers; STs) more than others (goal-trackers; GTs). Here we asked how periods of non-reinforcement influence conditioned responding in STs vs. GTs, in both Pavlovian and instrumental tasks. After classifying rats as STs or GTs by pairing a retractable lever (the CS) with the delivery of a food pellet (US), we introduced periods of non-reinforcement, first by simply withholding the US (i.e., extinction training; experiment 1), then by signaling alternating periods of reward (R) and non-reward (NR) within the same session (experiments 2 and 3). We also examined how alternating R and NR periods influenced instrumental responding for food (experiment 4). STs and GTs did not differ in their ability to discriminate between R and NR periods in the instrumental task. However, in Pavlovian settings STs and GTs responded to periods of non-reward very differently. Relative to STs, GTs very rapidly modified their behavior in response to periods of non-reward, showing much faster extinction and better and faster discrimination between R and NR conditions. These results highlight differences between Pavlovian and instrumental extinction learning, and suggest that if a Pavlovian CS is strongly attributed with incentive salience, as in STs, it may continue to bias attention toward it, and to facilitate persistent and relatively inflexible responding, even when it is no longer followed by reward.

Stress-free automatic sleep deprivation using air puffs.

BACKGROUND: Sleep deprivation via gentle handling is time-consuming and personnel-intensive. NEW METHOD: We present here an automated sleep deprivation system via air puffs. Implanted EMG and EEG electrodes were used to assess sleep/waking states in six male Sprague-Dawley rats. Blood samples were collected from an implanted intravenous catheter every 4h during the 12-h light cycle on baseline, 8h of sleep deprivation via air puffs, and 8h of sleep deprivation by gentle handling days. RESULTS: The automated system was capable of scoring sleep and waking states as accurately as our offline version (∼90% for sleep) and with sufficient speed to trigger a feedback response within an acceptable amount of time (1.76s). Manual state scoring confirmed normal sleep on the baseline day and sleep deprivation on the two manipulation days (68% decrease in non-REM, 63% decrease in REM, and 74% increase in waking). No significant differences in levels of ACTH and corticosterone (stress hormones indicative of HPA axis activity) were found at any time point between baseline sleep and sleep deprivation via air puffs. COMPARISON WITH EXISTING METHOD: There were no significant differences in ACTH or corticosterone concentrations between sleep deprivation by air puffs and gentle handling over the 8-h period. CONCLUSIONS: Our system accurately detects sleep and delivers air puffs to acutely deprive rats of sleep with sufficient temporal resolution during the critical 4-5h post learning sleep-dependent memory consolidation period. The system is stress-free and a viable alternative to existing sleep deprivation techniques.

Variation in the form of Pavlovian conditioned approach behavior among outbred male Sprague-Dawley rats from different vendors and colonies: sign-tracking vs. goal-tracking.

Even when trained under exactly the same conditions outbred male Sprague-Dawley (SD) rats vary in the form of the Pavlovian conditioned approach response (CR) they acquire. The form of the CR (i.e. sign-tracking vs. goal-tracking) predicts to what degree individuals attribute incentive salience to cues associated with food or drugs. However, we have noticed variation in the incidence of these two phenotypes in rats obtained from different vendors. In this study, we quantified sign- and goal-tracking behavior in a reasonably large sample of SD rats obtained from two vendors (Harlan or Charles River), as well as from individual colonies operated by both vendors. Our sample of rats acquired from Harlan had, on average, more sign-trackers than goal-trackers, and vice versa for our sample of rats acquired from Charles River. Furthermore, there were significant differences among colonies of the same vendor. Although it is impossible to rule out environmental variables, SD rats at different vendors and barriers may have reduced phenotypic heterogeneity as a result of genetic variables, such as random genetic drift or population bottlenecks. Consistent with this hypothesis, we identified marked population structure among colonies from Harlan. Therefore, despite sharing the same name, investigators should be aware that important genetic and phenotypic differences exist among SD rats from different vendors or even from different colonies of the same vendor. If used judiciously this can be an asset to experimental design, but it can also be a pitfall for those unaware of the issue.

Unconditioned freezing is enhanced in an appetitive context: implications for the contextual dependency of unconditioned fear.

It has been well established that expression of conditioned fear is context independent, but the context dependency of unconditioned fear expression has rarely been explored. A recent study reported that unconditioned freezing in rats is enhanced in a familiar context, which suggests that unconditioned fear expression can be modulated by contextual processing. In order to further explore this possibility we examined unconditioned freezing in novel, familiar, and appetitive contexts; and attempted to identify brain regions critical for context-related changes in unconditioned freezing by measuring c-Fos mRNA levels in emotional circuits. Unconditioned freezing was enhanced in the appetitive context, and this enhancement was accompanied by increased c-Fos mRNA expression in the medial amygdala and hippocampus, but attenuated expression in the medial prefrontal cortex. In the appetitive context, expectation of a reward coupled with detection of threat may have enhanced unconditioned fear expression, which suggests that unconditioned fear expression can be modulated by contextual factors. Context-related expectancy mismatch may explain the enhancement of unconditioned fear expression seen in this study and warrants further examination.

Single prolonged stress disrupts retention of extinguished fear in rats.

Clinical research has linked post-traumatic stress disorder (PTSD) with deficits in fear extinction. However, it is not clear whether these deficits result from stress-related changes in the acquisition or retention of extinction or in the regulation of extinction memories by context, for example. In this study, we used the single prolonged stress (SPS) animal model of PTSD and fear conditioning procedures to examine the effects of prior traumatic stress on the acquisition, retention, and context-specificity of extinction. SPS administered one week prior to fear conditioning had no effect on the acquisition of fear conditioning or extinction but disrupted the retention of extinction memories for both contextual and cued fear. This SPS effect required a post-stress incubation period to manifest. The results demonstrate that SPS disrupts extinction retention, leading to enhanced fear renewal; further research is needed to identify the neurobiological processes through which SPS induces these effects.

Inactivation of the prelimbic cortex enhances freezing induced by trimethylthiazoline, a component of fox feces.

Previous research has demonstrated that the rodent medial prefrontal cortex (mPFC) is critical for the expression of unconditioned defense behaviors. The prelimbic (PL) and infralimbic (IL) cortices comprise the majority of the mPFC, but the role of these regions in mediating unconditioned defense behaviors is not well understood. In order to address this, we temporarily inactivated the PL or IL and documented the effects of these manipulations on freezing induced by trimethylthiazoline (TMT), a component of fox feces, and center region avoidance in the open field (OF). PL inactivation enhanced TMT-induced freezing, but had no effect on OF behavior. IL inactivation had no effect on any behavioral measure. The results of this study are the first to demonstrate that the PL can have an inhibitory role with regard to unconditioned defense behavior. Further research is needed to define the parameters under which the PL inhibits unconditioned defense behavior.