Different Effects of Peer Sex on Operant Responding for Social Interaction and Striatal Dopamine Activity.

When rats are given discrete choices between social interactions with a peer and opioid or psychostimulant drugs, they choose social interaction, even after extensive drug self-administration experience. Studies show that like drug and nondrug food reinforcers, social interaction is an operant reinforcer and induces dopamine release. However, these studies were conducted with same-sex peers. We examined if peer sex influences operant social interaction and the role of estrous cycle and striatal dopamine in same- versus opposite-sex social interaction. We trained male and female rats (n = 13 responders/12 peers) to lever-press (fixed-ratio 1 [FR1] schedule) for 15 s access to a same- or opposite-sex peer for 16 d (8 d/sex) while tracking females' estrous cycle. Next, we transfected GRAB-DA2m and implanted optic fibers into nucleus accumbens (NAc) core and dorsomedial striatum (DMS). We then retrained the rats for 15 s social interaction (FR1 schedule) for 16 d (8 d/sex) and recorded striatal dopamine during operant responding for a peer for 8 d (4 d/sex). Finally, we assessed economic demand by manipulating FR requirements for a peer (10 d/sex). In male, but not female rats, operant responding was higher for the opposite-sex peer. Female's estrous cycle fluctuations had no effect on operant social interaction. Striatal dopamine signals for operant social interaction were dependent on the peer's sex and striatal region (NAc core vs DMS). Results indicate that estrous cycle fluctuations did not influence operant social interaction and that NAc core and DMS dopamine activity reflect sex-dependent features of volitional social interaction.

Role of Piriform Cortex and Its Afferent Projections in Relapse to Fentanyl Seeking after Food Choice-Induced Voluntary Abstinence.

We previously demonstrated a role of piriform cortex (Pir) in relapse to fentanyl seeking after food choice-induced voluntary abstinence. Here, we used this model to further study the role of Pir and its afferent projections in fentanyl relapse. We trained male and female rats to self-administer palatable food pellets for 6 d (6 h/day) and fentanyl (2.5 µg/kg/infusion, i.v.) for 12 d (6 h/day). We assessed relapse to fentanyl seeking after 12 voluntary abstinence sessions, achieved through a discrete choice procedure between fentanyl and palatable food (20 trials/session). We determined projection-specific activation of Pir afferents during fentanyl relapse with Fos plus the retrograde tracer cholera toxin B (injected into Pir). Fentanyl relapse was associated with increased Fos expression in anterior insular cortex (AI) and prelimbic cortex (PL) neurons projecting to Pir. We next used an anatomical disconnection procedure to determine the causal role of these two projections (AI→Pir and PL→Pir) in fentanyl relapse. Contralateral but not ipsilateral disconnection of AI→Pir projections decreased fentanyl relapse but not reacquisition of fentanyl self-administration. In contrast, contralateral but not ipsilateral disconnection of PL→Pir projections modestly decreased reacquisition but not relapse. Fluorescence-activated cell sorting and quantitative PCR data showed molecular changes within Pir Fos-expressing neurons associated with fentanyl relapse. Finally, we found minimal or no sex differences in fentanyl self-administration, fentanyl versus food choice, and fentanyl relapse. Our results indicate that AI→Pir and PL→Pir projections play dissociable roles in nonreinforced relapse to fentanyl seeking versus reacquisition of fentanyl self-administration after food choice-induced voluntary abstinence.SIGNIFICANCE STATEMENT We previously showed a role of Pir in fentanyl relapse after food choice-induced voluntary abstinence in rats, a procedure mimicking human abstinence or a significant reduction in drug self-administration because of the availability of alternative nondrug rewards. Here, we aimed to further characterize the role of Pir in fentanyl relapse by investigating the role of Pir afferent projections and analyzing molecular changes in relapse-activated Pir neurons. We identified dissociable roles of two Pir afferent projections (AI→Pir and PL→Pir) in relapse to fentanyl seeking versus reacquisition of fentanyl self-administration after voluntary abstinence. We also characterized molecular changes within Pir Fos-expressing neurons associated with fentanyl relapse.

Effect of Selective Lesions of Nucleus Accumbens µ-Opioid Receptor-Expressing Cells on Heroin Self-Administration in Male and Female Rats: A Study with Novel Oprm1-Cre Knock-in Rats.

The brain µ-opioid receptor (MOR) is critical for the analgesic, rewarding, and addictive effects of opioid drugs. However, in rat models of opioid-related behaviors, the circuit mechanisms of MOR-expressing cells are less known because of a lack of genetic tools to selectively manipulate them. We introduce a CRISPR-based Oprm1-Cre knock-in transgenic rat that provides cell type-specific genetic access to MOR-expressing cells. After performing anatomic and behavioral validation experiments, we used the Oprm1-Cre knock-in rats to study the involvement of NAc MOR-expressing cells in heroin self-administration in male and female rats. Using RNAscope, autoradiography, and FISH chain reaction (HCR-FISH), we found no differences in Oprm1 expression in NAc, dorsal striatum, and dorsal hippocampus, or MOR receptor density (except dorsal striatum) or function between Oprm1-Cre knock-in rats and wildtype littermates. HCR-FISH assay showed that iCre is highly coexpressed with Oprm1 (95%-98%). There were no genotype differences in pain responses, morphine analgesia and tolerance, heroin self-administration, and relapse-related behaviors. We used the Cre-dependent vector AAV1-EF1a-Flex-taCasp3-TEVP to lesion NAc MOR-expressing cells. We found that the lesions decreased acquisition of heroin self-administration in male Oprm1-Cre rats and had a stronger inhibitory effect on the effort to self-administer heroin in female Oprm1-Cre rats. The validation of an Oprm1-Cre knock-in rat enables new strategies for understanding the role of MOR-expressing cells in rat models of opioid addiction, pain-related behaviors, and other opioid-mediated functions. Our initial mechanistic study indicates that lesioning NAc MOR-expressing cells had different effects on heroin self-administration in male and female rats.SIGNIFICANCE STATEMENT The brain µ-opioid receptor (MOR) is critical for the analgesic, rewarding, and addictive effects of opioid drugs. However, in rat models of opioid-related behaviors, the circuit mechanisms of MOR-expressing cells are less known because of a lack of genetic tools to selectively manipulate them. We introduce a CRISPR-based Oprm1-Cre knock-in transgenic rat that provides cell type-specific genetic access to brain MOR-expressing cells. After performing anatomical and behavioral validation experiments, we used the Oprm1-Cre knock-in rats to show that lesioning NAc MOR-expressing cells had different effects on heroin self-administration in males and females. The new Oprm1-Cre rats can be used to study the role of brain MOR-expressing cells in animal models of opioid addiction, pain-related behaviors, and other opioid-mediated functions.

Animal Models of Drug Relapse and Craving after Voluntary Abstinence: A Review.

Relapse to drug use during abstinence is a defining feature of addiction. During the last several decades, this clinical scenario has been studied at the preclinical level using classic relapse/reinstatement models in which drug seeking is assessed after experimenter-imposed home-cage forced abstinence or extinction of the drug-reinforced responding in the self-administration chambers. To date, however, results from studies using rat relapse/reinstatement models have yet to result in Food and Drug Administration-approved medications for relapse prevention. The reasons for this state of affairs are complex and multifaceted, but one potential reason is that, in humans, abstinence is often self-imposed or voluntary and occurs either because the negative consequences of drug use outweigh the drug's rewarding effects or because of the availability of nondrug alternative rewards that are chosen over the drug. Based on these considerations, we and others have recently developed rat models of relapse after voluntary abstinence, achieved either by introducing adverse consequences to drug taking (punishment) or seeking (electric barrier) or by providing mutually exclusive choices between the self-administered drug and nondrug rewards (palatable food or social interaction). In this review, we provide an overview of these translationally relevant relapse models and discuss recent neuropharmacological findings from studies using these models. We also discuss sex as a biological variable, future directions, and clinical implications of results from relapse studies using voluntary abstinence models. Our main conclusion is that the neuropharmacological mechanisms controlling relapse to drug seeking after voluntary abstinence are often different from the mechanisms controlling relapse after home-cage forced abstinence or reinstatement after extinction. SIGNIFICANCE STATEMENT: This review describes recently developed rat models of relapse after voluntary abstinence, achieved either by introducing adverse consequences to drug taking or seeking or by providing mutually exclusive choices between the self-administered drug and nondrug rewards. This review discusses recent neuropharmacological findings from studies using these models and discusses future directions and clinical implications.

The Protective Effect of Social Reward on Opioid and Psychostimulant Reward and Relapse: Behavior, Pharmacology, and Brain Regions.

Until recently, most modern neuroscience research on addiction using animal models did not incorporate manipulations of social factors. Social factors play a critical role in human addiction: social isolation and exclusion can promote drug use and relapse, while social connections and inclusion tend to be protective. Here, we discuss the state of the literature on social factors in animal models of opioid and psychostimulant preference, self-administration, and relapse. We first summarize results from rodent studies on behavioral, pharmacological, and circuit mechanisms of the protective effect of traditional experimenter-controlled social interaction procedures on opioid and psychostimulant conditioned place preference, self-administration, and relapse. Next, we summarize behavioral and brain-mechanism results from studies using newer operant social-interaction procedures that inhibit opioid and psychostimulant self-administration and relapse. We conclude by discussing how the reviewed studies point to future directions for the addiction field and other neuroscience and psychiatric fields, and their implications for mechanistic understanding of addiction and development of new treatments.SIGNIFICANCE STATEMENT In this review, we propose that incorporating social factors into modern neuroscience research on addiction could improve mechanistic accounts of addiction and help close gaps in translating discovery to treatment. We first summarize rodent studies on behavioral, pharmacological, and circuit mechanisms of the protective effect of both traditional experimenter-controlled and newer operant social-interaction procedures. We then discuss potential future directions and clinical implications.

Isolating the incentive salience of reward-associated stimuli: value, choice, and persistence.

Sign- and goal-tracking are differentially associated with drug abuse-related behavior. Recently, it has been hypothesized that sign- and goal-tracking behavior are mediated by different neurobehavioral valuation systems, including differential incentive salience attribution. Herein, we used different conditioned stimuli to preferentially elicit different response types to study the different incentive valuation characteristics of stimuli associated with sign- and goal-tracking within individuals. The results demonstrate that all stimuli used were equally effective conditioned stimuli; however, only a lever stimulus associated with sign-tracking behavior served as a robust conditioned reinforcer and was preferred over a tone associated with goal-tracking. Moreover, the incentive value attributed to the lever stimulus was capable of promoting suboptimal choice, leading to a significant reduction in reinforcers (food) earned. Furthermore, sign-tracking to a lever was more persistent than goal-tracking to a tone under omission and extinction contingencies. Finally, a conditional discrimination procedure demonstrated that sign-tracking to a lever and goal-tracking to a tone were dependent on learned stimulus-reinforcer relations. Collectively, these results suggest that the different neurobehavioral valuation processes proposed to govern sign- and goal-tracking behavior are independent but parallel processes within individuals. Examining these systems within individuals will provide a better understanding of how one system comes to dominate stimulus-reward learning, thus leading to the differential role these systems play in abuse-related behavior.

A rat model of operant negative reinforcement in opioid-dependent males and females.

RATIONALE AND OBJECTIVE: Avoidance of opioid withdrawal plays a key role in human opioid addiction. Here, we present a procedure for studying operant negative reinforcement in rats that was inspired by primate procedures where opioid-dependent subjects lever-press to prevent naloxone infusions. METHODS: In Experiment 1, we trained rats (n = 30, 15 females) to lever-press to escape and then avoid mild footshocks (0.13-0.27 mA) for 35 days (30 trials/d). Next, we catheterized them and implanted minipumps containing methadone (10 mg/kg/day) or saline. We then paired (4 times, single session) a light cue (20-s) with a naloxone infusion (20 µg/kg, i.v) that precipitated opioid withdrawal. Next, we trained the rats to escape naloxone injections for 10 days (30 trials/d). Each trial started with the onset of the opioid-withdrawal cue. After 20-s, the lever extended, and an infusion of naloxone (1 to 2.2 µg/kg/infusion) began; a lever-press during an 11-s window terminated the withdrawal-paired cue and the infusion. In Experiment 2, we trained rats (n = 34, 17 females) on the same procedure but decreased the footshock escape/avoidance training to 20 days. RESULTS: All rats learned to lever-press to escape or avoid mild footshocks. In both experiments, a subset, 56% (10/18) and 33% (8/24) of methadone-dependent rats learned to lever-press to escape naloxone infusions. CONCLUSIONS: We introduce an operant negative reinforcement procedure where a subset of opioid-dependent rats learned to lever-press to escape withdrawal-inducing naloxone infusions. The procedure can be used to study mechanisms of individual differences in opioid negative reinforcement-related behaviors in opioid-dependent rats.

Role of ventral subiculum neuronal ensembles in incubation of oxycodone craving after electric barrier-induced voluntary abstinence.

High relapse rate is a key feature of opioid addiction. In humans, abstinence is often voluntary due to negative consequences of opioid seeking. To mimic this human condition, we recently introduced a rat model of incubation of oxycodone craving after electric barrier-induced voluntary abstinence. Incubation of drug craving refers to time-dependent increases in drug seeking after cessation of drug self-administration. Here, we used the activity marker Fos, muscimol-baclofen (GABAa + GABAb receptor agonists) global inactivation, Daun02-selective inactivation of putative relapse-associated neuronal ensembles, and fluorescence-activated cell sorting of Fos-positive cells and quantitative polymerase chain reaction to demonstrate a key role of vSub neuronal ensembles in incubation of oxycodone craving after voluntary abstinence, but not homecage forced abstinence. We also used a longitudinal functional magnetic resonance imaging method and showed that functional connectivity changes in vSub-related circuits predict opioid relapse after abstinence induced by adverse consequences of opioid seeking.

Characterization of operant social interaction in rats: effects of access duration, effort, peer familiarity, housing conditions, and choice between social interaction vs. food or remifentanil.

RATIONALE AND OBJECTIVE: Social factors play a critical role in drug addiction. We recently showed that rats will abstain from methamphetamine, cocaine, heroin, and remifentanil self-administration when given a choice between the addictive drug and operant social interaction. Here, we further characterized operant social interaction by determining the effects of access duration, effort, peer familiarity, and housing conditions. We also determined choice between social interaction vs. palatable food or remifentanil. METHODS: We first trained single-housed male and female rats to lever-press for social interaction with a sex- and age-matched peer. Next, we determined effects of access duration (3.75 to 240 s), effort (increasing fixed-ratio schedule requirements or progressive ratio schedule), peer familiarity (familiar vs. unfamiliar), and housing conditions (single vs. paired housing) on social self-administration. We also determined choice between social interaction vs. palatable food pellets or intravenous remifentanil (0, 1, 10 µg/kg/infusion). RESULTS: Increasing access duration to a peer decreased social self-administration under fixed ratio but not progressive ratio schedule; the rats showed similar preference for short vs. long access duration. Social self-administration under different fixed ratio requirements was higher in single-housed than in paired-housed rats and higher for a familiar vs. unfamiliar partner in single-housed but not paired-housed rats. Response rates of food-sated rats under increasing fixed-ratio requirements were higher for palatable food than for social interaction. The rats strongly preferred palatable food over social interaction and showed dose-dependent preference for social interaction vs. remifentanil. CONCLUSIONS: We identified parameters influencing the reinforcing effects of operant social interaction and introduce a choice procedure sensitive to remifentanil self-administration dose.

Remifentanil-food choice follows predictions of relative subjective value.

BACKGROUND: Preclinical studies into drug vs. nondrug choice have emerged to better model and investigate the neurobehavioral mechanisms underlying drug preference. Current literature has suggested that drugs of abuse have inherently low value, thus promoting food preference. Herein, we examined remifentanil vs. food choice to test both the relative value hypothesis and the 'direct effects' (pharmacological effects of drugs on alternative reinforcers) hypothesis of opioid preference. METHODS: Adult male rats were trained under two choice procedures (controlled vs. uncontrolled reinforcer frequency) for remifentanil vs. food choice. Furthermore, a series of procedural manipulations known to affect drug reinforcement were tested under both choice procedures. Using remifentanil self-administration data, pharmacokinetic profiles were calculated and analyzed to determine if opioid intake was related to opioid preference. RESULTS: Both choice procedures produced dose-dependent preference. Moreover, procedural manipulations produced comparable changes in remifentanil preference under both choice procedures. In addition, calculated pharmacokinetic data revealed that preference was dissociable from intake under the controlled reinforcer frequency choice procedure. CONCLUSIONS: When compared to the 'direct effects' hypothesis, remifentanil preference was better predicted by the relative value hypothesis, formalized in generalized matching. Use of a controlled reinforcer frequency schedule successfully removed the drug preference-intake confound found in most drug-choice procedures. Importantly, drug preference under the controlled reinforcer frequency schedule remained sensitive to procedural manipulations known to affect drug reinforcement. Thus, given that differential drug intake itself affects neurobiological measurements, future use of controlled reinforcer frequency schedules may help to better isolate the neurobehavioral mechanisms that mediate opioid preference.

Neuronal activity associated with cocaine preference: Effects of differential cocaine intake.

Differences in overall cocaine intake can directly affect neuroadaptations, and this relationship can make it difficult to interpret neurobiological changes seen in drug-choice studies, since drug intake varies between subjects. Herein, a choice procedure that controls for cocaine intake was utilized to explore if neuronal activity, measured as cFos expression in the orbitofrontal cortex (OFC) and nucleus accumbens (NAc), was reflective of preference. Results demonstrated that cFos expression, in both the OFC and NAc, was independent of cocaine preference when cocaine intake was kept constant across individuals. However, when cocaine intake was systematically varied, the expression of cFos associated with cocaine preference was related to overall cocaine intake in the OFC, but not the NAc. Altogether, these results demonstrate that cocaine intake during choice can affect neurobiological outcome measures; thus, the neurobehavioral mechanisms underlying cocaine preference may be better isolated when controlling for cocaine frequency and intake. In all, some caution is warranted when interpreting results from choice studies evaluating the neurobehavioral mechanisms that underlie drug preference when drug frequency and intake are uncontrolled, and future research is needed to determine the role of drug frequency and intake on neurobiological measures associated with drug choice.

Presence of a social peer enhances acquisition of remifentanil self-administration in male rats.

BACKGROUND: Social peers influence human drug use at every stage of addiction. Using a dual-compartment apparatus that allows for limited social contact, recent work has shown that cocaine self-administration is enhanced when two rats are trained to self-administer at the same time compared to rats trained alone or trained in the presence of a saline self-administration control peer. The current study measured social influence on self-administration of the short-acting opioid remifentanil using a dual-compartment operant conditioning chamber. METHODS: Adult male rats were placed in one of five groups: (1) REMI-REMI group, in which both rats self-administered remifentanil; (2) REMI-SAL group, in which rats self-administered remifentanil in the presence of a peer that self-administered saline; (3) SAL-REMI group, in which rats self-administered saline in the presence of a peer that self-administered remifentanil; and (4) REMI ALONE and (5) SAL ALONE groups, in which rats administered their respective drugs alone (no peer). Self-administration was measured using a 2-lever procedure during acquisition, maintenance, increasing fixed-ratio, and dose-response phases. RESULTS: The presence of a social peer enhanced drug intake during acquisition, regardless of the drug exposure of their peer. Additionally, active lever position significantly affected remifentanil intake during acquisition and maintenance, with the greatest influence occurring when the active lever was close to the peer. CONCLUSION: The presence of a social peer in the drug-taking context potentiates remifentanil self-administration, regardless of the peer's drug access. Future studies utilizing the dual-compartment apparatus will help elucidate the neural mechanisms underlying social influence on opioid abuse.

Cocaine-associated decision-making: Toward isolating preference.

Ever-increasing evidence suggests that substance use disorder is mediated by decision-making processes, and as such, providing nondrug alternatives can shift maladaptive preferences away from drug reinforcers, such as cocaine. Of note, a recent hypothesis suggests that preference for cocaine is simply a byproduct of cocaine intake, such that the 'direct' effects of cocaine weaken the impact of non-drug alternatives while measuring choice. Conversely, existing quantitative theories of decision-making suggest preference is determined by various dimensions of concurrent reinforcers that in turn determine the relative value of available alternatives. Toward teasing apart the conflicting theories above, we developed a novel drug-choice procedure to control for reinforcer frequency and magnitude (two reinforcer dimensions well known to influence preference) that consequently controls for overall cocaine intake. As predicted by quantitative choice theory, results suggest that cocaine intake and preference are dissociable while measuring choice, with reinforcer frequency and magnitude having independent influence on the relative value of choice alternatives. Furthermore, we demonstrate that the choice procedure is sensitive to various manipulations known to alter cocaine reinforcement, all while keeping cocaine intake constant. Finally, the results point to the process of economic substitution as an important avenue of future neurobehavioral investigation toward the improvement of behavioral and pharmacological therapies for substance use disorders. Overall, the proposed choice procedure will allow for improved isolation of the neurobehavioral processes that mediate drug-associated decision-making in future studies.

NMDA receptor blockade specifically impedes the acquisition of incentive salience attribution.

Glutamatergic signaling plays an important role in learning and memory. Using Pavlovian conditioned approach procedures, the mechanisms that drive stimulus-reward learning and memory have been investigated. However, there are instances where reward-predictive stimuli can function beyond being solely predictive and can be attributed with "motivational value" or incentive salience. Using a Pavlovian conditioned approach procedure consisting of two different but equally predictive stimuli (lever vs. tone) we investigated the role NMDA receptor function has in the attribution of incentive salience. The results revealed that the administration of MK-801, an NMDA receptor antagonist, during acquisition of Pavlovian conditioned approach promoted goal-tracking to a lever stimulus, while control animals learned to sign-track. Moreover, within the same animals, the use of a tone stimulus elicited goal-tracking responses that were unaffected by MK-801 pretreatments. Furthermore, a lever CS that elicited sign-tracking served as a more robust conditioned reinforcer than a tone CS that elicited goal-tracking or a lever CS that elicited goal-tracking via MK-801 pretreatments. Collectively, these results demonstrate that NMDA receptor antagonism can alter the stimulus-reward relationship learned and prevent the attribution of incentive salience, rather than impede general learning.

Effects of environmental enrichment on self-administration of the short-acting opioid remifentanil in male rats.

BACKGROUND: Opioid abuse is a major problem around the world. Identifying environmental factors that contribute to opioid abuse and addiction is necessary for decreasing this epidemic. In rodents, environmental enrichment protects against the development of low dose stimulant self-administration, but studies examining the effect of enrichment and isolation (compared to standard housing) on the development of intravenous opioid self-administration have not been conducted. The present study investigated the role of environmental enrichment on self-administration of the short-acting µ-opioid remifentanil. METHODS: Rats were raised in an enriched condition (Enr), standard condition (Std), or isolated condition (Iso) beginning at 21 days of age and were trained to lever press for 1 or 3 µg/kg/infusion remifentanil in young adulthood. Acquisition of self-administration and responding during increasing fixed ratio requirements were assessed, and a dose-response curve was generated. RESULTS: In all phases, Enr rats lever pressed significantly less than Std and Iso rats, with Enr rats pressing between 9 and 40% the amount of Iso rats. Enr rats did not acquire remifentanil self-administration when trained with 1 µg/kg/infusion, did not increase responding over increasing FR when trained at either dose, and their dose-response curves were flattened compared to Std and Iso rats. When expressed as economic demand curves, Enr rats displayed a decrease in both essential value (higher α) and reinforcer intensity (Q 0) compared to Std and Iso rats at the 1 µg/kg/infusion training dose. CONCLUSION: Environmental enrichment reduced remifentanil intake, suggesting that social and environmental novelty may protect against opioid abuse.

Suboptimal choice in rats: Incentive salience attribution promotes maladaptive decision-making.

Stimuli that are more predictive of subsequent reward also function as better conditioned reinforcers. Moreover, stimuli attributed with incentive salience function as more robust conditioned reinforcers. Some theories have suggested that conditioned reinforcement plays an important role in promoting suboptimal choice behavior, like gambling. The present experiments examined how different stimuli, those attributed with incentive salience versus those without, can function in tandem with stimulus-reward predictive utility to promote maladaptive decision-making in rats. One group of rats had lights associated with goal-tracking as the reward-predictive stimuli and another had levers associated with sign-tracking as the reward-predictive stimuli. All rats were first trained on a choice procedure in which the expected value across both alternatives was equivalent but differed in their stimulus-reward predictive utility. Next, the expected value across both alternatives was systematically changed so that the alternative with greater stimulus-reward predictive utility was suboptimal in regard to primary reinforcement. The results demonstrate that in order to obtain suboptimal choice behavior, incentive salience alongside strong stimulus-reward predictive utility may be necessary; thus, maladaptive decision-making can be driven more by the value attributed to stimuli imbued with incentive salience that reliably predict a reward rather than the reward itself.

Toward isolating the role of dopamine in the acquisition of incentive salience attribution.

Stimulus-reward learning has been heavily linked to the reward-prediction error learning hypothesis and dopaminergic function. However, some evidence suggests dopaminergic function may not strictly underlie reward-prediction error learning, but may be specific to incentive salience attribution. Utilizing a Pavlovian conditioned approach procedure consisting of two stimuli that were equally reward-predictive (both undergoing reward-prediction error learning) but functionally distinct in regard to incentive salience (levers that elicited sign-tracking and tones that elicited goal-tracking), we tested the differential role of D1 and D2 dopamine receptors and nucleus accumbens dopamine in the acquisition of sign- and goal-tracking behavior and their associated conditioned reinforcing value within individuals. Overall, the results revealed that both D1 and D2 inhibition disrupted performance of sign- and goal-tracking. However, D1 inhibition specifically prevented the acquisition of sign-tracking to a lever, instead promoting goal-tracking and decreasing its conditioned reinforcing value, while neither D1 nor D2 signaling was required for goal-tracking in response to a tone. Likewise, nucleus accumbens dopaminergic lesions disrupted acquisition of sign-tracking to a lever, while leaving goal-tracking in response to a tone unaffected. Collectively, these results are the first evidence of an intraindividual dissociation of dopaminergic function in incentive salience attribution from reward-prediction error learning, indicating that incentive salience, reward-prediction error, and their associated dopaminergic signaling exist within individuals and are stimulus-specific. Thus, individual differences in incentive salience attribution may be reflective of a differential balance in dopaminergic function that may bias toward the attribution of incentive salience, relative to reward-prediction error learning only.

Suboptimal Choice in Pigeons: Stimulus Value Predicts Choice over Frequencies.

Pigeons have shown suboptimal gambling-like behavior when preferring a stimulus that infrequently signals reliable reinforcement over alternatives that provide greater reinforcement overall. As a mechanism for this behavior, recent research proposed that the stimulus value of alternatives with more reliable signals for reinforcement will be preferred relatively independently of their frequencies. The present study tested this hypothesis using a simplified design of a Discriminative alternative that, 50% of the time, led to either a signal for 100% reinforcement or a blackout period indicative of 0% reinforcement against a Nondiscriminative alternative that always led to a signal that predicted 50% reinforcement. Pigeons showed a strong preference for the Discriminative alternative that remained despite reducing the frequency of the signal for reinforcement in subsequent phases to 25% and then 12.5%. In Experiment 2, using the original design of Experiment 1, the stimulus following choice of the Nondiscriminative alternative was increased to 75% and then to 100%. Results showed that preference for the Discriminative alternative decreased only when the signals for reinforcement for the two alternatives predicted the same probability of reinforcement. The ability of several models to predict this behavior are discussed, but the terminal link stimulus value offers the most parsimonious account of this suboptimal behavior.

Role of serotonin transporter function in rat orbitofrontal cortex in impulsive choice.

Impulsivity is a multi-faceted personality construct that plays a prominent role in drug abuse vulnerability. Dysregulation of 5-hydroxytryptamine (serotonin, 5-HT) systems in subregions of the prefrontal cortex has been implicated in impulsivity. Extracellular 5-HT concentrations are regulated by 5-HT transporters (SERTs), indicating that these transporters may be important molecular targets underlying individual differences in impulsivity and drug abuse vulnerability. The present study evaluated the role of SERT in mediating individual differences in impulsivity. Rats were tested for both impulsive action using the cued go/no-go task and for impulsive choice using a delay discounting task in a counterbalanced design. Following behavioral evaluation, Km and Vmax were obtained from kinetic analysis of [(3)H]5-HT uptake by SERT using synaptosomes prepared from both orbitofrontal cortex (OFC) and medial prefrontal cortex (mPFC) obtained from each individual rat. Vmax for SERT in OFC, but not mPFC, was negatively correlated with mean adjusted delay scores in the delay discounting task. In contrast, Vmax for SERT in OFC and mPFC was not correlated with performance in the cued go/no-go task. To further evaluate the relationship between SERT function and impulsive choice, a selective SERT inhibitor, fluoxetine (0, 15, 50 and 150pmol/side) was microinjected bilaterally into OFC and effects on the delay discounting task determined. Following stabilization of behavior, fluoxetine increased mean adjusted delay scores (decreased impulsivity) in high impulsive rats compared to saline microinjection, but had no effect in low impulsive rats. These ex vivo and in vivo results suggest that enhanced SERT function in OFC underlies high impulsive choice behavior.