Operant social self-administration in male CD1 mice.

RATIONALE AND OBJECTIVE: We recently introduced a model of operant social reward in which female CD1 mice lever press for access to affiliative social interaction with a cagemate peer mouse of the same sex and strain. Here we determined the generality of the operant social self-administration model to male CD1 mice who, under certain conditions, will lever press to attack a subordinate male mouse. METHODS: We trained male CD1 mice to lever press for food and social interaction with a same sex and strain cagemate peer under different fixed-ratio (FR) schedule response requirements (FR1 to FR6). We then tested their motivation to seek social interaction after 15 days of isolation in the presence of cues previously paired with social self-administration. We also determined the effect of housing conditions on operant social self-administration and seeking. Finally, we determined sex differences in operant social self-administration and seeking, and the effect of housing conditions on unconditioned affiliative and antagonistic (aggressive) social interactions in both sexes. RESULTS: Male CD1 mice lever pressed for access to a cagemate peer under different FR response requirements and seek social interaction after 15 isolation days; these effects were independent of housing conditions. There were no sex differences in operant social self-administration and seeking. Finally, group-housed CD1 male mice did not display unconditioned aggressive behavior toward a peer male CD1 mouse. CONCLUSIONS: Adult socially housed male CD1 mice can be used in studies on operant social reward without the potential confound of operant responding to engage in aggressive interactions.

Social odor choice buffers drug craving.

Social interactions are rewarding and protective against substance use disorders, but it is unclear which specific aspect of the complex sensory social experience drives these effects. Here, we investigated the role of olfactory sensory experience on social interaction, social preference over cocaine, and cocaine craving in rats. First, we conducted bulbectomy on both male and female rats to evaluate the necessity of olfactory system experience on the acquisition and maintenance of volitional social interaction. Next, we assessed the effect of bulbectomy on rats given a choice between social interaction and cocaine. Finally, we evaluated the influence of olfactory sensory experience by training rats on volitional partner-associated odors, assessing their preference for partner odors over cocaine to achieve voluntary abstinence and assessing its effect on the incubation of cocaine craving. Bulbectomy impaired operant social interaction without affecting food and cocaine self-administration. Rats with intact olfactory systems preferred social interaction over cocaine, while rats with impaired olfactory sense showed a preference for cocaine. Providing access to a partner odor in a choice procedure led to cocaine abstinence, preventing incubation of cocaine craving, in contrast to forced abstinence or non-contingent exposure to cocaine and partner odors. Our data suggests the olfactory sensory experience is necessary and sufficient for volitional social reward. Furthermore, the active preference for partner odors over cocaine buffers drug craving. Based on these findings, translational research should explore the use of social sensory-based treatments utilizing odor-focused foundations for individuals with substance use disorders.

Microglia-mediated calcium-permeable AMPAR accumulation in the nucleus accumbens drives hyperlocomotion during cocaine withdrawal.

During withdrawal from cocaine, calcium permeable-AMPA receptors (CP-AMPAR) progressively accumulate in nucleus accumbens (NAc) synapses, a phenomenon linked to behavioral sensitization and drug-seeking. Recently, it has been suggested that neuroimmune alterations might promote aberrant changes in synaptic plasticity, thus contributing to substance abuse-related behaviors. Here, we investigated the role of microglia in NAc neuroadaptations after withdrawal from cocaine-induced conditioned place preference (CPP). We depleted microglia using PLX5622-supplemented diet during cocaine withdrawal, and after the place preference test, we measured dendritic spine density and the presence of CP-AMPAR in the NAc shell. Microglia depletion prevented cocaine-induced changes in dendritic spines and CP-AMPAR accumulation. Furthermore, microglia depletion prevented conditioned hyperlocomotion without affecting drug-context associative memory. Microglia displayed fewer number of branches, resulting in a reduced arborization area and microglia control domain at late withdrawal. Our results suggest that microglia are necessary for the synaptic adaptations in NAc synapses during cocaine withdrawal and therefore represent a promising therapeutic target for relapse prevention.

Relative to females, male rats are more willing to forego obtaining sucrose reward in order to prevent harm to their cage mate.

RATIONALE: Empathy, or the ability to perceive, share, and act upon the emotions of another, is a crucial social skill and is dysfunctional in autism and schizophrenia. While the complexities of human empathy are difficult to model in rodents, behavioral paradigms utilizing rats which study decision-making in social contexts may provide a translational framework for assessing biological, pharmacotherapeutic, and environmental interventions. OBJECTIVES: Modify and expand upon the three-session rat harm aversion task, which measures the willingness of rats to cease pressing a lever that earns them sucrose reward but delivers a shock to their cage mate. We sought to test the sustainability of harm aversion across seven sessions in male and female rats. METHODS: Same-sex pair-housed rats were assigned as either the observer, which had access to the lever, or the demonstrator, which would receive shocks. After training the observer to press the lever to receive sucrose pellets, the demonstrator was placed into an adjacent chamber at which point lever responses would also deliver a shock. If the observer did not press the lever, no shock and no sucrose was delivered. RESULTS: A sex difference in harm aversion was observed with female rats having significantly higher response rates and decreased response latencies across the seven test sessions, thus delivering more shocks and obtaining more sucrose, relative to males. CONCLUSIONS: These data demonstrate that male rats sustain harm aversion to a greater extent relative to females.

An operant social self-administration and choice model in mice.

Little is known about how social factors contribute to neurobiology or neuropsychiatric disorders. The use of mice allows one to probe the neurobiological bases of social interaction, offering the genetic diversity and versatility to identify cell types and neural circuits of social behavior. However, mice typically show lower social motivation compared with rats, leading to the question of whether mice should be used to model complex social behaviors displayed by humans. Studies on mouse social behavior often rely on measures such as time spent in contact with a social partner or preference for a social-paired context, but fail to assess volitional (subject-controlled) rewarding social interaction. Here, we describe a volitional social self-administration and choice model that is an extension of our previous work on rats. Using mice, we systematically compared female adolescent and adult C57BL/6 mice and outbred CD1 mice, showing that operant social self-administration, social seeking during periods of isolation and choice of social interaction over palatable food is significantly stronger in female CD1 mice than in female C57BL/6J mice, independently of age. We describe the requirements for building the social self-administration and choice apparatus and we provide guidance for studying the role of operant social reward in mice. We also discuss its use to study brain mechanisms of operant social reward, potentially extending its application to mouse models of neuropsychiatric disorders. The training commonly requires ~4 weeks for stable social self-administration and 3-4 additional weeks for tests, including social seeking and choice.

Increased heroin intake and relapse vulnerability in intermittent relative to continuous self-administration: Sex differences in rats.

BACKGROUND AND PURPOSE: Studies using intermittent-access drug self-administration show increased motivation to take and seek cocaine and fentanyl, relative to continuous access. In this study, we examined the effects of intermittent- and continuous-access self-administration on heroin intake, patterns of self-administration and cue-induced heroin-seeking, after forced or voluntary abstinence, in male and female rats. We also modelled brain levels of heroin and its active metabolites. EXPERIMENTAL APPROACH: Rats were trained to self-administer a palatable solution and then heroin (0.075 mg·kg-1 per inf) either continuously (6 h·day-1 ; 10 days) or intermittently (6 h·day-1 ; 5-min access every 30-min; 10 days). Brain levels of heroin and its metabolites were modelled using a pharmacokinetic software. Next, heroin-seeking was assessed after 1 or 21 abstinence days. Between tests, rats underwent either forced or voluntary abstinence. The oestrous cycle was measured using a vaginal smear test. KEY RESULTS: Intermittent access exacerbated heroin self-administration and was characterized by a burst-like intake, yielding higher brain peaks of heroin and 6-monoacetylmorphine concentrations. Moreover, intermittent access increased cue-induced heroin-seeking during early, but not late abstinence. Heroin-seeking was higher in females after intermittent, but not continuous access, and this effect was independent of the oestrous cycle. CONCLUSIONS AND IMPLICATIONS: Intermittent heroin access in rats resembles critical features of heroin use disorder: a self-administration pattern characterized by repeated large doses of heroin and higher relapse vulnerability during early abstinence. This has significant implications for refining animal models of substance use disorder and for better understanding of the neuroadaptations responsible for this disorder. LINKED ARTICLES: This article is part of a themed issue on Advances in Opioid Pharmacology at the Time of the Opioid Epidemic. To view the other articles in this section visit http://onlinelibrary.wiley.com/doi/10.1111/bph.v180.7/issuetoc.

The Protective Effect of Social Reward on Opioid and Psychostimulant Reward and Relapse: Behavior, Pharmacology, and Brain Regions.

Until recently, most modern neuroscience research on addiction using animal models did not incorporate manipulations of social factors. Social factors play a critical role in human addiction: social isolation and exclusion can promote drug use and relapse, while social connections and inclusion tend to be protective. Here, we discuss the state of the literature on social factors in animal models of opioid and psychostimulant preference, self-administration, and relapse. We first summarize results from rodent studies on behavioral, pharmacological, and circuit mechanisms of the protective effect of traditional experimenter-controlled social interaction procedures on opioid and psychostimulant conditioned place preference, self-administration, and relapse. Next, we summarize behavioral and brain-mechanism results from studies using newer operant social-interaction procedures that inhibit opioid and psychostimulant self-administration and relapse. We conclude by discussing how the reviewed studies point to future directions for the addiction field and other neuroscience and psychiatric fields, and their implications for mechanistic understanding of addiction and development of new treatments.SIGNIFICANCE STATEMENT In this review, we propose that incorporating social factors into modern neuroscience research on addiction could improve mechanistic accounts of addiction and help close gaps in translating discovery to treatment. We first summarize rodent studies on behavioral, pharmacological, and circuit mechanisms of the protective effect of both traditional experimenter-controlled and newer operant social-interaction procedures. We then discuss potential future directions and clinical implications.

Operant social seeking to a novel peer after social isolation is associated with activation of nucleus accumbens shell in rats.

RATIONALE AND OBJECTIVE: Deprivation of social interaction promotes social reward seeking in rodents, assessed primarily by the conditioned place preference procedure. Here, we used an operant social procedure in rats and examined the effect of the housing condition (pair-housing vs. single-housing) during or after social self-administration on social reward seeking. METHODS: We first trained paired-housed or single-housed rats to gain access to an age- and sex-matched novel peer. On post-training day 1 (PTD1), we tested both groups for social seeking without the presence of the novel peer. Next, we divided each group into pair-housing or single-housing conditions and tested all four groups (pair-pair, pair-single, single-pair, and single-single) for social seeking on post-training day 12 (PTD12). Finally, we analyzed Fos expression in the striatum associated with social seeking on PTD12. RESULT: Single-housed rats earned more social rewards during social self-administration than pair-housed rats. Social isolation during social self-administration also promoted social seeking on PTD1 and PTD12, regardless of their housing conditions after social self-administration training. Additionally, in pair-housed rats, social isolation during the post-training period led to a time-dependent increase of social seeking on PTD12 compared with PTD1. Finally, the Fos analyses revealed an increase of Fos expression in NAc shell of single-single rats after social seeking test on PTD12 compared with pair-pair rats. CONCLUSION: Our data suggest that social isolation promotes operant social self-administration and social seeking. In addition, neuronal activation of NAc shell is associated with social seeking after social isolation.

Early resource scarcity alters motivation for natural rewards in a sex- and reinforcer-dependent manner.

RATIONALE: Early life adversity impacts reward-related behaviors, including reward seeking for drugs of abuse. However, the effects of early stress on natural rewards, such as food and social rewards, which have strong implications for symptoms of psychiatric conditions such as major depressive disorder (MDD), are understudied. To fill this gap, we used the limited bedding and nesting (LBN) procedure to assess the impact of early resource scarcity on motivational drive for both food and social rewards in rats. METHODS: Male and female Long Evans rats were reared in either an LBN environment, with limited nesting materials and no enrichment, from their postnatal day 2-9 or control environment with ample nesting materials and enrichment. As adults, they were tested for reward-seeking behavior on progressive ratio operant tasks: food reward (sucrose) or social reward (access to a same-sex/age conspecific). RESULTS: We observed sex differences in the impact of LBN on motivation for natural rewards. In males, LBN increased motivation for both a sucrose and social reward. In females, LBN reduced motivation for sucrose but had no effect on social reward. CONCLUSIONS: These results suggest that the effects of LBN on motivation for natural rewards are both sex- and reinforcer-dependent, with males and females showing differential motivation for food and social rewards following early scarcity. Our previous data revealed an LBN-driven reduction in motivation for morphine in males and no effect in females, highlighting the reinforcer-dependent impact of early resource scarcity on motivated behavior more widely.

Characterization of operant social interaction in rats: effects of access duration, effort, peer familiarity, housing conditions, and choice between social interaction vs. food or remifentanil.

RATIONALE AND OBJECTIVE: Social factors play a critical role in drug addiction. We recently showed that rats will abstain from methamphetamine, cocaine, heroin, and remifentanil self-administration when given a choice between the addictive drug and operant social interaction. Here, we further characterized operant social interaction by determining the effects of access duration, effort, peer familiarity, and housing conditions. We also determined choice between social interaction vs. palatable food or remifentanil. METHODS: We first trained single-housed male and female rats to lever-press for social interaction with a sex- and age-matched peer. Next, we determined effects of access duration (3.75 to 240 s), effort (increasing fixed-ratio schedule requirements or progressive ratio schedule), peer familiarity (familiar vs. unfamiliar), and housing conditions (single vs. paired housing) on social self-administration. We also determined choice between social interaction vs. palatable food pellets or intravenous remifentanil (0, 1, 10 µg/kg/infusion). RESULTS: Increasing access duration to a peer decreased social self-administration under fixed ratio but not progressive ratio schedule; the rats showed similar preference for short vs. long access duration. Social self-administration under different fixed ratio requirements was higher in single-housed than in paired-housed rats and higher for a familiar vs. unfamiliar partner in single-housed but not paired-housed rats. Response rates of food-sated rats under increasing fixed-ratio requirements were higher for palatable food than for social interaction. The rats strongly preferred palatable food over social interaction and showed dose-dependent preference for social interaction vs. remifentanil. CONCLUSIONS: We identified parameters influencing the reinforcing effects of operant social interaction and introduce a choice procedure sensitive to remifentanil self-administration dose.

Waving Through the Window: A Model of Volitional Social Interaction in Female Mice.

BACKGROUND: Mouse models of social behavior fail to account for volitional aspects of social interaction, and current neurobiological investigation of social behavior is performed almost exclusively using C57BL/6J mice, the background strain of most transgenic mice. Here, we introduce a mouse model of operant social self-administration and choice, using a custom-made apparatus. METHODS: First, we trained adolescent and adult female C57BL/6J and CD1 mice to self-administer palatable food pellets and then to lever press under increasing fixed-ratio response requirements for access to an age-matched female social partner. Next, we tested their motivation to seek social interaction using a progressive ratio reinforcement schedule, relapse to social seeking after social isolation, and choice between palatable food versus social interaction. We also tested social conditioned place preference in adult female CD1 and C57BL/6J mice. RESULTS: Adolescent and adult female mice of both strains showed similar rates of food self-administration. In contrast, CD1 mice demonstrated significantly stronger social self-administration than C57BL/6J mice under both reinforcement schedules. CD1 but not C57BL/6J mice demonstrated robust social seeking after social isolation. In the choice task, CD1 mice preferred social interaction, whereas C57BL/6J mice preferred food. CD1 but not C57BL/6J mice demonstrated robust social conditioned place preference. The strain differences were age independent. CONCLUSIONS: Our data show that CD1 mice are a better strain for studying female social reward learning. Our mouse operant social model provides a tool for research on neurobiological substrates of female social reward and disruption of social reward in psychiatric disorders using mouse-specific genetic tools.

Factors modulating the incubation of drug and non-drug craving and their clinical implications.

It was suggested in 1986 that cue-induced cocaine craving increases progressively during early abstinence and remains high during extended periods of time. Clinical evidence now supports this hypothesis and that this increase is not specific to cocaine but rather generalize across several drugs of abuse. Investigators have identified an analogous incubation phenomenon in rodents, in which time-dependent increases in cue-induced drug seeking are observed after abstinence from intravenous drug or palatable food self-administration. Incubation of craving is susceptible to variation in magnitude as a function of biological and/or the environmental circumstances surrounding the individual. During the last decade, the neurobiological correlates of the modulatory role of biological (sex, age, genetic factors) and environmental factors (environmental enrichment and physical exercise, sleep architecture, acute and chronic stress, abstinence reinforcement procedures) on incubation of drug craving has been investigated. In this review, we summarized the behavioral procedures adopted, the key underlying neurobiological correlates and clinical implications of these studies.

Individual differences in addiction-like behaviors and choice between cocaine versus food in Heterogeneous Stock rats.

RATIONALE AND OBJECTIVES: Recent studies reported that when given a mutually exclusive choice between cocaine and palatable food, most rats prefer the non-drug reward over cocaine. However, these studies used rat strains with limited genetic and behavioral diversity. Here, we used a unique outbred strain of rats (Heterogeneous Stock, HS) that mimic the genetic variability of humans. METHODS: We first identified individual differences in addiction-like behaviors (low and high). Next, we tested choice between cocaine and palatable food using a discrete choice procedure. We characterized the individual differences using an addiction score that incorporates key features of addiction: escalated intake, highly motivated responding (progressive ratio), and responding despite adverse consequences (footshock punishment). We assessed food versus cocaine choice at different drug-free days (without pre-choice cocaine self-administration) during acquisition of cocaine self-administration or after escalation of cocaine self-administration. We also assessed drug versus food choice immediately after 1-, 2-, or 6-h cocaine self-administration. RESULTS: Independent of the addiction score, without pre-choice cocaine (1 or more abstinence days), HS rats strongly preferred the palatable food over cocaine, even if the food reward was delayed or its size was reduced. However, rats with high but not low addiction score modestly increased cocaine choice immediately after 1-, 2-, or 6-h cocaine self-administration. CONCLUSIONS: Like other strains, HS rats strongly prefer palatable food over cocaine. Individual differences in addiction score were associated with increased drug choice in the presence but not absence (abstinence) of cocaine. The HS strain may be useful in studies on mechanisms of addiction vulnerability.

A neural substrate of compulsive alcohol use.

Alcohol intake remains controlled in a majority of users but becomes "compulsive," i.e., continues despite adverse consequences, in a minority who develop alcohol addiction. Here, using a footshock-punished alcohol self-administration procedure, we screened a large population of outbred rats to identify those showing compulsivity operationalized as punishment-resistant self-administration. Using unsupervised clustering, we found that this behavior emerged as a stable trait in a subpopulation of rats and was associated with activity of a brain network that included central nucleus of the amygdala (CeA). Activity of PKCδ+ inhibitory neurons in the lateral subdivision of CeA (CeL) accounted for ~75% of variance in punishment-resistant alcohol taking. Activity-dependent tagging, followed by chemogenetic inhibition of neurons activated during punishment-resistant self-administration, suppressed alcohol taking, as did a virally mediated shRNA knockdown of PKCδ in CeA. These findings identify a previously unknown mechanism for a core element of alcohol addiction and point to a novel candidate therapeutic target.

The protective effect of operant social reward on cocaine self-administration, choice, and relapse is dependent on delay and effort for the social reward.

Social reinforcement-based treatments are effective for many, but not all, people with addictions to drugs. We recently developed an operant rat model that mimics features of one such treatment, the community-reinforcement approach. In this model, rats uniformly choose social interaction over methamphetamine or heroin. Abstinence induced by social preference protects against the incubation of drug-seeking that would emerge during forced abstinence. Here, we determined whether these findings generalize to cocaine and whether delaying or increasing effort for social interaction could reveal possibly human-relevant individual differences in responsiveness. We trained male and female rats for social self-administration (6 days) and then for cocaine self-administration, initially for 2-h/day for 4 days, and then for 12-h/day continuously or intermittently for 8 days. We assessed relapse to cocaine seeking after 1 and 15 days. Between tests, the rats underwent either forced abstinence or social-choice-induced abstinence. After establishing stable social preference, we manipulated the delay for both rewards or for social reward alone, or the response requirements (effort) for social reward. Independent of cocaine-access conditions and sex, operant social interaction inhibited cocaine self-administration and prevented incubation of cocaine seeking. Preference for social access was decreased by the delay of both rewards or social reward alone, or by increased response requirements for social reward, with notable individual variability. This choice procedure can identify mechanisms of individual differences in an animal model of cocaine use and could thereby help screen medications for people who are relatively unresponsive to treatments based on rewarding social interaction.

Animal Models of Drug Relapse and Craving after Voluntary Abstinence: A Review.

Relapse to drug use during abstinence is a defining feature of addiction. During the last several decades, this clinical scenario has been studied at the preclinical level using classic relapse/reinstatement models in which drug seeking is assessed after experimenter-imposed home-cage forced abstinence or extinction of the drug-reinforced responding in the self-administration chambers. To date, however, results from studies using rat relapse/reinstatement models have yet to result in Food and Drug Administration-approved medications for relapse prevention. The reasons for this state of affairs are complex and multifaceted, but one potential reason is that, in humans, abstinence is often self-imposed or voluntary and occurs either because the negative consequences of drug use outweigh the drug's rewarding effects or because of the availability of nondrug alternative rewards that are chosen over the drug. Based on these considerations, we and others have recently developed rat models of relapse after voluntary abstinence, achieved either by introducing adverse consequences to drug taking (punishment) or seeking (electric barrier) or by providing mutually exclusive choices between the self-administered drug and nondrug rewards (palatable food or social interaction). In this review, we provide an overview of these translationally relevant relapse models and discuss recent neuropharmacological findings from studies using these models. We also discuss sex as a biological variable, future directions, and clinical implications of results from relapse studies using voluntary abstinence models. Our main conclusion is that the neuropharmacological mechanisms controlling relapse to drug seeking after voluntary abstinence are often different from the mechanisms controlling relapse after home-cage forced abstinence or reinstatement after extinction. SIGNIFICANCE STATEMENT: This review describes recently developed rat models of relapse after voluntary abstinence, achieved either by introducing adverse consequences to drug taking or seeking or by providing mutually exclusive choices between the self-administered drug and nondrug rewards. This review discusses recent neuropharmacological findings from studies using these models and discusses future directions and clinical implications.

Fos-expressing neuronal ensemble in rat ventromedial prefrontal cortex encodes cocaine seeking but not food seeking in rats.

Neuronal ensembles in ventromedial prefrontal cortex (vmPFC) play a role in both cocaine and palatable food seeking. However, it is unknown whether similar or different vmPFC neuronal ensembles mediate food and cocaine seeking. Here, we used the Daun02 inactivation procedure to assess whether the neuronal ensembles mediating food and cocaine seeking can be functionally distinguished. We trained male and female Fos-LacZ rats to self-administer palatable food pellets and cocaine on alternating days for 18 days. We then exposed the rats to a brief nonreinforced food- or cocaine-seeking test to induce Fos and ß-gal in neuronal ensembles associated with food or cocaine seeking, respectively and infused Daun02 into vmPFC to ablate the ß-gal-expressing ensembles. Two days later, we tested the rats for food or cocaine seeking under extinction conditions. Although inactivation of the food-seeking ensemble did not influence food or cocaine seeking, inactivation of the cocaine-seeking ensemble reduced cocaine seeking but not food seeking. Results indicate that the neuronal ensemble activated by cocaine seeking in vmPFC is functionally separate from the ensemble activated by food seeking.

Improving translation of animal models of addiction and relapse by reverse translation.

Critical features of human addiction are increasingly being incorporated into complementary animal models, including escalation of drug intake, punished drug seeking and taking, intermittent drug access, choice between drug and non-drug rewards, and assessment of individual differences based on criteria in the fourth edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-IV). Combined with new technologies, these models advanced our understanding of brain mechanisms of drug self-administration and relapse, but these mechanistic gains have not led to improvements in addiction treatment. This problem is not unique to addiction neuroscience, but it is an increasing source of disappointment and calls to regroup. Here we first summarize behavioural and neurobiological results from the animal models mentioned above. We then propose a reverse translational approach, whose goal is to develop models that mimic successful treatments: opioid agonist maintenance, contingency management and the community-reinforcement approach. These reverse-translated 'treatments' may provide an ecologically relevant platform from which to discover new circuits, test new medications and improve translation.