Valence ambiguity dynamically shapes striatal dopamine heterogeneity.

Adaptive decision making relies on dynamic updating of learned associations where environmental cues come to predict positive and negatively valenced stimuli, such as food or threat. Flexible cue-guided behaviors depend on a network of brain systems, including dopamine signaling in the striatum, which is critical for learning and maintenance of conditioned behaviors. Critically, it remains unclear how dopamine signaling encodes multi-valent, dynamic learning contexts, where positive and negative associations must be rapidly disambiguated. To understand this, we employed a Pavlovian discrimination paradigm, where cues predicting positive and negative outcomes were intermingled during conditioning sessions, and their meaning was serially reversed across training. We found that rats readily distinguished these cues, and updated their behavior rapidly upon valence reversal. Using fiber photometry, we recorded dopamine signaling in three major striatal subregions -,the dorsolateral striatum (DLS), the nucleus accumbens core, and the nucleus accumbens medial shell - and found heterogeneous responses to positive and negative conditioned cues and their predicted outcomes. Valence ambiguity introduced by cue reversal reshaped striatal dopamine on different timelines: nucleus accumbens core and shell signals updated more readily than those in the DLS. Together, these results suggest that striatal dopamine flexibly encodes multi-valent learning contexts, and these signals are dynamically modulated by changing contingencies to resolve ambiguity about the meaning of environmental cues.

A Conditioned Place Preference for Heroin Is Signaled by Increased Dopamine and Direct Pathway Activity and Decreased Indirect Pathway Activity in the Nucleus Accumbens.

Repeated pairing of a drug with a neutral stimulus, such as a cue or context, leads to the attribution of the drug's reinforcing properties to that stimulus, and exposure to that stimulus in the absence of the drug can elicit drug-seeking. A principal role for the NAc in the response to drug-associated stimuli has been well documented. Direct and indirect pathway medium spiny neurons (dMSNs and iMSNs) have been shown to bidirectionally regulate cue-induced heroin-seeking in rats expressing addiction-like phenotypes, and a shift in NAc activity toward the direct pathway has been shown in mice following cocaine conditioned place preference (CPP). However, how NAc signaling guides heroin CPP, and whether heroin alters the balance of signaling between dMSNs and iMSNs, remains unknown. Moreover, the role of NAc dopamine signaling in heroin reinforcement is unclear. Here, we integrate fiber photometry for in vivo monitoring of dopamine and dMSN/iMSN calcium activity with a heroin CPP procedure in rats to begin to address these questions. We identify a sensitization-like response to heroin in the NAc, with prominent iMSN activity during initial heroin exposure and prominent dMSN activity following repeated heroin exposure. We demonstrate a ramp in dopamine activity, dMSN activation, and iMSN inactivation preceding entry into a heroin-paired context, and a decrease in dopamine activity, dMSN inactivation, and iMSN activation preceding exit from a heroin-paired context. Finally, we show that buprenorphine is sufficient to prevent the development of heroin CPP and reduce Fos activation in the NAc after conditioning. Together, these data support the hypothesis that an imbalance in NAc activity contributes to the development of drug-cue associations that can drive addiction processes.SIGNIFICANCE STATEMENT The attribution of the reinforcing effects of drugs to neutral stimuli (e.g., cues and contexts) contributes to the long-standing nature of addiction, as re-exposure to drug-associated stimuli can reinstate drug-seeking and -taking even after long periods of abstinence. The NAc has an established role in encoding the value of drug-associated stimuli, and dopamine release into the NAc is known to modulate the reinforcing effects of drugs, including heroin. Using fiber photometry, we show that entering a heroin-paired context is driven by dopamine signaling and NAc direct pathway activation, whereas exiting a heroin-paired context is driven by NAc indirect pathway activation. This study provides further insight into the role of NAc microcircuitry in encoding the reinforcing properties of heroin.

Dopamine D2 receptor signaling on iMSNs is required for initiation and vigor of learned actions.

Striatal dopamine D2 receptors (D2Rs) are important for motor output. Selective deletion of D2Rs from indirect pathway-projecting medium spiny neurons (iMSNs) impairs locomotor activities in a task-specific manner. However, the role of D2Rs in the initiation of motor actions in reward seeking and taking is not fully understood, and there is little information about how receptors contribute under different task demands and with different outcome types. The iMSN-D2Rs modulate neuronal activity and synaptic transmission, exerting control on circuit functions that may play distinct roles in action learning and performance. Selective deletion of D2Rs on iMSNs resulted in slower action initiation and response rate in an instrumental conditioning task, but only when performance demand was increased. The iMSN-Drd2KO mice were also slower to initiate swimming in a T-maze procedural learning task but were unimpaired in cognitive function and behavioral flexibility. In contrast, in a Pavlovian discrimination learning task, iMSN-Drd2KO mice exhibited normal acquisition and extinction of rewarded responding. The iMSN-Drd2KO mice showed performance deficits at all phases of rotarod skill learning. These findings reveal that dopamine modulation through iMSN-D2Rs influences the ability to self-initiate actions, as well as the willingness and/or vigor with which these responses are performed. However, these receptors seem to have little influence on simple associative learning or on stimulus-driven responding. The loss of normal D2R roles may contribute to disorders in which impaired dopamine signaling leads to hypokinesia or impaired initiation of specific voluntary actions.

One Is Not Enough: Understanding and Modeling Polysubstance Use.

Substance use disorder (SUD) is a chronic, relapsing disease with a highly multifaceted pathology that includes (but is not limited to) sensitivity to drug-associated cues, negative affect, and motivation to maintain drug consumption. SUDs are highly prevalent, with 35 million people meeting criteria for SUD. While drug use and addiction are highly studied, most investigations of SUDs examine drug use in isolation, rather than in the more prevalent context of comorbid substance histories. Indeed, 11.3% of individuals diagnosed with a SUD have concurrent alcohol and illicit drug use disorders. Furthermore, having a SUD with one substance increases susceptibility to developing dependence on additional substances. For example, the increased risk of developing heroin dependence is twofold for alcohol misusers, threefold for cannabis users, 15-fold for cocaine users, and 40-fold for prescription misusers. Given the prevalence and risk associated with polysubstance use and current public health crises, examining these disorders through the lens of co-use is essential for translatability and improved treatment efficacy. The escalating economic and social costs and continued rise in drug use has spurred interest in developing preclinical models that effectively model this phenomenon. Here, we review the current state of the field in understanding the behavioral and neural circuitry in the context of co-use with common pairings of alcohol, nicotine, cannabis, and other addictive substances. Moreover, we outline key considerations when developing polysubstance models, including challenges to developing preclinical models to provide insights and improve treatment outcomes.

Chemogenetic modulation of accumbens direct or indirect pathways bidirectionally alters reinstatement of heroin-seeking in high- but not low-risk rats.

Opioid addiction has been declared a public health emergency, with fatal overdoses following relapse reaching epidemic proportions and disease-associated costs continuing to escalate. Relapse is often triggered by re-exposure to drug-associated cues, and though the neural substrates responsible for relapse in vulnerable individuals remains ambiguous, the nucleus accumbens (NAc) has been shown to play a central role. NAc direct and indirect pathway medium spiny neurons (dMSNs and iMSNs) can have oppositional control over reward-seeking and associative learning and are critically involved in reinstatement of psychostimulant-seeking. However, whether these pathways similarly regulate reinstatement of opioid-seeking remains unknown, as is their role in modulating motivation to take opioids. Here, we describe a method for classifying addiction severity in outbred rats following intermittent-access heroin self-administration that identifies subgroups as addiction-vulnerable (high-risk) or addiction-resistant (low-risk). Using dual viral-mediated gene transfer of DREADDs, we show that transient inactivation of dMSNs or activation of iMSNs is capable of suppressing cue-induced reinstatement of heroin-seeking in high- but not low-risk rats. Surprisingly, however, the motivation to self-administer heroin was unchanged, indicating a divergence in the encoding of heroin-taking and heroin-seeking in rats. We further show that transient activation of dMSNs or inactivation of iMSNs exacerbates cue-induced reinstatement of heroin-seeking in high- but not low-risk rats, again with no effect on motivation. These findings demonstrate a critical role for dMSNs and iMSNs in encoding vulnerability to reinstatement of heroin-seeking and provide insight into the specific neurobiological changes that occur in vulnerable groups following heroin self-administration.

Feeding Experimentation Device (FED): Construction and Validation of an Open-source Device for Measuring Food Intake in Rodents.

Food intake measurements are essential for many research studies. Here, we provide a detailed description of a novel solution for measuring food intake in mice: the Feeding Experimentation Device (FED). FED is an open-source system that was designed to facilitate flexibility in food intake studies. Due to its compact and battery powered design, FED can be placed within standard home cages or other experimental equipment. Food intake measurements can also be synchronized with other equipment in real-time via FED's transistor-transistor logic (TTL) digital output, or in post-acquisition processing as FED timestamps every event with a real-time clock. When in use, a food pellet sits within FED's food well where it is monitored via an infrared beam. When the pellet is removed by the mouse, FED logs the timestamp onto its internal secure digital (SD) card and dispenses another pellet. FED can run for up to 5 days before it is necessary to charge the battery and refill the pellet hopper, minimizing human interference in data collection. Assembly of FED requires minimal engineering background, and off-the-shelf materials and electronics were prioritized in its construction. We also provide scripts for analysis of food intake and meal patterns. Finally, FED is open-source and all design and construction files are online, to facilitate modifications and improvements by other researchers.

Increases in Physical Activity Result in Diminishing Increments in Daily Energy Expenditure in Mice.

Exercise is a common component of weight loss strategies, yet exercise programs are associated with surprisingly small changes in body weight [1-4]. This may be due in part to compensatory adaptations, in which calories expended during exercise are counteracted by decreases in other aspects of energy expenditure [1, 5-10]. Here we examined the relationship between a rodent model of voluntary exercise- wheel running- and total daily energy expenditure. Use of a running wheel for 3 to 7 days increased daily energy expenditure, resulting in a caloric deficit of ∼1 kcal/day; however, total daily energy expenditure remained stable after the first week of wheel access, despite further increases in wheel use. We hypothesized that compensatory mechanisms accounted for the lack of increase in daily energy expenditure after the first week. Supporting this idea, we observed a decrease in off-wheel ambulation when mice were using the wheels, indicating behavioral compensation. Finally, we asked whether individual variation in wheel use within a group of mice would be associated with different levels of daily energy expenditure. Despite a large variation in wheel running, we did not observe a significant relationship between the amount of daily wheel running and total daily energy expenditure or energy intake across mice. Together, our experiments support a model in which the transition from sedentary to light activity is associated with an increase in daily energy expenditure, but further increases in physical activity produce diminishingly small increments in daily energy expenditure.

Basal Ganglia Dysfunction Contributes to Physical Inactivity in Obesity.

Obesity is associated with physical inactivity, which exacerbates the health consequences of weight gain. However, the mechanisms that mediate this association are unknown. We hypothesized that deficits in dopamine signaling contribute to physical inactivity in obesity. To investigate this, we quantified multiple aspects of dopamine signaling in lean and obese mice. We found that D2-type receptor (D2R) binding in the striatum, but not D1-type receptor binding or dopamine levels, was reduced in obese mice. Genetically removing D2Rs from striatal medium spiny neurons was sufficient to reduce motor activity in lean mice, whereas restoring Gi signaling in these neurons increased activity in obese mice. Surprisingly, although mice with low D2Rs were less active, they were not more vulnerable to diet-induced weight gain than control mice. We conclude that deficits in striatal D2R signaling contribute to physical inactivity in obesity, but inactivity is more a consequence than a cause of obesity.

Do Dopaminergic Impairments Underlie Physical Inactivity in People with Obesity?

Obesity is associated with physical inactivity, which exacerbates the negative health consequences of obesity. Despite a wide consensus that people with obesity should exercise more, there are few effective methods for increasing physical activity in people with obesity. This lack is reflected in our limited understanding of the cellular and molecular causes of physical inactivity in obesity. We hypothesize that impairments in dopamine signaling contribute to physical inactivity in people with obesity, as in classic movement disorders such as Parkinson's disease. Here, we review two lines of evidence supporting this hypothesis: (1) chronic exposure to obesogenic diets has been linked to impairments in dopamine synthesis, release, and receptor function, particularly in the striatum, and (2) striatal dopamine is necessary for the proper control of movement. Identifying the biological determinants of physical inactivity may lead to more effective strategies for increasing physical activity in people with obesity, as well as improve our understanding of why it is difficult for people with obesity to alter their levels of physical activity.

Feeding Experimentation Device (FED): A flexible open-source device for measuring feeding behavior.

BACKGROUND: Measuring food intake in rodents is a conceptually simple yet labor-intensive and temporally-imprecise task. Most commonly, food is weighed manually, with an interval of hours or days between measurements. Commercial feeding monitors are excellent, but are costly and require specialized caging and equipment. NEW METHOD: We have developed the Feeding Experimentation Device (FED): a low-cost, open-source, home cage-compatible feeding system. FED utilizes an Arduino microcontroller and open-source software and hardware. FED dispenses a single food pellet into a food well where it is monitored by an infrared beam. When the mouse removes the pellet, FED logs the timestamp to a secure digital (SD) card and dispenses a new pellet into the well. Post-hoc analyses of pellet retrieval timestamps reveal high-resolution details about feeding behavior. RESULTS: FED is capable of accurately measuring food intake, identifying discrete trends during light and dark-cycle feeding. Additionally, we show the utility of FED for measuring increases in feeding resulting from optogenetic stimulation of agouti-related peptide neurons in the arcuate nucleus of the hypothalamus. COMPARISON TO EXISTING METHODS: With a cost of ∼$350 per device, FED is >10× cheaper than commercially available feeding systems. FED is also self-contained, battery powered, and designed to be placed in standard colony rack cages, allowing for monitoring of true home cage feeding behavior. Moreover, FED is highly adaptable and can be synchronized with emerging techniques in neuroscience, such as optogenetics, as we demonstrate here. CONCLUSIONS: FED allows for accurate, precise monitoring of feeding behavior in a home cage setting.