Reversal of Alcohol-Induced Dysregulation in Dopamine Network Dynamics May Rescue Maladaptive Decision-making.

Alcohol is the most commonly abused substance among adolescents, promoting the development of substance use disorders and compromised decision-making in adulthood. We have previously demonstrated, with a preclinical model in rodents, that adolescent alcohol use results in adult risk-taking behavior that positively correlates with phasic dopamine transmission in response to risky options, but the underlying mechanisms remain unknown. Here, we show that adolescent alcohol use may produce maladaptive decision-making through a disruption in dopamine network dynamics via increased GABAergic transmission within the ventral tegmental area (VTA). Indeed, we find that increased phasic dopamine signaling after adolescent alcohol use is attributable to a midbrain circuit, including the input from the pedunculopontine tegmentum to the VTA. Moreover, we demonstrate that VTA dopamine neurons from adult rats exhibit enhanced IPSCs after adolescent alcohol exposure corresponding to decreased basal dopamine levels in adulthood that negatively correlate with risk-taking. Building on these findings, we develop a model where increased inhibitory tone on dopamine neurons leads to a persistent decrease in tonic dopamine levels and results in a potentiation of stimulus-evoked phasic dopamine release that may drive risky choice behavior. Based on this model, we take a pharmacological approach to the reversal of risk-taking behavior through normalization of this pattern in dopamine transmission. These results isolate the underlying circuitry involved in alcohol-induced maladaptive decision-making and identify a novel therapeutic target. SIGNIFICANCE STATEMENT: One of the primary problems resulting from chronic alcohol use is persistent, maladaptive decision-making that is associated with ongoing addiction vulnerability and relapse. Indeed, studies with the Iowa Gambling Task, a standard measure of risk-based decision-making, have reliably shown that alcohol-dependent individuals make riskier, more maladaptive choices than nondependent individuals, even after periods of prolonged abstinence. Using a preclinical model, in the current work, we identify a selective disruption in dopamine network dynamics that may promote maladaptive decision-making after chronic adolescent alcohol use and demonstrate its pharmacological reversal in adulthood. Together, these results highlight a novel neural mechanism underlying heightened risk-taking behavior in alcohol-dependent individuals and provide a potential therapeutic target for further investigation.

A selective role for dopamine in stimulus-reward learning.

Individuals make choices and prioritize goals using complex processes that assign value to rewards and associated stimuli. During Pavlovian learning, previously neutral stimuli that predict rewards can acquire motivational properties, becoming attractive and desirable incentive stimuli. However, whether a cue acts solely as a predictor of reward, or also serves as an incentive stimulus, differs between individuals. Thus, individuals vary in the degree to which cues bias choice and potentially promote maladaptive behaviour. Here we use rats that differ in the incentive motivational properties they attribute to food cues to probe the role of the neurotransmitter dopamine in stimulus-reward learning. We show that intact dopamine transmission is not required for all forms of learning in which reward cues become effective predictors. Rather, dopamine acts selectively in a form of stimulus-reward learning in which incentive salience is assigned to reward cues. In individuals with a propensity for this form of learning, reward cues come to powerfully motivate and control behaviour. This work provides insight into the neurobiology of a form of stimulus-reward learning that confers increased susceptibility to disorders of impulse control.

Dynamic shaping of dopamine signals during probabilistic Pavlovian conditioning.

Cue- and reward-evoked phasic dopamine activity during Pavlovian and operant conditioning paradigms is well correlated with reward-prediction errors from formal reinforcement learning models, which feature teaching signals in the form of discrepancies between actual and expected reward outcomes. Additionally, in learning tasks where conditioned cues probabilistically predict rewards, dopamine neurons show sustained cue-evoked responses that are correlated with the variance of reward and are maximal to cues predicting rewards with a probability of 0.5. Therefore, it has been suggested that sustained dopamine activity after cue presentation encodes the uncertainty of impending reward delivery. In the current study we examined the acquisition and maintenance of these neural correlates using fast-scan cyclic voltammetry in rats implanted with carbon fiber electrodes in the nucleus accumbens core during probabilistic Pavlovian conditioning. The advantage of this technique is that we can sample from the same animal and recording location throughout learning with single trial resolution. We report that dopamine release in the nucleus accumbens core contains correlates of both expected value and variance. A quantitative analysis of these signals throughout learning, and during the ongoing updating process after learning in probabilistic conditions, demonstrates that these correlates are dynamically encoded during these phases. Peak CS-evoked responses are correlated with expected value and predominate during early learning while a variance-correlated sustained CS signal develops during the post-asymptotic updating phase.

Dopamine encoding of Pavlovian incentive stimuli diminishes with extended training.

Dopamine is highly implicated both as a teaching signal in reinforcement learning and in motivating actions to obtain rewards. However, theoretical disconnects remain between the temporal encoding properties of dopamine neurons and the behavioral consequences of its release. Here, we demonstrate in rats that dopamine evoked by Pavlovian cues increases during acquisition, but dissociates from stable conditioned appetitive behavior as this signal returns to preconditioning levels with extended training. Experimental manipulation of the statistical parameters of the behavioral paradigm revealed that this attenuation of cue-evoked dopamine release during the postasymptotic period was attributable to acquired knowledge of the temporal structure of the task. In parallel, conditioned behavior became less dopamine dependent after extended training. Thus, the current work demonstrates that as the presentation of reward-predictive stimuli becomes anticipated through the acquisition of task information, there is a shift in the neurobiological substrates that mediate the motivational properties of these incentive stimuli.

Chronic alcohol intake during adolescence, but not adulthood, promotes persistent deficits in risk-based decision making.

BACKGROUND: Adolescent alcohol use is a major public health concern and is strongly correlated with the development of alcohol abuse problems in adulthood. Adolescence is characterized by maturation and remodeling of brain regions implicated in decision making and therefore may be uniquely vulnerable to environmental insults such as alcohol exposure. We have previously demonstrated that voluntary alcohol consumption in adolescence results in maladaptive risk-based decision making in adulthood. However, it is unclear whether this effect on risk-based decision making can be attributed to chronic alcohol use in general or to a selective effect of alcohol use during the adolescent period. METHODS: Ethanol (EtOH) was presented to adolescent (postnatal day [PND] 30 to 49) and adult rats (PND 80 to 99) for 20 days, either 24 hours or 1 h/d, in a gel matrix consisting of distilled water, gelatin, polycose (10%), and EtOH (10%). The 24-hour time course of EtOH intake was measured and compared between adolescent and adult animals. Following 20 days of withdrawal from EtOH, we assessed risk-based decision making with a concurrent instrumental probability-discounting task. Blood EtOH concentrations (BECs) were taken from trunk blood and assessed using the Analox micro-stat GM7 in separate groups of animals at different time points. RESULTS: Unlike animals exposed to EtOH during adolescence, animals exposed to alcohol during adulthood did not display differences in risk preference compared to controls. Adolescent and adult rats displayed similar EtOH intake levels and patterns when given either 24- or 1-hour access per day. In addition, while both groups reached significant BEC levels, we failed to find a difference between adult and adolescent animals. CONCLUSIONS: Here, we show that adolescent, but not adult, EtOH intake leads to a persistent increase in risk preference which cannot be attributed to differences in intake levels or BECs attained. Our findings support previous work implicating adolescence as a time period of heightened susceptibility to the long-term negative effects of alcohol exposure.

Risk preference following adolescent alcohol use is associated with corrupted encoding of costs but not rewards by mesolimbic dopamine.

Several emerging theories of addiction have described how abused substances exploit vulnerabilities in decision-making processes. These vulnerabilities have been proposed to result from pharmacologically corrupted neural mechanisms of normal brain valuation systems. High alcohol intake in rats during adolescence has been shown to increase risk preference, leading to suboptimal performance on a decision-making task when tested in adulthood. Understanding how alcohol use corrupts decision making in this way has significant clinical implications. However, the underlying mechanism by which alcohol use increases risk preference remains unclear. To address this central issue, we assessed dopamine neurotransmission with fast-scan cyclic voltammetry during reward valuation and risk-based decision making in rats with and without a history of adolescent alcohol intake. We specifically targeted the mesolimbic dopamine system, the site of action for virtually all abused substances. This system, which continuously develops during the adolescent period, is central to both reward processing and risk-based decision making. We report that a history of adolescent alcohol use alters dopamine signaling to risk but not to reward. Thus, a corruption of cost encoding suggests that adolescent alcohol use leads to long-term changes in decision making by altering the valuation of risk.

Chronic microsensors for longitudinal, subsecond dopamine detection in behaving animals.

Neurotransmission operates on a millisecond timescale but is changed by normal experience or neuropathology over days to months. Despite the importance of long-term neurotransmitter dynamics, no technique exists to track these changes in a subject from day to day over extended periods of time. Here we describe and characterize a microsensor that can detect the neurotransmitter dopamine with subsecond temporal resolution over months in vivo in rats and mice.

Absence of NMDA receptors in dopamine neurons attenuates dopamine release but not conditioned approach during Pavlovian conditioning.

During Pavlovian conditioning, phasic dopamine (DA) responses emerge to reward-predictive stimuli as the subject learns to anticipate reward delivery. This observation has led to the hypothesis that phasic dopamine signaling is important for learning. To assess the ability of mice to develop anticipatory behavior and to characterize the contribution of dopamine, we used a food-reinforced Pavlovian conditioning paradigm. As mice learned the cue-reward association, they increased their head entries to the food receptacle in a pattern that was consistent with conditioned anticipatory behavior. D1-receptor knockout (D1R-KO) mice had impaired acquisition, and systemic administration of a D1R antagonist blocked both the acquisition and expression of conditioned approach in wild-type mice. To assess the specific contribution of phasic dopamine transmission, we tested mice lacking NMDA-type glutamate receptors (NMDARs) exclusively in dopamine neurons (NR1-KO mice). Surprisingly, NR1-KO mice learned at the same rate as their littermate controls. To evaluate the contribution of NMDARs to phasic dopamine release in this paradigm, we performed fast-scan cyclic voltammetry in the nucleus accumbens of awake mice. Despite having significantly attenuated phasic dopamine release following reward delivery, KO mice developed cue-evoked dopamine release at the same rate as controls. We conclude that NMDARs in dopamine neurons enhance but are not critical for phasic dopamine release to behaviorally relevant stimuli; furthermore, their contribution to phasic dopamine signaling is not necessary for the development of cue-evoked dopamine or anticipatory activity in a D1R-dependent Pavlovian conditioning paradigm.

Sexually dimorphic development of the mesolimbic dopamine system is associated with nuanced sensitivity to adolescent alcohol use.

Alcohol use remains a major public health concern and is especially prevalent during adolescence. Adolescent alcohol use has been linked to several behavioral abnormalities in later life, including increased risk taking and impulsivity. Accordingly, when modeled in animals, male rats that had moderate alcohol consumption during adolescence exhibit multiple effects in adulthood, including increased risk taking, altered incentive learning, and greater release of dopamine in the mesolimbic pathway. It has been proposed that alcohol arrests neural development, "locking in" adolescent physiological, and consequent behavioral, phenotypes. Here we examined the feasibility that the elevated dopamine levels following adolescent alcohol exposure are a "locked in" phenotype by testing mesolimbic dopamine release across adolescent development. We found that in male rats, dopamine release peaks in late adolescence, returning to lower levels in adulthood, consistent with the notion that high dopamine levels in adolescence-alcohol-exposed adults were due to arrested development. Surprisingly, dopamine release in females was stable across the tested developmental window. This result raised a quandary that arrested dopamine levels would not differ from normal development in females and, therefore, may not contribute to pathological behavior. However, the aforementioned findings related to risk-based decision-making have only been performed in male subjects. When we tested females that had undergone adolescent alcohol use, we found that neither risk attitude during probabilistic decision-making nor mesolimbic dopamine release was altered. These findings suggest that different developmental profiles of the mesolimbic dopamine system across sexes result in dimorphic susceptibility to alcohol-induced cognitive and motivational anomalies exposure.

Levodopa reduces consumption of multiple classes of addictive substances in rats.

Dopamine transmission is implicated in aberrant behaviors associated with substance use disorders. Previous research revealed a causal link between excessive drug consumption and the loss of dopamine signaling to stimuli associated with psychostimulant use. The emerging change in dopamine signaling is specific to stimuli associated with the substance rather than the pharmacological properties of the drug itself. Because the change in dopamine signaling was specific to the associated stimuli and not the pharmacological properties of the substance, we examined if treatment with the dopamine precursor, l-DOPA, alters alcohol and opioid self-administration. Therefore, we trained rats to orally self-administer ethanol or the synthetic opioid fentanyl and found that treating animals with l-DOPA significantly reduced consumption of both alcohol and fentanyl. These data suggest dopamine signaling has a vital role in mediating the amount of drug animals will voluntarily take, across multiple classes of drugs. Importantly, these data are preclinical demonstrations of l-DOPA being utilized as a harm reducing treatment in substance use disorders.

Orally consumed cannabinoids provide long-lasting relief of allodynia in a mouse model of chronic neuropathic pain.

Chronic pain affects a significant percentage of the United States population, and available pain medications like opioids have drawbacks that make long-term use untenable. Cannabinoids show promise in the management of pain, but long-term treatment of pain with cannabinoids has been challenging to implement in preclinical models. We developed a voluntary, gelatin oral self-administration paradigm that allowed male and female mice to consume ∆9-tetrahydrocannabinol, cannabidiol, or morphine ad libitum. Mice stably consumed these gelatins over 3 weeks, with detectable serum levels. Using a real-time gelatin measurement system, we observed that mice consumed gelatin throughout the light and dark cycles, with animals consuming less THC-gelatin than the other gelatin groups. Consumption of all three gelatins reduced measures of allodynia in a chronic, neuropathic sciatic nerve injury model, but tolerance to morphine developed after 1 week while THC or CBD reduced allodynia over three weeks. Hyperalgesia gradually developed after sciatic nerve injury, and by the last day of testing, THC significantly reduced hyperalgesia, with a trend effect of CBD, and no effect of morphine. Mouse vocalizations were recorded throughout the experiment, and mice showed a large increase in ultrasonic, broadband clicks after sciatic nerve injury, which was reversed by THC, CBD, and morphine. This study demonstrates that mice voluntarily consume both cannabinoids and opioids via gelatin, and that cannabinoids provide long-term relief of chronic pain states. In addition, ultrasonic clicks may objectively represent mouse pain status and could be integrated into future pain models.

Controls of tonic and phasic dopamine transmission in the dorsal and ventral striatum.

Dopamine (DA) release varies within subregions and local environments of the striatum, suggesting that controls intrinsic and extrinsic to the DA fibers and terminals regulate release. While applying fast-scan cyclic voltammetry and using tonic and phasic stimulus trains, we investigated the regulation of DA release in the dorsolateral to ventral striatum. The ratio of phasic-to-tonic-evoked DA signals varied with the average ongoing firing frequency, and the ratio was generally higher in the nucleus accumbens (NAc) compared with the dorsolateral striatum. At the normal average firing frequency, burst stimulation produces a larger increase in the DA response in the NAc than the dorsolateral striatum. This finding was comparable whether the DA measurements were made using in vitro brain slices or were recorded in vivo from freely moving rodents. Blockade of the dopamine transporters and dopamine D(2) receptors particularly enhanced the tonic DA signals. Conversely, blockade of nicotinic acetylcholine receptors (nAChRs) containing the beta(2) subunit (beta(2)(*)) predominantly suppressed tonic DA signals. The suppression of tonic DA release increased the contrast between phasic and tonic DA signals, and that made the frequency-dependent DA dynamics between the dorsolateral striatum and NAc more similar. The results indicate that intrinsic differences in the DA fibers that innervate specific regions of the striatum combine with (at least) DA transporters, DA receptors, and nAChRs to regulate the frequency dependence of DA release. A combination of mechanisms provides specific local control of DA release that underlies pathway-specific information associated with motor and reward-related functions.

Voluntary oral consumption of Δ9-tetrahydrocannabinol by adolescent rats impairs reward-predictive cue behaviors in adulthood.

Few preclinical approaches are available to study the health impact of voluntary consumption of edibles containing the psychoactive drug Δ9-tetrahydrocannabinol (THC). We developed and validated such approach by measuring voluntary oral consumption of THC-containing gelatin by rats and used it to study if and how THC consumption during adolescence impacts adult behavior. We found that adolescent rats of both sexes consumed enough THC to trigger acute hypothermia, analgesic, and locomotor responses, and that 15 days of access to THC-gelatin in adolescence resulted in the down-regulation of cannabinoid 1 receptors (CB1Rs) in adulthood in a sex and brain area specific manner. Remarkably, THC consumption by adolescent male rats and not female rats led to impaired Pavlovian reward-predictive cue behaviors in adulthood consistent with a male-specific loss of CB1R-expressing vGlut-1 synaptic terminals in the ventral tegmental area (VTA). Thus, voluntary oral consumption of THC during adolescence is associated with sex-dependent behavioral impairment in adulthood.

Maladaptive Decision Making in Adults with a History of Adolescent Alcohol use, in a Preclinical Model, Is Attributable to the Compromised Assignment of Incentive Value during Stimulus-Reward Learning.

According to recent WHO reports, alcohol remains the number one substance used and abused by adolescents, despite public health efforts to curb its use. Adolescence is a critical period of biological maturation where brain development, particularly the mesocorticolimbic dopamine system, undergoes substantial remodeling. These circuits are implicated in complex decision making, incentive learning and reinforcement during substance use and abuse. An appealing theoretical approach has been to suggest that alcohol alters the normal development of these processes to promote deficits in reinforcement learning and decision making, which together make individuals vulnerable to developing substance use disorders in adulthood. Previously we have used a preclinical model of voluntary alcohol intake in rats to show that use in adolescence promotes risky decision making in adulthood that is mirrored by selective perturbations in dopamine network dynamics. Further, we have demonstrated that incentive learning processes in adulthood are also altered by adolescent alcohol use, again mirrored by changes in cue-evoked dopamine signaling. Indeed, we have proposed that these two processes, risk-based decision making and incentive learning, are fundamentally linked through dysfunction of midbrain circuitry where inputs to the dopamine system are disrupted by adolescent alcohol use. Here, we test the behavioral predictions of this model in rats and present the findings in the context of the prevailing literature with reference to the long-term consequences of early-life substance use on the vulnerability to develop substance use disorders. We utilize an impulsive choice task to assess the selectivity of alcohol's effect on decision-making profiles and conditioned reinforcement to parse out the effect of incentive value attribution, one mechanism of incentive learning. Finally, we use the differential reinforcement of low rates of responding (DRL) task to examine the degree to which behavioral disinhibition may contribute to an overall decision-making profile. The findings presented here support the proposition that early life alcohol use selectively alters risk-based choice behavior through modulation of incentive learning processes, both of which may be inexorably linked through perturbations in mesolimbic circuitry and may serve as fundamental vulnerabilities to the development of substance use disorders.

Sensitization of salt appetite is associated with increased "wanting" but not "liking" of a salt reward in the sodium-deplete rat.

To examine the role of incentive sensitization in the potentiation of salt appetite by prior depletions, the authors assessed the motivation to obtain salt ("wanting") and the palatability of salt ("liking") independently in salt-sensitized rats. Breakpoint on a progressive ratio reinforcement schedule was used to measure salt wanting and taste reactivity was used to measure salt liking in rats with and without a history of Na+ depletion. Salt-sensitized rats displayed higher breakpoints relative to controls. However, a history of Na+ depletion was not associated with a greater positive shift in taste reactivity measures. The data suggest that these components of reward are separable in this model and support the general proposition that sensitization may alter wanting but not liking.

A role for D2 but not D1 dopamine receptors in the cross-sensitization between amphetamine and salt appetite.

A history of sodium depletions has been found to potentiate the psychomotor as well as the rewarding effects of amphetamine, an indirect dopamine agonist. The present experiments were conducted to further define the role of dopamine receptor subtypes in this cross-sensitization effect. Rats with a history of sodium depletions were found to display psychomotor sensitization to a D2 but not a D1 direct agonist. Cross-sensitization between salt appetite and amphetamine was found to be blocked by a D2 but not a D1 antagonist. Together, these results implicate D2 but not D1 receptor function in the cross-sensitization seen after sodium depletions.

Experimental predictions drawn from a computational model of sign-trackers and goal-trackers.

Gaining a better understanding of the biological mechanisms underlying the individual variation observed in response to rewards and reward cues could help to identify and treat individuals more prone to disorders of impulsive control, such as addiction. Variation in response to reward cues is captured in rats undergoing autoshaping experiments where the appearance of a lever precedes food delivery. Although no response is required for food to be delivered, some rats (goal-trackers) learn to approach and avidly engage the magazine until food delivery, whereas other rats (sign-trackers) come to approach and engage avidly the lever. The impulsive and often maladaptive characteristics of the latter response are reminiscent of addictive behaviour in humans. In a previous article, we developed a computational model accounting for a set of experimental data regarding sign-trackers and goal-trackers. Here we show new simulations of the model to draw experimental predictions that could help further validate or refute the model. In particular, we apply the model to new experimental protocols such as injecting flupentixol locally into the core of the nucleus accumbens rather than systemically, and lesioning of the core of the nucleus accumbens before or after conditioning. In addition, we discuss the possibility of removing the food magazine during the inter-trial interval. The predictions from this revised model will help us better understand the role of different brain regions in the behaviours expressed by sign-trackers and goal-trackers.

Adolescent Alcohol Exposure Amplifies the Incentive Value of Reward-Predictive Cues Through Potentiation of Phasic Dopamine Signaling.

Adolescent alcohol use remains a major public health concern due in part to well-established findings implicating the age of onset in alcohol use in the development of alcohol use disorders and persistent decision-making deficits in adults. We have previously demonstrated that moderate adolescent alcohol consumption in rats promotes suboptimal decision making and an associated perturbation in mesolimbic dopamine transmission in adulthood. Dopamine-dependent incentive learning processes are an integral component of value-based decision making and a fundamental element to many theoretical accounts of addiction. Thus we tested the hypothesis that adolescent alcohol use selectively alters incentive learning processes through perturbation of mesolimbic dopamine systems. To assess incentive learning, behavioral and neurochemical measurements were made during the acquisition, maintenance, extinction, and reacquisition of a Pavlovian conditioned approach procedure in adult rats with a history of adolescent alcohol consumption. We show that moderate adolescent alcohol consumption potentiates stimulus-evoked phasic dopamine transmission, measured in vivo by fast-scan cyclic voltammetry, in adulthood and biases individuals toward a dopamine-dependent incentive learning strategy. Moreover, we demonstrate that animals exposed to alcohol in adolescence are more sensitive to an unexpected variation in reward outcomes. This pattern of phasic dopamine signaling and the associated bias in learning may provide a mechanism for the well-documented vulnerability of individuals with early-life alcohol use for alcohol use disorders in adulthood.

Reciprocal cross-sensitization between amphetamine and salt appetite.

Previous work in our laboratory has demonstrated a potentiation of the psychomotor effects of amphetamine in animals with a history of sodium depletion, a process referred to as cross-sensitization. The present studies were done to further develop this finding by assessing multiple effects of amphetamine in rats with and without a history of sodium depletion. For Experiments 1-3, rats were depleted of sodium twice then subjected to one of three experimental procedures [open-field activity, conditioned place preference (CPP) and conditioned taste aversion (CTA)]. A history of depletion produced an elevation in the psychomotor effects of amphetamine. CPP, used to assess the rewarding properties of amphetamine, developed in rats with a history of depletion but not in controls. The aversive component of amphetamine as measured by CTA was unaffected by previous experience with sodium depletion. Finally, acute salt appetite after depletion was assessed in rats exposed to a sensitizing regimen of amphetamine. Animals with a drug history demonstrated a significant elevation in NaCl solution intake after depletion in comparison to controls. Together, the data provide strong evidence for the reciprocal cross-sensitization of salt appetite and response to amphetamine.

Pavlovian valuation systems in learning and decision making.

Environmental stimuli guide value-based decision making, but can do so through cognitive representation of outcomes or through general-incentive properties attributed to the cues themselves. We assert that these differences are conferred through the use of alternative associative structures differing in computational intensity. Using this framework, we review scientific evidence to discern the neural substrates of these assumed separable processes. We suggest that the contribution of the mesolimbic dopamine system to Pavlovian valuation is restricted to an affective system that is only updated through experiential feedback of stimulus-outcome pairing, whereas the orbitofrontal cortex contributes to an alternative system capable of inferential reasoning. Finally we discuss the interactions and convergence of these systems and their implications for decision making and its pathology.