Does phasic dopamine release cause policy updates?

Phasic dopamine activity is believed to both encode reward-prediction errors (RPEs) and to cause the adaptations that these errors engender. If so, a rat working for optogenetic stimulation of dopamine neurons will repeatedly update its policy and/or action values, thus iteratively increasing its work rate. Here, we challenge this view by demonstrating stable, non-maximal work rates in the face of repeated optogenetic stimulation of midbrain dopamine neurons. Furthermore, we show that rats learn to discriminate between world states distinguished only by their history of dopamine activation. Comparison of these results to reinforcement learning simulations suggests that the induced dopamine transients acted more as rewards than RPEs. However, pursuit of dopaminergic stimulation drifted upwards over a time scale of days and weeks, despite its stability within trials. To reconcile the results with prior findings, we consider multiple roles for dopamine signalling.

Early Adolescence is a Critical Period for the Maturation of Inhibitory Behavior.

Psychiatric conditions marked by impairments in cognitive control often emerge during adolescence, when the prefrontal cortex (PFC) and its inputs undergo structural and functional maturation and are vulnerable to disruption by external events. It is not known, however, whether there exists a specific temporal window within the broad range of adolescence when the development of PFC circuitry and its related behaviors are sensitive to disruption. Here we show, in male mice, that repeated exposure to amphetamine during early adolescence leads to impaired behavioral inhibition, aberrant PFC dopamine connectivity, and reduced PFC dopamine function in adulthood. Remarkably, these deficits are not observed following exposure to the exact same amphetamine regimen at later times. These findings demonstrate that there is a critical period for the disruption of the adolescent maturation of cognitive control and PFC dopamine function and suggest that early adolescence is particularly relevant to the emergence of psychopathology in humans.

Role of dopamine tone in the pursuit of brain stimulation reward.

Dopaminergic neurons contribute to intracranial self-stimulation (ICSS) and other reward-seeking behaviors, but it is not yet known where dopaminergic neurons intervene in the neural circuitry underlying reward pursuit or which psychological processes are involved. In rats working for electrical stimulation of the medial forebrain bundle, we assessed the effect of GBR-12909 (1-[2-[bis(4-fluorophenyl)-methoxy]ethyl]-4-[3- phenylpropyl]piperazine), a specific blocker of the dopamine transporter. Operant performance was measured as a function of the strength and cost of electrical stimulation. GBR-12909 increased the opportunity cost most subjects were willing to pay for a reward of a given intensity. However, this effect was smaller than that produced by a regimen of cocaine administration that drove similar increases in nucleus accumbens (NAc) dopamine levels in unstimulated rats. Delivery of rewarding stimulation to drug-treated rats caused an additional increase in dopamine concentration in the NAc shell in cocaine-treated, but not GBR-12909-treated, rats. These behavioral and neurochemical differences may reflect blockade of the norepinephrine transporter by cocaine but not by GBR-12909. Whereas the effect of psychomotor stimulants on ICSS has long been attributed to dopaminergic action at early stages of the reward pathway, the results reported here imply that increased dopamine tone boosts reward pursuit by acting at or beyond the output of the circuitry that temporally and spatially summates the output of the directly stimulated neurons underlying ICSS. The observed enhancement of reward seeking could be attributable to a decrease in the value of competing behaviors, a decrease in subjective effort costs, or an increase in reward-system gain.

Cannabinoid receptor blockade reduces the opportunity cost at which rats maintain operant performance for rewarding brain stimulation.

There is ample evidence that blockade of CB(1) receptors reduces reward seeking. However, the reported effects of CB(1) blockade on performance for rewarding electrical brain stimulation stand out as an exception. By applying a novel method for conceptualizing and measuring reward seeking, we show that AM-251, a CB(1) receptor antagonist, does indeed decrease performance for rewarding electrical stimulation of the medial forebrain bundle in rats. Reward seeking depends on multiple sets of variables, including the intensity of the reward, its cost, and the value of competing rewards. In turn, reward intensity depends both on the sensitivity and gain of brain reward circuitry. We show that drug-induced changes in sensitivity cannot account for the suppressive effect of AM-251 on reward seeking. Therefore, the role of CB(1) receptors must be sought among the remaining determinants of performance. Our analysis provides an explanation of the inconsistencies between prior reports, which likely arose from the following: (1) the averaging of data across subjects showing heterogeneous effects and (2) the use of methods that cannot distinguish between the different determinants of reward pursuit. By means of microdialysis, we demonstrate that blockade of CB(1) receptors attenuates nucleus accumbens dopamine release in response to rewarding medial forebrain bundle stimulation, and we propose that this action is responsible for the ability of the drug to decrease performance for the electrical reward.

Endogenous dopamine regulates the rhythm of expression of the clock protein PER2 in the rat dorsal striatum via daily activation of D2 dopamine receptors.

A role for dopamine (DA) in the regulation of clock genes in the mammalian brain is suggested by evidence that manipulations of DA receptors can alter the expression of some clock genes outside the suprachiasmatic nucleus (SCN), the master circadian clock. The role of endogenous DA in the regulation of clock gene expression is unknown. Here, we demonstrate a direct relationship between extracellular DA levels and the rhythm of expression of the clock protein PERIOD2 (PER2) in the dorsal striatum of the male Wistar rat. Specifically, we show that the peak of the daily rhythm of extracellular DA in the dorsal striatum precedes the peak of PER2 by ∼6 h and that depletion of striatal DA by 6-hydroxydopamine or α-methyl-para-tyrosine or blockade of D(2) DA receptors by raclopride blunts the rhythm of striatal PER2. Furthermore, timed daily activation of D(2) DA receptors, but not D(1) DA receptors, restores and entrains the PER2 rhythm in the DA-depleted striatum. None of these manipulations had any effect on the PER2 rhythm in the SCN. Our findings are consistent with the idea that the rhythm of expression of PER2 in the dorsal striatum depends on daily dopaminergic activation of D(2) DA receptors. These observations may have implications for circadian abnormalities seen in Parkinson's disease.

A limited role for the hippocampus in the modulation of novel-object preference by contextual cues.

Recent evidence suggests that rats require an intact hippocampus in order to recognize familiar objects when they encounter them again in a different context. The two experiments reported here further examined how changes in context affect rats' performance on the novel-object preference (NOP) test of object-recognition memory, and how those effects interact with the effects of HPC damage. Rats with HPC lesions and control rats received NOP testing in either the same context in which they had previously encountered sample objects, or in a different but equally familiar context. In Experiment 1, the two contexts had very few overlapping cues within or outside the apparatus; thus, the differences between them were global. Consistent with previous results, control rats showed a novel-object preference in both the unchanged and (globally) changed contexts, whereas rats with HPC lesions displayed a preference only in the unchanged context. In Experiment 2, the context shift included only local features proximal to the test objects. The main results were the reverse of Experiment 1--rats with HPC lesions displayed a novel-object preference in both the unchanged and (locally) changed contexts, whereas control rats displayed a preference only in the unchanged context. The findings are consistent with the view that HPC damage does not cause a general inability to recognize objects, nor an inability to encode or store a representation of the context in which the objects are encountered. They suggest instead that HPC damage impairs the ability to remember specific locations of familiar objects within a particular context.

17ß-estradiol locally increases phasic dopamine release in the dorsal striatum.

Studies using in vivo microdialysis have shown that 17ß-estradiol (E2) increases dopamine (DA) transmission in the dorsal striatum. Both systemic administration of E2 and local infusion into the dorsal striatum rapidly enhance amphetamine-induced DA release. However, it is not known to what degree these effects reflect tonic and/or phasic DA release. It was hypothesized that E2 acts directly within the DS to rapidly increase phasic DA transmission. In urethane-anesthetized (1.5mL/kg) female rats, we used fast-scan cyclic voltammetry to study the effects of E2 on phasic, electrically-evoked release of DA in the dorsal striatum. Rats were ovariectomized and implanted with a silastic tube containing 5% E2 in cholesterol, previously shown to mimic low physiological serum concentrations of∼20-25pg/mL. DA release was evoked every 1min by delivering biphasic electrical stimulation in the substantia nigra. Local infusions of E2 (244.8pg/µl) into the dorsal striatum increased the amplitude of the electrically evoked DA transients. Behaviorally significant stimuli and events trigger phasic release of DA. The present findings predict that E2 would boost such signaling in behaving subjects.

Ventral Midbrain NMDA Receptor Blockade: From Enhanced Reward and Dopamine Inactivation.

Glutamate stimulates ventral midbrain (VM) N-Methyl-D-Aspartate receptors (NMDAR) to initiate dopamine (DA) burst firing activity, a mode of discharge associated with enhanced DA release and reward. Blockade of VM NMDAR, however, enhances brain stimulation reward (BSR), the results can be explained by a reduction in the inhibitory drive on DA neurons that is also under the control of glutamate. In this study, we used fast-scan cyclic voltammetry (FSCV) in anesthetized animals to determine whether this enhancement is associated with a change in phasic DA release in the nucleus accumbens. Rats were implanted with a stimulation electrode in the dorsal-raphe (DR) and bilateral cannulae above the VM and trained to self-administer trains of electrical stimulation. The curve-shift method was used to evaluate the effect of a single dose (0.825 nmol/0.5 µl/side) of the NMDAR antagonist, (2R,4S)-4-(3-Phosphopropyl)-2-piperidinecarboxylic acid (PPPA), on reward. These animals were then anesthetized and DA release was measured during delivery of electrical stimulation before and after VM microinjection of the vehicle followed by PPPA. As expected, phasic DA release and operant responding depended similarly on the frequency of rewarding electrical stimulation. As anticipated, PPPA produced a significant reward enhancement. Unexpectedly, PPPA produced a decrease in the magnitude of DA transients at all tested frequencies. To test whether this decrease resulted from excessive activation of DA neurons, we injected apomorphine 20 min after PPPA microinjection. At a dose (100 µg s.c.) sufficient to reduce DA firing under control conditions, apomorphine restored electrical stimulation-induced DA transients. These findings show that combined electrical stimulation and VM NMDARs blockade induce DA inactivation, an effect that indirectly demonstrates that VM NMDARs blockade enhances reward by potentiating stimulation-induced excitation in the mesoaccumbens DA pathway.

Pregnancy and maternal behavior induce changes in glia, glutamate and its metabolism within the cingulate cortex.

An upregulation of the astrocytic proteins GFAP and bFGF within area 2 of the cingulate cortex (Cg2) occurs within 3 hours of parturition in rats. These changes are the result of an interaction between hormonal state and maternal experience and are associated with increased dendritic spine density in this area. Here, we examined whether this upregulation of astrocytic proteins generalized to other glial markers and, in particular those associated with glutamate metabolism. We chose glial markers commonly used to reflect different aspects of glial function: vimentin, like GFAP, is a marker of intermediate filaments; glutamine synthetase (GS), and S-100beta, are used as markers for mature astrocytes and GS has also been used as a specific marker for glutamatergic enzymatic activity. In addition, we examined levels of proteins associated with glutamine synthetase, glutamate, glutamine and two excitatory amino acid transporters found in astrocytes, glt-1 and glast. S100beta immunoreactivity did not vary with reproductive state in either Cg2 or MPOA suggesting no change in the number of mature astrocytes across these conditions. Vimentin-ir did not differ across groups in Cg2, but expression of this protein decreased from Day 1 postpartum onwards in the MPOA. By contrast, GS-ir was increased within 24 h postpartum in Cg2 but not MPOA and similarly to GFAP and bFGF this upregulation of GS resulted from an interaction between hormonal state and maternal experience. Within Cg2, upregulation of GS was not accompanied by changes in the astrocytic glutamatergic transporters, glt-1 and glast, however, an increase in both glutamate and glutamine proteins were observed within the Cg2 of postpartum animals. Together, these changes suggest postpartum upregulation of glutamatergic activity and metabolism within Cg2 that is stimulated by pregnancy hormones and maternal experience.