Valence ambiguity dynamically shapes striatal dopamine heterogeneity.

Adaptive decision making relies on dynamic updating of learned associations where environmental cues come to predict positive and negatively valenced stimuli, such as food or threat. Flexible cue-guided behaviors depend on a network of brain systems, including dopamine signaling in the striatum, which is critical for learning and maintenance of conditioned behaviors. Critically, it remains unclear how dopamine signaling encodes multi-valent, dynamic learning contexts, where positive and negative associations must be rapidly disambiguated. To understand this, we employed a Pavlovian discrimination paradigm, where cues predicting positive and negative outcomes were intermingled during conditioning sessions, and their meaning was serially reversed across training. We found that rats readily distinguished these cues, and updated their behavior rapidly upon valence reversal. Using fiber photometry, we recorded dopamine signaling in three major striatal subregions -,the dorsolateral striatum (DLS), the nucleus accumbens core, and the nucleus accumbens medial shell - and found heterogeneous responses to positive and negative conditioned cues and their predicted outcomes. Valence ambiguity introduced by cue reversal reshaped striatal dopamine on different timelines: nucleus accumbens core and shell signals updated more readily than those in the DLS. Together, these results suggest that striatal dopamine flexibly encodes multi-valent learning contexts, and these signals are dynamically modulated by changing contingencies to resolve ambiguity about the meaning of environmental cues.

Dopamine neurons drive spatiotemporally heterogeneous striatal dopamine signals during learning.

Environmental cues, through Pavlovian learning, become conditioned stimuli that invigorate and guide animals toward acquisition of rewards. Dopamine neurons in the ventral tegmental area (VTA) and substantia nigra (SNC) are crucial for this process. Dopamine neurons are embedded in a reciprocally connected network with their striatal targets, the functional organization of which remains poorly understood. Here, we investigated how learning during optogenetic Pavlovian cue conditioning of VTA or SNC dopamine neurons directs cue-evoked behavior and shapes subregion-specific striatal dopamine dynamics. We used a fluorescent dopamine biosensor to monitor dopamine in the nucleus accumbens (NAc) core and shell, dorsomedial striatum (DMS), and dorsolateral striatum (DLS). We demonstrate spatially heterogeneous, learning-dependent dopamine changes across striatal regions. While VTA stimulation evoked robust dopamine release in NAc core, shell, and DMS, cues predictive of this activation preferentially recruited dopamine release in NAc core, starting early in training, and DMS, late in training. Corresponding negative prediction error signals, reflecting a violation in the expectation of dopamine neuron activation, only emerged in the NAc core and DMS, and not the shell. Despite development of vigorous movement late in training, conditioned dopamine signals did not similarly emerge in the DLS, even during Pavlovian conditioning with SNC dopamine neuron activation, which elicited robust DLS dopamine release. Together, our studies show broad dissociation in the fundamental prediction and reward-related information generated by different dopamine neuron populations and signaled by dopamine across the striatum. Further, they offer new insight into how larger-scale plasticity across the striatal network emerges during Pavlovian learning to coordinate behavior.

Sensory Cues Potentiate VTA Dopamine Mediated Reinforcement.

Sensory cues are critical for shaping decisions and invigorating actions during reward seeking. Dopamine neurons in the ventral tegmental area (VTA) are central in this process, supporting associative learning in Pavlovian and instrumental settings. Studies of intracranial self-stimulation (ICSS) behavior, which show that animals will work hard to receive stimulation of dopamine neurons, support the notion that dopamine transmits a reward or value signal to support learning. Recent studies have begun to question this, however, emphasizing dopamine's value-free functions, leaving its contribution to behavioral reinforcement somewhat muddled. Here, we investigated the role of sensory stimuli in dopamine-mediated reinforcement, using an optogenetic ICSS paradigm in tyrosine hydroxylase (TH)-Cre rats. We find that while VTA dopamine neuron activation in the absence of explicit external cues is sufficient to maintain robust self-stimulation, the presence of cues dramatically potentiates ICSS behavior. Our results support a framework where dopamine can have some base value as a reinforcer, but the impact of this signal is modulated heavily by the sensory learning context.

Contexts facilitate dynamic value encoding in the mesolimbic dopamine system.

Adaptive behavior in a dynamic environment often requires rapid revaluation of stimuli that deviates from well-learned associations. The divergence between stable value-encoding and appropriate behavioral output remains a critical test to theories of dopamine's function in learning, motivation, and motor control. Yet how dopamine neurons are involved in the revaluation of cues when the world changes to alter our behavior remains unclear. Here we make use of pharmacology, in vivo electrophysiology, fiber photometry, and optogenetics to resolve the contributions of the mesolimbic dopamine system to the dynamic reorganization of reward-seeking. Male and female rats were trained to discriminate when a conditioned stimulus would be followed by sucrose reward by exploiting the prior, non-overlapping presentation of a separate discrete cue - an occasion setter. Only when the occasion setter's presentation preceded the conditioned stimulus did the conditioned stimulus predict sucrose delivery. As a result, in this task we were able to dissociate the average value of the conditioned stimulus from its immediate expected value on a trial-to-trial basis. Both the activity of ventral tegmental area dopamine neurons and dopamine signaling in the nucleus accumbens were essential for rats to successfully update behavioral responding in response to the occasion setter. Moreover, dopamine release in the nucleus accumbens following the conditioned stimulus only occurred when the occasion setter indicated it would predict reward. Downstream of dopamine release, we found that single neurons in the nucleus accumbens dynamically tracked the value of the conditioned stimulus. Together these results reveal a novel mechanism within the mesolimbic dopamine system for the rapid revaluation of motivation.

Sensory cues potentiate VTA dopamine mediated reinforcement.

Sensory cues are critical for shaping decisions and invigorating actions during reward seeking. Dopamine neurons in the ventral tegmental area (VTA) are critical in this process, supporting associative learning in Pavlovian and instrumental settings. Studies of intracranial self stimulation (ICSS) behavior, which show that animals will work hard to receive stimulation of dopamine neurons, support the notion that dopamine transmits a reward or value signal to support learning. Recent studies have begun to question this, however, emphasizing dopamine's value-free functions, leaving its contribution to behavioral reinforcement somewhat muddled. Here, we investigated the role of sensory stimuli in dopamine-mediated reinforcement, using an optogenetic ICSS paradigm in tyrosine hydroxylase (TH)-cre rats. We find that while VTA dopamine neuron activation in the absence of any external cueing stimulus is sufficient to maintain robust self stimulation, the presence of cues dramatically potentiates ICSS behavior. Our results support a framework where dopamine can have some base value as a reinforcer, but the impact of this signal is modulated heavily by the sensory learning context.

Disrupted hippocampal synchrony following maternal immune activation in a rat model.

Maternal immune activation (MIA) is a risk factor for schizophrenia and other neurodevelopmental disorders. MIA in rats models a number of the brain and behavioral changes that are observed in schizophrenia, including impaired memory. Recent studies in the MIA model have shown that the firing of the hippocampal place cells that are involved in memory processes appear relatively normal, but with abnormalities in the temporal ordering of firing. In this study, we re-analyzed data from prior hippocampal electrophysiological recordings of MIA and control animals to determine whether temporal dysfunction was evident. We find that there is a decreased ratio of slow to fast gamma power, resulting from an increase in fast gamma power and a tendency toward reduced slow gamma power in MIA rats. Moreover, we observe a robust reduction in spectral coherence between hippocampal theta and both fast and slow gamma rhythms, as well as changes in the phase of theta at which fast gamma occurs. We also find the phasic organization of place cell phase precession on the theta wave to be abnormal in MIA rats. Lastly, we observe that the local field potential of MIA rats contains more frequent sharp-wave ripple events, and that place cells were more likely to fire spikes during ripples in these animals than control. These findings provide further evidence of desynchrony in MIA animals and may point to circuit-level changes that underlie failures to integrate and encode information in schizophrenia.

Hierarchical cue control of cocaine seeking in the face of cost.

RATIONALE: Addiction is characterized by intermittent drug seeking despite rising costs. This behavior is heavily influenced by environmental stimuli that signal drug availability and reinforce drug seeking. OBJECTIVE: To establish the relationship between three key aspects of human drug use in rats: the intermittent, binge nature of drug intake, the motivational conflict of drug seeking in the face of escalating negative costs, and the ability of different drug cues to interact to modulate relapse. METHODS: Male and female rats were trained to self-administer cocaine on an intermittent access schedule, where brief drug-availability states were signaled by a shift in the ambient lighting of the environment, and cocaine infusions were signaled by a separate proximal discrete cue. Rats then went through a conflict procedure, where foot shock intensity associated with cocaine seeking was escalated until intake was suppressed. We then completed relapse tests where the drug-delivery cue was noncontingently presented alone, or in the context of dynamic drug-availability state transitions. RESULTS: Intermittent access spurred psychomotor sensitization and binge-like cocaine intake. The intensity of binge-like drug taking during training was predictive of later drug seeking despite escalating costs during conflict. In relapse tests, the ability of a proximal discrete drug cue to trigger relapse was gated by the presence of a global cue signaling drug-availability state transitions. CONCLUSIONS: Our results suggest that the pattern of drug intake plays a role in many features of addiction, including modifying an individual's willingness to endure high costs associated with drug seeking. Furthermore, our studies indicate that drug-related sensory information can be hierarchically organized to exert a dynamic modulating influence on drug-seeking motivation.

Hippocampal Hyperactivity as a Druggable Circuit-Level Origin of Aberrant Salience in Schizophrenia.

The development of current neuroleptics was largely aiming to decrease excessive dopaminergic signaling in the striatum. However, the notion that abnormal dopamine creates psychotic symptoms by causing an aberrant assignment of salience that drives maladaptive learning chronically during disease development suggests a therapeutic value of early interventions that correct salience-related neural processing. The mesolimbic dopaminergic output is modulated by several interconnected brain-wide circuits centrally involving the hippocampus and key relays like the ventral and associative striatum, ventral pallidum, amygdala, bed nucleus of the stria terminalis, nucleus reuniens, lateral and medial septum, prefrontal and cingulate cortex, among others. Unraveling the causal relationships between these circuits using modern neuroscience techniques holds promise for identifying novel cellular-and ultimately molecular-treatment targets for reducing transition to psychosis and symptoms of schizophrenia. Imaging studies in humans have implicated a hyperactivity of the hippocampus as a robust and early endophenotype in schizophrenia. Experiments in rodents, in turn, suggested that the activity of its output region-the ventral subiculum-may modulate dopamine release from ventral tegmental area (VTA) neurons in the ventral striatum. Even though these observations suggested a novel circuit-level target for anti-psychotic action, no therapy has yet been developed along this rationale. Recently evaluated treatment strategies-at least in part-target excess glutamatergic activity, e.g. N-acetyl-cysteine (NAC), levetiracetam, and mGluR2/3 modulators. We here review the evidence for the central implication of the hippocampus-VTA axis in schizophrenia-related pathology, discuss its symptom-related implications with a particular focus on aberrant assignment of salience, and evaluate some of its short-comings and prospects for drug discovery.

Ring of Power: A Band of Peptidergic Midbrain Neurons that Binds Motivation.

A recent Cell paper identifies a novel population of neurons within the ventral tegmental area producing the endogenous opioid nociceptin that regulates dopamine neuron firing and acts uniquely to gate motivation in reward seeking. These results highlight neuropeptidergic signaling as a critical component of functional heterogeneity in the midbrain.

Hippocampal-prefrontal coherence mediates working memory and selective attention at distinct frequency bands and provides a causal link between schizophrenia and its risk gene GRIA1.

Increased fronto-temporal theta coherence and failure of its stimulus-specific modulation have been reported in schizophrenia, but the psychological correlates and underlying neural mechanisms remain elusive. Mice lacking the putative schizophrenia risk gene GRIA1 (Gria1-/-), which encodes GLUA1, show strongly impaired spatial working memory and elevated selective attention owing to a deficit in stimulus-specific short-term habituation. A failure of short-term habituation has been suggested to cause an aberrant assignment of salience and thereby psychosis in schizophrenia. We recorded hippocampal-prefrontal coherence while assessing spatial working memory and short-term habituation in these animals, wildtype (WT) controls, and Gria1-/- mice in which GLUA1 expression was restored in hippocampal subfields CA2 and CA3. We found that beta (20-30 Hz) and low-gamma (30-48 Hz) frequency coherence could predict working memory performance, whereas-surprisingly-theta (6-12 Hz) coherence was unrelated to performance and largely unaffected by genotype in this task. In contrast, in novel environments, theta coherence specifically tracked exploration-related attention in WT mice, but was strongly elevated and unmodulated in Gria1-knockouts, thereby correlating with impaired short-term habituation. Strikingly, reintroduction of GLUA1 selectively into CA2/CA3 restored abnormal short-term habituation, theta coherence, and hippocampal and prefrontal theta oscillations. Although local oscillations and coherence in other frequency bands (beta, gamma), and theta-gamma cross-frequency coupling also showed dependence on GLUA1, none of them correlated with short-term habituation. Therefore, sustained elevation of hippocampal-prefrontal theta coherence may underlie a failure in regulating novelty-related selective attention leading to aberrant salience, and thereby represents a mechanistic link between GRIA1 and schizophrenia.

Optogenetic induction of the schizophrenia-related endophenotype of ventral hippocampal hyperactivity causes rodent correlates of positive and cognitive symptoms.

Pathological over-activity of the CA1 subfield of the human anterior hippocampus has been identified as a potential predictive marker for transition from a prodromal state to overt schizophrenia. Psychosis, in turn, is associated with elevated activity in the anterior subiculum, the hippocampal output stage directly activated by CA1. Over-activity in these subfields may represent a useful endophenotype to guide translationally predictive preclinical models. To recreate this endophenotype and study its causal relation to deficits in the positive and cognitive symptom domains, we optogenetically activated excitatory neurons of the ventral hippocampus (vHPC; analogous to the human anterior hippocampus), targeting the ventral subiculum. Consistent with previous studies, we found that vHPC over-activity evokes hyperlocomotion, a rodent correlate of positive symptoms. vHPC activation also impaired performance on the spatial novelty preference (SNP) test of short-term memory, regardless of whether stimulation was applied during the encoding or retrieval stage of the task. Increasing dopamine transmission with amphetamine produced hyperlocomotion, but was not associated with SNP impairments. This suggests that short-term memory impairments resulting from hippocampal over-activity likely arise independently of a hyperdopaminergic state, a finding that is consistent with the pharmaco-resistance of cognitive symptoms in patients.

Layer-specific optogenetic activation of pyramidal neurons causes beta-gamma entrainment of neonatal networks.

Coordinated activity patterns in the developing brain may contribute to the wiring of neuronal circuits underlying future behavioural requirements. However, causal evidence for this hypothesis has been difficult to obtain owing to the absence of tools for selective manipulation of oscillations during early development. We established a protocol that combines optogenetics with electrophysiological recordings from neonatal mice in vivo to elucidate the substrate of early network oscillations in the prefrontal cortex. We show that light-induced activation of layer II/III pyramidal neurons that are transfected by in utero electroporation with a high-efficiency channelrhodopsin drives frequency-specific spiking and boosts network oscillations within beta-gamma frequency range. By contrast, activation of layer V/VI pyramidal neurons causes nonspecific network activation. Thus, entrainment of neonatal prefrontal networks in fast rhythms relies on the activation of layer II/III pyramidal neurons. This approach used here may be useful for further interrogation of developing circuits, and their behavioural readout.

Evaluation of a Novel Approach for Reducing Emissions of Pharmaceuticals to the Environment.

Increased interest over the levels of pharmaceuticals detected in the environment has led to the need for new approaches to manage their emissions. Inappropriate disposal of unused and waste medicines and release from manufacturing plants are believed to be important pathways for pharmaceuticals entering the environment. In situ treatment technologies, which can be used on-site in pharmacies, hospitals, clinics, and at manufacturing plants, might provide a solution. In this study we explored the use of Pyropure, a microscale combined pyrolysis and gasification in situ treatment system for destroying pharmaceutical wastes. This involved selecting 17 pharmaceuticals, including 14 of the most thermally stable compounds currently in use and three of high environmental concern to determine the technology's success in waste destruction. Treatment simulation studies were done on three different waste types and liquid, solid, and gaseous emissions from the process were analyzed for parent pharmaceutical and known active transformation products. Gaseous emissions were also analyzed for NOx, particulates, dioxins, furans, and metals. Results suggest that Pyropure is an effective treatment process for pharmaceutical wastes: over 99 % of each study pharmaceutical was destroyed by the system without known active transformation products being formed during the treatment process. Emissions of the other gaseous air pollutants were within acceptable levels. Future uptake of the system, or similar in situ treatment approaches, by clinics, pharmacists, and manufacturers could help to reduce the levels of pharmaceuticals in the environment and reduce the economic and environmental costs of current waste management practices.

Prenatal immune activation alters hippocampal place cell firing characteristics in adult animals.

Prenatal maternal immune activation (MIA) is a risk factor for several developmental neuropsychiatric disorders, including autism, bipolar disorder and schizophrenia. Adults with these disorders display alterations in memory function that may result from changes in the structure and function of the hippocampus. In the present study we use an animal model to investigate the effect that a transient prenatal maternal immune activation episode has on the spatially-modulated firing activity of hippocampal neurons in adult animals. MIA was induced in pregnant rat dams with a single injection of the synthetic cytokine inducer polyinosinic:polycytidylic acid (poly I:C) on gestational day 15. Control dams were given a saline equivalent. Firing activity and local field potentials (LFPs) were recorded from the CA1 region of the adult male offspring of these dams as they moved freely in an open arena. Most neurons displayed characteristic spatially-modulated 'place cell' firing activity and while there was no between-group difference in mean firing rate between groups, place cells had smaller place fields in MIA-exposed animals when compared to control-group cells. Cells recorded in MIA-group animals also displayed an altered firing-phase synchrony relationship to simultaneously recorded LFPs. When the floor of the arena was rotated, the place fields of MIA-group cells were more likely to shift in the same direction as the floor rotation, suggesting that local cues may have been more salient for these animals. In contrast, place fields in control group cells were more likely to shift firing position to novel spatial locations suggesting an altered response to contextual cues. These findings show that a single MIA intervention is sufficient to change several important characteristics of hippocampal place cell activity in adult offspring. These changes could contribute to the memory dysfunction that is associated with MIA, by altering the encoding of spatial context and by disrupting plasticity mechanisms that are dependent on spike timing synchrony.

Enhanced hippocampal neuronal excitability and LTP persistence associated with reduced behavioral flexibility in the maternal immune activation model of schizophrenia.

Individuals with schizophrenia display a number of structural and cytoarchitectural alterations in the hippocampus, suggesting that other functions such as synaptic plasticity may also be modified. Altered hippocampal plasticity is likely to affect memory processing, and therefore any such pathology may contribute to the cognitive symptoms of schizophrenia, which includes prominent memory impairment. The current study tested whether prenatal exposure to infection, an environmental risk factor that has previously been associated with schizophrenia produced changes in hippocampal synaptic transmission or plasticity, using the maternal immune activation (MIA) animal model. We also assessed performance in hippocampus-dependent memory tasks to determine whether altered plasticity is associated with memory dysfunction. MIA did not alter basal synaptic transmission in either the dentate gyrus or CA1 of freely moving adult rats. It did, however, result in increased paired-pulse facilitation of the dentate gyrus population spike and an enhanced persistence of dentate long-term potentiation. MIA animals displayed slower learning of a reversed platform location in the water maze, and a similarly slowed learning during reversal in a spatial plus maze task. Together these findings are indicative of reduced behavioral flexibility in response to changes in task requirements. The results are consistent with the hypothesis that hippocampal plasticity is altered in schizophrenia, and that this change in plasticity mechanisms may underlie some aspects of cognitive dysfunction in this disorder.

Altered arginine metabolism in the hippocampus and prefrontal cortex of maternal immune activation rat offspring.

Altered arginine metabolism has been implicated in the pathogenesis of schizophrenia. The present study measured the levels of L-arginine and its downstream metabolites in the sub-regions of the hippocampus, prefrontal cortex and cerebellum in adult rats that had been exposed to maternal immune activation (MIA; a risk factor for schizophrenia). MIA significantly increased L-arginine, L-ornithine and putrescine levels and decreased agmatine levels in the hippocampus and prefrontal cortex in a region-specific manner. Correlational analysis revealed a significant neurochemical-behavioural correlation. Cluster analyses showed that L-arginine and its main metabolites formed distinct groups, which changed as a function of MIA. These results demonstrate, for the first time, that MIA leads to altered arginine metabolism in the hippocampus and prefrontal cortex of the adult offspring.

Behavioural deficits associated with maternal immune activation in the rat model of schizophrenia.

Schizophrenia is associated with changes in memory and contextual processing. As maternal infection is a risk factor in schizophrenia we tested for these impairments in a maternal immune activation (MIA) animal model. MIA rats displayed impaired object recognition memory, despite intact object discrimination, and a reduced reinstatement of rearing in response to a contextual manipulation. These results link MIA to contextual impairments in schizophrenia, possibly through changes in hippocampal function.

Abnormal long-range neural synchrony in a maternal immune activation animal model of schizophrenia.

The synchrony of neural firing is believed to underlie the integration of information between and within neural networks in the brain. Abnormal synchronization of neural activity between distal brain regions has been proposed to underlie the core symptomatology in schizophrenia. This study investigated whether abnormal synchronization occurs between the medial prefrontal cortex (mPFC) and the hippocampus (HPC), two brain regions implicated in schizophrenia pathophysiology, using the maternal immune activation (MIA) animal model in rats. This neurodevelopmental model of schizophrenia is induced through a single injection of the synthetic immune system activator polyriboinosinic-polyribocytidylic acid, a synthetic analog of double-stranded RNA, a molecular pattern associated with viral infection, in pregnant rat dams. It is based on epidemiological evidence of increased risk of schizophrenia in adulthood after prenatal exposure to infection. In the present study, EEG coherence and neuronal phase-locking to underlying EEG were measured in freely moving MIA and control offspring. The MIA intervention produced significant reductions in mPFC-HPC EEG coherence that correlated with decreased prepulse inhibition of startle, a measure of sensory gating and a hallmark schizotypal behavioral measure. Furthermore, changes in the synchronization of neuronal firing to the underlying EEG were evident in the theta and low-gamma frequencies. Firing within a putative population of theta-modulated, gamma-entrained mPFC neurons was also reduced in MIA animals. Thus, MIA in rats produces a fundamental disruption in long-range neuronal synchrony in the brains of the adult offspring that models the disruption of synchrony observed in schizophrenia.

The maternal immune activation (MIA) model of schizophrenia produces pre-pulse inhibition (PPI) deficits in both juvenile and adult rats but these effects are not associated with maternal weight loss.

The developmental onset of deficits in sensorimotor-gating was examined in the maternal immune activation (MIA) animal model of schizophrenia. Pre-pulse inhibition (PPI) deficits were evident in juvenile MIA rats. This parallels the sensorimotor-gating deficits observed in groups at high-risk of schizophrenia. PPI deficits were independent of maternal weight loss following the MIA manipulation, suggesting that this measure may not be a useful marker of treatment efficacy.

Immune activation during mid-gestation disrupts sensorimotor gating in rat offspring.

Maternal immune activation (MIA) is a newly developed animal model of schizophrenia. It has recently been reported that when MIA is induced with the cytokine inducer polyinosinic-polycytidilic acid (poly I:C) rats do not show deficits in prepulse inhibition (PPI), a test that is often considered a validity benchmark. The aim of the current experiment was to determine whether doses of poly I:C that have previously been shown to induce the behavioural features of schizophrenia can disrupt PPI in rats. Pregnant rat dams were given a single injection of poly I:C (4.0 mg/kg) or a saline injection equivalent on gestational day 15. Acoustic startle reactivity, habituation of the startle response and PPI were assessed in juvenile (34-35 day) and adult (>56 day) offspring. Prenatal immune activation did not alter startle reactivity on startle-only or prepulse-only trials. Furthermore, there was no effect of MIA on habituation of the startle response. MIA does however disrupt PPI, as PPI was reduced significantly in adult MIA offspring, and a trend was observed in the juvenile animals. Our finding that prenatal poly I:C can disrupt PPI in MIA rats further validates this procedure as an animal model.