Severe stress switches CRF action in the nucleus accumbens from appetitive to aversive.

Stressors motivate an array of adaptive responses ranging from 'fight or flight' to an internal urgency signal facilitating long-term goals. However, traumatic or chronic uncontrollable stress promotes the onset of major depressive disorder, in which acute stressors lose their motivational properties and are perceived as insurmountable impediments. Consequently, stress-induced depression is a debilitating human condition characterized by an affective shift from engagement of the environment to withdrawal. An emerging neurobiological substrate of depression and associated pathology is the nucleus accumbens, a region with the capacity to mediate a diverse range of stress responses by interfacing limbic, cognitive and motor circuitry. Here we report that corticotropin-releasing factor (CRF), a neuropeptide released in response to acute stressors and other arousing environmental stimuli, acts in the nucleus accumbens of naive mice to increase dopamine release through coactivation of the receptors CRFR1 and CRFR2. Remarkably, severe-stress exposure completely abolished this effect without recovery for at least 90 days. This loss of CRF's capacity to regulate dopamine release in the nucleus accumbens is accompanied by a switch in the reaction to CRF from appetitive to aversive, indicating a diametric change in the emotional response to acute stressors. Thus, the current findings offer a biological substrate for the switch in affect which is central to stress-induced depressive disorders.

Dopamine-associated cached values are not sufficient as the basis for action selection.

Phasic dopamine transmission is posited to act as a critical teaching signal that updates the stored (or "cached") values assigned to reward-predictive stimuli and actions. It is widely hypothesized that these cached values determine the selection among multiple courses of action, a premise that has provided a foundation for contemporary theories of decision making. In the current work we used fast-scan cyclic voltammetry to probe dopamine-associated cached values from cue-evoked dopamine release in the nucleus accumbens of rats performing cost-benefit decision-making paradigms to evaluate critically the relationship between dopamine-associated cached values and preferences. By manipulating the amount of effort required to obtain rewards of different sizes, we were able to bias rats toward preferring an option yielding a high-value reward in some sessions and toward instead preferring an option yielding a low-value reward in others. Therefore, this approach permitted the investigation of dopamine-associated cached values in a context in which reward magnitude and subjective preference were dissociated. We observed greater cue-evoked mesolimbic dopamine release to options yielding the high-value reward even when rats preferred the option yielding the low-value reward. This result identifies a clear mismatch between the ordinal utility of the available options and the rank ordering of their cached values, thereby providing robust evidence that dopamine-associated cached values cannot be the sole determinant of choices in simple economic decision making.

Phasic dopamine release in the nucleus accumbens in response to pro-social 50 kHz ultrasonic vocalizations in rats.

Rats emit ultrasonic vocalizations (USVs) that are thought to serve as situation-dependent affective signals and accomplish important communicative functions. In appetitive situations, rats produce 50 kHz USVs, whereas 22 kHz USVs occur in aversive situations. Reception of 50 kHz USVs induces social approach behavior, while 22 kHz USVs lead to freezing behavior. These opposite behavioral responses are paralleled by distinct brain activation patterns, with 50 kHz USVs, but not 22 kHz USVs, activating neurons in the nucleus accumbens (NAcc). The NAcc mediates appetitive behavior and is critically modulated by dopaminergic afferents that are known to encode the value of reward. Therefore, we hypothesized that 50 kHz USVs, but not 22 kHz USVs, elicit NAcc dopamine release. While recording dopamine signaling with fast-scan cyclic voltammetry, freely moving rats were exposed to playback of four acoustic stimuli via an ultrasonic speaker in random order: (1) 50 kHz USVs, (2) 22 kHz USVs, (3) time- and amplitude-matched white noise, and (4) background noise. Only presentation of 50 kHz USVs induced phasic dopamine release and elicited approach behavior toward the speaker. Both of these effects, neurochemical and behavioral, were most pronounced during initial playback, but then declined rapidly with subsequent presentations, indicating a close temporal relationship between the two measures. Moreover, the magnitudes of these effects during initial playback were significantly correlated. Collectively, our findings show that NAcc dopamine release encodes pro-social 50 kHz USVs, but not alarming 22 kHz USVs. Thus, our results support the hypothesis that these call types are processed in distinct neuroanatomical regions and establish a functional link between pro-social communicative signals and reward-related neurotransmission.

Mesoaccumbal glutamate neurons drive reward via glutamate release but aversion via dopamine co-release.

Ventral tegmental area (VTA) projections to the nucleus accumbens (NAc) drive reward-related motivation. Although dopamine neurons are predominant, a substantial glutamatergic projection is also present, and a subset of these co-release both dopamine and glutamate. Optogenetic stimulation of VTA glutamate neurons not only supports self-stimulation but can also induce avoidance behavior, even in the same assay. Here, we parsed the selective contribution of glutamate or dopamine co-release from VTA glutamate neurons to reinforcement and avoidance. We expressed channelrhodopsin-2 (ChR2) in mouse VTA glutamate neurons in combination with CRISPR-Cas9 to disrupt either the gene encoding vesicular glutamate transporter 2 (VGLUT2) or tyrosine hydroxylase (Th). Selective disruption of VGLUT2 abolished optogenetic self-stimulation but left real-time place avoidance intact, whereas CRISPR-Cas9 deletion of Th preserved self-stimulation but abolished place avoidance. Our results demonstrate that glutamate release from VTA glutamate neurons is positively reinforcing but that dopamine release from VTA glutamate neurons can induce avoidance behavior.

Ventral pallidum GABA and glutamate neurons drive approach and avoidance through distinct modulation of VTA cell types.

The ventral pallidum (VP) contains GABA and glutamate neurons projecting to ventral tegmental area (VTA) whose stimulation drives approach and avoidance, respectively. Yet little is known about the mechanisms by which VP cell types shape VTA activity and drive behavior. Here, we found that both VP GABA and glutamate neurons were activated during approach to reward or by delivery of an aversive stimulus. Stimulation of VP GABA neurons inhibited VTA GABA, but activated dopamine and glutamate neurons. Remarkably, stimulation-evoked activation was behavior-contingent such that VTA recruitment was inhibited when evoked by the subject's own action. Conversely, VP glutamate neurons activated VTA GABA, as well as dopamine and glutamate neurons, despite driving aversion. However, VP glutamate neurons evoked dopamine in aversion-associated ventromedial nucleus accumbens (NAc), but reduced dopamine release in reward-associated dorsomedial NAc. These findings show how heterogeneous VP projections to VTA can be engaged to shape approach and avoidance behaviors.

Nigrostriatal dopamine signals sequence-specific action-outcome prediction errors.

Dopamine has been suggested to encode cue-reward prediction errors during Pavlovian conditioning, signaling discrepancies between actual versus expected reward predicted by the cues.1-5 While this theory has been widely applied to reinforcement learning concerning instrumental actions, whether dopamine represents action-outcome prediction errors and how it controls sequential behavior remain largely unknown. The vast majority of previous studies examining dopamine responses primarily have used discrete reward-predictive stimuli,1-15 whether Pavlovian conditioned stimuli for which no action is required to earn reward or explicit discriminative stimuli that essentially instruct an animal how and when to respond for reward. Here, by training mice to perform optogenetic intracranial self-stimulation, we examined how self-initiated goal-directed behavior influences nigrostriatal dopamine transmission during single and sequential instrumental actions, in behavioral contexts with minimal overt changes in the animal's external environment. We found that dopamine release evoked by direct optogenetic stimulation was dramatically reduced when delivered as the consequence of the animal's own action, relative to non-contingent passive stimulation. This dopamine suppression generalized to food rewards was specific to the reinforced action, was temporally restricted to counteract the expected outcome, and exhibited sequence-selectivity consistent with hierarchical control of sequential behavior. These findings demonstrate that nigrostriatal dopamine signals sequence-specific prediction errors in action-outcome associations, with fundamental implications for reinforcement learning and instrumental behavior in health and disease.

Neural Implementation of Behavioral Hierarchy.

A vast array of animal behavior-from locomotion to human speech-is thought to consist of different hierarchical levels, but its neural implementation remains poorly understood. In this issue of Neuron, Kaplan et al. (2020) identify neuronal circuit dynamics responsible for multiple levels and timescales of hierarchical locomotion control in Caenorhabditis elegans.

VTA Glutamate Neuron Activity Drives Positive Reinforcement Absent Dopamine Co-release.

Like ventral tegmental area (VTA) dopamine (DA) neurons, VTA glutamate neuron activity can support positive reinforcement. However, a subset of VTA neurons co-release DA and glutamate, and DA release might be responsible for behavioral reinforcement induced by VTA glutamate neuron activity. To test this, we used optogenetics to stimulate VTA glutamate neurons in which tyrosine hydroxylase (TH), and thus DA biosynthesis, was conditionally ablated using either floxed Th mice or viral-based CRISPR/Cas9. Both approaches led to loss of TH expression in VTA glutamate neurons and loss of DA release from their distal terminals in nucleus accumbens (NAc). Despite loss of the DA signal, optogenetic activation of VTA glutamate cell bodies or axon terminals in NAc was sufficient to support reinforcement. These results suggest that glutamate release from VTA is sufficient to promote reinforcement independent of concomitant DA co-release, establishing a non-DA mechanism by which VTA activity can support reward-seeking behaviors.

Genetic-Based Dissection Unveils the Inputs and Outputs of Striatal Patch and Matrix Compartments.

The striatum contains neurochemically defined compartments termed patches and matrix. Previous studies suggest patches preferentially receive limbic inputs and project to dopamine neurons in substantia nigra pars compacta (SNc), whereas matrix neurons receive sensorimotor inputs and do not innervate SNc. Using BAC-Cre transgenic mice with viral tracing techniques, we mapped brain-wide differences in the input-output organization of the patch/matrix. Findings reveal a displaced population of striatal patch neurons termed "exo-patch," which reside in matrix zones but have neurochemistry, connectivity, and electrophysiological characteristics resembling patch neurons. Contrary to previous studies, results show patch/exo-patch and matrix neurons receive both limbic and sensorimotor information. A novel inhibitory projection from bed nucleus of the stria terminalis to patch/exo-patch neurons was revealed. Projections to SNc were found to originate from patch/exo-patch and matrix neurons. These findings redefine patch/matrix beyond traditional neurochemical topography and reveal new principles about their input-output connectivity, providing a foundation for future functional studies.

Stress effects on the neural substrates of motivated behavior.

Exposure to stress has profound, but complex, actions on motivated behavior and decision-making. These effects are central to core symptoms of a number of psychiatric disorders that are precipitated or augmented by stress, such as depressive disorders and substance use disorders. Studying the neural substrates of stress's effects on motivation has revealed that stress affects multiple targets on circuits throughout the brain using diverse molecular signaling processes. Moreover, stress does not have unitary effects on motivated behavior, but differences in the intensity, duration, intermittency, controllability and nature of the stressor produce qualitatively and quantitatively different behavioral endpoints. Unsurprisingly, the results of neuroscientific investigations into stress and motivation often open more questions than they resolve. Here we discuss contemporary results pertaining to the neural mechanisms by which stress alters motivation, identify points of contention and highlight integrative areas for continuing research into these multifaceted complexities.

Pavlovian valuation systems in learning and decision making.

Environmental stimuli guide value-based decision making, but can do so through cognitive representation of outcomes or through general-incentive properties attributed to the cues themselves. We assert that these differences are conferred through the use of alternative associative structures differing in computational intensity. Using this framework, we review scientific evidence to discern the neural substrates of these assumed separable processes. We suggest that the contribution of the mesolimbic dopamine system to Pavlovian valuation is restricted to an affective system that is only updated through experiential feedback of stimulus-outcome pairing, whereas the orbitofrontal cortex contributes to an alternative system capable of inferential reasoning. Finally we discuss the interactions and convergence of these systems and their implications for decision making and its pathology.

Interdependent self-construal and neural representations of self and mother.

Representations of self are thought to be dynamically influenced by one's surroundings, including the culture one lives in. However, neuroimaging studies of self-representations have either ignored cultural influences or operationalized culture as country of origin. The present study used functional magnetic resonance imaging to examine the neural correlates of individual differences in interdependent self-construal. Participants rated whether trait adjectives applied to themselves or their mothers, or judged their valence or font. Findings indicated that individual differences in interdependent self-construal correlated positively with increased activation in the medial prefrontal cortex and posterior cingulated cortex when making judgments about one-self vs making judgments about one's mother. This suggests that those with greater interdependent self-construals may rely more upon episodic memory, reflected appraisals, or theory of mind to incorporate social information to make judgments about themselves.

Available alternative incentives modulate anticipatory nucleus accumbens activation.

A reward or punishment can seem better or worse depending on what else might have happened. Little is known, however, about how neural representations of an anticipated incentive might be influenced by the available alternatives. We used event-related FMRI to investigate the activation in the nucleus accumbens (NAcc), while we varied the available alternative incentives in a monetary incentive delay task. Some task blocks included only uncertain gains and losses; others included the same uncertain gains and losses intermixed with certain gains and losses. The availability of certain gains and losses increased NAcc activation for uncertain losses and decreased the difference between uncertain gains and losses. We suggest that this pattern of activation can result from reference point changes across blocks, and that the worst available loss may serve as an important anchor for NAcc activation. These findings imply that NAcc activation represents anticipated incentive value relative to the current context of available alternative gains and losses.

Individual differences in insular sensitivity during loss anticipation predict avoidance learning.

The anterior insula has been implicated in both the experience and the anticipation of negative outcomes. Although individual differences in insular sensitivity have been associated with self-report measures of chronic anxiety, previous research has not examined whether individual differences in insular sensitivity predict learning to avoid aversive stimuli. In the present study, insular sensitivity was assessed as participants anticipated monetary losses while undergoing functional magnetic resonance imaging. We found that insular responsiveness to anticipated losses predicted participants' ability to learn to avoid losses (but not to approach gains) in a behavioral test several months later. These findings suggest that in addition to correlating with self-reported anxiety, heightened insular sensitivity may promote learning to avoid loss.

Neural antecedents of the endowment effect.

The "endowment effect" refers to the tendency to place greater value on items that one owns-an anomaly that violates the reference-independence assumption of rational choice theories. We investigated neural antecedents of the endowment effect in an event-related functional magnetic resonance imaging (fMRI) study. During scanning, 24 subjects considered six products paired with 18 different prices under buying, choosing, or selling conditions. Subjects showed greater nucleus accumbens (NAcc) activation for preferred products across buy and sell conditions combined, but greater mesial prefrontal cortex (MPFC) activation in response to low prices when buying versus selling. During selling, right insular activation for preferred products predicted individual differences in susceptibility to the endowment effect. These findings are consistent with a reference-dependent account in which ownership increases value by enhancing the salience of the possible loss of preferred products.