Rat behavior and dopamine release are modulated by conspecific distress.

Rats exhibit 'empathy' making them a model to understand the neural underpinnings of such behavior. We show data consistent with these findings, but also that behavior and dopamine (DA) release reflects subjective rather than objective evaluation of appetitive and aversive events that occur to another. We recorded DA release in two paradigms: one that involved cues predictive of unavoidable shock to the conspecific and another that allowed the rat to refrain from reward when there were harmful consequences to the conspecific. Behavior and DA reflected pro-social interactions in that DA suppression was reduced during cues that predicted shock in the presence of the conspecific and that DA release observed on self-avoidance trials was present when the conspecific was spared. However, DA also increased when the conspecific was shocked instead of the recording rat and DA release during conspecific avoidance trials was lower than when the rat avoided shock for itself.

Pathway- and Cell-Specific Kappa-Opioid Receptor Modulation of Excitation-Inhibition Balance Differentially Gates D1 and D2 Accumbens Neuron Activity.

Endogenous dynorphin signaling via the kappa-opioid receptor (KOR) in the nucleus accumbens (NAcc) powerfully mediates negative affective states and stress reactivity. Excitatory inputs from the hippocampus and amygdala play a fundamental role in shaping the activity of both NAcc D1 and D2 MSNs, which encode positive and negative motivational valences, respectively. However, a circuit-based mechanism by which KOR modulation of excitation-inhibition balance modifies D1 and D2 MSN activity is lacking. Here, we provide a comprehensive synaptic framework wherein presynaptic KOR inhibition decreases the excitatory drive of D1 MSN activity by the amygdala, but not the hippocampus. Conversely, presynaptic inhibition by KORs of inhibitory synapses on D2 MSNs enhances integration of excitatory drive by the amygdala and hippocampus. In conclusion, we describe a circuit-based mechanism showing differential gating of afferent control of D1 and D2 MSN activity by KORs in a pathway-specific manner.

Observation of reward delivery to a conspecific modulates dopamine release in ventral striatum.

Dopamine (DA) neurons increase and decrease firing for rewards that are better and worse than expected, respectively. These correlates have been observed at the level of single-unit firing and in measurements of phasic DA release in ventral striatum (VS). Here, we ask whether DA release is modulated by delivery of reward, not to oneself, but to a conspecific. It is unknown what, if anything, DA release encodes during social situations in which one animal witnesses another animal receive reward. It might be predicted that DA release will increase, suggesting that watching a conspecific receive reward is a favorable outcome. Conversely, DA release may be entirely dependent on personal experience, or perhaps observation of receipt of reward might be experienced as a negative outcome because another individual, rather than oneself, receives the reward. Our data show that animals display a mixture of affective states during observation of conspecific reward, first exhibiting increases in appetitive calls (50 kHz), then exhibiting increases in aversive calls (22 kHz). Like ultrasonic vocalizations (USVs), DA signals were modulated by delivery of reward to the conspecific. We show stronger DA release during observation of the conspecific receiving reward relative to observation of reward delivered to an empty box, but only on the first trial. During the following trials, this relationship reversed: DA release was reduced during observation of the conspecific receiving reward. These findings suggest that positive and negative states associated with conspecific reward delivery modulate DA signals related to learning in social situations.

Measuring working memory is all fun and games: a four-dimensional spatial game predicts cognitive task performance.

We developed a novel four-dimensional spatial task called Shapebuilder and used it to predict performance on a wide variety of cognitive tasks. In six experiments, we illustrate that Shapebuilder: (1) Loads on a common factor with complex working memory (WM) span tasks and that it predicts performance on quantitative reasoning tasks and Ravens Progressive Matrices (Experiment 1), (2) Correlates well with traditional complex WM span tasks (Experiment 2), predicts performance on the conditional go/no go task (Experiment 3) and N-back (Experiment 4), and showed weak or nonsignificant correlations with the Attention Networks Task (Experiment 5), and task switching (Experiment 6). Shapebuilder shows that it exhibits minimal skew and kurtosis, and shows good reliability. We argue that Shapebuilder has many advantages over existing measures of WM, including the fact that it is largely language independent, is not prone to ceiling effects, and take less than 6 min to complete on average.

Increased firing to cues that predict low-value reward in the medial orbitofrontal cortex.

Anatomical, imaging, and lesion work have suggested that medial and lateral aspects of orbitofrontal cortex (OFC) play different roles in reward-guided decision-making, yet few single-neuron recording studies have examined activity in more medial parts of the OFC (mOFC) making it difficult to fully assess its involvement in motivated behavior. Previously, we have shown that neurons in lateral parts of the OFC (lOFC) selectively fire for rewards of different values. In that study, we trained rats to respond to different fluid wells for rewards of different sizes or delivered at different delays. Rats preferred large over small reward, and rewards delivered after short compared with long delays. Here, we recorded from single neurons in rat rostral mOFC as they performed the same task. Similar to the lOFC, activity was attenuated for rewards that were delivered after long delays and was enhanced for delivery of larger rewards. However, unlike lOFC, odor-responsive neurons in the mOFC were more active when cues predicted low-value outcomes. These data suggest that odor-responsive mOFC neurons signal the association between environmental cues and unfavorable outcomes during decision making.

Ventral striatum lesions enhance stimulus and response encoding in dorsal striatum.

BACKGROUND: The development of addiction is thought to reflect a transition from goal-directed to stimulus-response driven behavior, functions attributed to ventral (VS) and dorsal striatum (DS), respectively. In line with this theory, neuroadaptations that occur during prolonged drug use progress from VS to DS. Here we ask if VS dysfunction alone, independent of drug use, can affect neural selectivity in DS. METHODS: To address this issue, we recorded from single neurons in DS while rats performed an odor-guided choice task for differently valued rewards in rats with and without unilateral VS lesions. In a separate group of animals, we used bilateral VS lesions to determine if VS was critical for performance on this task. RESULTS: We describe data showing that unilateral lesions of VS enhance neural representations in DS during performance of a task that is dependent on VS. Furthermore, we show that VS is critical for reward-guided decision-making initially, but that rats regain function after several days. CONCLUSIONS: These results suggest that loss of VS function, independent of chronic drug use, can trigger stronger encoding in DS in a reward-guided decision-making task and that the transition from VS to DS governed behavior observed in addiction might be due, in part, to initial loss of VS function.

Separate populations of neurons in ventral striatum encode value and motivation.

Neurons in the ventral striatum (VS) fire to cues that predict differently valued rewards. It is unclear whether this activity represents the value associated with the expected reward or the level of motivation induced by reward anticipation. To distinguish between the two, we trained rats on a task in which we varied value independently from motivation by manipulating the size of the reward expected on correct trials and the threat of punishment expected upon errors. We found that separate populations of neurons in VS encode expected value and motivation.

Response inhibition signals and miscoding of direction in dorsomedial striatum.

The ability to inhibit action is critical for everyday behavior and is affected by a variety of disorders. Behavioral control and response inhibition is thought to depend on a neural circuit that includes the dorsal striatum, yet the neural signals that lead to response inhibition and its failure are unclear. To address this issue, we recorded from neurons in rat dorsomedial striatum (mDS) in a novel task in which rats responded to a spatial cue that signaled that reward would be delivered either to the left or to the right. On 80% of trials rats were instructed to respond in the direction cued by the light (GO). On 20% of trials a second light illuminated instructing the rat to refrain from making the cued movement and move in the opposite direction (STOP). Many neurons in mDS encoded direction, firing more or less strongly for GO movements made ipsilateral or contralateral to the recording electrode. Neurons that fired more strongly for contralateral GO responses were more active when rats were faster, showed reduced activity on STOP trials, and miscoded direction on errors, suggesting that when these neurons were overly active, response inhibition failed. Neurons that decreased firing for contralateral movement were excited during trials in which the rat was required to stop the ipsilateral movement. For these neurons activity was reduced when errors were made and was negatively correlated with movement time suggesting that when these neurons were less active on STOP trials, response inhibition failed. Finally, the activity of a significant number of neurons represented a global inhibitory signal, firing more strongly during response inhibition regardless of response direction. Breakdown by cell type suggests that putative medium spiny neurons (MSNs) tended to fire more strongly under STOP trials, whereas putative interneurons exhibited both activity patterns.

Ventral striatum encodes past and predicted value independent of motor contingencies.

The ventral striatum (VS) is thought to signal the predicted value of expected outcomes. However, it is still unclear whether VS can encode value independently from variables often yoked to value such as response direction and latency. Expectations of high value reward are often associated with a particular action and faster latencies. To address this issue we trained rats to perform a task in which the size of the predicted reward was signaled before the instrumental response was instructed. Instrumental directional cues were presented briefly at a variable onset to reduce accuracy and increase reaction time. Rats were more accurate and slower when a large versus small reward was at stake. We found that activity in VS was high during odors that predicted large reward even though reaction times were slower under these conditions. In addition to these effects, we found that activity before the reward predicting cue reflected past and predicted reward. These results demonstrate that VS can encode value independent of motor contingencies and that the role of VS in goal-directed behavior is not just to increase vigor of specific actions when more is at stake.

Basolateral amygdala encodes upcoming errors but not response conflict.

Adaptive behavior depends on the detection of potential errors so that ongoing behavior might be corrected. Here, we ask whether basolateral amygdala (ABL) might serve this function by examining activity in rats performing a task in which errors were induced by pitting two behavioral responses against each other. This response competition or conflict was created by forcing rats to respond away from the direction in which they were freely choosing on the majority of trials. Rats were slower and less accurate on these incongruent trial types. We found that activity in ABL fired more strongly prior to errant responses, but did not signal the potential for errors on correctly performed incongruent trials. These data support a role for ABL in processing errors prior to their occurrence and suggest that ABL is not involved in monitoring conflict so that ongoing behavior might be corrected.

Attention for learning signals in anterior cingulate cortex.

Learning theory suggests that animals attend to pertinent environmental cues when reward contingencies unexpectedly change so that learning can occur. We have previously shown that activity in basolateral nucleus of amygdala (ABL) responds to unexpected changes in reward value, consistent with unsigned prediction error signals theorized by Pearce and Hall. However, changes in activity were present only at the time of unexpected reward delivery, not during the time when the animal needed to attend to conditioned stimuli that would come to predict the reward. This suggested that a different brain area must be signaling the need for attention necessary for learning. One likely candidate to fulfill this role is the anterior cingulate cortex (ACC). To test this hypothesis, we recorded from single neurons in ACC as rats performed the same behavioral task that we have used to dissociate signed from unsigned prediction errors in dopamine and ABL neurons. In this task, rats chose between two fluid wells that produced varying magnitudes of and delays to reward. Consistent with previous work, we found that ACC detected errors of commission and reward prediction errors. We also found that activity during cue sampling encoded reward size, but not expected delay to reward. Finally, activity in ACC was elevated during trials in which attention was increased following unexpected upshifts and downshifts in value. We conclude that ACC not only signals errors in reward prediction, as previously reported, but also signals the need for enhanced neural resources during learning on trials subsequent to those errors.