A microbiome-dependent gut-brain pathway regulates motivation for exercise.

Exercise exerts a wide range of beneficial effects for healthy physiology1. However, the mechanisms regulating an individual's motivation to engage in physical activity remain incompletely understood. An important factor stimulating the engagement in both competitive and recreational exercise is the motivating pleasure derived from prolonged physical activity, which is triggered by exercise-induced neurochemical changes in the brain. Here, we report on the discovery of a gut-brain connection in mice that enhances exercise performance by augmenting dopamine signalling during physical activity. We find that microbiome-dependent production of endocannabinoid metabolites in the gut stimulates the activity of TRPV1-expressing sensory neurons and thereby elevates dopamine levels in the ventral striatum during exercise. Stimulation of this pathway improves running performance, whereas microbiome depletion, peripheral endocannabinoid receptor inhibition, ablation of spinal afferent neurons or dopamine blockade abrogate exercise capacity. These findings indicate that the rewarding properties of exercise are influenced by gut-derived interoceptive circuits and provide a microbiome-dependent explanation for interindividual variability in exercise performance. Our study also suggests that interoceptomimetic molecules that stimulate the transmission of gut-derived signals to the brain may enhance the motivation for exercise.

Behavioral encoding across timescales by region-specific dopamine dynamics.

The dorsal (DS) and ventral striatum (VS) receive dopaminergic projections that control motor functions and reward-related behavior. It remains poorly understood how dopamine release dynamics across different temporal scales in these regions are coupled to behavioral outcomes. Here, we employ the dopamine sensor dLight1.3b together with multiregion fiber photometry and machine learning-based analysis to decode dopamine dynamics across the striatum during self-paced exploratory behavior in mice. Our data show a striking coordination of rapidly fluctuating signal in the DS, carrying information across dopamine levels, with a slower signal in the VS, consisting mainly of slow-paced transients. Importantly, these release dynamics correlated with discrete behavioral motifs, such as turns, running, and grooming on a subsecond-to-minute time scale. Disruption of dopamine dynamics with cocaine caused randomization of action selection sequencing and disturbance of DS-VS coordination. The data suggest that distinct dopamine dynamics of DS and VS jointly encode behavioral sequences during unconstrained activity with DS modulating the stringing together of actions and VS the signal to initiate and sustain the selected action.

Motor System-Dependent Effects of Amygdala and Ventral Striatum Lesions on Explore-Exploit Behaviors.

Deciding whether to forego immediate rewards or explore new opportunities is a key component of flexible behavior and is critical for the survival of the species. Although previous studies have shown that different cortical and subcortical areas, including the amygdala and ventral striatum (VS), are implicated in representing the immediate (exploitative) and future (explorative) value of choices, the effect of the motor system used to make choices has not been examined. Here, we tested male rhesus macaques with amygdala or VS lesions on two versions of a three-arm bandit task where choices were registered with either a saccade or an arm movement. In both tasks we presented the monkeys with explore-exploit tradeoffs by periodically replacing familiar options with novel options that had unknown reward probabilities. We found that monkeys explored more with saccades but showed better learning with arm movements. VS lesions caused the monkeys to be more explorative with arm movements and less explorative with saccades, although this may have been due to an overall decrease in performance. VS lesions affected the monkeys' ability to learn novel stimulus-reward associations in both tasks, while after amygdala lesions this effect was stronger when choices were made with saccades. Further, on average, VS and amygdala lesions reduced the monkeys' ability to choose better options only when choices were made with a saccade. These results show that learning reward value associations to manage explore-exploit behaviors is motor system dependent and they further define the contributions of amygdala and VS to reinforcement learning.

Accentuated Paralimbic and Reduced Mesolimbic D2/3-Impulsivity Associations in Parkinson's Disease.

Impulsivity is a behavioral trait that is elevated in many neuropsychiatric disorders. Parkinson's disease (PD) patients can exhibit a specific pattern of reward-seeking impulsive-compulsive behaviors (ICBs), as well as more subtle changes to generalized trait impulsivity. Prior studies in healthy controls (HCs) suggest that trait impulsivity is regulated by D2/3 autoreceptors in mesocorticolimbic circuits. While altered D2/3 binding is noted in ICB+ PD patients, there is limited prior assessment of the trait impulsivity-D2/3 relationship in PD, and no prior direct comparison with patterns in HCs. We examined 54 PD (36 M; 18 F) and 31 sex- and age-matched HC (21 M; 10 F) subjects using [18F]fallypride, a high-affinity D2/3 receptor ligand, to measure striatal and extrastriatal D2/3 nondisplaceable binding potential (BPND). Subcortical and cortical assessment exclusively used ROI or exploratory-voxelwise methods, respectively. All completed the Barratt Impulsiveness Scale, a measure of trait impulsivity. Subcortical ROI analyses indicated a negative relationship between trait impulsivity and D2/3 BPND in the ventral striatum and amygdala of HCs but not in PD. By contrast, voxelwise methods demonstrated a positive trait impulsivity-D2/3 BPND correlation in ventral frontal olfactocentric-paralimbic cortex of subjects with PD but not HCs. Subscale analysis also highlighted different aspects of impulsivity, with significant interactions between group and motor impulsivity in the ventral striatum, and attentional impulsivity in the amygdala and frontal paralimbic cortex. These results suggest that dopamine functioning in distinct regions of the mesocorticolimbic circuit influence aspects of impulsivity, with the relative importance of regional dopamine functions shifting in the neuropharmacological context of PD.SIGNIFICANCE STATEMENT The biological determinants of impulsivity have broad clinical relevance, from addiction to neurodegenerative disorders. Here, we address biomolecular distinctions in Parkinson's disease. This is the first study to evaluate a large cohort of Parkinson's disease patients and age-matched healthy controls with a measure of trait impulsivity and concurrent [18F]fallypride PET, a method that allows quantification of D2/3 receptors throughout the mesocorticolimbic network. We demonstrate widespread differences in the trait impulsivity-dopamine relationship, including (1) loss of subcortical relationships present in the healthy brain and (2) emergence of a new relationship in a limbic cortical area. This illustrates the loss of mechanisms of behavioral regulation present in the healthy brain while suggesting a potential compensatory response and target for future investigation.

Common neural dysfunction of economic decision-making across psychiatric conditions.

Adaptive decision-making, which is often impaired in various psychiatric conditions, is essential for well-being. Recent evidence has indicated that decision-making capacity in multiple tasks could be accounted for by latent dimensions, enlightening the question of whether there is a common disruption of brain networks in economic decision-making across psychiatric conditions. Here, we addressed the issue by combining activation/lesion network mapping analyses with a transdiagnostic brain imaging meta-analysis. Our findings indicate that there were transdiagnostic alterations in the thalamus and ventral striatum during the decision or outcome stage of decision-making. The identified regions represent key nodes in a large-scale network, which is composed of multiple heterogeneous brain regions and plays a causal role in motivational functioning. The findings suggest that disturbances in the network associated with emotion- and reward-related processing play a key role in dysfunctions of decision-making observed in various psychiatric conditions. This study provides the first meta-analytic evidence of common neural alterations linked to deficits in economic decision-making.

In vivo structural connectivity of the reward system along the hippocampal long axis.

Recent work has identified a critical role for the hippocampus in reward-sensitive behaviors, including motivated memory, reinforcement learning, and decision-making. Animal histology and human functional neuroimaging have shown that brain regions involved in reward processing and motivation are more interconnected with the ventral/anterior hippocampus. However, direct evidence examining gradients of structural connectivity between reward regions and the hippocampus in humans is lacking. The present study used diffusion MRI (dMRI) and probabilistic tractography to quantify the structural connectivity of the hippocampus with key reward processing regions in vivo. Using a large sample of subjects (N = 628) from the human connectome dMRI data release, we found that connectivity profiles with the hippocampus varied widely between different regions of the reward circuit. While the dopaminergic midbrain (ventral tegmental area) showed stronger connectivity with the anterior versus posterior hippocampus, the ventromedial prefrontal cortex showed stronger connectivity with the posterior hippocampus. The limbic (ventral) striatum demonstrated a more homogeneous connectivity profile along the hippocampal long axis. This is the first study to generate a probabilistic atlas of the hippocampal structural connectivity with reward-related networks, which is essential to investigating how these circuits contribute to normative adaptive behavior and maladaptive behaviors in psychiatric illness. These findings describe nuanced structural connectivity that sets the foundation to better understand how the hippocampus influences reward-guided behavior in humans.

Differential patterns of basal and naloxone-evoked dopamine efflux in the rat dorsal and ventral striatum following prolonged-intermittent exposure to morphine.

Hypodopaminergia in the ventral striatum is a putative neurobiological correlate of withdrawal in opioid-dependent individuals. This perspective stands in contrast to brain imaging studies with chronic opioid users showing that naloxone-enhanced dopamine (DA) release in the dorsal striatum is positively correlated with withdrawal aversion. Here, we examined regional differences in striatal DA function associated with opioid withdrawal in rats exposed to intermittent morphine injections for 31 days. Basal concentrations of DA were reduced (i.e., indicating a hypodopaminergic state) in the ventral striatum on Day 10 of morphine exposure, whereas a more prolonged period of morphine treatment was required to reveal hypodopaminergia in the dorsal striatum on Day 31. The ventral striatum consistently exhibited naloxone-induced transient reductions in DA below the hypodopaminergic basal levels, whereas morphine enhanced DA efflux. In the dorsal striatum, DA responsivity to naloxone shifted from a significant decrease on Day 10 to a notable increase above hypodopaminergic basal levels on Day 31, corroborating the findings in the human dorsal striatum. Unexpectedly, the magnitude of morphine-evoked increases in DA efflux on Day 31 was significantly blunted relative to values on Day 10. These findings indicate that prolonged-intermittent access to morphine results in a sustained hypodopaminergic state as reflected in basal levels in the striatum, which is accompanied by regional differences in DA responsivity to naloxone and morphine. Overall, our findings suggest that prolonging the duration of morphine exposure to 31 days is sufficient to reveal neuroadaptations that may underlie the transition from initial drug exposure to opioid dependence.

Cortico-striatal beta oscillations as a reward-related signal.

The value associated with reward is sensitive to external factors, such as the time between the choice and reward delivery as classically manipulated in temporal discounting tasks. Subjective preference for two reward options is dependent on objective variables of reward magnitude and reward delay. Single neuron correlates of reward value have been observed in regions, including ventral striatum, orbital, and medial prefrontal cortex. Brain imaging studies show cortico-striatal-limbic network activity related to subjective preferences. To explore how oscillatory dynamics represent reward processing across brain regions, we measured local field potentials of rats performing a temporal discounting task. Our goal was to use a data-driven approach to identify an electrophysiological marker that correlates with reward preference. We found that reward-locked oscillations at beta frequencies signaled the magnitude of reward and decayed with longer temporal delays. Electrodes in orbitofrontal/medial prefrontal cortex, anterior insula, ventral striatum, and amygdala individually increased power and were functionally connected at beta frequencies during reward outcome. Beta power during reward outcome correlated with subjective value as defined by a computational model fit to the discounting behavior. These data suggest that cortico-striatal beta oscillations are a reward signal correlated, which may represent subjective value and hold potential to serve as a biomarker and potential therapeutic target.

Angiotensin blockade enhances motivational reward learning via enhancing striatal prediction error signaling and frontostriatal communication.

Adaptive human learning utilizes reward prediction errors (RPEs) that scale the differences between expected and actual outcomes to optimize future choices. Depression has been linked with biased RPE signaling and an exaggerated impact of negative outcomes on learning which may promote amotivation and anhedonia. The present proof-of-concept study combined computational modeling and multivariate decoding with neuroimaging to determine the influence of the selective competitive angiotensin II type 1 receptor antagonist losartan on learning from positive or negative outcomes and the underlying neural mechanisms in healthy humans. In a double-blind, between-subjects, placebo-controlled pharmaco-fMRI experiment, 61 healthy male participants (losartan, n = 30; placebo, n = 31) underwent a probabilistic selection reinforcement learning task incorporating a learning and transfer phase. Losartan improved choice accuracy for the hardest stimulus pair via increasing expected value sensitivity towards the rewarding stimulus relative to the placebo group during learning. Computational modeling revealed that losartan reduced the learning rate for negative outcomes and increased exploitatory choice behaviors while preserving learning for positive outcomes. These behavioral patterns were paralleled on the neural level by increased RPE signaling in orbitofrontal-striatal regions and enhanced positive outcome representations in the ventral striatum (VS) following losartan. In the transfer phase, losartan accelerated response times and enhanced VS functional connectivity with left dorsolateral prefrontal cortex when approaching maximum rewards. These findings elucidate the potential of losartan to reduce the impact of negative outcomes during learning and subsequently facilitate motivational approach towards maximum rewards in the transfer of learning. This may indicate a promising therapeutic mechanism to normalize distorted reward learning and fronto-striatal functioning in depression.

Gender Dysphoria and Sexual Euphoria: A Bayesian Perspective on the Influence of Gender-Affirming Hormone Therapy on Sexual Arousal.

Self-reported sexual orientation of transgender individuals occasionally changes over transition. Using functional magnetic resonance imaging, we tested the hypothesis that neural and behavioral patterns of sexual arousal in transgender individuals would shift from the assigned to the experienced gender (e.g., trans women's responses becoming more dissimilar to those of cis men and more similar to those of cis women). To this aim, trans women (N = 12) and trans men (N = 20) as well as cisgender women (N = 24) and cisgender men (N = 14) rated visual stimuli showing male-female, female-female or male-male intercourse for sexual arousal before and after four months of gender-affirming hormone therapy. A Bayesian framework allowed us to incorporate previous behavioral findings. The hypothesized changes could indeed be observed in the behavioral responses with the strongest results for trans men and female-female scenes. Activation of the ventral striatum supported our hypothesis only for female-female scenes in trans women. The respective application or depletion of androgens in trans men and trans women might partly explain this observation. The prominent role of female-female stimuli might be based on the differential responses they elicit in cis women and men or, in theory, the controversial concept of autogynephilia. We show that correlates of sexual arousal in transgender individuals might change in the direction of the experienced gender. Future investigations should elucidate the mechanistic role of sex hormones and the cause of the differential neural and behavioral findings.The study was registered at ClinicalTrials.gov (NCT02715232), March 22, 2016.

Altered neural anticipation of reward and loss but not receipt in adolescents with obsessive-compulsive disorder.

BACKGROUND: Obsessive-compulsive disorder (OCD) is characterized by persistent, unwanted thoughts and repetitive actions. Such repetitive thoughts and/or behaviors may be reinforced either by reducing anxiety or by avoiding a potential threat or harm, and thus may be rewarding to the individual. The possible involvement of the reward system in the symptomatology of OCD is supported by studies showing altered reward processing in reward-related regions, such as the ventral striatum (VS) and the orbitofrontal cortex (OFC), in adults with OCD. However, it is not clear whether this also applies to adolescents with OCD. METHODS: Using functional magnetic resonance imaging, two sessions were conducted focusing on the anticipation and receipt of monetary reward (1) or loss (2), each contrasted to a verbal (control) condition. In each session, adolescents with OCD (n1=31/n2=26) were compared with typically developing (TD) controls (n1=33/ n2=31), all aged 10-19 years, during the anticipation and feedback phase of an adapted Monetary Incentive Delay task. RESULTS: Data revealed a hyperactivation of the VS, but not the OFC, when anticipating both monetary reward and loss in the OCD compared to the TD group. CONCLUSIONS: These findings suggest that aberrant neural reward and loss processing in OCD is associated with greater motivation to gain or maintain a reward but not with the actual receipt. The greater degree of reward 'wanting' may contribute to adolescents with OCD repeating certain actions more and more frequently, which then become habits (i.e., OCD symptomatology).

White matter integrity of right frontostriatal circuit predicts internet addiction severity among internet gamers.

Excessive use of the internet, which is a typical scenario of self-control failure, could lead to potential consequences such as anxiety, depression, and diminished academic performance. However, the underlying neuropsychological mechanisms remain poorly understood. This study aims to investigate the structural basis of self-control and internet addiction. In a cohort of 96 internet gamers, we examined the relationships among grey matter volume and white matter integrity within the frontostriatal circuits and internet addiction severity, as well as self-control measures. The results showed a significant and negative correlation between dACC grey matter volume and internet addiction severity (p < 0.001), but not with self-control. Subsequent tractography from the dACC to the bilateral ventral striatum (VS) was conducted. The fractional anisotropy (FA) and radial diffusivity of dACC-right VS pathway was negatively (p = 0.011) and positively (p = 0.020) correlated with internet addiction severity, respectively, and the FA was also positively correlated with self-control (p = 0.036). These associations were not observed for the dACC-left VS pathway. Further mediation analysis demonstrated a significant complete mediation effect of self-control on the relationship between FA of the dACC-right VS pathway and internet addiction severity. Our findings suggest that the dACC-right VS pathway is a critical neural substrate for both internet addiction and self-control. Deficits in this pathway may lead to impaired self-regulation over internet usage, exacerbating the severity of internet addiction.

Diurnal rhythms across the human dorsal and ventral striatum.

The human striatum can be subdivided into the caudate, putamen, and nucleus accumbens (NAc). Each of these structures have some overlapping and some distinct functions related to motor control, cognitive processing, motivation, and reward. Previously, we used a "time-of-death" approach to identify diurnal rhythms in RNA transcripts in human cortical regions. Here, we identify molecular rhythms across the three striatal subregions collected from postmortem human brain tissue in subjects without psychiatric or neurological disorders. Core circadian clock genes are rhythmic across all three regions and show strong phase concordance across regions. However, the putamen contains a much larger number of significantly rhythmic transcripts than the other two regions. Moreover, there are many differences in pathways that are rhythmic across regions. Strikingly, the top rhythmic transcripts in NAc (but not the other regions) are predominantly small nucleolar RNAs and long noncoding RNAs, suggesting that a completely different mechanism might be used for the regulation of diurnal rhythms in translation and/or RNA processing in the NAc versus the other regions. Further, although the NAc and putamen are generally in phase with regard to timing of expression rhythms, the NAc and caudate, and caudate and putamen, have several clusters of discordant rhythmic transcripts, suggesting a temporal wave of specific cellular processes across the striatum. Taken together, these studies reveal distinct transcriptome rhythms across the human striatum and are an important step in helping to understand the normal function of diurnal rhythms in these regions and how disruption could lead to pathology.

Differential Alterations in Striatal Direct and Indirect Pathways Mediate Two Autism-like Behaviors in Valproate-Exposed Mice.

Autism is characterized by two key diagnostic criteria including social deficits and repetitive behaviors. Although recent studies implicated ventral striatum in social deficits and dorsal striatum in repetitive behaviors, here we revealed coexisting and opposite morphologic and functional alterations in the dorsostriatal direct and indirect pathways, and such alterations in these two pathways were found to be responsible, respectively, for the two abovementioned different autism-like behaviors exhibited by male mice prenatally exposed to valproate. The alteration in direct pathway was characterized by a potentiated state of basal activity, with impairment in transient responsiveness of D1-MSNs during social exploration. Concurrent alteration in indirect pathway was a depressed state of basal activity, with enhancement in transient responsiveness of D2-MSNs during repetitive behaviors. A causal relationship linking such differential alterations in these two pathways to the coexistence of these two autism-like behaviors was demonstrated by the cell type-specific correction of abnormal basal activity in the D1-MSNs and D2-MSNs of valproate-exposed mice. The findings support those differential alterations in two striatal pathways mediate the two coexisting autism-like behavioral abnormalities, respectively. This result will help in developing therapeutic options targeting these circuit alterations.SIGNIFICANCE STATEMENT Autism is characterized by two key diagnostic criteria including social deficits and repetitive behaviors. Although a number of recent studies have implicated ventral striatum in social deficits and dorsal striatum in repetitive behaviors, but social behaviors need to be processed by a series of actions, and repetitive behaviors, especially the high-order repetitive behaviors such as restrictive interests, have its scope to cognitive and emotional domains. The current study, for the first time, revealed that prenatal valproate exposure induced coexisting and differential alterations in the dorsomedial striatal direct and indirect pathways, and that these alterations mediate the two coexisting autism-like behavioral abnormalities, respectively. This result will help in developing therapeutic options targeting these circuit alterations to address the behavioral abnormalities.

Differential Contributions of Ventral Striatum Subregions to the Motivational and Hedonic Components of the Affective Processing of Reward.

The ventral striatum is implicated in the affective processing of reward, which can be divided into a motivational and a hedonic component. Here, we examined whether these two components rely on distinct neural substrates within the ventral striatum in humans (11 females and 13 males). We used a high-resolution fMRI protocol targeting the ventral striatum combined with a pavlovian-instrumental task and a hedonic reactivity task. Both tasks involved an olfactory reward, thereby allowing us to measure pavlovian-triggered motivation and sensory pleasure for the same reward within the same participants. Our findings show that different subregions of the ventral striatum are dissociable in their contributions to the motivational versus the hedonic component of the affective processing of reward. Parsing the neural mechanisms of the interplay between pavlovian incentive and hedonic processes may have important implications for understanding compulsive reward-seeking behaviors such as addiction, binge eating, or gambling.

Cognitive and neural bases of visual-context-guided decision-making.

Humans adjust their behavioral strategies based on feedback, a process that may depend on intrinsic preferences and contextual factors such as visual salience. In this study, we hypothesized that decision-making based on visual salience is influenced by habitual and goal-directed processes, which can be evidenced by changes in attention and subjective valuation systems. To test this hypothesis, we conducted a series of studies to investigate the behavioral and neural mechanisms underlying visual salience-driven decision-making. We first established the baseline behavioral strategy without salience in Experiment 1 (n = 21). We then highlighted the utility or performance dimension of the chosen outcome using colors in Experiment 2 (n = 30). We demonstrated that the difference in staying frequency increased along the salient dimension, confirming a salience effect. Furthermore, the salience effect was abolished when directional information was removed in Experiment 3 (n = 28), suggesting that the salience effect is feedback-specific. To generalize our findings, we replicated the feedback-specific salience effects using eye-tracking and text emphasis. The fixation differences between the chosen and unchosen values were enhanced along the feedback-specific salient dimension in Experiment 4 (n = 48) but unchanged after removing feedback-specific information in Experiment 5 (n = 32). Moreover, the staying frequency was correlated with fixation properties, confirming that salience guides attention deployment. Lastly, our neuroimaging study (Experiment 6, n = 25) showed that the striatum subregions encoded salience-based outcome evaluation, while the vmPFC encoded salience-based behavioral adjustments. The connectivity of the vmPFC-ventral striatum accounted for individual differences in utility-driven, whereas the vmPFC-dmPFC for performance-driven behavioral adjustments. Together, our results provide a neurocognitive account of how task-irrelevant visual salience drives decision-making by involving attention and the frontal-striatal valuation systems. PUBLIC SIGNIFICANCE STATEMENT: Humans may use the current outcome to make behavior adjustments. How this occurs may depend on stable individual preferences and contextual factors, such as visual salience. Under the hypothesis that visual salience determines attention and subsequently modulates subjective valuation, we investigated the underlying behavioral and neural bases of visual-context-guided outcome evaluation and behavioral adjustments. Our findings suggest that the reward system is orchestrated by visual context and highlight the critical role of attention and the frontal-striatal neural circuit in visual-context-guided decision-making that may involve habitual and goal-directed processes.

Development and validation of an fMRI-informed EEG model of reward-related ventral striatum activation.

Reward processing is essential for our mental-health and well-being. In the current study, we developed and validated a scalable, fMRI-informed EEG model for monitoring reward processing related to activation in the ventral-striatum (VS), a significant node in the brain's reward system. To develop this EEG-based model of VS-related activation, we collected simultaneous EEG/fMRI data from 17 healthy individuals while listening to individually-tailored pleasurable music - a highly rewarding stimulus known to engage the VS. Using these cross-modal data, we constructed a generic regression model for predicting the concurrently acquired Blood-Oxygen-Level-Dependent (BOLD) signal from the VS using spectro-temporal features from the EEG signal (termed hereby VS-related-Electrical Finger Print; VS-EFP). The performance of the extracted model was examined using a series of tests that were applied on the original dataset and, importantly, an external validation dataset collected from a different group of 14 healthy individuals who underwent the same EEG/FMRI procedure. Our results showed that the VS-EFP model, as measured by simultaneous EEG, predicted BOLD activation in the VS and additional functionally relevant regions to a greater extent than an EFP model derived from a different anatomical region. The developed VS-EFP was also modulated by musical pleasure and predictive of the VS-BOLD during a monetary reward task, further indicating its functional relevance. These findings provide compelling evidence for the feasibility of using EEG alone to model neural activation related to the VS, paving the way for future use of this scalable neural probing approach in neural monitoring and self-guided neuromodulation.

Slow-rising and fast-falling dopaminergic dynamics jointly adjust negative prediction error in the ventral striatum.

The greater the reward expectations are, the more different the brain's physiological response will be. Although it is well-documented that better-than-expected outcomes are encoded quantitatively via midbrain dopaminergic (DA) activity, it has been less addressed experimentally whether worse-than-expected outcomes are expressed quantitatively as well. We show that larger reward expectations upon unexpected reward omissions are associated with the preceding slower rise and following larger decrease (DA dip) in the DA concentration at the ventral striatum of mice. We set up a lever press task on a fixed ratio (FR) schedule requiring five lever presses as an effort for a food reward (FR5). The mice occasionally checked the food magazine without a reward before completing the task. The percentage of this premature magazine entry (PME) increased as the number of lever presses approached five, showing rising expectations with increasing proximity to task completion, and hence greater reward expectations. Fibre photometry of extracellular DA dynamics in the ventral striatum using a fluorescent protein (genetically encoded GPCR activation-based DA sensor: GRABDA2m ) revealed that the slow increase and fast decrease in DA levels around PMEs were correlated with the PME percentage, demonstrating a monotonic relationship between the DA dip amplitude and degree of expectations. Computational modelling of the lever press task implementing temporal difference errors and state transitions replicated the observed correlation between the PME frequency and DA dip amplitude in the FR5 task. Taken together, these findings indicate that the DA dip amplitude represents the degree of reward expectations monotonically, which may guide behavioural adjustment.

Motivated for near impossibility: How task type and reward modulate task enjoyment and the striatal activation for extremely difficult task.

Economic and decision-making theories suppose that people would disengage from a task with near zero success probability, because this implicates little normative utility values. However, humans often are motivated for an extremely challenging task, even without any extrinsic incentives. The current study aimed to address the nature of this challenge-based motivation and its neural correlates. We found that, when participants played a skill-based task without extrinsic incentives, their task enjoyment increased as the chance of success decreased, even if the task was almost impossible to achieve. However, such challenge-based motivation was not observed when participants were rewarded for the task or the reward was determined in a probabilistic manner. The activation in the ventral striatum/pallidum tracked the pattern of task enjoyment. These results suggest that people are intrinsically motivated to challenge a nearly impossible task but only when the task requires certain skills and extrinsic rewards are unavailable.

The 5-HT1A receptor agonist 8-OH-DPAT modulates motor/exploratory activity, recognition memory and dopamine transporter binding in the dorsal and ventral striatum.

In the present studies, we assessed the effect of the 5-HT1A receptor (R) agonist 8-hydroxy-2-(di-n-propylamino)tetralin (8-OH-DPAT) on motor and exploratory behaviors, object and place recognition and dopamine transporter (DAT) and serotonin transporter (SERT) binding in the rat brain. In Experiment I, motor/exploratory behaviors were assessed in an open field after injection of either 8-OH-DPAT (0.1 and 3 mg/kg) or vehicle for 30 min without previous habituation to the open field. In Experiment II, rats underwent a 5-min exploration trial in an open field with two identical objects. After injection of either 8-OH-DPAT (0.1 and 3 mg/kg) or vehicle, rats underwent a 5-min test trial with one of the objects replaced by a novel one and the other object transferred to a novel place. Subsequently, N-o-fluoropropyl-2b-carbomethoxy-3b-(4-[123I]iodophenyl)-nortropane ([123I]FP-CIT; 11 ± 4 MBq) was injected into the tail vein. Regional radioactivity accumulations were determined post mortem with a well counter. In both experiments, 8-OH-DPAT dose-dependently increased ambulation and exploratory head-shoulder motility, whereas rearing was dose-dependently decreased. In the test rial of Experiment II, there were no effects of 8-OH-DPAT on overall activity, sitting and grooming. 8-OH-DPAT dose-dependently impaired recognition of object and place. 8-OH-DPAT (3 mg/kg) increased DAT binding in the dorsal striatum relative to both vehicle and 0.1 mg/kg 8-OH-DPAT. Furthermore, in the ventral striatum, DAT binding was decreased after 3 mg/kg 8-OH-DPAT relative to vehicle. Findings indicate that motor/exploratory behaviors, memory for object and place and regional dopamine function may be modulated by the 5-HT1AR. Since, after 8-OH-DPAT, rats exhibited more horizontal and less (exploratory) vertical motor activity, while overall activity was not different between groups, it may be inferred, that the observed impairment of object recognition was not related to a decrease of motor activity as such, but to a decrease of intrinsic motivation, attention and/or awareness, which are relevant accessories of learning. Furthermore, the present findings on 8-OH-DPAT action indicate associations not only between motor/exploratory behavior and the recognition of object and place but also between the respective parameters and the levels of available DA in dorsal and ventral striatum.