Motor System-Dependent Effects of Amygdala and Ventral Striatum Lesions on Explore-Exploit Behaviors.

Deciding whether to forego immediate rewards or explore new opportunities is a key component of flexible behavior and is critical for the survival of the species. Although previous studies have shown that different cortical and subcortical areas, including the amygdala and ventral striatum (VS), are implicated in representing the immediate (exploitative) and future (explorative) value of choices, the effect of the motor system used to make choices has not been examined. Here, we tested male rhesus macaques with amygdala or VS lesions on two versions of a three-arm bandit task where choices were registered with either a saccade or an arm movement. In both tasks we presented the monkeys with explore-exploit tradeoffs by periodically replacing familiar options with novel options that had unknown reward probabilities. We found that monkeys explored more with saccades but showed better learning with arm movements. VS lesions caused the monkeys to be more explorative with arm movements and less explorative with saccades, although this may have been due to an overall decrease in performance. VS lesions affected the monkeys' ability to learn novel stimulus-reward associations in both tasks, while after amygdala lesions this effect was stronger when choices were made with saccades. Further, on average, VS and amygdala lesions reduced the monkeys' ability to choose better options only when choices were made with a saccade. These results show that learning reward value associations to manage explore-exploit behaviors is motor system dependent and they further define the contributions of amygdala and VS to reinforcement learning.

Establishing the Roles of the Dorsal and Ventral Striatum in Humor Comprehension and Appreciation with fMRI.

Humor comprehension (i.e., getting a joke) and humor appreciation (i.e., enjoying a joke) are distinct, cognitively complex processes. Functional magnetic resonance imaging (fMRI) investigations have identified several key cortical regions but have overlooked subcortical structures that have theoretical importance in humor processing. The dorsal striatum (DS) contributes to working memory, ambiguity processing, and cognitive flexibility, cognitive functions that are required to accurately recognize humorous stimuli. The ventral striatum (VS) is critical in reward processing and enjoyment. We hypothesized that the DS and VS play important roles in humor comprehension and appreciation, respectively. We investigated the engagement of these regions in these distinct processes using fMRI. Twenty-six healthy young male and female human adults completed two humor-elicitation tasks during a 3 tesla fMRI scan consisting of a traditional behavior-based joke task and a naturalistic audiovisual sitcom paradigm (i.e., Seinfeld viewing task). Across both humor-elicitation methods, whole-brain analyses revealed cortical activation in the inferior frontal gyrus, the middle frontal gyrus, and the middle temporal gyrus for humor comprehension, and the temporal cortex for humor appreciation. Additionally, with region of interest analyses, we specifically examined whether DS and VS activation correlated with these processes. Across both tasks, we demonstrated that humor comprehension implicates both the DS and the VS, whereas humor appreciation only engages the VS. These results establish the role of the DS in humor comprehension, which has been previously overlooked, and emphasize the role of the VS in humor processing more generally.SIGNIFICANCE STATEMENT Humorous stimuli are processed by the brain in at least two distinct stages. First, humor comprehension involves understanding humorous intent through cognitive and problem-solving mechanisms. Second, humor appreciation involves enjoyment, mirth, and laughter in response to a joke. The roles of smaller subcortical brain regions in humor processing, such as the DS and VS, have been overlooked in previous investigations. However, these regions are involved in functions that support humor comprehension (e.g., working memory ambiguity resolution, and cognitive flexibility) and humor appreciation (e.g., reward processing, pleasure, and enjoyment). In this study, we used neuroimaging to demonstrate that the DS and VS play important roles in humor comprehension and appreciation, respectively, across two different humor-elicitation tasks.

Understanding the Therapeutic Action of Antipsychotics: From Molecular to Cellular Targets With Focus on the Islands of Calleja.

The understanding of the pathophysiology of schizophrenia as well as the mechanisms of action of antipsychotic drugs remains a challenge for psychiatry. The demonstration of the therapeutic efficacy of several new atypical drugs targeting multiple different receptors, apart from the classical dopamine D2 receptor as initially postulated unique antipsychotic target, complicated even more conceptualization efforts. Here we discuss results suggesting a main role of the islands of Calleja, still poorly studied GABAergic granule cell clusters in the ventral striatum, as cellular targets of several innovative atypical antipsychotics (clozapine, cariprazine, and xanomeline/emraclidine) effective in treating also negative symptoms of schizophrenia. We will emphasize the potential role of dopamine D3 and M4 muscarinic acetylcholine receptor expressed at the highest level by the islands of Calleja, as well as their involvement in schizophrenia-associated neurocircuitries. Finally, we will discuss the implications of new data showing ongoing adult neurogenesis of the islands of Calleja as a very promising antipsychotic target linking long-life neurodevelopment and dopaminergic dysfunction in the striatum.

Reciprocal relationships between stress and depressive symptoms: the essential role of the nucleus accumbens.

BACKGROUND: Stress and depression have a reciprocal relationship, but the neural underpinnings of this reciprocity are unclear. We investigated neuroimaging phenotypes that facilitate the reciprocity between stress and depressive symptoms. METHODS: In total, 22 195 participants (52.0% females) from the population-based UK Biobank study completed two visits (initial visit: 2006-2010, age = 55.0 ± 7.5 [40-70] years; second visit: 2014-2019; age = 62.7 ± 7.5 [44-80] years). Structural equation modeling was used to examine the longitudinal relationship between self-report stressful life events (SLEs) and depressive symptoms. Cross-sectional data were used to examine the overlap between neuroimaging correlates of SLEs and depressive symptoms on the second visit among 138 multimodal imaging phenotypes. RESULTS: Longitudinal data were consistent with significant bidirectional causal relationship between SLEs and depressive symptoms. In cross-sectional analyses, SLEs were significantly associated with lower bilateral nucleus accumbal volume and lower fractional anisotropy of the forceps major. Depressive symptoms were significantly associated with extensive white matter hyperintensities, thinner cortex, lower subcortical volume, and white matter microstructural deficits, mainly in corticostriatal-limbic structures. Lower bilateral nucleus accumbal volume were the only imaging phenotypes with overlapping effects of depressive symptoms and SLEs (B = -0.032 to -0.023, p = 0.006-0.034). Depressive symptoms and SLEs significantly partially mediated the effects of each other on left and right nucleus accumbens volume (proportion of effects mediated = 12.7-14.3%, p < 0.001-p = 0.008). For the left nucleus accumbens, post-hoc seed-based analysis showed lower resting-state functional connectivity with the left orbitofrontal cortex (cluster size = 83 voxels, p = 5.4 × 10-5) in participants with high v. no SLEs. CONCLUSIONS: The nucleus accumbens may play a key role in the reciprocity between stress and depressive symptoms.

Major stress in early childhood strengthens the association between peripheral inflammatory activity and corticostriatal responsivity to reward.

BACKGROUND: Severe, chronic stress during childhood accentuates vulnerability to mental and physical health problems across the lifespan. To explain this phenomenon, the neuroimmune network hypothesis proposes that childhood stressors amplify signaling between peripheral inflammatory cells and developing brain circuits that support processing of rewards and threats. Here, we conducted a preliminary test of the basic premises of this hypothesis. METHODS: 180 adolescents (mean age = 19.1 years; 68.9 % female) with diverse racial and ethnic identities (56.1 % White; 28.3 % Hispanic; 26.1 % Asian) participated. The Childhood Trauma Interview was administered to quantify early adversity. Five inflammatory biomarkers were assayed in antecubital blood - C-reactive protein, tumor necrosis factor-a, and interleukins-6, -8, and -10 - and were averaged to form a composite score. Participants also completed a functional MRI task to measure corticostriatal responsivity to the anticipation and acquisition of monetary rewards. RESULTS: Stress exposure and corticostriatal responsivity interacted statistically to predict the inflammation composite. Among participants who experienced major stressors in the first decade of life, higher inflammatory activity covaried with lower corticostriatal responsivity during acquisition of monetary rewards. This relationship was specific to participants who experienced major stress in early childhood, implying a sensitive period for exposure, and were evident in both the orbitofrontal cortex and the ventral striatum, suggesting the broad involvement of corticostriatal regions. The findings were independent of participants' age, sex, racial and ethnic identity, family income, and depressive symptoms. CONCLUSIONS: Collectively, the results are consistent with hypotheses suggesting that major stress in childhood alters brain-immune signaling.

Nothing to lose? Neural correlates of decision, anticipation, and feedback in the balloon analog risk task.

Understanding the subprocesses of risky decision making is a prerequisite for understanding (dys-)functional decisions. For the present fMRI study, we designed a novel variant of the balloon-analog-risk task (BART) that measures three phases: decision making, reward anticipation, and feedback processing. Twenty-nine healthy young adults completed the BART. We analyzed neural activity and functional connectivity. Parametric modulation allowed assessing changes in brain functioning depending on the riskiness of the decision. Our results confirm involvement of nucleus accumbens, insula, anterior cingulate cortex, and dorsolateral prefrontal cortex in all subprocesses of risky decision-making. In addition, subprocesses were differentiated by the strength of activation in these regions, as well as by changes in activity and nucleus accumbens-connectivity by the riskiness of the decision. The presented fMRI-BART variant allows distinguishing activity and connectivity during the subprocesses of risky decision making and shows how activation and connectivity patterns relate to the riskiness of the decision. Hence, it is a useful tool for unraveling impairments in subprocesses of risky decision making in people with high risk behavior.

Gender Dysphoria and Sexual Euphoria: A Bayesian Perspective on the Influence of Gender-Affirming Hormone Therapy on Sexual Arousal.

Self-reported sexual orientation of transgender individuals occasionally changes over transition. Using functional magnetic resonance imaging, we tested the hypothesis that neural and behavioral patterns of sexual arousal in transgender individuals would shift from the assigned to the experienced gender (e.g., trans women's responses becoming more dissimilar to those of cis men and more similar to those of cis women). To this aim, trans women (N = 12) and trans men (N = 20) as well as cisgender women (N = 24) and cisgender men (N = 14) rated visual stimuli showing male-female, female-female or male-male intercourse for sexual arousal before and after four months of gender-affirming hormone therapy. A Bayesian framework allowed us to incorporate previous behavioral findings. The hypothesized changes could indeed be observed in the behavioral responses with the strongest results for trans men and female-female scenes. Activation of the ventral striatum supported our hypothesis only for female-female scenes in trans women. The respective application or depletion of androgens in trans men and trans women might partly explain this observation. The prominent role of female-female stimuli might be based on the differential responses they elicit in cis women and men or, in theory, the controversial concept of autogynephilia. We show that correlates of sexual arousal in transgender individuals might change in the direction of the experienced gender. Future investigations should elucidate the mechanistic role of sex hormones and the cause of the differential neural and behavioral findings.The study was registered at ClinicalTrials.gov (NCT02715232), March 22, 2016.

Altered neural anticipation of reward and loss but not receipt in adolescents with obsessive-compulsive disorder.

BACKGROUND: Obsessive-compulsive disorder (OCD) is characterized by persistent, unwanted thoughts and repetitive actions. Such repetitive thoughts and/or behaviors may be reinforced either by reducing anxiety or by avoiding a potential threat or harm, and thus may be rewarding to the individual. The possible involvement of the reward system in the symptomatology of OCD is supported by studies showing altered reward processing in reward-related regions, such as the ventral striatum (VS) and the orbitofrontal cortex (OFC), in adults with OCD. However, it is not clear whether this also applies to adolescents with OCD. METHODS: Using functional magnetic resonance imaging, two sessions were conducted focusing on the anticipation and receipt of monetary reward (1) or loss (2), each contrasted to a verbal (control) condition. In each session, adolescents with OCD (n1=31/n2=26) were compared with typically developing (TD) controls (n1=33/ n2=31), all aged 10-19 years, during the anticipation and feedback phase of an adapted Monetary Incentive Delay task. RESULTS: Data revealed a hyperactivation of the VS, but not the OFC, when anticipating both monetary reward and loss in the OCD compared to the TD group. CONCLUSIONS: These findings suggest that aberrant neural reward and loss processing in OCD is associated with greater motivation to gain or maintain a reward but not with the actual receipt. The greater degree of reward 'wanting' may contribute to adolescents with OCD repeating certain actions more and more frequently, which then become habits (i.e., OCD symptomatology).

The transcriptional response to acute cocaine is inverted in male mice with a history of cocaine self-administration and withdrawal throughout the mesocorticolimbic system.

A large body of work has demonstrated that cocaine-induced changes in transcriptional regulation play a central role in the onset and maintenance of cocaine use disorder. An underappreciated aspect of this area of research, however, is that the pharmacodynamic properties of cocaine can change depending on an organism's previous drug-exposure history. In this study, we utilized RNA sequencing to characterize how the transcriptome-wide effects of acute cocaine exposure were altered by a history of cocaine self-administration and long-term withdrawal (30 days) in the ventral tegmental area (VTA), nucleus accumbens (NAc), and prefrontal cortex (PFC) in male mice. First, we found that the gene expression patterns induced by a single cocaine injection (10 mg/kg) were discordant between cocaine-naïve mice and mice in withdrawal from cocaine self-administration. Specifically, the same genes that were upregulated by acute cocaine in cocaine-naïve mice were downregulated by the same dose of cocaine in mice undergoing long-term withdrawal; the same pattern of opposite regulation was observed for the genes downregulated by initial acute cocaine exposure. When we analyzed this dataset further, we found that the gene expression patterns that were induced by long-term withdrawal from cocaine self-administration showed a high degree of overlap with the gene expression patterns of acute cocaine exposure - even though animals had not consumed cocaine in 30 days. Interestingly, cocaine re-exposure at this withdrawal time point reversed this expression pattern. Finally, we found that this pattern was similar across the VTA, PFC, NAc, and within each brain region the same genes were induced by acute cocaine, re-induced during long-term withdrawal, and reversed by cocaine re-exposure. Together, we identified a longitudinal pattern of gene regulation that is conserved across the VTA, PFC, and NAc, and characterized the genes constituting this pattern in each brain region.

A Low-Intensity Transcranial Focused Ultrasound Parameter Exploration Study of the Ventral Capsule/Ventral Striatum.

OBJECTIVES: Deep brain stimulation (DBS) of the ventral capsule/ventral striatum (VC/VS) is effective for treatment-resistant obsessive-compulsive disorder (OCD); however, DBS is associated with neurosurgical risks. Transcranial focused ultrasound (tFUS) is a newer form of noninvasive (ie, nonsurgical) stimulation that can modulate deeper regions, such as the VC/VS. tFUS parameters have just begun to be studied and have often not been compared in the same participants. We explored the effects of three VC/VS tFUS protocols and an entorhinal cortex (ErC) tFUS session on the VC/VS and cortico-striato-thalamo-cortical circuit (CSTC) in healthy individuals for later application to patients with OCD. MATERIALS AND METHODS: Twelve individuals participated in a total of 48 sessions of tFUS in this exploratory multisite, within-subject parameter study. We collected resting-state, reward task, and arterial spin-labeled (ASL) magnetic resonance imaging scans before and after ErC tFUS and three VC/VS tFUS sessions with different pulse repetition frequencies (PRFs), pulse widths (PWs), and duty cycles (DCs). RESULTS: VC/VS protocol A (PRF = 10 Hz, PW = 5 ms, 5% DC) was associated with increased putamen activation during a reward task (p = 0.003), and increased VC/VS resting-state functional connectivity (rsFC) with the anterior cingulate cortex (p = 0.022) and orbitofrontal cortex (p = 0.004). VC/VS protocol C (PRF = 125 Hz, PW = 4 ms, 50% DC) was associated with decreased VC/VS rsFC with the putamen (p = 0.017), and increased VC/VS rsFC with the globus pallidus (p = 0.008). VC/VS protocol B (PRF = 125 Hz, PW = 0.4 ms, 5% DC) was not associated with changes in task-related CSTC activation or rsFC. None of the protocols affected CSTC ASL perfusion. CONCLUSIONS: This study began to explore the multidimensional parameter space of an emerging form of noninvasive brain stimulation, tFUS. Our preliminary findings in a small sample suggest that VC/VS tFUS should continue to be investigated for future noninvasive treatment of OCD.

Threat and Bidirectional Valence Signaling in the Nucleus Accumbens Core.

Appropriate responding to threat and reward is essential to survival. The nucleus accumbens core (NAcc) is known to support and organize reward behavior. The NAcc is also necessary to fully discriminate threat and safety cues. To directly reveal NAcc threat firing, we recorded single-unit activity from seven female rats undergoing pavlovian fear discrimination. Rats fully discriminated danger, uncertainty, and safety cues, and most NAcc neurons showed the greatest firing change to danger and uncertainty. Heterogeneity in cue and reward firing led us to identify distinct functional populations. One NAcc population signaled threat, specifically decreasing firing to danger and uncertainty cues. A separate population signaled Bidirectional Valence, decreasing firing to the danger cue (negative valence), but increasing firing to reward (positive valence). The results reveal the NAcc to be a source of threat information and a more general valence hub.SIGNIFICANCE STATEMENT The nucleus accumbens core (NAcc) is synonymous with reward. Yet, anatomy, neurotoxic lesions, and optogenetic manipulation implicate the NAcc in threat. Here, we directly revealed NAcc threat firing by recording single-unit activity during multicue fear discrimination. Most cue-responsive NAcc neurons markedly altered firing to threat cues. Finer analyses revealed a NAcc population signaling threat, specifically decreasing firing to danger and uncertainty cues; and a NAcc population signaling Bidirectional Valence, increasing firing to reward but decreasing firing to the danger cue. The results reveal the NAcc to be a source of threat information and a valence hub.

Differential Contributions of Ventral Striatum Subregions to the Motivational and Hedonic Components of the Affective Processing of Reward.

The ventral striatum is implicated in the affective processing of reward, which can be divided into a motivational and a hedonic component. Here, we examined whether these two components rely on distinct neural substrates within the ventral striatum in humans (11 females and 13 males). We used a high-resolution fMRI protocol targeting the ventral striatum combined with a pavlovian-instrumental task and a hedonic reactivity task. Both tasks involved an olfactory reward, thereby allowing us to measure pavlovian-triggered motivation and sensory pleasure for the same reward within the same participants. Our findings show that different subregions of the ventral striatum are dissociable in their contributions to the motivational versus the hedonic component of the affective processing of reward. Parsing the neural mechanisms of the interplay between pavlovian incentive and hedonic processes may have important implications for understanding compulsive reward-seeking behaviors such as addiction, binge eating, or gambling.

Development and validation of an fMRI-informed EEG model of reward-related ventral striatum activation.

Reward processing is essential for our mental-health and well-being. In the current study, we developed and validated a scalable, fMRI-informed EEG model for monitoring reward processing related to activation in the ventral-striatum (VS), a significant node in the brain's reward system. To develop this EEG-based model of VS-related activation, we collected simultaneous EEG/fMRI data from 17 healthy individuals while listening to individually-tailored pleasurable music - a highly rewarding stimulus known to engage the VS. Using these cross-modal data, we constructed a generic regression model for predicting the concurrently acquired Blood-Oxygen-Level-Dependent (BOLD) signal from the VS using spectro-temporal features from the EEG signal (termed hereby VS-related-Electrical Finger Print; VS-EFP). The performance of the extracted model was examined using a series of tests that were applied on the original dataset and, importantly, an external validation dataset collected from a different group of 14 healthy individuals who underwent the same EEG/FMRI procedure. Our results showed that the VS-EFP model, as measured by simultaneous EEG, predicted BOLD activation in the VS and additional functionally relevant regions to a greater extent than an EFP model derived from a different anatomical region. The developed VS-EFP was also modulated by musical pleasure and predictive of the VS-BOLD during a monetary reward task, further indicating its functional relevance. These findings provide compelling evidence for the feasibility of using EEG alone to model neural activation related to the VS, paving the way for future use of this scalable neural probing approach in neural monitoring and self-guided neuromodulation.

Motivated for near impossibility: How task type and reward modulate task enjoyment and the striatal activation for extremely difficult task.

Economic and decision-making theories suppose that people would disengage from a task with near zero success probability, because this implicates little normative utility values. However, humans often are motivated for an extremely challenging task, even without any extrinsic incentives. The current study aimed to address the nature of this challenge-based motivation and its neural correlates. We found that, when participants played a skill-based task without extrinsic incentives, their task enjoyment increased as the chance of success decreased, even if the task was almost impossible to achieve. However, such challenge-based motivation was not observed when participants were rewarded for the task or the reward was determined in a probabilistic manner. The activation in the ventral striatum/pallidum tracked the pattern of task enjoyment. These results suggest that people are intrinsically motivated to challenge a nearly impossible task but only when the task requires certain skills and extrinsic rewards are unavailable.

Evidence for functional improvement in reward anticipation in recent onset schizophrenia after one year of coordinated specialty care.

BACKGROUND: Motivational impairment associated with deficits in processing the anticipation of future reward is hypothesized to be a cardinal feature of schizophrenia spectrum disorders (SZ). Evidence from short-term follow-up (6-week post-treatment) studies suggests that these deficits may improve or be reversed with treatment, although longer-term outcomes are unknown. Here we examined the one-year trajectory of functional activation in brain circuitry associated with reward anticipation in people with recent onset SZ who participated in coordinated specialty care (CSC) treatment, hypothesizing normalization of brain response mirroring previous short-term findings in first-episode individuals. METHOD: Blood oxygen level-dependent (BOLD) response in the dorsal anterior cingulate cortex, anterior insula, and ventral striatum (VS) associated with reward anticipation during the Incentivized Control Engagement Task (ICE-T) was analyzed in a baseline sample of 49 healthy controls (HCs) and 52 demographically matched people with SZ, with follow-up data available for 35 HCs and 17 people with SZ. RESULTS: In agreement with our hypothesis, significant time × diagnosis interactions were observed across all regions, in which reward anticipation-associated BOLD response increased in SZ to above baseline HC levels at follow-up. Increased VS activation was associated with decreased reality distortion symptoms over the follow-up period. Baseline reward anticipation-associated BOLD response in the right anterior insula was associated with improvement in reality distortion symptoms. CONCLUSIONS: These findings suggest that functional deficits in reward anticipation may be reversed after one year of CSC in recent onset participants with SZ, and that this improvement is associated with reduced positive symptoms in the illness.

A computational neuroimaging study of reinforcement learning and goal-directed exploration in schizophrenia spectrum disorders.

BACKGROUND: Prior evidence indicates that negative symptom severity and cognitive deficits, in people with schizophrenia (PSZ), relate to measures of reward-seeking and loss-avoidance behavior (implicating the ventral striatum/VS), as well as uncertainty-driven exploration (reliant on rostrolateral prefrontal cortex/rlPFC). While neural correlates of reward-seeking and loss-avoidance have been examined in PSZ, neural correlates of uncertainty-driven exploration have not. Understanding neural correlates of uncertainty-driven exploration is an important next step that could reveal insights to how this mechanism of cognitive and negative symptoms manifest at a neural level. METHODS: We acquired fMRI data from 29 PSZ and 36 controls performing the Temporal Utility Integration decision-making task. Computational analyses estimated parameters corresponding to learning rates for both positive and negative reward prediction errors (RPEs) and the degree to which participates relied on representations of relative uncertainty. Trial-wise estimates of expected value, certainty, and RPEs were generated to model fMRI data. RESULTS: Behaviorally, PSZ demonstrated reduced reward-seeking behavior compared to controls, and negative symptoms were positively correlated with loss-avoidance behavior. This finding of a bias toward loss avoidance learning in PSZ is consistent with previous work. Surprisingly, neither behavioral measures of exploration nor neural correlates of uncertainty in the rlPFC differed significantly between groups. However, we showed that trial-wise estimates of relative uncertainty in the rlPFC distinguished participants who engaged in exploratory behavior from those who did not. rlPFC activation was positively associated with intellectual function. CONCLUSIONS: These results further elucidate the nature of reinforcement learning and decision-making in PSZ and healthy volunteers.

The association between delinquent peer affiliation and disruptive behavior interacts with functional brain correlates of reward sensitivity: a biosocial interaction study in adolescent delinquents.

BACKGROUND: Affiliating with delinquent peers may stimulate the development of antisocial behavior, especially for adolescents who are sensitive to social rewards. The current study examines whether the association between delinquent peer affiliation (DPA) and disruptive behavior interacts with functional brain correlates of reward sensitivity in early onset male adolescents delinquents. METHODS: Childhood arrestees (n = 126, mean age = 17.7 [s.d. 1.6]) completed a DPA questionnaire, and participated in an fMRI study in which reward sensitivity was operationalized through responsiveness of the ventral striatum (VS), amygdala, and medial prefrontal cortex (mPFC) during the monetary incentive delay paradigm (reward anticipation and outcome). Symptoms of disruptive behavior disorders (DBD) were assessed through structured psychiatric interviews (Diagnostic Interview Schedule for Children) with adolescents. RESULTS: DPA had a main effect on DBD symptoms. Adolescents with high VS reward responses showed a stronger significant positive association between DPA and DBD symptoms compared to low VS responders. No evidence for an interaction effect was found for the amygdala and mPFC. Post-hoc analyses revealed the positive association between DPA and DBD was only present in males, with a diminishing effect as age increased. CONCLUSIONS: We found evidence for a biosocial interaction between DPA and reward sensitivity of the VS in relation to DBD symptom severity. This study provides the first evidence of an interaction effect between a brain mechanism and an environmental factor in relation to DBD symptoms, implying that susceptibility to influences of delinquent peers may intertwine with individual biological differences.

An altered reward system characterizes chronic migraine with medication overuse headache.

BACKGROUND: Medication overuse headache shares several characteristics with substance use disorders. However, key features of substance use disorders such as increased impulsivity and alterations in reward processing remain little explored in medication overuse headache. METHODS: Temporal discounting and impulsive decision making behavior and the associated brain mechanisms were assessed in 26 chronic migraine patients with medication overuse headache and in 28 healthy controls. Regions-of-interest analyses were first performed for task-related regions, namely the ventral striatum and the ventromedial and dorsomedial prefrontal cortices. Resting-state functional connectivity between these regions were then explored. An additional 27 chronic migraine patients without medication overuse headache were included for comparison in the latter analysis. RESULTS: Patients with medication overuse headache showed steeper temporal discounting behavior than healthy controls. They also showed weaker subjective value representations in the dorsomedial prefrontal cortex, when accepting larger delayed rewards, and in ventral striatum and ventromedial prefrontal cortex, when accepting the smaller immediate reward. Resting-state functional connectivity was reduced among the valuation regions when comparing patients with medication overuse headache to the other two control groups. CONCLUSIONS: Patients with medication overuse headache were characterized by altered processing and dysconnectivity in the reward system during intertemporal choices and in the resting-state.

Sex Differences and Exogenous Estrogen Influence Learning and Brain Responses to Prediction Errors.

Animal studies show marked sex differences as well as effects of estrogen (E2) in the mesocorticolimbic dopaminergic (DA) pathways, which play a critical role in reward processing and reinforcement learning and are also implicated in drug addiction. In this computational pharmacological fMRI study, we investigate the effects of both factors, sex and estrogen, on reinforcement learning and the dopaminergic system in humans; 67 male and 64 naturally cycling female volunteers, the latter in their low-hormone phase, were randomly assigned, double-blind, to take E2 or placebo. They completed a reinforcement learning task in the MRI scanner for which we have previously shown reward prediction error (RPE)-related activity to be dopaminergic. We found RPE-related brain activity to be enhanced in women compared with men and to a greater extent when E2 levels were elevated in both sexes. However, both factors, female sex and E2, slowed adaptation to RPEs (smaller learning rate). This discrepancy of larger RPE-related activity yet smaller learning rates can be explained by organizational sex differences and activational effects of circulating E2, which both affect DA release differently to DA receptor binding capacities.

The ventral striatum dissociates information expectation, reward anticipation, and reward receipt.

Do dopaminergic reward structures represent the expected utility of information similarly to a reward? Optimal experimental design models from Bayesian decision theory and statistics have proposed a theoretical framework for quantifying the expected value of information that might result from a query. In particular, this formulation quantifies the value of information before the answer to that query is known, in situations where payoffs are unknown and the goal is purely epistemic: That is, to increase knowledge about the state of the world. Whether and how such a theoretical quantity is represented in the brain is unknown. Here we use an event-related functional MRI (fMRI) task design to disentangle information expectation, information revelation and categorization outcome anticipation, and response-contingent reward processing in a visual probabilistic categorization task. We identify a neural signature corresponding to the expectation of information, involving the left lateral ventral striatum. Moreover, we show a temporal dissociation in the activation of different reward-related regions, including the nucleus accumbens, medial prefrontal cortex, and orbitofrontal cortex, during information expectation versus reward-related processing.