Effort expenditure modulates feedback evaluations involving self-other agreement: evidence from brain potentials and neural oscillations.

The influence of effort expenditure on the subjective value in feedback involving material reward has been the focus of previous research. However, little is known about the impact of effort expenditure on subjective value evaluations when feedback involves reward that is produced in the context of social interaction (e.g. self-other agreement). Moreover, how effort expenditure influences confidence (second-order subjective value) in feedback evaluations remains unclear. Using electroencephalography, this study aimed to address these questions. Event-related potentials showed that, after exerting high effort, participants exhibited increased reward positivity difference in response to self-other (dis)agreement feedback. After exerting low effort, participants reported high confidence, and the self-other disagreement feedback evoked a larger P3a. Time-frequency analysis showed that the high-effort task evoked increased frontal midline theta power. In the low (vs. high)-effort task, the frontal midline delta power for self-other disagreement feedback was enhanced. These findings suggest that, at the early feedback evaluation stage, after exerting high effort, individuals exhibit an increased sensitivity of subjective value evaluation in response to self-other agreement feedback. At the later feedback evaluation stage, after completing the low-effort task, the self-other disagreement feedback violates the individuals'high confidence and leads to a metacognitive mismatch.

Reinforcement learning and the reward positivity with aversive outcomes.

The reinforcement learning (RL) theory of the reward positivity (RewP), an event-related potential (ERP) component that measures reward responsivity, suggests that the RewP should be largest when positive outcomes are unexpected and has been supported by work using appetitive outcomes (e.g., money). However, the RewP can also be elicited by the absence of aversive outcomes (e.g., shock). The limited work to-date that has manipulated expectancy while using aversive outcomes has not supported the predictions of RL theory. Nonetheless, this work has been difficult to reconcile with the appetitive literature because the RewP was not observed as a reward signal in these studies, which used passive tasks that did not involve participant choice. Here, we tested the predictions of the RL theory by manipulating expectancy in an active/choice-based threat-of-shock doors task that was previously found to elicit the RewP as a reward signal. Moreover, we used principal components analysis to isolate the RewP from overlapping ERP components. Eighty participants viewed pairs of doors surrounded by a red or green border; shock delivery was expected (80%) following red-bordered doors and unexpected (20%) following green-bordered doors. The RewP was observed as a reward signal (i.e., no shock > shock) that was not potentiated for unexpected feedback. In addition, the RewP was larger overall for unexpected (vs expected) feedback. Therefore, the RewP appears to reflect the additive (not interactive) effects of reward and expectancy, challenging the RL theory of the RewP, at least when reward is defined as the absence of an aversive outcome.

Reward positivity affects temporal interval production in a continuous timing task.

The neural circuits of reward processing and interval timing (including the perception and production of temporal intervals) are functionally intertwined, suggesting that it might be possible for momentary reward processing to influence subsequent timing behavior. Previous animal and human studies have mainly focused on the effect of reward on interval perception, whereas its impact on interval production is less clear. In this study, we examined whether feedback, as an example of performance-contingent reward, biases interval production. We recorded EEG from 20 participants while they engaged in a continuous drumming task with different realistic tempos (1728 trials per participant). Participants received color-coded feedback after each beat about whether they were correct (on time) or incorrect (early or late). Regression-based EEG analysis was used to unmix the rapid occurrence of a feedback response called the reward positivity (RewP), which is traditionally observed in more slow-paced tasks. Using linear mixed modeling, we found that RewP amplitude predicted timing behavior for the upcoming beat. This performance-biasing effect of the RewP was interpreted as reflecting the impact of fluctuations in reward-related anterior cingulate cortex activity on timing, and the necessity of continuous paradigms to make such observations was highlighted.

Does effort increase or decrease reward valuation? Considerations from cognitive dissonance theory.

The present research tested the effect of manipulated perceived control (over obtaining the outcomes) and effort on reward valuation using the event-related potential known as the Reward Positivity (RewP). This test was conducted in an attempt to integrate two research literatures with opposite findings: Effort justification occurs when high effort leads to high reward valuation, whereas effort discounting occurs when high effort leads to low reward valuation. Based on an examination of past methods used in these literatures, we predicted that perceived control and effort would interactively influence RewP. Consistent with the effort justification literature (cognitive dissonance theory), when individuals have high perceived control, high effort should lead to more reward valuation than low effort should. Consistent with the effort discounting literature, when individuals have low perceived control, low effort should lead to more reward valuation than high effort should. Results supported these interactive and integrative predictions.

The impact of stress on the risk decision-making process.

The effect of stress on risk-taking or risk-averse behavior in decision-making has been inconclusive in previous research, with few studies revealing the underlying neural mechanisms. This study employed event-related potentials technique and combined a social cold pressor assessment test with a mental arithmetic task to induce stress responses, aiming to investigate the influence of exogenous stress on the risk decision-making process. Stress induction results indicated that, in addition to raising heart rate and blood pressure, stress responses were accompanied by enhanced negative emotions, diminished positive emotions, and alterations in neural activity. The outcomes of risk decision-making showed that stress did not significantly affect risk preference or time of choice but did reduce the feedback-related negativity/reward positivity, with a particularly significant effect observed for large outcomes. Stress also altered the amplitude of the P3 component, with stress decreasing the P3 value for winning outcomes relative to losing outcomes. The study suggests that understanding how stress affects risk preference should consider the emotional valence induced by stress. Contrary to the reward sensitivity hypothesis, stress weakened reward sensitivity. Stress led to changes in the allocation of cognitive resources for outcome evaluation: compared to negative outcomes, stress reduced cognitive resources for positive outcomes, which might be related to the enhanced negative emotions induced by stress. The study highlights the importance of focusing on the subjective emotional experience induced by stress in future research on stress and risk decision-making.

Behavioral and psychiatric correlates of brain responses to social feedback.

Maladaptive responses to peer acceptance and rejection arise in numerous psychiatric disorders in adolescence; yet, homogeneity and heterogeneity across disorders suggest common and unique mechanisms of impaired social function. We tested the hypothesis that social feedback is processed similarly to other forms of feedback (e.g., monetary) by examining the correspondence between the brain's response to social acceptance and rejection and behavioral performance on a separate reward and loss task. We also examined the relationship between these brain responses and depression and social anxiety severity. The sample consisted of one hundred and thirteen 16-21-year olds who received virtual peer acceptance/rejection feedback in an event-related potential (ERP) task. We used temporospatial principal component analysis and identified a component consistent with the reward positivity (RewP) or feedback negativity (FN). RewP to social acceptance was not significantly related to reward bias or the FN to social rejection related to loss avoidance. The relationship between RewP and depression severity, while nonsignificant, was of a similar magnitude to prior studies. Exploratory analyses yielded a significant relationship between lower socioeconomic status (SES) and blunted RewP and between lower SES and heightened loss avoidance and blunted reward bias. These findings build on prior work to improve our understanding of the function of the brain's response to social feedback, while also suggesting a pathway for further study, whereby poverty leads to depression via social and reward learning mechanisms.

Neurocognitive reward processes measured via event-related potentials are associated with binge-eating disorder diagnosis and ecologically-assessed behavior.

Altered reward processing has been implicated in the onset and maintenance of binge-eating disorder (BED). However, it is unclear which precise neurocognitive reward processes may contribute to BED. In the present study, 40 individuals with BED and 40 age-, sex-, and BMI-matched controls completed a reward (incentive delay) task while their neural activity was recorded using electroencephalography (EEG). Individuals with BED also completed a 10-day ecological momentary assessment (EMA) protocol assessing binge-eating behavior in the natural environment. Event-related potential (ERP) analysis of the EEG indicated that individuals with BED had stronger anticipatory (CNV) and outcome-related (RewP) neural reward activity to food and monetary rewards, compared to controls. However, within the BED group, greater frequency of binge eating during the EMA protocol was associated with stronger anticipatory (CNV) but weaker outcome-related (RewP) neural reward activity. These associations within the BED group were unique to food, and not monetary, rewards. Although preliminary, these results suggest that both anticipatory ("wanting") and outcome ("liking") reward processes may be generally amplified in BED. However, they also suggest that among individuals with BED, disorder severity may be associated with increased anticipatory reward processes ("wanting"), but relatively decreased reward-outcome processing ("liking"), of food rewards specifically.

Risk factors for the intergenerational transmission of depression in women and girls: Understanding neural correlates of major depressive disorder and the role of early-onset maternal depression.

Deficits in neural reward processing have been implicated in the etiology of depression and have been observed in high-risk individuals. However, depression is a heterogeneous disorder, and not all depressed individuals exhibit blunted neural reward response, suggesting the need to examine more specific depression phenotypes. Early-onset depression, a well-defined phenotype, has been associated with greater intergenerational transmission of depression and appears more closely linked to neural reward processing deficits. The present study examined whether a maternal history of early-onset depression was associated with neural reward response among mothers and their daughters. Mothers with and without a history of depression, as well as their biological, adolescent daughters (N = 109 dyads), completed a monetary reward guessing task while electroencephalogram was collected. Analyses focused on the Reward Positivity (RewP), an event-related potential following reward receipt. Adjusting for current depressive symptoms, maternal early-onset depression was associated with a blunted RewP in the mothers and a numerically smaller RewP in their never-depressed, adolescent daughters. Maternal adult-onset depression was not statistically associated with a blunted RewP in mothers or daughters. Thus, a blunted RewP appears to be a trait-like vulnerability marker for depression that emerges before depression onset and relates to more specific depression phenotypes (e.g., early-onset depression). These findings have implications for early identification of individuals at risk of depression and for developing more targeted interventions.

Cumulative lifetime acute stressor exposure interacts with reward responsiveness to predict longitudinal increases in depression severity in adolescence.

BACKGROUND: Life stress and blunted reward processing each have been associated with the onset and maintenance of major depressive disorder. However, much of this work has been cross-sectional, conducted in separate lines of inquiry, and focused on recent life stressor exposure, despite the fact that theories of depression posit that stressors can have cumulative effects over the lifespan. To address these limitations, we investigated whether acute and chronic stressors occurring over the lifespan interacted with blunted reward processing to predict increases in depression over time in healthy youth. METHOD: Participants were 245 adolescent girls aged 8-14 years old (Mage = 12.4, s.d. = 1.8) who were evaluated at baseline and two years later. The reward positivity (RewP), an event-related potential measure of reward responsiveness, was assessed at baseline using the doors task. Cumulative lifetime exposure to acute and chronic stressors was assessed two years later using the Stress and Adversity Inventory for Adolescents (Adolescent STRAIN). Finally, depressive symptoms were assessed at both baseline and follow-up using the Children's Depression Inventory. RESULTS: As hypothesized, greater lifetime acute stressor exposure predicted increases in depressive symptoms over two years, but only for youth exhibiting a blunted RewP. This interaction, however, was not found for chronic stressors. CONCLUSIONS: Lifetime acute stressor exposure may be particularly depressogenic for youth exhibiting a blunted RewP. Conversely, a robust RewP may be protective in the presence of greater acute lifetime stressor exposure.

A comparison of reward processing during Becker-DeGroot-Marschak and Vickrey auctions: An ERP study.

Vickrey auctions (VA) and Becker-DeGroot-Marschak auctions (BDM) are strategically equivalent demand-revealing mechanisms, differentiated only by a human opponent in the VA, and a random-number-generator opponent in the BDM. Game parameters are such that players are incentivized to reveal their private subjective values (SV) and behavior should be identical in both tasks. However, this has been repeatedly shown not to be the case. In this study, the neural correlates of outcome feedback processing during VA and BDM were directly compared using electroencephalography. Twenty-eight healthy participants bid for household products which were then divided into high- and low-SV categories. The VA included a human opponent deception to induce a social environment, while in reality a random-number-generator was used in both tasks. A P3 component peaking at 336 ms over midline parietal sites showed more positive amplitudes for high bid values, and for win outcomes in the VA but not the BDM. Both auctions also elicited a Reward Positivity potential, maximal at 275 ms along the central midline electrodes, that was not modulated by auction task or SV. Further, an exploratory N170 potential in the right occipitotemporal electrodes and a vertex positive potential component were stronger in the VA relative to the BDM. Results point to an enhanced cortical response to bid outcomes during VA task in a potential component associated with emotional control, and to the occurrence of face-sensitive potentials in VA but not in BDM auction. These findings suggest modulation of bid outcome processing by the social-competitive aspect of auction tasks. Directly comparing two prominent auction paradigms affords the opportunity to isolate the impact of social environment on competitive, risky decision-making. Findings suggest that feedback processing as early as 176 ms is facilitated by the presence of a human competitor, and later processing is modulated by social context and subjective value.

The reward positivity shows increased amplitude and decreased latency with increasing age in early childhood.

The reward positivity (RewP) is a widely studied measure of neural response to rewards, yet little is known about normative developmental characteristics of the RewP during early childhood. The present study utilized a pooled community sample of 309 4- to 6-year-old children who participated in the Doors guessing game to examine the latency and amplitude of the RewP. Peak detection of the gain-loss difference waveform was conducted for electrodes Fz, Cz, Pz, Oz and the mean activity in a 100 ms window centered around this peak was analyzed. There was a significant decrease in RewP latency (RewP was earlier) and increase in RewP amplitude (RewP magnitude was larger) with advancing age in this cross-sectional analysis. Further, these were independent effects, as both RewP latency and RewP amplitude were uniquely associated with children's age. Moreover, our results indicate that the RewP latency in 4- to 6-year-olds falls outside the 250-350 ms window typically used to quantify the RewP (RewP latency in our sample = 381 ms; SD = 60.15). The internal consistency for latency (.64) and amplitude (.27) of the RewP were characterized by moderate to low reliability, consistent with previous work on the reliability of difference scores. Overall, results demonstrate RewP differences in both timing and amplitude across age in early childhood, and suggest that both amplitude and latency of the RewP might function as individual difference measures of reward processing. These findings are discussed in the context of methodological considerations and the development of reward processing across early childhood.

Reward, Salience, and Agency in Event-Related Potentials for Appetitive and Aversive Contexts.

Cognitive architectures tasked with swiftly and adaptively processing biologically important events are likely to classify these on two central axes: motivational salience, that is, those events' importance and unexpectedness, and motivational value, the utility they hold, relative to that expected. Because of its temporal precision, electroencephalography provides an opportunity to resolve processes associated with these two axes. A focus of attention for the last two decades has been the feedback-related negativity (FRN), a frontocentral component occurring 240-340 ms after valenced events that are not fully predicted. Both motivational salience and value are present in such events and competing claims have been made for which of these is encoded by the FRN. The present study suggests that motivational value, in the form of a reward prediction error, is the primary determinant of the FRN in active contexts, while in both passive and active contexts, a weaker and earlier overlapping motivational salience component may be present.

Associations between peer stress in early adolescence and multiple event-related potentials elicited during social feedback processing.

Interpersonal stress in adolescence has been associated with alterations in neural responses to peer feedback, and increased vulnerability to psychopathology. However, it is unclear whether the associations of interpersonal problems with neural responses are global across event-related potentials (ERPs) or might result in alterations only in specific ERPs. We examined associations between multiple informants of peer stress (self-reported, parent-reported, and peer-reported) and multiple ERPs (N1, P2, RewP, and LPP) to social feedback in a sample of 46 early adolescents (aged 12-13 years). Reports of peer stress were only moderately correlated with one another, indicating different informants capture different aspects of peer stress. Regressions using informant reports to predict ERPs revealed greater parent-reported peer stress was associated with a smaller RewP, whereas self-reported stress was associated with a smaller P2, to acceptance. In contrast, greater peer-reported stress was associated with larger P2, RewP, and LPP to acceptance. Findings suggest that different sources of stress measurement are differentially associated with ERPs. Future research using social feedback-related ERPs should consider multiple sources of information as well as multiple ERP components across the time-course of feedback processing, to gain a clearer understanding of the effects of peer stress on neural responses to feedback.

Reduced neural response to reward and pleasant pictures independently relate to depression.

BACKGROUND: Multiple studies have found a reduced reward positivity (RewP) among individuals with major depressive disorder (MDD). Event-related potential studies have also reported blunted neural responses to pleasant pictures in MDD as reflected by the late positive potential (LPP). These deficits have been interpreted broadly in terms of anhedonia and decreased emotional engagement characteristic of depression. METHODS: In the current study, a community-based sample of 83 participants with current MDD and 45 healthy individuals performed both a guessing task and a picture viewing paradigm with neutral and pleasant pictures to assess the RewP and the LPP, respectively. RESULTS: We found that both RewP and LPP to pleasant pictures were reduced in the MDD group; moreover, RewP and LPP were both independent predictors of MDD status. Within the MDD group, a smaller RewP predicted impaired mood reactivity in younger but not older participants. Smaller LPP amplitudes were associated with increased anhedonia severity in the MDD group. CONCLUSIONS: These data replicate and merge separate previous lines of research, and suggest that a blunted RewP and LPP reflect independent neural deficits in MDD - which could be used in conjunction to improve the classification of depression.

Stressful life events moderate the effect of neural reward responsiveness in childhood on depressive symptoms in adolescence.

BACKGROUND: Reward processing deficits have been implicated in the etiology of depression. A blunted reward positivity (RewP), an event-related potential elicited by feedback to monetary gain relative to loss, predicts new onsets and increases in depression symptoms. Etiological models of depression also highlight stressful life events. However, no studies have examined whether stressful life events moderate the effect of the RewP on subsequent depression symptoms. We examined this question during the key developmental transition from childhood to adolescence. METHODS: A community sample of 369 children (mean age of 9) completed a self-report measure of depression symptoms. The RewP to winning v. losing was elicited using a monetary reward task. Three years later, we assessed stressful life events occurring in the year prior to the follow-up. Youth depressive symptoms were rated by the children and their parents at baseline and follow-up. RESULTS: Stressful life events moderated the effect of the RewP on depression symptoms at follow-up such that a blunted RewP predicted higher depression symptoms in individuals with higher levels of stressful life events. This effect was also evident when events that were independent of the youth's behavior were examined separately. CONCLUSIONS: These results suggest that the RewP reflects a vulnerability for depression that is activated by stress.

Reward-Related Brain Activity Mediates the Relationship Between Decision-Making Deficits and Pediatric Depression Symptom Severity.

BACKGROUND: The mechanisms that link neural and behavioral indices of reduced reward sensitivity in depression, particularly in children, remain unclear. Reward positivity (RewP), a neural index of reward processing, has been consistently associated with depression. Separately, recent studies using the drift-diffusion model on behavioral data have delineated computational indices of reward sensitivity. Therefore, in the current study, we examined whether RewP is a neural mediator of drift-diffusion model-based indices of reward processing in predicting pediatric depression across varying levels of symptom severity. METHODS: A community sample of 166 girls, ages 8 to 14 years, completed 2 tasks. The first was a reward guessing task from which RewP was computed using electroencephalography; the second was a probabilistic reward-based decision-making task. On this second task, drift-diffusion model analysis was applied to behavioral data to quantify the efficiency of accumulating reward-related evidence (drift rate) and potential baseline bias (starting point) toward the differently rewarded choices. Depression severity was measured using the self-report Children's Depression Inventory. RESULTS: RewP was correlated with drift rate, but not starting point bias, toward the more rewarded choice. Furthermore, RewP completely mediated the association between a slower drift rate toward the more rewarded option and higher depression symptom severity. CONCLUSIONS: Our findings suggest that reduced neural sensitivity to reward feedback may be a neural mechanism that underlies behavioral insensitivity to reward in children and adolescents with higher depression symptom severity, offering novel insights into the relationship between neural and computational indices of reward processing in this context.

Prediction-error-dependent processing of immediate and delayed positive feedback.

Learning often involves trial-and-error, i.e. repeating behaviours that lead to desired outcomes, and adjusting behaviour when outcomes do not meet our expectations and thus lead to prediction errors (PEs). PEs have been shown to be reflected in the reward positivity (RewP), an event-related potential (ERP) component between 200 and 350 ms after performance feedback which is linked to striatal processing and assessed via electroencephalography (EEG). Here we show that this is also true for delayed feedback processing, for which a critical role of the hippocampus has been suggested. We found a general reduction of the RewP for delayed feedback, but the PE was similarly reflected in the RewP and the later P300 for immediate and delayed positive feedback, while no effect was found for negative feedback. Our results suggest that, despite processing differences between immediate and delayed feedback, positive PEs drive feedback processing and learning irrespective of delay.

The reward positivity mediates the association between adverse childhood experiences and anhedonia in young adults with drug-naïve major depressive disorder.

BACKGROUND: Current clinical studies have indicated that major depressive disorder (MDD) with adverse childhood experiences (ACEs) is associated with greater anhedonia. However, little is known about whether the change in reward sensitivity among young MDD individuals with ACEs are related to anhedonia. METHODS: We evaluated anhedonia and ACEs of each patient. Then, we performed Iowa gambling task during EEG to measure the reward positivity (RewP) and its difference (ΔRewP) in 86 MDD patients (31 with no or one ACE and 55 with two or more ACEs) and 44 healthy controls (HCs). Furthermore, we constructed a mediation model to assessed whether aberrant ΔRewP could mediate the relationship between ACEs and anhedonia. RESULTS: Compared with healthy controls and MDD patients with no or one ACE, MDD patients with two or more ACEs had the most severe symptoms of anhedonia and impaired decision-making, and showed significantly reduced reward sensitivity (most blunted ΔRewP). More importantly, ΔRewP mediated relationship between ACEs and anhedonia in MDD. CONCLUSIONS: We found that the ΔRewP partially mediates the association between ACEs and anhedonia in MDD patients, which provides evidence for the neurobiological basis of abnormal changes in the reward system in MDD individuals with early adverse experiences.

Severe sexual abuse in childhood and altered neurophysiological response to reward in female adults.

BACKGROUND: A relatively understudied but growing body of research indicates that individuals with a history of childhood trauma exhibit altered reward processing in adulthood. Research to date has focused on adversity broadly, with studies typically finding evidence of blunted response to rewards in adults with a history of childhood trauma. OBJECTIVE: Given the role of reward processing in risk for psychopathology and the particularly pathogenic nature of sexual abuse (SA), the present study sought to assess whether adults with a history of severe childhood SA exhibit altered neurophysiological response to rewards. PARTICIPANTS AND SETTING: Female adults (N = 105) were included from two study sites that used the same measures of childhood trauma (Childhood Trauma Questionnaire, CTQ), reward processing (Doors Task), and psychopathology (SCID). METHODS: Based on participants' CTQ and SCID responses, three groups were created: Severe SA (n = 36), Clinical Match (with comparable lifetime psychopathology but no-to-minimal SA history; n = 35), and Healthy Controls (n = 34). Group differences in RewP amplitude were assessed. RESULTS: The Severe SA group exhibited larger reward positivity (RewP) amplitude to monetary rewards than the Clinical Match and Healthy Control groups (partial ƞ2 = 0.06, p = .047). This effect remained after covarying for severity of other forms of childhood trauma. CONCLUSIONS: Our study found that severe SA in childhood was related to a heightened response to reward in adulthood. Furthermore, this was not attributable to the severity of other forms of early trauma or comorbid psychopathology. Future studies are needed to identify how heightened reward processing following severe childhood SA may be implicated in the onset and course of psychopathology.

Is providing choices always a good thing? the backfire effect of providing choices on competence restoration.

Grounded in self-determination theory (SDT), the purpose of this research is to investigate the influence of providing choices following competence frustration on one's intrinsic motivation in a follow-up task. Study 1 conducted a between-group EEG experiment with 50 participants and used a component of event-related potentials (ERPs) to represent intrinsic motivation. Study 2 was a behavioural experiment with 149 participants, adopting the self-report method to measure intrinsic motivation. The stimuli and procedure in Study 1 are identical to Study 2. All participants were asked to complete a high-difficult time-estimation (TE) task during sessions 1-2, and a moderate-difficult stopwatch (SW) task during session 3 (no choices in the control group vs. providing choices in the experimental group). In Study 1, we observed a smaller reward positivity (RewP) difference wave in the experimental (vs. control) group during session 3. In Study 2, participants' intrinsic motivation in the experimental (vs. control) group is significantly lower. The results suggest that providing choices impairs the competence-frustrated participants' intrinsic motivation in the follow-up task and hinders competence restoration. Thus, the current research contributes original neuroscientific and subjective evidences for the adverse influence of providing choices on the competence-frustrated individual's intrinsic motivation, and suggests important practical implications.