Disentangling effort from probability of success: Temporal dynamics of frontal midline theta in effort-based reward processing.

The ability to weigh a reward against the effort required to acquire it is critical for decision-making. However, extant experimental paradigms oftentimes confound increased effort demand with decreased reward probability, thereby obscuring neural correlates underlying these cognitive processes. To resolve this issue, we designed novel tasks that disentangled probability of success - and therefore reward probability - from effort demand. In Experiment 1, reward magnitude and effort demand were varied while reward probability was kept constant. In Experiment 2, effort demand and reward probability were varied while reward magnitude remained fixed. Electroencephalogram (EEG) data was recorded to explore how frontal midline theta (FMT; an electrophysiological index of mPFC function) and component P3 (an index of incentive salience) respond to effort demand, and reward magnitude and probability. We found no evidence that FMT tracked effort demands or net value during cue evaluation. At feedback, however, FMT power was enhanced for high compared to low effort trials, but not modulated by reward magnitude or probability. Conversely, P3 was sensitive to reward magnitude and probability at both cue and feedback phases and only integrated expended effort costs at feedback, such that P3 amplitudes continued to scale with reward magnitude and probability but were also increased for high compared to low effort reward feedback. These findings suggest that, when likelihood of success is equal, FMT power does not track net value of prospective effort-based rewards. Instead, expended cognitive effort potentiates FMT power and enhances the saliency of rewards at feedback. SIGNIFICANCE STATEMENT: The way the brain weighs rewards against the effort required to achieve them is critical for understanding motivational disorders. Current paradigms confound increased effort demand with decreased reward probability, making it difficult to disentangle neural activity associated with effort costs from those associated with reward likelihood. Here, we explored the temporal dynamics of effort-based reward (via frontal midline theta (FMT) and component P3) while participants underwent a novel paradigm that kept probability of reward constant between mental effort demand conditions. Our findings suggest that the FMT does not track net value and that expended effort enhances, instead of attenuates, the saliency of rewards.

The neural basis of effort valuation: A meta-analysis of functional magnetic resonance imaging studies.

Choosing how much effort to expend is critical for everyday decisions. While several neuroimaging studies have examined effort-based decision-making, results have been highly heterogeneous, leaving unclear which brain regions process effort-related costs and integrate them with rewards. We conducted two meta-analyses of functional magnetic resonance imaging data to examine consistent neural correlates of effort demands (23 studies, 15 maps, 549 participants) and net value (15 studies, 11 maps, 428 participants). The pre-supplementary motor area (pre-SMA) scaled positively with pure effort demand, whereas the ventromedial prefrontal cortex (vmPFC) showed the opposite effect. Moreover, regions that have been previously implicated in value integration in other cost domains, such as the vmPFC and ventral striatum, were consistently involved in signaling net value. The opposite response patterns of the pre-SMA and vmPFC imply that they are differentially involved in the representation of effort costs and value integration. These findings provide conclusive evidence that the vmPFC is a central node for net value computation and reveal potential brain targets to treat motivation-related disorders.

Acute drug effects differentially predict desire to take dextroamphetamine again for work and recreation.

RATIONALE: Misuse of dextroamphetamine occurs in work and recreational contexts. While acute drug effects broadly predict abuse liability, few studies have considered the relationship between acute effects and context. OBJECTIVES: This study examined how individual differences in acute effects of dextroamphetamine relate to desire to take dextroamphetamine again in different contexts. METHODS: This secondary analysis used data from healthy adults with no history of moderate-to-severe substance use disorder, who received oral doses of placebo and dextroamphetamine (10 and 20 mg) over 3 sessions under double-blind, randomized conditions. Subjects rated subjective effects and completed reward-related behavioral tasks. Subjects rated their desire to take dextroamphetamine again in hypothetical work and recreational contexts. Multilevel models examined within-subjects change scores (10 mg-placebo; 20 mg-placebo) to determine how subjective effects and behavioral outcomes predicted desire to take dextroamphetamine again for work versus recreation. RESULTS: Subjects reported more desire to take 20 mg dextroamphetamine again for work than for recreation. At 20 mg, there was an interaction between context and liking/wanting, such that liking/wanting predicted desire to use dextroamphetamine for work only. There was also an interaction at 20 mg between context and psychomotor speed, such that psychomotor speed predicted interest in using dextroamphetamine for recreation only. CONCLUSIONS: We found that positive subjective effects predicted desire to use dextroamphetamine again for work, while increased motor effects predicted desire to use dextroamphetamine recreationally. Hedonic effects may be perceived as advantageous when working, while increased physical energy may be preferred during recreation, suggesting that context of intended use is important when examining abuse liability.

Plasma pro- and anti-inflammatory cytokines may relate to cocaine use, cognitive functioning, and depressive symptoms in cocaine use disorder.

BACKGROUND: Inflammation is implicated in cocaine use and associated problems, including depression and cognitive impairment. OBJECTIVE: We assessed 18 cytokines, cocaine use, cognition, and depression in individuals with Cocaine Use Disorder. Our general hypothesis was that higher pro-inflammatory cytokines would relate to more cocaine use, poorer cognition, and more depression, while higher anti-inflammatory cytokines would relate to less cocaine use, better cognition, and less depression. METHODS: Data were collected from 85 individuals (76.5% male, 80% African American) aged 18-65. The ASI, Shipley-2, and BDI-II assessed frequency and duration of cocaine use, cognition, and depression. Cytokines were tested using Bio-Plex Pro™ assays. Elastic net regression identified which cytokines related to each measure, controlling for confounds. RESULTS: Lower IL-29 (B = -0.08, bootstrapped 95%CI = [-0.24,0.07]), scD163 (B = -0.11, bootstrapped 95%CI = [-0.27,0.04]), Eotaxin-1 CCL11 (B = -0.11, bootstrapped 95%CI = [-0.30,0.08]), and higher APRIL/TNFSF13 (B = 0.11, bootstrapped 95%CI = [-0.08,0.30]) related to more frequent cocaine use. Lower IL-29 (B = -0.24, bootstrapped 95% CI = [-2.26,1.79]) and IL-20 (B = -1.62, bootstrapped 95%CI = [-3.53,0.29]) related to longer duration of cocaine use. Higher Eotaxin-2 CCL24 (B = 2.79, bootstrapped 95%CI = [-0.59,6.17]) and TWEAK (B = 2.83, bootstrapped 95%CI = [-0.80,6.45]) related to better cognition. Finally, higher IL-20 (B = -1.83, bootstrapped 95%CI = [-3.70,0.04]) and Osteocalcin (B = -1.56, bootstrapped 95%CI = [-3.81,0.70]) related to lower depressive symptoms. However, none of these relationships survived bootstrapped analyses. CONCLUSION: Pro- and anti-inflammatory cytokines may relate to cocaine use, cognition, and depression, but inconsistent with our hypotheses, higher pro-inflammatory cytokines related to better functioning in several domains. Additionally, cytokines were selected at low frequencies and demonstrated weak relationships with outcomes. These preliminary findings suggest complex relationships between inflammation and cocaine use.

Dose-response effects of d-amphetamine on effort-based decision-making and reinforcement learning.

Effort-related decision-making and reward learning are both dopamine-dependent, but preclinical research suggests they depend on different dopamine signaling dynamics. Therefore, the same dose of a dopaminergic medication could have differential effects on effort for reward vs. reward learning. However, no study has tested how effort and reward learning respond to the same dopaminergic medication within subjects. The current study aimed to test the effect of therapeutic doses of d-amphetamine on effort for reward and reward learning in the same healthy volunteers. Participants (n = 30) completed the Effort Expenditure for Reward Task (EEfRT) measure of effort-related decision-making, and the Probabilistic Reward Task (PRT) measure of reward learning, under placebo and two doses of d-amphetamine (10 mg, and 20 mg). Secondarily, we examined whether the individual characteristics of baseline working memory and willingness to exert effort for reward moderated the effects of d-amphetamine. d-Amphetamine increased willingness to exert effort, particularly at low to intermediate expected values of reward. Computational modeling analyses suggested this was due to decreased effort discounting rather than probability discounting or decision consistency. Both baseline effort and working memory emerged as moderators of this effect, such that d-amphetamine increased effort more in individuals with lower working memory and lower baseline effort, also primarily at low to intermediate expected values of reward. In contrast, d-amphetamine had no significant effect on reward learning. These results have implications for treatment of neuropsychiatric disorders, which may be characterized by multiple underlying reward dysfunctions.

Using pharmacological manipulations to study the role of dopamine in human reward functioning: A review of studies in healthy adults.

Dopamine (DA) plays a key role in reward processing and is implicated in psychological disorders such as depression, substance use, and schizophrenia. The role of DA in reward processing is an area of highly active research. One approach to this question is drug challenge studies with drugs known to alter DA function. These studies provide good experimental control and can be performed in parallel in laboratory animals and humans. This review aimed to summarize results of studies using pharmacological manipulations of DA in healthy adults. 'Reward' is a complex process, so we separated 'phases' of reward, including anticipation, evaluation of cost and benefits of upcoming reward, execution of actions to obtain reward, pleasure in response to receiving a reward, and reward learning. Results indicated that i) DAergic drugs have different effects on different phases of reward; ii) the relationship between DA and reward functioning appears unlikely to be linear; iii) our ability to detect the effects of DAergic drugs varies depending on whether subjective, behavioral, imaging measures are used.

HIV Anxiety Reduction/Management Program (HAMRT): pilot randomized controlled trial.

Research has indicated that mental health disorders, particularly anxiety, predicts poorer antiretroviral medication adherence among persons living with HIV/AIDS (PLWHA). The present study tests a novel six-session Cognitive-Behavioral Therapy-based integrated treatment/management program for PLWHA with concurrent anxiety delivered in community health clinics Houston, Texas. Twenty-Seven PLWHA (Mage = 48.5, SD = 8.9, 44.4% female) were recruited for a proof-of-concept study and randomized to either an active treatment condition, or a waitlist control condition of equal length. Participants were assessed pre-randomization, at the mid-treatment time point (after three sessions for the active participants and three weeks for the control participants) and post-treatment (six sessions for active participants, six weeks for control participants). Data were examined used Bayesian multilevel models. Results indicated a reliable (99.87% posterior probability of a moderating effect) interaction between active and control groups for depressive symptoms and reliable (99.65% probability) interaction for anxiety symptoms. Results indicated an unreliable interaction for combined antiretroviral therapy adherence. These findings are discussed in terms of the feasibility and potential utility of administering an anxiety-reduction therapy program designed for PLWHA with HIV medication adherence difficulties.

Integrated cognitive behavioral therapy for comorbid cannabis use and anxiety disorders: A pilot randomized controlled trial.

Cannabis use disorder (CUD) is the most common illicit substance use disorder and individuals with CUD have high rates of comorbid anxiety disorders. Comorbidity between CUD and anxiety disorders is of public health relevance given that although motivation enhancement therapy (MET) combined with cognitive-behavioral therapy (CBT) is an efficacious intervention for CUD, outcomes are worse for patients with elevated anxiety. The current study tested the acceptability and efficacy of the integration of a transdiagnostic anxiety CBT (i.e., treatment of patients with any anxiety disorder) with MET-CBT (integrated cannabis and anxiety reduction treatment, or ICART) for CUD compared to MET-CBT alone. Treatment-seeking cannabis users (56.4% male, Mage = 23.2, 63.3% non-Hispanic White) with CUD and at least one comorbid anxiety disorder were randomly assigned to ICART (n = 27) or MET-CBT (n = 28). Patients in the ICART condition attended significantly more treatment sessions than those in the MET-CBT condition. Patients in the ICART condition were more likely to be abstinent post-treatment than those in MET-CBT. Further, treatment produced decreases in cannabis use and related problems. Notably, therapy type did not moderate the impact of treatment on frequency of use and related problems. Together, these data suggest that ICART may be at least as efficacious as a gold-standard psychosocial CUD treatment, MET-CBT, for a difficult-to-treat subpopulation of cannabis users.

Effects of an acute bout of physical exercise on reward functioning in healthy adults.

Exercise has been proposed as a treatment for several psychiatric disorders. Exercise may act in part through beneficial effects on reward functioning, as it alters neurotransmitter levels in reward-related circuits. However, there has been little investigation of the effect of exercise on reward functions in humans. We hypothesized an acute bout of exercise would increase motivation for and pleasurable responses to rewards in healthy humans. In addition, we examined possible moderators of exercise's effects, including demographics, fitness and previous exercise experience. Thirty-five participants completed exercise and sedentary control sessions in randomized, counterbalanced order on separate days. Immediately after each activity, participants completed measures of motivation for and pleasurable responses to rewards, consisting of willingness to exert effort for monetary rewards and subjective responses to emotional pictures. Exercise did not increase motivation or pleasurable responses on average. However, individuals who had been running for more years showed increases in motivation for rewards after exercise, while individuals with less years running showed decreases. Further, individuals with higher resting heart rate variability reported lower arousal in response to all emotional pictures after exercise, while individuals with low heart rate variability reported increased arousal in response to all emotional pictures after exercise. General fitness did not have similar moderating effects. In conclusion, acute exercise improved reward functioning only in individuals accustomed to that type of exercise. This suggests a possible conditioned effect of exercise on reward functioning. Previous experience with the exercise used should be examined as a possible moderator in exercise treatment trials.

The cognitive effort expenditure for rewards task (C-EEfRT): A novel measure of willingness to expend cognitive effort.

Research in animals suggests that decisions about physical versus cognitive effort have distinct neural bases, but exploration of this question in humans is hampered by lack of parallel measures of physical and cognitive effort for rewards. We developed a novel measure of willingness to exert cognitive effort for rewards, the C-EEfRT, paralleling the validated physical effort expenditure for rewards task (EEfRT). To validate the C-EEfRT we: (a) tested whether EEfRT and C-EEfRT tasks were equivalently difficult; (b) tested whether decisions on the EEfRT and C-EEfRT were equivalently responsive to changes in reward; (c) examined relationships between the C-EEfRT and anhedonia, intelligence, and working memory. Last, we tested the relationship between willingness to exert physical and cognitive effort for rewards in humans. Sixty healthy adults completed the EEfRT, the C-EEfRT, an anhedonia self-report, an intelligence test, and a working memory task. Overall willingness to exert effort was higher on the C-EEfRT than the EEfRT, particularly when reward probability and amount were low. This was despite participants perceiving the cognitive task as more difficult, and having greater difficulty completing it. Differential effects of physical fatigue may have contributed. Anhedonia was not related to effort on either measure. Working memory, but not intelligence, was associated with cognitive effort. There was a moderate relationship between cognitive and physical effort. These findings suggest the importance of measuring cognitive effort as distinct from physical effort in humans. Future studies should consider calibrating task difficulty for each individual, and exploring cognitive effort in clinical populations. (PsycINFO Database Record

Measuring appetitive conditioned responses in humans.

Clinical and preclinical findings suggest that individuals with abnormal responses to reward cues (stimuli associated with reward) may be at risk for maladaptive behaviors including obesity, addiction and depression. Our objective was to develop a new paradigm for producing appetitive conditioning using primary (food) rewards in humans, and investigate the equivalency of several outcomes previously used to measure appetitive responses to conditioned cues. We used an individualized food reward, and multimodal subjective, psychophysiological and behavioral measures of appetitive responses to a conditioned stimulus (CS) that predicted delivery of that food. We tested convergence among these measures of appetitive response, and relationships between these measures and action impulsivity, a putative correlate of appetitive conditioning. 90 healthy young adults participated. Although the paradigm produced robust appetitive conditioning in some measures, particularly psychophysiological ones, there were not strong correlations among measures of appetitive responses to the CS, as would be expected if they indexed a single underlying process. In addition, there was only one measure that related to impulsivity. These results provide important information for translational researchers interested in appetitive conditioning, suggesting that various measures of appetitive conditioning cannot be treated interchangeably.