Neural and Computational Mechanisms of Motivation and Decision-making.

Motivation is often thought to enhance adaptive decision-making by biasing actions toward rewards and away from punishment. Emerging evidence, however, points to a more nuanced view whereby motivation can both enhance and impair different aspects of decision-making. Model-based approaches have gained prominence over the past decade for developing more precise mechanistic explanations for how incentives impact goal-directed behavior. In this Special Focus, we highlight three studies that demonstrate how computational frameworks help decompose decision processes into constituent cognitive components, as well as formalize when and how motivational factors (e.g., monetary rewards) influence specific cognitive processes, decision-making strategies, and self-report measures. Finally, I conclude with a provocative suggestion based on recent advances in the field: that organisms do not merely seek to maximize the expected value of extrinsic incentives. Instead, they may be optimizing decision-making to achieve a desired internal state (e.g., homeostasis, effort, affect). Future investigation into such internal processes will be a fruitful endeavor for unlocking the cognitive, computational, and neural mechanisms of motivated decision-making.

Dorsal Anterior Cingulate Cortex Encodes the Integrated Incentive Motivational Value of Cognitive Task Performance.

Humans can seamlessly combine value signals from diverse motivational incentives, yet it is not well understood how these signals are "bundled" in the brain to modulate cognitive control. The dorsal ACC (dACC) is theorized to integrate motivational value dimensions in the service of goal-directed action, although this hypothesis has yet to receive rigorous confirmation. In the present study, we examined the role of human dACC in motivational incentive integration. Healthy young adult men and women were scanned with fMRI while engaged in an experimental paradigm that quantifies the combined effects of liquid (e.g., juice, neutral, saltwater) and monetary incentives on cognitive task performance. Monetary incentives modulated trial-by-trial dACC activation, whereas block-related effects of liquid incentives on dACC activity were observed. When bundled together, incentive-related dACC modulation predicted fluctuations in both cognitive performance and self-report motivation ratings. Statistical mediation analyses suggest that dACC encoded the incentives in terms of their integrated subjective motivational value, and that this value signal was most proximally associated with task performance. Finally, we confirmed that these incentive integration effects were selectively present in dACC. Together, the results support an account in which dACC integrates motivational signals to compute the expected value of goal-directed cognitive control.SIGNIFICANCE STATEMENT How are primary and secondary incentives integrated in the brain to influence goal-directed behavior? Using an innovative experimental fMRI paradigm that combines motivational incentives that have historically been studied independently between species (e.g., monetary rewards for humans, food rewards for animals), we examine the relationship between incentive motivational value and cognitive control allocation. We find evidence that the integrated incentive motivational value of combined incentives is encoded in human dorsal ACC. Further, self-reported motivational shifts mediated the effects of incentive-modulated dorsal ACC activity on task performance, revealing convergence in how self-reported and experimentally induced motivation are encoded in the human brain. Our findings may inform future translational studies examining affective/motivational and cognitive impairments in psychopathology (e.g., anxiety, depression, addiction).

Age-Related Differences in Motivational Integration and Cognitive Control.

Motivational incentives play an influential role in value-based decision-making and cognitive control. A compelling hypothesis in the literature suggests that the motivational value of diverse incentives are integrated in the brain into a common currency value signal that influences decision-making and behavior. To investigate whether motivational integration processes change during healthy aging, we tested older (N = 44) and younger (N = 54) adults in an innovative incentive integration task paradigm that establishes dissociable and additive effects of liquid (e.g., juice, neutral, saltwater) and monetary incentives on cognitive task performance. The results reveal that motivational incentives improve cognitive task performance in both older and younger adults, providing novel evidence demonstrating that age-related cognitive control deficits can be ameliorated with sufficient incentive motivation. Additional analyses revealed clear age-related differences in motivational integration. Younger adult task performance was modulated by both monetary and liquid incentives, whereas monetary reward effects were more gradual in older adults and more strongly impacted by trial-by-trial performance feedback. A surprising discovery was that older adults shifted attention from liquid valence toward monetary reward throughout task performance, but younger adults shifted attention from monetary reward toward integrating both monetary reward and liquid valence by the end of the task, suggesting differential strategic utilization of incentives. These data suggest that older adults may have impairments in incentive integration and employ different motivational strategies to improve cognitive task performance. The findings suggest potential candidate neural mechanisms that may serve as the locus of age-related change, providing targets for future cognitive neuroscience investigations.

Motivational context determines the impact of aversive outcomes on mental effort allocation.

It is well known that people will exert effort on a task if sufficiently motivated, but how they distribute these efforts across different strategies (e.g., efficiency vs. caution) remains uncertain. Past work has shown that people invest effort differently for potential positive outcomes (rewards) versus potential negative outcomes (penalties). However, this research failed to account for differences in the context in which negative outcomes motivate someone - either as punishment or reinforcement. It is therefore unclear whether effort profiles differ as a function of outcome valence, motivational context, or both. Using computational modeling and our novel Multi-Incentive Control Task, we show that the influence of aversive outcomes on one's effort profile is entirely determined by their motivational context. Participants (N:91) favored increased caution in response to larger penalties for incorrect responses, and favored increased efficiency in response to larger reinforcement for correct responses, whether positively or negatively incentivized.

An fMRI protocol for administering liquid incentives to human participants.

This protocol describes the materials and approaches for administering liquid incentives to human participants during fMRI scanning. We first describe preparation of the liquid solutions (e.g., neutral solution and saltwater) and liquid delivery setups. We then detail steps to connect the setups to the computer-controlled syringe pump in the MRI control room, followed by procedures for testing the syringe pump dispensing a liquid bolus during the task. Description of custom software and required adapters for implementing the liquid setup are included. For complete details on the use and execution of this protocol, please refer to Yee et al. (2021).

Aversive motivation and cognitive control.

Aversive motivation plays a prominent role in driving individuals to exert cognitive control. However, the complexity of behavioral responses attributed to aversive incentives creates significant challenges for developing a clear understanding of the neural mechanisms of this motivation-control interaction. We review the animal learning, systems neuroscience, and computational literatures to highlight the importance of experimental paradigms that incorporate both motivational context manipulations and mixed motivational components (e.g., bundling of appetitive and aversive incentives). Specifically, we postulate that to understand aversive incentive effects on cognitive control allocation, a critical contextual factor is whether such incentives are associated with negative reinforcement or punishment. We further illustrate how the inclusion of mixed motivational components in experimental paradigms enables increased precision in the measurement of aversive influences on cognitive control. A sharpened experimental and theoretical focus regarding the manipulation and assessment of distinct motivational dimensions promises to advance understanding of the neural, monoaminergic, and computational mechanisms that underlie the interaction of motivation and cognitive control.

Dissociable Effects of Monetary, Liquid, and Social Incentives on Motivation and Cognitive Control.

Humans are social creatures and, as such, can be motivated by aspects of social life (e.g., approval from others) to guide decision-making in everyday contexts. Indeed, a common view is that people may have stronger orientation toward social goals or incentives relative to other incentive modalities, such as food or money. However, current studies have only rarely addressed how social incentives compare to other types of rewards in motivating goal-directed behavior. The current study tested this claim; across two separate experiments, the effects of liquid and social incentives were compared in terms of their subsequent impact on task performance and self-reported affect and motivation. Critically, valenced social incentives offered both ecological validity (short video clips-Experiment 1) and continuity with prior stimuli used in the social reward and motivation literature (static images-Experiment 2) when examining their effect on behavior. Across both studies, the results replicate and extend prior work, demonstrating robust effects of liquid incentives on task performance and self-reported affect and motivation, while also supporting an interpretation of weaker motivational and affective effects for social incentives. These patterns of results highlight the complex and wide-ranging effects of social incentives and call into question the effectiveness of social incentives, relative to other incentive modalities, in motivating behavior.

Interactions of Motivation and Cognitive Control.

There is general agreement that both motivation and cognitive control play critical roles in shaping goal-directed behavior, but only recently has scientific interest focused around the question of motivation-control interactions. Here we briefly survey this literature, organizing contemporary findings around three issues: 1) whether motivation preferentially impacts cognitive control processes, 2) the neural mechanisms that underlie motivation-cognition interactions, and 3) why motivation might be relevant for overcoming the costs of control. Dopamine (DA) is discussed as a key neuromodulator in these motivation-cognition interactions. We conclude by highlighting open issues, specifically Pavlovian versus instrumental control distinctions and effects of motivational valence and conflict, which could benefit from future research attention.

Humans Integrate Monetary and Liquid Incentives to Motivate Cognitive Task Performance.

It is unequivocal that a wide variety of incentives can motivate behavior. However, few studies have explicitly examined whether and how different incentives are integrated in terms of their motivational influence. The current study examines the combined effects of monetary and liquid incentives on cognitive processing, and whether appetitive and aversive incentives have distinct influences. We introduce a novel task paradigm, in which participants perform cued task-switching for monetary rewards that vary parametrically across trials, with liquid incentives serving as post-trial performance feedback. Critically, the symbolic meaning of the liquid was held constant (indicating successful reward attainment), while liquid valence was blocked. In the first experiment, monetary rewards combined additively with appetitive liquid feedback to improve subject task performance. Aversive liquid feedback counteracted monetary reward effects in low monetary reward trials, particularly in a subset of participants who tended to avoid responding under these conditions. Self-report motivation ratings predicted behavioral performance above and beyond experimental effects. A follow-up experiment replicated the predictive power of motivation ratings even when only appetitive liquids were used, suggesting that ratings reflect idiosyncratic subjective values of, rather than categorical differences between, the liquid incentives. Together, the findings indicate an integrative relationship between primary and secondary incentives and potentially dissociable influences in modulating motivational value, while informing hypotheses regarding candidate neural mechanisms.