Motivated with joy or anxiety: Does approach-avoidance goal framing elicit differential reward-network activation in the brain?

Psychological research on human motivation repeatedly observed that approach goals (i.e., goals to attain success) increase task enjoyment and intrinsic motivation more strongly than avoidance goals (i.e., goals to avoid failure). The present study sought to address how the reward network in the brain-including the striatum and ventromedial prefrontal cortex-is involved when individuals engage in the same task with a focus on approach or avoidance goals. Participants reported stronger positive emotions when they focused on approach goals, but stronger anxiety and disappointment when they focused on avoidance goals. The fMRI analyses revealed that the reward network in the brain showed similar levels of activity to cues predictive of approach and avoidance goals. In contrast, the two goal states were associated with different patterns of activity in the visual cortex, hippocampus, and cerebellum during success and failure outcomes. Representation similarity analysis further revealed shared and different representations within the striatum and vmPFC between the approach and avoidance goal states, suggesting both the similarity and uniqueness of the mechanisms behind the two goal states. In addition, the distinct patterns of activation in the striatum were associated with distinct subjective experiences participants reported between the approach and the avoidance conditions. These results suggest the importance of examining the pattern of striatal activity in understanding the mechanisms behind different motivational states in humans.

Motivated for near impossibility: How task type and reward modulate task enjoyment and the striatal activation for extremely difficult task.

Economic and decision-making theories suppose that people would disengage from a task with near zero success probability, because this implicates little normative utility values. However, humans often are motivated for an extremely challenging task, even without any extrinsic incentives. The current study aimed to address the nature of this challenge-based motivation and its neural correlates. We found that, when participants played a skill-based task without extrinsic incentives, their task enjoyment increased as the chance of success decreased, even if the task was almost impossible to achieve. However, such challenge-based motivation was not observed when participants were rewarded for the task or the reward was determined in a probabilistic manner. The activation in the ventral striatum/pallidum tracked the pattern of task enjoyment. These results suggest that people are intrinsically motivated to challenge a nearly impossible task but only when the task requires certain skills and extrinsic rewards are unavailable.

Different types of uncertainty distinguished by monkey prefrontal neurons.

To adapt one's behavior, in a timely manner, to an environment that changes in many different aspects, one must be sensitive to uncertainty about each aspect of the environment. Although the medial prefrontal cortex has been implicated in the representation and reduction of a variety of uncertainties, it is unknown whether different types of uncertainty are distinguished by distinct neuronal populations. To investigate how the prefrontal cortex distinguishes between different types of uncertainty, we recorded neuronal activities from the medial and lateral prefrontal cortices of monkeys performing a visual feedback-based action-learning task in which uncertainty of coming feedback and that of context change varied asynchronously. We found that the activities of two groups of prefrontal cells represented the two different types of uncertainty. These results suggest that different types of uncertainty are represented by distinct neural populations in the prefrontal cortex.

Specificity and Continuity of Schizophrenia and Bipolar Disorder: Relation to Biomarkers.

Schizophrenia and bipolar disorder overlap considerably in terms of symptoms, familial patterns, risk genes, outcome, and treatment response. This article provides an overview of the specificity and continuity of schizophrenia and mood disorders on the basis of biomarkers, such as genes, molecules, cells, circuits, physiology and clinical phenomenology. Overall, the discussions herein provided support for the view that schizophrenia, schizoaffective disorder and bipolar disorder are in the continuum of severity of impairment, with bipolar disorder closer to normality and schizophrenia at the most severe end. This approach is based on the concept that examining biomarkers in several modalities across these diseases from the dimensional perspective would be meaningful. These considerations are expected to help develop new treatments for unmet needs, such as cognitive dysfunction, in psychiatric conditions.

Social Cognition Deficits as a Target of Early Intervention for Psychoses: A Systematic Review.

Backgrounds: Social cognition deficits are a core feature of schizophrenia and deteriorate functionality of patients. However, evidence is sparse for the treatment effect on social cognition impairments in the early stage of psychosis. Here, we provide a systematic review of the literature on social cognitive impairment in early psychosis in relation to its intervention. Methods: A literature search was conducted on English articles identified by Web of Science and PubMed databases, according to the guidelines of the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) statement. Results: Five papers met the inclusion criteria. Results from two studies of cognitive training and one study of modafinil indicate positive results regarding social cognition outcomes in patients with early psychosis. On the other hand, two studies with oxytocin and modafinil did not suggest such effects. Conclusions: Further research is warranted to explore the benefit of early intervention into disturbances of social cognition in psychoses.

Effects of behavioural activation on the neural circuit related to intrinsic motivation.

BACKGROUND: Behavioural activation is an efficient treatment for depression and can improve intrinsic motivation. Previous studies have revealed that the frontostriatal circuit is involved in intrinsic motivation; however, there are no data on how behavioural activation affects the frontostriatal circuit.AimsWe aimed to investigate behavioural activation-related changes in the frontostriatal circuit. METHOD: Fifty-nine individuals with subthreshold depression were randomly assigned to either the intervention or non-intervention group. The intervention group received five weekly behavioural activation sessions. The participants underwent functional magnetic resonance imaging scanning on two separate occasions while performing a stopwatch task based on intrinsic motivation. We investigated changes in neural activity and functional connectivity after behavioural activation. RESULTS: After behavioural activation, the intervention group had increased activation and connectivity in the frontostriatal region compared with the non-intervention group. The increased activation in the right middle frontal gyrus was correlated with an improvement of subjective sensitivity to environmental rewards. CONCLUSIONS: Behavioural activation-related changes to the frontostriatal circuit advance our understanding of psychotherapy-induced improvements in the neural basis of intrinsic motivation.Declaration of interestNone.

Neural Correlates for Intrinsic Motivational Deficits of Schizophrenia; Implications for Therapeutics of Cognitive Impairment.

The ultimate goal of the treatment of schizophrenia is recovery, a notion related to improvement of cognitive and social functioning. Cognitive remediation therapies (CRT), one of the most effective cognition enhancing methods, have been shown to moderately improve social functioning. For this purpose, intrinsic motivation, related to internal values such as interest and enjoyment, has been shown to play a key role. Although the impairment of intrinsic motivation is one of the characteristics of schizophrenia, its neural mechanisms remain unclear. This is related to the lack of feasible measures of intrinsic motivation, and its response to treatment. According to the self-determination theory (SDT), not only intrinsic motivation, but extrinsic motivation has been reported to enhance learning and memory in healthy subjects to some extent. This finding suggests the contribution of different types of motivation to potentiate the ability of the CRT to treat cognitive impairment of schizophrenia. In this paper, we provide a review of psychological characteristics, assessment methods, and neural correlates of intrinsic motivation in healthy subjects and patients with schizophrenia. Particularly, we focus on neuroimaging studies of intrinsic motivation, including our own. These considerations are relevant to enhancement of functional outcomes of schizophrenia.

The Neural Basis of Changing Social Norms through Persuasion.

Social norms regulate behavior, and changes in norms have a great impact on society. In most modern societies, norms change through interpersonal communication and persuasive messages found in media. Here, we examined the neural basis of persuasion-induced changes in attitude toward and away from norms using fMRI. We measured brain activity while human participants were exposed to persuasive messages directed toward specific norms. Persuasion directed toward social norms specifically activated a set of brain regions including temporal poles, temporo-parietal junction, and medial prefrontal cortex. Beyond these regions, when successful, persuasion away from an accepted norm specifically recruited the left middle temporal and supramarginal gyri. Furthermore, in combination with data from a separate attitude-rating task, we found that left supramarginal gyrus activity represented participant attitude toward norms and tracked the persuasion-induced attitude changes that were away from agreement.

Impaired prefrontal activity to regulate the intrinsic motivation-action link in schizophrenia.

A core feature of schizophrenia (SCZ) is impairment in intrinsic motivation. Although intrinsic motivation plays an important role in enhancing improvement of the social functioning, its neural mechanisms of impairment have yet to be clarified. We hypothesized that abnormal function of the frontostriatal loop consisting of the striatum and lateral prefrontal cortex (LPFC) may be related to impaired intrinsic motivation in SCZ. We tested this by comparing the brain activity measured by functional magnetic resonance imaging and behavioral parameters associated with movement, motivation, and cognitive control between 18 stable SCZ patients and 17 healthy control (HC) participants during a task that elicits intrinsic motivation. We also compared the functional connectivity during resting-state and the fractional anisotropy using diffusion tensor imaging analysis between the two groups. We adopted an enjoyable timing task to stop a stopwatch at an exact time, which in our previous study has demonstrated to elicit intrinsic motivation. Although the performance level in general was not different between groups, the SCZ group performed worse than the HC group in trials following "overshoot" errors (i.e., the response was too late). SCZ participants showed lower intrinsic motivation to the task than the HC group in an inventory report. The striatal activity during the prediction at the task cue period was consistently lower in SCZ participants than in HC. The LPFC activity at the task cue period positively correlated with intrinsic motivation and also with the rate of success following overshoot errors in the HC group, but not in the SCZ group. The LPFC activity at the task cue period was also positively correlated with the striatal activity in both groups. The striatal activity during the feedback period was not significantly different between groups. These results suggest that, unlike HC, the neural activity in the LPFC fails to mediate between prediction of hedonic events and cognitive control of action plans in SCZ, whereas the hedonic response is retained.

Coordinated activation of premotor and ventromedial prefrontal cortices during vicarious reward.

The vicarious reward we receive from watching likable others obtaining a positive outcome is a pervasive phenomenon, yet its neural correlates are poorly understood. Here, we conducted a series of functional magnetic resonance imaging experiments to test the hypothesis that the brain areas responsible for action observation and reward processing work in a coordinated fashion during vicarious reward. In the first experiment (manipulation phase), the participant was instructed to cheer for a particular player in a two-player competitive game (Rock-Paper-Scissors). This manipulation made participants feel more unity with that player and resulted in unity-related activation in the premotor area during action observation. In the following main experiment, the participant witnessed the previously cheered-for or non-cheered-for player succeed in a new solitary game (a stopwatch game). The ventromedial prefrontal cortex (vmPFC) was activated when the cheered-for player succeeded in the game but not when the other player did. Interestingly, this vmPFC activation was functionally connected with premotor activation only during the cheered-for player's success. These results suggest that vicarious reward is processed in the vmPFC-premotor network, which is activated specifically by the success of the other person with whom the individual feels unity and closeness.

The Anterior Insula Tracks Behavioral Entropy during an Interpersonal Competitive Game.

In competitive situations, individuals need to adjust their behavioral strategy dynamically in response to their opponent's behavior. In the present study, we investigated the neural basis of how individuals adjust their strategy during a simple, competitive game of matching pennies. We used entropy as a behavioral index of randomness in decision-making, because maximizing randomness is thought to be an optimal strategy in the game, according to game theory. While undergoing functional magnetic resonance imaging (fMRI), subjects played matching pennies with either a human or computer opponent in each block, although in reality they played the game with the same computer algorithm under both conditions. The winning rate of each block was also manipulated. Both the opponent (human or computer), and the winning rate, independently affected subjects' block-wise entropy during the game. The fMRI results revealed that activity in the bilateral anterior insula was positively correlated with subjects' (not opponent's) behavioral entropy during the game, which indicates that during an interpersonal competitive game, the anterior insula tracked how uncertain subjects' behavior was, rather than how uncertain subjects felt their opponent's behavior was. Our results suggest that intuitive or automatic processes based on somatic markers may be a key to optimally adjusting behavioral strategies in competitive situations.

Anatomical inputs to sulcal portions of areas 9m and 8Bm in the macaque monkey.

Neuronal activities recorded from the dorsal bank of the anterior cingulate sulcus have suggested that this cortical area is involved in control of search vs. repetition, goal-based action selection and encoding of prediction error regarding action value. In this study, to explore potential anatomical bases for these neuronal activities, we injected retrograde tracers (CTB-Alexa-488 and CTB-gold) into the dorsal bank of the anterior cingulate sulcus and examined the distribution of labeled cell bodies in macaque monkey brains. The Nissl staining showed that the cortex in the dorsal bank of the anterior cingulate sulcus has consistent layer 4 which means that the cortical region is a part of the granular prefrontal cortex. The injection site belonged to the sulcal portion of area 9m in two cases and the sulcal portion of area 8Bm in one case. In addition to the continuous distribution of labeled cells in the two areas (areas 9m and 8Bm) around the injection site, the labeled cells were densely distributed in the cingulate areas (areas 24, 32, and 23) in all the cases. The dense labeling of cells was also found in other prefrontal areas (areas 46, 10, 11, and 12) in the two cases with injection into the sulcal portion of area 9m, whereas the dense labeling of cells was found in pre-motor areas (F6 and F7) in the case with injection into the sulcal portion of area 8Bm. The dense labeling of cells in the prefrontal and premotor areas was more similar to those previously found after injections into dorsal parts of areas 9 and 8B. Subcortical distribution of labeled cells was found in the mediodorsal nucleus of thalamus, claustrum, and substantia nigra pars compacta in all the cases.

How self-determined choice facilitates performance: a key role of the ventromedial prefrontal cortex.

Recent studies have documented that self-determined choice does indeed enhance performance. However, the precise neural mechanisms underlying this effect are not well understood. We examined the neural correlates of the facilitative effects of self-determined choice using functional magnetic resonance imaging (fMRI). Participants played a game-like task involving a stopwatch with either a stopwatch they selected (self-determined-choice condition) or one they were assigned without choice (forced-choice condition). Our results showed that self-determined choice enhanced performance on the stopwatch task, despite the fact that the choices were clearly irrelevant to task difficulty. Neuroimaging results showed that failure feedback, compared with success feedback, elicited a drop in the vmPFC activation in the forced-choice condition, but not in the self-determined-choice condition, indicating that negative reward value associated with the failure feedback vanished in the self-determined-choice condition. Moreover, the vmPFC resilience to failure in the self-determined-choice condition was significantly correlated with the increased performance. Striatal responses to failure and success feedback were not modulated by the choice condition, indicating the dissociation between the vmPFC and striatal activation pattern. These findings suggest that the vmPFC plays a unique and critical role in the facilitative effects of self-determined choice on performance.

Social equality in the number of choice options is represented in the ventromedial prefrontal cortex.

A distinct aspect of the sense of fairness in humans is that we care not only about equality in material rewards but also about equality in nonmaterial values. One such value is the opportunity to choose freely among many options, often regarded as a fundamental right to economic freedom. In modern developed societies, equal opportunities in work, living, and lifestyle are enforced by antidiscrimination laws. Despite the widespread endorsement of equal opportunity, no studies have explored how people assign value to it. We used functional magnetic resonance imaging to identify the neural substrates for subjective valuation of equality in choice opportunity. Participants performed a two-person choice task in which the number of choices available was varied across trials independently of choice outcomes. By using this procedure, we manipulated the degree of equality in choice opportunity between players and dissociated it from the value of reward outcomes and their equality. We found that activation in the ventromedial prefrontal cortex (vmPFC) tracked the degree to which the number of options between the two players was equal. In contrast, activation in the ventral striatum tracked the number of options available to participants themselves but not the equality between players. Our results demonstrate that the vmPFC, a key brain region previously implicated in the processing of social values, is also involved in valuation of equality in choice opportunity between individuals. These findings may provide valuable insight into the human ability to value equal opportunity, a characteristic long emphasized in politics, economics, and philosophy.

Neural correlates of cognitive dissonance and choice-induced preference change.

According to many modern economic theories, actions simply reflect an individual's preferences, whereas a psychological phenomenon called "cognitive dissonance" claims that actions can also create preference. Cognitive dissonance theory states that after making a difficult choice between two equally preferred items, the act of rejecting a favorite item induces an uncomfortable feeling (cognitive dissonance), which in turn motivates individuals to change their preferences to match their prior decision (i.e., reducing preference for rejected items). Recently, however, Chen and Risen [Chen K, Risen J (2010) J Pers Soc Psychol 99:573-594] pointed out a serious methodological problem, which casts a doubt on the very existence of this choice-induced preference change as studied over the past 50 y. Here, using a proper control condition and two measures of preferences (self-report and brain activity), we found that the mere act of making a choice can change self-report preference as well as its neural representation (i.e., striatum activity), thus providing strong evidence for choice-induced preference change. Furthermore, our data indicate that the anterior cingulate cortex and dorsolateral prefrontal cortex tracked the degree of cognitive dissonance on a trial-by-trial basis. Our findings provide important insights into the neural basis of how actions can alter an individual's preferences.

Neural basis of the undermining effect of monetary reward on intrinsic motivation.

Contrary to the widespread belief that people are positively motivated by reward incentives, some studies have shown that performance-based extrinsic reward can actually undermine a person's intrinsic motivation to engage in a task. This "undermining effect" has timely practical implications, given the burgeoning of performance-based incentive systems in contemporary society. It also presents a theoretical challenge for economic and reinforcement learning theories, which tend to assume that monetary incentives monotonically increase motivation. Despite the practical and theoretical importance of this provocative phenomenon, however, little is known about its neural basis. Herein we induced the behavioral undermining effect using a newly developed task, and we tracked its neural correlates using functional MRI. Our results show that performance-based monetary reward indeed undermines intrinsic motivation, as assessed by the number of voluntary engagements in the task. We found that activity in the anterior striatum and the prefrontal areas decreased along with this behavioral undermining effect. These findings suggest that the corticobasal ganglia valuation system underlies the undermining effect through the integration of extrinsic reward value and intrinsic task value.

Medial prefrontal cell activity signaling prediction errors of action values.

To adapt behavior to a changing environment, one must monitor outcomes of executed actions and adjust subsequent actions accordingly. Involvement of the medial frontal cortex in performance monitoring has been suggested, but little is known about neural processes that link performance monitoring to performance adjustment. Here, we recorded from neurons in the medial prefrontal cortex of monkeys learning arbitrary action-outcome contingencies. Some cells preferentially responded to positive visual feedback stimuli and others to negative feedback stimuli. The magnitude of responses to positive feedback stimuli decreased over the course of behavioral adaptation, in correlation with decreases in the amount of prediction error of action values. Therefore, these responses in medial prefrontal cells may signal the direction and amount of error in prediction of values of executed actions to specify the adjustment in subsequent action selections.

Effects of novelty on activity of lateral and medial prefrontal neurons.

Detection of novel events is crucial for adapting to changing environments. The prefrontal cortex has been thought to be one of the areas involved in orienting attention to novel events. Here, we examined the effects of two components of novelty: context novelty, which purely happens when a familiar event occurs in an unpredicted situation or time and feature novelty, which happens by itself when an unfamiliar stimulus appears against the expectation of familiar ones. We trained monkeys on a task that included both novelty components and recorded the activity of neurons in the lateral and medial divisions of the prefrontal cortex. The responses of a substantial number of cells in both the lateral and medial divisions were enhanced when a familiar visual stimulus was presented in an unpredicted context. By contrast, enhancement of responses by the unfamiliarity of visual stimuli was observed mainly in cells in the lateral prefrontal cortex. These results suggest that the lateral and medial divisions of the prefrontal cortex are differentially involved in the control of attention triggered by novel sensory events.

Goal-based action selection and utility-based action bias.

According to artificial intelligence studies, goal-based and utility-based agents can select an action to attain a desired outcome. The goal-based agent sets a specific goal regardless of its utility at first, and selects the action that leads to that goal (goal-based action selection). The utility-based agent compares the utilities of different possible outcomes, and selects the action that causes the outcome with the highest utility (utility-based action bias). The medial prefrontal cortex is involved in implementing the goal-based action selection and the striatum is involved in implementing the utility-based action bias. Goal-based action selection may be temporarily dominant over the utility-based action bias in a new environment, whereas the utility-based action bias becomes dominant after acquisition of action utilities in the environment. This transition of dominance between the two decision systems may be enhanced by a reference-point shift based on the goal-setting process during goal-based action selection.

Representation of the spatial relationship among object parts by neurons in macaque inferotemporal cortex.

We investigated object representation in area TE, the anterior part of monkey inferotemporal (IT) cortex, with a combination of optical and extracellular recordings in anesthetized monkeys. We found neurons that respond to visual stimuli composed of naturally distinguishable parts. These neurons were sensitive to a particular spatial arrangement of parts but less sensitive to differences in local features within individual parts. Thus these neurons were activated when arbitrary local features were arranged in a particular spatial configuration, suggesting that they may be responsible for representing the spatial configuration of object images. Previously it has been reported that many neurons in area TE respond to visual features less complex than natural objects, but it has remained unclear whether these features are related to local features of object images or to more global features. These results indicate that TE neurons represent not only local features but also global features such as the spatial relationship among object parts.