Similar network compositions, but distinct neural dynamics underlying belief updating in environments with and without explicit outcomes.

Classic decision theories typically assume the presence of explicit value-based outcomes after action selections to update beliefs about action-outcome contingencies. However, ecological environments are often opaque, and it remains unclear whether the neural dynamics underlying belief updating vary under conditions characterized by the presence or absence of such explicit value-based information, after each choice selection. We investigated this question in healthy humans (n = 28) using Bayesian inference and two multi-option fMRI tasks: a multi-armed bandit task, and a probabilistic perceptual task, respectively with and without explicit value-based feedback after choice selections. Model-based fMRI analysis revealed a network encoding belief updating which did not change depending on the task. More precisely, we found a confidence-building network that included anterior hippocampus, amygdala, and medial prefrontal cortex (mPFC), which became more active as beliefs about action-outcome probabilities were confirmed by newly acquired information. Despite these consistent responses across tasks, dynamic causal modeling estimated that the network dynamics changed depending on the presence or absence of trial-by-trial value-based outcomes. In the task deprived of immediate feedback, the hippocampus increased its influence towards both amygdala and mPFC, in association with increased strength in the confidence signal. However, the opposite causal relations were found (i.e., from both mPFC and amygdala towards the hippocampus), in presence of immediate outcomes. This finding revealed an asymmetric relationship between decision confidence computations, which were based on similar computational models across tasks, and neural implementation, which varied depending on the availability of outcomes after choice selections.

A change of mind: Globus pallidus activity and effective connectivity during changes in choice selections.

The basal ganglia are a group of interconnected subcortical nuclei that plays a key role in multiple motor and cognitive processes, in a close interplay with several cortical regions. Two conflicting theories postulate that the basal ganglia pathways can either foster or suppress the cortico-striatal output or, alternatively, they can stabilize or destabilize the cortico-striatal circuit dynamics. These different approaches significantly impact the understanding of observable behaviours and cognitive processes in healthy, as well as clinical populations. We investigated the predictions of these models in healthy participants (N = 28), using dynamic causal modeling of fMRI BOLD activity to estimate time- and context-dependent changes in the indirect pathway effective connectivity, in association with repetitions or changes of choice selections. We used two multi-option tasks that required the participants to adapt to uncontrollable environmental changes, by performing sequential choice selections, with and without value-based feedbacks. We found that, irrespective of the task, the trials that were characterized by changes in choice selections (switch trials) were associated with a neural response that mostly overlapped with a network commonly described for the encoding of uncertainty. More interestingly, dynamic causal modeling and family-wise model comparison identified with high likelihood a directed causal relation from the external to the internal part of the globus pallidus (i.e., the short indirect pathway in the basal ganglia), in association with the switch trials. This finding supports the hypothesis that the short indirect pathway in the basal ganglia drives instability in the network dynamics, resulting in changes in choice selection.

An insula-driven network computes decision uncertainty and promotes abstinence in chronic cocaine users.

The anterior insular cortex (AIC) and its interconnected brain regions have been associated with both addiction and decision-making under uncertainty. However, the causal interactions in this uncertainty-encoding neurocircuitry and how these neural dynamics impact relapse remain elusive. Here, we used model-based fMRI to measure choice uncertainty in a motor decision task in 61 individuals with cocaine use disorder (CUD) and 25 healthy controls. CUD participants were assessed before discharge from a residential treatment program and followed for up to 24 weeks. We found that choice uncertainty was tracked by the AIC, dorsal anterior cingulate cortex (dACC) and ventral striatum (VS), across participants. Stronger activations in these regions measured pre-discharge predicted longer abstinence after discharge in individuals with CUD. Dynamic causal modeling revealed an AIC-to-dACC-directed connectivity modulated by uncertainty in controls, but a dACC-to-AIC connectivity in CUD participants. This reversal was mostly driven by early relapsers (<30 days). Furthermore, CUD individuals who displayed a stronger AIC-to-dACC excitatory connection during uncertainty encoding remained abstinent for longer periods. These findings reveal a critical role of an AIC-driven, uncertainty-encoding neurocircuitry in protecting against relapse and promoting abstinence.

Value encoding in the globus pallidus: fMRI reveals an interaction effect between reward and dopamine drive.

The external part of the globus pallidus (GPe) is a core nucleus of the basal ganglia (BG) whose activity is disrupted under conditions of low dopamine release, as in Parkinson's disease. Current models assume decreased dopamine release in the dorsal striatum results in deactivation of dorsal GPe, which in turn affects motor expression via a regulatory effect on other nuclei of the BG. However, recent studies in healthy and pathological animal models have reported neural dynamics that do not match with this view of the GPe as a relay in the BG circuit. Thus, the computational role of the GPe in the BG is still to be determined. We previously proposed a neural model that revisits the functions of the nuclei of the BG, and this model predicts that GPe encodes values which are amplified under a condition of low striatal dopaminergic drive. To test this prediction, we used an fMRI paradigm involving a within-subject placebo-controlled design, using the dopamine antagonist risperidone, wherein healthy volunteers performed a motor selection and maintenance task under low and high reward conditions. ROI-based fMRI analysis revealed an interaction between reward and dopamine drive manipulations, with increased BOLD activity in GPe in a high compared to low reward condition, and under risperidone compared to placebo. These results confirm the core prediction of our computational model, and provide a new perspective on neural dynamics in the BG and their effects on motor selection and cognitive disorders.

Heightened brain response to pain anticipation in high-functioning adults with autism spectrum disorder.

Autism spectrum disorder (ASD) is marked by both socio-communicative difficulties and abnormalities in sensory processing. Much of the work on sensory deficits in ASD has focused on tactile sensations and the perceptual aspects of somatosensation, such as encoding of stimulus intensity and location. Although aberrant pain processing has often been noted in clinical observations of patients with ASD, it remains largely uninvestigated. Importantly, the neural mechanism underlying higher order cognitive aspects of pain processing such as pain anticipation also remains unknown. Here we examined both pain perception and anticipation in high-functioning adults with ASD and matched healthy controls (HC) using an anticipatory pain paradigm in combination with functional magnetic resonance imaging (fMRI) and concurrent skin conductance response (SCR) recording. Participants were asked to choose a level of electrical stimulation that would feel moderately painful to them. Compared to HC group, ASD group chose a lower level of stimulation prior to fMRI. However, ASD participants showed greater activation in both rostral and dorsal anterior cingulate cortex during the anticipation of stimulation, but not during stimulation delivery. There was no significant group difference in insular activation during either pain anticipation or perception. However, activity in the left anterior insula correlated with SCR during pain anticipation. Taken together, these results suggest that ASD is marked with aberrantly higher level of sensitivity to upcoming aversive stimuli, which may reflect abnormal attentional orientation to nociceptive signals and a failure in interoceptive inference.

Belief about nicotine selectively modulates value and reward prediction error signals in smokers.

Little is known about how prior beliefs impact biophysically described processes in the presence of neuroactive drugs, which presents a profound challenge to the understanding of the mechanisms and treatments of addiction. We engineered smokers' prior beliefs about the presence of nicotine in a cigarette smoked before a functional magnetic resonance imaging session where subjects carried out a sequential choice task. Using a model-based approach, we show that smokers' beliefs about nicotine specifically modulated learning signals (value and reward prediction error) defined by a computational model of mesolimbic dopamine systems. Belief of "no nicotine in cigarette" (compared with "nicotine in cigarette") strongly diminished neural responses in the striatum to value and reward prediction errors and reduced the impact of both on smokers' choices. These effects of belief could not be explained by global changes in visual attention and were specific to value and reward prediction errors. Thus, by modulating the expression of computationally explicit signals important for valuation and choice, beliefs can override the physical presence of a potent neuroactive compound like nicotine. These selective effects of belief demonstrate that belief can modulate model-based parameters important for learning. The implications of these findings may be far ranging because belief-dependent effects on learning signals could impact a host of other behaviors in addiction as well as in other mental health problems.

Necessary, yet dissociable contributions of the insular and ventromedial prefrontal cortices to norm adaptation: computational and lesion evidence in humans.

Social norms and their enforcement are fundamental to human societies. The ability to detect deviations from norms and to adapt to norms in a changing environment is therefore important to individuals' normal social functioning. Previous neuroimaging studies have highlighted the involvement of the insular and ventromedial prefrontal (vmPFC) cortices in representing norms. However, the necessity and dissociability of their involvement remain unclear. Using model-based computational modeling and neuropsychological lesion approaches, we examined the contributions of the insula and vmPFC to norm adaptation in seven human patients with focal insula lesions and six patients with focal vmPFC lesions, in comparison with forty neurologically intact controls and six brain-damaged controls. There were three computational signals of interest as participants played a fairness game (ultimatum game): sensitivity to the fairness of offers, sensitivity to deviations from expected norms, and the speed at which people adapt to norms. Significant group differences were assessed using bootstrapping methods. Patients with insula lesions displayed abnormally low adaptation speed to norms, yet detected norm violations with greater sensitivity than controls. Patients with vmPFC lesions did not have such abnormalities, but displayed reduced sensitivity to fairness and were more likely to accept the most unfair offers. These findings provide compelling computational and lesion evidence supporting the necessary, yet dissociable roles of the insula and vmPFC in norm adaptation in humans: the insula is critical for learning to adapt when reality deviates from norm expectations, and that the vmPFC is important for valuation of fairness during social exchange.

Mindfulness training increases cooperative decision making in economic exchanges: Evidence from fMRI.

Emotions have been shown to exert influences on decision making during economic exchanges. Here we investigate the underlying neural mechanisms of a training regimen which is hypothesized to promote emotional awareness, specifically mindfulness training (MT). We test the hypothesis that MT increases cooperative economic decision making using fMRI in a randomized longitudinal design involving 8weeks of either MT or active control training (CT). We find that MT results in an increased willingness to cooperate indexed by higher acceptance rates to unfair monetary offers in the Ultimatum Game. While controlling for acceptance rates of monetary offers between intervention groups, subjects in the MT and CT groups show differential brain activation patterns. Specifically, a subset of more cooperative MT subjects displays increased activation in the septal region, an area linked to social attachment, which may drive the increased willingness to express cooperative behavior in the MT cohort. Furthermore, MT resulted in attenuated activity in anterior insula compared with the CT group in response to unfair monetary offers post-training, which may suggest that MT enables greater ability to effectively regulate the anterior insula and thereby promotes social cooperation. Finally, functional connectivity analyses show a coupling between the septal region and posterior insula in the MT group, suggesting an integration of interoceptive inputs. Together, these results highlight that MT may be employed in contexts where emotional regulation is required to promote social cooperation.

Autonomic and brain responses associated with empathy deficits in autism spectrum disorder.

Accumulating evidence suggests that autonomic signals and their cortical representations are closely linked to emotional processes, and that related abnormalities could lead to social deficits. Although socio-emotional impairments are a defining feature of autism spectrum disorder (ASD), empirical evidence directly supporting the link between autonomic, cortical, and socio-emotional abnormalities in ASD is still lacking. In this study, we examined autonomic arousal indexed by skin conductance responses (SCR), concurrent cortical responses measured by functional magnetic resonance imaging, and effective brain connectivity estimated by dynamic causal modeling in seventeen unmedicated high-functioning adults with ASD and seventeen matched controls while they performed an empathy-for-pain task. Compared to controls, adults with ASD showed enhanced SCR related to empathetic pain, along with increased neural activity in the anterior insular cortex, although their behavioral empathetic pain discriminability was reduced and overall SCR was decreased. ASD individuals also showed enhanced correlation between SCR and neural activities in the anterior insular cortex. Importantly, significant group differences in effective brain connectivity were limited to greater reduction in the negative intrinsic connectivity of the anterior insular cortex in the ASD group, indicating a failure in attenuating anterior insular responses to empathetic pain. These results suggest that aberrant interoceptive precision, as indexed by abnormalities in autonomic activity and its central representations, may underlie empathy deficits in ASD.

Abnormal autonomic and associated brain activities during rest in autism spectrum disorder.

Autism spectrum disorders are associated with social and emotional deficits, the aetiology of which are not well understood. A growing consensus is that the autonomic nervous system serves a key role in emotional processes, by providing physiological signals essential to subjective states. We hypothesized that altered autonomic processing is related to the socio-emotional deficits in autism spectrum disorders. Here, we investigated the relationship between non-specific skin conductance response, an objective index of sympathetic neural activity, and brain fluctuations during rest in high-functioning adults with autism spectrum disorder relative to neurotypical controls. Compared with control participants, individuals with autism spectrum disorder showed less skin conductance responses overall. They also showed weaker correlations between skin conductance responses and frontal brain regions, including the anterior cingulate and anterior insular cortices. Additionally, skin conductance responses were found to have less contribution to default mode network connectivity in individuals with autism spectrum disorders relative to controls. These results suggest that autonomic processing is altered in autism spectrum disorders, which may be related to the abnormal socio-emotional behaviours that characterize this condition.

Quantitative characterization of functional anatomical contributions to cognitive control under uncertainty.

Although much evidence indicates that RT increases as a function of computational load in many cognitive tasks, quantification of changes in neural activity related to increasing demand of cognitive control has rarely been attempted. In this fMRI study, we used a majority function task to quantify the effect of computational load on brain activation, reflecting the mental processes instantiated by cognitive control under conditions of uncertainty. We found that the activation of the frontoparieto-cingulate system as well as the deactivation of the anticorrelated default mode network varied parametrically as a function of information uncertainty, estimated as entropy with an information theoretic model. The current findings suggest that activity changes in the dynamic networks of the brain (especially the frontoparieto-cingulate system) track with information uncertainty, rather than only conflict or other commonly proposed targets of cognitive control.

Mindfulness training modulates value signals in ventromedial prefrontal cortex through input from insular cortex.

Neuroimaging research has demonstrated that ventromedial prefrontal cortex (vmPFC) encodes value signals that can be modulated by top-down cognitive input such as semantic knowledge, price incentives, and monetary favors suggesting that such biases may have an identified biological basis. It has been hypothesized that mindfulness training (MT) provides one path for gaining control over such top-down influences; yet, there have been no direct tests of this hypothesis. Here, we probe the behavioral and neural effects of MT on value signals in vmPFC in a randomized longitudinal design of 8 weeks of MT on an initially naïve subject cohort. The impact of this within-subject training was assessed using two paradigms: one that employed primary rewards (fruit juice) in a simple conditioning task and another that used a well-validated art-viewing paradigm to test bias of monetary favors on preference. We show that MT behaviorally censors the top-down bias of monetary favors through a measurable influence on value signals in vmPFC. MT also modulates value signals in vmPFC to primary reward delivery. Using a separate cohort of subjects we show that 8 weeks of active control training (ACT) generates the same behavioral impact also through an effect on signals in the vmPFC. Importantly, functional connectivity analyses show that value signals in vmPFC are coupled with bilateral posterior insula in the MT groups in both paradigms, but not in the ACT groups. These results suggest that MT integrates interoceptive input from insular cortex in the context of value computations of both primary and secondary rewards.

Cognitive strategies regulate fictive, but not reward prediction error signals in a sequential investment task.

Computational models of reward processing suggest that foregone or fictive outcomes serve as important information sources for learning and augment those generated by experienced rewards (e.g. reward prediction errors). An outstanding question is how these learning signals interact with top-down cognitive influences, such as cognitive reappraisal strategies. Using a sequential investment task and functional magnetic resonance imaging, we show that the reappraisal strategy selectively attenuates the influence of fictive, but not reward prediction error signals on investment behavior; such behavioral effect is accompanied by changes in neural activity and connectivity in the anterior insular cortex, a brain region thought to integrate subjective feelings with high-order cognition. Furthermore, individuals differ in the extent to which their behaviors are driven by fictive errors versus reward prediction errors, and the reappraisal strategy interacts with such individual differences; a finding also accompanied by distinct underlying neural mechanisms. These findings suggest that the variable interaction of cognitive strategies with two important classes of computational learning signals (fictive, reward prediction error) represent one contributing substrate for the variable capacity of individuals to control their behavior based on foregone rewards. These findings also expose important possibilities for understanding the lack of control in addiction based on possibly foregone rewarding outcomes.

Recovery of empathetic function following resection of insular gliomas.

The insular cortex is located deep within the Sylvian fissure between multi-functional and structurally-compressed cerebral structures, and has been suggested to play an important role in both basic sensorimotor and complex social-emotional functions. Such structural and functional complexity presents a challenge for neurosurgeons to remove tumors within the insula safely. It has therefore not yet been documented how neurosurgical resection of insular gliomas would impact social-emotional functions. In this study, we examined empathy, a high-level social-emotional function, in four patients with localized insular gliomas pre- and post-operatively. The patients completed an empathy-for others pain task in which they viewed another person's hand or foot in painful or non-painful situations and made judgments about either pain (explicit empathy) or laterality of the hand or foot (implicit empathy). They also completed questionnaires assessing general emotional processing and personality. Deficits in both explicit and implicit empathetic pain processing were found in patients before the operations. However, the operations significantly improved their empathetic ability after surgery, accompanied by unchanged personality traits. These results confirmed previous findings that the insula plays a critical role for empathetic pain perception. Importantly, the current results suggest that surgical resection is not only a suitable treatment for insular gliomas for clinical consideration, but also effective in improving high-level functions such as empathetic pain perception.

Cognition-emotion integration in the anterior insular cortex.

Both cognitive and affective processes require mental resources. However, it remains unclear whether these 2 processes work in parallel or in an integrated fashion. In this functional magnetic resonance imaging study, we investigated their interaction using an empathy-for-pain paradigm, with simultaneous manipulation of cognitive demand of the tasks and emotional valence of the stimuli. Eighteen healthy adult participants viewed photographs showing other people's hands and feet in painful or nonpainful situations while performing tasks of low (body part judgment) and high (laterality judgment) cognitive demand. Behavioral data showed increased reaction times and error rates for painful compared with nonpainful stimuli under laterality judgment relative to body part judgment, indicating an interaction between cognitive demand and stimulus valence. Imaging analyses showed activity in bilateral anterior insula (AI) and primary somatosensory cortex (SI), but not posterior insula, for main effects of cognitive demand and stimulus valence. Importantly, cognitive demand and stimulus valence showed a significant interaction in AI, SI, and regions of the frontoparietal network. These results suggest that cognitive and emotional processes at least partially share common brain networks and that AI might serve as a key node in a brain network subserving cognition-emotion integration.

Aberrant neural computation of social controllability in nicotine-dependent humans.

Social controllability, defined as the ability to exert influence when interacting with others, is crucial for optimal decision-making. Inability to do so might contribute to maladaptive behaviors such as drug use, which often takes place in social settings. Here, we examined nicotine-dependent humans using fMRI, as they made choices that could influence the proposals from simulated partners. Computational modeling revealed that smokers under-estimated the influence of their actions and self-reported a reduced sense of control, compared to non-smokers. These findings were replicated in a large independent sample of participants recruited online. Neurally, smokers showed reduced tracking of forward projected choice values in the ventromedial prefrontal cortex, and impaired computation of social prediction errors in the midbrain. These results demonstrate that smokers were less accurate in estimating their personal influence when the social environment calls for control, providing a neurocomputational account for the social cognitive deficits in this population.

Diminished Adaptation, Satisfaction, and Neural Responses to Advantageous Social Signals in Anorexia Nervosa and Bulimia Nervosa.

BACKGROUND: Development and recurrence of 2 eating disorders (EDs), anorexia nervosa and bulimia nervosa, are frequently associated with environmental stressors. Neurobehavioral responses to social learning signals were evaluated in both EDs. METHODS: Women with anorexia nervosa (n = 25), women with bulimia nervosa (n = 30), or healthy comparison women (n = 38) played a neuroeconomic game in which the norm shifted, generating social learning signals (norm prediction errors [NPEs]) during a functional magnetic resonance imaging scan. A Bayesian logistic regression model examined how the probability of offer acceptance depended on cohort, block, and NPEs. Rejection rates, emotion ratings, and neural responses to NPEs were compared across groups. RESULTS: Relative to the comparison group, both ED cohorts showed less adaptation (p = .028, ηp2 = 0.060), and advantageous signals (positive NPEs) led to higher rejection rates (p = .014, ηp2 = 0.077) and less positive emotion ratings (p = .004, ηp2 = 0.111). Advantageous signals increased neural activations in the orbitofrontal cortex for the comparison group but not for women with anorexia nervosa (p = .018, d = 0.655) or bulimia nervosa (p = .043, d = 0.527). More severe ED symptoms were associated with decreased activation of dorsomedial prefrontal cortex for advantageous signals. CONCLUSIONS: Diminished neural processing of advantageous social signals and impaired norm adaptation were observed in both anorexia nervosa and bulimia nervosa, while no differences were found for disadvantageous social signals. Development of neurocognitive interventions to increase responsivity to advantageous social signals could augment current treatments, potentially leading to improved clinical outcomes for EDs.

Phenotypical divergence between self-reported and clinically ascertained autism.

While allowing for rapid recruitment of large samples, online psychiatric and neurodevelopmental research relies heavily on participants' self-report of neuropsychiatric symptoms, foregoing the rigorous clinical characterization of laboratory settings. Autism spectrum disorder (ASD) research is one example where the clinical validity of such an approach remains elusive. Here, we compared participants characterized online via self-reports against in-person participants evaluated by clinicians. Despite having comparable self-reported autism symptoms, the online high-trait group reported significantly more social anxiety and avoidant behavior than in-person ASD subjects. Within the in-person sample, there was no relationship between self-rated and clinician-rated autism symptoms, suggesting these approaches may capture different aspects of ASD. The online high-trait and in-person ASD participants also differed in their behavior in well-validated social decision-making tasks: the in-person group perceived having less social control and acted less affiliative towards virtual characters. Our study aimed to draw comparisons at three levels: methodological platform (online versus in-person), symptom measurement (self- versus clinician-report), and social behavior. We identified a lack of agreement between self- and clinician-rated measures of symptoms and divergent social tendencies in groups ascertained by each method, highlighting the need for differentiation between in-person versus online samples in autism research.

Human Substantia Nigra Neurons Encode Reward Expectations.

Dopamine (DA) signals originating from substantia nigra (SN) neurons are centrally involved in the regulation of motor and reward processing. DA signals behaviorally relevant events where reward outcomes differ from expectations (reward prediction errors, RPEs). RPEs play a crucial role in learning optimal courses of action and in determining response vigor when an agent expects rewards. Nevertheless, how reward expectations, crucial for RPE calculations, are conveyed to and represented in the dopaminergic system is not fully understood, especially in the human brain where the activity of DA neurons is difficult to study. One possibility, suggested by evidence from animal models, is that DA neurons explicitly encode reward expectations. Alternatively, they may receive RPE information directly from upstream brain regions. To address whether SN neuron activity directly reflects reward expectation information, we directly examined the encoding of reward expectation signals in human putative DA neurons by performing single-unit recordings from the SN of patients undergoing neurosurgery. Patients played a two-armed bandit decision-making task in which they attempted to maximize reward. We show that neuronal firing rates (FR) of putative DA neurons during the reward expectation period explicitly encode reward expectations. First, activity in these neurons was modulated by previous trial outcomes, such that FR were greater after positive outcomes than after neutral or negative outcome trials. Second, this increase in FR was associated with shorter reaction times, consistent with an invigorating effect of DA neuron activity during expectation. These results suggest that human DA neurons explicitly encode reward expectations, providing a neurophysiological substrate for a signal critical for reward learning.

Dopamine and serotonin in human substantia nigra track social context and value signals during economic exchange.

Dopamine and serotonin are hypothesized to guide social behaviours. In humans, however, we have not yet been able to study neuromodulator dynamics as social interaction unfolds. Here, we obtained subsecond estimates of dopamine and serotonin from human substantia nigra pars reticulata during the ultimatum game. Participants, who were patients with Parkinson's disease undergoing awake brain surgery, had to accept or reject monetary offers of varying fairness from human and computer players. They rejected more offers in the human than the computer condition, an effect of social context associated with higher overall levels of dopamine but not serotonin. Regardless of the social context, relative changes in dopamine tracked trial-by-trial changes in offer value-akin to reward prediction errors-whereas serotonin tracked the current offer value. These results show that dopamine and serotonin fluctuations in one of the basal ganglia's main output structures reflect distinct social context and value signals.