Human Substantia Nigra Neurons Encode Reward Expectations.

Dopamine (DA) signals originating from substantia nigra (SN) neurons are centrally involved in the regulation of motor and reward processing. DA signals behaviorally relevant events where reward outcomes differ from expectations (reward prediction errors, RPEs). RPEs play a crucial role in learning optimal courses of action and in determining response vigor when an agent expects rewards. Nevertheless, how reward expectations, crucial for RPE calculations, are conveyed to and represented in the dopaminergic system is not fully understood, especially in the human brain where the activity of DA neurons is difficult to study. One possibility, suggested by evidence from animal models, is that DA neurons explicitly encode reward expectations. Alternatively, they may receive RPE information directly from upstream brain regions. To address whether SN neuron activity directly reflects reward expectation information, we directly examined the encoding of reward expectation signals in human putative DA neurons by performing single-unit recordings from the SN of patients undergoing neurosurgery. Patients played a two-armed bandit decision-making task in which they attempted to maximize reward. We show that neuronal firing rates (FR) of putative DA neurons during the reward expectation period explicitly encode reward expectations. First, activity in these neurons was modulated by previous trial outcomes, such that FR were greater after positive outcomes than after neutral or negative outcome trials. Second, this increase in FR was associated with shorter reaction times, consistent with an invigorating effect of DA neuron activity during expectation. These results suggest that human DA neurons explicitly encode reward expectations, providing a neurophysiological substrate for a signal critical for reward learning.

Phenotypical divergence between self-reported and clinically ascertained autism.

While allowing for rapid recruitment of large samples, online psychiatric and neurodevelopmental research relies heavily on participants' self-report of neuropsychiatric symptoms, foregoing the rigorous clinical characterization of laboratory settings. Autism spectrum disorder (ASD) research is one example where the clinical validity of such an approach remains elusive. Here, we compared participants characterized online via self-reports against in-person participants evaluated by clinicians. Despite having comparable self-reported autism symptoms, the online high-trait group reported significantly more social anxiety and avoidant behavior than in-person ASD subjects. Within the in-person sample, there was no relationship between self-rated and clinician-rated autism symptoms, suggesting these approaches may capture different aspects of ASD. The online high-trait and in-person ASD participants also differed in their behavior in well-validated social decision-making tasks: the in-person group perceived having less social control and acted less affiliative towards virtual characters. Our study aimed to draw comparisons at three levels: methodological platform (online versus in-person), symptom measurement (self- versus clinician-report), and social behavior. We identified a lack of agreement between self- and clinician-rated measures of symptoms and divergent social tendencies in groups ascertained by each method, highlighting the need for differentiation between in-person versus online samples in autism research.

Dopamine and serotonin in human substantia nigra track social context and value signals during economic exchange.

Dopamine and serotonin are hypothesized to guide social behaviours. In humans, however, we have not yet been able to study neuromodulator dynamics as social interaction unfolds. Here, we obtained subsecond estimates of dopamine and serotonin from human substantia nigra pars reticulata during the ultimatum game. Participants, who were patients with Parkinson's disease undergoing awake brain surgery, had to accept or reject monetary offers of varying fairness from human and computer players. They rejected more offers in the human than the computer condition, an effect of social context associated with higher overall levels of dopamine but not serotonin. Regardless of the social context, relative changes in dopamine tracked trial-by-trial changes in offer value-akin to reward prediction errors-whereas serotonin tracked the current offer value. These results show that dopamine and serotonin fluctuations in one of the basal ganglia's main output structures reflect distinct social context and value signals.

Aberrant neural computation of social controllability in nicotine-dependent humans.

Social controllability, defined as the ability to exert influence when interacting with others, is crucial for optimal decision-making. Inability to do so might contribute to maladaptive behaviors such as drug use, which often takes place in social settings. Here, we examined nicotine-dependent humans using fMRI, as they made choices that could influence the proposals from simulated partners. Computational modeling revealed that smokers under-estimated the influence of their actions and self-reported a reduced sense of control, compared to non-smokers. These findings were replicated in a large independent sample of participants recruited online. Neurally, smokers showed reduced tracking of forward projected choice values in the ventromedial prefrontal cortex, and impaired computation of social prediction errors in the midbrain. These results demonstrate that smokers were less accurate in estimating their personal influence when the social environment calls for control, providing a neurocomputational account for the social cognitive deficits in this population.

Diminished Adaptation, Satisfaction, and Neural Responses to Advantageous Social Signals in Anorexia Nervosa and Bulimia Nervosa.

BACKGROUND: Development and recurrence of 2 eating disorders (EDs), anorexia nervosa and bulimia nervosa, are frequently associated with environmental stressors. Neurobehavioral responses to social learning signals were evaluated in both EDs. METHODS: Women with anorexia nervosa (n = 25), women with bulimia nervosa (n = 30), or healthy comparison women (n = 38) played a neuroeconomic game in which the norm shifted, generating social learning signals (norm prediction errors [NPEs]) during a functional magnetic resonance imaging scan. A Bayesian logistic regression model examined how the probability of offer acceptance depended on cohort, block, and NPEs. Rejection rates, emotion ratings, and neural responses to NPEs were compared across groups. RESULTS: Relative to the comparison group, both ED cohorts showed less adaptation (p = .028, ηp2 = 0.060), and advantageous signals (positive NPEs) led to higher rejection rates (p = .014, ηp2 = 0.077) and less positive emotion ratings (p = .004, ηp2 = 0.111). Advantageous signals increased neural activations in the orbitofrontal cortex for the comparison group but not for women with anorexia nervosa (p = .018, d = 0.655) or bulimia nervosa (p = .043, d = 0.527). More severe ED symptoms were associated with decreased activation of dorsomedial prefrontal cortex for advantageous signals. CONCLUSIONS: Diminished neural processing of advantageous social signals and impaired norm adaptation were observed in both anorexia nervosa and bulimia nervosa, while no differences were found for disadvantageous social signals. Development of neurocognitive interventions to increase responsivity to advantageous social signals could augment current treatments, potentially leading to improved clinical outcomes for EDs.

Longing to act: Bayesian inference as a framework for craving in behavioral addiction.

Traditionally, craving is considered a defining feature of drug addiction. Accumulating evidence suggests that craving can also exist in behavioral addictions (e.g., gambling disorder) without drug-induced effects. However, the degree to which mechanisms of craving overlap between classic substance use disorders and behavioral addictions remains unclear. There is, therefore, an urgent need to develop an overarching theory of craving that conceptually integrates findings across behavioral and drug addictions. In this review, we will first synthesize existing theories and empirical findings related to craving in both drug-dependent and -independent addictive disorders. Building on the Bayesian brain hypothesis and previous work on interoceptive inference, we will then propose a computational theory for craving in behavioral addiction, where the target of craving is execution of an action (e.g., gambling) rather than a drug. Specifically, we conceptualize craving in behavioral addiction as a subjective belief about physiological states of the body associated with action completion and is updated based on both a prior belief ("I need to act to feel good") and sensory evidence ("I cannot act"). We conclude by briefly discussing the therapeutic implications of this framework. In summary, this unified Bayesian computational framework for craving generalizes across addictive disorders, provides explanatory power for ostensibly conflicting empirical findings, and generates strong hypotheses for future empirical studies. The disambiguation of the computational components underlying domain-general craving using this framework will lead to a deeper understanding of, and effective treatment targets for, behavioral and drug addictions.

A natural language processing approach reveals first-person pronoun usage and non-fluency as markers of therapeutic alliance in psychotherapy.

It remains elusive what language markers derived from psychotherapy sessions are indicative of therapeutic alliance, limiting our capacity to assess and provide feedback on the trusting quality of the patient-clinician relationship. To address this critical knowledge gap, we leveraged feature extraction methods from natural language processing (NLP), a subfield of artificial intelligence, to quantify pronoun and non-fluency language markers that are relevant for communicative and emotional aspects of therapeutic relationships. From twenty-eight transcripts of non-manualized psychotherapy sessions recorded in outpatient clinics, we identified therapists' first-person pronoun usage frequency and patients' speech transition marking relaxed interaction style as potential metrics of alliance. Behavioral data from patients who played an economic game that measures social exchange (i.e. trust game) suggested that therapists' first-person pronoun usage may influence alliance ratings through their diminished trusting behavior toward therapists. Together, this work supports that communicative language features in patient-therapist dialogues could be markers of alliance.

Towards a neurocomputational account of social controllability: From models to mental health.

Controllability, or the influence one has over their surroundings, is crucial for decision-making and mental health. Traditionally, controllability is operationalized in sensorimotor terms as one's ability to exercise their actions to achieve an intended outcome (also termed "agency"). However, recent social neuroscience research suggests that humans also assess if and how they can exert influence over other people (i.e., their actions, outcomes, beliefs) to achieve desired outcomes ("social controllability"). In this review, we will synthesize empirical findings and neurocomputational frameworks related to social controllability. We first introduce the concepts of contextual and perceived controllability and their respective relevance for decision-making. Then, we outline neurocomputational frameworks that can be used to model social controllability, with a focus on behavioral economic paradigms and reinforcement learning approaches. Finally, we discuss the implications of social controllability for computational psychiatry research, using delusion and obsession-compulsion as examples. Taken together, we propose that social controllability could be a key area of investigation in future social neuroscience and computational psychiatry research.

Reward-related self-agency is disturbed in depression and anxiety.

BACKGROUND: The sense of agency, or the belief in action causality, is an elusive construct that impacts day-to-day experience and decision-making. Despite its relevance in a range of neuropsychiatric disorders, it is widely under-studied and remains difficult to measure objectively in patient populations. We developed and tested a novel cognitive measure of reward-dependent agency perception in an in-person and online cohort. METHODS: The in-person cohort consisted of 52 healthy control subjects and 20 subjects with depression and anxiety disorders (DA), including major depressive disorder and generalized anxiety disorder. The online sample consisted of 254 participants. The task consisted of an effort implementation for monetary rewards with computerized visual feedback interference and trial-by-trial ratings of self versus other agency. RESULTS: All subjects across both cohorts demonstrated higher self-agency after receiving positive-win feedback, compared to negative-loss feedback when the level of computer inference was kept constant. Patients with DA showed reduced positive feedback-dependent agency compared to healthy controls. Finally, in our online sample, we found that higher self-agency following negative-loss feedback was associated with worse anhedonia symptoms. CONCLUSION: Together this work suggests how positive and negative environmental information impacts the sense of self-agency in healthy subjects, and how it is perturbed in patients with depression and anxiety.

Invasive Computational Psychiatry.

Computational psychiatry, a relatively new yet prolific field that aims to understand psychiatric disorders with formal theories about the brain, has seen tremendous growth in the past decade. Despite initial excitement, actual progress made by computational psychiatry seems stagnant. Meanwhile, understanding of the human brain has benefited tremendously from recent progress in intracranial neuroscience. Specifically, invasive techniques such as stereotactic electroencephalography, electrocorticography, and deep brain stimulation have provided a unique opportunity to precisely measure and causally modulate neurophysiological activity in the living human brain. In this review, we summarize progress and drawbacks in both computational psychiatry and invasive electrophysiology and propose that their combination presents a highly promising new direction-invasive computational psychiatry. The value of this approach is at least twofold. First, it advances our mechanistic understanding of the neural computations of mental states by providing a spatiotemporally precise depiction of neural activity that is traditionally unattainable using noninvasive techniques with human subjects. Second, it offers a direct and immediate way to modulate brain states through stimulation of algorithmically defined neural regions and circuits (i.e., algorithmic targeting), thus providing both causal and therapeutic insights. We then present depression as a use case where the combination of computational and invasive approaches has already shown initial success. We conclude by outlining future directions as a road map for this exciting new field as well as presenting cautions about issues such as ethical concerns and generalizability of findings.

An Interpretable and Predictive Connectivity-Based Neural Signature for Chronic Cannabis Use.

BACKGROUND: Cannabis is one of the most widely used substances in the world, with usage trending upward in recent years. However, although the psychiatric burden associated with maladaptive cannabis use has been well established, reliable and interpretable biomarkers associated with chronic use remain elusive. In this study, we combine large-scale functional magnetic resonance imaging with machine learning and network analysis and develop an interpretable decoding model that offers both accurate prediction and novel insights into chronic cannabis use. METHODS: Chronic cannabis users (n = 166) and nonusing healthy control subjects (n = 124) completed a cue-elicited craving task during functional magnetic resonance imaging. Linear machine learning methods were used to classify individuals into chronic users and nonusers based on whole-brain functional connectivity. Network analysis was used to identify the most predictive regions and communities. RESULTS: We obtained high (∼80% out-of-sample) accuracy across 4 different classification models, demonstrating that task-evoked connectivity can successfully differentiate chronic cannabis users from nonusers. We also identified key predictive regions implicating motor, sensory, attention, and craving-related areas, as well as a core set of brain networks that contributed to successful classification. The most predictive networks also strongly correlated with cannabis craving within the chronic user group. CONCLUSIONS: This novel approach produced a neural signature of chronic cannabis use that is both accurate in terms of out-of-sample prediction and interpretable in terms of predictive networks and their relation to cannabis craving.

Disrupted computations of social control in individuals with obsessive-compulsive and misophonia symptoms.

Misophonia is a disorder in which certain sounds produced by other people lead to intense negative reactions. It remains unknown how misophonia relates to other psychiatric conditions or impairments. To identify latent constructs underlying symptoms, we conducted a factor analysis consisting of items from questionnaires assessing symptoms of misophonia and other psychiatric conditions. One thousand forty-two participants completed the questionnaires and a social exchange task in which they either could ("controllable") or could not ("uncontrollable") influence future monetary offers from other people. Misophonia and obsessive-compulsive (OC) symptoms loaded onto the same factor. Compared with individuals with low Miso-OC factor scores, individuals with high scores reported higher perceived controllability of their social interactions during the uncontrollable condition and stronger aversion to social norm violations in the uncontrollable compared with the controllable condition. Together, these results suggest misophonia, and OC symptoms share a latent psychiatric dimension characterized by aberrant computations of social controllability.

Computational mechanisms underlying illusion of control in delusional individuals.

Humans navigate complex situations that require the accurate estimation of the controllability of the environment. Aberrant controllability computation might lead to maladaptive behaviors and poor mental health outcomes. Illusion of control, which refers to a heightened sense of control while the environment is uncontrollable, is one such manifestation and has been conceptually associated with delusional ideation. Nevertheless, this association has not yet been formally characterized in a computational framework. To address this, we used a computational psychiatry approach to quantify illusion of control in human participants with high (n = 125) or low (n = 126) trait delusion. Participants played a two-party exchange game in which their choices either did ("Controllable condition") or did not ("Uncontrollable condition") influence the future monetary offers made by simulated partners. We found that the two groups behaved similarly in model-agnostic measures (i.e., offer size, rejection rate). However, computational modeling revealed that compared to the low trait delusion group, the high delusion group overestimated their influence ("expected influence" parameter) over the offers made by their partners under the Uncontrollable condition. Highly delusional individuals also reported a stronger sense of control than those with low trait delusion in the Uncontrollable condition. Furthermore, the expected influence parameter and self-reported beliefs about controllability were significantly correlated in the Controllable condition in individuals with low trait delusion, whereas this relationship was diminished in those with high trait delusion. Collectively, these findings demonstrate that delusional ideation is associated with aberrant computation of and belief about environmental controllability, as well as a belief-behavior disconnect.

Elevated Neurobehavioral Responses to Negative Social Interactions in Women With Bulimia Nervosa.

BACKGROUND: Bulimia nervosa (BN) is a complex psychiatric illness that includes binge-purge behaviors and a belief that one's value as a person depends on body shape and weight. Social pressure strongly influences the development and maintenance of BN, but how this manifests neurobiologically within an individual remains unknown. We used a computational psychiatry approach to evaluate neural mechanisms underlying social interactions in BN. METHODS: Behavioral and functional magnetic resonance imaging data were collected from 24 women with BN and 26 healthy comparison women using an iterated social exchange game. Data were sorted round by round based on whether the mathematically computed social signals indicated an improving (positive reciprocity) or deteriorating (negative reciprocity) relationship for each participant. RESULTS: Social interactions with negative reciprocity resulted in more negative behavioral responses and stronger neural activations in both cortical and subcortical regions in women with BN than healthy comparison women. No behavioral or neural differences were observed for interactions demonstrating positive reciprocity, suggesting a very specific form of psychopathology in BN: amplification of negative self-relevant social interactions. Cortical activations (e.g., temporoparietal junction and dorsolateral prefrontal cortex) did not covary with mood symptoms, while subcortical activations (e.g., amygdala and dorsal striatum) were associated with acute psychopathology. CONCLUSIONS: These data provide a first step toward a mechanistic neuropsychological model of aberrant social processing in BN, demonstrating how a computational psychiatric approach can elucidate neural mechanisms for complex psychiatric illnesses. Future treatments for BN may include targeting neural regions that support these negative biases in social perceptions.

Similar network compositions, but distinct neural dynamics underlying belief updating in environments with and without explicit outcomes.

Classic decision theories typically assume the presence of explicit value-based outcomes after action selections to update beliefs about action-outcome contingencies. However, ecological environments are often opaque, and it remains unclear whether the neural dynamics underlying belief updating vary under conditions characterized by the presence or absence of such explicit value-based information, after each choice selection. We investigated this question in healthy humans (n = 28) using Bayesian inference and two multi-option fMRI tasks: a multi-armed bandit task, and a probabilistic perceptual task, respectively with and without explicit value-based feedback after choice selections. Model-based fMRI analysis revealed a network encoding belief updating which did not change depending on the task. More precisely, we found a confidence-building network that included anterior hippocampus, amygdala, and medial prefrontal cortex (mPFC), which became more active as beliefs about action-outcome probabilities were confirmed by newly acquired information. Despite these consistent responses across tasks, dynamic causal modeling estimated that the network dynamics changed depending on the presence or absence of trial-by-trial value-based outcomes. In the task deprived of immediate feedback, the hippocampus increased its influence towards both amygdala and mPFC, in association with increased strength in the confidence signal. However, the opposite causal relations were found (i.e., from both mPFC and amygdala towards the hippocampus), in presence of immediate outcomes. This finding revealed an asymmetric relationship between decision confidence computations, which were based on similar computational models across tasks, and neural implementation, which varied depending on the availability of outcomes after choice selections.

Humans use forward thinking to exploit social controllability.

The controllability of our social environment has a profound impact on our behavior and mental health. Nevertheless, neurocomputational mechanisms underlying social controllability remain elusive. Here, 48 participants performed a task where their current choices either did (Controllable), or did not (Uncontrollable), influence partners' future proposals. Computational modeling revealed that people engaged a mental model of forward thinking (FT; i.e., calculating the downstream effects of current actions) to estimate social controllability in both Controllable and Uncontrollable conditions. A large-scale online replication study (n=1342) supported this finding. Using functional magnetic resonance imaging (n=48), we further demonstrated that the ventromedial prefrontal cortex (vmPFC) computed the projected total values of current actions during forward planning, supporting the neural realization of the forward-thinking model. These findings demonstrate that humans use vmPFC-dependent FT to estimate and exploit social controllability, expanding the role of this neurocomputational mechanism beyond spatial and cognitive contexts.

Hippocampal contributions to social and cognitive deficits in autism spectrum disorder.

Autism spectrum disorder (ASD) is characterized by hallmark impairments in social functioning. Nevertheless, nonsocial cognition, including hippocampus-dependent spatial reasoning and episodic memory, is also commonly impaired in ASD. ASD symptoms typically emerge between 12 and 24 months of age, a time window associated with critical developmental events in the hippocampus. Despite this temporal overlap and evidence of hippocampal structural abnormalities in ASD individuals, relatively few human studies have focused on hippocampal function in ASD. Herein, we review the existing evidence for the involvement of the hippocampus in ASD and highlight the hippocampus as a promising area of interest for future research in ASD.

Emotional adaptation during a crisis: decline in anxiety and depression after the initial weeks of COVID-19 in the United States.

Crises such as the COVID-19 pandemic are known to exacerbate depression and anxiety, though their temporal trajectories remain under-investigated. The present study aims to investigate fluctuations in depression and anxiety using the COVID-19 pandemic as a model crisis. A total of 1512 adults living in the United States enrolled in this online study beginning April 2, 2020 and were assessed weekly for 10 weeks (until June 4, 2020). We measured depression and anxiety using the Zung Self-Rating Depression scale and State-Trait Anxiety Inventory (state subscale), respectively, along with demographic and COVID-related surveys. Linear mixed-effects models were used to examine factors contributing to longitudinal changes in depression and anxiety. We found that depression and anxiety levels were high in early April, but declined over time. Being female, younger age, lower-income, and previous psychiatric diagnosis correlated with higher overall levels of anxiety and depression; being married additionally correlated with lower overall levels of depression, but not anxiety. Importantly, worsening of COVID-related economic impact and increase in projected pandemic duration exacerbated both depression and anxiety over time. Finally, increasing levels of informedness correlated with decreasing levels of depression, while increased COVID-19 severity (i.e., 7-day change in cases) and social media use were positively associated with anxiety over time. These findings not only provide evidence for overall emotional adaptation during the initial weeks of the pandemic, but also provide insight into overlapping, yet distinct, factors contributing to depression and anxiety throughout the first wave of the pandemic.

Containment of COVID-19: Simulating the impact of different policies and testing capacities for contact tracing, testing, and isolation.

Efficient contact tracing and testing are fundamental tools to contain the transmission of SARS-CoV-2. We used multi-agent simulations to estimate the daily testing capacity required to find and isolate a number of infected agents sufficient to break the chain of transmission of SARS-CoV-2, so decreasing the risk of new waves of infections. Depending on the non-pharmaceutical mitigation policies in place, the size of secondary infection clusters allowed or the percentage of asymptomatic and paucisymptomatic (i.e., subclinical) infections, we estimated that the daily testing capacity required to contain the disease varies between 0.7 and 9.1 tests per thousand agents in the population. However, we also found that if contact tracing and testing efficacy dropped below 60% (e.g. due to false negatives or reduced tracing capability), the number of new daily infections did not always decrease and could even increase exponentially, irrespective of the testing capacity. Under these conditions, we show that population-level information about geographical distribution and travel behaviour could inform sampling policies to aid a successful containment, while avoiding concerns about government-controlled mass surveillance.

A change of mind: Globus pallidus activity and effective connectivity during changes in choice selections.

The basal ganglia are a group of interconnected subcortical nuclei that plays a key role in multiple motor and cognitive processes, in a close interplay with several cortical regions. Two conflicting theories postulate that the basal ganglia pathways can either foster or suppress the cortico-striatal output or, alternatively, they can stabilize or destabilize the cortico-striatal circuit dynamics. These different approaches significantly impact the understanding of observable behaviours and cognitive processes in healthy, as well as clinical populations. We investigated the predictions of these models in healthy participants (N = 28), using dynamic causal modeling of fMRI BOLD activity to estimate time- and context-dependent changes in the indirect pathway effective connectivity, in association with repetitions or changes of choice selections. We used two multi-option tasks that required the participants to adapt to uncontrollable environmental changes, by performing sequential choice selections, with and without value-based feedbacks. We found that, irrespective of the task, the trials that were characterized by changes in choice selections (switch trials) were associated with a neural response that mostly overlapped with a network commonly described for the encoding of uncertainty. More interestingly, dynamic causal modeling and family-wise model comparison identified with high likelihood a directed causal relation from the external to the internal part of the globus pallidus (i.e., the short indirect pathway in the basal ganglia), in association with the switch trials. This finding supports the hypothesis that the short indirect pathway in the basal ganglia drives instability in the network dynamics, resulting in changes in choice selection.