Anhedonia, Apathy, Pleasure, and Effort-Based Decision-Making in Adult and Adolescent Cannabis Users and Controls.

BACKGROUND: Cannabis use may be linked with anhedonia and apathy. However, previous studies have shown mixed results, and few have examined the association between cannabis use and specific reward sub-processes. Adolescents may be more vulnerable than adults to harmful effects of cannabis. This study investigated (1) the association between non-acute cannabis use and apathy, anhedonia, pleasure, and effort-based decision-making for reward; and (2) whether these relationships were moderated by age group. METHODS: We used data from the "CannTeen" study. Participants were 274 adult (26-29 years) and adolescent (16-17 years) cannabis users (1-7 d/wk use in the past 3 months) and gender- and age-matched controls. Anhedonia was measured with the Snaith-Hamilton Pleasure Scale (n = 274), and apathy was measured with the Apathy Evaluation Scale (n = 215). Effort-based decision-making for reward was measured with the Physical Effort task (n = 139), and subjective wanting and liking of rewards was measured with the novel Real Reward Pleasure task (n = 137). RESULTS: Controls had higher levels of anhedonia than cannabis users (F1,258 = 5.35, P = .02, η p2 = .02). There were no other significant effects of user-group and no significant user-group*age-group interactions. Null findings were supported by post hoc Bayesian analyses. CONCLUSION: Our results suggest that cannabis use at a frequency of 3 to 4 d/wk is not associated with apathy, effort-based decision-making for reward, reward wanting, or reward liking in adults or adolescents. Cannabis users had lower anhedonia than controls, albeit at a small effect size. These findings are not consistent with the hypothesis that non-acute cannabis use is associated with amotivation.

Reliability of Decision-Making and Reinforcement Learning Computational Parameters.

Computational models can offer mechanistic insight into cognition and therefore have the potential to transform our understanding of psychiatric disorders and their treatment. For translational efforts to be successful, it is imperative that computational measures capture individual characteristics reliably. Here we examine the reliability of reinforcement learning and economic models derived from two commonly used tasks. Healthy individuals (N = 50) completed a restless four-armed bandit and a calibrated gambling task twice, two weeks apart. Reward and punishment learning rates from the reinforcement learning model showed good reliability and reward and punishment sensitivity from the same model had fair reliability; while risk aversion and loss aversion parameters from a prospect theory model exhibited good and excellent reliability, respectively. Both models were further able to predict future behaviour above chance within individuals. This prediction was better when based on participants' own model parameters than other participants' parameter estimates. These results suggest that reinforcement learning, and particularly prospect theory parameters, as derived from a restless four-armed bandit and a calibrated gambling task, can be measured reliably to assess learning and decision-making mechanisms. Overall, these findings indicate the translational potential of clinically-relevant computational parameters for precision psychiatry.

Pleasure, Reward Value, Prediction Error and Anhedonia.

In order to develop effective treatments for anhedonia we need to understand its underlying neurobiological mechanisms. Anhedonia is conceptually strongly linked to reward processing, which involves a variety of cognitive and neural operations. This chapter reviews the evidence for impairments in experiencing hedonic response (pleasure), reward valuation and reward learning based on outcomes (commonly conceptualised in terms of "reward prediction error"). Synthesising behavioural and neuroimaging findings, we examine case-control studies of patients with depression and schizophrenia, including those focusing specifically on anhedonia. Overall, there is reliable evidence that depression and schizophrenia are associated with disrupted reward processing. In contrast to the historical definition of anhedonia, there is surprisingly limited evidence for impairment in the ability to experience pleasure in depression and schizophrenia. There is some evidence that learning about reward and reward prediction error signals are impaired in depression and schizophrenia, but the literature is inconsistent. The strongest evidence is for impairments in the representation of reward value and how this is used to guide action. Future studies would benefit from focusing on impairments in reward processing specifically in anhedonic samples, including transdiagnostically, and from using designs separating different components of reward processing, formulating them in computational terms, and moving beyond cross-sectional designs to provide an assessment of causality.

Altered reward and effort processing in children with maltreatment experience: a potential indicator of mental health vulnerability.

In this longitudinal study of children and adolescents with a documented history of maltreatment, we investigated the impact of maltreatment on behavioral and neural indices of effort-based decision making for reward and examined their associations with future internalizing symptoms. Thirty-seven children with a documented history of maltreatment (MT group) and a carefully matched group of 33 non-maltreated children (NMT group) aged 10-16, completed an effort-based decision-making task during functional magnetic resonance imaging (fMRI). Internalizing symptoms were assessed at baseline and again 18 months later. Computational models were implemented to extract individual estimates of reward and effort sensitivity, and neural signals during decision-making about different levels of reward and effort were analyzed. These were used to predict internalizing symptoms at follow-up. We identified lower effort-related activation in the anterior cingulate cortex (ACC), a prespecified region-of-interest, in the MT relative to the NMT group. No group differences were observed in the striatum, or in behavioral indices of reward and effort processing. Lower effort-related ACC activation significantly predicted elevated internalizing symptoms at follow-up in the MT group. These findings suggest that disrupted effort-related activation may index latent vulnerability to mental illness in children who have experienced maltreatment.

How representative are neuroimaging samples? Large-scale evidence for trait anxiety differences between fMRI and behaviour-only research participants.

Over the past three decades, functional magnetic resonance imaging (fMRI) has become crucial to study how cognitive processes are implemented in the human brain. However, the question of whether participants recruited into fMRI studies differ from participants recruited into other study contexts has received little to no attention. This is particularly pertinent when effects fail to generalize across study contexts: for example, a behavioural effect discovered in a non-imaging context not replicating in a neuroimaging environment. Here, we tested the hypothesis, motivated by preliminary findings (N = 272), that fMRI participants differ from behaviour-only participants on one fundamental individual difference variable: trait anxiety. Analysing trait anxiety scores and possible confounding variables from healthy volunteers across multiple institutions (N = 3317), we found robust support for lower trait anxiety in fMRI study participants, consistent with a sampling or self-selection bias. The bias was larger in studies that relied on phone screening (compared with full in-person psychiatric screening), recruited at least partly from convenience samples (compared with community samples), and in pharmacology studies. Our findings highlight the need for surveying trait anxiety at recruitment and for appropriate screening procedures or sampling strategies to mitigate this bias.

Factors associated with depression in people with inflammatory bowel disease: The relationship between active disease and biases in neurocognitive processing.

BACKGROUND: Depression is common among people with inflammatory bowel disease (IBD), though the causes remain unclear. We conducted a cross-sectional study to investigate the role of emotional processing biases in contributing to depression among people with IBD. MATERIALS AND METHODS: One hundred and twenty outpatients with IBD were recruited and: (a) completed questionnaires to record: age, sex, social support, socioeconomic status, anxiety and depression (n = 104), (b) underwent assessments of biases in emotional recognition (n = 112), emotional memory and reinforcement learning (c) had recorded from clinical records: type of IBD, duration of IBD, IBD activity and (d) provided blood for high-sensitivity C-reactive protein levels (n = 99). KEY RESULTS: Sixty-eight participants had Crohn's disease and 49 had ulcerative colitis. Of these, 35 had active disease and 26 had depression. Those with depression were more likely to be female, lack social support, have active disease, be taking corticosteroids but not TNF-alpha inhibitors and exhibit less positive emotional recognition bias. On multivariable regression analysis, depression was associated independently with lack of social support (unstandardized regression coefficient (B) = -1.40, P = 0.02) and increased disease activity (B = 1.29, P = 0.03). Causal steps analysis was consistent with less positive emotional recognition bias partially mediating the effects of disease activity on depression. CONCLUSIONS AND INFERENCES: This is the first study to demonstrate links between disease activity and less positive biases in emotional recognition that could explain higher rates of depression among people with active IBD. Future prospective studies are required to confirm the effects of emotional processing biases in depression and allow stronger causal inferences to be drawn.

Acquisition of visual priors and induced hallucinations in chronic schizophrenia.

Prominent theories suggest that symptoms of schizophrenia stem from learning deficiencies resulting in distorted internal models of the world. To test these theories further, we used a visual statistical learning task known to induce rapid implicit learning of the stimulus statistics. In this task, participants are presented with a field of coherently moving dots and are asked to report the presented direction of the dots (estimation task), and whether they saw any dots or not (detection task). Two of the directions were more frequently presented than the others. In controls, the implicit acquisition of the stimuli statistics influences their perception in two ways: (i) motion directions are perceived as being more similar to the most frequently presented directions than they really are (estimation biases); and (ii) in the absence of stimuli, participants sometimes report perceiving the most frequently presented directions (a form of hallucinations). Such behaviour is consistent with probabilistic inference, i.e. combining learnt perceptual priors with sensory evidence. We investigated whether patients with chronic, stable, treated schizophrenia (n = 20) differ from controls (n = 23) in the acquisition of the perceptual priors and/or their influence on perception. We found that although patients were slower than controls, they showed comparable acquisition of perceptual priors, approximating the stimulus statistics. This suggests that patients have no statistical learning deficits in our task. This may reflect our patients' relative wellbeing on antipsychotic medication. Intriguingly, however, patients experienced significantly fewer (P = 0.016) hallucinations of the most frequently presented directions than controls when the stimulus was absent or when it was very weak (prior-based lapse estimations). This suggests that prior expectations had less influence on patients' perception than on controls when stimuli were absent or below perceptual threshold.

Altered learning under uncertainty in unmedicated mood and anxiety disorders.

Anxiety is characterized by altered responses under uncertain conditions, but the precise mechanism by which uncertainty changes the behaviour of anxious individuals is unclear. Here we probe the computational basis of learning under uncertainty in healthy individuals and individuals suffering from a mix of mood and anxiety disorders. Participants were asked to choose between four competing slot machines with fluctuating reward and punishment outcomes during safety and stress. We predicted that anxious individuals under stress would learn faster about punishments and exhibit choices that were more affected by those punishments, thus formalizing our predictions as parameters in reinforcement learning accounts of behaviour. Overall, the data suggest that anxious individuals are quicker to update their behaviour in response to negative outcomes (increased punishment learning rates). When treating anxiety, it may therefore be more fruitful to encourage anxious individuals to integrate information over longer horizons when bad things happen, rather than try to blunt their responses to negative outcomes.

Comprehensive review: Computational modelling of schizophrenia.

Computational modelling has been used to address: (1) the variety of symptoms observed in schizophrenia using abstract models of behavior (e.g. Bayesian models - top-down descriptive models of psychopathology); (2) the causes of these symptoms using biologically realistic models involving abnormal neuromodulation and/or receptor imbalance (e.g. connectionist and neural networks - bottom-up realistic models of neural processes). These different levels of analysis have been used to answer different questions (i.e. understanding behavioral vs. neurobiological anomalies) about the nature of the disorder. As such, these computational studies have mostly supported diverging hypotheses of schizophrenia's pathophysiology, resulting in a literature that is not always expanding coherently. Some of these hypotheses are however ripe for revision using novel empirical evidence. Here we present a review that first synthesizes the literature of computational modelling for schizophrenia and psychotic symptoms into categories supporting the dopamine, glutamate, GABA, dysconnection and Bayesian inference hypotheses respectively. Secondly, we compare model predictions against the accumulated empirical evidence and finally we identify specific hypotheses that have been left relatively under-investigated.

The impact of induced anxiety on affective response inhibition.

Studying the effects of experimentally induced anxiety in healthy volunteers may increase our understanding of the mechanisms underpinning anxiety disorders. Experimentally induced stress (via threat of unpredictable shock) improves accuracy at withholding a response on the sustained attention to response task (SART), and in separate studies improves accuracy to classify fearful faces, creating an affective bias. Integrating these findings, participants at two public science engagement events (n = 46, n = 55) were recruited to explore the effects of experimentally induced stress on an affective version of the SART. We hypothesized that we would see an improved accuracy at withholding a response to affectively congruent stimuli (i.e. increased accuracy at withholding a response to fearful 'no-go' distractors) under threat of shock. Induced anxiety slowed reaction time, and at the second event quicker responses were made to fearful stimuli. However, we did not observe improved inhibition overall during induced anxiety, and there was no evidence to suggest an interaction between induced anxiety and stimulus valence on response accuracy. Indeed Bayesian analysis provided decisive evidence against this hypothesis. We suggest that the presence of emotional stimuli might make the safe condition more anxiogenic, reducing the differential between conditions and knocking out any threat-potentiated improvement.

Power-up: A Reanalysis of 'Power Failure' in Neuroscience Using Mixture Modeling.

Recently, evidence for endemically low statistical power has cast neuroscience findings into doubt. If low statistical power plagues neuroscience, then this reduces confidence in the reported effects. However, if statistical power is not uniformly low, then such blanket mistrust might not be warranted. Here, we provide a different perspective on this issue, analyzing data from an influential study reporting a median power of 21% across 49 meta-analyses (Button et al., 2013). We demonstrate, using Gaussian mixture modeling, that the sample of 730 studies included in that analysis comprises several subcomponents so the use of a single summary statistic is insufficient to characterize the nature of the distribution. We find that statistical power is extremely low for studies included in meta-analyses that reported a null result and that it varies substantially across subfields of neuroscience, with particularly low power in candidate gene association studies. Therefore, whereas power in neuroscience remains a critical issue, the notion that studies are systematically underpowered is not the full story: low power is far from a universal problem.SIGNIFICANCE STATEMENT Recently, researchers across the biomedical and psychological sciences have become concerned with the reliability of results. One marker for reliability is statistical power: the probability of finding a statistically significant result given that the effect exists. Previous evidence suggests that statistical power is low across the field of neuroscience. Our results present a more comprehensive picture of statistical power in neuroscience: on average, studies are indeed underpowered-some very seriously so-but many studies show acceptable or even exemplary statistical power. We show that this heterogeneity in statistical power is common across most subfields in neuroscience. This new, more nuanced picture of statistical power in neuroscience could affect not only scientific understanding, but potentially policy and funding decisions for neuroscience research.

Association between habenula dysfunction and motivational symptoms in unmedicated major depressive disorder.

The lateral habenula plays a central role in reward and punishment processing and has been suggested to drive the cardinal symptom of anhedonia in depression. This hypothesis is largely based on observations of habenula hypermetabolism in animal models of depression, but the activity of habenula and its relationship with clinical symptoms in patients with depression remains unclear. High-resolution functional magnetic resonance imaging (fMRI) and computational modelling were used to investigate the activity of the habenula during a probabilistic reinforcement learning task with rewarding and punishing outcomes in 21 unmedicated patients with major depression and 17 healthy participants. High-resolution anatomical scans were also acquired to assess group differences in habenula volume. Healthy individuals displayed the expected activation in the left habenula during receipt of punishment and this pattern was confirmed in the computational analysis of prediction error processing. In depressed patients, there was a trend towards attenuated left habenula activation to punishment, while greater left habenula activation was associated with more severe depressive symptoms and anhedonia. We also identified greater habenula volume in patients with depression, which was associated with anhedonic symptoms. Habenula dysfunction may contribute to abnormal response to punishment in patients with depression, and symptoms such as anhedonia.

Shared Neural Mechanisms for the Evaluation of Intense Sensory Stimulation and Economic Reward, Dependent on Stimulation-Seeking Behavior.

UNLABELLED: Why are some people strongly motivated by intense sensory experiences? Here we investigated how people encode the value of an intense sensory experience compared with economic reward, and how this varies according to stimulation-seeking preference. Specifically, we used a novel behavioral task in combination with computational modeling to derive the value individuals assigned to the opportunity to experience an intense tactile stimulus (mild electric shock). We then examined functional imaging data recorded during task performance to see how the opportunity to experience the sensory stimulus was encoded in stimulation-seekers versus stimulation-avoiders. We found that for individuals who positively sought out this kind of sensory stimulation, there was common encoding of anticipated economic and sensory rewards in the ventromedial prefrontal cortex. Conversely, there was robust encoding of the modeled probability of receiving such stimulation in the insula only in stimulation-avoidant individuals. Finally, we found preliminary evidence that sensory prediction error signals may be positively signed for stimulation-seekers, but negatively signed for stimulation-avoiders, in the posterior cingulate cortex. These findings may help explain why high intensity sensory experiences are appetitive for some individuals, but not for others, and may have relevance for the increased vulnerability for some psychopathologies, but perhaps increased resilience for others, in high sensation-seeking individuals. SIGNIFICANCE STATEMENT: People vary in their preference for intense sensory experiences. Here, we investigated how different individuals evaluate the prospect of an unusual sensory experience (electric shock), compared with the opportunity to gain a more traditional reward (money). We found that in a subset of individuals who sought out such unusual sensory stimulation, anticipation of the sensory outcome was encoded in the same way as that of monetary gain, in the ventromedial prefrontal cortex. Further understanding of stimulation-seeking behavior may shed light on the etiology of psychopathologies such as addiction, for which high or low sensation-seeking personality has been identified as a risk factor.

Neurocomputational mechanisms of prosocial learning and links to empathy.

Reinforcement learning theory powerfully characterizes how we learn to benefit ourselves. In this theory, prediction errors-the difference between a predicted and actual outcome of a choice-drive learning. However, we do not operate in a social vacuum. To behave prosocially we must learn the consequences of our actions for other people. Empathy, the ability to vicariously experience and understand the affect of others, is hypothesized to be a critical facilitator of prosocial behaviors, but the link between empathy and prosocial behavior is still unclear. During functional magnetic resonance imaging (fMRI) participants chose between different stimuli that were probabilistically associated with rewards for themselves (self), another person (prosocial), or no one (control). Using computational modeling, we show that people can learn to obtain rewards for others but do so more slowly than when learning to obtain rewards for themselves. fMRI revealed that activity in a posterior portion of the subgenual anterior cingulate cortex/basal forebrain (sgACC) drives learning only when we are acting in a prosocial context and signals a prosocial prediction error conforming to classical principles of reinforcement learning theory. However, there is also substantial variability in the neural and behavioral efficiency of prosocial learning, which is predicted by trait empathy. More empathic people learn more quickly when benefitting others, and their sgACC response is the most selective for prosocial learning. We thus reveal a computational mechanism driving prosocial learning in humans. This framework could provide insights into atypical prosocial behavior in those with disorders of social cognition.

Elucidating poor decision-making in a rat gambling task.

Although poor decision-making is a hallmark of psychiatric conditions such as attention deficit/hyperactivity disorder, pathological gambling or substance abuse, a fraction of healthy individuals exhibit similar poor decision-making performances in everyday life and specific laboratory tasks such as the Iowa Gambling Task. These particular individuals may provide information on risk factors or common endophenotypes of these mental disorders. In a rodent version of the Iowa gambling task--the Rat Gambling Task (RGT), we identified a population of poor decision makers, and assessed how these rats scored for several behavioral traits relevant to executive disorders: risk taking, reward seeking, behavioral inflexibility, and several aspects of impulsivity. First, we found that poor decision-making could not be well predicted by single behavioral and cognitive characteristics when considered separately. By contrast, a combination of independent traits in the same individual, namely risk taking, reward seeking, behavioral inflexibility, as well as motor impulsivity, was highly predictive of poor decision-making. Second, using a reinforcement-learning model of the RGT, we confirmed that only the combination of extreme scores on these traits could induce maladaptive decision-making. Third, the model suggested that a combination of these behavioral traits results in an inaccurate representation of rewards and penalties and inefficient learning of the environment. Poor decision-making appears as a consequence of the over-valuation of high-reward-high-risk options in the task. Such a specific psychological profile could greatly impair clinically healthy individuals in decision-making tasks and may predispose to mental disorders with similar symptoms.

The application of nonlinear Dynamic Causal Modelling for fMRI in subjects at high genetic risk of schizophrenia.

Nonlinear Dynamic Causal Modelling (DCM) for fMRI provides computational modelling of gating mechanisms at the neuronal population level. It allows for estimations of connection strengths with nonlinear modulation within task-dependent networks. This paper presents an application of nonlinear DCM in subjects at high familial risk of schizophrenia performing the Hayling Sentence Completion Task (HSCT). We analysed scans of 19 healthy controls and 46 subjects at high familial risk of schizophrenia, which included 26 high risk subjects without psychotic symptoms and 20 subjects with psychotic symptoms. The activity-dependent network consists of the intra parietal cortex (IPS), inferior frontal gyrus (IFG), middle temporal gyrus (MTG), anterior cingulate cortex (ACC) and the mediodorsal (MD) thalamus. The connections between the MD thalamus and the IFG were gated by the MD thalamus. We used DCM to investigate altered connection strength of these connections. Bayesian Model Selection (BMS) at the group and family level was used to compare the optimal bilinear and nonlinear models. Bayesian Model Averaging (BMA) was used to assess the connection strengths with the gating from the MD thalamus and the IFG. The nonlinear models provided the better explanation of the data. Furthermore, the BMA analysis showed significantly lower connection strength of the thalamocortical connection with nonlinear modulation from the MD thalamus in high risk subjects with psychotic symptoms and those who subsequently developed schizophrenia. These findings demonstrate that nonlinear DCM provides a method to investigate altered connectivity at the level of neural circuits. The reduced connection strength with thalamic gating may be a neurobiomarker implicated in the development of psychotic symptoms. This study suggests that nonlinear DCM could lead to new insights into functional and effective dysconnection at the network level in subjects at high familial risk.