Effort Foraging Task reveals positive correlation between individual differences in the cost of cognitive and physical effort in humans.

Effort-based decisions, in which people weigh potential future rewards against effort costs required to achieve those rewards involve both cognitive and physical effort, though the mechanistic relationship between them is not yet understood. Here, we use an individual differences approach to isolate and measure the computational processes underlying effort-based decisions and test the association between cognitive and physical domains. Patch foraging is an ecologically valid reward rate maximization problem with well-developed theoretical tools. We developed the Effort Foraging Task, which embedded cognitive or physical effort into patch foraging, to quantify the cost of both cognitive and physical effort indirectly, by their effects on foraging choices. Participants chose between harvesting a depleting patch, or traveling to a new patch that was costly in time and effort. Participants' exit thresholds (reflecting the reward they expected to receive by harvesting when they chose to travel to a new patch) were sensitive to cognitive and physical effort demands, allowing us to quantify the perceived effort cost in monetary terms. The indirect sequential choice style revealed effort-seeking behavior in a minority of participants (preferring high over low effort) that has apparently been missed by many previous approaches. Individual differences in cognitive and physical effort costs were positively correlated, suggesting that these are perceived and processed in common. We used canonical correlation analysis to probe the relationship of task measures to self-reported affect and motivation, and found correlations of cognitive effort with anxiety, cognitive function, behavioral activation, and self-efficacy, but no similar correlations with physical effort.

Transdiagnostic inflexible learning dynamics explain deficits in depression and schizophrenia.

Deficits in reward learning are core symptoms across many mental disorders. Recent work suggests that such learning impairments arise by a diminished ability to use reward history to guide behaviour, but the neuro-computational mechanisms through which these impairments emerge remain unclear. Moreover, limited work has taken a transdiagnostic approach to investigate whether the psychological and neural mechanisms that give rise to learning deficits are shared across forms of psychopathology. To provide insight into this issue, we explored probabilistic reward learning in patients diagnosed with major depressive disorder (n = 33) or schizophrenia (n = 24) and 33 matched healthy controls by combining computational modelling and single-trial EEG regression. In our task, participants had to integrate the reward history of a stimulus to decide whether it is worthwhile to gamble on it. Adaptive learning in this task is achieved through dynamic learning rates that are maximal on the first encounters with a given stimulus and decay with increasing stimulus repetitions. Hence, over the course of learning, choice preferences would ideally stabilize and be less susceptible to misleading information. We show evidence of reduced learning dynamics, whereby both patient groups demonstrated hypersensitive learning (i.e. less decaying learning rates), rendering their choices more susceptible to misleading feedback. Moreover, there was a schizophrenia-specific approach bias and a depression-specific heightened sensitivity to disconfirmational feedback (factual losses and counterfactual wins). The inflexible learning in both patient groups was accompanied by altered neural processing, including no tracking of expected values in either patient group. Taken together, our results thus provide evidence that reduced trial-by-trial learning dynamics reflect a convergent deficit across depression and schizophrenia. Moreover, we identified disorder distinct learning deficits.

Reward-Mediated, Model-Free Reinforcement-Learning Mechanisms in Pavlovian and Instrumental Tasks Are Related.

Model-free and model-based computations are argued to distinctly update action values that guide decision-making processes. It is not known, however, if these model-free and model-based reinforcement learning mechanisms recruited in operationally based instrumental tasks parallel those engaged by pavlovian-based behavioral procedures. Recently, computational work has suggested that individual differences in the attribution of incentive salience to reward predictive cues, that is, sign- and goal-tracking behaviors, are also governed by variations in model-free and model-based value representations that guide behavior. Moreover, it is not appreciated if these systems that are characterized computationally using model-free and model-based algorithms are conserved across tasks for individual animals. In the current study, we used a within-subject design to assess sign-tracking and goal-tracking behaviors using a pavlovian conditioned approach task and then characterized behavior using an instrumental multistage decision-making (MSDM) task in male rats. We hypothesized that both pavlovian and instrumental learning processes may be driven by common reinforcement-learning mechanisms. Our data confirm that sign-tracking behavior was associated with greater reward-mediated, model-free reinforcement learning and that it was also linked to model-free reinforcement learning in the MSDM task. Computational analyses revealed that pavlovian model-free updating was correlated with model-free reinforcement learning in the MSDM task. These data provide key insights into the computational mechanisms mediating associative learning that could have important implications for normal and abnormal states.SIGNIFICANCE STATEMENT Model-free and model-based computations that guide instrumental decision-making processes may also be recruited in pavlovian-based behavioral procedures. Here, we used a within-subject design to test the hypothesis that both pavlovian and instrumental learning processes were driven by common reinforcement-learning mechanisms. Sign-tracking and goal-tracking behaviors were assessed in rats using a pavlovian conditioned approach task, and then instrumental behavior was characterized using an MSDM task. We report that sign-tracking behavior was associated with greater model-free, but not model-based, learning in the MSDM task. These data suggest that pavlovian and instrumental behaviors may be driven by conserved reinforcement-learning mechanisms.

Data-driven sequence of cognitive decline in people with Parkinson's disease.

BACKGROUND: Understanding the sequential progression of cognitive impairments in Parkinson's disease (PD) is crucial for elucidating neuropathological underpinnings, refining the assessment of PD-related cognitive decline stages and enhancing early identification for targeted interventions. The first aim of this study was to use an innovative event-based modeling (EBM) analytic approach to estimate the sequence of cognitive declines in PD. The second aim was to validate the EBM by examining associations with EBM-derived individual-specific estimates of cognitive decline severity and performance on independent cognitive screening measures. METHODS: This cross-sectional observational study included 99 people with PD who completed a neuropsychological battery. Individuals were classified as meeting the criteria for mild cognitive impairment (PD-MCI) or subtle cognitive decline by consensus. An EBM was constructed to compare cognitively healthy individuals with those with PD-MCI or subtle cognitive disturbances. Multivariable linear regression estimated associations between the EBM-derived stage of cognitive decline and performance on two independent cognitive screening tests. RESULTS: The EBM estimated that tests assessing executive function and visuospatial ability become abnormal early in the sequence of PD-related cognitive decline. Each higher estimated stage of cognitive decline was associated with approximately 0.24 worse performance on the Dementia Rating Scale (p<0.001) and 0.26 worse performance on the Montreal Cognitive Assessment (p<0.001) adjusting for demographic and clinical variables. CONCLUSION: Findings from this study will have important clinical implications for practitioners, on specific cognitive tests to prioritise, when conducting neuropsychological evaluations with people with PD. Results also highlight the importance of frontal-subcortical system disruption impacting executive and visuospatial abilities.

A core component of psychological therapy causes adaptive changes in computational learning mechanisms.

BACKGROUND: Cognitive distancing is an emotion regulation strategy commonly used in psychological treatment of various mental health disorders, but its therapeutic mechanisms are unknown. METHODS: 935 participants completed an online reinforcement learning task involving choices between pairs of symbols with differing reward contingencies. Half (49.1%) of the sample was randomised to a cognitive self-distancing intervention and were trained to regulate or 'take a step back' from their emotional response to feedback throughout. Established computational (Q-learning) models were then fit to individuals' choices to derive reinforcement learning parameters capturing clarity of choice values (inverse temperature) and their sensitivity to positive and negative feedback (learning rates). RESULTS: Cognitive distancing improved task performance, including when participants were later tested on novel combinations of symbols without feedback. Group differences in computational model-derived parameters revealed that cognitive distancing resulted in clearer representations of option values (estimated 0.17 higher inverse temperatures). Simultaneously, distancing caused increased sensitivity to negative feedback (estimated 19% higher loss learning rates). Exploratory analyses suggested this resulted from an evolving shift in strategy by distanced participants: initially, choices were more determined by expected value differences between symbols, but as the task progressed, they became more sensitive to negative feedback, with evidence for a difference strongest by the end of training. CONCLUSIONS: Adaptive effects on the computations that underlie learning from reward and loss may explain the therapeutic benefits of cognitive distancing. Over time and with practice, cognitive distancing may improve symptoms of mental health disorders by promoting more effective engagement with negative information.

Depression is associated with blunted affective responses to naturalistic reward prediction errors.

BACKGROUND: Depression is characterized by abnormalities in emotional processing, but the specific drivers of such emotional abnormalities are unknown. Computational work indicates that both surprising outcomes (prediction errors; PEs) and outcomes (values) themselves drive emotional responses, but neither has been consistently linked to affective disturbances in depression. As a result, the computational mechanisms driving emotional abnormalities in depression remain unknown. METHODS: Here, in 687 individuals, one-third of whom qualify as depressed via a standard self-report measure (the PHQ-9), we use high-stakes, naturalistic events - the reveal of midterm exam grades - to test whether individuals with heightened depression display a specific reduction in emotional response to positive PEs. RESULTS: Using Bayesian mixed effects models, we find that individuals with heightened depression do not affectively benefit from surprising, good outcomes - that is, they display reduced affective responses to positive PEs. These results were highly specific: effects were not observed to negative PEs, value signals (grades), and were not related to generalized anxiety. This suggests that the computational drivers of abnormalities in emotion in depression may be specifically due to positive PE-based emotional responding. CONCLUSIONS: Affective abnormalities are core depression symptoms, but the computational mechanisms underlying such differences are unknown. This work suggests that blunted affective reactions to positive PEs are likely mechanistic drivers of emotional dysregulation in depression.

The explore/exploit trade-off: An ecologically valid and translational framework that can advance mechanistic understanding of eating disorders.

The explore/exploit trade-off is a decision-making process that is conserved across species and balances exploring unfamiliar choices of unknown value with choosing familiar options of known value to maximize reward. This framework is rooted in behavioral ecology and has traditionally been used to study maladaptive versus adaptive non-human animal foraging behavior. Researchers have begun to recognize the potential utility of understanding human decision-making and psychopathology through the explore/exploit trade-off. In this article, we propose that explore/exploit trade-off holds promise for advancing our mechanistic understanding of decision-making processes that confer vulnerability for and maintain eating pathology due to its neurodevelopmental bases, conservation across species, and ability to be mathematically modeled. We present a model for how suboptimal explore/exploit decision-making can promote disordered eating and present recommendations for future research applying this framework to eating pathology. Taken together, the explore/exploit trade-off provides a translational framework for expanding etiologic and maintenance models of eating pathology, given developmental changes in explore/exploit decision-making that coincide in time with the emergence of eating pathology and evidence of biased explore/exploit decision-making in psychopathology. Additionally, understanding explore/exploit decision-making in eating disorders may improve knowledge of their underlying pathophysiology, informing targeted clinical interventions such as neuromodulation and pharmacotherapy. PUBLIC SIGNIFICANCE STATEMENT: The explore/exploit trade-off is a cross-species decision-making process whereby organisms choose between a known option with a known reward or sampling unfamiliar options. We hypothesize that imbalanced explore/exploit decision-making can promote disordered eating and present preliminary data. We propose that explore/exploit trade-off has significant potential to advance understanding of the neurocognitive and neurodevelopmental mechanisms of eating pathology, which could ultimately guide revisions of etiologic models and inform novel interventions.

El balance entre explorar y explotar es un proceso de toma de decisiones que se conserva a través de las especies y equilibra la exploración de opciones desconocidas de valor desconocido con la elección de opciones familiares de valor conocido para maximizar la recompensa. Este marco está arraigado en la ecología del comportamiento y tradicionalmente se ha utilizado para estudiar el comportamiento de forrajeo no adaptativo versus adaptativo en animales no humanos. Los investigadores han comenzado a reconocer la utilidad potencial de entender la toma de decisiones humanas y la psicopatología a través del balance entre explorar y explotar. En este artículo, proponemos que el balance entre explorar y explotar ofrece promesas para avanzar en nuestra comprensión mecanicista de los procesos de toma de decisiones que confieren vulnerabilidad y mantienen la patología alimentaria debido a sus bases neurodesarrolladoras, su conservación a través de las especies y su capacidad de ser modelado matemáticamente. Presentamos un modelo de cómo la toma de decisiones subóptima entre explorar y explotar puede promover la alimentación disfuncional y presentamos recomendaciones para futuras investigaciones que apliquen este marco a la patología alimentaria. En conjunto, el balance entre explorar y explotar proporciona un marco translacional para expandir los modelos etiológicos y de mantenimiento de la patología alimentaria, dadas los cambios en el desarrollo de la toma de decisiones entre explorar y explotar que coinciden en el tiempo con la aparición de la patología alimentaria y la evidencia de una toma de decisiones entre explorar y explotar sesgada en la psicopatología. Además, comprender la toma de decisiones entre explorar y explotar en los trastornos alimentarios puede mejorar el conocimiento de su fisiopatología subyacente, informando intervenciones clínicas dirigidas como la neuromodulación y la farmacoterapia.

Modeling brain dynamics and gaze behavior: Starting point bias and drift rate relate to frontal midline theta oscillations.

Frontal midline theta oscillatory dynamics have been implicated as an important neural signature of inhibitory control. However, most proactive cognitive control studies rely on behavioral tasks where individual differences are inferred through button presses. We applied computational modeling to further refine our understanding of theta dynamics in a cued anti-saccade task with gaze-contingent eye tracking. Using a drift diffusion model, increased frontal midline theta power during high-conflict, relative to low-conflict, trials predicted a more conservative style of responding through the starting point (bias). During both high- and low-conflict trials, increases in frontal midline theta also predicted improvements in response efficiency (drift rate). Regression analyses provided support for the importance of the starting point bias, which was associated with frontal midline theta over the course of the task above-and-beyond both drift rate and mean reaction time. Our findings provide a more thorough understanding of proactive gaze control by linking trial-by-trial increases of frontal midline theta to a shift in starting point bias facilitating a more neutral style of responding.

Predicting future depressive episodes from resting-state fMRI with generative embedding.

After a first episode of major depressive disorder (MDD), there is substantial risk for a long-term remitting-relapsing course. Prevention and early interventions are thus critically important. Various studies have examined the feasibility of detecting at-risk individuals based on out-of-sample predictions about the future occurrence of depression. However, functional magnetic resonance imaging (fMRI) has received very little attention for this purpose so far. Here, we explored the utility of generative models (i.e. different dynamic causal models, DCMs) as well as functional connectivity (FC) for predicting future episodes of depression in never-depressed adults, using a large dataset (N = 906) of task-free ("resting state") fMRI data from the UK Biobank (UKB). Connectivity analyses were conducted using timeseries from pre-computed spatially independent components of different dimensionalities. Over a three-year period, 50% of selected participants showed indications of at least one depressive episode, while the other 50% did not. Using nested cross-validation for training and a held-out test set (80/20 split), we systematically examined the combination of 8 connectivity feature sets and 17 classifiers. We found that a generative embedding procedure based on combining regression DCM (rDCM) with a support vector machine (SVM) enabled the best predictions, both on the training set (0.63 accuracy, 0.66 area under the curve, AUC) and the test set (0.62 accuracy, 0.64 AUC; p < 0.001). However, on the test set, rDCM was only slightly superior to predictions based on FC (0.59 accuracy, 0.61 AUC). Interpreting model predictions based on SHAP (SHapley Additive exPlanations) values suggested that the most predictive connections were widely distributed and not confined to specific networks. Overall, our analyses suggest (i) ways of improving future fMRI-based generative embedding approaches for the early detection of individuals at-risk for depression and that (ii) achieving accuracies of clinical utility may require combination of fMRI with other data modalities.

Interoceptive and metacognitive facets of fatigue in multiple sclerosis.

Numerous disorders are characterised by fatigue as a highly disabling symptom. Fatigue plays a particularly important clinical role in multiple sclerosis (MS) where it exerts a profound impact on quality of life. Recent concepts of fatigue grounded in computational theories of brain-body interactions emphasise the role of interoception and metacognition in the pathogenesis of fatigue. So far, however, for MS, empirical data on interoception and metacognition are scarce. This study examined interoception and (exteroceptive) metacognition in a sample of 71 persons with a diagnosis of MS. Interoception was assessed by prespecified subscales of a standard questionnaire (Multidimensional Assessment of Interoceptive Awareness [MAIA]), while metacognition was investigated with computational models of choice and confidence data from a visual discrimination paradigm. Additionally, autonomic function was examined by several physiological measurements. Several hypotheses were tested based on a preregistered analysis plan. In brief, we found the predicted association of interoceptive awareness with fatigue (but not with exteroceptive metacognition) and an association of autonomic function with exteroceptive metacognition (but not with fatigue). Furthermore, machine learning (elastic net regression) showed that individual fatigue scores could be predicted out-of-sample from our measurements, with questionnaire-based measures of interoceptive awareness and sleep quality as key predictors. Our results support theoretical concepts of interoception as an important factor for fatigue and demonstrate the general feasibility of predicting individual levels of fatigue from simple questionnaire-based measures of interoception and sleep.

Measuring cognitive effort without difficulty.

An important finding in the cognitive effort literature has been that sensitivity to the costs of effort varies between individuals, suggesting that some people find effort more aversive than others. It has been suggested this may explain individual differences in other aspects of cognition; in particular that greater effort sensitivity may underlie some of the symptoms of conditions such as depression and schizophrenia. In this paper, we highlight a major problem with existing measures of cognitive effort that hampers this line of research, specifically the confounding of effort and difficulty. This means that behaviour thought to reveal effort costs could equally be explained by cognitive capacity, which influences the frequency of success and thereby the chance of obtaining reward. To address this shortcoming, we introduce a new test, the Number Switching Task (NST), specially designed such that difficulty will be unaffected by the effort manipulation and can easily be standardised across participants. In a large, online sample, we show that these criteria are met successfully and reproduce classic effort discounting results with the NST. We also demonstrate the use of Bayesian modelling with this task, producing behavioural parameters which can be associated with other measures, and report a preliminary association with the Need for Cognition scale.

Toward a computational understanding of how reminiscing about positive autobiographical memories influences decision-making under risk.

Recent computational psychiatric research has dissected decision-making under risk into different underlying cognitive computational constructs and identified disease-specific changes in these constructs. Studies are underway to investigate what kind of behavioral or psychological interventions can restore these cognitive, computational constructs. In our previous study, we showed that reminiscing about positive autobiographical memories reduced risk aversion and affected probability weighting in the opposite direction from that observed in psychiatric disorders. However, in that study, we compared positive versus neutral memory retrieval by using a within-subjects crossover posttest design. Therefore, the change of decision-making from baseline is unclear. Furthermore, we used a hypothetical decision-making task and did not include monetary incentives. We attempt to address these limitations and investigated how reminiscing about positive autobiographical memories influences decision-making under risk using a between-subjects pretest posttest comparison design with performance-contingent monetary incentives. In thirty-eight healthy, young adults, we found that reminiscing about positive memories reinforced the commonly observed inverted S-shaped nonlinear probability weighting (f = 0.345, medium to large in effect size). In contrast, reminiscing about positive memories did not affect risk aversion in general. Given that the change in probability weighting after reminiscing about positive memories is in the opposite direction from that observed in psychiatric disorders, our results indicate that positive autobiographical memory retrieval might be a useful behavioral intervention strategy for amending the altered decision-making under risk in psychiatric diseases.

Cognitive-attentional mechanisms of cooperation-with implications for attention-deficit hyperactivity disorder and cognitive neuroscience.

People's cooperativeness depends on many factors, such as their motives, cognition, experiences, and the situation they are in. To date, it is unclear how these factors interact and shape the decision to cooperate. We present a computational account of cooperation that not only provides insights for the design of effective incentive structures but also redefines neglected social-cognitive characteristics associated with attention-deficit hyperactivity disorder (ADHD). Leveraging game theory, we demonstrate that the source and magnitude of conflict between different motives affected the speed and frequency of cooperation. Integrating eye-tracking to measure motivation-based information processing during decision-making shows that participants' visual fixations on the gains of cooperation rather than its costs and risks predicted their cooperativeness on a trial-by-trial basis. Using Bayesian hierarchical modeling, we find that a situation's prosociality and participants' past experience each bias the decision-making process distinctively. ADHD characteristics explain individual differences in responsiveness across contexts, highlighting the clinical importance of experimentally studying reactivity in social interactions. We demonstrate how the use of eye-tracking and computational modeling can be used to experimentally investigate social-cognitive characteristics in clinical populations. We also discuss possible underlying neural mechanisms to be investigated in future studies.

Stronger coupling of emotional instability with reward processing in borderline personality disorder is predicted by schema modes.

BACKGROUND: Mood instability and risk-taking are hallmarks of borderline personality disorder (BPD). Schema modes are combinations of self-reflective evaluations, negative emotional states, and destructive coping strategies common in BPD. When activated, they can push patients with BPD into emotional turmoil and a dissociative state of mind. Our knowledge of the underlying neurocognitive mechanisms driving these changes is incomplete. We hypothesized that in patients with BPD, affective instability is more influenced by reward expectation, outcomes, and reward prediction errors (RPEs) during risky decision-making than in healthy controls. Additionally, we expected that these alterations would be related to schema modes. METHODS: Thirty-two patients with BPD and thirty-one healthy controls were recruited. We used an established behavioral paradigm to measure mood fluctuations during risky decision-making. The impact of expectations and RPEs on momentary mood was quantified by a computational model, and its parameters were estimated with hierarchical Bayesian analysis. Model parameters were compared using High-Density Intervals. RESULTS: We found that model parameters capturing the influence of RPE and Certain Rewards on mood were significantly higher in patients with BPD than in controls. These model parameters correlated significantly with schema modes, but not with depression severity. CONCLUSIONS: BPD is coupled with altered associations between mood fluctuation and reward processing under uncertainty. Our findings seem to be BPD-specific, as they stand in contrast with the correlates of depressive symptoms. Future studies should establish the clinical utility of these alterations, such as predicting or assessing therapeutic response in BPD.

Pupillary response in reward processing in adults with major depressive disorder in remission.

OBJECTIVE: Major depressive disorder (MDD) is associated with impaired reward processing and reward learning. The literature is inconclusive regarding whether these impairments persist after remission. The current study examined reward processing during a probabilistic learning task in individuals in remission from MDD (n = 19) and never depressed healthy controls (n = 31) matched for age and sex. The outcome measures were pupil dilation (an indirect index of noradrenergic activity and arousal) and computational modeling parameters. METHOD: Participants completed two versions (facial/nonfacial feedback) of probabilistic reward learning task with changing contingencies. Pupil dilation was measured with a corneal reflection eye tracker. The hypotheses and analysis plan were preregistered. RESULT: Healthy controls had larger pupil dilation following losses than gains (p <.001), whereas no significant difference between outcomes was found in individuals with a history of MDD, resulting in an interaction between group and outcome (ß = 0.81, SE = 0.34, t = 2.37, p = .018). The rMDD group also achieved lower mean score at the last trial (t[46.77] = 2.12, p = .040) as well as a smaller proportion of correct choices (t[46.70] = 2.09, p = .041) compared with healthy controls. CONCLUSION: Impaired reward processing may persist after remission from MDD and could constitute a latent risk factor for relapse. Measuring pupil dilation in a reward learning task is a promising method for identifying reward processing abnormalities linked to MDD. The task is simple and noninvasive, which makes it feasible for clinical research.

Computational Psychiatry Needs Time and Context.

Why has computational psychiatry yet to influence routine clinical practice? One reason may be that it has neglected context and temporal dynamics in the models of certain mental health problems. We develop three heuristics for estimating whether time and context are important to a mental health problem: Is it characterized by a core neurobiological mechanism? Does it follow a straightforward natural trajectory? And is intentional mental content peripheral to the problem? For many problems the answers are no, suggesting that modeling time and context is critical. We review computational psychiatry advances toward this end, including modeling state variation, using domain-specific stimuli, and interpreting differences in context. We discuss complementary network and complex systems approaches. Novel methods and unification with adjacent fields may inspire a new generation of computational psychiatry.

Is visual metacognition associated with autistic traits? A regression analysis shows no link between visual metacognition and Autism-Spectrum Quotient scores.

Metacognition -the human ability to recognize correct decisions- is a key cognitive process linked to learning and development. Several recent studies investigated the relationship between metacognition and autism. However, the evidence is still inconsistent. While some studies reported autistic people having lower levels of metacognitive sensitivity, others did not. Leveraging the fact that autistic traits are present in the general population, our study investigated the relationship between visual metacognition and autistic traits in a sample of 360 neurotypical participants. We measured metacognition as the correspondence between confidence and accuracy in a visual two alternative forced choice task. Autistic-traits were assessed through the Autism-spectrum Quotient (AQ) score. A regression analysis revealed no statistically significant association between autistic traits and metacognition or confidence. Furthermore, we found no link between AQ sub-scales and metacognition. We do not find support for the hypothesis that autistic traits are associated with metacognition in the general population.

Shared genetic architecture between mental health and the brain functional connectome in the UK Biobank.

Psychiatric disorders are complex clinical conditions with large heterogeneity and overlap in symptoms, genetic liability and brain imaging abnormalities. Building on a dimensional conceptualization of mental health, previous studies have reported genetic overlap between psychiatric disorders and population-level mental health, and between psychiatric disorders and brain functional connectivity. Here, in 30,701 participants aged 45-82 from the UK Biobank we map the genetic associations between self-reported mental health and resting-state fMRI-based measures of brain network function. Multivariate Omnibus Statistical Test revealed 10 genetic loci associated with population-level mental symptoms. Next, conjunctional FDR identified 23 shared genetic variants between these symptom profiles and fMRI-based brain network measures. Functional annotation implicated genes involved in brain structure and function, in particular related to synaptic processes such as axonal growth (e.g. NGFR and RHOA). These findings provide further genetic evidence of an association between brain function and mental health traits in the population.

Rapid, reliable mobile assessment of affect-related motor processing.

Mobile technologies can be used for behavioral assessments to associate changes in behavior with environmental context and its influence on mental health and disease. Research on real-time motor control with a joystick, analyzed using a computational proportion-derivative (PD) modeling approach, has shown that model parameters can be estimated with high reliability and are related both to self-reported fear and to brain structures important for affective regulation, such as the anterior cingulate cortex. Here we introduce a mobile version of this paradigm, the rapid assessment of motor processing (RAMP) paradigm, and show that it provides robust, reliable, and accessible behavioral measurements relevant to mental health. A smartphone version of a previous joystick sensorimotor task was developed in which participants control a virtual car to a stop sign and stop. A sample of 89 adults performed the task, with 66 completing a second retest session. A PD modeling approach was applied to compute Kp (drive) and Kd (damping) parameters. Both Kp and Kd exhibited high test-retest reliabilities (ICC .81 and .78, respectively). Replicating a previous finding from a different sample with the joystick version of the task, both Kp and Kd were negatively associated with self-reported fear. The RAMP paradigm, a mobile sensorimotor assessment, can be used to assess drive and damping during motor control, which is robustly associated with subjective affect. This paradigm could be useful for examining dynamic contextual modulation of affect-related processing, which could improve assessment of the effects of interventions for psychiatric disorders in a real-world context.

Test-retest reliability of reinforcement learning parameters.

It has recently been suggested that parameter estimates of computational models can be used to understand individual differences at the process level. One area of research in which this approach, called computational phenotyping, has taken hold is computational psychiatry. One requirement for successful computational phenotyping is that behavior and parameters are stable over time. Surprisingly, the test-retest reliability of behavior and model parameters remains unknown for most experimental tasks and models. The present study seeks to close this gap by investigating the test-retest reliability of canonical reinforcement learning models in the context of two often-used learning paradigms: a two-armed bandit and a reversal learning task. We tested independent cohorts for the two tasks (N = 69 and N = 47) via an online testing platform with a between-test interval of five weeks. Whereas reliability was high for personality and cognitive measures (with ICCs ranging from .67 to .93), it was generally poor for the parameter estimates of the reinforcement learning models (with ICCs ranging from .02 to .52 for the bandit task and from .01 to .71 for the reversal learning task). Given that simulations indicated that our procedures could detect high test-retest reliability, this suggests that a significant proportion of the variability must be ascribed to the participants themselves. In support of that hypothesis, we show that mood (stress and happiness) can partly explain within-participant variability. Taken together, these results are critical for current practices in computational phenotyping and suggest that individual variability should be taken into account in the future development of the field.