Dysfunctional Alpha Modulation as a Mechanism of Working Memory Impairment in Serious Mental Illness.

BACKGROUND: People with psychosis and mood disorders experience disruptions in working memory; however, the underlying mechanism remains unknown. We focused on two potential mechanisms: first, poor attentional engagement should be associated with elevated levels of pre-stimulus alpha-band activity within the EEG, whereas impaired working memory encoding should be associated with reduced post-stimulus alpha suppression. METHODS: We collected EEG data from 68 people with schizophrenia, 43 people with bipolar disorder with a history of psychosis, and 53 people with major depressive disorder, as well as 90 healthy comparison subjects (HCS), while they completed a spatial working memory task. We quantified attention lapsing, memory precision, and memory capacity from the behavioral responses, and we quantified alpha using both traditional wavelet analysis as well as a novel approach for isolating oscillatory alpha power from aperiodic elements of the EEG signal. RESULTS: We found that (1) greater pre-stimulus alpha power estimated using traditional wavelet analysis predicted behavioral errors; (2) post-stimulus alpha suppression was reduced in the patient groups; and (3) reduced suppression was associated with lower likelihood of memory storage. However, we also observed that pre-stimulus alpha was larger among HCS compared to patients, and single-trial analyses showed that it was the aperiodic elements of the pre-stimulus EEG-not oscillatory alpha-that predicted behavioral errors. DISCUSSION: These results suggest that working memory impairments in serious mental illness primarily reflect an impairment in the post-stimulus encoding processes rather than reduced attentional engagement prior to stimulus onset.

Beyond discrete-choice options.

While decision theories have evolved over the past five decades, their focus has largely been on choices among a limited number of discrete options, even though many real-world situations have a continuous-option space. Recently, theories have attempted to address decisions with continuous-option spaces, and several computational models have been proposed within the sequential sampling framework to explain how we make a decision in continuous-option space. This article aims to review the main attempts to understand decisions on continuous-option spaces, give an overview of applications of these types of decisions, and present puzzles to be addressed by future developments.

From Tripping and Falling to Ruminating and Worrying: A Meta-Control Account of Repetitive Negative Thinking.

Repetitive negative thinking (RNT) is a transdiagnostic construct that encompasses rumination and worry, yet what precisely is shared between rumination and worry is unclear. To clarify this, we develop a meta-control account of RNT. Meta-control refers to the reinforcement and control of mental behavior via similar computations as reinforce and control motor behavior. We propose rumination and worry are coarse terms for failure in meta-control, just as tripping and falling are coarse terms for failure in motor control. We delineate four meta-control stages and risk factors increasing the chance of failure at each, including open-ended thoughts (stage 1), individual differences influencing subgoal execution (stage 2) and switching (stage 3), and challenges inherent to learning adaptive mental behavior (stage 4). Distinguishing these stages therefore elucidates diverse processes that lead to the same behavior of excessive RNT. Our account also subsumes prominent clinical accounts of RNT into a computational cognitive neuroscience framework.

Keeping an eye out for change: Anxiety disrupts adaptive resolution of policy uncertainty.

BACKGROUND: Human learning unfolds under uncertainty. Uncertainty is heterogeneous with different forms exerting distinct influences on learning. While one can be uncertain about what to do to maximize rewarding outcomes, known as policy uncertainty, one can also be uncertain about general world knowledge, known as epistemic uncertainty. In complex and naturalistic environments such as the social world, adaptive learning may hinge on striking a balance between attending to and resolving each type of uncertainty. Prior work illustrates that people with anxiety-those with increased threat and uncertainty sensitivity-learn less from aversive outcomes, particularly as outcomes become more uncertain. How does a learner adaptively trade-off between attending to these distinct sources of uncertainty to successfully learn about their social environment? METHODS: We developed a novel eye-tracking method to capture highly granular estimates of policy and epistemic uncertainty based on gaze patterns and pupil diameter (a physiological estimate of arousal) RESULTS: These empirically derived uncertainty measures reveal that humans (N = 94) flexibly switch between resolving policy and epistemic uncertainty to adaptively learn about which individuals can be trusted and which should be avoided. However, those with increased anxiety (N = 49) do not flexibly switch between resolving policy and epistemic uncertainty, and instead express less uncertainty overall CONCLUSIONS: Combining modeling and eye-tracking techniques, we show that altered learning in people with anxiety emerges from an insensitivity to policy uncertainty and rigid choice policies, leading to maladaptive behaviors with untrustworthy people.

Subthalamic control of impulsive actions: insights from deep brain stimulation in Parkinson's disease.

Control of actions allows adaptive, goal-directed behaviour. The basal ganglia, including the subthalamic nucleus, are thought to play a central role in dynamically controlling actions through recurrent negative feedback loops with the cerebral cortex. Here, we summarize recent translational studies that used deep brain stimulation to record neural activity from and apply electrical stimulation to the subthalamic nucleus in people with Parkinson's disease. These studies have elucidated spatial, spectral and temporal features of the neural mechanisms underlying the controlled delay of actions in cortico-subthalamic networks and demonstrated their causal effects on behaviour in distinct processing windows. While these mechanisms have been conceptualized as control signals for suppressing impulsive response tendencies in conflict tasks and as decision threshold adjustments in value-based and perceptual decisions, we propose a common framework linking decision-making, cognition and movement. Within this framework subthalamic deep brain stimulation can lead to suboptimal choices by reducing the time that patients take for deliberation before committing to an action. However, clinical studies have consistently shown that the occurrence of impulse control disorders is reduced, not increased, after subthalamic deep brain stimulation surgery. This apparent contradiction can be reconciled when recognizing the multifaceted nature of impulsivity, its underlying mechanisms and modulation by treatment. While subthalamic deep brain stimulation renders patients susceptible to making decisions without proper forethought, this can be disentangled from effects related to dopamine comprising sensitivity to benefits vs. costs, reward delay aversion and learning from outcomes. Alterations in these dopamine-mediated mechanisms are thought to underlie the development of impulse control disorders, and can be relatively spared with reduced dopaminergic medication after subthalamic deep brain stimulation. Together, results from studies using deep brain stimulation as an experimental tool have improved our understanding of action control in the human brain and have important implications for treatment of patients with Neurological disorders.

The challenge of learning adaptive mental behavior.

Many psychotherapies aim to help people replace maladaptive mental behaviors (such as those leading to unproductive worry) with more adaptive ones (such as those leading to active problem solving). Yet, little is known empirically about how challenging it is to learn adaptive mental behaviors. Mental behaviors entail taking mental operations and thus may be more challenging to perform than motor actions; this challenge may enhance or impair learning. In particular, challenge when learning is often desirable because it improves retention. Yet, it is also plausible that the necessity of carrying out mental operations interferes with learning the expected values of mental actions by impeding credit assignment: the process of updating an action's value after reinforcement. Then, it may be more challenging not only to perform-but also to learn the consequences of-mental (vs. motor) behaviors. We designed a task to assess learning to take adaptive mental versus motor actions via matched probabilistic feedback. In two experiments (N = 300), most participants found it more difficult to learn to select optimal mental (vs. motor) actions, as evident in worse accuracy not only in a learning but also test (retention) phase. Computational modeling traced this impairment to an indicator of worse credit assignment (impaired construction and maintenance of expected values) when learning mental actions, accounting for worse accuracy in the learning and retention phases. The results suggest that people have particular difficulty learning adaptive mental behavior and pave the way for novel interventions to scaffold credit assignment and promote adaptive thinking. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Ethological computational psychiatry: Challenges and opportunities.

Studying the intricacies of individual subjects' moods and cognitive processing over extended periods of time presents a formidable challenge in medicine. While much of systems neuroscience appropriately focuses on the link between neural circuit functions and well-constrained behaviors over short timescales (e.g., trials, hours), many mental health conditions involve complex interactions of mood and cognition that are non-stationary across behavioral contexts and evolve over extended timescales. Here, we discuss opportunities, challenges, and possible future directions in computational psychiatry to quantify non-stationary continuously monitored behaviors. We suggest that this exploratory effort may contribute to a more precision-based approach to treating mental disorders and facilitate a more robust reverse translation across animal species. We conclude with ethical considerations for any field that aims to bridge artificial intelligence and patient monitoring.

Assessing Trial-by-Trial Electrophysiological and Behavioral Markers of Attentional Control and Sensory Precision in Psychotic and Mood Disorders.

BACKGROUND AND HYPOTHESIS: The current study investigated the extent to which changes in attentional control contribute to performance on a visual perceptual discrimination task, on a trial-by-trial basis in a transdiagnostic clinical sample. STUDY DESIGN: Participants with schizophrenia (SZ; N = 58), bipolar disorder (N = 42), major depression disorder (N = 51), and psychiatrically healthy controls (N = 92) completed a visual perception task in which stimuli appeared briefly. The design allowed us to estimate the lapse rate and the precision of perceptual representations of the stimuli. Electroencephalograms (EEG) were recorded to examine pre-stimulus activity in the alpha band (8-13 Hz), overall and in relation to behavior performance on the task. STUDY RESULTS: We found that the attention lapse rate was elevated in the SZ group compared with all other groups. We also observed group differences in pre-stimulus alpha activity, with control participants showing the highest levels of pre-stimulus alpha when averaging across trials. However, trial-by-trial analyses showed within-participant fluctuations in pre-stimulus alpha activity significantly predicted the likelihood of making an error, in all groups. Interestingly, our analysis demonstrated that aperiodic contributions to the EEG signal (which affect power estimates across frequency bands) serve as a significant predictor of behavior as well. CONCLUSIONS: These results confirm the elevated attention lapse rate that has been observed in SZ, validate pre-stimulus EEG markers of attentional control and their use as a predictor of behavior on a trial-by-trial basis, and suggest that aperiodic contributions to the EEG signal are an important target for further research in this area, in addition to alpha-band activity.

Human Curriculum Effects Emerge with In-Context Learning in Neural Networks.

Human learning is sensitive to rule-like structure and the curriculum of examples used for training. In tasks governed by succinct rules, learning is more robust when related examples are blocked across trials, but in the absence of such rules, interleaving is more effective. To date, no neural model has simultaneously captured these seemingly contradictory effects. Here we show that this same tradeoff spontaneously emerges with "in-context learning" (ICL) both in neural networks trained with metalearning and in large language models (LLMs). ICL is the ability to learn new tasks "in context" - without weight changes - via an inner-loop algorithm implemented in activation dynamics. Experiments with pretrained LLMs and metalearning transformers show that ICL exhibits the blocking advantage demonstrated in humans on a task involving rule-like structure, and conversely, that concurrent in-weight learning reproduces the interleaving advantage observed in humans on tasks lacking such structure.

Cognitive Signatures of Depressive and Anhedonic Symptoms and Affective States Using Computational Modeling and Neurocognitive Testing.

BACKGROUND: Deeper phenotyping may improve our understanding of depression. Because depression is heterogeneous, extracting cognitive signatures associated with severity of depressive symptoms, anhedonia, and affective states is a promising approach. METHODS: Sequential sampling models decomposed behavior from an adaptive approach-avoidance conflict task into computational parameters quantifying latent cognitive signatures. Fifty unselected participants completed clinical scales and the approach-avoidance conflict task by either approaching or avoiding trials offering monetary rewards and electric shocks. RESULTS: Decision dynamics were best captured by a sequential sampling model with linear collapsing boundaries varying by net offer values, and with drift rates varying by trial-specific reward and aversion, reflecting net evidence accumulation toward approach or avoidance. Unlike conventional behavioral measures, these computational parameters revealed distinct associations with self-reported symptoms. Specifically, passive avoidance tendencies, indexed by starting point biases, were associated with greater severity of depressive symptoms (R = 0.34, p = .019) and anhedonia (R = 0.49, p = .001). Depressive symptoms were also associated with slower encoding and response execution, indexed by nondecision time (R = 0.37, p = .011). Higher reward sensitivity for offers with negative net values, indexed by drift rates, was linked to more sadness (R = 0.29, p = .042) and lower positive affect (R = -0.33, p = .022). Conversely, higher aversion sensitivity was associated with more tension (R = 0.33, p = .025). Finally, less cautious response patterns, indexed by boundary separation, were linked to more negative affect (R = -0.40, p = .005). CONCLUSIONS: We demonstrated the utility of multidimensional computational phenotyping, which could be applied to clinical samples to improve characterization and treatment selection.

Double dissociation of dopamine and subthalamic nucleus stimulation on effortful cost/benefit decision making.

Deep brain stimulation (DBS) and dopaminergic therapy (DA) are common interventions for Parkinson's disease (PD). Both treatments typically improve patient outcomes, and both can have adverse side effects on decision making (e.g., impulsivity).1,2 Nevertheless, they are thought to act via different mechanisms within basal ganglia circuits.3 Here, we developed and formally evaluated their dissociable predictions within a single cost/benefit effort-based decision-making task. In the same patients, we manipulated DA medication status and subthalamic nucleus (STN) DBS status within and across sessions. Using a series of descriptive and computational modeling analyses of participant choices and their dynamics, we confirm a double dissociation: DA medication asymmetrically altered participants' sensitivities to benefits vs. effort costs of alternative choices (boosting the sensitivity to benefits while simultaneously lowering sensitivity to costs); whereas STN DBS lowered the decision threshold of such choices. To our knowledge, this is the first study to show, using a common modeling framework, a dissociation of DA and DBS within the same participants. As such, this work offers a comprehensive account for how different mechanisms impact decision making, and how impulsive behavior (present in DA-treated patients with PD and DBS patients) may emerge from separate physiological mechanisms.

A Transdiagnostic Study of Effort-Cost Decision-Making in Psychotic and Mood Disorders.

BACKGROUND: Research suggests that effort-cost decision-making (ECDM), the estimation of work required to obtain reward, may be a relevant framework for understanding motivational impairment in psychotic and mood pathology. Specifically, research has suggested that people with psychotic and mood pathology experience effort as more costly than controls, and thus pursue effortful goals less frequently. This study examined ECDM across psychotic and mood pathology. HYPOTHESIS: We hypothesized that patient groups would show reduced willingness to expend effort compared to controls. STUDY DESIGN: People with schizophrenia (N = 33), schizoaffective disorder (N = 28), bipolar disorder (N = 39), major depressive disorder (N = 40), and controls (N = 70) completed a physical ECDM task. Participants decided between completing a low-effort or high-effort option for small or larger rewards, respectively. Reward magnitude, reward probability, and effort magnitude varied trial-by-trial. Data were analyzed using standard and hierarchical logistic regression analyses to assess the subject-specific contribution of various factors to choice. Negative symptoms were measured with a clinician-rated interview. STUDY RESULTS: There was a significant effect of group, driven by reduced choice of high-effort options in schizophrenia. Hierarchical logistic regression revealed that reduced choice of high-effort options in schizophrenia was driven by weaker contributions of probability information. Use of reward information was inversely associated with motivational impairment in schizophrenia. Surprisingly, individuals with major depressive disorder and bipolar disorder did not differ from controls. CONCLUSIONS: Our results provide support for ECDM deficits in schizophrenia. Additionally, differences between groups in ECDM suggest a seemingly similar behavioral phenotype, reduced motivation, could arise from disparate mechanisms.

Multiple routes to enhanced memory for emotionally relevant events.

Events associated with aversive or rewarding outcomes are prioritized in memory. This memory boost is commonly attributed to the elicited affective response, closely linked to noradrenergic and dopaminergic modulation of hippocampal plasticity. Herein we review and compare this 'affect' mechanism to an additional, recently discovered, 'prediction' mechanism whereby memories are strengthened by the extent to which outcomes deviate from expectations, that is, by prediction errors (PEs). The mnemonic impact of PEs is separate from the affective outcome itself and has a distinct neural signature. While both routes enhance memory, these mechanisms are linked to different - and sometimes opposing - predictions for memory integration. We discuss new findings that highlight mechanisms by which emotional events strengthen, integrate, and segment memory.

Neural Index of Reinforcement Learning Predicts Improved Stimulus-Response Retention under High Working Memory Load.

Human learning and decision-making are supported by multiple systems operating in parallel. Recent studies isolating the contributions of reinforcement learning (RL) and working memory (WM) have revealed a trade-off between the two. An interactive WM/RL computational model predicts that although high WM load slows behavioral acquisition, it also induces larger prediction errors in the RL system that enhance robustness and retention of learned behaviors. Here, we tested this account by parametrically manipulating WM load during RL in conjunction with EEG in both male and female participants and administered two surprise memory tests. We further leveraged single-trial decoding of EEG signatures of RL and WM to determine whether their interaction predicted robust retention. Consistent with the model, behavioral learning was slower for associations acquired under higher load but showed parametrically improved future retention. This paradoxical result was mirrored by EEG indices of RL, which were strengthened under higher WM loads and predictive of more robust future behavioral retention of learned stimulus-response contingencies. We further tested whether stress alters the ability to shift between the two systems strategically to maximize immediate learning versus retention of information and found that induced stress had only a limited effect on this trade-off. The present results offer a deeper understanding of the cooperative interaction between WM and RL and show that relying on WM can benefit the rapid acquisition of choice behavior during learning but impairs retention.SIGNIFICANCE STATEMENT Successful learning is achieved by the joint contribution of the dopaminergic RL system and WM. The cooperative WM/RL model was productive in improving our understanding of the interplay between the two systems during learning, demonstrating that reliance on RL computations is modulated by WM load. However, the role of WM/RL systems in the retention of learned stimulus-response associations remained unestablished. Our results show that increased neural signatures of learning, indicative of greater RL computation, under high WM load also predicted better stimulus-response retention. This result supports a trade-off between the two systems, where degraded WM increases RL processing, which improves retention. Notably, we show that this cooperative interplay remains largely unaffected by acute stress.

On the normative advantages of dopamine and striatal opponency for learning and choice.

The basal ganglia (BG) contribute to reinforcement learning (RL) and decision-making, but unlike artificial RL agents, it relies on complex circuitry and dynamic dopamine modulation of opponent striatal pathways to do so. We develop the OpAL* model to assess the normative advantages of this circuitry. In OpAL*, learning induces opponent pathways to differentially emphasize the history of positive or negative outcomes for each action. Dynamic DA modulation then amplifies the pathway most tuned for the task environment. This efficient coding mechanism avoids a vexing explore-exploit tradeoff that plagues traditional RL models in sparse reward environments. OpAL* exhibits robust advantages over alternative models, particularly in environments with sparse reward and large action spaces. These advantages depend on opponent and nonlinear Hebbian plasticity mechanisms previously thought to be pathological. Finally, OpAL* captures risky choice patterns arising from DA and environmental manipulations across species, suggesting that they result from a normative biological mechanism.

Adaptive control of synaptic plasticity integrates micro- and macroscopic network function.

Synaptic plasticity configures interactions between neurons and is therefore likely to be a primary driver of behavioral learning and development. How this microscopic-macroscopic interaction occurs is poorly understood, as researchers frequently examine models within particular ranges of abstraction and scale. Computational neuroscience and machine learning models offer theoretically powerful analyses of plasticity in neural networks, but results are often siloed and only coarsely linked to biology. In this review, we examine connections between these areas, asking how network computations change as a function of diverse features of plasticity and vice versa. We review how plasticity can be controlled at synapses by calcium dynamics and neuromodulatory signals, the manifestation of these changes in networks, and their impacts in specialized circuits. We conclude that metaplasticity-defined broadly as the adaptive control of plasticity-forges connections across scales by governing what groups of synapses can and can't learn about, when, and to what ends. The metaplasticity we discuss acts by co-opting Hebbian mechanisms, shifting network properties, and routing activity within and across brain systems. Asking how these operations can go awry should also be useful for understanding pathology, which we address in the context of autism, schizophrenia and Parkinson's disease.

Self-judgment dissected: A computational modeling analysis of self-referential processing and its relationship to trait mindfulness facets and depression symptoms.

Cognitive theories of depression, and mindfulness theories of well-being, converge on the notion that self-judgment plays a critical role in mental health. However, these theories have rarely been tested via tasks and computational modeling analyses that can disentangle the information processes operative in self-judgments. We applied a drift-diffusion computational model to the self-referential encoding task (SRET) collected before and after an 8-week mindfulness intervention (n = 96). A drift-rate regression parameter representing positive-relative to negative-self-referential judgment strength positively related to mindful awareness and inversely related to depression, both at baseline and over time; however, this parameter did not significantly relate to the interaction between mindful awareness and nonjudgmentalness. At the level of individual depression symptoms, at baseline, a spectrum of symptoms (inversely) correlated with the drift-rate regression parameter, suggesting that many distinct depression symptoms relate to valenced self-judgment between subjects. By contrast, over the intervention, changes in only a smaller subset of anhedonia-related depression symptoms showed substantial relationships with this parameter. Both behavioral and model-derived measures showed modest split-half and test-retest correlations. Results support cognitive theories that implicate self-judgment in depression and mindfulness theories, which imply that mindful awareness should lead to more positive self-views.

Cognitive [Computational] Neuroscience Test Reliability and Clinical Applications for Serious Mental Illness (CNTRaCS) Consortium: Progress and Future Directions.

The development of treatments for impaired cognition in schizophrenia has been characterized as the most important challenge facing psychiatry at the beginning of the twenty-first century. The Cognitive Neuroscience Treatment Research to Improve Cognition in Schizophrenia (CNTRICS) project was designed to build on the potential benefits of using tasks and tools from cognitive neuroscience to better understanding and treat cognitive impairments in psychosis. These benefits include: (1) the use of fine-grained tasks that measure discrete cognitive processes; (2) the ability to design tasks that distinguish between specific cognitive domain deficits and poor performance due to generalized deficits resulting from sedation, low motivation, poor test taking skills, etc.; and (3) the ability to link cognitive deficits to specific neural systems, using animal models, neuropsychology, and functional imaging. CNTRICS convened a series of meetings to identify paradigms from cognitive neuroscience that maximize these benefits and identified the steps need for translation into use in clinical populations. The Cognitive Neuroscience Test Reliability and Clinical Applications for Schizophrenia (CNTRaCS) Consortium was developed to help carry out these steps. CNTRaCS consists of investigators at five different sites across the country with diverse expertise relevant to a wide range of the cognitive systems identified as critical as part of CNTRICs. This work reports on the progress and current directions in the evaluation and optimization carried out by CNTRaCS of the tasks identified as part of the original CNTRICs process, as well as subsequent extensions into the Positive Valence systems domain of Research Domain Criteria (RDoC). We also describe the current focus of CNTRaCS, which involves taking a computational psychiatry approach to measuring cognitive and motivational function across the spectrum of psychosis. Specifically, the current iteration of CNTRaCS is using computational modeling to isolate parameters reflecting potentially more specific cognitive and visual processes that may provide greater interpretability in understanding shared and distinct impairments across psychiatric disorders.

Beyond Drift Diffusion Models: Fitting a Broad Class of Decision and Reinforcement Learning Models with HDDM.

Computational modeling has become a central aspect of research in the cognitive neurosciences. As the field matures, it is increasingly important to move beyond standard models to quantitatively assess models with richer dynamics that may better reflect underlying cognitive and neural processes. For example, sequential sampling models (SSMs) are a general class of models of decision-making intended to capture processes jointly giving rise to RT distributions and choice data in n-alternative choice paradigms. A number of model variations are of theoretical interest, but empirical data analysis has historically been tied to a small subset for which likelihood functions are analytically tractable. Advances in methods designed for likelihood-free inference have recently made it computationally feasible to consider a much larger spectrum of SSMs. In addition, recent work has motivated the combination of SSMs with reinforcement learning models, which had historically been considered in separate literatures. Here, we provide a significant addition to the widely used HDDM Python toolbox and include a tutorial for how users can easily fit and assess a (user-extensible) wide variety of SSMs and how they can be combined with reinforcement learning models. The extension comes batteries included, including model visualization tools, posterior predictive checks, and ability to link trial-wise neural signals with model parameters via hierarchical Bayesian regression.