Deterioration in cognitive control related mPFC function underlying development of treatment resistance in early psychosis.

One third of people with psychosis become antipsychotic treatment-resistant and the underlying mechanisms remain unclear. We investigated whether altered cognitive control function is a factor underlying development of treatment resistance. We studied 50 people with early psychosis at a baseline visit (mean < 2 years illness duration) and follow-up visit (1 year later), when 35 were categorized at treatment-responsive and 15 as treatment-resistant. Participants completed an emotion-yoked reward learning task that requires cognitive control whilst undergoing fMRI and MR spectroscopy to measure glutamate levels from Anterior Cingulate Cortex (ACC). Changes in cognitive control related activity (in prefrontal cortex and ACC) over time were compared between treatment-resistant and treatment-responsive groups and related to glutamate. Compared to treatment-responsive, treatment-resistant participants showed blunted activity in right amygdala (decision phase) and left pallidum (feedback phase) at baseline which increased over time and was accompanied by a decrease in medial Prefrontal Cortex (mPFC) activity (feedback phase) over time. Treatment-responsive participants showed a negative relationship between mPFC activity and glutamate levels at follow-up, no such relationship existed in treatment-resistant participants. Reduced activity in right amygdala and left pallidum at baseline was predictive of treatment resistance at follow-up (67% sensitivity, 94% specificity). The findings suggest that deterioration in mPFC function over time, a key cognitive control region needed to compensate for an initial dysfunction within a social-emotional network, is a factor underlying development of treatment resistance in early psychosis. An uncoupling between glutamate and cognitive control related mPFC function requires further investigation that may present a future target for interventions.

Brain signatures of chronic gut inflammation.

Gut inflammation is thought to modify brain activity and behaviour via modulation of the gut-brain axis. However, how relapsing and remitting exposure to peripheral inflammation over the natural history of inflammatory bowel disease (IBD) contributes to altered brain dynamics is poorly understood. Here, we used electroencephalography (EEG) to characterise changes in spontaneous spatiotemporal brain states in Crohn's Disease (CD) (n = 40) and Ulcerative Colitis (UC) (n = 30), compared to healthy individuals (n = 28). We first provide evidence of a significantly perturbed and heterogeneous microbial profile in CD, consistent with previous work showing enduring and long-standing dysbiosis in clinical remission. Results from our brain state assessment show that CD and UC exhibit alterations in the temporal properties of states implicating default-mode network, parietal, and visual regions, reflecting a shift in the predominance from externally to internally-oriented attentional modes. We investigated these dynamics at a finer sub-network resolution, showing a CD-specific and highly selective enhancement of connectivity between the insula and medial prefrontal cortex (mPFC), regions implicated in cognitive-interoceptive appraisal mechanisms. Alongside overall higher anxiety scores in CD, we also provide preliminary support to suggest that the strength of chronic interoceptive hyper-signalling in the brain co-occurs with disease duration. Together, our results demonstrate that a long-standing diagnosis of CD is, in itself, a key factor in determining the risk of developing altered brain network signatures.

Establishing brain states in neuroimaging data.

The definition of a brain state remains elusive, with varying interpretations across different sub-fields of neuroscience-from the level of wakefulness in anaesthesia, to activity of individual neurons, voltage in EEG, and blood flow in fMRI. This lack of consensus presents a significant challenge to the development of accurate models of neural dynamics. However, at the foundation of dynamical systems theory lies a definition of what constitutes the 'state' of a system-i.e., a specification of the system's future. Here, we propose to adopt this definition to establish brain states in neuroimaging timeseries by applying Dynamic Causal Modelling (DCM) to low-dimensional embedding of resting and task condition fMRI data. We find that ~90% of subjects in resting conditions are better described by first-order models, whereas ~55% of subjects in task conditions are better described by second-order models. Our work calls into question the status quo of using first-order equations almost exclusively within computational neuroscience and provides a new way of establishing brain states, as well as their associated phase space representations, in neuroimaging datasets.

Sub-second Dopamine Signals during Risky Decision-Making in Patients with Impulse Control Disorder.

Background: Impulse Control Disorder (ICD) in Parkinson's disease is a behavioral addiction arising secondary to dopaminergic therapies, most often dopamine receptor agonists. Prior research implicates changes in striatal function and heightened dopaminergic activity in the dorsal striatum of patients with ICD. However, this prior work does not possess the temporal resolution required to investigate dopaminergic signaling during real-time progression through various stages of decision-making involving anticipation and feedback. Methods: We recorded high-frequency (10Hz) measurements of extracellular dopamine in the striatum of patients with (N=3) and without (N=3) a history of ICD secondary to dopamine receptor agonist therapy for Parkinson's disease symptoms. These measurements were made using carbon fiber microelectrodes during awake DBS neurosurgery and while participants performed a sequential decision-making task involving risky investment decisions and real monetary gains and losses. Per clinical standard-of-care, participants withheld all dopaminergic medications prior to the procedure. Results: Patients with ICD invested significantly more money than patients without ICD. On each trial, patients with ICD made smaller adjustments to their investment levels compared to patients without ICD. In patients with ICD, dopamine levels rose or fell on sub-second timescales in anticipation of investment outcomes consistent with increased or decreased confidence in a positive outcome, respectively; dopamine levels in patients without ICD were significantly more stable during this phase. After outcome revelation, dopamine levels in patients with ICD rose significantly more than in inpatients without ICD for better-than-expected gains. For worse-than-expected losses, dopamine levels in patients with ICD remained level whereas dopamine levels in patients without ICD fell. Conclusion: We report significantly increased risky behavior and exacerbated phasic dopamine signaling, on sub-second timescales, anticipating and following the revelation of the outcomes of risky decisions in patients with ICD. Notably, these results were obtained when patients who had demonstrated ICD in the past but were, at the time of surgery, in an off-medication state. Thus, it is unclear whether observed signals reflect an inherent predisposition for ICD that was revealed when dopamine receptor agonists were introduced or whether these observations were caused by the introduction of dopamine receptor agonists and the patients having experienced ICD symptoms in the past. Regardless, future work investigating dopamine's role in human cognition, behavior, and disease should consider the signals this system generates on sub-second timescales.

Dynamic causal modeling reveals increased cerebellar- periaqueductal gray communication during fear extinction.

Introduction: The extinction of fear memories is an important component in regulating defensive behaviors, contributing toward adaptive processes essential for survival. The cerebellar medial nucleus (MCN) has bidirectional connections with the ventrolateral periaqueductal gray (vlPAG) and is implicated in the regulation of multiple aspects of fear, such as conditioned fear learning and the expression of defensive motor outputs. However, it is unclear how communication between the MCN and vlPAG changes during conditioned fear extinction. Methods: We use dynamic causal models (DCMs) to infer effective connectivity between the MCN and vlPAG during auditory cue-conditioned fear retrieval and extinction in the rat. DCMs determine causal relationships between neuronal sources by using neurobiologically motivated models to reproduce the dynamics of post-synaptic potentials generated by synaptic connections within and between brain regions. Auditory event related potentials (ERPs) during the conditioned tone offset were recorded simultaneously from MCN and vlPAG and then modeled to identify changes in the strength of the synaptic inputs between these brain areas and the relationship to freezing behavior across extinction trials. The DCMs were structured to model evoked responses to best represent conditioned tone offset ERPs and were adapted to represent PAG and cerebellar circuitry. Results: With the use of Parametric Empirical Bayesian (PEB) analysis we found that the strength of the information flow, mediated through enhanced synaptic efficacy from MCN to vlPAG was inversely related to freezing during extinction, i.e., communication from MCN to vlPAG increased with extinction. Discussion: The results are consistent with the cerebellum contributing to predictive processes that underpin fear extinction.

A primer on entropy in neuroscience.

Entropy is not just a property of a system - it is a property of a system and an observer. Specifically, entropy is a measure of the amount of hidden information in a system that arises due to an observer's limitations. Here we provide an account of entropy from first principles in statistical mechanics with the aid of toy models of neural systems. Specifically, we describe the distinction between micro and macrostates in the context of simplified binary-state neurons and the characteristics of entropy required to capture an associated measure of hidden information. We discuss the origin of the mathematical form of entropy via the indistinguishable re-arrangements of discrete-state neurons and show the way in which the arguments are extended into a phase space description for continuous large-scale neural systems. Finally, we show the ways in which limitations in neuroimaging resolution, as represented by coarse graining operations in phase space, lead to an increase in entropy in time as per the second law of thermodynamics. It is our hope that this primer will support the increasing number of studies that use entropy as a way of characterising neuroimaging timeseries and of making inferences about brain states.

The role of cognitive control in the positive symptoms of psychosis.

BACKGROUND: Positive symptoms of psychosis (e.g., hallucinations) often limit everyday functioning and can persist despite adequate antipsychotic treatment. We investigated whether poor cognitive control is a mechanism underlying these symptoms. METHODS: 97 patients with early psychosis (30 with high positive symptoms (HS) and 67 with low positive symptoms (LS)) and 40 healthy controls (HC) underwent fMRI whilst performing a reward learning task with two conditions; low cognitive demand (choosing between neutral faces) and high cognitive demand (choosing between angry and happy faces - shown to induce an emotional bias). Decision and feedback phases were examined. RESULTS: Both patient groups showed suboptimal learning behaviour compared to HC and altered activity within a core reward network including occipital/lingual gyrus (decision), rostral Anterior Cingulate Cortex, left pre-central gyrus and Supplementary Motor Cortex (feedback). In the low cognitive demand condition, HS group showed significantly reduced activity in Supplementary Motor Area (SMA)/pre-SMA during the decision phase whilst activity was increased in LS group compared to HC. Recruitment of this region suggests a top-down compensatory mechanism important for control of positive symptoms. With additional cognitive demand (emotional vs. neutral contrast), HS patients showed further alterations within a subcortical network (increased left amygdala activity during decisions and reduced left pallidum and thalamus activity during feedback) compared to LS patients. CONCLUSIONS: The findings suggest a core reward system deficit may be present in both patient groups, but persistent positive symptoms are associated with a specific dysfunction within a network needed to integrate social-emotional information with reward feedback.

Estimating anisotropy directly via neural timeseries.

An isotropic dynamical system is one that looks the same in every direction, i.e., if we imagine standing somewhere within an isotropic system, we would not be able to differentiate between different lines of sight. Conversely, anisotropy is a measure of the extent to which a system deviates from perfect isotropy, with larger values indicating greater discrepancies between the structure of the system along its axes. Here, we derive the form of a generalised scalable (mechanically similar) discretized field theoretic Lagrangian that allows for levels of anisotropy to be directly estimated via timeseries of arbitrary dimensionality. We generate synthetic data for both isotropic and anisotropic systems and, by using Bayesian model inversion and reduction, show that we can discriminate between the two datasets - thereby demonstrating proof of principle. We then apply this methodology to murine calcium imaging data collected in rest and task states, showing that anisotropy can be estimated directly from different brain states and cortical regions in an empirical in vivo biological setting. We hope that this theoretical foundation, together with the methodology and publicly available MATLAB code, will provide an accessible way for researchers to obtain new insight into the structural organization of neural systems in terms of how scalable neural regions grow - both ontogenetically during the development of an individual organism, as well as phylogenetically across species.

Microbiota links to neural dynamics supporting threat processing.

There is growing recognition that the composition of the gut microbiota influences behaviour, including responses to threat. The cognitive-interoceptive appraisal of threat-related stimuli relies on dynamic neural computations between the anterior insular (AIC) and the dorsal anterior cingulate (dACC) cortices. If, to what extent, and how microbial consortia influence the activity of this cortical threat processing circuitry is unclear. We addressed this question by combining a threat processing task, neuroimaging, 16S rRNA profiling and computational modelling in healthy participants. Results showed interactions between high-level ecological indices with threat-related AIC-dACC neural dynamics. At finer taxonomic resolutions, the abundance of Ruminococcus was differentially linked to connectivity between, and activity within the AIC and dACC during threat updating. Functional inference analysis provides a strong rationale to motivate future investigations of microbiota-derived metabolites in the observed relationship with threat-related brain processes.

World model learning and inference.

Understanding information processing in the brain-and creating general-purpose artificial intelligence-are long-standing aspirations of scientists and engineers worldwide. The distinctive features of human intelligence are high-level cognition and control in various interactions with the world including the self, which are not defined in advance and are vary over time. The challenge of building human-like intelligent machines, as well as progress in brain science and behavioural analyses, robotics, and their associated theoretical formalisations, speaks to the importance of the world-model learning and inference. In this article, after briefly surveying the history and challenges of internal model learning and probabilistic learning, we introduce the free energy principle, which provides a useful framework within which to consider neuronal computation and probabilistic world models. Next, we showcase examples of human behaviour and cognition explained under that principle. We then describe symbol emergence in the context of probabilistic modelling, as a topic at the frontiers of cognitive robotics. Lastly, we review recent progress in creating human-like intelligence by using novel probabilistic programming languages. The striking consensus that emerges from these studies is that probabilistic descriptions of learning and inference are powerful and effective ways to create human-like artificial intelligent machines and to understand intelligence in the context of how humans interact with their world.

Contextual perception under active inference.

Human social interactions depend on the ability to resolve uncertainty about the mental states of others. The context in which social interactions take place is crucial for mental state attribution as sensory inputs may be perceived differently depending on the context. In this paper, we introduce a mental state attribution task where a target-face with either an ambiguous or an unambiguous emotion is embedded in different social contexts. The social context is determined by the emotions conveyed by other faces in the scene. This task involves mental state attribution to a target-face (either happy or sad) depending on the social context. Using active inference models, we provide a proof of concept that an agent's perception of sensory stimuli may be altered by social context. We show with simulations that context congruency and facial expression coherency improve behavioural performance in terms of decision times. Furthermore, we show through simulations that the abnormal viewing strategies employed by patients with schizophrenia may be due to (i) an imbalance between the precisions of local and global features in the scene and (ii) a failure to modulate the sensory precision to contextualise emotions.

Rendering neuronal state equations compatible with the principle of stationary action.

The principle of stationary action is a cornerstone of modern physics, providing a powerful framework for investigating dynamical systems found in classical mechanics through to quantum field theory. However, computational neuroscience, despite its heavy reliance on concepts in physics, is anomalous in this regard as its main equations of motion are not compatible with a Lagrangian formulation and hence with the principle of stationary action. Taking the Dynamic Causal Modelling (DCM) neuronal state equation as an instructive archetype of the first-order linear differential equations commonly found in computational neuroscience, we show that it is possible to make certain modifications to this equation to render it compatible with the principle of stationary action. Specifically, we show that a Lagrangian formulation of the DCM neuronal state equation is facilitated using a complex dependent variable, an oscillatory solution, and a Hermitian intrinsic connectivity matrix. We first demonstrate proof of principle by using Bayesian model inversion to show that both the original and modified models can be correctly identified via in silico data generated directly from their respective equations of motion. We then provide motivation for adopting the modified models in neuroscience by using three different types of publicly available in vivo neuroimaging datasets, together with open source MATLAB code, to show that the modified (oscillatory) model provides a more parsimonious explanation for some of these empirical timeseries. It is our hope that this work will, in combination with existing techniques, allow people to explore the symmetries and associated conservation laws within neural systems - and to exploit the computational expediency facilitated by direct variational techniques.

Fine-tuning neural excitation/inhibition for tailored ketamine use in treatment-resistant depression.

The glutamatergic modulator ketamine has been shown to rapidly reduce depressive symptoms in patients with treatment-resistant major depressive disorder (TRD). Although its mechanisms of action are not fully understood, changes in cortical excitation/inhibition (E/I) following ketamine administration are well documented in animal models and could represent a potential biomarker of treatment response. Here, we analyse neuromagnetic virtual electrode time series collected from the primary somatosensory cortex in 18 unmedicated patients with TRD and in an equal number of age-matched healthy controls during a somatosensory 'airpuff' stimulation task. These two groups were scanned as part of a clinical trial of ketamine efficacy under three conditions: (a) baseline; (b) 6-9 h following subanesthetic ketamine infusion; and (c) 6-9 h following placebo-saline infusion. We obtained estimates of E/I interaction strengths by using dynamic causal modelling (DCM) on the time series, thereby allowing us to pinpoint, under each scanning condition, where each subject's dynamics lie within the Poincaré diagram-as defined in dynamical systems theory. We demonstrate that the Poincaré diagram offers classification capability for TRD patients, in that the further the patients' coordinates were shifted (by virtue of ketamine) toward the stable (top-left) quadrant of the Poincaré diagram, the more their depressive symptoms improved. The same relationship was not observed by virtue of a placebo effect-thereby verifying the drug-specific nature of the results. We show that the shift in neural dynamics required for symptom improvement necessitates an increase in both excitatory and inhibitory coupling. We present accompanying MATLAB code made available in a public repository, thereby allowing for future studies to assess individually tailored treatments of TRD.

Neural Systems Under Change of Scale.

We derive a theoretical construct that allows for the characterisation of both scalable and scale free systems within the dynamic causal modelling (DCM) framework. We define a dynamical system to be "scalable" if the same equation of motion continues to apply as the system changes in size. As an example of such a system, we simulate planetary orbits varying in size and show that our proposed methodology can be used to recover Kepler's third law from the timeseries. In contrast, a "scale free" system is one in which there is no characteristic length scale, meaning that images of such a system are statistically unchanged at different levels of magnification. As an example of such a system, we use calcium imaging collected in murine cortex and show that the dynamical critical exponent, as defined in renormalization group theory, can be estimated in an empirical biological setting. We find that a task-relevant region of the cortex is associated with higher dynamical critical exponents in task vs. spontaneous states and vice versa for a task-irrelevant region.

Model-based prediction of muscarinic receptor function from auditory mismatch negativity responses.

Drugs affecting neuromodulation, for example by dopamine or acetylcholine, take centre stage among therapeutic strategies in psychiatry. These neuromodulators can change both neuronal gain and synaptic plasticity and therefore affect electrophysiological measures. An important goal for clinical diagnostics is to exploit this effect in the reverse direction, i.e., to infer the status of specific neuromodulatory systems from electrophysiological measures. In this study, we provide proof-of-concept that the functional status of cholinergic (specifically muscarinic) receptors can be inferred from electrophysiological data using generative (dynamic causal) models. To this end, we used epidural EEG recordings over two auditory cortical regions during a mismatch negativity (MMN) paradigm in rats. All animals were treated, across sessions, with muscarinic receptor agonists and antagonists at different doses. Together with a placebo condition, this resulted in five levels of muscarinic receptor status. Using a dynamic causal model - embodying a small network of coupled cortical microcircuits - we estimated synaptic parameters and their change across pharmacological conditions. The ensuing parameter estimates associated with (the neuromodulation of) synaptic efficacy showed both graded muscarinic effects and predictive validity between agonistic and antagonistic pharmacological conditions. This finding illustrates the potential utility of generative models of electrophysiological data as computational assays of muscarinic function. In application to EEG data of patients from heterogeneous spectrum diseases, e.g. schizophrenia, such models might help identify subgroups of patients that respond differentially to cholinergic treatments. SIGNIFICANCE STATEMENT: In psychiatry, the vast majority of pharmacological treatments affect actions of neuromodulatory transmitters, e.g. dopamine or acetylcholine. As treatment is largely trial-and-error based, one of the goals for computational psychiatry is to construct mathematical models that can serve as "computational assays" and infer the status of specific neuromodulatory systems in individual patients. This translational neuromodeling strategy has great promise for electrophysiological data in particular but requires careful validation. The present study demonstrates that the functional status of cholinergic (muscarinic) receptors can be inferred from electrophysiological data using dynamic causal models of neural circuits. While accuracy needs to be enhanced and our results must be replicated in larger samples, our current results provide proof-of-concept for computational assays of muscarinic function using EEG.

Computational models link cellular mechanisms of neuromodulation to large-scale neural dynamics.

Decades of neurobiological research have disclosed the diverse manners in which the response properties of neurons are dynamically modulated to support adaptive cognitive functions. This neuromodulation is achieved through alterations in the biophysical properties of the neuron. However, changes in cognitive function do not arise directly from the modulation of individual neurons, but are mediated by population dynamics in mesoscopic neural ensembles. Understanding this multiscale mapping is an important but nontrivial issue. Here, we bridge these different levels of description by showing how computational models parametrically map classic neuromodulatory processes onto systems-level models of neural activity. The ensuing critical balance of systems-level activity supports perception and action, although our knowledge of this mapping remains incomplete. In this way, quantitative models that link microscale neuronal neuromodulation to systems-level brain function highlight gaps in knowledge and suggest new directions for integrating theoretical and experimental work.

Cognitive control network connectivity differentially disrupted in treatment resistant schizophrenia.

Antipsychotic treatment resistance affects a third of people with schizophrenia and the underlying mechanism remains unclear. We used an fMRI emotion-yoked reward learning task, allied to prefrontal cortical glutamate levels, to explain the role of cognitive control in differentiating treatment-resistant from responsive patients. We investigated how reward learning is disrupted at the network level in 21 medicated treatment-responsive and 20 medicated treatment-resistant patients with schizophrenia compared with 24 healthy controls (HC). Dynamic Causal Modelling assessed how effective connectivity between regions in a cortico-striatal-limbic network is disrupted in each patient group compared to HC. Connectivity was also examined with respect to symptoms, salience and anterior cingulate (ACC) glutamate levels measured from the same region of the ACC. We found that ACC connectivity differentiated these patient groups, with responsive patients exhibiting increased top-down connectivity from ACC to sensory regions and reduced ACC drive to the striatum, while resistant patients showed altered connectivity within the ACC itself. In these resistant patients, the ACC drive to striatum was positively correlated with their symptom severity. ACC glutamate levels were found to correlate with ACC control over sensory regions in responsive patients but not in resistant patients. We suggest a central non-dopaminergic impairment that impacts cognitive control networks in treatment-resistant schizophrenia. This impairment was associated with disrupted reward learning and could be underpinned by aberrant glutamate function. These findings should form the focus of future treatment strategies (e.g. glutamatergic targets and giving clozapine earlier) in resistant patients.

Neural diffusivity and pre-emptive epileptic seizure intervention.

The propagation of epileptic seizure activity in the brain is a widespread pathophysiology that, in principle, should yield to intervention techniques guided by mathematical models of neuronal ensemble dynamics. During a seizure, neural activity will deviate from its current dynamical regime to one in which there are significant signal fluctuations. In silico treatments of neural activity are an important tool for the understanding of how the healthy brain can maintain stability, as well as of how pathology can lead to seizures. The hope is that, contained within the mathematical foundations of such treatments, there lie potential strategies for mitigating instabilities, e.g. via external stimulation. Here, we demonstrate that the dynamic causal modelling neuronal state equation generalises to a Fokker-Planck formalism if one extends the framework to model the ways in which activity propagates along the structural connections of neural systems. Using the Jacobian of this generalised state equation, we show that an initially unstable system can be rendered stable via a reduction in diffusivity-i.e., by lowering the rate at which neuronal fluctuations disperse to neighbouring regions. We show, for neural systems prone to epileptic seizures, that such a reduction in diffusivity can be achieved via external stimulation. Specifically, we show that this stimulation should be applied in such a way as to temporarily mirror the activity profile of a pathological region in its functionally connected areas. This counter-intuitive method is intended to be used pre-emptively-i.e., in order to mitigate the effects of the seizure, or ideally even prevent it from occurring in the first place. We offer proof of principle using simulations based on functional neuroimaging data collected from patients with idiopathic generalised epilepsy, in which we successfully suppress pathological activity in a distinct sub-network prior to seizure onset. Our hope is that this technique can form the basis for future real-time monitoring and intervention devices that are capable of treating epilepsy in a non-invasive manner.