Ketamine Affects Prediction Errors about Statistical Regularities: A Computational Single-Trial Analysis of the Mismatch Negativity.

The auditory mismatch negativity (MMN) is significantly reduced in schizophrenia. Notably, a similar MMN reduction can be achieved with NMDA receptor (NMDAR) antagonists. Both phenomena have been interpreted as reflecting an impairment of predictive coding or, more generally, the "Bayesian brain" notion that the brain continuously updates a hierarchical model to infer the causes of its sensory inputs. Specifically, neurobiological interpretations of predictive coding view perceptual inference as an NMDAR-dependent process of minimizing hierarchical precision-weighted prediction errors (PEs), and disturbances of this putative process play a key role in hierarchical Bayesian theories of schizophrenia. Here, we provide empirical evidence for this theory, demonstrating the existence of multiple, hierarchically related PEs in a "roving MMN" paradigm. We applied a hierarchical Bayesian model to single-trial EEG data from healthy human volunteers of either sex who received the NMDAR antagonist S-ketamine in a placebo-controlled, double-blind, within-subject fashion. Using an unrestricted analysis of the entire time-sensor space, our trial-by-trial analysis indicated that low-level PEs (about stimulus transitions) are expressed early (102-207 ms poststimulus), while high-level PEs (about transition probability) are reflected by later components (152-199 and 215-277 ms) of single-trial responses. Furthermore, we find that ketamine significantly diminished the expression of high-level PE responses, implying that NMDAR antagonism disrupts the inference on abstract statistical regularities. Our findings suggest that NMDAR dysfunction impairs hierarchical Bayesian inference about the world's statistical structure. Beyond the relevance of this finding for schizophrenia, our results illustrate the potential of computational single-trial analyses for assessing potential pathophysiological mechanisms.

Effects of hunger, satiety and oral glucose on effective connectivity between hypothalamus and insular cortex.

The hypothalamus and insular cortex play an essential role in the integration of endocrine and homeostatic signals and their impact on food intake. Resting-state functional connectivity alterations of the hypothalamus, posterior insula (PINS) and anterior insula (AINS) are modulated by metabolic states and caloric intake. Nevertheless, a deeper understanding of how these factors affect the strength of connectivity between hypothalamus, PINS and AINS is missing. This study investigated whether effective (directed) connectivity within this network varies as a function of prandial states (hunger vs. satiety) and energy availability (glucose levels and/or hormonal modulation). To address this question, we measured twenty healthy male participants of normal weight twice: once after 36 â€‹h of fasting (except water consumption) and once under satiated conditions. During each session, resting-state functional MRI (rs-fMRI) and hormone concentrations were recorded before and after glucose administration. Spectral dynamic causal modeling (spDCM) was used to assess the effective connectivity between the hypothalamus and anterior and posterior insula. Using Bayesian model selection, we observed that the same model was identified as the most likely model for each rs-fMRI recording. Compared to satiety, the hunger condition enhanced the strength of the forward connections from PINS to AINS and reduced the strength of backward connections from AINS to PINS. Furthermore, the strength of connectivity from PINS to AINS was positively related to plasma cortisol levels in the hunger condition, mainly before glucose administration. However, there was no direct relationship between glucose treatment and effective connectivity. Our findings suggest that prandial states modulate connectivity between PINS and AINS and relate to theories of interoception and homeostatic regulation that invoke hierarchical relations between posterior and anterior insula.

Hierarchical prediction errors in midbrain and basal forebrain during sensory learning.

In Bayesian brain theories, hierarchically related prediction errors (PEs) play a central role for predicting sensory inputs and inferring their underlying causes, e.g., the probabilistic structure of the environment and its volatility. Notably, PEs at different hierarchical levels may be encoded by different neuromodulatory transmitters. Here, we tested this possibility in computational fMRI studies of audio-visual learning. Using a hierarchical Bayesian model, we found that low-level PEs about visual stimulus outcome were reflected by widespread activity in visual and supramodal areas but also in the midbrain. In contrast, high-level PEs about stimulus probabilities were encoded by the basal forebrain. These findings were replicated in two groups of healthy volunteers. While our fMRI measures do not reveal the exact neuron types activated in midbrain and basal forebrain, they suggest a dichotomy between neuromodulatory systems, linking dopamine to low-level PEs about stimulus outcome and acetylcholine to more abstract PEs about stimulus probabilities.

Free energy, precision and learning: the role of cholinergic neuromodulation.

Acetylcholine (ACh) is a neuromodulatory transmitter implicated in perception and learning under uncertainty. This study combined computational simulations and pharmaco-electroencephalography in humans, to test a formulation of perceptual inference based upon the free energy principle. This formulation suggests that ACh enhances the precision of bottom-up synaptic transmission in cortical hierarchies by optimizing the gain of supragranular pyramidal cells. Simulations of a mismatch negativity paradigm predicted a rapid trial-by-trial suppression of evoked sensory prediction error (PE) responses that is attenuated by cholinergic neuromodulation. We confirmed this prediction empirically with a placebo-controlled study of cholinesterase inhibition. Furthermore, using dynamic causal modeling, we found that drug-induced differences in PE responses could be explained by gain modulation in supragranular pyramidal cells in primary sensory cortex. This suggests that ACh adaptively enhances sensory precision by boosting bottom-up signaling when stimuli are predictable, enabling the brain to respond optimally under different levels of environmental uncertainty.

Modelling trial-by-trial changes in the mismatch negativity.

The mismatch negativity (MMN) is a differential brain response to violations of learned regularities. It has been used to demonstrate that the brain learns the statistical structure of its environment and predicts future sensory inputs. However, the algorithmic nature of these computations and the underlying neurobiological implementation remain controversial. This article introduces a mathematical framework with which competing ideas about the computational quantities indexed by MMN responses can be formalized and tested against single-trial EEG data. This framework was applied to five major theories of the MMN, comparing their ability to explain trial-by-trial changes in MMN amplitude. Three of these theories (predictive coding, model adjustment, and novelty detection) were formalized by linking the MMN to different manifestations of the same computational mechanism: approximate Bayesian inference according to the free-energy principle. We thereby propose a unifying view on three distinct theories of the MMN. The relative plausibility of each theory was assessed against empirical single-trial MMN amplitudes acquired from eight healthy volunteers in a roving oddball experiment. Models based on the free-energy principle provided more plausible explanations of trial-by-trial changes in MMN amplitude than models representing the two more traditional theories (change detection and adaptation). Our results suggest that the MMN reflects approximate Bayesian learning of sensory regularities, and that the MMN-generating process adjusts a probabilistic model of the environment according to prediction errors.

Changes in auditory feedback connections determine the severity of speech processing deficits after stroke.

We compared brain structure and function in two subgroups of 21 stroke patients with either moderate or severe chronic speech comprehension impairment. Both groups had damage to the supratemporal plane; however, the severe group suffered greater damage to two unimodal auditory areas: primary auditory cortex and the planum temporale. The effects of this damage were investigated using fMRI while patients listened to speech and speech-like sounds. Pronounced changes in connectivity were found in both groups in undamaged parts of the auditory hierarchy. Compared to controls, moderate patients had significantly stronger feedback connections from planum temporale to primary auditory cortex bilaterally, while in severe patients this connection was significantly weaker in the undamaged right hemisphere. This suggests that predictive feedback mechanisms compensate in moderately affected patients but not in severely affected patients. The key pathomechanism in humans with persistent speech comprehension impairments may be impaired feedback connectivity to unimodal auditory areas.

Striatal prediction error modulates cortical coupling.

Both perceptual inference and motor responses are shaped by learned probabilities. For example, stimulus-induced responses in sensory cortices and preparatory activity in premotor cortex reflect how (un)expected a stimulus is. This is in accordance with predictive coding accounts of brain function, which posit a fundamental role of prediction errors for learning and adaptive behavior. We used functional magnetic resonance imaging and recent advances in computational modeling to investigate how (failures of) learned predictions about visual stimuli influence subsequent motor responses. Healthy volunteers discriminated visual stimuli that were differentially predicted by auditory cues. Critically, the predictive strengths of cues varied over time, requiring subjects to continuously update estimates of stimulus probabilities. This online inference, modeled using a hierarchical Bayesian learner, was reflected behaviorally: speed and accuracy of motor responses increased significantly with predictability of the stimuli. We used nonlinear dynamic causal modeling to demonstrate that striatal prediction errors are used to tune functional coupling in cortical networks during learning. Specifically, the degree of striatal trial-by-trial prediction error activity controls the efficacy of visuomotor connections and thus the influence of surprising stimuli on premotor activity. This finding substantially advances our understanding of striatal function and provides direct empirical evidence for formal learning theories that posit a central role for prediction error-dependent plasticity.

Repetition suppression and plasticity in the human brain.

The suppression of neuronal responses to a repeated event is a ubiquitous phenomenon in neuroscience. However, the underlying mechanisms remain largely unexplored. The aim of this study was to examine the temporal evolution of experience-dependent changes in connectivity induced by repeated stimuli. We recorded event-related potentials (ERPs) during frequency changes of a repeating tone. Bayesian inversion of dynamic causal models (DCM) of ERPs revealed systematic repetition-dependent changes in both intrinsic and extrinsic connections, within a hierarchical cortical network. Critically, these changes occurred very quickly, over inter-stimulus intervals that implicate short-term synaptic plasticity. Furthermore, intrinsic (within-source) connections showed biphasic changes that were much faster than changes in extrinsic (between-source) connections, which decreased monotonically with repetition. This study shows that auditory perceptual learning is associated with repetition-dependent plasticity in the human brain. It is remarkable that distinct changes in intrinsic and extrinsic connections could be quantified so reliably and non-invasively using EEG.

A dual role for prediction error in associative learning.

Confronted with a rich sensory environment, the brain must learn statistical regularities across sensory domains to construct causal models of the world. Here, we used functional magnetic resonance imaging and dynamic causal modeling (DCM) to furnish neurophysiological evidence that statistical associations are learnt, even when task-irrelevant. Subjects performed an audio-visual target-detection task while being exposed to distractor stimuli. Unknown to them, auditory distractors predicted the presence or absence of subsequent visual distractors. We modeled incidental learning of these associations using a Rescorla-Wagner (RW) model. Activity in primary visual cortex and putamen reflected learning-dependent surprise: these areas responded progressively more to unpredicted, and progressively less to predicted visual stimuli. Critically, this prediction-error response was observed even when the absence of a visual stimulus was surprising. We investigated the underlying mechanism by embedding the RW model into a DCM to show that auditory to visual connectivity changed significantly over time as a function of prediction error. Thus, consistent with predictive coding models of perception, associative learning is mediated by prediction-error dependent changes in connectivity. These results posit a dual role for prediction-error in encoding surprise and driving associative plasticity.

The functional anatomy of the MMN: a DCM study of the roving paradigm.

Using dynamic causal modelling (DCM), we have presented provisional evidence to suggest: (i) the mismatch negativity (MMN) is generated by self-organised interactions within a hierarchy of cortical sources [Garrido, M.I., Kilner, J.M., Kiebel, S.J., Stephan, K.E., Friston, K.J., 2007. Dynamic causal modelling of evoked potentials: a reproducibility study. NeuroImage 36, 571-580] and (ii) the MMN rests on plastic change in both extrinsic (between-source) and intrinsic (within source) connections (Garrido et al., under review). In this work we re-visit these two key issues in the context of the roving paradigm. Critically, this paradigm allows us to discount any differential response to differences in the stimuli per se, because the standards and oddballs are physically identical. We were able to confirm both the hierarchical nature of the MMN generation and the conjoint role of changes in extrinsic and intrinsic connections. These findings are consistent with a predictive coding account of repetition-suppression and the MMN, which gracefully accommodates two important mechanistic perspectives; the model-adjustment hypothesis [Winkler, I., Karmos, G., Näätänen, R., 1996. Adaptive modelling of the unattended acoustic environment reflected in the mismatch negativity event-related potential. Brain Res. 742, 239-252; Näätänen, R., Winkler, I., 1999. The concept of auditory stimulus representation in cognitive neuroscience. Psychol Bull 125, 826-859; Sussman, E., Winkler, I., 2001. Dynamic sensory updating in the auditory system. Brain Res. Cogn Brain Res. 12, 431-439] and the adaptation hypothesis [May, P., Tiitinen, H., Ilmoniemi, R.J., Nyman, G., Taylor, J.G., Näätänen, R., 1999. Frequency change detection in human auditory cortex. J. Comput. Neurosci. 6, 99-120; Jääskeläinen, I.P., Ahveninen, J., Bonmassar, G., Dale, A.M., Ilmoniemi, R.J., Levänen, S., Lin, F.H., May, P., Melcher, J., Stufflebeam, S., Tiitinen, H., Belliveau, J.W., 2004. Human posterior auditory cortex gates novel sounds to consciousness. Proc. Natl. Acad. Sci. U. S. A. 101, 6809-6814].

Fronto-temporal interactions during overt verbal initiation and suppression.

The Hayling Sentence Completion Task (HSCT) is known to activate left hemisphere frontal and temporal language regions. However, the effective connectivity between frontal and temporal language regions associated with the task has yet to be examined. The aims of the study were to examine activation and effective connectivity during the HSCT using a functional magnetic resonance imaging (fMRI) paradigm in which participants made overt verbal responses. We predicted that producing an incongruent response (response suppression), compared to a congruent one (response initiation), would be associated with greater activation in the left prefrontal cortex and an increase in the effective connectivity between temporal and frontal regions. Fifteen participants were scanned while completing 80 sentence stems. The congruency and constraint of sentences varied across trials. Dynamic Causal Modeling (DCM) and Bayesian Model Selection (BMS) were used to compare a set of alternative DCMs of fronto-temporal connectivity. The HSCT activated regions in the left temporal and prefrontal cortices, and the cuneus. Response suppression was associated with greater activation in the left middle and orbital frontal gyri and the bilateral precuneus than response initiation. Left middle temporal and frontal regions identified by the conventional fMRI analyses were entered into the DCM analysis. Using a systematic BMS procedure, the optimal DCM showed that the connection from the left middle temporal gyrus, which was driven by verbal stimuli per se, was significantly increased in strength during response suppression compared to initiation. Greater effective connectivity between left temporal and prefrontal regions during response suppression may reflect the transfer of information from posterior temporal regions where semantic and lexical information is stored to prefrontal regions where it is manipulated in preparation for an appropriate response.

Nicotinic modulation of human auditory sensory memory: Evidence from mismatch negativity potentials.

Impairment in mismatch negativity (MMN) generation is a robust biological marker of schizophrenia. Understanding the physiological and pharmacological processes involved in its generation may therefore advance our understanding of this complex disorder. The present study tested if acute administration of nicotine modulates human auditory sensory memory as measured with MMN. ERP responses to tone duration deviants were recorded using a stimulation protocol with continuously changing (roving) standard stimuli in order to measure the effect of stimulus repetitions on encoding of new stimuli (MMN memory trace effect). Twenty healthy adult volunteers were randomly assigned to receive either a nicotine gum or placebo after a baseline ERP recording. Nicotine administration augmented MMN amplitude in the treatment group compared to the baseline recording, while no MMN change was found in the placebo group. The drug effect was due to a selective enhancement of a frontal positive potential to standard stimuli (from 80-200 ms post-stimulus), while the negativity to deviants remained unaffected. Furthermore, under nicotine stimulation this repetition positivity showed a more marked increase with stimulus repetition compared to baseline and placebo. These results have potential implications for schizophrenia by suggesting that nicotinic agonists could ameliorate patients' MMN deficits by improving stimulus encoding and sensory memory trace formation.