Intracortical recordings reveal vision-to-action cortical gradients driving human exogenous attention.

Exogenous attention, the process that makes external salient stimuli pop-out of a visual scene, is essential for survival. How attention-capturing events modulate human brain processing remains unclear. Here we show how the psychological construct of exogenous attention gradually emerges over large-scale gradients in the human cortex, by analyzing activity from 1,403 intracortical contacts implanted in 28 individuals, while they performed an exogenous attention task. The timing, location and task-relevance of attentional events defined a spatiotemporal gradient of three neural clusters, which mapped onto cortical gradients and presented a hierarchy of timescales. Visual attributes modulated neural activity at one end of the gradient, while at the other end it reflected the upcoming response timing, with attentional effects occurring at the intersection of visual and response signals. These findings challenge multi-step models of attention, and suggest that frontoparietal networks, which process sequential stimuli as separate events sharing the same location, drive exogenous attention phenomena such as inhibition of return.

Resting-State EEG Signature of Early Consciousness Recovery in Comatose Traumatic Brain Injury Patients.

Background Resting-state electroencephalogram (rsEEG) is usually obtained to assess seizures in comatose patients with traumatic brain injury (TBI) patients. We aim to investigate rsEEG measures and their prediction of early recovery of consciousness in comatose TBI patients. Methods This is a retrospective study of comatose TBI patients who were admitted to a level-1 trauma center (10/2013-1/2022). Demographics, basic clinical data, imaging characteristics, and EEG data were collected. We calculated using 10-minute rsEEGs: power spectral density (PSD), permutation entropy (PE - complexity measure), weighted symbolic-mutual-information (wSMI - global information sharing measure), Kolmogorov complexity (Kolcom - complexity measure), and heart-evoked potentials (HEP - the averaged EEG signal relative to the corresponding QRS complex on electrocardiogram). We evaluated the prediction of consciousness recovery before hospital discharge using clinical, imaging, rsEEG data via Support Vector Machine with a linear kernel (SVM). Results We studied 113 (out of 134, 84%) patients with rsEEGs. A total of 73 (65%) patients recovered consciousness before discharge. Patients who recovered consciousness were younger (40 vs. 50, p .01). Patients who recovered consciousness had higher Kolcom (U = 1688, p = 0.01,), increased beta power (U = 1652 p = 0.003), with higher variability across channels ( U = 1534, p = 0.034), and epochs (U = 1711, p = 0.004), lower delta power (U = 981, p = 0.04) and showed higher connectivity across time and channels as measured by wSMI in the theta band (U = 1636, p = .026, U = 1639, p = 0.024) than those who didn't recover. The ROC-AUC improved from 0.66 (using age, motor response, pupils' reactivity, and CT Marshall classification) to 0.69 (p < 0.001) when adding rsEEG measures. Conclusion We describe the rsEEG EEG signature in recovery of consciousness prior to discharge in comatose TBI patients. Resting-state EEG measures improved prediction beyond the clinical and imaging data.

Specific and Nonuniform Brain States during Cold Perception in Mice.

The quest to decode the complex supraspinal mechanisms that integrate cutaneous thermal information in the central system is still ongoing. The dorsal horn of the spinal cord is the first hub that encodes thermal input which is then transmitted to brain regions via the spinothalamic and thalamocortical pathways. So far, our knowledge about the strength of the interplay between the brain regions during thermal processing is limited. To address this question, we imaged the brains of adult awake male mice in resting state using functional ultrasound imaging during plantar exposure to constant and varying temperatures. Our study reveals for the first time the following: (1) a dichotomy in the response of the somatomotor-cingulate cortices and the hypothalamus, which was never described before, due to the lack of appropriate tools to study such regions with both good spatial and temporal resolutions. (2) We infer that cingulate areas may be involved in the affective responses to temperature changes. (3) Colder temperatures (ramped down) reinforce the disconnection between the somatomotor-cingulate and hypothalamus networks. (4) Finally, we also confirm the existence in the mouse brain of a brain mode characterized by low cognitive strength present more frequently at resting neutral temperature. The present study points toward the existence of a common hub between somatomotor and cingulate regions, whereas hypothalamus functions are related to a secondary network.

Multimodal Prediction of 3- and 12-Month Outcomes in ICU Patients with Acute Disorders of Consciousness.

BACKGROUND: In intensive care unit (ICU) patients with coma and other disorders of consciousness (DoC), outcome prediction is key to decision-making regarding prognostication, neurorehabilitation, and management of family expectations. Current prediction algorithms are largely based on chronic DoC, whereas multimodal data from acute DoC are scarce. Therefore, the Consciousness in Neurocritical Care Cohort Study Using Electroencephalography and Functional Magnetic Resonance Imaging (i.e. CONNECT-ME; ClinicalTrials.gov identifier: NCT02644265) investigates ICU patients with acute DoC due to traumatic and nontraumatic brain injuries, using electroencephalography (EEG) (resting-state and passive paradigms), functional magnetic resonance imaging (fMRI) (resting-state) and systematic clinical examinations. METHODS: We previously presented results for a subset of patients (n = 87) concerning prediction of consciousness levels in the ICU. Now we report 3- and 12-month outcomes in an extended cohort (n = 123). Favorable outcome was defined as a modified Rankin Scale score ≤ 3, a cerebral performance category score ≤ 2, and a Glasgow Outcome Scale Extended score ≥ 4. EEG features included visual grading, automated spectral categorization, and support vector machine consciousness classifier. fMRI features included functional connectivity measures from six resting-state networks. Random forest and support vector machine were applied to EEG and fMRI features to predict outcomes. Here, random forest results are presented as areas under the curve (AUC) of receiver operating characteristic curves or accuracy. Cox proportional regression with in-hospital death as a competing risk was used to assess independent clinical predictors of time to favorable outcome. RESULTS: Between April 2016 and July 2021, we enrolled 123 patients (mean age 51 years, 42% women). Of 82 (66%) ICU survivors, 3- and 12-month outcomes were available for 79 (96%) and 77 (94%), respectively. EEG features predicted both 3-month (AUC 0.79 [95% confidence interval (CI) 0.77-0.82]) and 12-month (AUC 0.74 [95% CI 0.71-0.77]) outcomes. fMRI features appeared to predict 3-month outcome (accuracy 0.69-0.78) both alone and when combined with some EEG features (accuracies 0.73-0.84) but not 12-month outcome (larger sample sizes needed). Independent clinical predictors of time to favorable outcome were younger age (hazard ratio [HR] 1.04 [95% CI 1.02-1.06]), traumatic brain injury (HR 1.94 [95% CI 1.04-3.61]), command-following abilities at admission (HR 2.70 [95% CI 1.40-5.23]), initial brain imaging without severe pathological findings (HR 2.42 [95% CI 1.12-5.22]), improving consciousness in the ICU (HR 5.76 [95% CI 2.41-15.51]), and favorable visual-graded EEG (HR 2.47 [95% CI 1.46-4.19]). CONCLUSIONS: Our results indicate that EEG and fMRI features and readily available clinical data predict short-term outcome of patients with acute DoC and that EEG also predicts 12-month outcome after ICU discharge.

Processing of the same narrative stimuli elicits common functional connectivity dynamics between individuals.

It has been suggested that conscious experience is linked to the richness of brain state repertories, which change in response to environmental and internal stimuli. High-level sensory stimulation has been shown to alter local brain activity and induce neural synchrony across participants. However, the dynamic interplay of cognitive processes underlying moment-to-moment information processing remains poorly understood. Using naturalistic movies as an ecological laboratory model of the real world, here we investigate how the processing of complex naturalistic stimuli alters the dynamics of brain network interactions and how these in turn support information processing. Participants underwent fMRI recordings during movie watching, scrambled movie watching, and resting. By measuring the phase-synchrony between different brain networks, we analyzed whole-brain connectivity patterns. Our finding revealed distinct connectivity patterns associated with each experimental condition. We found higher synchronization of brain patterns across participants during movie watching compared to rest and scrambled movie conditions. Furthermore, synchronization levels increased during the most engaging parts of the movie. The synchronization dynamics among participants were associated with suspense; scenes with higher levels of suspense induced greater synchronization. These results suggest that processing the same high-level information elicits common neural dynamics across individuals, and that whole-brain functional connectivity tracks variations in processed information and subjective experience.

Pupil dilation response elicited by violations of auditory regularities is a promising but challenging approach to probe consciousness at the bedside.

Pupil dilation response (PDR) has been proposed as a physiological marker of conscious access to a stimulus or its attributes, such as novelty. In a previous study on healthy volunteers, we adapted the auditory "local global" paradigm and showed that violations of global regularity elicited a PDR. Notably without instructions, this global effect was present only in participants who could consciously report violations of global regularities. In the present study, we used a similar approach in 24 non-communicating patients affected with a Disorder of Consciousness (DoC) and compared PDR to ERPs regarding diagnostic and prognostic performance. At the group level, global effect could not be detected in DoC patients. At the individual level, the only patient with a PDR global effect was in a MCS and recovered consciousness at 6 months. Contrasting the most regular trials to the most irregular ones improved PDR's diagnostic and prognostic power in DoC patients. Pupillometry is a promising tool but requires several methodological improvements to enhance the signal-to-noise ratio and make it more robust for probing consciousness and cognition in DoC patients.

The arrow of time of brain signals in cognition: Potential intriguing role of parts of the default mode network.

A promising idea in human cognitive neuroscience is that the default mode network (DMN) is responsible for coordinating the recruitment and scheduling of networks for computing and solving task-specific cognitive problems. This is supported by evidence showing that the physical and functional distance of DMN regions is maximally removed from sensorimotor regions containing environment-driven neural activity directly linked to perception and action, which would allow the DMN to orchestrate complex cognition from the top of the hierarchy. However, discovering the functional hierarchy of brain dynamics requires finding the best way to measure interactions between brain regions. In contrast to previous methods measuring the hierarchical flow of information using, for example, transfer entropy, here we used a thermodynamics-inspired, deep learning based Temporal Evolution NETwork (TENET) framework to assess the asymmetry in the flow of events, 'arrow of time', in human brain signals. This provides an alternative way of quantifying hierarchy, given that the arrow of time measures the directionality of information flow that leads to a breaking of the balance of the underlying hierarchy. In turn, the arrow of time is a measure of nonreversibility and thus nonequilibrium in brain dynamics. When applied to large-scale Human Connectome Project (HCP) neuroimaging data from close to a thousand participants, the TENET framework suggests that the DMN plays a significant role in orchestrating the hierarchy, that is, levels of nonreversibility, which changes between the resting state and when performing seven different cognitive tasks. Furthermore, this quantification of the hierarchy of the resting state is significantly different in health compared to neuropsychiatric disorders. Overall, the present thermodynamics-based machine-learning framework provides vital new insights into the fundamental tenets of brain dynamics for orchestrating the interactions between cognition and brain in complex environments.

Conscious processing of global and local auditory irregularities causes differentiated heartbeat-evoked responses.

Recent research suggests that brain-heart interactions are associated with perceptual and self-consciousness. In this line, the neural responses to visceral inputs have been hypothesized to play a leading role in shaping our subjective experience. This study aims to investigate whether the contextual processing of auditory irregularities modulates both direct neuronal responses to the auditory stimuli (ERPs) and the neural responses to heartbeats, as measured with heartbeat-evoked responses (HERs). HERs were computed in patients with disorders of consciousness, diagnosed with a minimally conscious state or unresponsive wakefulness syndrome. We tested whether HERs reflect conscious auditory perception, which can potentially provide additional information for the consciousness diagnosis. EEG recordings were taken during the local-global paradigm, which evaluates the capacity of a patient to detect the appearance of auditory irregularities at local (short-term) and global (long-term) levels. The results show that local and global effects produce distinct ERPs and HERs, which can help distinguish between the minimally conscious state and unresponsive wakefulness syndrome patients. Furthermore, we found that ERP and HER responses were not correlated suggesting that independent neuronal mechanisms are behind them. These findings suggest that HER modulations in response to auditory irregularities, especially local irregularities, may be used as a novel neural marker of consciousness and may aid in the bedside diagnosis of disorders of consciousness with a more cost-effective option than neuroimaging methods.

Behavioral and brain responses to verbal stimuli reveal transient periods of cognitive integration of the external world during sleep.

Sleep has long been considered as a state of behavioral disconnection from the environment, without reactivity to external stimuli. Here we questioned this 'sleep disconnection' dogma by directly investigating behavioral responsiveness in 49 napping participants (27 with narcolepsy and 22 healthy volunteers) engaged in a lexical decision task. Participants were instructed to frown or smile depending on the stimulus type. We found accurate behavioral responses, visible via contractions of the corrugator or zygomatic muscles, in most sleep stages in both groups (except slow-wave sleep in healthy volunteers). Across sleep stages, responses occurred more frequently when stimuli were presented during high cognitive states than during low cognitive states, as indexed by prestimulus electroencephalography. Our findings suggest that transient windows of reactivity to external stimuli exist during bona fide sleep, even in healthy individuals. Such windows of reactivity could pave the way for real-time communication with sleepers to probe sleep-related mental and cognitive processes.

Common Data Elements for Disorders of Consciousness: Recommendations from the Electrophysiology Working Group.

BACKGROUND: Electroencephalography (EEG) has long been recognized as an important tool in the investigation of disorders of consciousness (DoC). From inspection of the raw EEG to the implementation of quantitative EEG, and more recently in the use of perturbed EEG, it is paramount to providing accurate diagnostic and prognostic information in the care of patients with DoC. However, a nomenclature for variables that establishes a convention for naming, defining, and structuring data for clinical research variables currently is lacking. As such, the Neurocritical Care Society's Curing Coma Campaign convened nine working groups composed of experts in the field to construct common data elements (CDEs) to provide recommendations for DoC, with the main goal of facilitating data collection and standardization of reporting. This article summarizes the recommendations of the electrophysiology DoC working group. METHODS: After assessing previously published pertinent CDEs, we developed new CDEs and categorized them into "disease core," "basic," "supplemental," and "exploratory." Key EEG design elements, defined as concepts that pertained to a methodological parameter relevant to the acquisition, processing, or analysis of data, were also included but were not classified as CDEs. RESULTS: After identifying existing pertinent CDEs and developing novel CDEs for electrophysiology in DoC, variables were organized into a framework based on the two primary categories of resting state EEG and perturbed EEG. Using this categorical framework, two case report forms were generated by the working group. CONCLUSIONS: Adherence to the recommendations outlined by the electrophysiology working group in the resting state EEG and perturbed EEG case report forms will facilitate data collection and sharing in DoC research on an international level. In turn, this will allow for more informed and reliable comparison of results across studies, facilitating further advancement in the realm of DoC research.

Numerical discrimination in Drosophila melanogaster.

Sensitivity to numbers is a crucial cognitive ability. The lack of experimental models amenable to systematic genetic and neural manipulation has precluded discovering neural circuits required for numerical cognition. Here, we demonstrate that Drosophila flies spontaneously prefer sets containing larger numbers of objects. This preference is determined by the ratio between the two numerical quantities tested, a characteristic signature of numerical cognition across species. Individual flies maintained their numerical choice over consecutive days. Using a numerical visual conditioning paradigm, we found that flies are capable of associating sucrose with numerical quantities and can be trained to reverse their spontaneous preference for large quantities. Finally, we show that silencing lobula columnar neurons (LC11) reduces the preference for more objects, thus identifying a neuronal substrate for numerical cognition in invertebrates. This discovery paves the way for the systematic analysis of the behavioral and neural mechanisms underlying the evolutionary conserved sensitivity to numerosity.

Fronto-parietal networks shape human conscious report through attention gain and reorienting.

How do attention and consciousness interact in the human brain? Rival theories of consciousness disagree on the role of fronto-parietal attentional networks in conscious perception. We recorded neural activity from 727 intracerebral contacts in 13 epileptic patients, while they detected near-threshold targets preceded by attentional cues. Clustering revealed three neural patterns: first, attention-enhanced conscious report accompanied sustained right-hemisphere fronto-temporal activity in networks connected by the superior longitudinal fasciculus (SLF) II-III, and late accumulation of activity (>300 ms post-target) in bilateral dorso-prefrontal and right-hemisphere orbitofrontal cortex (SLF I-III). Second, attentional reorienting affected conscious report through early, sustained activity in a right-hemisphere network (SLF III). Third, conscious report accompanied left-hemisphere dorsolateral-prefrontal activity. Task modeling with recurrent neural networks revealed multiple clusters matching the identified brain clusters, elucidating the causal relationship between clusters in conscious perception of near-threshold targets. Thus, distinct, hemisphere-asymmetric fronto-parietal networks support attentional gain and reorienting in shaping human conscious experience.

Low-dimensional organization of global brain states of reduced consciousness.

Brain states are frequently represented using a unidimensional scale measuring the richness of subjective experience (level of consciousness). This description assumes a mapping between the high-dimensional space of whole-brain configurations and the trajectories of brain states associated with changes in consciousness, yet this mapping and its properties remain unclear. We combine whole-brain modeling, data augmentation, and deep learning for dimensionality reduction to determine a mapping representing states of consciousness in a low-dimensional space, where distances parallel similarities between states. An orderly trajectory from wakefulness to patients with brain injury is revealed in a latent space whose coordinates represent metrics related to functional modularity and structure-function coupling, increasing alongside loss of consciousness. Finally, we investigate the effects of model perturbations, providing geometrical interpretation for the stability and reversibility of states. We conclude that conscious awareness depends on functional patterns encoded as a low-dimensional trajectory within the vast space of brain configurations.

Computational modelling in disorders of consciousness: Closing the gap towards personalised models for restoring consciousness.

Disorders of consciousness are complex conditions characterised by persistent loss of responsiveness due to brain injury. They present diagnostic challenges and limited options for treatment, and highlight the urgent need for a more thorough understanding of how human consciousness arises from coordinated neural activity. The increasing availability of multimodal neuroimaging data has given rise to a wide range of clinically- and scientifically-motivated modelling efforts, seeking to improve data-driven stratification of patients, to identify causal mechanisms for patient pathophysiology and loss of consciousness more broadly, and to develop simulations as a means of testing in silico potential treatment avenues to restore consciousness. As a dedicated Working Group of clinicians and neuroscientists of the international Curing Coma Campaign, here we provide our framework and vision to understand the diverse statistical and generative computational modelling approaches that are being employed in this fast-growing field. We identify the gaps that exist between the current state-of-the-art in statistical and biophysical computational modelling in human neuroscience, and the aspirational goal of a mature field of modelling disorders of consciousness; which might drive improved treatments and outcomes in the clinic. Finally, we make several recommendations for how the field as a whole can work together to address these challenges.

The lack of temporal brain dynamics asymmetry as a signature of impaired consciousness states.

Life is a constant battle against equilibrium. From the cellular level to the macroscopic scale, living organisms as dissipative systems require the violation of their detailed balance, i.e. metabolic enzymatic reactions, in order to survive. We present a framework based on temporal asymmetry as a measure of non-equilibrium. By means of statistical physics, it was discovered that temporal asymmetries establish an arrow of time useful for assessing the reversibility in human brain time series. Previous studies in human and non-human primates have shown that decreased consciousness states such as sleep and anaesthesia result in brain dynamics closer to the equilibrium. Furthermore, there is growing interest in the analysis of brain symmetry based on neuroimaging recordings and since it is a non-invasive technique, it can be extended to different brain imaging modalities and applied at different temporo-spatial scales. In the present study, we provide a detailed description of our methodological approach, paying special attention to the theories that motivated this work. We test, for the first time, the reversibility analysis in human functional magnetic resonance imaging data in patients suffering from disorder of consciousness. We verify that the tendency of a decrease in the asymmetry of the brain signal together with the decrease in non-stationarity are key characteristics of impaired consciousness states. We expect that this work will open the way for assessing biomarkers for patients' improvement and classification, as well as motivating further research on the mechanistic understanding underlying states of impaired consciousness.

EEG lexicality effect predicts clinical outcome in disorders of consciousness.

This study aimed at probing covert language processing in patients with disorders of consciousness. An auditory paradigm contrasting words to pronounceable pseudowords was designed, while recording bedside electroencephalogram and computing the two main correlates of lexicality: N400 and late positive component (LPC). Healthy volunteers and 19 patients, 10 in a minimally conscious state and 9 in a vegetative state (also coined unresponsive wakefulness syndrome), were recorded. N400 was present in all groups, whereas LPC was only present in the healthy volunteers and minimally conscious state groups. At the individual level, an unprecedented detection rate of N400 and LPC was reached, and LPC predicted overt cognitive improvement at 6 months. ANN NEUROL 2023;93:762-767.

Multimodal prediction of residual consciousness in the intensive care unit: the CONNECT-ME study.

Functional MRI (fMRI) and EEG may reveal residual consciousness in patients with disorders of consciousness (DoC), as reflected by a rapidly expanding literature on chronic DoC. However, acute DoC is rarely investigated, although identifying residual consciousness is key to clinical decision-making in the intensive care unit (ICU). Therefore, the objective of the prospective, observational, tertiary centre cohort, diagnostic phase IIb study 'Consciousness in neurocritical care cohort study using EEG and fMRI' (CONNECT-ME, NCT02644265) was to assess the accuracy of fMRI and EEG to identify residual consciousness in acute DoC in the ICU. Between April 2016 and November 2020, 87 acute DoC patients with traumatic or non-traumatic brain injury were examined with repeated clinical assessments, fMRI and EEG. Resting-state EEG and EEG with external stimulations were evaluated by visual analysis, spectral band analysis and a Support Vector Machine (SVM) consciousness classifier. In addition, within- and between-network resting-state connectivity for canonical resting-state fMRI networks was assessed. Next, we used EEG and fMRI data at study enrolment in two different machine-learning algorithms (Random Forest and SVM with a linear kernel) to distinguish patients in a minimally conscious state or better (≥MCS) from those in coma or unresponsive wakefulness state (≤UWS) at time of study enrolment and at ICU discharge (or before death). Prediction performances were assessed with area under the curve (AUC). Of 87 DoC patients (mean age, 50.0 ± 18 years, 43% female), 51 (59%) were ≤UWS and 36 (41%) were ≥ MCS at study enrolment. Thirty-one (36%) patients died in the ICU, including 28 who had life-sustaining therapy withdrawn. EEG and fMRI predicted consciousness levels at study enrolment and ICU discharge, with maximum AUCs of 0.79 (95% CI 0.77-0.80) and 0.71 (95% CI 0.77-0.80), respectively. Models based on combined EEG and fMRI features predicted consciousness levels at study enrolment and ICU discharge with maximum AUCs of 0.78 (95% CI 0.71-0.86) and 0.83 (95% CI 0.75-0.89), respectively, with improved positive predictive value and sensitivity. Overall, both machine-learning algorithms (SVM and Random Forest) performed equally well. In conclusion, we suggest that acute DoC prediction models in the ICU be based on a combination of fMRI and EEG features, regardless of the machine-learning algorithm used.

Description and Outcome of Severe Hypoglycemic Encephalopathy in the Intensive Care Unit.

BACKGROUND: Disorders of consciousness due to severe hypoglycemia are rare but challenging to treat. The aim of this retrospective cohort study was to describe our multimodal neurological assessment of patients with hypoglycemic encephalopathy hospitalized in the intensive care unit and their neurological outcomes. METHODS: Consecutive patients with disorders of consciousness related to hypoglycemia admitted for neuroprognostication from 2010 to 2020 were included. Multimodal neurological assessment included electroencephalography, somatosensory and cognitive event-related potentials, and morphological and quantitative magnetic resonance imaging (MRI) with quantification of fractional anisotropy. Neurological outcomes at 28 days, 3 months, 6 months, 1 year, and 2 years after hypoglycemia were retrieved. RESULTS: Twenty patients were included. After 2 years, 75% of patients had died, 5% remained in a permanent vegetative state, 10% were in a minimally conscious state, and 10% were conscious but with severe disabilities (Glasgow Outcome Scale-Extended scores 3 and 4). All patients showed pathologic electroencephalography findings with heterogenous patterns. Morphological brain MRI revealed abnormalities in 95% of patients, with various localizations including cortical atrophy in 65% of patients. When performed, quantitative MRI showed decreased fractional anisotropy affecting widespread white matter tracts in all patients. CONCLUSIONS: The overall prognosis of patients with severe hypoglycemic encephalopathy was poor, with only a small fraction of patients who slowly improved after intensive care unit discharge. Of note, patients who did not improve during the first 6 months did not recover consciousness. This study suggests that a multimodal approach capitalizing on advanced brain imaging and bedside electrophysiology techniques could improve diagnostic and prognostic performance in severe hypoglycemic encephalopathy.

Sensory Target Detection at Local and Global Timescales Reveals a Hierarchy of Supramodal Dynamics in the Human Cortex.

To ensure survival in a dynamic environment, the human neocortex monitors input streams from different sensory organs for important sensory events. Which principles govern whether different senses share common or modality-specific brain networks for sensory target detection? We examined whether complex targets evoke sustained supramodal activity while simple targets rely on modality-specific networks with short-lived supramodal contributions. In a series of hierarchical multisensory target detection studies (n = 77, of either sex) using EEG, we applied a temporal cross-decoding approach to dissociate supramodal and modality-specific cortical dynamics elicited by rule-based global and feature-based local sensory deviations within and between the visual, somatosensory, and auditory modality. Our data show that each sense implements a cortical hierarchy orchestrating supramodal target detection responses, which operate at local and global timescales in successive processing stages. Across different sensory modalities, simple feature-based sensory deviations presented in temporal vicinity to a monotonous input stream triggered a mismatch negativity-like local signal which decayed quickly and early, whereas complex rule-based targets tracked across time evoked a P3b-like global neural response which generalized across a late time window. Converging results from temporal cross-modality decoding analyses across different datasets, we reveal that global neural responses are sustained in a supramodal higher-order network, whereas local neural responses canonically thought to rely on modality-specific regions evolve into short-lived supramodal activity. Together, our findings demonstrate that cortical organization largely follows a gradient in which short-lived modality-specific as well as supramodal processes dominate local responses, whereas higher-order processes encode temporally extended abstract supramodal information fed forward from modality-specific cortices.SIGNIFICANCE STATEMENT Each sense supports a cortical hierarchy of processes tracking deviant sensory events at multiple timescales. Conflicting evidence produced a lively debate around which of these processes are supramodal. Here, we manipulated the temporal complexity of auditory, tactile, and visual targets to determine whether cortical local and global ERP responses to sensory targets share cortical dynamics between the senses. Using temporal cross-decoding, we found that temporally complex targets elicit a supramodal sustained response. Conversely, local responses to temporally confined targets typically considered modality-specific rely on early short-lived supramodal activation. Our finding provides evidence for a supramodal gradient supporting sensory target detection in the cortex, with implications for multiple fields in which these responses are studied (e.g., predictive coding, consciousness, and attention).

What lies underneath: Precise classification of brain states using time-dependent topological structure of dynamics.

The self-organising global dynamics underlying brain states emerge from complex recursive nonlinear interactions between interconnected brain regions. Until now, most efforts of capturing the causal mechanistic generating principles have supposed underlying stationarity, being unable to describe the non-stationarity of brain dynamics, i.e. time-dependent changes. Here, we present a novel framework able to characterise brain states with high specificity, precisely by modelling the time-dependent dynamics. Through describing a topological structure associated to the brain state at each moment in time (its attractor or 'information structure'), we are able to classify different brain states by using the statistics across time of these structures hitherto hidden in the neuroimaging dynamics. Proving the strong potential of this framework, we were able to classify resting-state BOLD fMRI signals from two classes of post-comatose patients (minimally conscious state and unresponsive wakefulness syndrome) compared with healthy controls with very high precision.