Spatiotemporal Dynamics of Successive Activations across the Human Brain during Simple Arithmetic Processing.

Previous neuroimaging studies have offered unique insights about the spatial organization of activations and deactivations across the brain; however, these were not powered to explore the exact timing of events at the subsecond scale combined with a precise anatomical source of information at the level of individual brains. As a result, we know little about the order of engagement across different brain regions during a given cognitive task. Using experimental arithmetic tasks as a prototype for human-unique symbolic processing, we recorded directly across 10,076 brain sites in 85 human subjects (52% female) using the intracranial electroencephalography. Our data revealed a remarkably distributed change of activity in almost half of the sampled sites. In each activated brain region, we found juxtaposed neuronal populations preferentially responsive to either the target or control conditions, arranged in an anatomically orderly manner. Notably, an orderly successive activation of a set of brain regions-anatomically consistent across subjects-was observed in individual brains. The temporal order of activations across these sites was replicable across subjects and trials. Moreover, the degree of functional connectivity between the sites decreased as a function of temporal distance between regions, suggesting that the information is partially leaked or transformed along the processing chain. Our study complements prior imaging studies by providing hitherto unknown information about the timing of events in the brain during arithmetic processing. Such findings can be a basis for developing mechanistic computational models of human-specific cognitive symbolic systems.

Spatiotemporal dynamics of successive activations across the human brain during simple arithmetic processing.

Previous neuroimaging studies have offered unique insights about the spatial organization of activations and deactivations across the brain, however these were not powered to explore the exact timing of events at the subsecond scale combined with precise anatomical source information at the level of individual brains. As a result, we know little about the order of engagement across different brain regions during a given cognitive task. Using experimental arithmetic tasks as a prototype for human-unique symbolic processing, we recorded directly across 10,076 brain sites in 85 human subjects (52% female) using intracranial electroencephalography (iEEG). Our data revealed a remarkably distributed change of activity in almost half of the sampled sites. Notably, an orderly successive activation of a set of brain regions - anatomically consistent across subjects-was observed in individual brains. Furthermore, the temporal order of activations across these sites was replicable across subjects and trials. Moreover, the degree of functional connectivity between the sites decreased as a function of temporal distance between regions, suggesting that information is partially leaked or transformed along the processing chain. Furthermore, in each activated region, distinct neuronal populations with opposite activity patterns during target and control conditions were juxtaposed in an anatomically orderly manner. Our study complements the prior imaging studies by providing hitherto unknown information about the timing of events in the brain during arithmetic processing. Such findings can be a basis for developing mechanistic computational models of human-specific cognitive symbolic systems. Significance statement: Our study elucidates the spatiotemporal dynamics and anatomical specificity of brain activations across >10,000 sites during arithmetic tasks, as captured by intracranial EEG. We discovered an orderly, successive activation of brain regions, consistent across individuals, and a decrease in functional connectivity as a function of temporal distance between regions. Our findings provide unprecedented insights into the sequence of cognitive processing and regional interactions, offering a novel perspective for enhancing computational models of cognitive symbolic systems.

Electrocorticographic evidence of a common neurocognitive sequence for mentalizing about the self and others.

Neuroimaging studies of mentalizing (i.e., theory of mind) consistently implicate the default mode network (DMN). Nevertheless, the social cognitive functions of individual DMN regions remain unclear, perhaps due to limited spatiotemporal resolution in neuroimaging. Here we use electrocorticography (ECoG) to directly record neuronal population activity while 16 human participants judge the psychological traits of themselves and others. Self- and other-mentalizing recruit near-identical cortical sites in a common spatiotemporal sequence. Activations begin in the visual cortex, followed by temporoparietal DMN regions, then finally in medial prefrontal regions. Moreover, regions with later activations exhibit stronger functional specificity for mentalizing, stronger associations with behavioral responses, and stronger self/other differentiation. Specifically, other-mentalizing evokes slower and longer activations than self-mentalizing across successive DMN regions, implying lengthier processing at higher levels of representation. Our results suggest a common neurocognitive pathway for self- and other-mentalizing that follows a complex spatiotemporal gradient of functional specialization across DMN and beyond.

A Platform for Spatiotemporal "Matrix" Stimulation in Brain Networks Reveals Novel Forms of Circuit Plasticity.

Here we demonstrate a facile method by which to deliver complex spatiotemporal stimulation to neural networks in fast patterns, to trigger interesting forms of circuit-level plasticity in cortical areas. We present a complete platform by which patterns of electricity can be arbitrarily defined and distributed across a brain circuit, either simultaneously, asynchronously, or in complex patterns that can be easily designed and orchestrated with precise timing. Interfacing with acute slices of mouse cortex, we show that our system can be used to activate neurons at many locations and drive synaptic transmission in distributed patterns, and that this elicits new forms of plasticity that may not be observable via traditional methods, including interesting measurements of associational and sequence plasticity. Finally, we introduce an automated "network assay" for imaging activation and plasticity across a circuit. Spatiotemporal stimulation opens the door for high-throughput explorations of plasticity at the circuit level, and may provide a basis for new types of adaptive neural prosthetics.

Fast temporal dynamics and causal relevance of face processing in the human temporal cortex.

We measured the fast temporal dynamics of face processing simultaneously across the human temporal cortex (TC) using intracranial recordings in eight participants. We found sites with selective responses to faces clustered in the ventral TC, which responded increasingly strongly to marine animal, bird, mammal, and human faces. Both face-selective and face-active but non-selective sites showed a posterior to anterior gradient in response time and selectivity. A sparse model focusing on information from the human face-selective sites performed as well as, or better than, anatomically distributed models when discriminating faces from non-faces stimuli. Additionally, we identified the posterior fusiform site (pFUS) as causally the most relevant node for inducing distortion of conscious face processing by direct electrical stimulation. These findings support anatomically discrete but temporally distributed response profiles in the human brain and provide a new common ground for unifying the seemingly contradictory modular and distributed modes of face processing.

Electrophysiological dynamics of antagonistic brain networks reflect attentional fluctuations.

Neuroimaging evidence suggests that the default mode network (DMN) exhibits antagonistic activity with dorsal attention (DAN) and salience (SN) networks. Here we use human intracranial electroencephalography to investigate the behavioral relevance of fine-grained dynamics within and between these networks. The three networks show dissociable profiles of task-evoked electrophysiological activity, best captured in the high-frequency broadband (HFB; 70-170 Hz) range. On the order of hundreds of milliseconds, HFB responses peak fastest in the DAN, at intermediate speed in the SN, and slowest in the DMN. Lapses of attention (behavioral errors) are marked by distinguishable patterns of both pre- and post-stimulus HFB activity within each network. Moreover, the magnitude of temporally lagged, negative HFB coupling between the DAN and DMN (but not SN and DMN) is associated with greater sustained attention performance and is reduced during wakeful rest. These findings underscore the behavioral relevance of temporally delayed coordination between antagonistic brain networks.

Direct Cortical Recordings Suggest Temporal Order of Task-Evoked Responses in Human Dorsal Attention and Default Networks.

The past decade has seen a large number of neuroimaging studies focused on the anticorrelated functional relationship between the default mode network (DMN) and the dorsal attention network (DAN). Due principally to the low temporal resolution of functional neuroimaging modalities, the fast-neuronal dynamics across these networks remain poorly understood. Here we report novel human intracranial electrophysiology data from six neurosurgical patients (four males) with simultaneous coverage of well characterized nodes of the DMN and DAN. Subjects performed an arithmetic processing task, shown previously to evoke reliable deactivations (below baseline) in the DMN, and activations in the DAN. In this cohort, we show that DMN deactivations lag DAN activations by approximately 200 ms. Our findings suggest a clear temporal order of processing across the two networks during the current task and place the DMN further than the DAN in a plausible information-processing hierarchy.SIGNIFICANCE STATEMENT The human brain contains an intrinsic and strictly organized network architecture. Our understanding of the interplay across association networks has relied primarily on the slow fluctuations of the hemodynamic response, and as such it has lacked essential evidence regarding the temporal dynamics of activity across these networks. The current study presents evidence from high spatiotemporal methods showing that well studied areas of the default mode network display delayed task-induced activity relative to divergent responses in dorsal attention network nodes. This finding provides direct and critical evidence regarding the temporal chronology of neuronal events across opposing brain networks.

Brain Mechanisms of Arithmetic: A Crucial Role for Ventral Temporal Cortex.

Elementary arithmetic requires a complex interplay between several brain regions. The classical view, arising from fMRI, is that the intraparietal sulcus (IPS) and the superior parietal lobe (SPL) are the main hubs for arithmetic calculations. However, recent studies using intracranial electroencephalography have discovered a specific site, within the posterior inferior temporal cortex (pITG), that activates during visual perception of numerals, with widespread adjacent responses when numerals are used in calculation. Here, we reexamined the contribution of the IPS, SPL, and pITG to arithmetic by recording intracranial electroencephalography signals while participants solved addition problems. Behavioral results showed a classical problem size effect: RTs increased with the size of the operands. We then examined how high-frequency broadband (HFB) activity is modulated by problem size. As expected from previous fMRI findings, we showed that the total HFB activity in IPS and SPL sites increased with problem size. More surprisingly, pITG sites showed an initial burst of HFB activity that decreased as the operands got larger, yet with a constant integral over the whole trial, thus making these signals invisible to slow fMRI. Although parietal sites appear to have a more sustained function in arithmetic computations, the pITG may have a role of early identification of the problem difficulty, beyond merely digit recognition. Our results ask for a reevaluation of the current models of numerical cognition and reveal that the ventral temporal cortex contains regions specifically engaged in mathematical processing.

Neuronal Population Responses in the Human Ventral Temporal and Lateral Parietal Cortex during Arithmetic Processing with Digits and Number Words.

Past research has identified anatomically specific sites within the posterior inferior temporal gyrus (PITG) and the intraparietal sulcus (IPS) areas that are engaged during arithmetic processing. Although a small region of the PITG (known as the number form area) is selectively engaged in the processing of numerals, its surrounding area is activated during both digit and number word processing. In eight participants with intracranial electrodes, we compared the timing and selectivity of electrophysiological responses in the number form area-surround and IPS regions during arithmetic processing with digits and number words. Our recordings revealed stronger electrophysiological responses in the high-frequency broadband range in both regions to digits than number words, with the difference that number words elicited delayed activity in the IPS but not PITG. Our findings of distinct profiles of responses in the PITG and the IPS to digits compared with number words provide novel information that is relevant to existing theoretical models of mathematical cognition.

Spatial and temporal heterogeneity of neural responses in human posteromedial cortex.

Neuroimaging evidence supports a role of the default mode network (DMN) in spontaneous thought and goal-driven internally oriented processes, such as recalling an autobiographical event, and has demonstrated its deactivation during focused, externally oriented attention. Recent work suggests that the DMN is not a homogeneous network but rather is composed of at least several subnetworks, which are engaged in distinct functions; however, it is still unclear if these different functions rely on the same neuronal populations. In this study, we used intracranial EEG to record from the posteromedial cortex (PMC), a core hub of the DMN, in 13 human subjects, during autobiographical memory retrieval (internally oriented), arithmetic processing (externally oriented), and cued rest (spontaneous thought), allowing us to measure activity from anatomically precise PMC sites with high temporal resolution. We observed a heterogeneous, yet spatially organized, pattern of activity across tasks. Many sites, primarily in the more ventral portion of PMC, were engaged during autobiographical recall and suppressed during arithmetic processing. Other more dorsal PMC sites were engaged during the cued-rest condition. Of these rest-active sites, some exhibited variable temporal dynamics across trials, possibly reflecting various forms of spontaneous thought, while others showed only transient activity at the beginning of cued-rest trials (i.e., after a switch from a task to cued rest), possibly involved in shifting the brain from a more focused to a more exploratory attentional state. These results suggest heterogeneity of function even within an individual node of the DMN.

Intracranial Electrophysiology of the Human Default Network.

The human default network (DN) plays a critical role in internally directed cognition, behavior, and neuropsychiatric disease. Despite much progress with functional neuroimaging, persistent questions still linger concerning the electrophysiological underpinnings, fast temporal dynamics, and causal importance of the DN. Here, we review how direct intracranial recording and stimulation of the DN provides a unique combination of high spatiotemporal resolution and causal information that speaks directly to many of these outstanding questions. Our synthesis highlights the electrophysiological basis of activation, suppression, and connectivity of the DN, each key areas of debate in the literature. Integrating these unique electrophysiological data with extant neuroimaging findings will help lay the foundation for a mechanistic account of DN function in human behavior and cognition.

Distinct phase-amplitude couplings distinguish cognitive processes in human attention.

Spatial attention is the cognitive function that coordinates the selection of visual stimuli with appropriate behavioral responses. Recent studies have reported that phase-amplitude coupling (PAC) of low and high frequencies covaries with spatial attention, but differ on the direction of covariation and the frequency ranges involved. We hypothesized that distinct phase-amplitude frequency pairs have differentiable contributions during tasks that manipulate spatial attention. We investigated this hypothesis with electrocorticography (ECoG) recordings from participants who engaged in a cued spatial attention task. To understand the contribution of PAC to spatial attention we classified cortical sites by their relationship to spatial variables or behavioral performance. Local neural activity in spatial sites was sensitive to spatial variables in the task, while local neural activity in behavioral sites correlated with reaction time. We found two PAC frequency clusters that covaried with different aspects of the task. During a period of cued attention, delta-phase/high-gamma (DH) PAC was sensitive to cue direction in spatial sites. In contrast, theta-alpha-phase/beta-low-gamma-amplitude (TABL) PAC robustly correlated with future reaction times in behavioral sites. Finally, we investigated the origins of TABL PAC and found it corresponded to behaviorally relevant, sharp waveforms, which were also coupled to a low frequency rhythm. We conclude that TABL and DH PAC correspond to distinct mechanisms during spatial attention tasks and that sharp waveforms are elements of a coupled dynamical process.

Mapping human temporal and parietal neuronal population activity and functional coupling during mathematical cognition.

Brain areas within the lateral parietal cortex (LPC) and ventral temporal cortex (VTC) have been shown to code for abstract quantity representations and for symbolic numerical representations, respectively. To explore the fast dynamics of activity within each region and the interaction between them, we used electrocorticography recordings from 16 neurosurgical subjects implanted with grids of electrodes over these two regions and tracked the activity within and between the regions as subjects performed three different numerical tasks. Although our results reconfirm the presence of math-selective hubs within the VTC and LPC, we report here a remarkable heterogeneity of neural responses within each region at both millimeter and millisecond scales. Moreover, we show that the heterogeneity of response profiles within each hub mirrors the distinct patterns of functional coupling between them. Our results support the existence of multiple bidirectional functional loops operating between discrete populations of neurons within the VTC and LPC during the visual processing of numerals and the performance of arithmetic functions. These findings reveal information about the dynamics of numerical processing in the brain and also provide insight into the fine-grained functional architecture and connectivity within the human brain.

Characterization of the effects of the human dura on macro- and micro-electrocorticographic recordings.

OBJECTIVE: Electrocorticography (ECoG) electrodes implanted on the surface of the brain have recently emerged as a potential signal platform for brain-computer interface (BCI) systems. While clinical ECoG electrodes are currently implanted beneath the dura, epidural electrodes could reduce the invasiveness and the potential impact of a surgical site infection. Subdural electrodes, on the other hand, while slightly more invasive, may have better signals for BCI application. Because of this balance between risk and benefit between the two electrode positions, the effect of the dura on signal quality must be determined in order to define the optimal implementation for an ECoG BCI system. APPROACH: This study utilized simultaneously acquired baseline recordings from epidural and subdural ECoG electrodes while patients rested. Both macro-scale (2 mm diameter electrodes with 1 cm inter-electrode distance, one patient) and micro-scale (75 µm diameter electrodes with 1 mm inter-electrode distance, four patients) ECoG electrodes were tested. Signal characteristics were evaluated to determine differences in the spectral amplitude and noise floor. Furthermore, the experimental results were compared to theoretical effects produced by placing epidural and subdural ECoG contacts of different sizes within a finite element model. MAIN RESULTS: The analysis demonstrated that for micro-scale electrodes, subdural contacts have significantly higher spectral amplitudes and reach the noise floor at a higher frequency than epidural contacts. For macro-scale electrodes, while there are statistical differences, these differences are small in amplitude and likely do not represent differences relevant to the ability of the signals to be used in a BCI system. CONCLUSIONS: Our findings demonstrate an important trade-off that should be considered in developing a chronic BCI system. While implanting electrodes under the dura is more invasive, it is associated with increased signal quality when recording from micro-scale electrodes with very small sizes and spacing. If recording from larger electrodes, such as traditionally used clinically, the signal quality of epidural recordings is similar to that of subdural recordings.

Frequency-specific mechanism links human brain networks for spatial attention.

Selective attention allows us to filter out irrelevant information in the environment and focus neural resources on information relevant to our current goals. Functional brain-imaging studies have identified networks of broadly distributed brain regions that are recruited during different attention processes; however, the dynamics by which these networks enable selection are not well understood. Here, we first used functional MRI to localize dorsal and ventral attention networks in human epileptic subjects undergoing seizure monitoring. We subsequently recorded cortical physiology using subdural electrocorticography during a spatial-attention task to study network dynamics. Attention networks become selectively phase-modulated at low frequencies (δ, θ) during the same task epochs in which they are recruited in functional MRI. This mechanism may alter the excitability of task-relevant regions or their effective connectivity. Furthermore, different attention processes (holding vs. shifting attention) are associated with synchrony at different frequencies, which may minimize unnecessary cross-talk between separate neuronal processes.

Decoding covert spatial attention using electrocorticographic (ECoG) signals in humans.

This study shows that electrocorticographic (ECoG) signals recorded from the surface of the brain provide detailed information about shifting of visual attention and its directional orientation in humans. ECoG allows for the identification of the cortical areas and time periods that hold the most information about covert attentional shifts. Our results suggest a transient distributed fronto-parietal mechanism for orienting of attention that is represented by different physiological processes. This neural mechanism encodes not only whether or not a subject shifts their attention to a location, but also the locus of attention. This work contributes to our understanding of the electrophysiological representation of attention in humans. It may also eventually lead to brain-computer interfaces (BCIs) that optimize user interaction with their surroundings or that allow people to communicate choices simply by shifting attention to them.

Environmental experience within and across testing days determines the strength of human visuomotor adaptation.

The use of vision allows us to guide and modify our movements by appropriately transforming external sensory information into proper motor commands. We investigated how people learned visuomotor transformations in different visual feedback environments. These environments presented perturbations of visual sense of movement direction. Across experiments and testing days, we altered the likelihood of visual perturbation occurrence and the distribution of sign and strength of visual perturbation angles. We then observed how transformation of sensed error into incremental adaptation depended on visual perturbation angle and on environmental experience. We found that environmental context affected adaptive responses within a day and across days. The across-day effect was profound enough that people exhibited very weak or very strong adaptive sensitivity to identical stimuli, dependent solely on prior days' experience. We conclude that trial-by-trial adaptation to visual feedback is not fixed, but dependent on environmental experiences on both short and long time scales.

Neural correlates of visual-spatial attention in electrocorticographic signals in humans.

Attention is a cognitive selection mechanism that allocates the limited processing resources of the brain to the sensory streams most relevant to our immediate goals, thereby enhancing responsiveness and behavioral performance. The underlying neural mechanisms of orienting attention are distributed across a widespread cortical network. While aspects of this network have been extensively studied, details about the electrophysiological dynamics of this network are scarce. In this study, we investigated attentional networks using electrocorticographic (ECoG) recordings from the surface of the brain, which combine broad spatial coverage with high temporal resolution, in five human subjects. ECoG was recorded when subjects covertly attended to a spatial location and responded to contrast changes in the presence of distractors in a modified Posner cueing task. ECoG amplitudes in the alpha, beta, and gamma bands identified neural changes associated with covert attention and motor preparation/execution in the different stages of the task. The results show that attentional engagement was primarily associated with ECoG activity in the visual, prefrontal, premotor, and parietal cortices. Motor preparation/execution was associated with ECoG activity in premotor/sensorimotor cortices. In summary, our results illustrate rich and distributed cortical dynamics that are associated with orienting attention and the subsequent motor preparation and execution. These findings are largely consistent with and expand on primate studies using intracortical recordings and human functional neuroimaging studies.