Music can be reconstructed from human auditory cortex activity using nonlinear decoding models.

Music is core to human experience, yet the precise neural dynamics underlying music perception remain unknown. We analyzed a unique intracranial electroencephalography (iEEG) dataset of 29 patients who listened to a Pink Floyd song and applied a stimulus reconstruction approach previously used in the speech domain. We successfully reconstructed a recognizable song from direct neural recordings and quantified the impact of different factors on decoding accuracy. Combining encoding and decoding analyses, we found a right-hemisphere dominance for music perception with a primary role of the superior temporal gyrus (STG), evidenced a new STG subregion tuned to musical rhythm, and defined an anterior-posterior STG organization exhibiting sustained and onset responses to musical elements. Our findings show the feasibility of applying predictive modeling on short datasets acquired in single patients, paving the way for adding musical elements to brain-computer interface (BCI) applications.

Subspace partitioning in the human prefrontal cortex resolves cognitive interference.

The human prefrontal cortex (PFC) constitutes the structural basis underlying flexible cognitive control, where mixed-selective neural populations encode multiple task features to guide subsequent behavior. The mechanisms by which the brain simultaneously encodes multiple task-relevant variables while minimizing interference from task-irrelevant features remain unknown. Leveraging intracranial recordings from the human PFC, we first demonstrate that competition between coexisting representations of past and present task variables incurs a behavioral switch cost. Our results reveal that this interference between past and present states in the PFC is resolved through coding partitioning into distinct low-dimensional neural states; thereby strongly attenuating behavioral switch costs. In sum, these findings uncover a fundamental coding mechanism that constitutes a central building block of flexible cognitive control.

A Comparison of Rapid Rule-Learning Strategies in Humans and Monkeys.

Interspecies comparisons are key to deriving an understanding of the behavioral and neural correlates of human cognition from animal models. We perform a detailed comparison of the strategies of female macaque monkeys to male and female humans on a variant of the Wisconsin Card Sorting Test (WCST), a widely studied and applied task that provides a multiattribute measure of cognitive function and depends on the frontal lobe. WCST performance requires the inference of a rule change given ambiguous feedback. We found that well-trained monkeys infer new rules three times more slowly than minimally instructed humans. Input-dependent hidden Markov model-generalized linear models were fit to their choices, revealing hidden states akin to feature-based attention in both species. Decision processes resembled a win-stay, lose-shift strategy with interspecies similarities as well as key differences. Monkeys and humans both test multiple rule hypotheses over a series of rule-search trials and perform inference-like computations to exclude candidate choice options. We quantitatively show that perseveration, random exploration, and poor sensitivity to negative feedback account for the slower task-switching performance in monkeys.

Differential Cognitive Effects of Unilateral Subthalamic Nucleus Deep Brain Stimulation for Parkinson's Disease.

OBJECTIVE: The aim of this study was to investigate the cognitive effects of unilateral directional versus ring subthalamic nucleus deep brain stimulation (STN DBS) in patients with advanced Parkinson's disease. METHODS: We examined 31 participants who underwent unilateral STN DBS (left n = 17; right n = 14) as part of an National Institutes of Health (NIH)-sponsored randomized, double-blind, crossover study contrasting directional versus ring stimulation. All participants received unilateral DBS implants in the hemisphere more severely affected by motor parkinsonism. Measures of cognition included verbal fluency, auditory-verbal memory, and response inhibition. We used mixed linear models to contrast the effects of directional versus ring stimulation and implant hemisphere on longitudinal cognitive function. RESULTS: Crossover analyses showed no evidence for group-level changes in cognitive performance related to directional versus ring stimulation. Implant hemisphere, however, impacted cognition in several ways. Left STN participants had lower baseline verbal fluency than patients with right implants (t [20.66 = -2.50, p = 0.02]). Verbal fluency declined after left (p = 0.013) but increased after right STN DBS (p < 0.001), and response inhibition was faster following right STN DBS (p = 0.031). Regardless of hemisphere, delayed recall declined modestly over time versus baseline (p = 0.001), and immediate recall was unchanged. INTERPRETATION: Directional versus ring STN DBS did not differentially affect cognition. Similar to prior bilateral DBS studies, unilateral left stimulation worsened verbal fluency performance. In contrast, unilateral right STN surgery increased performance on verbal fluency and response inhibition tasks. Our findings raise the hypothesis that unilateral right STN DBS in selected patients with predominant right brain motor parkinsonism could mitigate declines in verbal fluency associated with the bilateral intervention. ANN NEUROL 2024;95:1205-1219.

Predictable and unpredictable deviance detection in the human hippocampus and amygdala.

Our brains extract structure from the environment and form predictions given past experience. Predictive circuits have been identified in wide-spread cortical regions. However, the contribution of medial temporal structures in predictions remains under-explored. The hippocampus underlies sequence detection and is sensitive to novel stimuli, sufficient to gain access to memory, while the amygdala to novelty. Yet, their electrophysiological profiles in detecting predictable and unpredictable deviant auditory events remain unknown. Here, we hypothesized that the hippocampus would be sensitive to predictability, while the amygdala to unexpected deviance. We presented epileptic patients undergoing presurgical monitoring with standard and deviant sounds, in predictable or unpredictable contexts. Onsets of auditory responses and unpredictable deviance effects were detected earlier in the temporal cortex compared with the amygdala and hippocampus. Deviance effects in 1-20 Hz local field potentials were detected in the lateral temporal cortex, irrespective of predictability. The amygdala showed stronger deviance in the unpredictable context. Low-frequency deviance responses in the hippocampus (1-8 Hz) were observed in the predictable but not in the unpredictable context. Our results reveal a distributed network underlying the generation of auditory predictions and suggest that the neural basis of sensory predictions and prediction error signals needs to be extended.

Differential contribution of sensorimotor cortex and subthalamic nucleus to unimanual and bimanual hand movements.

Why does unilateral deep brain stimulation improve motor function bilaterally? To address this clinical observation, we collected parallel neural recordings from sensorimotor cortex (SMC) and the subthalamic nucleus (STN) during repetitive ipsilateral, contralateral, and bilateral hand movements in patients with Parkinson's disease. We used a cross-validated electrode-wise encoding model to map electromyography data to the neural signals. Electrodes in the STN encoded movement at a comparable level for both hands, whereas SMC electrodes displayed a strong contralateral bias. To examine representational overlap across the two hands, we trained the model with data from one condition (contralateral hand) and used the trained weights to predict neural activity for movements produced with the other hand (ipsilateral hand). Overall, between-hand generalization was poor, and this limitation was evident in both regions. A similar method was used to probe representational overlap across different task contexts (unimanual vs. bimanual). Task context was more important for the STN compared to the SMC indicating that neural activity in the STN showed greater divergence between the unimanual and bimanual conditions. These results indicate that SMC activity is strongly lateralized and relatively context-free, whereas the STN integrates contextual information with the ongoing behavior.

Consciousness is supported by near-critical slow cortical electrodynamics.

Mounting evidence suggests that during conscious states, the electrodynamics of the cortex are poised near a critical point or phase transition and that this near-critical behavior supports the vast flow of information through cortical networks during conscious states. Here, we empirically identify a mathematically specific critical point near which waking cortical oscillatory dynamics operate, which is known as the edge-of-chaos critical point, or the boundary between stability and chaos. We do so by applying the recently developed modified 0-1 chaos test to electrocorticography (ECoG) and magnetoencephalography (MEG) recordings from the cortices of humans and macaques across normal waking, generalized seizure, anesthesia, and psychedelic states. Our evidence suggests that cortical information processing is disrupted during unconscious states because of a transition of low-frequency cortical electric oscillations away from this critical point; conversely, we show that psychedelics may increase the information richness of cortical activity by tuning low-frequency cortical oscillations closer to this critical point. Finally, we analyze clinical electroencephalography (EEG) recordings from patients with disorders of consciousness (DOC) and show that assessing the proximity of slow cortical oscillatory electrodynamics to the edge-of-chaos critical point may be useful as an index of consciousness in the clinical setting.

Electrocorticographic Activation Patterns of Electroencephalographic Microstates.

Electroencephalography (EEG) microstates are short successive periods of stable scalp field potentials representing spontaneous activation of brain resting-state networks. EEG microstates are assumed to mediate local activity patterns. To test this hypothesis, we correlated momentary global EEG microstate dynamics with the local temporo-spectral evolution of electrocorticography (ECoG) and stereotactic EEG (SEEG) depth electrode recordings. We hypothesized that these correlations involve the gamma band. We also hypothesized that the anatomical locations of these correlations would converge with those of previous studies using either combined functional magnetic resonance imaging (fMRI)-EEG or EEG source localization. We analyzed resting-state data (5 min) of simultaneous noninvasive scalp EEG and invasive ECoG and SEEG recordings of two participants. Data were recorded during the presurgical evaluation of pharmacoresistant epilepsy using subdural and intracranial electrodes. After standard preprocessing, we fitted a set of normative microstate template maps to the scalp EEG data. Using covariance mapping with EEG microstate timelines and ECoG/SEEG temporo-spectral evolutions as inputs, we identified systematic changes in the activation of ECoG/SEEG local field potentials in different frequency bands (theta, alpha, beta, and high-gamma) based on the presence of particular microstate classes. We found significant covariation of ECoG/SEEG spectral amplitudes with microstate timelines in all four frequency bands (p = 0.001, permutation test). The covariance patterns of the ECoG/SEEG electrodes during the different microstates of both participants were similar. To our knowledge, this is the first study to demonstrate distinct activation/deactivation patterns of frequency-domain ECoG local field potentials associated with simultaneous EEG microstates.

Grasp-specific high-frequency broadband mirror neuron activity during reach-and-grasp movements in humans.

Broadly congruent mirror neurons, responding to any grasp movement, and strictly congruent mirror neurons, responding only to specific grasp movements, have been reported in single-cell studies with primates. Delineating grasp properties in humans is essential to understand the human mirror neuron system with implications for behavior and social cognition. We analyzed electrocorticography data from a natural reach-and-grasp movement observation and delayed imitation task with 3 different natural grasp types of everyday objects. We focused on the classification of grasp types from high-frequency broadband mirror activation patterns found in classic mirror system areas, including sensorimotor, supplementary motor, inferior frontal, and parietal cortices. Classification of grasp types was successful during movement observation and execution intervals but not during movement retention. Our grasp type classification from combined and single mirror electrodes provides evidence for grasp-congruent activity in the human mirror neuron system potentially arising from strictly congruent mirror neurons.

Unexpected sound omissions are signaled in human posterior superior temporal gyrus: an intracranial study.

Context modulates sensory neural activations enhancing perceptual and behavioral performance and reducing prediction errors. However, the mechanism of when and where these high-level expectations act on sensory processing is unclear. Here, we isolate the effect of expectation absent of any auditory evoked activity by assessing the response to omitted expected sounds. Electrocorticographic signals were recorded directly from subdural electrode grids placed over the superior temporal gyrus (STG). Subjects listened to a predictable sequence of syllables, with some infrequently omitted. We found high-frequency band activity (HFA, 70-170 Hz) in response to omissions, which overlapped with a posterior subset of auditory-active electrodes in STG. Heard syllables could be distinguishable reliably from STG, but not the identity of the omitted stimulus. Both omission- and target-detection responses were also observed in the prefrontal cortex. We propose that the posterior STG is central for implementing predictions in the auditory environment. HFA omission responses in this region appear to index mismatch-signaling or salience detection processes.

Distinct electrophysiological signatures of task-unrelated and dynamic thoughts.

Humans spend much of their lives engaging with their internal train of thoughts. Traditionally, research focused on whether or not these thoughts are related to ongoing tasks, and has identified reliable and distinct behavioral and neural correlates of task-unrelated and task-related thought. A recent theoretical framework highlighted a different aspect of thinking-how it dynamically moves between topics. However, the neural correlates of such thought dynamics are unknown. The current study aimed to determine the electrophysiological signatures of these dynamics by recording electroencephalogram (EEG) while participants performed an attention task and periodically answered thought-sampling questions about whether their thoughts were 1) task-unrelated, 2) freely moving, 3) deliberately constrained, and 4) automatically constrained. We examined three EEG measures across different time windows as a function of each thought type: stimulus-evoked P3 event-related potentials and non-stimulus-evoked alpha power and variability. Parietal P3 was larger for task-related relative to task-unrelated thoughts, whereas frontal P3 was increased for deliberately constrained compared with unconstrained thoughts. Frontal electrodes showed enhanced alpha power for freely moving thoughts relative to non-freely moving thoughts. Alpha-power variability was increased for task-unrelated, freely moving, and unconstrained thoughts. Our findings indicate distinct electrophysiological patterns associated with task-unrelated and dynamic thoughts, suggesting these neural measures capture the heterogeneity of our ongoing thoughts.

Coupling between slow waves and sharp-wave ripples engages distributed neural activity during sleep in humans.

Hippocampal-dependent memory consolidation during sleep is hypothesized to depend on the synchronization of distributed neuronal ensembles, organized by the hippocampal sharp-wave ripples (SWRs, 80 to 150 Hz), subcortical/cortical slow-wave activity (SWA, 0.5 to 4 Hz), and sleep spindles (SP, 7 to 15 Hz). However, the precise role of these interactions in synchronizing subcortical/cortical neuronal activity is unclear. Here, we leverage intracranial electrophysiological recordings from the human hippocampus, amygdala, and temporal and frontal cortices to examine activity modulation and cross-regional coordination during SWRs. Hippocampal SWRs are associated with widespread modulation of high-frequency activity (HFA, 70 to 200 Hz), a measure of local neuronal activation. This peri-SWR HFA modulation is predicted by the coupling between hippocampal SWRs and local subcortical/cortical SWA or SP. Finally, local cortical SWA phase offsets and SWR amplitudes predicted functional connectivity between the frontal and temporal cortex during individual SWRs. These findings suggest a selection mechanism wherein hippocampal SWR and cortical slow-wave synchronization governs the transient engagement of distributed neuronal populations supporting hippocampal-dependent memory consolidation.

Multiple memory systems for efficient temporal order memory.

We report distinct contributions of multiple memory systems to the retrieval of the temporal order of events. The neural dynamics related to the retrieval of movie scenes revealed that recalling the temporal order of close events elevates hippocampal theta power, like that observed for recalling close spatial relationships. In contrast, recalling far events increases beta power in the orbitofrontal cortex, reflecting recall based on the overall movie structure.

Frontotemporal Regulation of Subjective Value to Suppress Impulsivity in Intertemporal Choices.

Impulsive decisions arise from preferring smaller but sooner rewards compared with larger but later rewards. How neural activity and attention to choice alternatives contribute to reward decisions during temporal discounting is not clear. Here we probed (1) attention to and (2) neural representation of delay and reward information in humans (both sexes) engaged in choices. We studied behavioral and frequency-specific dynamics supporting impulsive decisions on a fine-grained temporal scale using eye tracking and MEG recordings. In one condition, participants had to decide for themselves but pretended to decide for their best friend in a second prosocial condition, which required perspective taking. Hence, conditions varied in the value for themselves versus that pretending to choose for another person. Stronger impulsivity was reliably found across three independent groups for prosocial decisions. Eye tracking revealed a systematic shift of attention from the delay to the reward information and differences in eye tracking between conditions predicted differences in discounting. High-frequency activity (175-250 Hz) distributed over right frontotemporal sensors correlated with delay and reward information in consecutive temporal intervals for high value decisions for oneself but not the friend. Collectively, the results imply that the high-frequency activity recorded over frontotemporal MEG sensors plays a critical role in choice option integration.SIGNIFICANCE STATEMENT Humans face decisions between sooner smaller rewards and larger later rewards daily. An objective benefit of losing weight over a longer time might be devalued in face of ice cream because they prefer currently available options because of insufficiently considering long-term alternatives. The degree of contribution of neural representation and attention to choice alternatives is not clear. We investigated correlates of such decisions in participants deciding for themselves or pretending to choose for a friend. Behaviorally participants discounted less in self-choices compared with the prosocial condition. Eye movement and MEG recordings revealed how participants represent choice options most evident for options with high subjective value. These results advance our understanding of neural mechanisms underlying decision-making in humans.

Advances in human intracranial electroencephalography research, guidelines and good practices.

Since the second-half of the twentieth century, intracranial electroencephalography (iEEG), including both electrocorticography (ECoG) and stereo-electroencephalography (sEEG), has provided an intimate view into the human brain. At the interface between fundamental research and the clinic, iEEG provides both high temporal resolution and high spatial specificity but comes with constraints, such as the individual's tailored sparsity of electrode sampling. Over the years, researchers in neuroscience developed their practices to make the most of the iEEG approach. Here we offer a critical review of iEEG research practices in a didactic framework for newcomers, as well addressing issues encountered by proficient researchers. The scope is threefold: (i) review common practices in iEEG research, (ii) suggest potential guidelines for working with iEEG data and answer frequently asked questions based on the most widespread practices, and (iii) based on current neurophysiological knowledge and methodologies, pave the way to good practice standards in iEEG research. The organization of this paper follows the steps of iEEG data processing. The first section contextualizes iEEG data collection. The second section focuses on localization of intracranial electrodes. The third section highlights the main pre-processing steps. The fourth section presents iEEG signal analysis methods. The fifth section discusses statistical approaches. The sixth section draws some unique perspectives on iEEG research. Finally, to ensure a consistent nomenclature throughout the manuscript and to align with other guidelines, e.g., Brain Imaging Data Structure (BIDS) and the OHBM Committee on Best Practices in Data Analysis and Sharing (COBIDAS), we provide a glossary to disambiguate terms related to iEEG research.

Deep brain stimulation of the ventrointermediate nucleus of the thalamus to treat essential tremor improves motor sequence learning.

The network of brain structures engaged in motor sequence learning comprises the same structures as those involved in tremor, including basal ganglia, cerebellum, thalamus, and motor cortex. Deep brain stimulation (DBS) of the ventrointermediate nucleus of the thalamus (VIM) reduces tremor, but the effects on motor sequence learning are unknown. We investigated whether VIM stimulation has an impact on motor sequence learning and hypothesized that stimulation effects depend on the laterality of electrode location. Twenty patients (age: 38-81 years; 12 female) with VIM electrodes implanted to treat essential tremor (ET) successfully performed a serial reaction time task, varying whether the stimuli followed a repeating pattern or were selected at random, during which VIM-DBS was either on or off. Analyses of variance were applied to evaluate motor sequence learning performance according to reaction times (RTs) and accuracy. An interaction was observed between whether the sequence was repeated or random and whether VIM-DBS was on or off (F[1,18] = 7.89, p = .012). Motor sequence learning, reflected by reduced RTs for repeated sequences, was greater with DBS on than off (T[19] = 2.34, p = .031). Stimulation location correlated with the degree of motor learning, with greater motor learning when stimulation targeted the lateral VIM (n = 23, ρ = 0.46; p = .027). These results demonstrate the beneficial effects of VIM-DBS on motor sequence learning in ET patients, particularly with lateral VIM electrode location, and provide evidence for a role for the VIM in motor sequence learning.

Top-Down Attentional Modulation in Human Frontal Cortex: Differential Engagement during External and Internal Attention.

Decades of electrophysiological research on top-down control converge on the role of the lateral frontal cortex in facilitating attention to behaviorally relevant external inputs. However, the involvement of frontal cortex in the top-down control of attention directed to the external versus internal environment remains poorly understood. To address this, we recorded intracranial electrocorticography while subjects directed their attention externally to tones and responded to infrequent target tones, or internally to their own thoughts while ignoring the tones. Our analyses focused on frontal and temporal cortices. We first computed the target effect, as indexed by the difference in high frequency activity (70-150 Hz) between target and standard tones. Importantly, we then compared the target effect between external and internal attention, reflecting a top-down attentional effect elicited by task demands, in each region of interest. Both frontal and temporal cortices showed target effects during external and internal attention, suggesting this effect is present irrespective of attention states. However, only the frontal cortex showed an enhanced target effect during external relative to internal attention. These findings provide electrophysiological evidence for top-down attentional modulation in the lateral frontal cortex, revealing preferential engagement with external attention.

Intact Proactive Motor Inhibition after Unilateral Prefrontal Cortex or Basal Ganglia Lesions.

Previous research provided evidence for the critical importance of the PFC and BG for reactive motor inhibition, that is, when actions are cancelled in response to external signals. Less is known about the role of the PFC and BG in proactive motor inhibition, referring to preparation for an upcoming stop signal. In this study, patients with unilateral lesions to the BG or lateral PFC performed in a cued go/no-go task, whereas their EEG was recorded. The paradigm called for cue-based preparation for upcoming, lateralized no-go signals. Based on previous findings, we focused on EEG indices of cognitive control (prefrontal beta), motor preparation (sensorimotor mu/beta, contingent negative variation [CNV]), and preparatory attention (occipital alpha, CNV). On a behavioral level, no differences between patients and controls were found, suggesting an intact ability to proactively prepare for motor inhibition. Patients showed an altered preparatory CNV effect, but no other differences in electrophysiological activity related to proactive and reactive motor inhibition. Our results suggest a context-dependent role of BG and PFC structures in motor inhibition, being critical in reactive, unpredictable contexts, but less so in situations where one can prepare for stopping on a short timescale.

Prefrontal Lesions Disrupt Posterior Alpha-Gamma Coordination of Visual Working Memory Representations.

How does the human brain prioritize different visual representations in working memory (WM)? Here, we define the oscillatory mechanisms supporting selection of "where" and "when" features from visual WM storage and investigate the role of pFC in feature selection. Fourteen individuals with lateral pFC damage and 20 healthy controls performed a visuospatial WM task while EEG was recorded. On each trial, two shapes were presented sequentially in a top/bottom spatial orientation. A retro-cue presented mid-delay prompted which of the two shapes had been in either the top/bottom spatial position or first/second temporal position. We found that cross-frequency coupling between parieto-occipital alpha (α; 8-12 Hz) oscillations and topographically distributed gamma (γ; 30-50 Hz) activity tracked selection of the distinct cued feature in controls. This signature of feature selection was disrupted in patients with pFC lesions, despite intact α-γ coupling independent of feature selection. These findings reveal a pFC-dependent parieto-occipital α-γ mechanism for the rapid selection of visual WM representations.

Intracranial Recordings Demonstrate Both Cortical and Medial Temporal Lobe Engagement in Visual Search in Humans.

Visual search is a fundamental human behavior, providing a gateway to understanding other sensory domains as well as the role of search in higher-order cognition. Search has been proposed to include two component processes: inefficient search (Search) and efficient search (Pop-out). According to extant research, these two processes map onto two separable neural systems located in the frontal and parietal association cortices. In this study, we use intracranial recordings from 23 participants to delineate the neural correlates of Search and Pop-out with an unprecedented combination of spatiotemporal resolution and coverage across cortical and subcortical structures. First, we demonstrate a role for the medial temporal lobe in visual search, on par with engagement in frontal and parietal association cortex. Second, we show a gradient of increasing engagement over anatomical space from dorsal to ventral lateral frontal cortex. Third, we confirm previous intracranial work demonstrating nearly complete overlap in neural engagement across cortical regions in Search and Pop-out. We further demonstrate Pop-out selectivity, manifesting as activity increase in Pop-out as compared to Search, in a distributed set of sites including frontal cortex. This result is at odds with the view that Pop-out is implemented in low-level visual cortex or parietal cortex alone. Finally, we affirm a central role for the right lateral frontal cortex in Search.