Music can be reconstructed from human auditory cortex activity using nonlinear decoding models.

Music is core to human experience, yet the precise neural dynamics underlying music perception remain unknown. We analyzed a unique intracranial electroencephalography (iEEG) dataset of 29 patients who listened to a Pink Floyd song and applied a stimulus reconstruction approach previously used in the speech domain. We successfully reconstructed a recognizable song from direct neural recordings and quantified the impact of different factors on decoding accuracy. Combining encoding and decoding analyses, we found a right-hemisphere dominance for music perception with a primary role of the superior temporal gyrus (STG), evidenced a new STG subregion tuned to musical rhythm, and defined an anterior-posterior STG organization exhibiting sustained and onset responses to musical elements. Our findings show the feasibility of applying predictive modeling on short datasets acquired in single patients, paving the way for adding musical elements to brain-computer interface (BCI) applications.

Advances in human intracranial electroencephalography research, guidelines and good practices.

Since the second-half of the twentieth century, intracranial electroencephalography (iEEG), including both electrocorticography (ECoG) and stereo-electroencephalography (sEEG), has provided an intimate view into the human brain. At the interface between fundamental research and the clinic, iEEG provides both high temporal resolution and high spatial specificity but comes with constraints, such as the individual's tailored sparsity of electrode sampling. Over the years, researchers in neuroscience developed their practices to make the most of the iEEG approach. Here we offer a critical review of iEEG research practices in a didactic framework for newcomers, as well addressing issues encountered by proficient researchers. The scope is threefold: (i) review common practices in iEEG research, (ii) suggest potential guidelines for working with iEEG data and answer frequently asked questions based on the most widespread practices, and (iii) based on current neurophysiological knowledge and methodologies, pave the way to good practice standards in iEEG research. The organization of this paper follows the steps of iEEG data processing. The first section contextualizes iEEG data collection. The second section focuses on localization of intracranial electrodes. The third section highlights the main pre-processing steps. The fourth section presents iEEG signal analysis methods. The fifth section discusses statistical approaches. The sixth section draws some unique perspectives on iEEG research. Finally, to ensure a consistent nomenclature throughout the manuscript and to align with other guidelines, e.g., Brain Imaging Data Structure (BIDS) and the OHBM Committee on Best Practices in Data Analysis and Sharing (COBIDAS), we provide a glossary to disambiguate terms related to iEEG research.

Monitoring of Self-Paced Action Timing and Sensory Outcomes After Lesions to the Orbitofrontal Cortex.

Anticipation, monitoring, and evaluation of the outcome of one's actions are at the core of proactive control. Individuals with lesions to OFC often demonstrate behaviors that indicate a lack of recognition or concern for the negative effects of their actions. Altered action timing has also been reported in these patients. We investigated the role of OFC in predicting and monitoring the sensory outcomes of self-paced actions. We studied patients with focal OFC lesions (n = 15) and healthy controls (n = 20) while they produced actions that infrequently evoked unexpected outcomes. Participants performed a self-paced, random generation task where they repeatedly pressed right and left buttons that were associated with specific sensory outcomes: a 1- and 2-kHz tone, respectively. Occasional unexpected action outcomes occurred (mismatch) that inverted the learned button-tone association (match). We analyzed ERPs to the expected and unexpected outcomes as well as action timing. Neither group showed post-mismatch slowing of button presses, but OFC patients had a higher number of fast button presses, indicating that they were inferior to controls at producing regularly timed actions. Mismatch trials elicited enhanced N2b-P3a responses across groups as indicated by the significant main effect of task condition. Planned within-group analyses showed, however, that patients did not have a significant condition effect, suggesting that the result of the omnibus analysis was driven primarily by the controls. Altogether, our findings indicate that monitoring of action timing and the sensory outcomes of self-paced actions as indexed by ERPs is impacted by OFC damage.

Cortical Dynamics of Semantic Priming and Interference during Word Production: An Intracerebral Study.

Language production requires that semantic representations are mapped to lexical representations on the basis of the ongoing context to select the appropriate words. This mapping is thought to generate two opposing phenomena, "semantic priming," where multiple word candidates are activated, and "interference," where these word activities are differentiated to make a goal-relevant selection. In previous neuroimaging and neurophysiological research, priming and interference have been associated to activity in regions of a left frontotemporal network. Most of such studies relied on recordings that either have high temporal or high spatial resolution, but not both. Here, we employed intracerebral EEG techniques to explore with both high resolutions, the neural activity associated with these phenomena. The data came from nine epileptic patients who were stereotactically implanted for presurgical diagnostics. They performed a cyclic picture-naming task contrasting semantically homogeneous and heterogeneous contexts. Of the 84 brain regions sampled, 39 showed task-evoked activity that was significant and consistent across two patients or more. In nine of these regions, activity was significantly modulated by the semantic manipulation. It was reduced for semantically homogeneous contexts (i.e., priming) in eight of these regions, located in the temporal ventral pathway as well as frontal areas. Conversely, it was increased only in the pre-SMA, notably at an early poststimulus temporal window (200-300 msec) and a preresponse temporal window (700-800 msec). These temporal effects respectively suggest the pre-SMA's role in initial conflict detection (e.g., increased response caution) and in preresponse control. Such roles of the pre-SMA are traditional from a history of neural evidence in simple perceptual tasks, yet are also consistent with recent cognitive lexicosemantic theories that highlight top-down processes in language production. Finally, although no significant semantic modulation was found in the ACC, future intracerebral EEG work should continue to inspect ACC with the pre-SMA.

Estimating Parallel Processing in a Language Task Using Single-Trial Intracerebral Electroencephalography.

We provide a quantitative assessment of the parallel-processing hypothesis included in various language-processing models. First, we highlight the importance of reasoning about cognitive processing at the level of single trials rather than using averages. Then, we report the results of an experiment in which the hypothesis was tested at an unprecedented level of granularity with intracerebral data recorded during a picture-naming task. We extracted patterns of significant high-gamma activity from multiple patients and combined them into a single analysis framework that identified consistent patterns. Average signals from different brain regions, presumably indexing distinct cognitive processes, revealed a large degree of concurrent activity. In comparison, at the level of single trials, the temporal overlap of detected significant activity was unexpectedly low, with the exception of activity in sensory cortices. Our novel methodology reveals some limits on the degree to which word production involves parallel processing.

Ramping dynamics and theta oscillations reflect dissociable signatures during rule-guided human behavior.

Contextual cues and prior evidence guide human goal-directed behavior. The neurophysiological mechanisms that implement contextual priors to guide subsequent actions in the human brain remain unclear. Using intracranial electroencephalography (iEEG), we demonstrate that increasing uncertainty introduces a shift from a purely oscillatory to a mixed processing regime with an additional ramping component. Oscillatory and ramping dynamics reflect dissociable signatures, which likely differentially contribute to the encoding and transfer of different cognitive variables in a cue-guided motor task. The results support the idea that prefrontal activity encodes rules and ensuing actions in distinct coding subspaces, while theta oscillations synchronize the prefrontal-motor network, possibly to guide action execution. Collectively, our results reveal how two key features of large-scale neural population activity, namely continuous ramping dynamics and oscillatory synchrony, jointly support rule-guided human behavior.

Altered hierarchical auditory predictive processing after lesions to the orbitofrontal cortex.

Orbitofrontal cortex (OFC) is classically linked to inhibitory control, emotion regulation, and reward processing. Recent perspectives propose that the OFC also generates predictions about perceptual events, actions, and their outcomes. We tested the role of the OFC in detecting violations of prediction at two levels of abstraction (i.e., hierarchical predictive processing) by studying the event-related potentials (ERPs) of patients with focal OFC lesions (n = 12) and healthy controls (n = 14) while they detected deviant sequences of tones in a local-global paradigm. The structural regularities of the tones were controlled at two hierarchical levels by rules defined at a local (i.e., between tones within sequences) and at a global (i.e., between sequences) level. In OFC patients, ERPs elicited by standard tones were unaffected at both local and global levels compared to controls. However, patients showed an attenuated mismatch negativity (MMN) and P3a to local prediction violation, as well as a diminished MMN followed by a delayed P3a to the combined local and global level prediction violation. The subsequent P3b component to conditions involving violations of prediction at the level of global rules was preserved in the OFC group. Comparable effects were absent in patients with lesions restricted to the lateral PFC, which lends a degree of anatomical specificity to the altered predictive processing resulting from OFC lesion. Overall, the altered magnitudes and time courses of MMN/P3a responses after lesions to the OFC indicate that the neural correlates of detection of auditory regularity violation are impacted at two hierarchical levels of rule abstraction.

Anatomical registration of intracranial electrodes. Robust model-based localization and deformable smooth brain-shift compensation methods.

BACKGROUND: Intracranial electrodes are typically localized from post-implantation CT artifacts. Automatic algorithms localizing low signal-to-noise ratio artifacts and high-density electrode arrays are missing. Additionally, implantation of grids/strips introduces brain deformations, resulting in registration errors when fusing post-implantation CT and pre-implantation MR images. Brain-shift compensation methods project electrode coordinates to cortex, but either fail to produce smooth solutions or do not account for brain deformations. NEW METHODS: We first introduce GridFit, a model-based fitting approach that simultaneously localizes all electrodes' CT artifacts in grids, strips, or depth arrays. Second, we present CEPA, a brain-shift compensation algorithm combining orthogonal-based projections, spring-mesh models, and spatial regularization constraints. RESULTS: We tested GridFit on ∼6000 simulated scenarios. The localization of CT artifacts showed robust performance under difficult scenarios, such as noise, overlaps, and high-density implants (<1 mm errors). Validation with data from 20 challenging patients showed 99% accurate localization of the electrodes (3160/3192). We tested CEPA brain-shift compensation with data from 15 patients. Projections accounted for simple mechanical deformation principles with < 0.4 mm errors. The inter-electrode distances smoothly changed across neighbor electrodes, while changes in inter-electrode distances linearly increased with projection distance. COMPARISON WITH EXISTING METHODS: GridFit succeeded in difficult scenarios that challenged available methods and outperformed visual localization by preserving the inter-electrode distance. CEPA registration errors were smaller than those obtained for well-established alternatives. Additionally, modeling resting-state high-frequency activity in five patients further supported CEPA. CONCLUSION: GridFit and CEPA are versatile tools for registering intracranial electrode coordinates, providing highly accurate results even in the most challenging implantation scenarios. The methods are implemented in the iElectrodes open-source toolbox.

Quantifying evoked responses through information-theoretical measures.

Information theory is a viable candidate to advance our understanding of how the brain processes information generated in the internal or external environment. With its universal applicability, information theory enables the analysis of complex data sets, is free of requirements about the data structure, and can help infer the underlying brain mechanisms. Information-theoretical metrics such as Entropy or Mutual Information have been highly beneficial for analyzing neurophysiological recordings. However, a direct comparison of the performance of these methods with well-established metrics, such as the t-test, is rare. Here, such a comparison is carried out by evaluating the novel method of Encoded Information with Mutual Information, Gaussian Copula Mutual Information, Neural Frequency Tagging, and t-test. We do so by applying each method to event-related potentials and event-related activity in different frequency bands originating from intracranial electroencephalography recordings of humans and marmoset monkeys. Encoded Information is a novel procedure that assesses the similarity of brain responses across experimental conditions by compressing the respective signals. Such an information-based encoding is attractive whenever one is interested in detecting where in the brain condition effects are present.

Decision and response monitoring during working memory are sequentially represented in the human insula.

Emerging research supports a role of the insula in human cognition. Here, we used intracranial EEG to investigate the spatiotemporal dynamics in the insula during a verbal working memory (vWM) task. We found robust effects for theta, beta, and high frequency activity (HFA) during probe presentation requiring a decision. Theta band activity showed differential involvement across left and right insulae while sequential HFA modulations were observed along the anteroposterior axis. HFA in anterior insula tracked decision making and subsequent HFA was observed in posterior insula after the behavioral response. Our results provide electrophysiological evidence of engagement of different insula subregions in both decision-making and response monitoring during vWM and expand our knowledge of the role of the insula in complex human behavior.

Anatomical registration of intracranial electrodes. Robust model-based localization and deformable smooth brain-shift compensation methods.

Precise electrode localization is important for maximizing the utility of intracranial EEG data. Electrodes are typically localized from post-implantation CT artifacts, but algorithms can fail due to low signal-to-noise ratio, unrelated artifacts, or high-density electrode arrays. Minimizing these errors usually requires time-consuming visual localization and can still result in inaccurate localizations. In addition, surgical implantation of grids and strips typically introduces non-linear brain deformations, which result in anatomical registration errors when post-implantation CT images are fused with the pre-implantation MRI images. Several projection methods are currently available, but they either fail to produce smooth solutions or do not account for brain deformations. To address these shortcomings, we propose two novel algorithms for the anatomical registration of intracranial electrodes that are almost fully automatic and provide highly accurate results. We first present GridFit, an algorithm that simultaneously localizes all contacts in grids, strips, or depth arrays by fitting flexible models to the electrodes' CT artifacts. We observed localization errors of less than one millimeter (below 8% relative to the inter-electrode distance) and robust performance under the presence of noise, unrelated artifacts, and high-density implants when we ran ~6000 simulated scenarios. Furthermore, we validated the method with real data from 20 intracranial patients. As a second registration step, we introduce CEPA, a brain-shift compensation algorithm that combines orthogonal-based projections, spring-mesh models, and spatial regularization constraints. When tested with real data from 15 patients, anatomical registration errors were smaller than those obtained for well-established alternatives. Additionally, CEPA accounted simultaneously for simple mechanical deformation principles, which is not possible with other available methods. Inter-electrode distances of projected coordinates smoothly changed across neighbor electrodes, while changes in inter-electrode distances linearly increased with projection distance. Moreover, in an additional validation procedure, we found that modeling resting-state high-frequency activity (75-145 Hz ) in five patients further supported our new algorithm. Together, GridFit and CEPA constitute a versatile set of tools for the registration of subdural grid, strip, and depth electrode coordinates that provide highly accurate results even in the most challenging implantation scenarios. The methods presented here are implemented in the iElectrodes open-source toolbox, making their use simple, accessible, and straightforward to integrate with other popular toolboxes used for analyzing electrophysiological data.

Gender bias in academia: A lifetime problem that needs solutions.

Despite increased awareness of the lack of gender equity in academia and a growing number of initiatives to address issues of diversity, change is slow, and inequalities remain. A major source of inequity is gender bias, which has a substantial negative impact on the careers, work-life balance, and mental health of underrepresented groups in science. Here, we argue that gender bias is not a single problem but manifests as a collection of distinct issues that impact researchers' lives. We disentangle these facets and propose concrete solutions that can be adopted by individuals, academic institutions, and society.

The brain tracks auditory rhythm predictability independent of selective attention.

The brain responds to violations of expected rhythms, due to extraction- and prediction of the temporal structure in auditory input. Yet, it is unknown how probability of rhythm violations affects the overall rhythm predictability. Another unresolved question is whether predictive processes are independent of attention processes. In this study, EEG was recorded while subjects listened to rhythmic sequences. Predictability was manipulated by changing the stimulus-onset-asynchrony (SOA deviants) for given tones in the rhythm. When SOA deviants were inserted rarely, predictability remained high, whereas predictability was lower with more frequent SOA deviants. Dichotic tone-presentation allowed for independent manipulation of attention, as specific tones of the rhythm were presented to separate ears. Attention was manipulated by instructing subjects to attend to tones in one ear only, while keeping the rhythmic structure of tones constant. The analyses of event-related potentials revealed an attenuated N1 for tones when rhythm predictability was high, while the N1 was enhanced by attention to tones. Bayesian statistics revealed no interaction between predictability and attention. A right-lateralization of attention effects, but not predictability effects, suggested potentially different cortical processes. This is the first study to show that probability of rhythm violation influences rhythm predictability, independent of attention.

Auditory deviance detection in the human insula: An intracranial EEG study.

The human insula is known to be involved in auditory processing, but knowledge about its precise functional role and the underlying electrophysiology is limited. To assess its role in automatic auditory deviance detection we analyzed the EEG high frequency activity (HFA; 75-145 Hz) and ERPs from 90 intracranial insular channels across 16 patients undergoing pre-surgical intracranial monitoring for epilepsy treatment. Subjects passively listened to a stream of standard and deviant tones differing in four physical dimensions: intensity, frequency, location or time. HFA responses to auditory stimuli were found in the short and long gyri, and the anterior, superior, and inferior segments of the circular sulcus of the insular cortex. Only a subset of channels in the inferior segment of the circular sulcus of the insula showed HFA deviance detection responses, i.e., a greater and longer latency response to specific deviants relative to standards. Auditory deviancy processing was also later in the insula when compared with the superior temporal cortex. ERP results were more widespread and supported the HFA insular findings. These results provide evidence that the human insula is engaged during auditory deviance detection.

Preservation of Interference Effects in Working Memory After Orbitofrontal Damage.

Orbitofrontal cortex (OFC) is implicated in multiple cognitive processes, including inhibitory control, context memory, recency judgment, and choice behavior. Despite an emerging understanding of the role of OFC in memory and executive control, its necessity for core working memory (WM) operations remains undefined. Here, we assessed the impact of OFC damage on interference effects in WM using a Recent Probes task based on the Sternberg item-recognition task (1966). Subjects were asked to memorize a set of letters and then indicate whether a probe letter was presented in a particular set. Four conditions were created according to the forthcoming response ("yes"/"no") and the recency of the probe (presented in the previous trial set or not). We compared behavioral and electroencephalography (EEG) responses between healthy subjects (n = 14) and patients with bilateral OFC damage (n = 14). Both groups had the same recency pattern of slower reaction time (RT) when the probe was presented in the previous trial but not in the current one, reflecting the proactive interference (PI). The within-group electrophysiological results showed no condition difference during letter encoding and maintenance. In contrast, event-related potentials (ERPs) to probes showed distinct within-group condition effects, and condition by group effects. The response and recency effects for controls occurred within the same time window (300-500 ms after probe onset) and were observed in two distinct spatial groups including right centro-posterior and left frontal electrodes. Both clusters showed ERP differences elicited by the response effect, and one cluster was also sensitive to the recency manipulation. Condition differences for the OFC group involved two different clusters, encompassing only left hemisphere electrodes and occurring during two consecutive time windows (345-463 ms and 565-710 ms). Both clusters were sensitive to the response effect, but no recency effect was found despite the behavioral recency effect. Although the groups had different electrophysiological responses, the maintenance of letters in WM, the evaluation of the context of the probe, and the decision to accept or reject a probed letter were preserved in OFC patients. The results suggest that neural reorganization may contribute to intact recency judgment and response after OFC damage.

High frequency gamma activity in the left hippocampus predicts visual object naming performance.

Access to an object's name requires the retrieval of an arbitrary association between it's identity and a word-label. The hippocampus is essential in retrieving arbitrary associations, and thus could be involved in retrieving the link between an object and its name. To test this hypothesis we recorded the iEEG signal from epileptic patients, directly implanted in the hippocampus, while they performed a picture naming task. High-frequency broadband gamma (50-150 Hz) responses were computed as an index of population-level spiking activity. Our results show, for the first time, single-trial hippocampal dynamics between visual confrontation and naming. Remarkably, the latency of the hippocampal response predicts naming latency, while inefficient hippocampal activation is associated with "tip-of-the-tongue" states (a failure to retrieve the name of a recognized object) suggesting that the hippocampus is an active component of the naming network and that its dynamics are closely related to efficient word production.

How familiarization and repetition modulate the picture naming network.

A common strategy to reveal the components of the speech production network is to use psycholinguistic manipulations previously tested in behavioral protocols. This often disregards how implementation aspects that are nonessential for interpreting behavior may affect the neural response. We compared the electrophysiological (EEG) signature of two popular picture naming protocols involving either unfamiliar pictures without repetitions or repeated familiar pictures. We observed significant semantic interference effects in behavior but not in the EEG, contrary to some previous findings. Remarkably, the two protocols elicited clearly distinct EEG responses. These were not due to naming latency differences nor did they reflect a homogeneous modulation of amplitude over the trial time-window. The effect of protocol is attributed to the familiarization induced by the first encounter with the materials. Picture naming processes can be substantially modulated by specific protocol requirements controlled by familiarity and, to a much lesser degree, the repetition of materials.

Intra-cranial recordings of brain activity during language production.

Recent findings in the neurophysiology of language production have provided a detailed description of the brain network underlying this behavior, as well as some indications about the timing of operations. Despite their invaluable utility, these data generally suffer from limitations either in terms of temporal resolution, or in terms of spatial localization. In addition, studying the neural basis of speech is complicated by the presence of articulation artifacts such as electro-myographic activity that interferes with the neural signal. These difficulties are virtually absent in a powerful albeit much less frequent methodology, namely the recording of intra-cranial brain activity (intra-cranial electroencephalography). Such recordings are only possible under very specific clinical circumstances requiring functional mapping before brain surgery, most notably in patients that suffer from pharmaco-resistant epilepsy. Here we review the research conducted with this methodology in the field of language production, with explicit consideration of its advantages and drawbacks. The available evidence is shown to be diverse, both in terms of the tasks and the cognitive processes tested and in terms of the brain localizations being studied. Still, the review provides valuable information for characterizing the dynamics of the neural events occurring in the language production network. Following modality specific activities (in auditory or visual cortices), there is a convergence of activity in superior temporal sulcus, which is a plausible neural correlate of phonological encoding processes. Later, between 500 and 800 ms, inferior frontal gyrus (around Broca's area) is involved. Peri-rolandic areas are recruited in the two modalities relatively early (200-500 ms window), suggesting a very early involvement of (pre-) motor processes. We discuss how some of these findings may be at odds with conclusions drawn from available meta-analysis of language production studies.