Spatiotemporal mapping of auditory onsets during speech production.

The human auditory cortex is organized according to the timing and spectral characteristics of speech sounds during speech perception. During listening, the posterior superior temporal gyrus is organized according to onset responses, which segment acoustic boundaries in speech, and sustained responses, which further process phonological content. When we speak, the auditory system is actively processing the sound of our own voice to detect and correct speech errors in real time. This manifests in neural recordings as suppression of auditory responses during speech production compared to perception, but whether this differentially affects onset and sustained temporal profiles is not known. Here we investigated this question using intracranial EEG recorded from seventeen pediatric, adolescent, and adult patients with medication-resistant epilepsy while they performed a reading/listening task. We identified onset and sustained responses to speech in bilateral auditory cortex and observed a selective suppression of onset responses during speech production. We conclude that onset responses provide a temporal landmark during speech perception that is redundant with forward prediction during speech production and are therefore suppressed. Phonological feature tuning in these "onset suppression" electrodes remained stable between perception and production. Notably, auditory onset responses and phonological feature tuning were present in the posterior insula during both speech perception and production, suggesting an anatomically and functionally separate auditory processing zone that we believe to be involved in multisensory integration during speech perception and feedback control.Significance Statement Specific neural populations in the auditory cortex preferentially respond to the onset of speech sounds. These "onset responses" aid in perceiving boundaries in continuous speech. We recorded neural responses from patients with intracranial electrodes during a speaking and listening task to investigate the role of onset responses in speech production. Onset responses were present in the auditory cortex during listening, but absent during speaking. On the other hand, onset responses were observed in the insula during both conditions, suggesting a different functional role for the insula in auditory feedback processing. These findings extend our knowledge of how different parts of the brain involved in feedback control operate during speech production by identifying two functionally and anatomically distinct patterns of activity.

The Oscillatory ReConstruction Algorithm adaptively identifies frequency bands to improve spectral decomposition in human and rodent neural recordings.

Neural oscillations are routinely analyzed using methods that measure activity in fixed frequency bands (e.g., alpha, 8-12 Hz), although the frequency of neural signals varies within and across individuals based on numerous factors including neuroanatomy, behavioral demands, and species. Furthermore, band-limited activity is an often assumed, typically unmeasured model of neural activity, and band definitions vary considerably across studies. Together, these factors mask individual differences and can lead to noisy spectral estimates and interpretational problems when linking electrophysiology to behavior. We developed the Oscillatory ReConstruction Algorithm ("ORCA"), an unsupervised method to measure the spectral characteristics of neural signals in adaptively identified bands, which incorporates two new methods for frequency band identification. ORCA uses the instantaneous amplitude, phase, and frequency of activity in each band to reconstruct the signal and directly quantify spectral decomposition performance using each of four different models. To reduce researcher bias, ORCA provides spectral estimates derived from the best model and requires minimal hyperparameterization. Analyzing human scalp EEG data during eyes-open and eyes-closed "resting" conditions, we first identify variability in the frequency content of neural signals across subjects and electrodes. We demonstrate that ORCA significantly improves spectral decomposition compared with conventional methods and captures the well-known increase in low-frequency activity during eye closure in electrode- and subject-specific frequency bands. We further illustrate the utility of our method in rodent CA1 recordings. ORCA is a novel analytic tool that allows researchers to investigate how nonstationary neural oscillations vary across behaviors, brain regions, individuals, and species.NEW & NOTEWORTHY Neural oscillations show substantial variability within and across individuals and brain regions, yet most existing studies analyze oscillations using canonical, fixed-frequency bands. Thus, there is an ongoing need for tools that capture oscillatory variability in neural signals. Toward this end, Oscillatory ReConstruction Algorithm is a novel and adaptive analytic tool that allows researchers to measure neural oscillations with more precision and less researcher bias.

Electrical Stimulation in Hippocampus and Entorhinal Cortex Impairs Spatial and Temporal Memory.

The medial temporal lobe (MTL) is widely implicated in supporting episodic memory and navigation, but its precise functional role in organizing memory across time and space remains elusive. Here we examine the specific cognitive processes implemented by MTL structures (hippocampus and entorhinal cortex) to organize memory by using electrical brain stimulation, leveraging its ability to establish causal links between brain regions and features of behavior. We studied neurosurgical patients of both sexes who performed spatial-navigation and verbal-episodic memory tasks while brain stimulation was applied in various regions during learning. During the verbal memory task, stimulation in the MTL disrupted the temporal organization of encoded memories such that items learned with stimulation tended to be recalled in a more randomized order. During the spatial task, MTL stimulation impaired subjects' abilities to remember items located far away from boundaries. These stimulation effects were specific to the MTL. Our findings thus provide the first causal demonstration in humans of the specific memory processes that are performed by the MTL to encode when and where events occurred.SIGNIFICANCE STATEMENT Numerous studies have implicated the medial temporal lobe (MTL) in encoding spatial and temporal memories, but they have not been able to causally demonstrate the nature of the cognitive processes by which this occurs in real-time. Electrical brain stimulation is able to demonstrate causal links between a brain region and a given function with high temporal precision. By examining behavior in a memory task as subjects received MTL stimulation, we provide the first causal evidence demonstrating the role of the MTL in organizing the spatial and temporal aspects of episodic memory.

Electrophysiological Signatures of Spatial Boundaries in the Human Subiculum.

Environmental boundaries play a crucial role in spatial navigation and memory across a wide range of distantly related species. In rodents, boundary representations have been identified at the single-cell level in the subiculum and entorhinal cortex of the hippocampal formation. Although studies of hippocampal function and spatial behavior suggest that similar representations might exist in humans, boundary-related neural activity has not been identified electrophysiologically in humans until now. To address this gap in the literature, we analyzed intracranial recordings from the hippocampal formation of surgical epilepsy patients (of both sexes) while they performed a virtual spatial navigation task and compared the power in three frequency bands (1-4, 4-10, and 30-90 Hz) for target locations near and far from the environmental boundaries. Our results suggest that encoding locations near boundaries elicited stronger theta oscillations than for target locations near the center of the environment and that this difference cannot be explained by variables such as trial length, speed, movement, or performance. These findings provide direct evidence of boundary-dependent neural activity localized in humans to the subiculum, the homolog of the hippocampal subregion in which most boundary cells are found in rodents, and indicate that this system can represent attended locations that rather than the position of one's own body.SIGNIFICANCE STATEMENT Spatial computations using environmental boundaries are an integral part of the brain's spatial mapping system. In rodents, border/boundary cells in the subiculum and entorhinal cortex reveal boundary coding at the single-neuron level. Although there is good reason to believe that such representations also exist in humans, the evidence has thus far been limited to functional neuroimaging studies that broadly implicate the hippocampus in boundary-based navigation. By combining intracranial recordings with high-resolution imaging of hippocampal subregions, we identified a neural marker of boundary representation in the human subiculum.

Multifaceted roles for low-frequency oscillations in bottom-up and top-down processing during navigation and memory.

A prominent and replicated finding is the correlation between running speed and increases in low-frequency oscillatory activity in the hippocampal local field potential. A more recent finding concerns low-frequency oscillations that increase in coherence between the hippocampus and neocortical brain areas such as prefrontal cortex during memory-related behaviors (i.e., remembering the correct location to visit). In this review, we tie together movement-related and memory-related low-frequency oscillations in the rodent with similar findings in humans. We argue that although movement-related low-frequency oscillations, in particular, may have slightly different characteristics in humans than rodents, placing important constraints on our thinking about this issue, both phenomena have similar functional foundations. We review four prominent theoretical models that provide partially conflicting accounts of movement-related low-frequency oscillations. We attempt to tie together these theoretical proposals, and existing data in rodents and humans, with memory-related low-frequency oscillations. We propose that movement-related low-frequency oscillations and memory-related low-frequency oscillatory activity, both of which show significant coherence with oscillations in other brain regions, represent different facets of "spectral fingerprints," or different resonant frequencies within the same brain networks underlying different cognitive processes. Together, movement-related and memory-related low-frequency oscillatory coupling may be linked by their distinct contributions to bottom-up, sensorimotor driven processing and top-down, controlled processing characterizing aspects of memory encoding and retrieval.

Prestimulus theta activity predicts correct source memory retrieval.

Recent evidence indicates that the processing of a stimulus can be influenced by preceding patterns of brain activity. Here we examine whether prestimulus oscillatory brain activity can influence the ability to retrieve episodic memories. Neural activity in the theta-frequency band (4-8 Hz) was enhanced before presentation of test items which elicited accurate recollection of contextual details of the prior study episode ("source retrieval"), relative to trials for which item recognition was successful but source retrieval failed. Poststimulus theta activity was also related to source retrieval, and the magnitude of poststimulus theta was predicted by the magnitude of the prestimulus theta effects. The results suggest that ongoing neural processes occurring before stimulus onset might play a critical role in readying the brain for successful memory retrieval.

Processing of auditory feedback in perisylvian and insular cortex.

When we speak, we not only make movements with our mouth, lips, and tongue, but we also hear the sound of our own voice. Thus, speech production in the brain involves not only controlling the movements we make, but also auditory and sensory feedback. Auditory responses are typically suppressed during speech production compared to perception, but how this manifests across space and time is unclear. Here we recorded intracranial EEG in seventeen pediatric, adolescent, and adult patients with medication-resistant epilepsy who performed a reading/listening task to investigate how other auditory responses are modulated during speech production. We identified onset and sustained responses to speech in bilateral auditory cortex, with a selective suppression of onset responses during speech production. Onset responses provide a temporal landmark during speech perception that is redundant with forward prediction during speech production. Phonological feature tuning in these "onset suppression" electrodes remained stable between perception and production. Notably, the posterior insula responded at sentence onset for both perception and production, suggesting a role in multisensory integration during feedback control.

A biophysically constrained brain connectivity model based on stimulation-evoked potentials.

BACKGROUND: Single-pulse electrical stimulation (SPES) is an established technique used to map functional effective connectivity networks in treatment-refractory epilepsy patients undergoing intracranial-electroencephalography monitoring. While the connectivity path between stimulation and recording sites has been explored through the integration of structural connectivity, there are substantial gaps, such that new modeling approaches may advance our understanding of connectivity derived from SPES studies. NEW METHOD: Using intracranial electrophysiology data recorded from a single patient undergoing stereo-electroencephalography (sEEG) evaluation, we employ an automated detection method to identify early response components, C1, from pulse-evoked potentials (PEPs) induced by SPES. C1 components were utilized for a novel topology optimization method, modeling 3D electrical conductivity to infer neural pathways from stimulation sites. Additionally, PEP features were compared with tractography metrics, and model results were analyzed with respect to anatomical features. RESULTS: The proposed optimization model resolved conductivity paths with low error. Specific electrode contacts displaying high error correlated with anatomical complexities. The C1 component strongly correlated with additional PEP features and displayed stable, weak correlations with tractography measures. COMPARISON WITH EXISTING METHOD: Existing methods for estimating neural signal pathways are imaging-based and thus rely on anatomical inferences. CONCLUSIONS: These results demonstrate that informing topology optimization methods with human intracranial SPES data is a feasible method for generating 3D conductivity maps linking electrical pathways with functional neural ensembles. PEP-estimated effective connectivity is correlated with but distinguished from structural connectivity. Modeled conductivity resolves connectivity pathways in the absence of anatomical priors.

Intracranial Directed Connectivity Links Subregions of the Prefrontal Cortex to Major Depression.

Understanding the neural basis of major depressive disorder (MDD) is vital to guiding neuromodulatory treatments. The available evidence supports the hypothesis that MDD is fundamentally a disease of cortical disinhibition, where breakdowns of inhibitory neural systems lead to diminished emotion regulation and intrusive ruminations. Recent research also points towards network changes in the brain, especially within the prefrontal cortex (PFC), as primary sources of MDD etiology. However, due to limitations in spatiotemporal resolution and clinical opportunities for intracranial recordings, this hypothesis has not been directly tested. We recorded intracranial EEG from the dorsolateral (dlPFC), orbitofrontal (OFC), and anterior cingulate cortices (ACC) in neurosurgical patients with MDD. We measured daily fluctuations in self-reported depression severity alongside directed connectivity between these PFC subregions. We focused primarily on delta oscillations (1-3 Hz), which have been linked to GABAergic inhibitory control and intracortical communication. Depression symptoms worsened when connectivity within the left vs. right PFC became imbalanced. In the left hemisphere, all directed connectivity towards the ACC, from the dlPFC and OFC, was positively correlated with depression severity. In the right hemisphere, directed connectivity between the OFC and dlPFC increased with depression severity as well. This is the first evidence that delta oscillations flowing between prefrontal subregions transiently increase intensity when people are experiencing more negative mood. These findings support the overarching hypothesis that MDD worsens with prefrontal disinhibition.

Stereo-Electroencephalography-Guided Network Neuromodulation for Psychiatric Disorders: The Neurophysiology Monitoring Unit.

BACKGROUND AND OBJECTIVES: Recent advances in stereotactic and functional neurosurgery have brought forth the stereo-electroencephalography approach which allows deeper interrogation and characterization of the contributions of deep structures to neural and affective functioning. We argue that this approach can and should be brought to bear on the notoriously intractable issue of defining the pathophysiology of refractory psychiatric disorders and developing patient-specific optimized stimulation therapies. METHODS: We have developed a suite of methods for maximally leveraging the stereo-electroencephalography approach for an innovative application to understand affective disorders, with high translatability across the broader range of refractory neuropsychiatric conditions. RESULTS: This article provides a roadmap for determining desired electrode coverage, tracking high-resolution research recordings across a large number of electrodes, synchronizing intracranial signals with ongoing research tasks and other data streams, applying intracranial stimulation during recording, and design choices for patient comfort and safety. CONCLUSION: These methods can be implemented across other neuropsychiatric conditions needing intensive electrophysiological characterization to define biomarkers and more effectively guide therapeutic decision-making in cases of severe and treatment-refractory disease.

Beta activity in human anterior cingulate cortex mediates reward biases.

The rewards that we get from our choices and actions can have a major influence on our future behavior. Understanding how reward biasing of behavior is implemented in the brain is important for many reasons, including the fact that diminution in reward biasing is a hallmark of clinical depression. We hypothesized that reward biasing is mediated by the anterior cingulate cortex (ACC), a cortical hub region associated with the integration of reward and executive control and with the etiology of depression. To test this hypothesis, we recorded neural activity during a biased judgment task in patients undergoing intracranial monitoring for either epilepsy or major depressive disorder. We found that beta (12-30 Hz) oscillations in the ACC predicted both associated reward and the size of the choice bias, and also tracked reward receipt, thereby predicting bias on future trials. We found reduced magnitude of bias in depressed patients, in whom the beta-specific effects were correspondingly reduced. Our findings suggest that ACC beta oscillations may orchestrate the learning of reward information to guide adaptive choice, and, more broadly, suggest a potential biomarker for anhedonia and point to future development of interventions to enhance reward impact for therapeutic benefit.

Insula uses overlapping codes for emotion in self and others.

In daily life, we must recognize others' emotions so we can respond appropriately. This ability may rely, at least in part, on neural responses similar to those associated with our own emotions. We hypothesized that the insula, a cortical region near the junction of the temporal, parietal, and frontal lobes, may play a key role in this process. We recorded local field potential (LFP) activity in human neurosurgical patients performing two tasks, one focused on identifying their own emotional response and one on identifying facial emotional responses in others. We found matching patterns of gamma- and high-gamma band activity for the two tasks in the insula. Three other regions (MTL, ACC, and OFC) clearly encoded both self- and other-emotions, but used orthogonal activity patterns to do so. These results support the hypothesis that the insula plays a particularly important role in mediating between experienced vs. observed emotions.

Using games to understand the mind.

Board, card or video games have been played by virtually every individual in the world. Games are popular because they are intuitive and fun. These distinctive qualities of games also make them ideal for studying the mind. By being intuitive, games provide a unique vantage point for understanding the inductive biases that support behaviour in more complex, ecological settings than traditional laboratory experiments. By being fun, games allow researchers to study new questions in cognition such as the meaning of 'play' and intrinsic motivation, while also supporting more extensive and diverse data collection by attracting many more participants. We describe the advantages and drawbacks of using games relative to standard laboratory-based experiments and lay out a set of recommendations on how to gain the most from using games to study cognition. We hope this Perspective will lead to a wider use of games as experimental paradigms, elevating the ecological validity, scale and robustness of research on the mind.

Expected reward modulates encoding-related theta activity before an event.

Oscillatory brain activity in the theta frequency range (4-8 Hz) before the onset of an event has been shown to affect the likelihood of successfully encoding the event into memory. Recent work has also indicated that frontal theta activity might be modulated by reward, but it is not clear how reward expectancy, anticipatory theta activity, and memory formation might be related. Here, we used scalp electroencephalography (EEG) to assess the relationship between these factors. EEG was recorded from healthy adults while they memorized a series of words. Each word was preceded by a cue that indicated whether a high or low monetary reward would be earned if the word was successfully remembered in a later recognition test. Frontal theta power between the presentation of the reward cue and the onset of a word was predictive of later memory for the word, but only in the high reward condition. No theta differences were observed before word onset following low reward cues. The magnitude of prestimulus encoding-related theta activity in the high reward condition was correlated with the number of high reward words that were later confidently recognized. These findings provide strong evidence for a link between reward expectancy, theta activity, and memory encoding. Theta activity before event onset seems to be especially important for the encoding of motivationally significant stimuli. One possibility is that dopaminergic activity during reward anticipation mediates frontal theta activity related to memory.

A comparative study of human and rat hippocampal low-frequency oscillations during spatial navigation.

Rhythmic oscillations within the 3-12 Hz theta frequency band manifest in the rodent hippocampus during a variety of behaviors and are particularly well characterized during spatial navigation. In contrast, previous studies of rhythmic hippocampal activity in primates under comparable behavioral conditions suggest it may be less apparent and possibly less prevalent, or even absent, compared with the rodent. We compared the relative presence of low-frequency oscillations in rats and humans during spatial navigation by using an oscillation detection algorithm ("P-episode" or "BOSC") to better characterize their presence in microelectrode local field potential (LFP) recordings. This method quantifies the proportion of time the LFP exceeds both a power and cycle duration threshold at each frequency, characterizing the presence of (1) oscillatory activity compared with background noise, (2) the peak frequency of oscillatory activity, and (3) the duration of oscillatory activity. Results demonstrate that both humans and rodents have hippocampal rhythmic fluctuations lasting, on average, 2.75 and 4.3 cycles, respectively. Analyses further suggest that human hippocampal rhythmicity is centered around ∼3 Hz while that of rats is centered around ∼8 Hz. These results establish that low-frequency rhythms relevant to spatial navigation are present in both the rodent and human hippocampus, albeit with different properties under the behavioral conditions tested.

Brain mechanisms underlying the emotion processing bias in treatment-resistant depression.

Depression is associated with a cognitive bias towards negative information and away from positive information. This biased emotion processing may underlie core depression symptoms, including persistent feelings of sadness or low mood and a reduced capacity to experience pleasure. The neural mechanisms responsible for this biased emotion processing remain unknown. Here, we had a unique opportunity to record stereotactic electroencephalography (sEEG) signals in the amygdala and prefrontal cortex (PFC) from 5 treatment-resistant depression (TRD) patients and 12 epilepsy patients (as control) while they participated in an affective bias task in which happy and sad faces were rated. First, compared with the control group, patients with TRD showed increased amygdala responses to sad faces in the early stage (around 300 ms) and decreased amygdala responses to happy faces in the late stage (around 600 ms) following the onset of faces. Further, during the late stage of happy face processing, alpha-band activity in PFC as well as alpha-phase locking between the amygdala and PFC were significantly greater in TRD patients compared to the controls. Second, after deep brain stimulation (DBS) delivered to bilateral subcallosal cingulate (SCC) and ventral capsule/ventral striatum (VC/VS), atypical amygdala and PFC processing of happy faces in TRD patients remitted toward the normative pattern. The increased amygdala activation during the early stage of sad face processing suggests an overactive bottom-up processing system in TRD. Meanwhile, the reduced amygdala response during the late stage of happy face processing could be attributed to inhibition by PFC through alpha-band oscillation, which can be released by DBS in SCC and VC/VS.

A biophysically constrained brain connectivity model based on stimulation-evoked potentials.

Background: Single-pulse electrical stimulation (SPES) is an established technique used to map functional effective connectivity networks in treatment-refractory epilepsy patients undergoing intracranial-electroencephalography monitoring. While the connectivity path between stimulation and recording sites has been explored through the integration of structural connectivity, there are substantial gaps, such that new modeling approaches may advance our understanding of connectivity derived from SPES studies. New Method: Using intracranial electrophysiology data recorded from a single patient undergoing sEEG evaluation, we employ an automated detection method to identify early response components, C1, from pulse-evoked potentials (PEPs) induced by SPES. C1 components were utilized for a novel topology optimization method, modeling 3D conductivity propagation from stimulation sites. Additionally, PEP features were compared with tractography metrics, and model results were analyzed with respect to anatomical features. Results: The proposed optimization model resolved conductivity paths with low error. Specific electrode contacts displaying high error correlated with anatomical complexities. The C1 component strongly correlates with additional PEP features and displayed stable, weak correlations with tractography measures. Comparison with existing methods: Existing methods for estimating conductivity propagation are imaging-based and thus rely on anatomical inferences. Conclusions: These results demonstrate that informing topology optimization methods with human intracranial SPES data is a feasible method for generating 3D conductivity maps linking electrical pathways with functional neural ensembles. PEP-estimated effective connectivity is correlated with but distinguished from structural connectivity. Modeled conductivity resolves connectivity pathways in the absence of anatomical priors.

Stereo-EEG-guided network modulation for psychiatric disorders: Surgical considerations.

BACKGROUND: Deep brain stimulation (DBS) and other neuromodulatory techniques are being increasingly utilized to treat refractory neurologic and psychiatric disorders. OBJECTIVE: /Hypothesis: To better understand the circuit-level pathophysiology of treatment-resistant depression (TRD) and treat the network-level dysfunction inherent to this challenging disorder, we adopted an approach of inpatient intracranial monitoring borrowed from the epilepsy surgery field. METHODS: We implanted 3 patients with 4 DBS leads (bilateral pair in both the ventral capsule/ventral striatum and subcallosal cingulate) and 10 stereo-electroencephalography (sEEG) electrodes targeting depression-relevant network regions. For surgical planning, we used an interactive, holographic visualization platform to appreciate the 3D anatomy and connectivity. In the initial surgery, we placed the DBS leads and sEEG electrodes using robotic stereotaxy. Subjects were then admitted to an inpatient monitoring unit for depression-specific neurophysiological assessments. Following these investigations, subjects returned to the OR to remove the sEEG electrodes and internalize the DBS leads to implanted pulse generators. RESULTS: Intraoperative testing revealed positive valence responses in all 3 subjects that helped verify targeting. Given the importance of the network-based hypotheses we were testing, we required accurate adherence to the surgical plan (to engage DBS and sEEG targets) and stability of DBS lead rotational position (to ensure that stimulation field estimates of the directional leads used during inpatient monitoring were relevant chronically), both of which we confirmed (mean radial error 1.2±0.9 mm; mean rotation 3.6±2.6°). CONCLUSION: This novel hybrid sEEG-DBS approach allows detailed study of the neurophysiological substrates of complex neuropsychiatric disorders.

Behavioral correlates of human hippocampal delta and theta oscillations during navigation.

Previous rodent studies demonstrate movement-related increases in theta oscillations, and recent evidence suggests that multiple navigationally relevant variables are reflected in this activity. Human invasive recordings have revealed movement-related modulations in delta and theta activity, although it is unclear whether additional behavioral variables are responsible for modulating this neural activity during navigation. We tested the role of delta and theta oscillations during navigation by addressing whether spatial-related processing, in addition to speed and task variables, modulates delta and theta activity. Recording from 317 hippocampal intracranial electrodes in 10 patients undergoing seizure monitoring, we observed increasing delta and theta power with increasing virtual speed at significantly more electrodes than would be expected by chance, replicating previous findings in nonhuman mammals. Delta and theta power were more consistently modulated, however, as a function of spatial view, including when subjects looked at stores in the virtual environment both to find a relevant goal or for spatial updating. A significantly larger proportion of electrodes showed view-related effects than speed-related modulations. Although speed, task, and spatial view affected delta and theta activity, individual electrodes were most frequently modulated by only one variable, rather than a combination of variables. These electrodes likely sampled independent delta and theta generators, which reflected movement-related and allocentric processing, respectively. These results extend previous findings in nonhuman mammals and humans, expanding our knowledge of the role of human hippocampal low-frequency oscillations in navigation.

A Platform for Cognitive Monitoring of Neurosurgical Patients During Hospitalization.

Intracranial recordings in epilepsy patients are increasingly utilized to gain insight into the electrophysiological mechanisms of human cognition. There are currently several practical limitations to conducting research with these patients, including patient and researcher availability and the cognitive abilities of patients, which limit the amount of task-related data that can be collected. Prior studies have synchronized clinical audio, video, and neural recordings to understand naturalistic behaviors, but these recordings are centered on the patient to understand their seizure semiology and thus do not capture and synchronize audiovisual stimuli experienced by patients. Here, we describe a platform for cognitive monitoring of neurosurgical patients during their hospitalization that benefits both patients and researchers. We provide the full specifications for this system and describe some example use cases in perception, memory, and sleep research. We provide results obtained from a patient passively watching TV as proof-of-principle for the naturalistic study of cognition. Our system opens up new avenues to collect more data per patient using real-world behaviors, affording new possibilities to conduct longitudinal studies of the electrophysiological basis of human cognition under naturalistic conditions.