Functional ultrasound neuroimaging reveals mesoscopic organization of saccades in the lateral intraparietal area of posterior parietal cortex.

The lateral intraparietal cortex (LIP) located within the posterior parietal cortex (PPC) is an important area for the transformation of spatial information into accurate saccadic eye movements. Despite extensive research, we do not fully understand the functional anatomy of intended movement directions within LIP. This is in part due to technical challenges. Electrophysiology recordings can only record from small regions of the PPC, while fMRI and other whole-brain techniques lack sufficient spatiotemporal resolution. Here, we use functional ultrasound imaging (fUSI), an emerging technique with high sensitivity, large spatial coverage, and good spatial resolution, to determine how movement direction is encoded across PPC. We used fUSI to record local changes in cerebral blood volume in PPC as two monkeys performed memory-guided saccades to targets throughout their visual field. We then analyzed the distribution of preferred directional response fields within each coronal plane of PPC. Many subregions within LIP demonstrated strong directional tuning that was consistent across several months to years. These mesoscopic maps revealed a highly heterogenous organization within LIP with many small patches of neighboring cortex encoding different directions. LIP had a rough topography where anterior LIP represented more contralateral upward movements and posterior LIP represented more contralateral downward movements. These results address two fundamental gaps in our understanding of LIP's functional organization: the neighborhood organization of patches and the broader organization across LIP. These findings were achieved by tracking the same LIP populations across many months to years and developing mesoscopic maps of direction specificity previously unattainable with fMRI or electrophysiology methods.

Functional ultrasound imaging of human brain activity through an acoustically transparent cranial window.

Visualization of human brain activity is crucial for understanding normal and aberrant brain function. Currently available neural activity recording methods are highly invasive, have low sensitivity, and cannot be conducted outside of an operating room. Functional ultrasound imaging (fUSI) is an emerging technique that offers sensitive, large-scale, high-resolution neural imaging; however, fUSI cannot be performed through the adult human skull. Here, we used a polymeric skull replacement material to create an acoustic window compatible with fUSI to monitor adult human brain activity in a single individual. Using an in vitro cerebrovascular phantom to mimic brain vasculature and an in vivo rodent cranial defect model, first, we evaluated the fUSI signal intensity and signal-to-noise ratio through polymethyl methacrylate (PMMA) cranial implants of different thicknesses or a titanium mesh implant. We found that rat brain neural activity could be recorded with high sensitivity through a PMMA implant using a dedicated fUSI pulse sequence. We then designed a custom ultrasound-transparent cranial window implant for an adult patient undergoing reconstructive skull surgery after traumatic brain injury. We showed that fUSI could record brain activity in an awake human outside of the operating room. In a video game "connect the dots" task, we demonstrated mapping and decoding of task-modulated cortical activity in this individual. In a guitar-strumming task, we mapped additional task-specific cortical responses. Our proof-of-principle study shows that fUSI can be used as a high-resolution (200 µm) functional imaging modality for measuring adult human brain activity through an acoustically transparent cranial window.

Representation of internal speech by single neurons in human supramarginal gyrus.

Speech brain-machine interfaces (BMIs) translate brain signals into words or audio outputs, enabling communication for people having lost their speech abilities due to diseases or injury. While important advances in vocalized, attempted and mimed speech decoding have been achieved, results for internal speech decoding are sparse and have yet to achieve high functionality. Notably, it is still unclear from which brain areas internal speech can be decoded. Here two participants with tetraplegia with implanted microelectrode arrays located in the supramarginal gyrus (SMG) and primary somatosensory cortex (S1) performed internal and vocalized speech of six words and two pseudowords. In both participants, we found significant neural representation of internal and vocalized speech, at the single neuron and population level in the SMG. From recorded population activity in the SMG, the internally spoken and vocalized words were significantly decodable. In an offline analysis, we achieved average decoding accuracies of 55% and 24% for each participant, respectively (chance level 12.5%), and during an online internal speech BMI task, we averaged 79% and 23% accuracy, respectively. Evidence of shared neural representations between internal speech, word reading and vocalized speech processes was found in participant 1. SMG represented words as well as pseudowords, providing evidence for phonetic encoding. Furthermore, our decoder achieved high classification with multiple internal speech strategies (auditory imagination/visual imagination). Activity in S1 was modulated by vocalized but not internal speech in both participants, suggesting no articulator movements of the vocal tract occurred during internal speech production. This work represents a proof-of-concept for a high-performance internal speech BMI.

Visual context affects the perceived timing of tactile sensations elicited through intra-cortical microstimulation.

Intra-cortical microstimulation (ICMS) is a technique to provide tactile sensations for a somatosensory brain-machine interface (BMI). A viable BMI must function within the rich, multisensory environment of the real world, but how ICMS is integrated with other sensory modalities is poorly understood. To investigate how ICMS percepts are integrated with visual information, ICMS and visual stimuli were delivered at varying times relative to one another. Both visual context and ICMS current amplitude were found to bias the qualitative experience of ICMS. In two tetraplegic participants, ICMS and visual stimuli were more likely to be experienced as occurring simultaneously when visual stimuli were more realistic, demonstrating an effect of visual context on the temporal binding window. The peak of the temporal binding window varied but was consistently offset from zero, suggesting that multisensory integration with ICMS can suffer from temporal misalignment. Recordings from primary somatosensory cortex (S1) during catch trials where visual stimuli were delivered without ICMS demonstrated that S1 represents visual information related to ICMS across visual contexts.

Geometry and electronic structure of Yb(III)[CH(SiMe3)2]3 from EPR and solid-state NMR augmented by computations.

Characterization of paramagnetic compounds, in particular regarding the detailed conformation and electronic structure, remains a challenge, and - still today it often relies solely on the use of X-ray crystallography, thus limiting the access to electronic structure information. This is particularly true for lanthanide elements that are often associated with peculiar structural and electronic features in relation to their partially filled f-shell. Here, we develop a methodology based on the combined use of state-of-the-art magnetic resonance spectroscopies (EPR and solid-state NMR) and computational approaches as well as magnetic susceptibility measurements to determine the electronic structure and geometry of a paramagnetic Yb(III) alkyl complex, Yb(III)[CH(SiMe3)2]3, a prototypical example, which contains notable structural features according to X-ray crystallography. Each of these techniques revealed specific information about the geometry and electronic structure of the complex. Taken together, both EPR and NMR, augmented by quantum chemical calculations, provide a detailed and complementary understanding of such paramagnetic compounds. In particular, the EPR and NMR signatures point to the presence of three-centre-two-electron Yb-γ-Me-ß-Si secondary metal-ligand interactions in this otherwise tri-coordinate metal complex, similarly to its diamagnetic Lu analogues. The electronic structure of Yb(III) can be described as a single 4f13 configuration, while an unusually large crystal-field splitting results in a thermally isolated ground Kramers doublet. Furthermore, the computational data indicate that the Yb-carbon bond contains some π-character, reminiscent of the so-called α-H agostic interaction.

Decoding motor plans using a closed-loop ultrasonic brain-machine interface.

Brain-machine interfaces (BMIs) enable people living with chronic paralysis to control computers, robots and more with nothing but thought. Existing BMIs have trade-offs across invasiveness, performance, spatial coverage and spatiotemporal resolution. Functional ultrasound (fUS) neuroimaging is an emerging technology that balances these attributes and may complement existing BMI recording technologies. In this study, we use fUS to demonstrate a successful implementation of a closed-loop ultrasonic BMI. We streamed fUS data from the posterior parietal cortex of two rhesus macaque monkeys while they performed eye and hand movements. After training, the monkeys controlled up to eight movement directions using the BMI. We also developed a method for pretraining the BMI using data from previous sessions. This enabled immediate control on subsequent days, even those that occurred months apart, without requiring extensive recalibration. These findings establish the feasibility of ultrasonic BMIs, paving the way for a new class of less-invasive (epidural) interfaces that generalize across extended time periods and promise to restore function to people with neurological impairments.

Suppression of cortical electrostimulation artifacts using pre-whitening and null projection.

Objective.Invasive brain-computer interfaces (BCIs) have shown promise in restoring motor function to those paralyzed by neurological injuries. These systems also have the ability to restore sensation via cortical electrostimulation. Cortical stimulation produces strong artifacts that can obscure neural signals or saturate recording amplifiers. While front-end hardware techniques can alleviate this problem, residual artifacts generally persist and must be suppressed by back-end methods.Approach.We have developed a technique based on pre-whitening and null projection (PWNP) and tested its ability to suppress stimulation artifacts in electroencephalogram (EEG), electrocorticogram (ECoG) and microelectrode array (MEA) signals from five human subjects.Main results.In EEG signals contaminated by narrow-band stimulation artifacts, the PWNP method achieved average artifact suppression between 32 and 34 dB, as measured by an increase in signal-to-interference ratio. In ECoG and MEA signals contaminated by broadband stimulation artifacts, our method suppressed artifacts by 78%-80% and 85%, respectively, as measured by a reduction in interference index. When compared to independent component analysis, which is considered the state-of-the-art technique for artifact suppression, our method achieved superior results, while being significantly easier to implement.Significance.PWNP can potentially act as an efficient method of artifact suppression to enable simultaneous stimulation and recording in bi-directional BCIs to biomimetically restore motor function.

A window to the brain: ultrasound imaging of human neural activity through a permanent acoustic window.

Recording human brain activity is crucial for understanding normal and aberrant brain function. However, available recording methods are either highly invasive or have relatively low sensitivity. Functional ultrasound imaging (fUSI) is an emerging technique that offers sensitive, large-scale, high-resolution neural imaging. However, fUSI cannot be performed through adult human skull. Here, we use a polymeric skull replacement material to create an acoustic window allowing ultrasound to monitor brain activity in fully intact adult humans. We design the window through experiments in phantoms and rodents, then implement it in a participant undergoing reconstructive skull surgery. Subsequently, we demonstrate fully non-invasive mapping and decoding of cortical responses to finger movement, marking the first instance of high-resolution (200 µm) and large-scale (50 mmx38 mm) brain imaging through a permanent acoustic window.

Decoding and geometry of ten finger movements in human posterior parietal cortex and motor cortex.

Objective. Enable neural control of individual prosthetic fingers for participants with upper-limb paralysis.Approach. Two tetraplegic participants were each implanted with a 96-channel array in the left posterior parietal cortex (PPC). One of the participants was additionally implanted with a 96-channel array near the hand knob of the left motor cortex (MC). Across tens of sessions, we recorded neural activity while the participants attempted to move individual fingers of the right hand. Offline, we classified attempted finger movements from neural firing rates using linear discriminant analysis with cross-validation. The participants then used the neural classifier online to control individual fingers of a brain-machine interface (BMI). Finally, we characterized the neural representational geometry during individual finger movements of both hands.Main Results. The two participants achieved 86% and 92% online accuracy during BMI control of the contralateral fingers (chance = 17%). Offline, a linear decoder achieved ten-finger decoding accuracies of 70% and 66% using respective PPC recordings and 75% using MC recordings (chance = 10%). In MC and in one PPC array, a factorized code linked corresponding finger movements of the contralateral and ipsilateral hands.Significance. This is the first study to decode both contralateral and ipsilateral finger movements from PPC. Online BMI control of contralateral fingers exceeded that of previous finger BMIs. PPC and MC signals can be used to control individual prosthetic fingers, which may contribute to a hand restoration strategy for people with tetraplegia.

S1 represents multisensory contexts and somatotopic locations within and outside the bounds of the cortical homunculus.

Recent literature suggests that tactile events are represented in the primary somatosensory cortex (S1) beyond its long-established topography; in addition, the extent to which S1 is modulated by vision remains unclear. To better characterize S1, human electrophysiological data were recorded during touches to the forearm or finger. Conditions included visually observed physical touches, physical touches without vision, and visual touches without physical contact. Two major findings emerge from this dataset. First, vision strongly modulates S1 area 1, but only if there is a physical element to the touch, suggesting that passive touch observation is insufficient to elicit neural responses. Second, despite recording in a putative arm area of S1, neural activity represents both arm and finger stimuli during physical touches. Arm touches are encoded more strongly and specifically, supporting the idea that S1 encodes tactile events primarily through its topographic organization but also more generally, encompassing other areas of the body.

Stability of motor representations after paralysis.

Neural plasticity allows us to learn skills and incorporate new experiences. What happens when our lived experiences fundamentally change, such as after a severe injury? To address this question, we analyzed intracortical population activity in the posterior parietal cortex (PPC) of a tetraplegic adult as she controlled a virtual hand through a brain-computer interface (BCI). By attempting to move her fingers, she could accurately drive the corresponding virtual fingers. Neural activity during finger movements exhibited robust representational structure similar to fMRI recordings of able-bodied individuals' motor cortex, which is known to reflect able-bodied usage patterns. The finger representational structure was consistent throughout multiple sessions, even though the structure contributed to BCI decoding errors. Within individual BCI movements, the representational structure was dynamic, first resembling muscle activation patterns and then resembling the anticipated sensory consequences. Our results reveal that motor representations in PPC reflect able-bodied motor usage patterns even after paralysis, and BCIs can re-engage these stable representations to restore lost motor functions.

Preserved cortical somatotopic and motor representations in tetraplegic humans.

A rich literature has documented changes in cortical representations of the body in somatosensory and motor cortex. Recent clinical studies of brain-machine interfaces designed to assist paralyzed patients have afforded the opportunity to record from and stimulate human somatosensory, motor, and action-related areas of the posterior parietal cortex. These studies show considerable preserved structure in the cortical somato-motor system. Motor cortex can immediately control assistive devices, stimulation of somatosensory cortex produces sensations in an orderly somatotopic map, and the posterior parietal cortex shows a high-dimensional representation of cognitive action variables. These results are strikingly similar to what would be expected in a healthy subject, demonstrating considerable stability of adult cortex even after severe injury and despite potential plasticity-induced new activations within the same region of cortex. Clinically, these results emphasize the importance of targeting cortical areas for BMI control signals that are consistent with their normal functional role.

Decoding grasp and speech signals from the cortical grasp circuit in a tetraplegic human.

The cortical grasp network encodes planning and execution of grasps and processes spoken and written aspects of language. High-level cortical areas within this network are attractive implant sites for brain-machine interfaces (BMIs). While a tetraplegic patient performed grasp motor imagery and vocalized speech, neural activity was recorded from the supramarginal gyrus (SMG), ventral premotor cortex (PMv), and somatosensory cortex (S1). In SMG and PMv, five imagined grasps were well represented by firing rates of neuronal populations during visual cue presentation. During motor imagery, these grasps were significantly decodable from all brain areas. During speech production, SMG encoded both spoken grasp types and the names of five colors. Whereas PMv neurons significantly modulated their activity during grasping, SMG's neural population broadly encoded features of both motor imagery and speech. Together, these results indicate that brain signals from high-level areas of the human cortex could be used for grasping and speech BMI applications.

Implicit mechanisms of intention.

High-level cortical regions encode motor decisions before or even absent awareness, suggesting that neural processes predetermine behavior before conscious choice. Such early neural encoding challenges popular conceptions of human agency. It also raises fundamental questions for brain-machine interfaces (BMIs) that traditionally assume that neural activity reflects the user's conscious intentions. Here, we study the timing of human posterior parietal cortex single-neuron activity recorded from implanted microelectrode arrays relative to the explicit urge to initiate movement. Participants were free to choose when to move, whether to move, and what to move, and they retrospectively reported the time they felt the urge to move. We replicate prior studies by showing that posterior parietal cortex (PPC) neural activity sharply rises hundreds of milliseconds before the reported urge. However, we find that this "preconscious" activity is part of a dynamic neural population response that initiates much earlier, when the participant first chooses to perform the task. Together with details of neural timing, our results suggest that PPC encodes an internal model of the motor planning network that transforms high-level task objectives into appropriate motor behavior. These new data challenge traditional interpretations of early neural activity and offer a more holistic perspective on the interplay between choice, behavior, and their neural underpinnings. Our results have important implications for translating BMIs into more complex real-world environments. We find that early neural dynamics are sufficient to drive BMI movements before the participant intends to initiate movement. Appropriate algorithms ensure that BMI movements align with the subject's awareness of choice.

Exploring Cognition with Brain-Machine Interfaces.

Traditional brain-machine interfaces decode cortical motor commands to control external devices. These commands are the product of higher-level cognitive processes, occurring across a network of brain areas, that integrate sensory information, plan upcoming motor actions, and monitor ongoing movements. We review cognitive signals recently discovered in the human posterior parietal cortex during neuroprosthetic clinical trials. These signals are consistent with small regions of cortex having a diverse role in cognitive aspects of movement control and body monitoring, including sensorimotor integration, planning, trajectory representation, somatosensation, action semantics, learning, and decision making. These variables are encoded within the same population of cells using structured representations that bind related sensory and motor variables, an architecture termed partially mixed selectivity. Diverse cognitive signals provide complementary information to traditional motor commands to enable more natural and intuitive control of external devices.

Benchtop and bedside validation of a low-cost programmable cortical stimulator in a testbed for bi-directional brain-computer-interface research.

Introduction: Bi-directional brain-computer interfaces (BD-BCI) to restore movement and sensation must achieve concurrent operation of recording and decoding of motor commands from the brain and stimulating the brain with somatosensory feedback. Methods: A custom programmable direct cortical stimulator (DCS) capable of eliciting artificial sensorimotor response was integrated into an embedded BCI system to form a safe, independent, wireless, and battery powered testbed to explore BD-BCI concepts at a low cost. The BD-BCI stimulator output was tested in phantom brain tissue by assessing its ability to deliver electrical stimulation equivalent to an FDA-approved commercial electrical cortical stimulator. Subsequently, the stimulator was tested in an epilepsy patient with subcortical electrocorticographic (ECoG) implants covering the sensorimotor cortex to assess its ability to elicit equivalent responses as the FDA-approved counterpart. Additional safety features (impedance monitoring, artifact mitigation, and passive and active charge balancing mechanisms) were also implemeneted and tested in phantom brain tissue. Finally, concurrent operation with interleaved stimulation and BCI decoding was tested in a phantom brain as a proof-of-concept operation of BD-BCI system. Results: The benchtop prototype BD-BCI stimulator's basic output features (current amplitude, pulse frequency, pulse width, train duration) were validated by demonstrating the output-equivalency to an FDA-approved commercial cortical electrical stimulator (R 2 > 0.99). Charge-neutral stimulation was demonstrated with pulse-width modulation-based correction algorithm preventing steady state voltage deviation. Artifact mitigation achieved a 64.5% peak voltage reduction. Highly accurate impedance monitoring was achieved with R 2 > 0.99 between measured and actual impedance, which in-turn enabled accurate charge density monitoring. An online BCI decoding accuracy of 93.2% between instructional cues and decoded states was achieved while delivering interleaved stimulation. The brain stimulation mapping via ECoG grids in an epilepsy patient showed that the two stimulators elicit equivalent responses. Significance: This study demonstrates clinical validation of a fully-programmable electrical stimulator, integrated into an embedded BCI system. This low-cost BD-BCI system is safe and readily applicable as a testbed for BD-BCI research. In particular, it provides an all-inclusive hardware platform that approximates the limitations in a near-future implantable BD-BCI. This successful benchtop/human validation of the programmable electrical stimulator in a BD-BCI system is a critical milestone toward fully-implantable BD-BCI systems.

Neuropathological effects of chronically implanted, intracortical microelectrodes in a tetraplegic patient.

Objective.Intracortical microelectrode arrays (MEA) can be used as part of a brain-machine interface system to provide sensory feedback control of an artificial limb to assist persons with tetraplegia. Variability in functionality of electrodes has been reported but few studies in humans have examined the impact of chronic brain tissue responses revealed postmortem on electrode performancein vivo. Approach.In a tetraplegic man, recording MEAs were implanted into the anterior intraparietal area and Brodmann's area 5 (BA5) of the posterior parietal cortex and a recording and stimulation array was implanted in BA1 of the primary somatosensory cortex (S1). The participant expired from unrelated causes seven months after MEA implantation. The underlying tissue of two of the three devices was processed for histology and electrophysiological recordings were assessed.Main results.Recordings of neuronal activity were obtained from all three MEAs despite meningeal encapsulation. However, the S1 array had a greater encapsulation, yielded lower signal quality than the other arrays and failed to elicit somatosensory percepts with electrical stimulation. Histological examination of tissues underlying S1 and BA5 implant sites revealed localized leptomeningeal proliferation and fibrosis, lymphocytic infiltrates, astrogliosis, and foreign body reaction around the electrodes. The BA5 recording site showed focal cerebral microhemorrhages and leptomeningeal vascular ectasia. The S1 site showed focal tissue damage including vascular recanalization, neuronal loss, and extensive subcortical white matter necrosis. The tissue response at the S1 site included hemorrhagic-induced injury suggesting a likely mechanism for reduced function of the S1 implant.Significance.Our findings are similar to those from animal studies with chronic intracortical implants and suggest that vascular disruption and microhemorrhage during device implantation are important contributors to overall array and individual electrode performance and should be a topic for future device development to mitigate tissue responses. Neurosurgical considerations are also discussed.

Single-trial decoding of movement intentions using functional ultrasound neuroimaging.

New technologies are key to understanding the dynamic activity of neural circuits and systems in the brain. Here, we show that a minimally invasive approach based on ultrasound can be used to detect the neural correlates of movement planning, including directions and effectors. While non-human primates (NHPs) performed memory-guided movements, we used functional ultrasound (fUS) neuroimaging to record changes in cerebral blood volume with 100 µm resolution. We recorded from outside the dura above the posterior parietal cortex, a brain area important for spatial perception, multisensory integration, and movement planning. We then used fUS signals from the delay period before movement to decode the animals' intended direction and effector. Single-trial decoding is a prerequisite to brain-machine interfaces, a key application that could benefit from this technology. These results are a critical step in the development of neuro-recording and brain interface tools that are less invasive, high resolution, and scalable.

Neural encoding of actual and imagined touch within human posterior parietal cortex.

In the human posterior parietal cortex (PPC), single units encode high-dimensional information with partially mixed representations that enable small populations of neurons to encode many variables relevant to movement planning, execution, cognition, and perception. Here, we test whether a PPC neuronal population previously demonstrated to encode visual and motor information is similarly engaged in the somatosensory domain. We recorded neurons within the PPC of a human clinical trial participant during actual touch presentation and during a tactile imagery task. Neurons encoded actual touch at short latency with bilateral receptive fields, organized by body part, and covered all tested regions. The tactile imagery task evoked body part-specific responses that shared a neural substrate with actual touch. Our results are the first neuron-level evidence of touch encoding in human PPC and its cognitive engagement during a tactile imagery task, which may reflect semantic processing, attention, sensory anticipation, or imagined touch.

The Neurophysiological Representation of Imagined Somatosensory Percepts in Human Cortex.

Intracortical microstimulation (ICMS) in human primary somatosensory cortex (S1) has been used to successfully evoke naturalistic sensations. However, the neurophysiological mechanisms underlying the evoked sensations remain unknown. To understand how specific stimulation parameters elicit certain sensations we must first understand the representation of those sensations in the brain. In this study we record from intracortical microelectrode arrays implanted in S1, premotor cortex, and posterior parietal cortex of a male human participant performing a somatosensory imagery task. The sensations imagined were those previously elicited by ICMS of S1, in the same array of the same participant. In both spike and local field potential recordings, features of the neural signal can be used to classify different imagined sensations. These features are shown to be stable over time. The sensorimotor cortices only encode the imagined sensation during the imagery task, while posterior parietal cortex encodes the sensations starting with cue presentation. These findings demonstrate that different aspects of the sensory experience can be individually decoded from intracortically recorded human neural signals across the cortical sensory network. Activity underlying these unique sensory representations may inform the stimulation parameters for precisely eliciting specific sensations via ICMS in future work.SIGNIFICANCE STATEMENT Electrical stimulation of human cortex is increasingly more common for providing feedback in neural devices. Understanding the relationship between naturally evoked and artificially evoked neurophysiology for the same sensations will be important in advancing such devices. Here, we investigate the neural activity in human primary somatosensory, premotor, and parietal cortices during somatosensory imagery. The sensations imagined were those previously elicited during intracortical microstimulation (ICMS) of the same somatosensory electrode array. We elucidate the neural features during somatosensory imagery that significantly encode different aspects of individual sensations and demonstrate feature stability over almost a year. The correspondence between neurophysiology elicited with or without stimulation for the same sensations will inform methods to deliver more precise feedback through stimulation in the future.