Nanoporous graphene-based thin-film microelectrodes for in vivo high-resolution neural recording and stimulation.

One of the critical factors determining the performance of neural interfaces is the electrode material used to establish electrical communication with the neural tissue, which needs to meet strict electrical, electrochemical, mechanical, biological and microfabrication compatibility requirements. This work presents a nanoporous graphene-based thin-film technology and its engineering to form flexible neural interfaces. The developed technology allows the fabrication of small microelectrodes (25 µm diameter) while achieving low impedance (∼25 kΩ) and high charge injection (3-5 mC cm-2). In vivo brain recording performance assessed in rodents reveals high-fidelity recordings (signal-to-noise ratio >10 dB for local field potentials), while stimulation performance assessed with an intrafascicular implant demonstrates low current thresholds (<100 µA) and high selectivity (>0.8) for activating subsets of axons within the rat sciatic nerve innervating tibialis anterior and plantar interosseous muscles. Furthermore, the tissue biocompatibility of the devices was validated by chronic epicortical (12 week) and intraneural (8 week) implantation. This work describes a graphene-based thin-film microelectrode technology and demonstrates its potential for high-precision and high-resolution neural interfacing.

Overt speech decoding from cortical activity: a comparison of different linear methods.

Introduction: Speech BCIs aim at reconstructing speech in real time from ongoing cortical activity. Ideal BCIs would need to reconstruct speech audio signal frame by frame on a millisecond-timescale. Such approaches require fast computation. In this respect, linear decoder are good candidates and have been widely used in motor BCIs. Yet, they have been very seldomly studied for speech reconstruction, and never for reconstruction of articulatory movements from intracranial activity. Here, we compared vanilla linear regression, ridge-regularized linear regressions, and partial least squares regressions for offline decoding of overt speech from cortical activity. Methods: Two decoding paradigms were investigated: (1) direct decoding of acoustic vocoder features of speech, and (2) indirect decoding of vocoder features through an intermediate articulatory representation chained with a real-time-compatible DNN-based articulatory-to-acoustic synthesizer. Participant's articulatory trajectories were estimated from an electromagnetic-articulography dataset using dynamic time warping. The accuracy of the decoders was evaluated by computing correlations between original and reconstructed features. Results: We found that similar performance was achieved by all linear methods well above chance levels, albeit without reaching intelligibility. Direct and indirect methods achieved comparable performance, with an advantage for direct decoding. Discussion: Future work will address the development of an improved neural speech decoder compatible with fast frame-by-frame speech reconstruction from ongoing activity at a millisecond timescale.

A hybrid autoencoder framework of dimensionality reduction for brain-computer interface decoding.

OBJECTIVE: As the scale of neural recording increases, Brain-computer interfaces (BCIs) are restrained by high-dimensional neural features, so dimensionality reduction is required as a preprocess of neural features. In this context, we propose a novel framework based on deep learning to reduce the dimensionality of neural features that are typically extracted from electrocorticography (ECoG) or local field potential (LFP). APPROACH: A high-performance autoencoder was implemented by chaining convolutional layers to deal with spatial and frequency dimensions with bottleneck long short-term memory (LSTM) layers to deal with the temporal dimension of the features. Furthermore, this autoencoder is combined with a fully connected layer to regularize the training. MAIN RESULTS: By applying the proposed method to two different datasets, we found that this dimensionality reduction method largely outperforms kernel principal component analysis (KPCA), partial least square (PLS), preferential subspace identification (PSID), and latent factor analysis via dynamical systems (LFADS). Besides, the new features obtained by our method can be applied to various BCI decoders, without significant differences in decoding performance. SIGNIFICANCE: A novel method is proposed as a reliable tool for efficient dimensionality reduction of neural signals. Its high performance and robustness are promising to enhance the decoding accuracy and long-term stability of online BCI systems based on large-scale neural recordings.

Chronic recording of cortical activity underlying vocalization in awake minipigs.

BACKGROUND: Investigating brain dynamics underlying vocal production in animals is a powerful way to inform on the neural bases of human speech. In particular, brain networks underlying vocal production in non-human primates show striking similarities with the human speech production network. However, despite increasing findings also in birds and more recently in rodents, the extent to which the primate vocal cortical network model generalizes to other non-primate mammals remains unclear. Especially, no domestic species has yet been proposed to investigate vocal brain activity using electrophysiological approaches. NEW METHOD: In the present study, we introduce a novel experimental paradigm to identify the cortical dynamics underlying vocal production in behaving minipigs. A key problem to chronically implant cortical probes in pigs is the presence and growth of frontal sinuses extending caudally to the parietal bone and preventing safe access to neural structures with conventional craniotomy in adult animals. RESULTS: Here we first show that implantations of soft ECoG grids can be done safely using conventional craniotomy in minipigs younger than 5 months, a period when sinuses are not yet well developed. Using wireless recordings in behaving animals, we further show activation of the motor and premotor cortex around the onset of vocal production of grunts, the most common vocalization of pigs. CONCLUSION: These results suggest that minipigs, which are very loquacious and social animals, can be a good experimental large animal model to study the cortical bases of vocal production.

Dimensionality Reduction of Local Field Potential Features with Convolution Neural Network in Neural Decoding: A Pilot Study.

Local field potentials (LFPs) have better long-term stability compared with spikes in brain-machine interfaces (BMIs). Many studies have shown promising results of LFP decoding, but the high-dimensional feature of LFP still hurdle the development of the BMIs to low-cost. In this paper, we proposed a framework of a 1D convolution neural network (CNN) to reduce the dimensionality of the LFP features. For evaluating the performance of this architecture, the reduced LFP features were decoded to cursor position (Center-out task) by a Kalman filter. The Principal components analysis (PCA) was also performed as a comparison. The results showed that the CNN model could reduce the dimensionality of LFP features to a smaller size without significant performance loss. The decoding result based on the CNN features outperformed that based on the PCA features. Moreover, the reduced features by CNN also showed robustness across different sessions. These results demonstrated that the LFP features reduced by the CNN model achieved low cost without sacrificing high-performance and robustness, suggesting that this method could be used for portable BMI systems in the future.

MRI-Compatible and Conformal Electrocorticography Grids for Translational Research.

Intraoperative electrocorticography (ECoG) captures neural information from the surface of the cerebral cortex during surgeries such as resections for intractable epilepsy and tumors. Current clinical ECoG grids come in evenly spaced, millimeter-sized electrodes embedded in silicone rubber. Their mechanical rigidity and fixed electrode spatial resolution are common shortcomings reported by the surgical teams. Here, advances in soft neurotechnology are leveraged to manufacture conformable subdural, thin-film ECoG grids, and evaluate their suitability for translational research. Soft grids with 0.2 to 10 mm electrode pitch and diameter are embedded in 150 µm silicone membranes. The soft grids are compatible with surgical handling and can be folded to safely interface hidden cerebral surface such as the Sylvian fold in human cadaveric models. It is found that the thin-film conductor grids do not generate diagnostic-impeding imaging artefacts (<1 mm) nor adverse local heating within a standard 3T clinical magnetic resonance imaging scanner. Next, the ability of the soft grids to record subdural neural activity in minipigs acutely and two weeks postimplantation is validated. Taken together, these results suggest a promising future alternative to current stiff electrodes and may enable the future adoption of soft ECoG grids in translational research and ultimately in clinical settings.

Observation and assessment of acoustic contamination of electrophysiological brain signals during speech production and sound perception.

OBJECTIVE: A current challenge of neurotechnologies is to develop speech brain-computer interfaces aiming at restoring communication in people unable to speak. To achieve a proof of concept of such system, neural activity of patients implanted for clinical reasons can be recorded while they speak. Using such simultaneously recorded audio and neural data, decoders can be built to predict speech features using features extracted from brain signals. A typical neural feature is the spectral power of field potentials in the high-gamma frequency band, which happens to overlap the frequency range of speech acoustic signals, especially the fundamental frequency of the voice. Here, we analyzed human electrocorticographic and intracortical recordings during speech production and perception as well as a rat microelectrocorticographic recording during sound perception. We observed that several datasets, recorded with different recording setups, contained spectrotemporal features highly correlated with those of the sound produced by or delivered to the participants, especially within the high-gamma band and above, strongly suggesting a contamination of electrophysiological recordings by the sound signal. This study investigated the presence of acoustic contamination and its possible source. APPROACH: We developed analysis methods and a statistical criterion to objectively assess the presence or absence of contamination-specific correlations, which we used to screen several datasets from five centers worldwide. MAIN RESULTS: Not all but several datasets, recorded in a variety of conditions, showed significant evidence of acoustic contamination. Three out of five centers were concerned by the phenomenon. In a recording showing high contamination, the use of high-gamma band features dramatically facilitated the performance of linear decoding of acoustic speech features, while such improvement was very limited for another recording showing no significant contamination. Further analysis and in vitro replication suggest that the contamination is caused by the mechanical action of the sound waves onto the cables and connectors along the recording chain, transforming sound vibrations into an undesired electrical noise affecting the biopotential measurements. SIGNIFICANCE: Although this study does not per se question the presence of speech-relevant physiological information in the high-gamma range and above (multiunit activity), it alerts on the fact that acoustic contamination of neural signals should be proofed and eliminated before investigating the cortical dynamics of these processes. To this end, we make available a toolbox implementing the proposed statistical approach to quickly assess the extent of contamination in an electrophysiological recording (https://doi.org/10.5281/zenodo.3929296).

Neuroprosthetic Speech: The Ethical Significance of Accuracy, Control and Pragmatics.

Neuroprosthetic speech devices are an emerging technology that can offer the possibility of communication to those who are unable to speak. Patients with 'locked in syndrome,' aphasia, or other such pathologies can use covert speech-vividly imagining saying something without actual vocalization-to trigger neural controlled systems capable of synthesizing the speech they would have spoken, but for their impairment.We provide an analysis of the mechanisms and outputs involved in speech mediated by neuroprosthetic devices. This analysis provides a framework for accounting for the ethical significance of accuracy, control, and pragmatic dimensions of prosthesis-mediated speech. We first examine what it means for the output of the device to be accurate, drawing a distinction between technical accuracy on the one hand and semantic accuracy on the other. These are conceptual notions of accuracy.Both technical and semantic accuracy of the device will be necessary (but not yet sufficient) for the user to have sufficient control over the device. Sufficient control is an ethical consideration: we place high value on being able to express ourselves when we want and how we want. Sufficient control of a neural speech prosthesis requires that a speaker can reliably use their speech apparatus as they want to, and can expect their speech to authentically represent them. We draw a distinction between two relevant features which bear on the question of whether the user has sufficient control: voluntariness of the speech and the authenticity of the speech. These can come apart: the user might involuntarily produce an authentic output (perhaps revealing private thoughts) or might voluntarily produce an inauthentic output (e.g., when the output is not semantically accurate). Finally, we consider the role of the interlocutor in interpreting the content and purpose of the communication.These three ethical dimensions raise philosophical questions about the nature of speech, the level of control required for communicative accuracy, and the nature of 'accuracy' with respect to both natural and prosthesis-mediated speech.

Volitional control of single-electrode high gamma local field potentials by people with paralysis.

Intracortical brain-computer interfaces (BCIs) can enable individuals to control effectors, such as a computer cursor, by directly decoding the user's movement intentions from action potentials and local field potentials (LFPs) recorded within the motor cortex. However, the accuracy and complexity of effector control achieved with such "biomimetic" BCIs will depend on the degree to which the intended movements used to elicit control modulate the neural activity. In particular, channels that do not record distinguishable action potentials and only record LFP modulations may be of limited use for BCI control. In contrast, a biofeedback approach may surpass these limitations by letting the participants generate new control signals and learn strategies that improve the volitional control of signals used for effector control. Here, we show that, by using a biofeedback paradigm, three individuals with tetraplegia achieved volitional control of gamma LFPs (40-400 Hz) recorded by a single microelectrode implanted in the precentral gyrus. Control was improved over a pair of consecutive sessions up to 3 days apart. In all but one session, the channel used to achieve control lacked distinguishable action potentials. Our results indicate that biofeedback LFP-based BCIs may potentially contribute to the neural modulation necessary to obtain reliable and useful control of effectors. NEW & NOTEWORTHY Our study demonstrates that people with tetraplegia can volitionally control individual high-gamma local-field potential (LFP) channels recorded from the motor cortex, and that this control can be improved using biofeedback. Motor cortical LFP signals are thought to be both informative and stable intracortical signals and, thus, of importance for future brain-computer interfaces.

An Attention-Based Spiking Neural Network for Unsupervised Spike-Sorting.

Bio-inspired computing using artificial spiking neural networks promises performances outperforming currently available computational approaches. Yet, the number of applications of such networks remains limited due to the absence of generic training procedures for complex pattern recognition, which require the design of dedicated architectures for each situation. We developed a spike-timing-dependent plasticity (STDP) spiking neural network (SSN) to address spike-sorting, a central pattern recognition problem in neuroscience. This network is designed to process an extracellular neural signal in an online and unsupervised fashion. The signal stream is continuously fed to the network and processed through several layers to output spike trains matching the truth after a short learning period requiring only few data. The network features an attention mechanism to handle the scarcity of action potential occurrences in the signal, and a threshold adaptation mechanism to handle patterns with different sizes. This method outperforms two existing spike-sorting algorithms at low signal-to-noise ratio (SNR) and can be adapted to process several channels simultaneously in the case of tetrode recordings. Such attention-based STDP network applied to spike-sorting opens perspectives to embed neuromorphic processing of neural data in future brain implants.

Corrigendum: Spiking Neural Networks Based on OxRAM Synapses for Real-Time Unsupervised Spike Sorting.

[This corrects the article on p. 474 in vol. 10, PMID: 27857680.].

Spiking Neural Networks Based on OxRAM Synapses for Real-Time Unsupervised Spike Sorting.

In this paper, we present an alternative approach to perform spike sorting of complex brain signals based on spiking neural networks (SNN). The proposed architecture is suitable for hardware implementation by using resistive random access memory (RRAM) technology for the implementation of synapses whose low latency (<1µs) enables real-time spike sorting. This offers promising advantages to conventional spike sorting techniques for brain-computer interfaces (BCI) and neural prosthesis applications. Moreover, the ultra-low power consumption of the RRAM synapses of the spiking neural network (nW range) may enable the design of autonomous implantable devices for rehabilitation purposes. We demonstrate an original methodology to use Oxide based RRAM (OxRAM) as easy to program and low energy (<75 pJ) synapses. Synaptic weights are modulated through the application of an online learning strategy inspired by biological Spike Timing Dependent Plasticity. Real spiking data have been recorded both intra- and extracellularly from an in-vitro preparation of the Crayfish sensory-motor system and used for validation of the proposed OxRAM based SNN. This artificial SNN is able to identify, learn, recognize and distinguish between different spike shapes in the input signal with a recognition rate about 90% without any supervision.

Real-Time Control of an Articulatory-Based Speech Synthesizer for Brain Computer Interfaces.

Restoring natural speech in paralyzed and aphasic people could be achieved using a Brain-Computer Interface (BCI) controlling a speech synthesizer in real-time. To reach this goal, a prerequisite is to develop a speech synthesizer producing intelligible speech in real-time with a reasonable number of control parameters. We present here an articulatory-based speech synthesizer that can be controlled in real-time for future BCI applications. This synthesizer converts movements of the main speech articulators (tongue, jaw, velum, and lips) into intelligible speech. The articulatory-to-acoustic mapping is performed using a deep neural network (DNN) trained on electromagnetic articulography (EMA) data recorded on a reference speaker synchronously with the produced speech signal. This DNN is then used in both offline and online modes to map the position of sensors glued on different speech articulators into acoustic parameters that are further converted into an audio signal using a vocoder. In offline mode, highly intelligible speech could be obtained as assessed by perceptual evaluation performed by 12 listeners. Then, to anticipate future BCI applications, we further assessed the real-time control of the synthesizer by both the reference speaker and new speakers, in a closed-loop paradigm using EMA data recorded in real time. A short calibration period was used to compensate for differences in sensor positions and articulatory differences between new speakers and the reference speaker. We found that real-time synthesis of vowels and consonants was possible with good intelligibility. In conclusion, these results open to future speech BCI applications using such articulatory-based speech synthesizer.

Generation of Locomotor-Like Activity in the Isolated Rat Spinal Cord Using Intraspinal Electrical Microstimulation Driven by a Digital Neuromorphic CPG.

Neural prostheses based on electrical microstimulation offer promising perspectives to restore functions following lesions of the central nervous system (CNS). They require the identification of appropriate stimulation sites and the coordination of their activation to achieve the restoration of functional activity. On the long term, a challenging perspective is to control microstimulation by artificial neural networks hybridized to the living tissue. Regarding the use of this strategy to restore locomotor activity in the spinal cord, to date, there has been no proof of principle of such hybrid approach driving intraspinal microstimulation (ISMS). Here, we address a first step toward this goal in the neonatal rat spinal cord isolated ex vivo, which can display locomotor-like activity while offering an easy access to intraspinal circuitry. Microelectrode arrays were inserted in the lumbar region to determine appropriate stimulation sites to elicit elementary bursting patterns on bilateral L2/L5 ventral roots. Two intraspinal sites were identified at L1 level, one on each side of the spinal cord laterally from the midline and approximately at a median position dorso-ventrally. An artificial CPG implemented on digital integrated circuit (FPGA) was built to generate alternating activity and was hybridized to the living spinal cord to drive electrical microstimulation on these two identified sites. Using this strategy, sustained left-right and flexor-extensor alternating activity on bilateral L2/L5 ventral roots could be generated in either whole or thoracically transected spinal cords. These results are a first step toward hybrid artificial/biological solutions based on electrical microstimulation for the restoration of lost function in the injured CNS.

Key considerations in designing a speech brain-computer interface.

Restoring communication in case of aphasia is a key challenge for neurotechnologies. To this end, brain-computer strategies can be envisioned to allow artificial speech synthesis from the continuous decoding of neural signals underlying speech imagination. Such speech brain-computer interfaces do not exist yet and their design should consider three key choices that need to be made: the choice of appropriate brain regions to record neural activity from, the choice of an appropriate recording technique, and the choice of a neural decoding scheme in association with an appropriate speech synthesis method. These key considerations are discussed here in light of (1) the current understanding of the functional neuroanatomy of cortical areas underlying overt and covert speech production, (2) the available literature making use of a variety of brain recording techniques to better characterize and address the challenge of decoding cortical speech signals, and (3) the different speech synthesis approaches that can be considered depending on the level of speech representation (phonetic, acoustic or articulatory) envisioned to be decoded at the core of a speech BCI paradigm.

TRPP2 modulates ryanodine- and inositol-1,4,5-trisphosphate receptors-dependent Ca2+ signals in opposite ways in cerebral arteries.

TRPP2 is a cationic channel expressed in plasma membrane and in sarcoplasmic reticulum. In several cell lines, TRPP2 is described as a reticulum Ca(2+) leak channel but it also interacts with ryanodine and inositol 1,4,5-trisphosphate (InsP3) receptors to inhibit and increase the release of Ca(2+) stores, respectively. TRPP2 is known to be expressed in vascular smooth muscle cells, however its function in Ca(2+) signals remains poorly described in native cells, principally because the pharmacology is not developed. TRPP2 was expressed in cerebral arteries. Triptolide evoked Ca(2+) responses in a Ca(2+)-free solution as well as permeabilized arteries. This Ca(2+) signal was inhibited in presence of antisense oligonucleotide and siRNA directed against TRPP2 and antibody directed against the first loop of TRPP2. The partial inhibition of TRPP2 expression increased both the caffeine-evoked Ca(2+) responses and in vivo contraction. It also decreased the InsP3-evoked Ca(2+) responses. Finally, aging affected the regulations in which TRPP2 is engaged, whereas the triptolide-evoked Ca(2+) response was not modified. Taken together, our results have shown that TRPP2 is implicated in triptolide-induced Ca(2+) release from intracellular Ca(2+) stores. TRPP2 functionally interacts with both ryanodine and InsP3 receptors. These interactions were not similar in adult and old mice.

3D-nanostructured boron-doped diamond for microelectrode array neural interfacing.

The electrode material is a key element in the design of long-term neural implants and neuroprostheses. To date, the ideal electrode material offering high longevity, biocompatibility, low-noise recording and high stimulation capabilities remains to be found. We show that 3D-nanostructured boron doped diamond (BDD), an innovative material consisting in a chemically stable material with a high aspect ratio structure obtained by encapsulation of a carbon nanotube template within two BDD nanolayers, allows neural cell attachment, survival and neurite extension. Further, we developed arrays of 20-µm-diameter 3D-nanostructured BDD microelectrodes for neural interfacing. These microelectrodes exhibited low impedances and low intrinsic recording noise levels. In particular, they allowed the detection of low amplitude (10-20 µV) local-field potentials, single units and multiunit bursts neural activity in both acute whole embryonic hindbrain-spinal cord preparations and long-term hippocampal cell cultures. Also, cyclic voltammetry measurements showed a wide potential window of about 3 V and a charge storage capacity of 10 mC.cm(-2), showing high potentiality of this material for neural stimulation. These results demonstrate the attractiveness of 3D-nanostructured BDD as a novel material for neural interfacing, with potential applications for the design of biocompatible neural implants for the exploration and rehabilitation of the nervous system.

Current approaches to model extracellular electrical neural microstimulation.

Nowadays, high-density microelectrode arrays provide unprecedented possibilities to precisely activate spatially well-controlled central nervous system (CNS) areas. However, this requires optimizing stimulating devices, which in turn requires a good understanding of the effects of microstimulation on cells and tissues. In this context, modeling approaches provide flexible ways to predict the outcome of electrical stimulation in terms of CNS activation. In this paper, we present state-of-the-art modeling methods with sufficient details to allow the reader to rapidly build numerical models of neuronal extracellular microstimulation. These include (1) the computation of the electrical potential field created by the stimulation in the tissue, and (2) the response of a target neuron to this field. Two main approaches are described: First we describe the classical hybrid approach that combines the finite element modeling of the potential field with the calculation of the neuron's response in a cable equation framework (compartmentalized neuron models). Then, we present a "whole finite element" approach allowing the simultaneous calculation of the extracellular and intracellular potentials, by representing the neuronal membrane with a thin-film approximation. This approach was previously introduced in the frame of neural recording, but has never been implemented to determine the effect of extracellular stimulation on the neural response at a sub-compartment level. Here, we show on an example that the latter modeling scheme can reveal important sub-compartment behavior of the neural membrane that cannot be resolved using the hybrid approach. The goal of this paper is also to describe in detail the practical implementation of these methods to allow the reader to easily build new models using standard software packages. These modeling paradigms, depending on the situation, should help build more efficient high-density neural prostheses for CNS rehabilitation.