Volitional control of single-electrode high gamma local field potentials by people with paralysis.

Intracortical brain-computer interfaces (BCIs) can enable individuals to control effectors, such as a computer cursor, by directly decoding the user's movement intentions from action potentials and local field potentials (LFPs) recorded within the motor cortex. However, the accuracy and complexity of effector control achieved with such "biomimetic" BCIs will depend on the degree to which the intended movements used to elicit control modulate the neural activity. In particular, channels that do not record distinguishable action potentials and only record LFP modulations may be of limited use for BCI control. In contrast, a biofeedback approach may surpass these limitations by letting the participants generate new control signals and learn strategies that improve the volitional control of signals used for effector control. Here, we show that, by using a biofeedback paradigm, three individuals with tetraplegia achieved volitional control of gamma LFPs (40-400 Hz) recorded by a single microelectrode implanted in the precentral gyrus. Control was improved over a pair of consecutive sessions up to 3 days apart. In all but one session, the channel used to achieve control lacked distinguishable action potentials. Our results indicate that biofeedback LFP-based BCIs may potentially contribute to the neural modulation necessary to obtain reliable and useful control of effectors. NEW & NOTEWORTHY Our study demonstrates that people with tetraplegia can volitionally control individual high-gamma local-field potential (LFP) channels recorded from the motor cortex, and that this control can be improved using biofeedback. Motor cortical LFP signals are thought to be both informative and stable intracortical signals and, thus, of importance for future brain-computer interfaces.

Neuroprosthetic Speech: The Ethical Significance of Accuracy, Control and Pragmatics.

Neuroprosthetic speech devices are an emerging technology that can offer the possibility of communication to those who are unable to speak. Patients with 'locked in syndrome,' aphasia, or other such pathologies can use covert speech-vividly imagining saying something without actual vocalization-to trigger neural controlled systems capable of synthesizing the speech they would have spoken, but for their impairment.We provide an analysis of the mechanisms and outputs involved in speech mediated by neuroprosthetic devices. This analysis provides a framework for accounting for the ethical significance of accuracy, control, and pragmatic dimensions of prosthesis-mediated speech. We first examine what it means for the output of the device to be accurate, drawing a distinction between technical accuracy on the one hand and semantic accuracy on the other. These are conceptual notions of accuracy.Both technical and semantic accuracy of the device will be necessary (but not yet sufficient) for the user to have sufficient control over the device. Sufficient control is an ethical consideration: we place high value on being able to express ourselves when we want and how we want. Sufficient control of a neural speech prosthesis requires that a speaker can reliably use their speech apparatus as they want to, and can expect their speech to authentically represent them. We draw a distinction between two relevant features which bear on the question of whether the user has sufficient control: voluntariness of the speech and the authenticity of the speech. These can come apart: the user might involuntarily produce an authentic output (perhaps revealing private thoughts) or might voluntarily produce an inauthentic output (e.g., when the output is not semantically accurate). Finally, we consider the role of the interlocutor in interpreting the content and purpose of the communication.These three ethical dimensions raise philosophical questions about the nature of speech, the level of control required for communicative accuracy, and the nature of 'accuracy' with respect to both natural and prosthesis-mediated speech.

Real-Time Control of an Articulatory-Based Speech Synthesizer for Brain Computer Interfaces.

Restoring natural speech in paralyzed and aphasic people could be achieved using a Brain-Computer Interface (BCI) controlling a speech synthesizer in real-time. To reach this goal, a prerequisite is to develop a speech synthesizer producing intelligible speech in real-time with a reasonable number of control parameters. We present here an articulatory-based speech synthesizer that can be controlled in real-time for future BCI applications. This synthesizer converts movements of the main speech articulators (tongue, jaw, velum, and lips) into intelligible speech. The articulatory-to-acoustic mapping is performed using a deep neural network (DNN) trained on electromagnetic articulography (EMA) data recorded on a reference speaker synchronously with the produced speech signal. This DNN is then used in both offline and online modes to map the position of sensors glued on different speech articulators into acoustic parameters that are further converted into an audio signal using a vocoder. In offline mode, highly intelligible speech could be obtained as assessed by perceptual evaluation performed by 12 listeners. Then, to anticipate future BCI applications, we further assessed the real-time control of the synthesizer by both the reference speaker and new speakers, in a closed-loop paradigm using EMA data recorded in real time. A short calibration period was used to compensate for differences in sensor positions and articulatory differences between new speakers and the reference speaker. We found that real-time synthesis of vowels and consonants was possible with good intelligibility. In conclusion, these results open to future speech BCI applications using such articulatory-based speech synthesizer.

Nanoporous graphene-based thin-film microelectrodes for in vivo high-resolution neural recording and stimulation.

One of the critical factors determining the performance of neural interfaces is the electrode material used to establish electrical communication with the neural tissue, which needs to meet strict electrical, electrochemical, mechanical, biological and microfabrication compatibility requirements. This work presents a nanoporous graphene-based thin-film technology and its engineering to form flexible neural interfaces. The developed technology allows the fabrication of small microelectrodes (25 µm diameter) while achieving low impedance (∼25 kΩ) and high charge injection (3-5 mC cm-2). In vivo brain recording performance assessed in rodents reveals high-fidelity recordings (signal-to-noise ratio >10 dB for local field potentials), while stimulation performance assessed with an intrafascicular implant demonstrates low current thresholds (<100 µA) and high selectivity (>0.8) for activating subsets of axons within the rat sciatic nerve innervating tibialis anterior and plantar interosseous muscles. Furthermore, the tissue biocompatibility of the devices was validated by chronic epicortical (12 week) and intraneural (8 week) implantation. This work describes a graphene-based thin-film microelectrode technology and demonstrates its potential for high-precision and high-resolution neural interfacing.

Overt speech decoding from cortical activity: a comparison of different linear methods.

Introduction: Speech BCIs aim at reconstructing speech in real time from ongoing cortical activity. Ideal BCIs would need to reconstruct speech audio signal frame by frame on a millisecond-timescale. Such approaches require fast computation. In this respect, linear decoder are good candidates and have been widely used in motor BCIs. Yet, they have been very seldomly studied for speech reconstruction, and never for reconstruction of articulatory movements from intracranial activity. Here, we compared vanilla linear regression, ridge-regularized linear regressions, and partial least squares regressions for offline decoding of overt speech from cortical activity. Methods: Two decoding paradigms were investigated: (1) direct decoding of acoustic vocoder features of speech, and (2) indirect decoding of vocoder features through an intermediate articulatory representation chained with a real-time-compatible DNN-based articulatory-to-acoustic synthesizer. Participant's articulatory trajectories were estimated from an electromagnetic-articulography dataset using dynamic time warping. The accuracy of the decoders was evaluated by computing correlations between original and reconstructed features. Results: We found that similar performance was achieved by all linear methods well above chance levels, albeit without reaching intelligibility. Direct and indirect methods achieved comparable performance, with an advantage for direct decoding. Discussion: Future work will address the development of an improved neural speech decoder compatible with fast frame-by-frame speech reconstruction from ongoing activity at a millisecond timescale.

Artificial CSF motion ensures rhythmic activity in the developing CNS ex vivo: a mechanical source of rhythmogenesis?

Spontaneous rhythmic activity is a ubiquitous feature of developing neural structures that has been shown to be essential for the establishment of functional CNS connectivity. However, the primordial origin of these rhythms remains unknown. Here, we describe two types of rhythmic activity in distinct parts of the developing CNS isolated ex vivo on microelectrode arrays, the expression of which was found to be strictly dependent upon the movement of the artificial CSF (aCSF) flowing over the inner wall of the ventricles or over the outer surface of the CNS. First, whole embryonic mouse hindbrain-spinal cord preparations (stages E12.5-E15.5) rhythmically expressed waves of activity originating in the hindbrain and propagating in the spinal cord. Interestingly enough, the frequency of this rhythm was completely determined by the speed of the aCSF flow. In particular, at all stages considered, hindbrain activity was abolished when the perfusion was stopped. Immature rhythmic activity was also recorded in the isolated newborn (P0-P8) mouse cortex under normal aCSF perfusion. Again, this rhythm was abolished when the perfusion flow was stopped. In both structures, this phenomenon was not due to changes in temperature, oxygen level, or pH of the bath, but to the movement itself of the aCSF. These observations challenge the so-called "spontaneous" nature of rhythmic activity in immature neural networks and suggest that the movement of CSF in the ventricles and around the brain in vivo may mechanically drive rhythmogenesis in the developing CNS.

Combined macro-/mesoporous microelectrode arrays for low-noise extracellular recording of neural networks.

Microelectrode arrays (MEAs) are appealing tools to probe large neural ensembles and build neural prostheses. Microelectronics microfabrication technologies now allow building high-density MEAs containing several hundreds of microelectrodes. However, several major problems become limiting factors when the size of the microelectrodes decreases. In particular, regarding recording of neural activity, the intrinsic noise level of a microelectrode dramatically increases when the size becomes small (typically below 20-µm diameter). Here, we propose to overcome this limitation using a template-based, single-scale meso- or two-scale macro-/mesoporous modification of the microelectrodes, combining the advantages of an overall small geometric surface and an active surface increased by several orders of magnitude. For this purpose, standard platinum MEAs were covered with a highly porous platinum overlayer obtained by lyotropic liquid crystal templating possibly in combination with a microsphere templating approach. These porous coatings were mechanically more robust than Pt-black coating and avoid potential toxicity issues. They had a highly increased active surface, resulting in a noise level ∼3 times smaller than that of conventional flat electrodes. This approach can thus be used to build highly dense arrays of small-size microelectrodes for sensitive neural signal detection.

Multichannel boron doped nanocrystalline diamond ultramicroelectrode arrays: design, fabrication and characterization.

We report on the fabrication and characterization of an 8 × 8 multichannel Boron Doped Diamond (BDD) ultramicro-electrode array (UMEA). The device combines both the assets of microelectrodes, resulting from conditions in mass transport from the bulk solution toward the electrode, and of BDD's remarkable intrinsic electrochemical properties. The UMEAs were fabricated using an original approach relying on the selective growth of diamond over pre-processed 4 inches silicon substrates. The prepared UMEAs were characterized by cyclic voltammetry (CV) and electrochemical impedance spectroscopy (EIS). The results demonstrated that the electrodes have exhibited a very fast electrode transfer rate (k(0)) up to 0.05 cm·s(-1) (in a fast redox couple) and on average, a steady state limiting current (in a 0.5 M potassium chloride aqueous solution containing 1 mM Fe(CN)(6)(4-) ion at 100 mV·s(-1)) of 1.8 nA. The UMEAs are targeted for electrophysiological as well as analytical applications.

A hybrid autoencoder framework of dimensionality reduction for brain-computer interface decoding.

OBJECTIVE: As the scale of neural recording increases, Brain-computer interfaces (BCIs) are restrained by high-dimensional neural features, so dimensionality reduction is required as a preprocess of neural features. In this context, we propose a novel framework based on deep learning to reduce the dimensionality of neural features that are typically extracted from electrocorticography (ECoG) or local field potential (LFP). APPROACH: A high-performance autoencoder was implemented by chaining convolutional layers to deal with spatial and frequency dimensions with bottleneck long short-term memory (LSTM) layers to deal with the temporal dimension of the features. Furthermore, this autoencoder is combined with a fully connected layer to regularize the training. MAIN RESULTS: By applying the proposed method to two different datasets, we found that this dimensionality reduction method largely outperforms kernel principal component analysis (KPCA), partial least square (PLS), preferential subspace identification (PSID), and latent factor analysis via dynamical systems (LFADS). Besides, the new features obtained by our method can be applied to various BCI decoders, without significant differences in decoding performance. SIGNIFICANCE: A novel method is proposed as a reliable tool for efficient dimensionality reduction of neural signals. Its high performance and robustness are promising to enhance the decoding accuracy and long-term stability of online BCI systems based on large-scale neural recordings.

Chronic recording of cortical activity underlying vocalization in awake minipigs.

BACKGROUND: Investigating brain dynamics underlying vocal production in animals is a powerful way to inform on the neural bases of human speech. In particular, brain networks underlying vocal production in non-human primates show striking similarities with the human speech production network. However, despite increasing findings also in birds and more recently in rodents, the extent to which the primate vocal cortical network model generalizes to other non-primate mammals remains unclear. Especially, no domestic species has yet been proposed to investigate vocal brain activity using electrophysiological approaches. NEW METHOD: In the present study, we introduce a novel experimental paradigm to identify the cortical dynamics underlying vocal production in behaving minipigs. A key problem to chronically implant cortical probes in pigs is the presence and growth of frontal sinuses extending caudally to the parietal bone and preventing safe access to neural structures with conventional craniotomy in adult animals. RESULTS: Here we first show that implantations of soft ECoG grids can be done safely using conventional craniotomy in minipigs younger than 5 months, a period when sinuses are not yet well developed. Using wireless recordings in behaving animals, we further show activation of the motor and premotor cortex around the onset of vocal production of grunts, the most common vocalization of pigs. CONCLUSION: These results suggest that minipigs, which are very loquacious and social animals, can be a good experimental large animal model to study the cortical bases of vocal production.

Dimensionality Reduction of Local Field Potential Features with Convolution Neural Network in Neural Decoding: A Pilot Study.

Local field potentials (LFPs) have better long-term stability compared with spikes in brain-machine interfaces (BMIs). Many studies have shown promising results of LFP decoding, but the high-dimensional feature of LFP still hurdle the development of the BMIs to low-cost. In this paper, we proposed a framework of a 1D convolution neural network (CNN) to reduce the dimensionality of the LFP features. For evaluating the performance of this architecture, the reduced LFP features were decoded to cursor position (Center-out task) by a Kalman filter. The Principal components analysis (PCA) was also performed as a comparison. The results showed that the CNN model could reduce the dimensionality of LFP features to a smaller size without significant performance loss. The decoding result based on the CNN features outperformed that based on the PCA features. Moreover, the reduced features by CNN also showed robustness across different sessions. These results demonstrated that the LFP features reduced by the CNN model achieved low cost without sacrificing high-performance and robustness, suggesting that this method could be used for portable BMI systems in the future.

MRI-Compatible and Conformal Electrocorticography Grids for Translational Research.

Intraoperative electrocorticography (ECoG) captures neural information from the surface of the cerebral cortex during surgeries such as resections for intractable epilepsy and tumors. Current clinical ECoG grids come in evenly spaced, millimeter-sized electrodes embedded in silicone rubber. Their mechanical rigidity and fixed electrode spatial resolution are common shortcomings reported by the surgical teams. Here, advances in soft neurotechnology are leveraged to manufacture conformable subdural, thin-film ECoG grids, and evaluate their suitability for translational research. Soft grids with 0.2 to 10 mm electrode pitch and diameter are embedded in 150 µm silicone membranes. The soft grids are compatible with surgical handling and can be folded to safely interface hidden cerebral surface such as the Sylvian fold in human cadaveric models. It is found that the thin-film conductor grids do not generate diagnostic-impeding imaging artefacts (<1 mm) nor adverse local heating within a standard 3T clinical magnetic resonance imaging scanner. Next, the ability of the soft grids to record subdural neural activity in minipigs acutely and two weeks postimplantation is validated. Taken together, these results suggest a promising future alternative to current stiff electrodes and may enable the future adoption of soft ECoG grids in translational research and ultimately in clinical settings.

Observation and assessment of acoustic contamination of electrophysiological brain signals during speech production and sound perception.

OBJECTIVE: A current challenge of neurotechnologies is to develop speech brain-computer interfaces aiming at restoring communication in people unable to speak. To achieve a proof of concept of such system, neural activity of patients implanted for clinical reasons can be recorded while they speak. Using such simultaneously recorded audio and neural data, decoders can be built to predict speech features using features extracted from brain signals. A typical neural feature is the spectral power of field potentials in the high-gamma frequency band, which happens to overlap the frequency range of speech acoustic signals, especially the fundamental frequency of the voice. Here, we analyzed human electrocorticographic and intracortical recordings during speech production and perception as well as a rat microelectrocorticographic recording during sound perception. We observed that several datasets, recorded with different recording setups, contained spectrotemporal features highly correlated with those of the sound produced by or delivered to the participants, especially within the high-gamma band and above, strongly suggesting a contamination of electrophysiological recordings by the sound signal. This study investigated the presence of acoustic contamination and its possible source. APPROACH: We developed analysis methods and a statistical criterion to objectively assess the presence or absence of contamination-specific correlations, which we used to screen several datasets from five centers worldwide. MAIN RESULTS: Not all but several datasets, recorded in a variety of conditions, showed significant evidence of acoustic contamination. Three out of five centers were concerned by the phenomenon. In a recording showing high contamination, the use of high-gamma band features dramatically facilitated the performance of linear decoding of acoustic speech features, while such improvement was very limited for another recording showing no significant contamination. Further analysis and in vitro replication suggest that the contamination is caused by the mechanical action of the sound waves onto the cables and connectors along the recording chain, transforming sound vibrations into an undesired electrical noise affecting the biopotential measurements. SIGNIFICANCE: Although this study does not per se question the presence of speech-relevant physiological information in the high-gamma range and above (multiunit activity), it alerts on the fact that acoustic contamination of neural signals should be proofed and eliminated before investigating the cortical dynamics of these processes. To this end, we make available a toolbox implementing the proposed statistical approach to quickly assess the extent of contamination in an electrophysiological recording (https://doi.org/10.5281/zenodo.3929296).

The "mirror" estimate: an intuitive predictor of membrane polarization during extracellular stimulation.

Achieving controlled extracellular microstimulation of the central nervous system requires understanding the membrane response of a neuron to an applied electric field. The "activating function" has been proposed as an intuitive predictor of membrane polarization during stimulation, but subsequent literature raised several limitations of this estimate. In this study, we show that, depending on the space constant lambda, the steady-state solution to the passive cable equation is theoretically well approximated by either the activating function when lambda is small, or the "mirror" image of the extracellular potential when lambda is large. Using simulations, we then explore the respective domain of both estimates as a function of lambda, stimulus duration, fiber length, and electrode-fiber distance. For realistic lambda (>50-100 microm), the mirror estimate is the best predictor for either long electrode-fiber distances or short distances (<20-30 microm) when stimulus durations exceed a few tens of microseconds. For intermediate distances, the mirror estimate is all the more valid that the stimulus duration is long and the fiber is short. We also illustrate that this estimate correctly predicts the steady-state membrane polarization of complex central nervous system arborizations. In conclusion, the mirror estimate can often be preferred to the activating function to intuitively predict membrane polarization during extracellular stimulation.

An Attention-Based Spiking Neural Network for Unsupervised Spike-Sorting.

Bio-inspired computing using artificial spiking neural networks promises performances outperforming currently available computational approaches. Yet, the number of applications of such networks remains limited due to the absence of generic training procedures for complex pattern recognition, which require the design of dedicated architectures for each situation. We developed a spike-timing-dependent plasticity (STDP) spiking neural network (SSN) to address spike-sorting, a central pattern recognition problem in neuroscience. This network is designed to process an extracellular neural signal in an online and unsupervised fashion. The signal stream is continuously fed to the network and processed through several layers to output spike trains matching the truth after a short learning period requiring only few data. The network features an attention mechanism to handle the scarcity of action potential occurrences in the signal, and a threshold adaptation mechanism to handle patterns with different sizes. This method outperforms two existing spike-sorting algorithms at low signal-to-noise ratio (SNR) and can be adapted to process several channels simultaneously in the case of tetrode recordings. Such attention-based STDP network applied to spike-sorting opens perspectives to embed neuromorphic processing of neural data in future brain implants.

SIMONE: a realistic neural network simulator to reproduce MEA-based recordings.

Contemporary multielectrode arrays (MEAs) used to record extracellular activity from neural tissues can deliver data at rates on the order of 100 Mbps. Such rates require efficient data compression and/or preprocessing algorithms implemented on an application specific integrated circuit (ASIC) close to the MEA. We present SIMONE (Statistical sIMulation Of Neuronal networks Engine), a versatile simulation tool whose parameters can be either fixed or defined by a probability distribution. We validated our tool by simulating data recorded from the first olfactory relay of an insect. Different key aspects make this tool suitable for testing the robustness and accuracy of neural signal processing algorithms (such as the detection, alignment, and classification of spikes). For instance, most of the parameters can be defined by a probabilistic distribution, then tens of simulations may be obtained from the same scenario. This is especially useful when validating the robustness of the processing algorithm. Moreover, the number of active cells and the exact firing activity of each one of them is perfectly known, which provides an easy way to test accuracy.

Corrigendum: Spiking Neural Networks Based on OxRAM Synapses for Real-Time Unsupervised Spike Sorting.

[This corrects the article on p. 474 in vol. 10, PMID: 27857680.].

Key considerations in designing a speech brain-computer interface.

Restoring communication in case of aphasia is a key challenge for neurotechnologies. To this end, brain-computer strategies can be envisioned to allow artificial speech synthesis from the continuous decoding of neural signals underlying speech imagination. Such speech brain-computer interfaces do not exist yet and their design should consider three key choices that need to be made: the choice of appropriate brain regions to record neural activity from, the choice of an appropriate recording technique, and the choice of a neural decoding scheme in association with an appropriate speech synthesis method. These key considerations are discussed here in light of (1) the current understanding of the functional neuroanatomy of cortical areas underlying overt and covert speech production, (2) the available literature making use of a variety of brain recording techniques to better characterize and address the challenge of decoding cortical speech signals, and (3) the different speech synthesis approaches that can be considered depending on the level of speech representation (phonetic, acoustic or articulatory) envisioned to be decoded at the core of a speech BCI paradigm.

Spiking Neural Networks Based on OxRAM Synapses for Real-Time Unsupervised Spike Sorting.

In this paper, we present an alternative approach to perform spike sorting of complex brain signals based on spiking neural networks (SNN). The proposed architecture is suitable for hardware implementation by using resistive random access memory (RRAM) technology for the implementation of synapses whose low latency (<1µs) enables real-time spike sorting. This offers promising advantages to conventional spike sorting techniques for brain-computer interfaces (BCI) and neural prosthesis applications. Moreover, the ultra-low power consumption of the RRAM synapses of the spiking neural network (nW range) may enable the design of autonomous implantable devices for rehabilitation purposes. We demonstrate an original methodology to use Oxide based RRAM (OxRAM) as easy to program and low energy (<75 pJ) synapses. Synaptic weights are modulated through the application of an online learning strategy inspired by biological Spike Timing Dependent Plasticity. Real spiking data have been recorded both intra- and extracellularly from an in-vitro preparation of the Crayfish sensory-motor system and used for validation of the proposed OxRAM based SNN. This artificial SNN is able to identify, learn, recognize and distinguish between different spike shapes in the input signal with a recognition rate about 90% without any supervision.

Generation of Locomotor-Like Activity in the Isolated Rat Spinal Cord Using Intraspinal Electrical Microstimulation Driven by a Digital Neuromorphic CPG.

Neural prostheses based on electrical microstimulation offer promising perspectives to restore functions following lesions of the central nervous system (CNS). They require the identification of appropriate stimulation sites and the coordination of their activation to achieve the restoration of functional activity. On the long term, a challenging perspective is to control microstimulation by artificial neural networks hybridized to the living tissue. Regarding the use of this strategy to restore locomotor activity in the spinal cord, to date, there has been no proof of principle of such hybrid approach driving intraspinal microstimulation (ISMS). Here, we address a first step toward this goal in the neonatal rat spinal cord isolated ex vivo, which can display locomotor-like activity while offering an easy access to intraspinal circuitry. Microelectrode arrays were inserted in the lumbar region to determine appropriate stimulation sites to elicit elementary bursting patterns on bilateral L2/L5 ventral roots. Two intraspinal sites were identified at L1 level, one on each side of the spinal cord laterally from the midline and approximately at a median position dorso-ventrally. An artificial CPG implemented on digital integrated circuit (FPGA) was built to generate alternating activity and was hybridized to the living spinal cord to drive electrical microstimulation on these two identified sites. Using this strategy, sustained left-right and flexor-extensor alternating activity on bilateral L2/L5 ventral roots could be generated in either whole or thoracically transected spinal cords. These results are a first step toward hybrid artificial/biological solutions based on electrical microstimulation for the restoration of lost function in the injured CNS.