Brain-Machine Interfaces: From Basic Science to Neuroprostheses and Neurorehabilitation.

Brain-machine interfaces (BMIs) combine methods, approaches, and concepts derived from neurophysiology, computer science, and engineering in an effort to establish real-time bidirectional links between living brains and artificial actuators. Although theoretical propositions and some proof of concept experiments on directly linking the brains with machines date back to the early 1960s, BMI research only took off in earnest at the end of the 1990s, when this approach became intimately linked to new neurophysiological methods for sampling large-scale brain activity. The classic goals of BMIs are 1) to unveil and utilize principles of operation and plastic properties of the distributed and dynamic circuits of the brain and 2) to create new therapies to restore mobility and sensations to severely disabled patients. Over the past decade, a wide range of BMI applications have emerged, which considerably expanded these original goals. BMI studies have shown neural control over the movements of robotic and virtual actuators that enact both upper and lower limb functions. Furthermore, BMIs have also incorporated ways to deliver sensory feedback, generated from external actuators, back to the brain. BMI research has been at the forefront of many neurophysiological discoveries, including the demonstration that, through continuous use, artificial tools can be assimilated by the primate brain's body schema. Work on BMIs has also led to the introduction of novel neurorehabilitation strategies. As a result of these efforts, long-term continuous BMI use has been recently implicated with the induction of partial neurological recovery in spinal cord injury patients.

Creating a neuroprosthesis for active tactile exploration of textures.

Intracortical microstimulation (ICMS) of the primary somatosensory cortex (S1) can produce percepts that mimic somatic sensation and, thus, has potential as an approach to sensorize prosthetic limbs. However, it is not known whether ICMS could recreate active texture exploration-the ability to infer information about object texture by using one's fingertips to scan a surface. Here, we show that ICMS of S1 can convey information about the spatial frequencies of invisible virtual gratings through a process of active tactile exploration. Two rhesus monkeys scanned pairs of visually identical screen objects with the fingertip of a hand avatar-controlled first via a joystick and later via a brain-machine interface-to find the object with denser virtual gratings. The gratings consisted of evenly spaced ridges that were signaled through individual ICMS pulses generated whenever the avatar's fingertip crossed a ridge. The monkeys learned to interpret these ICMS patterns, evoked by the interplay of their voluntary movements and the virtual textures of each object, to perform a sensory discrimination task. Discrimination accuracy followed Weber's law of just-noticeable differences (JND) across a range of grating densities; a finding that matches normal cutaneous sensation. Moreover, 1 monkey developed an active scanning strategy where avatar velocity was integrated with the ICMS pulses to interpret the texture information. We propose that this approach could equip upper-limb neuroprostheses with direct access to texture features acquired during active exploration of natural objects.

Time-Dependent Effect of Sciatic Nerve Injury on Rat Plasma Lipidome.

Neuropathic pain is a condition affecting the quality of life of a substantial part of the population, but biomarkers and treatment options are still limited. While this type of pain is caused by nerve damage, in which lipids play key roles, lipidome alterations related to nerve injury remain poorly studied. Here, we assessed blood lipidome alterations in a common animal model, the rat sciatic nerve crush injury. We analyzed alterations in blood lipid abundances between seven rats with nerve injury (NI) and eight control (CL) rats in a time-course experiment. For these rats, abundances of 377 blood lipid species were assessed at three distinct time points: immediately after, two weeks, and five weeks post injury. Although we did not detect significant differences between NI and CL at the first two time points, 106 lipids were significantly altered in NI five weeks post injury. At this time point, we found increased levels of triglycerides (TGs) and lipids containing esterified palmitic acid (16:0) in the blood plasma of NI animals. Lipids containing arachidonic acid (20:4), by contrast, were significantly decreased after injury, aligning with the crucial role of arachidonic acid reported for NI. Taken together, these results indicate delayed systematic alterations in fatty acid metabolism after nerve injury, potentially reflecting nerve tissue restoration dynamics.

Consensus on the reporting and experimental design of clinical and cognitive-behavioural neurofeedback studies (CRED-nf checklist).

Neurofeedback has begun to attract the attention and scrutiny of the scientific and medical mainstream. Here, neurofeedback researchers present a consensus-derived checklist that aims to improve the reporting and experimental design standards in the field.

Cortical neurons multiplex reward-related signals along with sensory and motor information.

Rewards are known to influence neural activity associated with both motor preparation and execution. This influence can be exerted directly upon the primary motor (M1) and somatosensory (S1) cortical areas via the projections from reward-sensitive dopaminergic neurons of the midbrain ventral tegmental areas. However, the neurophysiological manifestation of reward-related signals in M1 and S1 are not well understood. Particularly, it is unclear how the neurons in these cortical areas multiplex their traditional functions related to the control of spatial and temporal characteristics of movements with the representation of rewards. To clarify this issue, we trained rhesus monkeys to perform a center-out task in which arm movement direction, reward timing, and magnitude were manipulated independently. Activity of several hundred cortical neurons was simultaneously recorded using chronically implanted microelectrode arrays. Many neurons (9-27%) in both M1 and S1 exhibited activity related to reward anticipation. Additionally, neurons in these areas responded to a mismatch between the reward amount given to the monkeys and the amount they expected: A lower-than-expected reward caused a transient increase in firing rate in 60-80% of the total neuronal sample, whereas a larger-than-expected reward resulted in a decreased firing rate in 20-35% of the neurons. Moreover, responses of M1 and S1 neurons to reward omission depended on the direction of movements that led to those rewards. These observations suggest that sensorimotor cortical neurons corepresent rewards and movement-related activity, presumably to enable reward-based learning.

A novel paraplegia model in awake behaving macaques.

Lower limb paralysis from spinal cord injury (SCI) or neurological disease carries a poor prognosis for recovery and remains a large societal burden. Neurophysiological and neuroprosthetic research have the potential to improve quality of life for these patients; however, the lack of an ethical and sustainable nonhuman primate model for paraplegia hinders their advancement. Therefore, our multidisciplinary team developed a way to induce temporary paralysis in awake behaving macaques by creating a fully implantable lumbar epidural catheter-subcutaneous port system that enables easy and reliable targeted drug delivery for sensorimotor blockade. During treadmill walking, aliquots of 1.5% lidocaine with 1:200,000 epinephrine were percutaneously injected into the ports of three rhesus macaques while surface electromyography (EMG) recorded muscle activity from their quadriceps and gastrocnemii. Diminution of EMG amplitude, loss of voluntary leg movement, and inability to bear weight were achieved for 60-90 min in each animal, followed by a complete recovery of function. The monkeys remained alert and cooperative during the paralysis trials and continued to take food rewards, and the ports remained functional after several months. This technique will enable recording from the cortex and/or spinal cord in awake behaving nonhuman primates during the onset, maintenance, and resolution of paraplegia for the first time, thus opening the door to answering basic neurophysiological questions about the acute neurological response to spinal cord injury and recovery. It will also negate the need to permanently injure otherwise high-value research animals for certain experimental paradigms aimed at developing and testing neural interface decoding algorithms for patients with lower extremity dysfunction.NEW & NOTEWORTHY A novel implantable lumbar epidural catheter-subcutaneous port system enables targeted drug delivery and induction of temporary paraplegia in awake, behaving nonhuman primates. Three macaques displayed loss of voluntary leg movement for 60-90 min after injection of lidocaine with epinephrine, followed by a full recovery. This technique for the first time will enable ethical live recording from the proximal central nervous system during the acute onset, maintenance, and resolution of paraplegia.

Chronic, wireless recordings of large-scale brain activity in freely moving rhesus monkeys.

Advances in techniques for recording large-scale brain activity contribute to both the elucidation of neurophysiological principles and the development of brain-machine interfaces (BMIs). Here we describe a neurophysiological paradigm for performing tethered and wireless large-scale recordings based on movable volumetric three-dimensional (3D) multielectrode implants. This approach allowed us to isolate up to 1,800 neurons (units) per animal and simultaneously record the extracellular activity of close to 500 cortical neurons, distributed across multiple cortical areas, in freely behaving rhesus monkeys. The method is expandable, in principle, to thousands of simultaneously recorded channels. It also allows increased recording longevity (5 consecutive years) and recording of a broad range of behaviors, such as social interactions, and BMI paradigms in freely moving primates. We propose that wireless large-scale recordings could have a profound impact on basic primate neurophysiology research while providing a framework for the development and testing of clinically relevant neuroprostheses.

Active tactile exploration using a brain-machine-brain interface.

Brain-machine interfaces use neuronal activity recorded from the brain to establish direct communication with external actuators, such as prosthetic arms. It is hoped that brain-machine interfaces can be used to restore the normal sensorimotor functions of the limbs, but so far they have lacked tactile sensation. Here we report the operation of a brain-machine-brain interface (BMBI) that both controls the exploratory reaching movements of an actuator and allows signalling of artificial tactile feedback through intracortical microstimulation (ICMS) of the primary somatosensory cortex. Monkeys performed an active exploration task in which an actuator (a computer cursor or a virtual-reality arm) was moved using a BMBI that derived motor commands from neuronal ensemble activity recorded in the primary motor cortex. ICMS feedback occurred whenever the actuator touched virtual objects. Temporal patterns of ICMS encoded the artificial tactile properties of each object. Neuronal recordings and ICMS epochs were temporally multiplexed to avoid interference. Two monkeys operated this BMBI to search for and distinguish one of three visually identical objects, using the virtual-reality arm to identify the unique artificial texture associated with each. These results suggest that clinical motor neuroprostheses might benefit from the addition of ICMS feedback to generate artificial somatic perceptions associated with mechanical, robotic or even virtual prostheses.

Expanding the primate body schema in sensorimotor cortex by virtual touches of an avatar.

The brain representation of the body, called the body schema, is susceptible to plasticity. For instance, subjects experiencing a rubber hand illusion develop a sense of ownership of a mannequin hand when they view it being touched while tactile stimuli are simultaneously applied to their own hand. Here, the cortical basis of such an embodiment was investigated through concurrent recordings from primary somatosensory (i.e., S1) and motor (i.e., M1) cortical neuronal ensembles while two monkeys observed an avatar arm being touched by a virtual ball. Following a period when virtual touches occurred synchronously with physical brushes of the monkeys' arms, neurons in S1 and M1 started to respond to virtual touches applied alone. Responses to virtual touch occurred 50 to 70 ms later than to physical touch, consistent with the involvement of polysynaptic pathways linking the visual cortex to S1 and M1. We propose that S1 and M1 contribute to the rubber hand illusion and that, by taking advantage of plasticity in these areas, patients may assimilate neuroprosthetic limbs as parts of their body schema.

Simultaneous top-down modulation of the primary somatosensory cortex and thalamic nuclei during active tactile discrimination.

The rat somatosensory system contains multiple thalamocortical loops (TCLs) that altogether process, in fundamentally different ways, tactile stimuli delivered passively or actively sampled. To elucidate potential top-down mechanisms that govern TCL processing in awake, behaving animals, we simultaneously recorded neuronal ensemble activity across multiple cortical and thalamic areas while rats performed an active aperture discrimination task. Single neurons located in the primary somatosensory cortex (S1), the ventroposterior medial, and the posterior medial thalamic nuclei of the trigeminal somatosensory pathways exhibited prominent anticipatory firing modulations before the whiskers touching the aperture edges. This cortical and thalamic anticipatory firing could not be explained by whisker movements or whisker stimulation, because neither trigeminal ganglion sensory-evoked responses nor EMG activity were detected during the same period. Both thalamic and S1 anticipatory activity were predictive of the animal's discrimination accuracy. Inactivation of the primary motor cortex (M1) with muscimol affected anticipatory patterns in S1 and the thalamus, and impaired the ability to predict the animal's performance accuracy based on thalamocortical anticipatory activity. These findings suggest that neural processing in TCLs is launched in anticipation of whisker contact with objects, depends on top-down effects generated in part by M1 activity, and cannot be explained by the classical feedforward model of the rat trigeminal system.

Joint cross-correlation analysis reveals complex, time-dependent functional relationship between cortical neurons and arm electromyograms.

Correlation between cortical activity and electromyographic (EMG) activity of limb muscles has long been a subject of neurophysiological studies, especially in terms of corticospinal connectivity. Interest in this issue has recently increased due to the development of brain-machine interfaces with output signals that mimic muscle force. For this study, three monkeys were implanted with multielectrode arrays in multiple cortical areas. One monkey performed self-timed touch pad presses, whereas the other two executed arm reaching movements. We analyzed the dynamic relationship between cortical neuronal activity and arm EMGs using a joint cross-correlation (JCC) analysis that evaluated trial-by-trial correlation as a function of time intervals within a trial. JCCs revealed transient correlations between the EMGs of multiple muscles and neural activity in motor, premotor and somatosensory cortical areas. Matching results were obtained using spike-triggered averages corrected by subtracting trial-shuffled data. Compared with spike-triggered averages, JCCs more readily revealed dynamic changes in cortico-EMG correlations. JCCs showed that correlation peaks often sharpened around movement times and broadened during delay intervals. Furthermore, JCC patterns were directionally selective for the arm-reaching task. We propose that such highly dynamic, task-dependent and distributed relationships between cortical activity and EMGs should be taken into consideration for future brain-machine interfaces that generate EMG-like signals.

Principles of neural ensemble physiology underlying the operation of brain-machine interfaces.

Research on brain-machine interfaces has been ongoing for at least a decade. During this period, simultaneous recordings of the extracellular electrical activity of hundreds of individual neurons have been used for direct, real-time control of various artificial devices. Brain-machine interfaces have also added greatly to our knowledge of the fundamental physiological principles governing the operation of large neural ensembles. Further understanding of these principles is likely to have a key role in the future development of neuroprosthetics for restoring mobility in severely paralysed patients.

Resting-state EEG recorded with gel-based vs. consumer dry electrodes: spectral characteristics and across-device correlations.

Introduction: Recordings of electroencephalographic (EEG) rhythms and their analyses have been instrumental in basic neuroscience, clinical diagnostics, and the field of brain-computer interfaces (BCIs). While in the past such measurements have been conducted mostly in laboratory settings, recent advancements in dry electrode technology pave way to a broader range of consumer and medical application because of their greater convenience compared to gel-based electrodes. Methods: Here we conducted resting-state EEG recordings in two groups of healthy participants using three dry-electrode devices, the PSBD Headband, the PSBD Headphones and the Muse Headband, and one standard gel electrode-based system, the NVX. We examined signal quality for various spatial and spectral ranges which are essential for cognitive monitoring and consumer applications. Results: Distinctive characteristics of signal quality were found, with the PSBD Headband showing sensitivity in low-frequency ranges and replicating the modulations of delta, theta and alpha power corresponding to the eyes-open and eyes-closed conditions, and the NVX system performing well in capturing high-frequency oscillations. The PSBD Headphones were more prone to low-frequency artifacts compared to the PSBD Headband, yet recorded modulations in the alpha power and had a strong alignment with the NVX at the higher EEG frequencies. The Muse Headband had several limitations in signal quality. Discussion: We suggest that while dry-electrode technology appears to be appropriate for the EEG rhythm-based applications, the potential benefits of these technologies in terms of ease of use and accessibility should be carefully weighed against the capacity of each given system.

Stochastic facilitation of artificial tactile sensation in primates.

Artificial sensation via electrical or optical stimulation of brain sensory areas offers a promising treatment for sensory deficits. For a brain-machine-brain interface, such artificial sensation conveys feedback signals from a sensorized prosthetic limb. The ways neural tissue can be stimulated to evoke artificial sensation and the parameter space of such stimulation, however, remain largely unexplored. Here we investigated whether stochastic facilitation (SF) could enhance an artificial tactile sensation produced by intracortical microstimulation (ICMS). Two rhesus monkeys learned to use a virtual hand, which they moved with a joystick, to explore virtual objects on a computer screen. They sought an object associated with a particular artificial texture (AT) signaled by a periodic ICMS pattern delivered to the primary somatosensory cortex (S1) through a pair of implanted electrodes. During each behavioral trial, aperiodic ICMS (i.e., noise) of randomly chosen amplitude was delivered to S1 through another electrode pair implanted 1 mm away from the site of AT delivery. Whereas high-amplitude noise worsened AT detection, moderate noise clearly improved the detection of weak signals, significantly raising the proportion of correct trials. These findings suggest that SF could be used to enhance prosthetic sensation.

Subcortical neuronal ensembles: an analysis of motor task association, tremor, oscillations, and synchrony in human patients.

Deep brain stimulation (DBS) has expanded as an effective treatment for motor disorders, providing a valuable opportunity for intraoperative recording of the spiking activity of subcortical neurons. The properties of these neurons and their potential utility in neuroprosthetic applications are not completely understood. During DBS surgeries in 25 human patients with either essential tremor or Parkinson's disease, we acutely recorded the single-unit activity of 274 ventral intermediate/ventral oralis posterior motor thalamus (Vim/Vop) neurons and 123 subthalamic nucleus (STN) neurons. These subcortical neuronal ensembles (up to 23 neurons sampled simultaneously) were recorded while the patients performed a target-tracking motor task using a cursor controlled by a haptic glove. We observed that modulations in firing rate of a substantial number of neurons in both Vim/Vop and STN represented target onset, movement onset/direction, and hand tremor. Neurons in both areas exhibited rhythmic oscillations and pairwise synchrony. Notably, all tremor-associated neurons exhibited synchrony within the ensemble. The data further indicate that oscillatory (likely pathological) neurons and behaviorally tuned neurons are not distinct but rather form overlapping sets. Whereas previous studies have reported a linear relationship between power spectra of neuronal oscillations and hand tremor, we report a nonlinear relationship suggestive of complex encoding schemes. Even in the presence of this pathological activity, linear models were able to extract motor parameters from ensemble discharges. Based on these findings, we propose that chronic multielectrode recordings from Vim/Vop and STN could prove useful for further studying, monitoring, and even treating motor disorders.

Coherence potentials: loss-less, all-or-none network events in the cortex.

Transient associations among neurons are thought to underlie memory and behavior. However, little is known about how such associations occur or how they can be identified. Here we recorded ongoing local field potential (LFP) activity at multiple sites within the cortex of awake monkeys and organotypic cultures of cortex. We show that when the composite activity of a local neuronal group exceeds a threshold, its activity pattern, as reflected in the LFP, occurs without distortion at other cortex sites via fast synaptic transmission. These large-amplitude LFPs, which we call coherence potentials, extend up to hundreds of milliseconds and mark periods of loss-less spread of temporal and amplitude information much like action potentials at the single-cell level. However, coherence potentials have an additional degree of freedom in the diversity of their waveforms, which provides a high-dimensional parameter for encoding information and allows identification of particular associations. Such nonlinear behavior is analogous to the spread of ideas and behaviors in social networks.

An olfactory-based Brain-Computer Interface: electroencephalography changes during odor perception and discrimination.

Brain-Computer Interfaces (BCIs) are devices designed for establishing communication between the central nervous system and a computer. The communication can occur through different sensory modalities, and most commonly visual and auditory modalities are used. Here we propose that BCIs can be expanded by the incorporation of olfaction and discuss the potential applications of such olfactory BCIs. To substantiate this idea, we present results from two olfactory tasks: one that required attentive perception of odors without any overt report, and the second one where participants discriminated consecutively presented odors. In these experiments, EEG recordings were conducted in healthy participants while they performed the tasks guided by computer-generated verbal instructions. We emphasize the importance of relating EEG modulations to the breath cycle to improve the performance of an olfactory-based BCI. Furthermore, theta-activity could be used for olfactory-BCI decoding. In our experiments, we observed modulations of theta activity over the frontal EEG leads approximately 2 s after the inhalation of an odor. Overall, frontal theta rhythms and other types of EEG activity could be incorporated in the olfactory-based BCIs which utilize odors either as inputs or outputs. These BCIs could improve olfactory training required for conditions like anosmia and hyposmia, and mild cognitive impairment.

An experimental paradigm for studying EEG correlates of olfactory discrimination.

Electroencephalography (EEG) correlates of olfaction are of fundamental and practical interest for many reasons. In the field of neural technologies, olfactory-based brain-computer interfaces (BCIs) represent an approach that could be useful for neurorehabilitation of anosmia, dysosmia and hyposmia. While the idea of a BCI that decodes neural responses to different odors and/or enables odor-based neurofeedback is appealing, the results of previous EEG investigations into the olfactory domain are rather inconsistent, particularly when non-primary processing of olfactory signals is concerned. Here we developed an experimental paradigm where EEG recordings are conducted while a participant executes an olfaction-based instructed-delay task. We utilized an olfactory display and a sensor of respiration to deliver odors in a strictly controlled fashion. We showed that with this approach spatial and spectral EEG properties could be analyzed to assess neural processing of olfactory stimuli and their conversion into a motor response. We conclude that EEG recordings are suitable for detecting active processing of odors. As such they could be integrated in a BCI that strives to rehabilitate olfactory disabilities or uses odors for hedonistic purposes.

Communities in C. elegans connectome through the prism of non-backtracking walks.

The fundamental relationship between the mesoscopic structure of neuronal circuits and organismic functions they subserve is one of the major challenges in contemporary neuroscience. Formation of structurally connected modules of neurons enacts the conversion from single-cell firing to large-scale behaviour of an organism, highlighting the importance of their accurate profiling in the data. While connectomes are typically characterized by significant sparsity of neuronal connections, recent advances in network theory and machine learning have revealed fundamental limitations of traditionally used community detection approaches in cases where the network is sparse. Here we studied the optimal community structure in the structural connectome of Caenorhabditis elegans, for which we exploited a non-conventional approach that is based on non-backtracking random walks, virtually eliminating the sparsity issue. In full agreement with the previous asymptotic results, we demonstrated that non-backtracking walks resolve the ground truth annotation into clusters on stochastic block models (SBM) with the size and density of the connectome better than the spectral methods related to simple random walks. Based on the cluster detectability threshold, we determined that the optimal number of modules in a recently mapped connectome of C. elegans is 10, which precisely corresponds to the number of isolated eigenvalues in the spectrum of the non-backtracking flow matrix. The discovered communities have a clear interpretation in terms of their functional role, which allows one to discern three structural compartments in the worm: the Worm Brain (WB), the Worm Movement Controller (WMC), and the Worm Information Flow Connector (WIFC). Broadly, our work provides a robust network-based framework to reveal mesoscopic structures in sparse connectomic datasets, paving way to further investigation of connectome mechanisms for different functions.

Exoskeleton gait training with spinal cord neuromodulation.

Neuromodulating the locomotor network through spinal cord electrical stimulation (SCES) is effective for restoring function in individuals with gait deficits. However, SCES alone has limited effectiveness without concurrent locomotor function training that enhances activity-dependent plasticity of spinal neuronal networks by sensory feedback. This mini review discusses recent developments in using combined interventions, such as SCES added to exoskeleton gait training (EGT). To develop personalized therapies, it is crucial to assess the state of spinal circuitry through a physiologically relevant approach that identifies individual characteristics of spinal cord function to develop person-specific SCES and EGT. The existing literature suggests that combining SCES and EGT to activate the locomotor network can have a synergistic rehabilitative effect on restoring walking abilities, somatic sensation, and cardiovascular and bladder function in paralyzed individuals.