User Training With Error Augmentation for sEMG-Based Gesture Classification.

We designed and tested a system for real-time control of a user interface by extracting surface electromyographic (sEMG) activity from eight electrodes in a wristband configuration. sEMG data were streamed into a machine-learning algorithm that classified hand gestures in real-time. After an initial model calibration, participants were presented with one of three types of feedback during a human-learning stage: veridical feedback, in which predicted probabilities from the gesture classification algorithm were displayed without alteration; modified feedback, in which we applied a hidden augmentation of error to these probabilities; and no feedback. User performance was then evaluated in a series of minigames, in which subjects were required to use eight gestures to manipulate their game avatar to complete a task. Experimental results indicated that relative to the baseline, the modified feedback condition led to significantly improved accuracy. Class separation also improved, though this trend was not significant. These findings suggest that real-time feedback in a gamified user interface with manipulation of feedback may enable intuitive, rapid, and accurate task acquisition for sEMG-based gesture recognition applications.

Identifying Naturalistic Movies from Human Brain Activity with High-Density Diffuse Optical Tomography.

Modern neuroimaging modalities, particularly functional MRI (fMRI), can decode detailed human experiences. Thousands of viewed images can be identified or classified, and sentences can be reconstructed. Decoding paradigms often leverage encoding models that reduce the stimulus space into a smaller yet generalizable feature set. However, the neuroimaging devices used for detailed decoding are non-portable, like fMRI, or invasive, like electrocorticography, excluding application in naturalistic use. Wearable, non-invasive, but lower-resolution devices such as electroencephalography and functional near-infrared spectroscopy (fNIRS) have been limited to decoding between stimuli used during training. Herein we develop and evaluate model-based decoding with high-density diffuse optical tomography (HD-DOT), a higher-resolution expansion of fNIRS with demonstrated promise as a surrogate for fMRI. Using a motion energy model of visual content, we decoded the identities of novel movie clips outside the training set with accuracy far above chance for single-trial decoding. Decoding was robust to modulations of testing time window, different training and test imaging sessions, hemodynamic contrast, and optode array density. Our results suggest that HD-DOT can translate detailed decoding into naturalistic use.

Measuring neuronal activity with diffuse correlation spectroscopy: a theoretical investigation.

Significance: Diffuse correlation spectroscopy (DCS) measures cerebral blood flow non-invasively. Variations in blood flow can be used to detect neuronal activities, but its peak has a latency of a few seconds, which is slow for real-time monitoring. Neuronal cells also deform during activation, which, in principle, can be utilized to detect neuronal activity on fast timescales (within 100 ms) using DCS. Aims: We aim to characterize DCS signal variation quantified as the change of the decay time of the speckle intensity autocorrelation function during neuronal activation on both fast (within 100 ms) and slow (100 ms to seconds) timescales. Approach: We extensively modeled the variations in the DCS signal that are expected to arise from neuronal activation using Monte Carlo simulations, including the impacts of neuronal cell motion, vessel wall dilation, and blood flow changes. Results: We found that neuronal cell motion induces a DCS signal variation of ∼ 10 - 5 . We also estimated the contrast and number of channels required to detect hemodynamic signals at different time delays. Conclusions: From this extensive analysis, we do not expect to detect neuronal cell motion using DCS in the near future based on current technology trends. However, multi-channel DCS will be able to detect hemodynamic response with sub-second latency, which is interesting for brain-computer interfaces.

Citizen Neuroscience: Brain-Computer Interface Researcher Perspectives on Do-It-Yourself Brain Research.

Devices that record from and stimulate the brain are currently available for consumer use. The increasing sophistication and resolution of these devices provide consumers with the opportunity to engage in do-it-yourself brain research and contribute to neuroscience knowledge. The rise of do-it-yourself (DIY) neuroscience may provide an enriched fund of neural data for researchers, but also raises difficult questions about data quality, standards, and the boundaries of scientific practice. We administered an online survey to brain-computer interface (BCI) researchers to gather their perspectives on DIY brain research. While BCI researcher concerns about data quality and reproducibility were high, the possibility of expert validation of data generated by citizen neuroscientists mitigated concerns. We discuss survey results in the context of an established ethical framework for citizen science, and describe the potential of constructive collaboration between citizens and researchers to both increase data collection and advance understanding of how the brain operates outside the confines of the lab.

Advanced technologies for intuitive control and sensation of prosthetics.

The Department of Defense, Department of Veterans Affairs and National Institutes of Health have invested significantly in advancing prosthetic technologies over the past 25 years, with the overall intent to improve the function, participation and quality of life of Service Members, Veterans, and all United States Citizens living with limb loss. These investments have contributed to substantial advancements in the control and sensory perception of prosthetic devices over the past decade. While control of motorized prosthetic devices through the use of electromyography has been widely available since the 1980s, this technology is not intuitive. Additionally, these systems do not provide stimulation for sensory perception. Recent research has made significant advancement not only in the intuitive use of electromyography for control but also in the ability to provide relevant meaningful perceptions through various stimulation approaches. While much of this previous work has traditionally focused on those with upper extremity amputation, new developments include advanced bidirectional neuroprostheses that are applicable to both the upper and lower limb amputation. The goal of this review is to examine the state-of-the-science in the areas of intuitive control and sensation of prosthetic devices and to discuss areas of exploration for the future. Current research and development efforts in external systems, implanted systems, surgical approaches, and regenerative approaches will be explored.

DARPA investment in peripheral nerve interfaces for prosthetics, prescriptions, and plasticity.

BACKGROUND: Peripheral nerve interfaces have emerged as alternative solutions for a variety of therapeutic and performance improvement applications. The Defense Advanced Research Projects Agency (DARPA) has widely invested in these interfaces to provide motor control and sensory feedback to prosthetic limbs, identify non-pharmacological interventions to treat disease, and facilitate neuromodulation to accelerate learning or improve performance on cognitive, sensory, or motor tasks. In this commentary, we highlight some of the design considerations for optimizing peripheral nerve interfaces depending on the application space. We also discuss the ethical considerations that accompany these advances.

Brain-computer interface (BCI) researcher perspectives on neural data ownership and privacy.

OBJECTIVE: Brain-computer interface (BCI) research and commercially available neural devices generate large amounts of neural data. These data have significant potential value to researchers and industry. Individuals from whose brains neural data derive may want to exert control over what happens to their neural data at study conclusion or as a result of using a consumer device. It is unclear how BCI researchers understand the relationship between neural data and BCI users and what control individuals should have over their neural data. APPROACH: An online survey of BCI researchers (n = 122) gathered perspectives on control of neural data generated in research and non-research contexts. The survey outcomes are discussed and other relevant concerns are highlighted. MAIN RESULTS: The study found that 58% of BCI researchers endorsed giving research participants access to their raw neural data at the conclusion of a study. However, researchers felt that individuals should be limited in their freedom to either donate or sell these data. A majority of researchers viewed raw neural data as a kind of medical data. Survey respondents felt that current laws and regulations were inadequate to protect consumer neural data privacy, though many respondents were also unfamiliar with the details of existing guidelines. SIGNIFICANCE: The majority of BCI researchers believe that individuals should have some but not unlimited control over neural data produced in research and non-research contexts.

A muscle-activity-dependent gain between motor cortex and EMG.

Whether one is delicately placing a contact lens on the surface of the eye or lifting a heavy weight from the floor, the motor system must produce a wide range of forces under different dynamical loads. How does the motor cortex, with neurons that have a limited activity range, function effectively under these widely varying conditions? In this study, we explored the interaction of activity in primary motor cortex (M1) and muscles (electromyograms, EMGs) of two male rhesus monkeys for wrist movements made during three tasks requiring different dynamical loads and forces. Despite traditionally providing adequate predictions in single tasks, in our experiments, a single linear model failed to account for the relation between M1 activity and EMG across conditions. However, a model with a gain parameter that increased with the target force remained accurate across forces and dynamical loads. Surprisingly, this model showed that a greater proportion of EMG changes were explained by the nonlinear gain than the linear mapping from M1. In addition to its theoretical implications, the strength of this nonlinearity has important implications for brain-computer interfaces (BCIs). If BCI decoders are to be used to control movement dynamics (including interaction forces) directly, they will need to be nonlinear and include training data from broad data sets to function effectively across tasks. Our study reinforces the need to investigate neural control of movement across a wide range of conditions to understand its basic characteristics as well as translational implications. NEW & NOTEWORTHY We explored the motor cortex-to-electromyogram (EMG) mapping across a wide range of forces and loading conditions, which we found to be highly nonlinear. A greater proportion of EMG was explained by a nonlinear gain than a linear mapping. This nonlinearity allows motor cortex to control the wide range of forces encountered in the real world. These results unify earlier observations and inform the next-generation brain-computer interfaces that will control movement dynamics and interaction forces.

Cortical population activity within a preserved neural manifold underlies multiple motor behaviors.

Populations of cortical neurons flexibly perform different functions; for the primary motor cortex (M1) this means a rich repertoire of motor behaviors. We investigate the flexibility of M1 movement control by analyzing neural population activity during a variety of skilled wrist and reach-to-grasp tasks. We compare across tasks the neural modes that capture dominant neural covariance patterns during each task. While each task requires different patterns of muscle and single unit activity, we find unexpected similarities at the neural population level: the structure and activity of the neural modes is largely preserved across tasks. Furthermore, we find two sets of neural modes with task-independent activity that capture, respectively, generic temporal features of the set of tasks and a task-independent mapping onto muscle activity. This system of flexibly combined, well-preserved neural modes may underlie the ability of M1 to learn and generate a wide-ranging behavioral repertoire.

A cryptography-based approach for movement decoding.

Brain decoders use neural recordings to infer the activity or intent of a user. To train a decoder, one generally needs to infer the measured variables of interest (covariates) from simultaneously measured neural activity. However, there are cases for which obtaining supervised data is difficult or impossible. Here, we describe an approach for movement decoding that does not require access to simultaneously measured neural activity and motor outputs. We use the statistics of movement-much like cryptographers use the statistics of language-to find a mapping between neural activity and motor variables, and then align the distribution of decoder outputs with the typical distribution of motor outputs by minimizing their Kullback-Leibler divergence. By using datasets collected from the motor cortex of three non-human primates performing either a reaching task or an isometric force-production task, we show that the performance of such a distribution-alignment decoding algorithm is comparable to the performance of supervised approaches. Distribution-alignment decoding promises to broaden the set of potential applications of brain decoding.

Representation of Stimulus Speed and Direction in Vibrissal-Sensitive Regions of the Trigeminal Nuclei: A Comparison of Single Unit and Population Responses.

The rat vibrissal (whisker) system is one of the oldest and most important models for the study of active tactile sensing and sensorimotor integration. It is well established that primary sensory neurons in the trigeminal ganglion respond to deflections of one and only one whisker, and that these neurons are strongly tuned for both the speed and direction of individual whisker deflections. During active whisking behavior, however, multiple whiskers will be deflected simultaneously. Very little is known about how neurons at central levels of the trigeminal pathway integrate direction and speed information across multiple whiskers. In the present work, we investigated speed and direction coding in the trigeminal brainstem nuclei, the first stage of neural processing that exhibits multi-whisker receptive fields. Specifically, we recorded both single-unit spikes and local field potentials from fifteen sites in spinal trigeminal nucleus interpolaris and oralis while systematically varying the speed and direction of coherent whisker deflections delivered across the whisker array. For 12/15 neurons, spike rate was higher when the whisker array was stimulated from caudal to rostral rather than rostral to caudal. In addition, 10/15 neurons exhibited higher firing rates for slower stimulus speeds. Interestingly, using a simple decoding strategy for the local field potentials and spike trains, classification of speed and direction was higher for field potentials than for single unit spike trains, suggesting that the field potential is a robust reflection of population activity. Taken together, these results point to the idea that population responses in these brainstem regions in the awake animal will be strongest during behaviors that stimulate a population of whiskers with a directionally coherent motion.