NeuroMotion: Open-source platform with neuromechanical and deep network modules to generate surface EMG signals during voluntary movement.

Neuromechanical studies investigate how the nervous system interacts with the musculoskeletal (MSK) system to generate volitional movements. Such studies have been supported by simulation models that provide insights into variables that cannot be measured experimentally and allow a large number of conditions to be tested before the experimental analysis. However, current simulation models of electromyography (EMG), a core physiological signal in neuromechanical analyses, remain either limited in accuracy and conditions or are computationally heavy to apply. Here, we provide a computational platform to enable future work to overcome these limitations by presenting NeuroMotion, an open-source simulator that can modularly test a variety of approaches to the full-spectrum synthesis of EMG signals during voluntary movements. We demonstrate NeuroMotion using three sample modules. The first module is an upper-limb MSK model with OpenSim API to estimate the muscle fibre lengths and muscle activations during movements. The second module is BioMime, a deep neural network-based EMG generator that receives nonstationary physiological parameter inputs, like the afore-estimated muscle fibre lengths, and efficiently outputs motor unit action potentials (MUAPs). The third module is a motor unit pool model that transforms the muscle activations into discharge timings of motor units. The discharge timings are convolved with the output of BioMime to simulate EMG signals during the movement. We first show how MUAP waveforms change during different levels of physiological parameter variations and different movements. We then show that the synthetic EMG signals during two-degree-of-freedom hand and wrist movements can be used to augment experimental data for regressing joint angles. Ridge regressors trained on the synthetic dataset were directly used to predict joint angles from experimental data. In this way, NeuroMotion was able to generate full-spectrum EMG for the first use-case of human forearm electrophysiology during voluntary hand, wrist, and forearm movements. All intermediate variables are available, which allows the user to study cause-effect relationships in the complex neuromechanical system, fast iterate algorithms before collecting experimental data, and validate algorithms that estimate non-measurable parameters in experiments. We expect this modular platform will enable validation of generative EMG models, complement experimental approaches and empower neuromechanical research.

Spatio-temporal evolution of human neural activity during visually cued hand movements.

Making hand movements in response to visual cues is common in daily life. It has been well known that this process activates multiple areas in the brain, but how these neural activations progress across space and time remains largely unknown. Taking advantage of intracranial electroencephalographic (iEEG) recordings using depth and subdural electrodes from 36 human subjects using the same task, we applied single-trial and cross-trial analyses to high-frequency iEEG activity. The results show that the neural activation was widely distributed across the human brain both within and on the surface of the brain, and focused specifically on certain areas in the parietal, frontal, and occipital lobes, where parietal lobes present significant left lateralization on the activation. We also demonstrate temporal differences across these brain regions. Finally, we evaluated the degree to which the timing of activity within these regions was related to sensory or motor function. The findings of this study promote the understanding of task-related neural processing of the human brain, and may provide important insights for translational applications.

Assessing differential representation of hand movements in multiple domains using stereo-electroencephalographic recordings.

Invasive brain-computer interfaces (BCI) have made great progress in the reconstruction of fine hand movement parameters for paralyzed patients, where superficial measurement modalities including electrocorticography (ECoG) and micro-array recordings are mostly used. However, these recording techniques typically focus on the signals from the sensorimotor cortex, leaving subcortical regions and other cortical regions related to the movements largely unexplored. As an intracranial recording technique for the presurgical assessments of brain surgery, stereo-encephalography (SEEG) inserts depth electrodes containing multiple contacts into the brain and thus provides the unique opportunity for investigating movement-related neural representation throughout the brain. Although SEEG samples neural signals with high spatial-temporal resolutions, its potential of being used to build BCIs has just been realized recently, and the decoding of SEEG activity related to hand movements has not been comprehensively investigated yet. Here, we systematically evaluated the factors influencing the performance of movement decoding using SEEG signals recorded from 32 human subjects performing a visually-cued hand movement task. Our results suggest that multiple regions in both lateral and depth directions present significant neural selectivity to the task, whereas the sensorimotor area, including both precentral and postcentral cortex, carries the richest discriminative neural information for the decoding. The posterior parietal and prefrontal cortex contribute gradually less, but still rich sources for extracting movement parameters. The insula, temporal and occipital cortex also contains useful task-related information for decoding. Under the cortex layer, white matter presents decodable neural patterns but yields a lower accuracy (42.0 ± 0.8%) than the cortex on average (44.2 ± 0.8%, p<0.01). Notably, collectively using neural signals from multiple task-related areas can significantly enhance the movement decoding performance by 6.9% (p<0.01) on average compared to using a single region. Among the different spectral components of SEEG activity, the high gamma and delta bands offer the most informative features for hand movements reconstruction. Additionally, the phase-amplitude coupling strength between these two frequency ranges correlates positively with the performance of movement decoding. In the temporal domain, maximum decoding accuracy is first reached around 2 s after the onset of movement commands. In sum, this study provides valuable insights for the future motor BCIs design employing both SEEG recordings and other recording modalities.

Improving robustness against electrode shift of high density EMG for myoelectric control through common spatial patterns.

BACKGROUND: Most prosthetic myoelectric control studies have concentrated on low density (less than 16 electrodes, LD) electromyography (EMG) signals, due to its better clinical applicability and low computation complexity compared with high density (more than 16 electrodes, HD) EMG signals. Since HD EMG electrodes have been developed more conveniently to wear with respect to the previous versions recently, HD EMG signals become an alternative for myoelectric prostheses. The electrode shift, which may occur during repositioning or donning/doffing of the prosthetic socket, is one of the main reasons for degradation in classification accuracy (CA). METHODS: HD EMG signals acquired from the forearm of the subjects were used for pattern recognition-based myoelectric control in this study. Multiclass common spatial patterns (CSP) with two types of schemes, namely one versus one (CSP-OvO) and one versus rest (CSP-OvR), were used for feature extraction to improve the robustness against electrode shift for myoelectric control. Shift transversal (ST1 and ST2) and longitudinal (SL1 and SL2) to the direction of the muscle fibers were taken into consideration. We tested nine intact-limb subjects for eleven hand and wrist motions. The CSP features (CSP-OvO and CSP-OvR) were compared with three commonly used features, namely time-domain (TD) features, time-domain autoregressive (TDAR) features and variogram (Variog) features. RESULTS: Compared with the TD features, the CSP features significantly improved the CA over 10 % in all shift configurations (ST1, ST2, SL1 and SL2). Compared with the TDAR features, a. the CSP-OvO feature significantly improved the average CA over 5 % in all shift configurations; b. the CSP-OvR feature significantly improved the average CA in shift configurations ST1, SL1 and SL2. Compared with the Variog features, the CSP features significantly improved the average CA in longitudinal shift configurations (SL1 and SL2). CONCLUSION: The results demonstrated that the CSP features significantly improved the robustness against electrode shift for myoelectric control with respect to the commonly used features.

Decoding Multi-DoF Movements Using a CST-Based Force Generation Model With Single-DoF Training.

Recent developments in dexterous myoelectric prosthetics have established a hardware base for human-machine interfaces. Although pattern recognition techniques have seen successful deployment in gesture classification, their applications remain largely confined to certain specific discrete gestures. Addressing complex daily tasks demands an immediate need for precise simultaneous and proportional control (SPC) for multiple degrees of freedom (DoFs) movements. In this paper, we introduce an SPC approach for multi-DoF wrist movements using the cumulative spike trains (CSTs) of motor unit pools, merely leveraging single-DoF training. The efficacy of our proposed approach was validated offline against existing methods respectively based on non-negative matrix factorization and motor unit spike trains, using experimental data. The experimental process includes both single-DoF (for training) and multi-DoF (for testing) movements. We evaluated the performance using Pearson correlation coefficient (R) and the normalized root mean square error (nRMSE). The results reveal that our method outperforms comparative approaches in force estimation for both testing datasets (3 and 4). On average, for dataset 3, R and nRMSE of the flexion/extension DoF (the pronation/supination DoF) are 0.923±0.037 (0.901±0.040) and 12.3±3.1% (12.9±2.2%); similarly, those of dataset 4 are 0.865±0.057 (0.837±0.053) and 14.9±2.9% (15.4±2.0%), respectively. The outcomes demonstrate the effectiveness of our method in simultaneous and proportional force estimation for multi-DoF wrist movements, showing a promising potential as a neural-machine interface for SPC of dexterous myoelectric prostheses.

Optimized uniform sampling and validation of fiber tracts from magnetic resonance tractography for in vivo architectural measurement of human forearm muscles.

In vivo muscle architectural parameters can be calculated from the fiber tracts using magnetic resonance (MR) tractography. However, the reconstructed tracts may be unevenly distributed within the muscle volume and there lacks commonly used metric to quantitatively evaluate the validity of the tracts. Our objective is to measure forearm muscle architecture by uniformly sampling fiber tracts from the candidate streamlines in MR tractography and validate the reconstructed fiber tracts qualitatively and quantitatively. We proposed farthest streamline sampling (FSS) to uniformly sample fiber tracts from the candidate streamlines. The method was evaluated on the MR data acquired from 12 healthy subjects for 17 forearm muscles and was compared with two conventional methods through uniform coverage performance. Anatomical correctness was verified by: 1. visually assessing fiber orientation, 2. checking whether architectural parameters were within physiological ranges and 3. classifying architectural types. The proposed FSS yielded optimal uniform coverage performance among the three methods (P<0.05). FSS reduced the sampling of long tracts (10% fiber length reduction, P<0.05), and the estimated architectural parameters were within the physiological ranges (P<0.05). The tractography visually matched cadaveric specimens. The architectural types of 16 muscles were correctly classified except for the palmaris longus, which exhibited a linear arrangement of fiber endpoints (R2 = 0.95±0.02, P<0.001). The proposed FSS method reconstructed uniformly distributed fiber tracts and the anatomical correctness of the reconstructed tracts was verified. The novel methods allow for accurate in vivo muscle architectural measurement, which was demonstrated through the characterization of architectural properties in human forearm muscles.

Consistent control information driven musculoskeletal model for multiday myoelectric control.

Objective.Musculoskeletal model (MM)-based myoelectric interface has aroused great interest in human-machine interaction. However, the performance of electromyography (EMG)-driven MM in long-term use would be degraded owing to the inherent non-stationary characteristics of EMG signals. Here, to improve the estimation performance without retraining, we proposed a consistent muscle excitation extraction approach based on an improved non-negative matrix factorization (NMF) algorithm for MM when applied to simultaneous hand and wrist movement prediction.Approach.We added constraints andL2-norm regularization terms to the objective function of classic NMF regarding muscle weighting matrix and time-varying profiles, through which stable muscle synergies across days were identified. The resultant profiles of these synergies were then used to drive the MM. Both offline and online experiments were conducted to evaluate the performance of the proposed method in inter-day scenarios.Main results.The results demonstrated significantly better and more robust performance over several competitive methods in inter-day experiments, including machine learning methods, EMG envelope-driven MM, and classic NMF-based MM. Furthermore, the analysis of control information on different days revealed the effectiveness of the proposed method in obtaining consistent muscle excitations.Significance.The outcomes potentially provide a novel and promising pathway for the robust and zero-retraining control of myoelectric interfaces.

Hand Grasp Pose Prediction Based on Motion Prior Field.

Shared control of bionic robot hands has recently attracted much research attention. However, few studies have performed predictive analysis for grasp pose, which is vital for the pre-shape planning of robotic wrists and hands. Aiming at shared control of dexterous hand grasp planning, this paper proposes a framework for grasp pose prediction based on the motion prior field. To map the hand-object pose to the final grasp pose, an object-centered motion prior field is established to learn the prediction model. The results of motion capture reconstruction show that, with the input of a 7-dimensional pose and cluster manifolds of dimension 100, the model performs best in terms of prediction accuracy (90.2%) and error distance (1.27 cm) in the sequence. The model makes correct predictions in the first 50% of the sequence during hand approach to the object. The outcomes of this study enable prediction of the grasp pose in advance as the hand approaches the object, which is very important for enabling the shared control of bionic and prosthetic hands.

A Calibration-Free Hybrid Approach Combining SSVEP and EOG for Continuous Control.

While SSVEP-BCI has been widely developed to control external devices, most of them rely on the discrete control strategy. The continuous SSVEP-BCI enables users to continuously deliver commands and receive real-time feedback from the devices, but it suffers from the transition state problem, a period the erroneous recognition, when users shift their gazes between targets. To resolve this issue, we proposed a novel calibration-free Bayesian approach by hybridizing SSVEP and electrooculography (EOG). First, canonical correlation analysis (CCA) was applied to detect the evoked SSVEPs, and saccade during the gaze shift was detected by EOG data using an adaptive threshold method. Then, the new target after the gaze shift was recognized based on a Bayesian optimization approach, which combined the detection of SSVEP and saccade together and calculated the optimized probability distribution of the targets. Eighteen healthy subjects participated in the offline and online experiments. The offline experiments showed that the proposed hybrid BCI had significantly higher overall continuous accuracy and shorter gaze-shifting time compared to FBCCA, CCA, MEC, and PSDA. In online experiments, the proposed hybrid BCI significantly outperformed CCA-based SSVEP-BCI in terms of continuous accuracy (77.61 ± 1.36%vs. 68.86 ± 1.08% and gaze-shifting time (0.93 ± 0.06s vs. 1.94 ± 0.08s). Additionally, participants also perceived a significant improvement over the CCA-based SSVEP-BCI when the newly proposed decoding approach was used. These results validated the efficacy of the proposed hybrid Bayesian approach for the BCI continuous control without any calibration. This study provides an effective framework for combining SSVEP and EOG, and promotes the potential applications of plug-and-play BCIs in continuous control.

Cumulative Spike Train Estimation for Muscle Excitation Assessment From Surface EMG Using Spatial Spike Detection.

Estimating cumulative spike train (CST) of motor units (MUs) from surface electromyography (sEMG) is essential for the effective control of neural interfaces. However, the limited accuracy of existing estimation methods greatly hinders the further development of neural interface. This paper proposes a simple but effective approach for identifying CST based on spatial spike detection from high-density sEMG. Specifically, we use a spatial sliding window to detect spikes according to the spatial propagation characteristics of the motor unit action potential, focusing on the spikes of activated MUs in a local area rather than those of a specific MU. We validated the effectiveness of our proposed method through an experiment involving wrist flexion/extension and pronation/supination, comparing it with a recognized CST estimation method and an MU decomposition based method. The results demonstrated that the proposed method obtained higher accuracy on multi-DoF wrist torque estimation leveraging the estimated CST compared to the other three methods. On average, the correlation coefficient (R) and the normalized root mean square error (nRMSE) between the estimation results and recorded force were 0.96 ± 0.03 and 10.1% ± 3.7%, respectively. Moreover, there was an extremely high interpretive extent between the CSTs of proposed method and the MU decomposition method. The outcomes reveal the superiority of the proposed method in identifying CSTs and can provide promising driven signals for neural interface.

A Novel and Efficient Surface Electromyography Decomposition Algorithm Using Local Spatial Information.

Motor unit spike trains (MUSTs) decomposed from surface electromyography (sEMG) have been an emerging solution for neural interfacing, especially for the control of upper limb prosthetics. Accurate and efficient decomposition techniques are essential and desirable. However, most decomposition methods are designed for motor units (MUs) with global maximum of single or large muscle, while in general forearm muscles are usually small and slender with low global energy. Thus, we propose a novel approach using local spatial information towards more accurate and efficient sEMG decomposition of forearm muscles. A fast spatial spike detection method is proposed to replace the time-consuming iteration process of blind source separation (BSS) methods. Here, spatial distribution characteristics of motor unit action potential are leveraged to pre-classify the candidate MUs, and further to create initial MU templates, aiming to avoid repeating convergence to high-energy MUs. The results of both simulated and experimental sEMG signals show that low-energy MUs from small muscles are more easily found compared with conventional BSS algorithm. Specifically, the proposed method can identify more 40% reliable MUs while only 30% consuming time are needed. The outcomes provide a novel solution for more efficient sEMG decomposition, potentially paving the way of MUST-based non-invasive neural interface.

Extracting Individual Muscle Drive and Activity From High-Density Surface Electromyography Signals Based on the Center of Gravity of Motor Unit.

Neural interfacing has played an essential role in advancing our understanding of fundamental movement neurophysiology and the development of human-machine interface. However, direct neural interfaces from brain and nerve recording are currently limited in clinical areas for their invasiveness and high selectivity. Here, we applied the surface electromyogram (EMG) in studying the neural control of movement and proposed a new non-invasive way of extracting neural drive to individual muscles. Sixteen subjects performed isometric contractions to complete six hand tasks. High-density surface EMG signals (256 channels in total) recorded from the forearm muscles were decomposed into motor unit firing trains. The location of each decomposed motor unit was represented by its center of gravity and was put into clustering for distinct muscle regions. All the motor units in the same cluster served as a muscle-specific motor pool from which individual muscle drive could be extracted directly. Moreover, we cross-validated the self-clustered muscle regions by magnetic resonance imaging (MRI) recorded from the subjects' forearms. All motor units that fall within the MRI region are considered correctly clustered. We achieved a clustering accuracy of 95.72% ± 4.01% for all subjects. We provided a new framework for collecting experimental muscle-specific drives and generalized the way of surface electrode placement without prior knowledge of the targeting muscle architecture.

Mapping Individual Motor Unit Activity to Continuous Three-DoF Wrist Torques: Perspectives for Myoelectric Control.

The surface electromyography (EMG) decomposition techniques provide access to motor neuron activities and have been applied to myoelectric control schemes. However, the current decomposition-based myoelectric control mainly focuses on discrete gestures or single-DoF continuous movements. In this study, we aimed to map the motor unit discharges, which were identified from high-density surface EMG, to the three degrees of freedom (DoFs) wrist movements. The 3-DoF wrist torques and high-density surface EMG signals were recorded concurrently from eight non-disabled subjects. The experimental protocol included single-DoF movements and their various combinations. We decoded the motor unit discharges from the EMG signals using a segment-wise decomposition algorithm. Then the neural features were extracted from motor unit discharges and projected to wrist torques with a multiple linear regression model. We compared the performance of two neural features (twitch model and spike counting) and two training schemes (single-DoF and multi-DoF training). On average, 145 ± 33 motor units were identified from each subject, with a pulse-to-noise ratio of 30.8 ± 4.2 dB. Both neural features exhibited high estimation accuracy of 3-DoF wrist torques, with an average [Formula: see text] of 0.76 ± 0.12 and normalized root mean square error of 11.4 ± 3.1%. These results demonstrated the efficiency of the proposed method in continuous estimation of 3-DoF wrist torques, which has the potential to advance dexterous myoelectric control based on neural information.

Real-Time Hand Gesture Recognition by Decoding Motor Unit Discharges Across Multiple Motor Tasks From Surface Electromyography.

OBJECTIVE: Surface electromyography (EMG) decomposition techniques have been developed to decode motor neuron activities non-invasively in the past decades, showing superior performance in human-machine interfaces such as gesture recognition and proportional control. However, neural decoding across multiple motor tasks and in real-time remains challenging, which limits its wide application. In this work, we proposed a real-time hand gesture recognition method by decoding motor unit (MU) discharges across multiple motor tasks ( 10) in a motion-wise way. METHODS: The EMG signals were first divided into numerous segments related to motions. The convolution kernel compensation algorithm was applied for each segment individually. The local MU filters, which indicate the MU-EMG correlation for each motion, were calculated iteratively in each segment and reused for global EMG decomposition to trace the MU discharges across motor tasks in real-time. The motion-wise decomposition method was applied on the high-density EMG signals recorded during twelve hand gesture tasks from eleven non-disabled participants. The neural feature of discharge count was extracted for gesture recognition based on five common classifiers. MAIN RESULTS: On average, 164 ±34 MUs were identified for twelve motions from each subject, with a pulse-to-noise ratio of 32.1 ±5.6 dB. The average time cost of EMG decomposition in a sliding window of 50 ms was less than 5 ms. The average classification accuracy using a linear discriminant analysis classifier was 94.6 ±8.1%, which was significantly higher than that of a time-domain feature called root mean square. The superiority of the proposed method was also validated with a previously published EMG database comprising 65 gestures. CONCLUSION AND SIGNIFICANCE: These results indicate the feasibility and superiority of the proposed method for MU identification and hand gesture recognition across multiple motor tasks, extending the potential applications of neural decoding in human-machine interfaces.

Neural evidence for functional roles of tactile and visual feedback in the application of myoelectric prosthesis.

Objective. The primary purpose of this study was to investigate the electrophysiological mechanism underlying different modalities of sensory feedback and multi-sensory integration in typical prosthesis control tasks.Approach. We recruited 15 subjects and developed a closed-loop setup for three prosthesis control tasks which covered typical activities in the practical prosthesis application, i.e. prosthesis finger position control (PFPC), equivalent grasping force control (GFC) and box and block control (BABC). All the three tasks were conducted under tactile feedback (TF), visual feedback (VF) and tactile-visual feedback (TVF), respectively, with a simultaneous electroencephalography (EEG) recording to assess the electroencephalogram (EEG) response underlying different types of feedback. Behavioral and psychophysical assessments were also administered in each feedback condition.Results. EEG results showed that VF played a predominant role in GFC and BABC tasks. It was reflected by a significantly lower somatosensory alpha event-related desynchronization (ERD) in TVF than in TF and no significant difference in visual alpha ERD between TVF and VF. In PFPC task, there was no significant difference in somatosensory alpha ERD between TF and TVF, while a significantly lower visual alpha ERD was found in TVF than in VF, indicating that TF was essential in situations related to proprioceptive position perception. Tactile-visual integration was found when TF and VF were congruently implemented, showing an obvious activation over the premotor cortex in the three tasks. Behavioral and psychophysical results were consistent with EEG evaluations.Significance. Our findings could provide neural evidence for multi-sensory integration and functional roles of tactile and VF in a practical setting of prosthesis control, shedding a multi-dimensional insight into the functional mechanisms of sensory feedback.

A soft neuroprosthetic hand providing simultaneous myoelectric control and tactile feedback.

Neuroprosthetic hands are typically heavy (over 400 g) and expensive (more than US$10,000), and lack the compliance and tactile feedback of human hands. Here, we report the design, fabrication and performance of a soft, low-cost and lightweight (292 g) neuroprosthetic hand that provides simultaneous myoelectric control and tactile feedback. The neuroprosthesis has six active degrees of freedom under pneumatic actuation, can be controlled through the input from four electromyography sensors that measure surface signals from residual forearm muscles, and integrates five elastomeric capacitive sensors on the fingertips to measure touch pressure so as to enable tactile feedback by eliciting electrical stimulation on the skin of the residual limb. In a set of standardized tests performed by two individuals with transradial amputations, we show that the soft neuroprosthetic hand outperforms a conventional rigid neuroprosthetic hand in speed and dexterity. We also show that one individual with a transradial amputation wearing the soft neuroprosthetic hand can regain primitive touch sensation and real-time closed-loop control.

Slow-wave modulation analysis during states of unconsciousness using the novel tau-modulation method.

Objective. Slow-wave modulation occurs during states of unconsciousness and is a large-scale indicator of underlying brain states. Conventional methods typically characterize these large-scale dynamics by assuming that slow-wave activity is sinusoidal with a stationary frequency. However, slow-wave activity typically has an irregular waveform shape with a non-stationary frequency, causing these methods to be highly unpredictable and inaccurate. To address these limitations, we developed a novel method using tau-modulation, which is more robust than conventional methods in estimating the modulation of slow-wave activity and does not require assumptions on the shape or stationarity of the underlying waveform.Approach. We propose a novel method to estimate modulatory effects on slow-wave activity. Tau-modulation curves are constructed from cross-correlation between slow-wave and high-frequency activity. The resultant curves capture several aspects of modulation, including attenuation or enhancement of slow-wave activity, the temporal synchrony between slow-wave and high-frequency activity, and the rate at which the overall brain activity oscillates between states.Main results. The method's performance was tested on an open electrocorticographic dataset from two monkeys that were recorded during propofol-induced anesthesia, with electrodes implanted over the left hemispheres. We found a robust propagation of slow-wave modulation along the anterior-posterior axis of the lateral aspect of the cortex. This propagation preferentially originated from the anterior superior temporal cortex and anterior cingulate gyrus. We also found the modulation frequency and polarity to track the stages of anesthesia. The algorithm performed well, even with non-sinusoidal activity and in the presence of real-world noise.Significance. The novel method provides new insight into several aspects of slow-wave modulation that have been previously difficult to evaluate across several brain states. This ability to better characterize slow-wave modulation, without spurious correlations induced by non-sinusoidal signals, may lead to robust and physiologically-plausible diagnostic tools for monitoring brain functions during states of unconsciousness.

Phase-amplitude coupling between low-frequency scalp EEG and high-frequency intracranial EEG during working memory task.

Objective. Revealing the relationship between simultaneous scalp electroencephalography (EEG) and intracranial electroencephalography (iEEG) is of great importance for both neuroscientific research and translational applications. However, whether prominent iEEG features in the high-gamma band can be reflected by scalp EEG is largely unknown. To address this, we investigated the phase-amplitude coupling (PAC) phenomenon between the low-frequency band of scalp EEG and the high-gamma band of iEEG.Approach. We analyzed a simultaneous iEEG and scalp EEG dataset acquired under a verbal working memory paradigm from nine epilepsy subjects. The PAC values between pairs of scalp EEG channel and identified iEEG channel were explored. After identifying the frequency combinations and electrode locations that generated the most significant PAC values, we compared the PAC values of different task periods (encoding, maintenance, and retrieval) and memory loads.Main results. We demonstrated that the amplitude of high-gamma activities in the entorhinal cortex, hippocampus, and amygdala was correlated to the delta or theta phase at scalp locations such as Cz and Pz. In particular, the frequency bin that generated the maximum PAC value centered at 3.16-3.84 Hz for the phase and 50-85 Hz for the amplitude. Moreover, our results showed that PAC values for the retrieval period were significantly higher than those of the encoding and maintenance periods, and the PAC was also influenced by the memory load.Significance. This is the first human simultaneous iEEG and scalp EEG study demonstrating that the amplitude of iEEG high-gamma components is associated with the phase of low-frequency components in scalp EEG. These findings enhance our understanding of multiscale neural interactions during working memory, and meanwhile, provide a new perspective to estimate intracranial high-frequency features with non-invasive neural recordings.

Non-Invasive Analysis of Motor Unit Activation During Simultaneous and Continuous Wrist Movements.

Surface electromyography (EMG) signals have shown promising applications in human-machine interfacing (HMI) systems such as orthotics, prosthetics, and exoskeletons. Nevertheless, existing myoelectric control methods, generally based on time-domain or frequency-domain features, could not directly interpret neural commands. EMG decomposition techniques have become a prevailing solution to decode the motor neuron discharges from the spinal cord, whereas only single degree-of-freedom (DoF) movements are primarily involved in the current neural-based interfaces, resulting in limited intuitiveness and functionality. Here, we propose a non-invasive framework to analyze motor unit activities and estimate wrist torques during simultaneous contractions of multiple DoFs. Motor unit discharges were decoded from surface EMG signals and pooled into groups during sequential wrist movements. Then three neural features were extracted and linearly projected to the torques of multi-DoF tasks. On average, there were 44 ±13 motor units identified for each motion with a PNR value of 25.8 ±2.9 dB. The neural features outperformed the classic EMG feature on the estimation accuracy with higher correlation coefficients and smoothness. These results demonstrate the feasibility and superiority of the proposed framework in kinetics estimation of simultaneous movements, extending the potential applications of surface EMG decomposition in human-machine interfaces.

Electrotactile Feedback Improves Grip Force Control and Enables Object Stiffness Recognition While Using a Myoelectric Hand.

Current myoelectric hands are limited in their ability to provide effective sensory feedback to the users, which highly affects their functionality and utility. Although the sensory information of a myoelectric hand can be acquired with equipped sensors, transforming the sensory signals into effective tactile sensations on users for functional tasks is a largely unsolved challenge. The purpose of this study aims to demonstrate that electrotactile feedback of the grip force improves the sensorimotor control of a myoelectric hand and enables object stiffness recognition. The grip force of a sensorized myoelectric hand was delivered to its users via electrotactile stimulation based on four kinds of typical encoding strategies, including graded (G), linear amplitude (LA), linear frequency (LF), and biomimetic (B) modulation. Object stiffness was encoded with the change of electrotactile sensations triggered by final grip force, as the prosthesis grasped the objects. Ten able-bodied subjects and two transradial amputees were recruited to participate in a dual-task virtual eggs test (VET) and an object stiffness discrimination test (OSDT) to quantify the prosthesis users' ability to handle fragile objects and recognize object stiffnesses, respectively. The quantified results showed that with electrotactile feedback enabled, the four kinds of encoding strategies allowed subjects to better able to handle fragile objects with similar performance, and the subjects were able to differentiate four levels of object stiffness at favorable accuracies (>86%) and high manual efficiency. Strategy LA presented the best stiffness discrimination performance, while strategy B was able to reduce the discrimination time but the discrimination accuracy was not better than the other three strategies. Electrotactile feedback also enhanced prosthesis embodiment and improved the users' confidence in prosthetic control. Outcomes indicate electrotactile feedback can be effectively exploited by the prosthesis users for grip force control and object stiffness recognition, proving the feasibility of functional sensory restoration of myoelectric prostheses equipped with electrotactile feedback.