Decoding Multi-DoF Movements Using a CST-Based Force Generation Model With Single-DoF Training.

Recent developments in dexterous myoelectric prosthetics have established a hardware base for human-machine interfaces. Although pattern recognition techniques have seen successful deployment in gesture classification, their applications remain largely confined to certain specific discrete gestures. Addressing complex daily tasks demands an immediate need for precise simultaneous and proportional control (SPC) for multiple degrees of freedom (DoFs) movements. In this paper, we introduce an SPC approach for multi-DoF wrist movements using the cumulative spike trains (CSTs) of motor unit pools, merely leveraging single-DoF training. The efficacy of our proposed approach was validated offline against existing methods respectively based on non-negative matrix factorization and motor unit spike trains, using experimental data. The experimental process includes both single-DoF (for training) and multi-DoF (for testing) movements. We evaluated the performance using Pearson correlation coefficient (R) and the normalized root mean square error (nRMSE). The results reveal that our method outperforms comparative approaches in force estimation for both testing datasets (3 and 4). On average, for dataset 3, R and nRMSE of the flexion/extension DoF (the pronation/supination DoF) are 0.923±0.037 (0.901±0.040) and 12.3±3.1% (12.9±2.2%); similarly, those of dataset 4 are 0.865±0.057 (0.837±0.053) and 14.9±2.9% (15.4±2.0%), respectively. The outcomes demonstrate the effectiveness of our method in simultaneous and proportional force estimation for multi-DoF wrist movements, showing a promising potential as a neural-machine interface for SPC of dexterous myoelectric prostheses.

Consistent control information driven musculoskeletal model for multiday myoelectric control.

Objective.Musculoskeletal model (MM)-based myoelectric interface has aroused great interest in human-machine interaction. However, the performance of electromyography (EMG)-driven MM in long-term use would be degraded owing to the inherent non-stationary characteristics of EMG signals. Here, to improve the estimation performance without retraining, we proposed a consistent muscle excitation extraction approach based on an improved non-negative matrix factorization (NMF) algorithm for MM when applied to simultaneous hand and wrist movement prediction.Approach.We added constraints andL2-norm regularization terms to the objective function of classic NMF regarding muscle weighting matrix and time-varying profiles, through which stable muscle synergies across days were identified. The resultant profiles of these synergies were then used to drive the MM. Both offline and online experiments were conducted to evaluate the performance of the proposed method in inter-day scenarios.Main results.The results demonstrated significantly better and more robust performance over several competitive methods in inter-day experiments, including machine learning methods, EMG envelope-driven MM, and classic NMF-based MM. Furthermore, the analysis of control information on different days revealed the effectiveness of the proposed method in obtaining consistent muscle excitations.Significance.The outcomes potentially provide a novel and promising pathway for the robust and zero-retraining control of myoelectric interfaces.

A Calibration-Free Hybrid Approach Combining SSVEP and EOG for Continuous Control.

While SSVEP-BCI has been widely developed to control external devices, most of them rely on the discrete control strategy. The continuous SSVEP-BCI enables users to continuously deliver commands and receive real-time feedback from the devices, but it suffers from the transition state problem, a period the erroneous recognition, when users shift their gazes between targets. To resolve this issue, we proposed a novel calibration-free Bayesian approach by hybridizing SSVEP and electrooculography (EOG). First, canonical correlation analysis (CCA) was applied to detect the evoked SSVEPs, and saccade during the gaze shift was detected by EOG data using an adaptive threshold method. Then, the new target after the gaze shift was recognized based on a Bayesian optimization approach, which combined the detection of SSVEP and saccade together and calculated the optimized probability distribution of the targets. Eighteen healthy subjects participated in the offline and online experiments. The offline experiments showed that the proposed hybrid BCI had significantly higher overall continuous accuracy and shorter gaze-shifting time compared to FBCCA, CCA, MEC, and PSDA. In online experiments, the proposed hybrid BCI significantly outperformed CCA-based SSVEP-BCI in terms of continuous accuracy (77.61 ± 1.36%vs. 68.86 ± 1.08% and gaze-shifting time (0.93 ± 0.06s vs. 1.94 ± 0.08s). Additionally, participants also perceived a significant improvement over the CCA-based SSVEP-BCI when the newly proposed decoding approach was used. These results validated the efficacy of the proposed hybrid Bayesian approach for the BCI continuous control without any calibration. This study provides an effective framework for combining SSVEP and EOG, and promotes the potential applications of plug-and-play BCIs in continuous control.

Cumulative Spike Train Estimation for Muscle Excitation Assessment From Surface EMG Using Spatial Spike Detection.

Estimating cumulative spike train (CST) of motor units (MUs) from surface electromyography (sEMG) is essential for the effective control of neural interfaces. However, the limited accuracy of existing estimation methods greatly hinders the further development of neural interface. This paper proposes a simple but effective approach for identifying CST based on spatial spike detection from high-density sEMG. Specifically, we use a spatial sliding window to detect spikes according to the spatial propagation characteristics of the motor unit action potential, focusing on the spikes of activated MUs in a local area rather than those of a specific MU. We validated the effectiveness of our proposed method through an experiment involving wrist flexion/extension and pronation/supination, comparing it with a recognized CST estimation method and an MU decomposition based method. The results demonstrated that the proposed method obtained higher accuracy on multi-DoF wrist torque estimation leveraging the estimated CST compared to the other three methods. On average, the correlation coefficient (R) and the normalized root mean square error (nRMSE) between the estimation results and recorded force were 0.96 ± 0.03 and 10.1% ± 3.7%, respectively. Moreover, there was an extremely high interpretive extent between the CSTs of proposed method and the MU decomposition method. The outcomes reveal the superiority of the proposed method in identifying CSTs and can provide promising driven signals for neural interface.

Spatio-temporal evolution of human neural activity during visually cued hand movements.

Making hand movements in response to visual cues is common in daily life. It has been well known that this process activates multiple areas in the brain, but how these neural activations progress across space and time remains largely unknown. Taking advantage of intracranial electroencephalographic (iEEG) recordings using depth and subdural electrodes from 36 human subjects using the same task, we applied single-trial and cross-trial analyses to high-frequency iEEG activity. The results show that the neural activation was widely distributed across the human brain both within and on the surface of the brain, and focused specifically on certain areas in the parietal, frontal, and occipital lobes, where parietal lobes present significant left lateralization on the activation. We also demonstrate temporal differences across these brain regions. Finally, we evaluated the degree to which the timing of activity within these regions was related to sensory or motor function. The findings of this study promote the understanding of task-related neural processing of the human brain, and may provide important insights for translational applications.

Slow-wave modulation analysis during states of unconsciousness using the novel tau-modulation method.

Objective. Slow-wave modulation occurs during states of unconsciousness and is a large-scale indicator of underlying brain states. Conventional methods typically characterize these large-scale dynamics by assuming that slow-wave activity is sinusoidal with a stationary frequency. However, slow-wave activity typically has an irregular waveform shape with a non-stationary frequency, causing these methods to be highly unpredictable and inaccurate. To address these limitations, we developed a novel method using tau-modulation, which is more robust than conventional methods in estimating the modulation of slow-wave activity and does not require assumptions on the shape or stationarity of the underlying waveform.Approach. We propose a novel method to estimate modulatory effects on slow-wave activity. Tau-modulation curves are constructed from cross-correlation between slow-wave and high-frequency activity. The resultant curves capture several aspects of modulation, including attenuation or enhancement of slow-wave activity, the temporal synchrony between slow-wave and high-frequency activity, and the rate at which the overall brain activity oscillates between states.Main results. The method's performance was tested on an open electrocorticographic dataset from two monkeys that were recorded during propofol-induced anesthesia, with electrodes implanted over the left hemispheres. We found a robust propagation of slow-wave modulation along the anterior-posterior axis of the lateral aspect of the cortex. This propagation preferentially originated from the anterior superior temporal cortex and anterior cingulate gyrus. We also found the modulation frequency and polarity to track the stages of anesthesia. The algorithm performed well, even with non-sinusoidal activity and in the presence of real-world noise.Significance. The novel method provides new insight into several aspects of slow-wave modulation that have been previously difficult to evaluate across several brain states. This ability to better characterize slow-wave modulation, without spurious correlations induced by non-sinusoidal signals, may lead to robust and physiologically-plausible diagnostic tools for monitoring brain functions during states of unconsciousness.

Hand Grasp Pose Prediction Based on Motion Prior Field.

Shared control of bionic robot hands has recently attracted much research attention. However, few studies have performed predictive analysis for grasp pose, which is vital for the pre-shape planning of robotic wrists and hands. Aiming at shared control of dexterous hand grasp planning, this paper proposes a framework for grasp pose prediction based on the motion prior field. To map the hand-object pose to the final grasp pose, an object-centered motion prior field is established to learn the prediction model. The results of motion capture reconstruction show that, with the input of a 7-dimensional pose and cluster manifolds of dimension 100, the model performs best in terms of prediction accuracy (90.2%) and error distance (1.27 cm) in the sequence. The model makes correct predictions in the first 50% of the sequence during hand approach to the object. The outcomes of this study enable prediction of the grasp pose in advance as the hand approaches the object, which is very important for enabling the shared control of bionic and prosthetic hands.

Extracting Individual Muscle Drive and Activity From High-Density Surface Electromyography Signals Based on the Center of Gravity of Motor Unit.

Neural interfacing has played an essential role in advancing our understanding of fundamental movement neurophysiology and the development of human-machine interface. However, direct neural interfaces from brain and nerve recording are currently limited in clinical areas for their invasiveness and high selectivity. Here, we applied the surface electromyogram (EMG) in studying the neural control of movement and proposed a new non-invasive way of extracting neural drive to individual muscles. Sixteen subjects performed isometric contractions to complete six hand tasks. High-density surface EMG signals (256 channels in total) recorded from the forearm muscles were decomposed into motor unit firing trains. The location of each decomposed motor unit was represented by its center of gravity and was put into clustering for distinct muscle regions. All the motor units in the same cluster served as a muscle-specific motor pool from which individual muscle drive could be extracted directly. Moreover, we cross-validated the self-clustered muscle regions by magnetic resonance imaging (MRI) recorded from the subjects' forearms. All motor units that fall within the MRI region are considered correctly clustered. We achieved a clustering accuracy of 95.72% ± 4.01% for all subjects. We provided a new framework for collecting experimental muscle-specific drives and generalized the way of surface electrode placement without prior knowledge of the targeting muscle architecture.

Real-Time Hand Gesture Recognition by Decoding Motor Unit Discharges Across Multiple Motor Tasks From Surface Electromyography.

OBJECTIVE: Surface electromyography (EMG) decomposition techniques have been developed to decode motor neuron activities non-invasively in the past decades, showing superior performance in human-machine interfaces such as gesture recognition and proportional control. However, neural decoding across multiple motor tasks and in real-time remains challenging, which limits its wide application. In this work, we proposed a real-time hand gesture recognition method by decoding motor unit (MU) discharges across multiple motor tasks ( 10) in a motion-wise way. METHODS: The EMG signals were first divided into numerous segments related to motions. The convolution kernel compensation algorithm was applied for each segment individually. The local MU filters, which indicate the MU-EMG correlation for each motion, were calculated iteratively in each segment and reused for global EMG decomposition to trace the MU discharges across motor tasks in real-time. The motion-wise decomposition method was applied on the high-density EMG signals recorded during twelve hand gesture tasks from eleven non-disabled participants. The neural feature of discharge count was extracted for gesture recognition based on five common classifiers. MAIN RESULTS: On average, 164 ±34 MUs were identified for twelve motions from each subject, with a pulse-to-noise ratio of 32.1 ±5.6 dB. The average time cost of EMG decomposition in a sliding window of 50 ms was less than 5 ms. The average classification accuracy using a linear discriminant analysis classifier was 94.6 ±8.1%, which was significantly higher than that of a time-domain feature called root mean square. The superiority of the proposed method was also validated with a previously published EMG database comprising 65 gestures. CONCLUSION AND SIGNIFICANCE: These results indicate the feasibility and superiority of the proposed method for MU identification and hand gesture recognition across multiple motor tasks, extending the potential applications of neural decoding in human-machine interfaces.

Mapping Individual Motor Unit Activity to Continuous Three-DoF Wrist Torques: Perspectives for Myoelectric Control.

The surface electromyography (EMG) decomposition techniques provide access to motor neuron activities and have been applied to myoelectric control schemes. However, the current decomposition-based myoelectric control mainly focuses on discrete gestures or single-DoF continuous movements. In this study, we aimed to map the motor unit discharges, which were identified from high-density surface EMG, to the three degrees of freedom (DoFs) wrist movements. The 3-DoF wrist torques and high-density surface EMG signals were recorded concurrently from eight non-disabled subjects. The experimental protocol included single-DoF movements and their various combinations. We decoded the motor unit discharges from the EMG signals using a segment-wise decomposition algorithm. Then the neural features were extracted from motor unit discharges and projected to wrist torques with a multiple linear regression model. We compared the performance of two neural features (twitch model and spike counting) and two training schemes (single-DoF and multi-DoF training). On average, 145 ± 33 motor units were identified from each subject, with a pulse-to-noise ratio of 30.8 ± 4.2 dB. Both neural features exhibited high estimation accuracy of 3-DoF wrist torques, with an average [Formula: see text] of 0.76 ± 0.12 and normalized root mean square error of 11.4 ± 3.1%. These results demonstrated the efficiency of the proposed method in continuous estimation of 3-DoF wrist torques, which has the potential to advance dexterous myoelectric control based on neural information.

Neural evidence for functional roles of tactile and visual feedback in the application of myoelectric prosthesis.

Objective. The primary purpose of this study was to investigate the electrophysiological mechanism underlying different modalities of sensory feedback and multi-sensory integration in typical prosthesis control tasks.Approach. We recruited 15 subjects and developed a closed-loop setup for three prosthesis control tasks which covered typical activities in the practical prosthesis application, i.e. prosthesis finger position control (PFPC), equivalent grasping force control (GFC) and box and block control (BABC). All the three tasks were conducted under tactile feedback (TF), visual feedback (VF) and tactile-visual feedback (TVF), respectively, with a simultaneous electroencephalography (EEG) recording to assess the electroencephalogram (EEG) response underlying different types of feedback. Behavioral and psychophysical assessments were also administered in each feedback condition.Results. EEG results showed that VF played a predominant role in GFC and BABC tasks. It was reflected by a significantly lower somatosensory alpha event-related desynchronization (ERD) in TVF than in TF and no significant difference in visual alpha ERD between TVF and VF. In PFPC task, there was no significant difference in somatosensory alpha ERD between TF and TVF, while a significantly lower visual alpha ERD was found in TVF than in VF, indicating that TF was essential in situations related to proprioceptive position perception. Tactile-visual integration was found when TF and VF were congruently implemented, showing an obvious activation over the premotor cortex in the three tasks. Behavioral and psychophysical results were consistent with EEG evaluations.Significance. Our findings could provide neural evidence for multi-sensory integration and functional roles of tactile and VF in a practical setting of prosthesis control, shedding a multi-dimensional insight into the functional mechanisms of sensory feedback.

A soft neuroprosthetic hand providing simultaneous myoelectric control and tactile feedback.

Neuroprosthetic hands are typically heavy (over 400 g) and expensive (more than US$10,000), and lack the compliance and tactile feedback of human hands. Here, we report the design, fabrication and performance of a soft, low-cost and lightweight (292 g) neuroprosthetic hand that provides simultaneous myoelectric control and tactile feedback. The neuroprosthesis has six active degrees of freedom under pneumatic actuation, can be controlled through the input from four electromyography sensors that measure surface signals from residual forearm muscles, and integrates five elastomeric capacitive sensors on the fingertips to measure touch pressure so as to enable tactile feedback by eliciting electrical stimulation on the skin of the residual limb. In a set of standardized tests performed by two individuals with transradial amputations, we show that the soft neuroprosthetic hand outperforms a conventional rigid neuroprosthetic hand in speed and dexterity. We also show that one individual with a transradial amputation wearing the soft neuroprosthetic hand can regain primitive touch sensation and real-time closed-loop control.

A Novel and Efficient Surface Electromyography Decomposition Algorithm Using Local Spatial Information.

Motor unit spike trains (MUSTs) decomposed from surface electromyography (sEMG) have been an emerging solution for neural interfacing, especially for the control of upper limb prosthetics. Accurate and efficient decomposition techniques are essential and desirable. However, most decomposition methods are designed for motor units (MUs) with global maximum of single or large muscle, while in general forearm muscles are usually small and slender with low global energy. Thus, we propose a novel approach using local spatial information towards more accurate and efficient sEMG decomposition of forearm muscles. A fast spatial spike detection method is proposed to replace the time-consuming iteration process of blind source separation (BSS) methods. Here, spatial distribution characteristics of motor unit action potential are leveraged to pre-classify the candidate MUs, and further to create initial MU templates, aiming to avoid repeating convergence to high-energy MUs. The results of both simulated and experimental sEMG signals show that low-energy MUs from small muscles are more easily found compared with conventional BSS algorithm. Specifically, the proposed method can identify more 40% reliable MUs while only 30% consuming time are needed. The outcomes provide a novel solution for more efficient sEMG decomposition, potentially paving the way of MUST-based non-invasive neural interface.

A Novel Automated RGB-D Sensor-Based Measurement of Voluntary Items of the Fugl-Meyer Assessment for Upper Extremity: A Feasibility Study.

Motor function assessment is essential for post-stroke rehabilitation, while the requirement for professional therapists' participation in current clinical assessment limits its availability to most patients. By means of sensors that collect the motion data and algorithms that conduct assessment based on such data, an automated system can be built to optimize the assessment process, benefiting both patients and therapists. To this end, this paper proposed an automated Fugl-Meyer Assessment (FMA) upper extremity system covering all 30 voluntary items of the scale. RGBD sensors, together with force sensing resistor sensors were used to collect the patients' motion information. Meanwhile, both machine learning and rule-based logic classification were jointly employed for assessment scoring. Clinical validation on 20 hemiparetic stroke patients suggests that this system is able to generate reliable FMA scores. There is an extremely high correlation coefficient (r = 0.981, p < 0.01) with that yielded by an experienced therapist. This study offers guidance and feasible solutions to a complete and independent automated assessment system.

Neural inputs from spinal motor neurons to lateralis vastus muscle: Comparison between sprinters and nonathletes.

The adaptation of neural contractile properties has been observed in previous work. However, the neural changes on the motor unit (MU) level remain largely unknown. Voluntary movements are controlled through the precise activation of MU populations. In this work, we estimate the neural inputs from the spinal motor neurons to the muscles during isometric contractions and characterize the neural adaptation during training by comparing the MU properties decomposed from sprinters and nonathletes. Twenty subjects were recruited and divided into two groups. The high-density surface electromyography (EMG) signals were recorded from the lateralis vastus muscle during the isometric contraction of knee extension and were then decomposed into MU spike trains. Each MU's action potentials and discharge properties were extracted for comparison across subject groups and tasks. A total of 1097 MUs were identified from all subjects. Results showed that the discharge rates and amplitudes of MUAPs from athletes were significantly higher than those from nonathletes. These results demonstrate the neural adaptations in physical training at the MU population level and indicate the great potential of EMG decomposition in physiological investigations.

Automated intraoperative central sulcus localization and somatotopic mapping using median nerve stimulation.

Objective. Accurate identification of functional cortical regions is essential in neurological resection. The central sulcus (CS) is an important landmark that delineates functional cortical regions. Median nerve stimulation (MNS) is a standard procedure to identify the position of the CS intraoperatively. In this paper, we introduce an automated procedure that uses MNS to rapidly localize the CS and create functional somatotopic maps.Approach. We recorded electrocorticographic signals from 13 patients who underwent MNS in the course of an awake craniotomy. We analyzed these signals to develop an automated procedure that determines the location of the CS and that also produces functional somatotopic maps.Main results. The comparison between our automated method and visual inspection performed by the neurosurgeon shows that our procedure has a high sensitivity (89%) in identifying the CS. Further, we found substantial concordance between the functional somatotopic maps generated by our method and passive functional mapping (92% sensitivity).Significance. Our automated MNS-based method can rapidly localize the CS and create functional somatotopic maps without imposing additional burden on the clinical procedure. With additional development and validation, our method may lead to a diagnostic tool that guides neurosurgeons and reduces postoperative morbidity in patients undergoing resective brain surgery.

Segment-Wise Decomposition of Surface Electromyography to Identify Discharges Across Motor Neuron Populations.

OBJECTIVE: The surface electromyography (EMG) decomposition techniques have shown promising results in neurophysiologic investigations, clinical diagnosis, and human-machine interfacing. However, current decomposition methods could only decode a limited number of motor units (MUs) because of the local convergence. The number of identified MUs remains similar even though more muscles or movements are involved, where multiple motor neuron populations are activated. The objective of this study was to develop a segment-wise decomposition strategy to increase the number of MU decoded from multiple motor neuron populations. METHODS: The EMG signals were divided into several segments depending on the number of involved movements. The motor neurons, activated during each movement, were regarded as a population. The convolution kernel compensation (CKC) method was applied individually for each segment to decode the motor unit discharges from each motor neuron population. The MU filters were obtained in each segment and filtrated to estimate the MU spike trains (MUSTs) from the global EMG signals. The decomposition performance was validated on synthetic and experimental EMG signals. MAIN RESULTS: From synthetic EMG signals generated by two motor neuron populations, the proposed segment-wise CKC (swCKC) decoded significantly more MUs during low and medium excitation levels, with an increased rate of 16.3% to 75.4% compared with the conventional CKC. From experimental signals recorded during ten motor tasks, 133±24 MUs with the pulse-to-noise ratio of 36.6±6.5 dB were identified for each subject by swCKC, whereas the conventional CKC identified only 43±12 MUs. CONCLUSION AND SIGNIFICANCE: These results indicate the feasibility and superiority of the proposed swCKC to decode MU activities across motor neuron populations, extending the potential applications of EMG decomposition for neural decoding during multiple motor tasks.

Electrotactile Feedback Improves Grip Force Control and Enables Object Stiffness Recognition While Using a Myoelectric Hand.

Current myoelectric hands are limited in their ability to provide effective sensory feedback to the users, which highly affects their functionality and utility. Although the sensory information of a myoelectric hand can be acquired with equipped sensors, transforming the sensory signals into effective tactile sensations on users for functional tasks is a largely unsolved challenge. The purpose of this study aims to demonstrate that electrotactile feedback of the grip force improves the sensorimotor control of a myoelectric hand and enables object stiffness recognition. The grip force of a sensorized myoelectric hand was delivered to its users via electrotactile stimulation based on four kinds of typical encoding strategies, including graded (G), linear amplitude (LA), linear frequency (LF), and biomimetic (B) modulation. Object stiffness was encoded with the change of electrotactile sensations triggered by final grip force, as the prosthesis grasped the objects. Ten able-bodied subjects and two transradial amputees were recruited to participate in a dual-task virtual eggs test (VET) and an object stiffness discrimination test (OSDT) to quantify the prosthesis users' ability to handle fragile objects and recognize object stiffnesses, respectively. The quantified results showed that with electrotactile feedback enabled, the four kinds of encoding strategies allowed subjects to better able to handle fragile objects with similar performance, and the subjects were able to differentiate four levels of object stiffness at favorable accuracies (>86%) and high manual efficiency. Strategy LA presented the best stiffness discrimination performance, while strategy B was able to reduce the discrimination time but the discrimination accuracy was not better than the other three strategies. Electrotactile feedback also enhanced prosthesis embodiment and improved the users' confidence in prosthetic control. Outcomes indicate electrotactile feedback can be effectively exploited by the prosthesis users for grip force control and object stiffness recognition, proving the feasibility of functional sensory restoration of myoelectric prostheses equipped with electrotactile feedback.

Spontaneous State Detection Using Time-Frequency and Time-Domain Features Extracted From Stereo-Electroencephalography Traces.

As a minimally invasive recording technique, stereo-electroencephalography (SEEG) measures intracranial signals directly by inserting depth electrodes shafts into the human brain, and thus can capture neural activities in both cortical layers and subcortical structures. Despite gradually increasing SEEG-based brain-computer interface (BCI) studies, the features utilized were usually confined to the amplitude of the event-related potential (ERP) or band power, and the decoding capabilities of other time-frequency and time-domain features have not been demonstrated for SEEG recordings yet. In this study, we aimed to verify the validity of time-domain and time-frequency features of SEEG, where classification performances served as evaluating indicators. To do this, using SEEG signals under intermittent auditory stimuli, we extracted features including the average amplitude, root mean square, slope of linear regression, and line-length from the ERP trace and three traces of band power activities (high-gamma, beta, and alpha). These features were used to detect the active state (including activations to two types of names) against the idle state. Results suggested that valid time-domain and time-frequency features distributed across multiple regions, including the temporal lobe, parietal lobe, and deeper structures such as the insula. Among all feature types, the average amplitude, root mean square, and line-length extracted from high-gamma (60-140 Hz) power and the line-length extracted from ERP were the most informative. Using a hidden Markov model (HMM), we could precisely detect the onset and the end of the active state with a sensitivity of 95.7 ± 1.3% and a precision of 91.7 ± 1.6%. The valid features derived from high-gamma power and ERP in this work provided new insights into the feature selection procedure for further SEEG-based BCI applications.

Phase-amplitude coupling between low-frequency scalp EEG and high-frequency intracranial EEG during working memory task.

Objective. Revealing the relationship between simultaneous scalp electroencephalography (EEG) and intracranial electroencephalography (iEEG) is of great importance for both neuroscientific research and translational applications. However, whether prominent iEEG features in the high-gamma band can be reflected by scalp EEG is largely unknown. To address this, we investigated the phase-amplitude coupling (PAC) phenomenon between the low-frequency band of scalp EEG and the high-gamma band of iEEG.Approach. We analyzed a simultaneous iEEG and scalp EEG dataset acquired under a verbal working memory paradigm from nine epilepsy subjects. The PAC values between pairs of scalp EEG channel and identified iEEG channel were explored. After identifying the frequency combinations and electrode locations that generated the most significant PAC values, we compared the PAC values of different task periods (encoding, maintenance, and retrieval) and memory loads.Main results. We demonstrated that the amplitude of high-gamma activities in the entorhinal cortex, hippocampus, and amygdala was correlated to the delta or theta phase at scalp locations such as Cz and Pz. In particular, the frequency bin that generated the maximum PAC value centered at 3.16-3.84 Hz for the phase and 50-85 Hz for the amplitude. Moreover, our results showed that PAC values for the retrieval period were significantly higher than those of the encoding and maintenance periods, and the PAC was also influenced by the memory load.Significance. This is the first human simultaneous iEEG and scalp EEG study demonstrating that the amplitude of iEEG high-gamma components is associated with the phase of low-frequency components in scalp EEG. These findings enhance our understanding of multiscale neural interactions during working memory, and meanwhile, provide a new perspective to estimate intracranial high-frequency features with non-invasive neural recordings.