Real-time strap pressure sensor system for powered exoskeletons.

Assistive and rehabilitative powered exoskeletons for spinal cord injury (SCI) and stroke subjects have recently reached the clinic. Proper tension and joint alignment are critical to ensuring safety. Challenges still exist in adjustment and fitting, with most current systems depending on personnel experience for appropriate individual fastening. Paraplegia and tetraplegia patients using these devices have impaired sensation and cannot signal if straps are uncomfortable or painful. Excessive pressure and blood-flow restriction can lead to skin ulcers, necrotic tissue and infections. Tension must be just enough to prevent slipping and maintain posture. Research in pressure dynamics is extensive for wheelchairs and mattresses, but little research has been done on exoskeleton straps. We present a system to monitor pressure exerted by physical human-machine interfaces and provide data about levels of skin/body pressure in fastening straps. The system consists of sensing arrays, signal processing hardware with wireless transmission, and an interactive GUI. For validation, a lower-body powered exoskeleton carrying the full weight of users was used. Experimental trials were conducted with one SCI and one able-bodied subject. The system can help prevent skin injuries related to excessive pressure in mobility-impaired patients using powered exoskeletons, supporting functionality, independence and better overall quality of life.

Towards a Portable Magnetoencephalography Based Brain Computer Interface with Optically-Pumped Magnetometers.

Brain Computer Interfaces (BCIs) allow individuals to control devices, machines and prostheses with their thoughts. Most feasibility studies with BCIs have utilized scalp electroencephalography (EEG), due to it being accessible, noninvasive, and portable. While BCIs have been studied with magnetoencephalography (MEG), the modality has limited applications due to the large immobile hardware. Here we propose that room-temperature, optically-pumped magnetometers (OPMs) can potentially serve a portable modality that can be used for BCIs. OPMs have the added advantage that low-frequency neuromagnetic fields are not affected by volume conduction, which is known to distort EEG signals. In this feasibility study, we tested an OPM system with a real-time BCI where able bodied participants controlled a cursor to reach two targets. This BCI system used alpha and beta-band power modulations associated with hand movements. Our preliminary results show significant alpha and beta-band desynchronization due to movement, as found in previous literature.

Towards a Unified Framework for De-noising Neural Signals.

Neural signals provide key information for decision-making processes in multiple disciplines including medicine, engineering, and neuroscience. The correct interpretation of these signals, however, requires substantial processing, especially when the signals exhibit low Signal to Noise Ratio (SNR). Electroencephalographic (EEG) signals are considered among this group and require effective handling of multiple types of artifactual components. Unfortunately, most available de-noising tools are suitable only for offline signal processing. For some artifacts (e.g., EEG motion artifacts), no established method of effective denoising exists for offline or real-time applications. Thus, there is a critical need for methods that can handle artifacts in neural signals with high performance, reliability and real-time capability. Here, we propose novel methods for handling some of the most challenging artifacts that exhibit highly complex dynamics, including motion artifacts. Having the same core sample-adaptive processing tool used for handling different types of artifacts, we present our efforts towards a unified framework for neural data artifact denoising with real-time compatibility.

Characterization and real-time removal of motion artifacts from EEG signals.

OBJECTIVE: Accurate implementation of real-time non-invasive brain-machine/computer interfaces (BMI/BCI) requires handling physiological and nonphysiological artifacts associated with the measurement modalities. For example, scalp electroencephalographic (EEG) measurements are often considered prone to excessive motion artifacts and other types of artifacts that contaminate the EEG recordings. Although the magnitude of such artifacts heavily depends on the task and the setup, complete minimization or isolation of such artifacts is generally not possible. APPROACH: We present an adaptive de-noising framework with robustness properties, using a Volterra based non-linear mapping to characterize and handle the motion artifact contamination in EEG measurements. We asked healthy able-bodied subjects to walk on a treadmill at gait speeds of 1-to-4 mph, while we tracked the motion of select EEG electrodes with an infrared video-based motion tracking system. We also placed inertial measurement unit (IMU) sensors on the forehead and feet of the subjects for assessing the overall head movement and segmenting the gait. MAIN RESULTS: We discuss in detail the characteristics of the motion artifacts and propose a real-time compatible solution to filter them. We report the effective handling of both the fundamental frequency of contamination (synchronized to the walking speed) and its harmonics. Event-related spectral perturbation (ERSP) analysis for walking shows that the gait dependency of artifact contamination is also eliminated on all target frequencies. SIGNIFICANCE: The real-time compatibility and generalizability of our adaptive filtering framework allows for the effective use of non-invasive BMI/BCI systems and greatly expands the implementation type and application domains to other types of problems where signal denoising is desirable. Combined with our previous efforts of filtering ocular artifacts, the presented technique allows for a comprehensive adaptive filtering framework to increase the EEG signal to noise ratio (SNR). We believe the implementation will benefit all non-invasive neural measurement modalities, including studies discussing neural correlates of movement and other internal states, not necessarily of BMI focus.

Classification and Transfer Learning of EEG during a Kinesthetic Motor Imagery Task using Deep Convolutional Neural Networks.

The reliable classification of Electroencephalography (EEG) signals is a crucial step towards making EEG-controlled non-invasive neuro-exoskeleton rehabilitation a practical reality. EEG signals collected during motor imagery tasks have been proposed to act as a control signal for exoskeleton applications. Here, a Deep Convolutional Neural Network (DCNN) was optimized to classify a two-class kinesthetic motor imagery EEG dataset, leading to an optimized architecture consisting of four convolutional layers and three fully connected layers. Transfer learning, or the leveraging of data from past subjects to classify the intentions of a new subject, is important for rehabilitation as it helps to minimize the number of training sessions required from subjects who lack full motor functionality. The transfer learning training paradigm investigated through this study utilized region criticality trends to reduce the number of new subject training sessions and increase the classification performance when compared against a single-subject non-transfer-learning classifier.

Multiple Kernel Based Region Importance Learning for Neural Classification of Gait States from EEG Signals.

With the development of Brain Machine Interface (BMI) systems, people with motor disabilities are able to control external devices to help them restore movement abilities. Longitudinal validation of these systems is critical not only to assess long-term performance reliability but also to investigate adaptations in electrocortical patterns due to learning to use the BMI system. In this paper, we decode the patterns of user's intended gait states (e.g., stop, walk, turn left, and turn right) from scalp electroencephalography (EEG) signals and simultaneously learn the relative importance of different brain areas by using the multiple kernel learning (MKL) algorithm. The region of importance (ROI) is identified during training the MKL for classification. The efficacy of the proposed method is validated by classifying different movement intentions from two subjects-an able-bodied and a spinal cord injury (SCI) subject. The preliminary results demonstrate that frontal and fronto-central regions are the most important regions for the tested subjects performing gait movements, which is consistent with the brain regions hypothesized to be involved in the control of lower-limb movements. However, we observed some regional changes comparing the able-bodied and the SCI subject. Moreover, in the longitudinal experiments, our findings exhibit the cortical plasticity triggered by the BMI use, as the classification accuracy and the weights for important regions-in sensor space-generally increased, as the user learned to control the exoskeleton for movement over multiple sessions.

A robust adaptive denoising framework for real-time artifact removal in scalp EEG measurements.

OBJECTIVE: Non-invasive measurement of human neural activity based on the scalp electroencephalogram (EEG) allows for the development of biomedical devices that interface with the nervous system for scientific, diagnostic, therapeutic, or restorative purposes. However, EEG recordings are often considered as prone to physiological and non-physiological artifacts of different types and frequency characteristics. Among them, ocular artifacts and signal drifts represent major sources of EEG contamination, particularly in real-time closed-loop brain-machine interface (BMI) applications, which require effective handling of these artifacts across sessions and in natural settings. APPROACH: We extend the usage of a robust adaptive noise cancelling (ANC) scheme ([Formula: see text] filtering) for removal of eye blinks, eye motions, amplitude drifts and recording biases simultaneously. We also characterize the volume conduction, by estimating the signal propagation levels across all EEG scalp recording areas due to ocular artifact generators. We find that the amplitude and spatial distribution of ocular artifacts vary greatly depending on the electrode location. Therefore, fixed filtering parameters for all recording areas would naturally hinder the true overall performance of an ANC scheme for artifact removal. We treat each electrode as a separate sub-system to be filtered, and without the loss of generality, they are assumed to be uncorrelated and uncoupled. MAIN RESULTS: Our results show over 95-99.9% correlation between the raw and processed signals at non-ocular artifact regions, and depending on the contamination profile, 40-70% correlation when ocular artifacts are dominant. We also compare our results with the offline independent component analysis and artifact subspace reconstruction methods, and show that some local quantities are handled better by our sample-adaptive real-time framework. Decoding performance is also compared with multi-day experimental data from 2 subjects, totaling 19 sessions, with and without [Formula: see text] filtering of the raw data. SIGNIFICANCE: The proposed method allows real-time adaptive artifact removal for EEG-based closed-loop BMI applications and mobile EEG studies in general, thereby increasing the range of tasks that can be studied in action and context while reducing the need for discarding data due to artifacts. Significant increase in decoding performances also justify the effectiveness of the method to be used in real-time closed-loop BMI applications.

Sitting and standing intention can be decoded from scalp EEG recorded prior to movement execution.

Low frequency signals recorded from non-invasive electroencephalography (EEG), in particular movement-related cortical potentials (MRPs), are associated with preparation and execution of movement and thus present a target for use in brain-machine interfaces. We investigated the ability to decode movement intent from delta-band (0.1-4 Hz) EEG recorded immediately before movement execution in healthy volunteers. We used data from epochs starting 1.5 s before movement onset to classify future movements into one of three classes: stand-up, sit-down, or quiet. We assessed classification accuracy in both externally triggered and self-paced paradigms. Movement onset was determined from electromyography (EMG) recordings synchronized with EEG signals. We employed an artifact subspace reconstruction (ASR) algorithm to eliminate high amplitude noise before building our time-embedded EEG features. We applied local Fisher's discriminant analysis to reduce the dimensionality of our spatio-temporal features and subsequently used a Gaussian mixture model classifier for our three class problem. Our results demonstrate significantly better than chance classification accuracy (chance level = 33.3%) for the self-initiated (78.0 ± 2.6%) and triggered (74.7 ± 5.7%) paradigms. Surprisingly, we found no significant difference in classification accuracy between the self-paced and cued paradigms when using the full set of non-peripheral electrodes. However, accuracy was significantly increased for self-paced movements when only electrodes over the primary motor area were used. Overall, this study demonstrates that delta-band EEG recorded immediately before movement carries discriminative information regarding movement type. Our results suggest that EEG-based classifiers could improve lower-limb neuroprostheses and neurorehabilitation techniques by providing earlier detection of movement intent, which could be used in robot-assisted strategies for motor training and recovery of function.

High accuracy decoding of user intentions using EEG to control a lower-body exoskeleton.

Brain-Machine Interface (BMI) systems allow users to control external mechanical systems using their thoughts. Commonly used in literature are invasive techniques to acquire brain signals and decode user's attempted motions to drive these systems (e.g. a robotic manipulator). In this work we use a lower-body exoskeleton and measure the users brain activity using non-invasive electroencephalography (EEG). The main focus of this study is to decode a paraplegic subject's motion intentions and provide him with the ability of walking with a lower-body exoskeleton accordingly. We present our novel method of decoding with high offline evaluation accuracies (around 98%), our closed loop implementation structure with considerably short on-site training time (around 38 sec), and preliminary results from the real-time closed loop implementation (NeuroRex) with a paraplegic test subject.

Classification of stand-to-sit and sit-to-stand movement from low frequency EEG with locality preserving dimensionality reduction.

Recent studies have demonstrated decoding of lower extremity limb kinematics from noninvasive electroencephalography (EEG), showing feasibility for development of an EEG-based brain-machine interface (BMI) to restore mobility following paralysis. Here, we present a new technique that preserves the statistical richness of EEG data to classify movement state from time-embedded low frequency EEG signals. We tested this new classifier, using cross-validation procedures, during sit-to-stand and stand-to-sit activity in 10 subjects and found decoding accuracy of greater than 95% on average. These results suggest that this classification technique could be used in a BMI system that, when combined with a robotic exoskeleton, can restore functional movement to individuals with paralysis.

Simultaneous scalp electroencephalography (EEG), electromyography (EMG), and whole-body segmental inertial recording for multi-modal neural decoding.

Recent studies support the involvement of supraspinal networks in control of bipedal human walking. Part of this evidence encompasses studies, including our previous work, demonstrating that gait kinematics and limb coordination during treadmill walking can be inferred from the scalp electroencephalogram (EEG) with reasonably high decoding accuracies. These results provide impetus for development of non-invasive brain-machine-interface (BMI) systems for use in restoration and/or augmentation of gait- a primary goal of rehabilitation research. To date, studies examining EEG decoding of activity during gait have been limited to treadmill walking in a controlled environment. However, to be practically viable a BMI system must be applicable for use in everyday locomotor tasks such as over ground walking and turning. Here, we present a novel protocol for non-invasive collection of brain activity (EEG), muscle activity (electromyography (EMG)), and whole-body kinematic data (head, torso, and limb trajectories) during both treadmill and over ground walking tasks. By collecting these data in the uncontrolled environment insight can be gained regarding the feasibility of decoding unconstrained gait and surface EMG from scalp EEG.