Nonlinear Mapping From EMG to Prosthesis Closing Velocity Improves Force Control With EMG Biofeedback.

When using EMG biofeedback to control the grasping force of a myoelectric prosthesis, subjects need to activate their muscles and maintain the myoelectric signal within an appropriate interval. However, their performance decreases for higher forces, because the myoelectric signal is more variable for stronger contractions. Therefore, the present study proposes to implement EMG biofeedback using nonlinear mapping, in which EMG intervals of increasing size are mapped to equal-sized intervals of the prosthesis velocity. To validate this approach, 20 non-disabled subjects performed force-matching tasks using Michelangelo prosthesis with and without EMG biofeedback with linear and nonlinear mapping. Additionally, four transradial amputees performed a functional task in the same feedback and mapping conditions. The success rate in producing desired force was significantly higher with feedback (65.4±15.9%) compared to no feedback (46.2±14.9%) as well as when using nonlinear (62.4±16.8%) versus linear mapping (49.2±17.2%). Overall, in non-disabled subjects, the highest success rate was obtained when EMG biofeedback was combined with nonlinear mapping (72%), and the opposite for linear mapping with no feedback (39.6%). The same trend was registered also in four amputee subjects. Therefore, EMG biofeedback improved prosthesis force control, especially when combined with nonlinear mapping, which showed to be an effective approach to counteract increasing variability of myoelectric signal for stronger contractions.

A review of user needs to drive the development of lower limb prostheses.

BACKGROUND: The development of bionic legs has seen substantial improvements in the past years but people with lower-limb amputation still suffer from impairments in mobility (e.g., altered balance and gait control) due to significant limitations of the contemporary prostheses. Approaching the problem from a human-centered perspective by focusing on user-specific needs can allow identifying critical improvements that can increase the quality of life. While there are several reviews of user needs regarding upper limb prostheses, a comprehensive summary of such needs for those affected by lower limb loss does not exist. METHODS: We have conducted a systematic review of the literature to extract important needs of the users of lower-limb prostheses. The review included 56 articles in which a need (desire, wish) was reported explicitly by the recruited people with lower limb amputation (N = 8149). RESULTS: An exhaustive list of user needs was collected and subdivided into functional, psychological, cognitive, ergonomics, and other domain. Where appropriate, we have also briefly discussed the developments in prosthetic devices that are related to or could have an impact on those needs. In summary, the users would like to lead an independent life and reintegrate into society by coming back to work and participating in social and leisure activities. Efficient, versatile, and stable gait, but also support to other activities (e.g., sit to stand), contribute to safety and confidence, while appearance and comfort are important for the body image. However, the relation between specific needs, objective measures of performance, and overall satisfaction and quality of life is still an open question. CONCLUSIONS: Identifying user needs is a critical step for the development of new generation lower limb prostheses that aim to improve the quality of life of their users. However, this is not a simple task, as the needs interact with each other and depend on multiple factors (e.g., mobility level, age, gender), while evolving in time with the use of the device. Hence, novel assessment methods are required that can evaluate the impact of the system from a holistic perspective, capturing objective outcomes but also overall user experience and satisfaction in the relevant environment (daily life).

Increase and Decrease in Velocity and Force During Exercise with a Hybrid Robotic-FES Rehabilitation System.

Early rehabilitation is beneficial for stroke patients, but it is often delayed since the patients are often bedbound due to their general condition. New robotic rehabilitation devices such as ROBERT® enable patients to exercise even while bedbound. During pilot testing of an automated FES-delivery system combined with ROBERT®, we observed both increased and decreased exerted velocity and interaction force during repetitive exercising with the system. The goal of the current study was thus to investigate the extent of both potentiation and fatigue, as assessed in the velocity and interaction force produced in response to repetitive robotic-FES exercising. Eight healthy subjects completed 50 repetitions of leg-press exercises using the hybrid robotic-FES system. For individual subjects, significant changes were found for both mean and maximal velocities and interaction forces exerted during the exercise. Roughly half of the subjects had an increase in maximal velocity and interaction force during the exercise, and half exhibited an increase in mean velocity, whereas three subjects had an increase in mean interaction force during the exercise. The changes in mean velocity were in the range of -40.6 to 30.9% and for the maximal velocity they were in the range of -21.9 to 22.0%. The changes for mean interaction force were in the range of -5.8 to 11.0%, while for the maximal interaction force, they were in the range of -7.8 to 14.4%. These changes might pose significant challenges for future developments of hybrid robotic-FES rehabilitation systems, as the system must be able to comply with the observed changes, and appropriately adapt to them in order to maintain efficacy and safety.

A compact system for simultaneous stimulation and recording for closed-loop myoelectric control.

BACKGROUND: Despite important advancements in control and mechatronics of myoelectric prostheses, the communication between the user and his/her bionic limb is still unidirectional, as these systems do not provide somatosensory feedback. Electrotactile stimulation is an attractive technology to close the control loop since it allows flexible modulation of multiple parameters and compact interface design via multi-pad electrodes. However, the stimulation interferes with the recording of myoelectric signals and this can be detrimental to control. METHODS: We present a novel compact solution for simultaneous recording and stimulation through dynamic blanking of stimulation artefacts. To test the system, a feedback coding scheme communicating wrist rotation and hand aperture was developed specifically to stress the myoelectric control while still providing meaningful information to the subjects. Ten subjects participated in an experiment, where the quality of closed-loop myoelectric control was assessed by controlling a cursor in a two degrees of freedom target-reaching task. The benchmark performance with visual feedback was compared to that achieved by combining visual feedback and electrotactile stimulation as well as by using electrotactile feedback only. RESULTS: There was no significant difference in performance between visual and combined feedback condition with regards to successfully reached targets, time to reach a target, path efficiency and the number of overshoots. Therefore, the quality of myoelectric control was preserved in spite of the stimulation. As expected, the tactile condition was significantly poorer in completion rate (100/4% and 78/25% for combined and tactile condition, respectively) and time to reach a target (9/2 s and 13/4 s for combined and tactile condition, respectively). However, the performance in the tactile condition was still good, with no significant difference in path efficiency (38/8%) and the number of overshoots (0.5/0.4 overshoots), indicating that the stimulation was meaningful for the subjects and useful for closed-loop control. CONCLUSIONS: Overall, the results demonstrated that the developed system can provide robust closed-loop control using electrotactile stimulation. The system supports different encoding schemes and allows placing the recording and stimulation electrodes next to each other. This is an important step towards an integrated solution where the developed unit will be embedded into a prosthetic socket.

Generative Adversarial Networks-Based Data Augmentation for Brain-Computer Interface.

The performance of a classifier in a brain-computer interface (BCI) system is highly dependent on the quality and quantity of training data. Typically, the training data are collected in a laboratory where the users perform tasks in a controlled environment. However, users' attention may be diverted in real-life BCI applications and this may decrease the performance of the classifier. To improve the robustness of the classifier, additional data can be acquired in such conditions, but it is not practical to record electroencephalogram (EEG) data over several long calibration sessions. A potentially time- and cost-efficient solution is artificial data generation. Hence, in this study, we proposed a framework based on the deep convolutional generative adversarial networks (DCGANs) for generating artificial EEG to augment the training set in order to improve the performance of a BCI classifier. To make a comparative investigation, we designed a motor task experiment with diverted and focused attention conditions. We used an end-to-end deep convolutional neural network for classification between movement intention and rest using the data from 14 subjects. The results from the leave-one subject-out (LOO) classification yielded baseline accuracies of 73.04% for diverted attention and 80.09% for focused attention without data augmentation. Using the proposed DCGANs-based framework for augmentation, the results yielded a significant improvement of 7.32% for diverted attention ( ) and 5.45% for focused attention ( ). In addition, we implemented the method on the data set IVa from BCI competition III to distinguish different motor imagery tasks. The proposed method increased the accuracy by 3.57% ( ). This study shows that using GANs for EEG augmentation can significantly improve BCI performance, especially in real-life applications, whereby users' attention may be diverted.

The Variability of Psychophysical Parameters Following Surface and Subdermal Stimulation: A Multiday Study in Amputees.

Electrotactile stimulation has been suggested as a modality for providing sensory feedback in upper limb prostheses. This study investigates the multiday variability of subdermal and surface stimulation. Electrical stimulation was delivered using either surface or fine wire electrodes placed right under the skin in eight amputees for seven consecutive days. The variability of psychophysical measurements, including detection threshold (DT), pain threshold (PT), dynamic range (DR), just noticeable difference (JND), Weber fraction (WF) and quality of evoked sensations, was evaluated using the coefficient of variation (CoV). In addition, the systematic change in the mean of the parameters across days was assessed in both stimulation modalities. In the case of DT, PT, DR, and perceived intensity at 100 Hz, the CoV of surface stimulation was significantly smaller than that of subdermal stimulation. Only PT showed a significant systematic change in the mean value across days for both modalities. The outcome of this study has implications for the choice of modality in delivering sensory feedback, though the significance of the quantified variability needs to be evaluated using usability tests with user feedback.

A thin-film multichannel electrode for muscle recording and stimulation in neuroprosthetics applications.

OBJECTIVE: We propose, design and test a novel thin-film multichannel electrode that can be used for both recording from and stimulating a muscle in acute implants. APPROACH: The system is built on a substrate of polyimide and contains 12 recording and three stimulation sites made of platinum. The structure is 420 µm wide, 20 µm thick and embeds the recording and stimulation contacts on the two sides of the polyimide over an approximate length of 2 cm. We show representative applications in healthy individuals as well as tremor patients. The designed system was tested by a psychometric characterization of the stimulation contacts in six tremor patients and three healthy individuals determining the perception threshold and current limit as well as the success rate in discriminating elicited sensations (electrotactile feedback). Also, we investigated the possibility of using the intramuscular electrode for reducing tremor in one patient by electrical stimulation delivered with timing based on the electromyographic activity recorded with the same electrode. MAIN RESULTS: In the tremor patients, the current corresponding to the perception threshold and the current limit were 0.7 ± 0.2 and 1.4 ± 0.7 mA for the wrist flexor muscles and 0.4 ± 0.2 and 1.5 ± 0.7 mA for the extensors. In one patient, closed-loop stimulation resulted in a decrease of the tremor power >50%. In healthy individuals the perception threshold and current limits were 0.9 ± 0.6 and 2.1 ± 0.6 mA for the extensor carpi radialis muscle. The subjects could distinguish four or six stimulation patterns (two or three stimulation sites × two stimulation current amplitudes) with true positive rate >80% (two subjects) and >60% (one subject), respectively. SIGNIFICANCE: The proposed electrode provides a compact multichannel interface for recording electromyogram and delivering electrical stimulation in applications such as neuroprostheses for tremor suppression and closed-loop myoelectric prostheses.

Psychophysical Evaluation of Subdermal Electrical Stimulation in Relation to Prosthesis Sensory Feedback.

This paper evaluated the psychophysical properties of subdermal electrical stimulation to investigate its feasibility in providing sensory feedback for limb prostheses. The detection threshold (DT), pain threshold (PT), just noticeable difference (JND), as well as the elicited sensation quality, comfort, intensity, and location were assessed in 16 healthy volunteers during stimulation of the ventral and dorsal forearm with subdermal electrodes. Moreover, the results were compared with those obtained from transcutaneous electrical stimulation. Despite a lower DT and PT, subdermal stimulation attained a greater relative dynamic range (i.e., PT/DT) and significantly smaller JNDs for stimulation amplitude. Muscle twitches and movements were more commonly elicited by surface stimulation, especially at the higher stimulation frequencies, whereas the pinprick sensation was more often reported with subdermal stimulation. Less comfort was perceived in subdermal stimulation of the ventral forearm at the highest tested stimulation frequency of 100 Hz. In summary, subdermal electrical stimulation was demonstrated to be able to produce similar sensation quality as transcutaneous stimulation and outperformed the latter in terms of energy efficiency and sensitivity. These results suggest that stimulation through implantable subdermal electrodes may lead to an efficient and compact sensory feedback system for substituting the lost sense in amputees.

GLIMPSE: Google Glass interface for sensory feedback in myoelectric hand prostheses.

OBJECTIVE: Providing sensory feedback to the user of the prosthesis is an important challenge. The common approach is to use tactile stimulation, which is easy to implement but requires training and has limited information bandwidth. In this study, we propose an alternative approach based on augmented reality. APPROACH: We have developed the GLIMPSE, a Google Glass application which connects to the prosthesis via a Bluetooth interface and renders the prosthesis states (EMG signals, aperture, force and contact) using augmented reality (see-through display) and sound (bone conduction transducer). The interface was tested in healthy subjects that used the prosthesis with (FB group) and without (NFB group) feedback during a modified clothespins test that allowed us to vary the difficulty of the task. The outcome measures were the number of unsuccessful trials, the time to accomplish the task, and the subjective ratings of the relevance of the feedback. MAIN RESULTS: There was no difference in performance between FB and NFB groups in the case of a simple task (basic, same-color clothespins test), but the feedback significantly improved the performance in a more complex task (pins of different resistances). Importantly, the GLIMPSE feedback did not increase the time to accomplish the task. Therefore, the supplemental feedback might be useful in the tasks which are more demanding, and thereby less likely to benefit from learning and feedforward control. The subjects integrated the supplemental feedback with the intrinsic sources (vision and muscle proprioception), developing their own idiosyncratic strategies to accomplish the task. SIGNIFICANCE: The present study demonstrates a novel self-contained, ready-to-deploy, wearable feedback interface. The interface was successfully tested and was proven to be feasible and functionally beneficial. The GLIMPSE can be used as a practical solution but also as a general and flexible instrument to investigate closed-loop prosthesis control.

Online tremor suppression using electromyography and low-level electrical stimulation.

Tremor is one of the most prevalent movement disorders. There is a large proportion of patients (around 25%) in whom current treatments do not attain a significant tremor reduction. This paper proposes a tremor suppression strategy that detects tremor from the electromyographic signals of the muscles from which tremor originates and counteracts it by delivering electrical stimulation to the antagonist muscles in an out of phase manner. The detection was based on the iterative Hilbert transform and stimulation was delivered above the motor threshold (motor stimulation) and below the motor threshold (sensory stimulation). The system was tested on six patients with predominant wrist flexion/extension tremor (four with Parkinson disease and two with Essential tremor) and led to an average tremor reduction in the range of 46%-81% and 35%-48% across five patients when using the motor and sensory stimulation, respectively. In one patient, the system did not attenuate tremor. These results demonstrate that tremor attenuation might be achieved by delivering electrical stimulation below the motor threshold, preventing muscle fatigue and discomfort for the patients, which sets the basis for the development of an alternative treatment for tremor.

Closed-Loop Control of Myoelectric Prostheses With Electrotactile Feedback: Influence of Stimulation Artifact and Blanking.

Electrocutaneous stimulation is a promising approach to provide sensory feedback to amputees, and thus close the loop in upper limb prosthetic systems. However, the stimulation introduces artifacts in the recorded electromyographic (EMG) signals, which may be detrimental for the control of myoelectric prostheses. In this study, artifact blanking with three data segmentation approaches was investigated as a simple method to restore the performance of pattern recognition in prosthesis control (eight motions) when EMG signals are corrupted by stimulation artifacts. The methods were tested over a range of stimulation conditions and using four feature sets, comprising both time and frequency domain features. The results demonstrated that when stimulation artifacts were present, the classification performance improved with blanking in all tested conditions. In some cases, the classification performance with blanking was at the level of the benchmark (artifact-free data). The greatest pulse duration and frequency that allowed a full performance recovery were 400 µs and 150 Hz, respectively. These results show that artifact blanking can be used as a practical solution to eliminate the negative influence of the stimulation artifact on EMG pattern classification in a broad range of conditions, thus allowing to close the loop in myoelectric prostheses using electrotactile feedback.

Electrical stimulation for the suppression of pathological tremor.

Pathological tremor is manifested as an involuntary oscillation of one or more body parts. Tremor greatly decreases the quality of life and often prevents the patient from performing daily activities. We hypothesized that sensors-driven multichannel electrical stimulation could stabilize affected joints by activating the antagonistic muscles during involuntary activation of agonist muscles and vice versa (out-of-phase stimulation). Here, we present the new system (hardware and software) and the testing of its operation. The hardware consists of a multichannel stimulator and inertial sensors for feedback. The software implements adaptive sensors-driven control for the out-of-phase stimulation. The system was initially applied to healthy persons at the wrist and elbow joints to test the efficiency of the hardware and software solutions. Predefined rhythmic stimulation resulted in tremulous movement, which subjects could not prevent; yet, they were still able to functionally use their hand. The system was then applied to seven patients with Parkinson's disease and essential tremor for minimization of the wrist joint tremor. In six patients, the adaptive out-of-phase stimulation resulted in a significant decrease in the amplitude of tremor (67 ± 13%). In one patient, the stimulation did not result in the expected reduction of tremor.

Moving-window dynamic optimization: design of stimulation profiles for walking.

The overall goal of the research is to improve control for electrical stimulation-based assistance of walking in hemiplegic individuals. We present the simulation for generating offline input (sensors)-output (intensity of muscle stimulation) representation of walking that serves in synthesizing a rule-base for control of electrical stimulation for restoration of walking. The simulation uses new algorithm termed moving-window dynamic optimization (MWDO). The optimization criterion was to minimize the sum of the squares of tracking errors from desired trajectories with the penalty function on the total muscle efforts. The MWDO was developed in the MATLAB environment and tested using target trajectories characteristic for slow-to-normal walking recorded in healthy individual and a model with the parameters characterizing the potential hemiplegic user. The outputs of the simulation are piecewise constant intensities of electrical stimulation and trajectories generated when the calculated stimulation is applied to the model. We demonstrated the importance of this simulation by showing the outputs for healthy and hemiplegic individuals, using the same target trajectories. Results of the simulation show that the MWDO is an efficient tool for analyzing achievable trajectories and for determining the stimulation profiles that need to be delivered for good tracking.

Lumbar stimulation belt for therapy of low-back pain.

We developed the STIMBELT, an electrical stimulation system that comprises a lumbar belt with up to eight pairs of embedded electrodes and an eight-channel electronic stimulator. The STIMBELT is an assistive system for the treatment of low-back pain (LBP). We describe here technical details of the system and summarize the results of its application in individuals with subacute and chronic LBP. The direct goals of the treatment were to relieve pain, reduce muscle spasms, increase strength and range of motion, and educate individuals with LBP in reducing the chances of its reoccurrence. The outcome measures include: a Visual Analogue Scale (VAS), the Oswestry LBP Disability Questionnaire, the Short Form (SF)-12 health survey, and the Manual Muscle Test. The results indicate significant benefits for individuals who use the STIMBELT in addition to the conventional therapy as opposed to only the conventional therapy.