Integrating Upper-Limb Prostheses with the Human Body: Technology Advances, Readiness, and Roles in Human-Prosthesis Interaction.

Significant advances in bionic prosthetics have occurred in the past two decades. The field's rapid expansion has yielded many exciting technologies that can enhance the physical, functional, and cognitive integration of a prosthetic limb with a human. We review advances in the engineering of prosthetic devices and their interfaces with the human nervous system, as well as various surgical techniques for altering human neuromusculoskeletal systems for seamless human-prosthesis integration. We discuss significant advancements in research and clinical translation, focusing on upper limbprosthetics since they heavily rely on user intent for daily operation, although many discussed technologies have been extended to lower limb prostheses as well. In addition, our review emphasizes the roles of advanced prosthetics technologies in complex interactions with humans and the technology readiness levels (TRLs) of individual research advances. Finally, we discuss current gaps and controversies in the field and point out future research directions, guided by TRLs.

Biomimetic versus arbitrary motor control strategies for bionic hand skill learning.

A long-standing engineering ambition has been to design anthropomorphic bionic limbs: devices that look like and are controlled in the same way as the biological body (biomimetic). The untested assumption is that biomimetic motor control enhances device embodiment, learning, generalization and automaticity. To test this, we compared biomimetic and non-biomimetic control strategies for non-disabled participants when learning to control a wearable myoelectric bionic hand operated by an eight-channel electromyography pattern-recognition system. We compared motor learning across days and behavioural tasks for two training groups: biomimetic (mimicking the desired bionic hand gesture with biological hand) and arbitrary control (mapping an unrelated biological hand gesture with the desired bionic gesture). For both trained groups, training improved bionic limb control, reduced cognitive reliance and increased embodiment over the bionic hand. Biomimetic users had more intuitive and faster control early in training. Arbitrary users matched biomimetic performance later in training. Furthermore, arbitrary users showed increased generalization to a new control strategy. Collectively, our findings suggest that biomimetic and arbitrary control strategies provide different benefits. The optimal strategy is probably not strictly biomimetic, but rather a flexible strategy within the biomimetic-to-arbitrary spectrum, depending on the user, available training opportunities and user requirements.

Implications of EMG channel count: enhancing pattern recognition online prosthetic testing.

Introduction: Myoelectric pattern recognition systems have shown promising control of upper limb powered prostheses and are now commercially available. These pattern recognition systems typically record from up to 8 muscle sites, whereas other control systems use two-site control. While previous offline studies have shown 8 or fewer sites to be optimal, real-time control was not evaluated. Methods: Six individuals with no limb absence and four individuals with a transradial amputation controlled a virtual upper limb prosthesis using pattern recognition control with 8 and 16 channels of EMG. Additionally, two of the individuals with a transradial amputation performed the Assessment for Capacity of Myoelectric Control (ACMC) with a multi-articulating hand and wrist prosthesis with the same channel count conditions. Results: Users had significant improvements in control when using 16 compared to 8 EMG channels including decreased classification error (p = 0.006), decreased completion time (p = 0.019), and increased path efficiency (p = 0.013) when controlling a virtual prosthesis. ACMC scores increased by more than three times the minimal detectable change from the 8 to the 16-channel condition. Discussion: The results of this study indicate that increasing EMG channel count beyond the clinical standard of 8 channels can benefit myoelectric pattern recognition users.

Evaluating the partial contribution of the P3 event-related potential elicited by auditory oddball stimuli during the Stroop task.

The cognitive load of a precisely timed task, such as the Stroop task, may be measured through the use of event-related potentials (ERPs). To determine the time at which cognitive load is at its peak, oddball tones may be applied at various times surrounding a cognitive task. However, we need to determine whether the simultaneous presentation of auditory and visual stimuli would mask a potential change in P3 in an ERP-producing task. If the contribution of the Stroop stimulus is too large, then Stroop ERP with oddball stimuli occurring at different timepoints may not be directly comparable across the various timepoints due to the contribution of the Stroop ERP. The aim of this study was to measure the magnitude of the difference wave between that of simultaneously presented stimuli and that of linearly added stimuli of separate responses. Participants were fitted with a dry-sensor EEG cap and were presented with a series of Stroop and auditory stimuli. For some Stroop stimuli, auditory stimuli occurred simultaneously or in a close time proximity to the Stroop stimuli. We sought to estimate the linear contribution of the ERP from Stroop and oddball stimuli. We found that the magnitude of the difference waves were 3.07 ± 1.65 µV and 2.82 ± 1.34 µV for congruent and incongruent stimuli, respectively. As the average amplitude in the P3 region for both the congruent and incongruent difference waves was lower than the magnitude of the auditory oddball presented simultaneously with Stroop stimuli (12.13 ± 1.00 µV for congruent and 11.78 ± 1.05 µV for incongruent Stroop), we expect that the contribution of P3 auditory oddball would not mask a potential Stroop effect even if the timing of the auditory oddball stimuli were experimentally manipulated, a direction that we hope to explore in future work. In conclusion, we determine this paradigm is suitable for measuring cognitive load in precisely timed tasks.Clinical Relevance- This study establishes the efficacy of presenting a Stroop task as a proxy for a cognitive challenge that could cause cognitive overload.

Machine Learning-Based Gait Mode Prediction for Hybrid Knee Prosthesis Control.

Recently, hybrid prosthetic knees, which can combine the advantages of passive and active prosthetic knees, have been proposed for individuals with a transfemoral amputation. Users could potentially take advantage of the passive knee mechanics during walking and the active power generation during stair ascent. One challenge in controlling the hybrid knees is accurate gait mode prediction for seamless transitions between passive and active modes. However, data imbalance between passive and active modes may impact the performance of a classifier. In this study, we used a dataset collected from nine individuals with a unilateral transfemoral amputation as they ambulated over level ground, inclines, and stairs. We evaluated several machine learning-based classifiers on the prediction of passive (level-ground walking, incline walking, descending stairs, and donning and doffing the prosthesis) and active mode (ascending stairs). In addition, we developed a generative adversarial network (GAN) to create synthetic data for improving classification performance. The results indicated that linear discriminant analysis and random forest might be the best classifiers regarding sensitivity to the active mode and overall accuracy, respectively. Further, we demonstrated that using the GAN-based synthetic data for training improves the sensitivity of classifiers.

Haptic Human-Human Interaction During an Ankle Tracking Task: Effects of Virtual Connection Stiffness.

While treating sensorimotor impairments, a therapist may provide physical assistance by guiding their patient's limb to teach a desired movement. In this scenario, a key aspect is the compliance of the interaction, as the therapist can provide subtle cues or impose a movement as demonstration. One approach to studying these interactions involves haptically connecting two individuals through robotic interfaces. Upper-limb studies have shown that pairs of connected individuals estimate one another's goals during tracking tasks by exchanging haptic information, resulting in improved performance dependent on the ability of one's partner and the stiffness of the virtual connection. In this study, our goal was to investigate whether these findings generalize to the lower limb during an ankle tracking task. Pairs of healthy participants (i.e., dyads) independently tracked target trajectories with and without connections rendered between two ankle robots. We tested the effects of connection stiffness as well as visual noise to manipulate the correlation of tracking errors between partners. In our analysis, we compared changes in task performance across conditions while tracking with and without the connection. We found that tracking improvements while connected increased with connection stiffness, favoring the worse partner in the dyad during hard connections. We modeled the interaction as three springs in series, considering the stiffness of the connection and each partners' ankle, to show that improvements were likely due to a cancellation of random tracking errors between partners. These results suggest a simplified mechanism of improvements compared to what has been reported during upper-limb dyadic tracking.

Generating synthetic gait patterns based on benchmark datasets for controlling prosthetic legs.

BACKGROUND: Prosthetic legs help individuals with an amputation regain locomotion. Recently, deep neural network (DNN)-based control methods, which take advantage of the end-to-end learning capability of the network, have been proposed. One prominent challenge for these learning-based approaches is obtaining data for the training, particularly for the training of a mid-level controller. In this study, we propose a method for generating synthetic gait patterns (vertical load and lower limb joint angles) using a generative adversarial network (GAN). This approach enables a mid-level controller to execute ambulation modes that are not included in the training datasets. METHODS: The conditional GAN is trained on benchmark datasets that contain the gait data of individuals without amputation; synthetic gait patterns are generated from the user input. Further, a DNN-based controller for the generation of impedance parameters is trained using the synthetic gait pattern and the corresponding synthetic stiffness and damping coefficients. RESULTS: The trained GAN generated synthetic gait patterns with a coefficient of determination of 0.97 and a structural similarity index of 0.94 relative to benchmark data that were not included in the training datasets. We trained a DNN-based controller using the GAN-generated synthetic gait patterns for level-ground walking, standing-to-sitting motion, and sitting-to-standing motion. Four individuals without amputation participated in bypass testing and demonstrated the ambulation modes. The model successfully generated control parameters for the knee and ankle based on thigh angle and vertical load. CONCLUSIONS: This study demonstrates that synthetic gait patterns can be used to train DNN models for impedance control. We believe a conditional GAN trained on benchmark datasets can provide reliable gait data for ambulation modes that are not included in its training datasets. Thus, designing gait data using a conditional GAN could facilitate the efficient and effective training of controllers for prosthetic legs.

Electromyography-Based Control of Lower Limb Prostheses: A Systematic Review.

Most amputations occur in lower limbs and despite improvements in prosthetic technology, no commercially available prosthetic leg uses electromyography (EMG) information as an input for control. Efforts to integrate EMG signals as part of the control strategy have increased in the last decade. In this systematic review, we summarize the research in the field of lower limb prosthetic control using EMG. Four different online databases were searched until June 2022: Web of Science, Scopus, PubMed, and Science Direct. We included articles that reported systems for controlling a prosthetic leg (with an ankle and/or knee actuator) by decoding gait intent using EMG signals alone or in combination with other sensors. A total of 1,331 papers were initially assessed and 121 were finally included in this systematic review. The literature showed that despite the burgeoning interest in research, controlling a leg prosthesis using EMG signals remains challenging. Specifically, regarding EMG signal quality and stability, electrode placement, prosthetic hardware, and control algorithms, all of which need to be more robust for everyday use. In the studies that were investigated, large variations were found between the control methodologies, type of research participant, recording protocols, assessments, and prosthetic hardware.

Dry EEG measurement of P3 to evaluate cognitive load during sitting, standing, and walking.

Combining brain imaging with dual-task paradigms provides a quantitative, direct metric of cognitive load that is agnostic to the motor task. This work aimed to quantitatively assess cognitive load during activities of daily living-sitting, standing, and walking-using a commercial dry encephalography headset. We recorded participants' brain activity while engaging in a stimulus paradigm that elicited event-related potentials. The stimulus paradigm consisted of an auditory oddball task in which participants had to report the number of oddball tones that were heard during each motor task. We extracted the P3 event-related potential, which is inversely proportional to cognitive load, from EEG signals in each condition. Our main findings showed that P3 was significantly lower during walking compared to sitting (p = .039), suggesting that cognitive load was higher during walking compared to the other activities. There were no significant differences in P3 between sitting and standing. Head motion did not have a significant impact on the measurement of cognitive load. This work validates the use of a commercial dry-EEG headset for measuring cognitive load across different motor tasks. The ability to accurately measure cognitive load in dynamic activities opens new avenues for exploring cognitive-motor interactions in individuals with and without motor impairments. This work highlights the potential of dry EEG for measuring cognitive load in naturalistic settings.

Powered knee and ankle prosthesis use with a K2 level ambulator: a case report.

Powered prosthetic knees and ankles have the capability of restoring power to the missing joints and potential to provide increased functional mobility to users. Nearly all development with these advanced prostheses is with individuals who are high functioning community level ambulators even though limited community ambulators may also receive great benefit from these devices. We trained a 70 year old male participant with a unilateral transfemoral amputation to use a powered knee and powered ankle prosthesis. He participated in eight hours of therapist led in-lab training (two hours per week for four weeks). Sessions included static and dynamic balance activities for improved stability and comfort with the powered prosthesis and ambulation training on level ground, inclines, and stairs. Assessments were taken with both the powered prosthesis and his prescribed, passive prosthesis post-training. Outcome measures showed similarities in velocity between devices for level-ground walking and ascending a ramp. During ramp descent, the participant had a slightly faster velocity and more symmetrical stance and step times with the powered prosthesis compared to his prescribed prosthesis. For stairs, he was able to climb with reciprocal stepping for both ascent and descent, a stepping strategy he is unable to do with his prescribed prosthesis. More research with limited community ambulators is necessary to understand if further functional improvements are possible with either additional training, longer accommodation periods, and/or changes in powered prosthesis control strategies.

Should bionic limb control mimic the human body? Impact of control strategy on bionic hand skill learning.

A longstanding engineering ambition has been to design anthropomorphic bionic limbs: devices that look like and are controlled in the same way as the biological body (biomimetic). The untested assumption is that biomimetic motor control enhances device embodiment, learning, generalization, and automaticity. To test this, we compared biomimetic and non-biomimetic control strategies for able-bodied participants when learning to operate a wearable myoelectric bionic hand. We compared motor learning across days and behavioural tasks for two training groups: Biomimetic (mimicking the desired bionic hand gesture with biological hand) and Arbitrary control (mapping an unrelated biological hand gesture with the desired bionic gesture). For both trained groups, training improved bionic limb control, reduced cognitive reliance, and increased embodiment over the bionic hand. Biomimetic users had more intuitive and faster control early in training. Arbitrary users matched biomimetic performance later in training. Further, arbitrary users showed increased generalization to a novel control strategy. Collectively, our findings suggest that biomimetic and arbitrary control strategies provide different benefits. The optimal strategy is likely not strictly biomimetic, but rather a flexible strategy within the biomimetic to arbitrary spectrum, depending on the user, available training opportunities and user requirements.

Wrist speed feedback improves elbow compensation and reaching accuracy for myoelectric transradial prosthesis users in hybrid virtual reaching task.

BACKGROUND: Myoelectric prostheses are a popular choice for restoring motor capability following the loss of a limb, but they do not provide direct feedback to the user about the movements of the device-in other words, kinesthesia. The outcomes of studies providing artificial sensory feedback are often influenced by the availability of incidental feedback. When subjects are blindfolded and disconnected from the prosthesis, artificial sensory feedback consistently improves control; however, when subjects wear a prosthesis and can see the task, benefits often deteriorate or become inconsistent. We theorize that providing artificial sensory feedback about prosthesis speed, which cannot be precisely estimated via vision, will improve the learning and control of a myoelectric prosthesis. METHODS: In this study, we test a joint-speed feedback system with six transradial amputee subjects to evaluate how it affects myoelectric control and adaptation behavior during a virtual reaching task. RESULTS: Our results showed that joint-speed feedback lowered reaching errors and compensatory movements during steady-state reaches. However, the same feedback provided no improvement when control was perturbed. CONCLUSIONS: These outcomes suggest that the benefit of joint speed feedback may be dependent on the complexity of the myoelectric control and the context of the task.

Myoelectric prosthesis hand grasp control following targeted muscle reinnervation in individuals with transradial amputation.

BACKGROUND: Despite the growing availability of multifunctional prosthetic hands, users' control and overall functional abilities with these hands remain limited. The combination of pattern recognition control and targeted muscle reinnervation (TMR) surgery, an innovative technique where amputated nerves are transferred to reinnervate new muscle targets in the residual limb, has been used to improve prosthesis control of individuals with more proximal upper limb amputations (i.e., shoulder disarticulation and transhumeral amputation). OBJECTIVE: The goal of this study was to determine if prosthesis hand grasp control improves following transradial TMR surgery. METHODS: Eight participants were trained to use a multi-articulating hand prosthesis under myoelectric pattern recognition control. All participated in home usage trials pre- and post-TMR surgery. Upper limb outcome measures were collected following each home trial. RESULTS: Three outcome measures (Southampton Hand Assessment Procedure, Jebsen-Taylor Hand Function Test, and Box and Blocks Test) improved 9-12 months post-TMR surgery compared with pre-surgery measures. The Assessment of Capacity for Myoelectric Control and Activities Measure for Upper Limb Amputees outcome measures had no difference pre- and post-surgery. An offline electromyography analysis showed a decrease in grip classification error post-TMR surgery compared to pre-TMR surgery. Additionally, a majority of subjects noted qualitative improvements in their residual limb and phantom limb sensations post-TMR. CONCLUSIONS: The potential for TMR surgery to result in more repeatable muscle contractions, possibly due to the reduction in pain levels and/or changes to phantom limb sensations, may increase functional use of many of the clinically available dexterous prosthetic hands.

Effect of Dyadic Haptic Collaboration on Ankle Motor Learning and Task Performance.

Optimizing skill acquisition during novel motor tasks and regaining lost motor functions have been the interest of many researchers over the past few decades. One approach shown to accelerate motor learning involves haptically coupling two individuals through robotic interfaces. Studies have shown that an individual's solo performance during upper-limb tracking tasks may improve after haptically-coupled training with a partner. In this study, our goal was to investigate whether these findings can be translated to lower-limb motor tasks, more specifically, during an ankle position tracking task. Using one-degree-of-freedom ankle movements, pairs of participants (i.e., dyads) tracked target trajectories independently. Participants alternated between tracking trials with and without haptic coupling, achieved by rendering a virtual spring between two ankle rehabilitation robots. In our analysis, we compared changes in task performance across trials while training with and without haptic coupling. The tracking performance of both individuals (i.e., dyadic task performance) improved during haptic coupling, which was likely due to averaging of random errors of the dyadic pair during tracking. However, we found that dyadic haptic coupling did not lead to faster individual learning for the tracking task. These results suggest that haptic coupling between unimpaired individuals may not be an effective method of training ankle movements during a simple, one-degree-of-freedom task.

User Performance With a Transradial Multi-Articulating Hand Prosthesis During Pattern Recognition and Direct Control Home Use.

With the increasing availability of more advanced prostheses individuals with a transradial amputation can now be fit with single to multi-degree of freedom hands. Reliable and accurate control of these multi-grip hands still remains challenging. This is the first multi-user study to investigate at-home control and use of a multi-grip hand prosthesis under pattern recognition and direct control. Individuals with a transradial amputation were fitted with and trained to use an OSSUR i-Limb Ultra Revolution with Coapt COMPLETE CONTROL system. They participated in two 8-week home trials using the hand under myoelectric direct and pattern recognition control in a randomized order. While at home, participants demonstrated broader usage of grips in pattern recognition compared to direct control. After the home trial, they showed significant improvements in the Assessment of Capacity for Myoelectric Control (ACMC) outcome measure while using pattern recognition control compared to direct control; other outcome measures showed no differences between control styles. Additionally, this study provided a unique opportunity to evaluate EMG signals during home use. Offline analysis of calibration data showed that users were 81.5% [7.1] accurate across a range of three to five grips. Although EMG signal noise was identified during some calibrations, overall EMG quality was sufficient to provide users with control performance at or better than direct control.

Toward higher-performance bionic limbs for wider clinical use.

Most prosthetic limbs can autonomously move with dexterity, yet they are not perceived by the user as belonging to their own body. Robotic limbs can convey information about the environment with higher precision than biological limbs, but their actual performance is substantially limited by current technologies for the interfacing of the robotic devices with the body and for transferring motor and sensory information bidirectionally between the prosthesis and the user. In this Perspective, we argue that direct skeletal attachment of bionic devices via osseointegration, the amplification of neural signals by targeted muscle innervation, improved prosthesis control via implanted muscle sensors and advanced algorithms, and the provision of sensory feedback by means of electrodes implanted in peripheral nerves, should all be leveraged towards the creation of a new generation of high-performance bionic limbs. These technologies have been clinically tested in humans, and alongside mechanical redesigns and adequate rehabilitation training should facilitate the wider clinical use of bionic limbs.

Corrigendum: Powered knee and ankle prosthesis use with a K2 level ambulator: a case report.

[This corrects the article DOI: 10.3389/fresc.2023.1203545.].

Surface EMG Statistical and Performance Analysis of Targeted-Muscle-Reinnervated (TMR) Transhumeral Prosthesis Users in Home and Laboratory Settings.

A pattern-recognition (PR)-based myoelectric control system is the trend of future prostheses development. Compared with conventional prosthetic control systems, PR-based control systems provide high dexterity, with many studies achieving >95% accuracy in the last two decades. However, most research studies have been conducted in the laboratory. There is limited research investigating how EMG signals are acquired when users operate PR-based systems in their home and community environments. This study compares the statistical properties of surface electromyography (sEMG) signals used to calibrate prostheses and quantifies the quality of calibration sEMG data through separability indices, repeatability indices, and correlation coefficients in home and laboratory settings. The results demonstrate no significant differences in classification performance between home and laboratory environments in within-calibration classification error (home: 6.33 ± 2.13%, laboratory: 7.57 ± 3.44%). However, between-calibration classification errors (home: 40.61 ± 9.19%, laboratory: 44.98 ± 12.15%) were statistically different. Furthermore, the difference in all statistical properties of sEMG signals is significant (p < 0.05). Separability indices reveal that motion classes are more diverse in the home setting. In summary, differences in sEMG signals generated between home and laboratory only affect between-calibration performance.

The impact of added mass placement on metabolic and temporal-spatial characteristics of transfemoral prosthetic gait.

BACKGROUND: Despite prosthetic technology advancements, individuals with transfemoral amputation have compromised temporal-spatial gait parameters and high metabolic requirements for ambulation. It is unclear how adding mass at different locations on a transfemoral prosthesis might affect these outcomes. Research question Does walking with mass added at different locations on a transfemoral prosthesis affect temporal-spatial gait parameters and metabolic requirements compared to walking with no additional mass? METHODS: Fourteen participants with unilateral transfemoral amputations took part. A 1.8 kg mass was added to their prostheses in three locations: Knee, just proximal to the prosthetic knee; Shank, mid-shank on the prosthesis; or Ankle, just proximal to the prosthetic foot. Temporal-spatial gait parameters were collected as participants walked over a GAITRite® walkway and metabolic data were collected during treadmill walking for each of these conditions and with no mass added, the None condition. Separate linear mixed effects models were created and post-hoc tests to compare with the control condition of None were performed with a significance level of 0.05. RESULTS: Overground self-selected walking speed for Ankle was significantly slower than for None (p < 0.05) (None: 1.16 ± 0.24; Knee: 1.15 ± 0.19; Shank: 1.14 ± 0.24; Ankle 0.99 ± 0.20 m/s). Compared to None, Ankle showed significantly increased oxygen consumption during treadmill walking (p < 0.05) (None: 13.82 ± 2.98; Knee: 13.83 ± 2.82; Shank: 14.30 ± 2.89; Ankle 14.56 ± 2.99 ml O2/kg/min). Other metabolic outcomes (power, cost of transport, oxygen cost) showed similar trends. Knee and Shank did not have significant negative effects on any metabolic or temporal-spatial parameters, as compared to None (p > 0.05). Significance Results suggest that additional mass located mid-shank or further proximal on a transfemoral prosthesis may not have negative temporal-spatial or metabolic consequences. Clinicians, researchers, and designers may be able to utilize heavier components, as long as the center of mass is not further distal than mid-shank, without adversely affecting gait parameters or metabolic requirements.

Corrigendum: Functional mobility training with a powered knee and ankle prosthesis.

[This corrects the article DOI: 10.3389/fresc.2022.790538.].