Novel Wearable Device for Mindful Sensorimotor Training: Integrating Motor Decoding and Somatosensory Stimulation for Neurorehabilitation.

Sensorimotor impairment is a prevalent condition requiring effective rehabilitation strategies. This study introduces a novel wearable device for Mindful Sensorimotor Training (MiSMT) designed for sensory and motor rehabilitation. Our MiSMT device combines motor training using myoelectric pattern recognition along sensory training using two tactile displays. This device offers a comprehensive solution, integrating electromyography and haptic feedback, lacking in existing devices. The device features eight electromyography channels, a rechargeable battery, and wireless Bluetooth or Wi-Fi connectivity for seamless communication with a computer or mobile device. Its flexible material allows for adaptability to various body parts, ensuring ease of use in diverse patients. The two tactile displays, with 16 electromagnetic actuators each, provide touch and vibration sensations up to 250 Hz. In this proof-of-concept study, we show improved two-point discrimination after 5 training sessions in participants with intact limbs (p=0.047). We also demonstrated successful acquisition, processing, and decoding of myoelectric signals in offline and online evaluations. In conclusion, the MiSMT device presents a promising tool for sensorimotor rehabilitation by combining motor execution and sensory training benefits. Further studies are required to assess its effectiveness in individuals with sensorimotor impairments. Integrating mindful sensory and motor training with innovative technology can enhance rehabilitation outcomes and improve the quality of life for those with sensorimotor impairments.

A highly integrated bionic hand with neural control and feedback for use in daily life.

Restoration of sensorimotor function after amputation has remained challenging because of the lack of human-machine interfaces that provide reliable control, feedback, and attachment. Here, we present the clinical implementation of a transradial neuromusculoskeletal prosthesis-a bionic hand connected directly to the user's nervous and skeletal systems. In one person with unilateral below-elbow amputation, titanium implants were placed intramedullary in the radius and ulna bones, and electromuscular constructs were created surgically by transferring the severed nerves to free muscle grafts. The native muscles, free muscle grafts, and ulnar nerve were implanted with electrodes. Percutaneous extensions from the titanium implants provided direct skeletal attachment and bidirectional communication between the implanted electrodes and a prosthetic hand. Operation of the bionic hand in daily life resulted in improved prosthetic function, reduced postamputation, and increased quality of life. Sensations elicited via direct neural stimulation were consistently perceived on the phantom hand throughout the study. To date, the patient continues using the prosthesis in daily life. The functionality of conventional artificial limbs is hindered by discomfort and limited and unreliable control. Neuromusculoskeletal interfaces can overcome these hurdles and provide the means for the everyday use of a prosthesis with reliable neural control fixated into the skeleton.

Improved control of a prosthetic limb by surgically creating electro-neuromuscular constructs with implanted electrodes.

Remnant muscles in the residual limb after amputation are the most common source of control signals for prosthetic hands, because myoelectric signals can be generated by the user at will. However, for individuals with amputation higher up the arm, such as an above-elbow (transhumeral) amputation, insufficient muscles remain to generate myoelectric signals to enable control of the lost arm and hand joints, thus making intuitive control of wrist and finger prosthetic joints unattainable. We show that severed nerves can be divided along their fascicles and redistributed to concurrently innervate different types of muscle targets, particularly native denervated muscles and nonvascularized free muscle grafts. We engineered these neuromuscular constructs with implanted electrodes that were accessible via a permanent osseointegrated interface, allowing for bidirectional communication with the prosthesis while also providing direct skeletal attachment. We found that the transferred nerves effectively innervated their new targets as shown by a gradual increase in myoelectric signal strength. This allowed for individual flexion and extension of all five fingers of a prosthetic hand by a patient with a transhumeral amputation. Improved prosthetic function in tasks representative of daily life was also observed. This proof-of-concept study indicates that motor neural commands can be increased by creating electro-neuromuscular constructs using distributed nerve transfers to different muscle targets with implanted electrodes, enabling improved control of a limb prosthesis.

HANDdata - first-person dataset including proximity and kinematics measurements from reach-to-grasp actions.

HANDdata is a dataset designed to provide hand kinematics and proximity vision data during reach to grasp actions of non-virtual objects, specifically tailored for autonomous grasping of a robotic hand, and with particular attention to the reaching phase. Thus, we sought to capture target object characteristics from radar and time-of-flight proximity sensors, as well as details of the reach-to-grasp action by looking at wrist and fingers kinematics, and at hand-object interaction main events. We structured the data collection as a sequence of static and grasping tasks, organized by increasing levels of complexity. HANDdata is a first-person, reach-to-grasp dataset that includes almost 6000 human-object interactions from 29 healthy adults, with 10 standardized objects of 5 different shapes and 2 kinds of materials. We believe that such data collection can be of value for researchers interested in autonomous grasping robots for healthcare and industrial applications, as well as for those interested in radar-based computer vision and in basic aspects of sensorimotor control and manipulation.

Development and Validation of a Wearable Device to Provide Rich Somatosensory Stimulation for Rehabilitation After Sensorimotor Impairment.

Training sensory discrimination of the skin has the potential to reduce chronic pain due to sensorimotor impairments and increase sensorimotor function. Currently, there is no such device that can systematically provide rich skin stimulation suitable for a training protocol for individuals with amputation or major sensory impairment. This study describes the development and validation of a non-invasive wearable device meant to repeatedly and safely deliver somatosensory stimulations. The development was guided by a structured design control process to ensure the verifiability and validity of the design outcomes. Two sub-systems were designed: 1) a tactile display for touch and vibration sensations, and 2) a set of bands for sliding, pressure, and strain sensations. The device was designed with a versatile structure that allows for its application on different body parts. We designed a device-paired interactive computer program to enable structured sensory training sessions. Validation was performed with 11 individuals with intact limbs whose upper arm tactile sensitivity was measured over 5 training sessions. Tactile discrimination and perception threshold were measured using the standard 2-point discrimination and Semmes-Weinstein monofilament tests, respectively. The results of the monofilament test showed a significant improvement (p = 0.011), but the improvement was not significant for the 2-point discrimination test(p = 0.141). These promising results confirm the potential of the proposed training to increase the sensory acuity in the upper arms of individuals with intact limbs. Further studies will be conducted to determine how to transfer the findings of this work to improve the pain and/or functional rehabilitation in individuals with sensorimotor impairments.

Decoding of Multiple Wrist and Hand Movements Using a Transient EMG Classifier.

The design of prosthetic controllers by means of neurophysiological signals still poses a crucial challenge to bioengineers. State of the art of electromyographic (EMG) continuous pattern recognition controllers rely on the questionable assumption that repeated muscular contractions produce repeatable patterns of steady-state EMG signals. Conversely, we propose an algorithm that decodes wrist and hand movements by processing the signals that immediately follow the onset of contraction (i.e., the transient EMG). We collected EMG data from the forearms of 14 non-amputee and 5 transradial amputee participants while they performed wrist flexion/extension, pronation/supination, and four hand grasps (power, lateral, bi-digital, open). We firstly identified the combination of wrist and hand movements that yielded the best control performance for the same participant (intra-subject classification). Then, we assessed the ability of our algorithm to classify participant data that were not included in the training set (cross-subject classification). Our controller achieved a median accuracy of ~96% with non-amputees, while it achieved heterogeneous outcomes with amputees, with a median accuracy of ~89%. Importantly, for each amputee, it produced at least one acceptable combination of wrist-hand movements (i.e., with accuracy >85%). Regarding the cross-subject classifier, while our algorithm obtained promising results with non-amputees (accuracy up to ~80%), they were not as good with amputees (accuracy up to ~35%), possibly suggesting further assessments with domain-adaptation strategies. In general, our offline outcomes, together with a preliminary online assessment, support the hypothesis that the transient EMG decoding could represent a viable pattern recognition strategy, encouraging further online assessments.

Cross-Channel Impedance Measurement for Monitoring Implanted Electrodes.

Implanted electrodes, such as those used for cochlear implants, brain-computer interfaces, and prosthetic limbs, rely on particular electrical conditions for optimal operation. Measurements of electrical impedance can be a diagnostic tool to monitor implanted electrodes for changing conditions arising from glial scarring, encapsulation, and shorted or broken wires. Such measurements provide information about the electrical impedance between a single electrode and its electrical reference, but offer no insights into the overall network of impedances between electrodes. Other solutions generally rely on geometrical assumptions of the arrangement of the electrodes and may not generalize to other electrode networks. Here, we propose a linear algebra-based approach, Cross-Channel Impedance Measurement (CCIM), for measuring a network of impedances between electrodes which all share a common electrical reference. This is accomplished by measuring the voltage response from all electrodes to a known current applied between each electrode and the shared reference, and is agnostic to the number and arrangement of electrodes. The approach is validated using a simulated 8-electrode network, demonstrating direct impedance measurements between electrodes and the reference with 96.6% ±0.2% accuracy, and cross-channel impedance measurements with 93.3% ±0.6% accuracy in a typical system. Subsequent analyses on randomized systems demonstrate the sensitivity of the model to impedance range and measurement noise. Clinical Relevance- CCIM provides a system-agnostic diagnostic test for implanted electrode networks, which may aid in the longitudinal tracking of electrode performance and early identification of electronics failures.

Extra-neural signals from severed nerves enable intrinsic hand movements in transhumeral amputations.

Robotic prostheses controlled by myoelectric signals can restore limited but important hand function in individuals with upper limb amputation. The lack of individual finger control highlights the yet insurmountable gap to fully replacing a biological hand. Implanted electrodes around severed nerves have been used to elicit sensations perceived as arising from the missing limb, but using such extra-neural electrodes to record motor signals that allow for the decoding of phantom movements has remained elusive. Here, we showed the feasibility of using signals from non-penetrating neural electrodes to decode intrinsic hand and finger movements in individuals with above-elbow amputations. We found that information recorded with extra-neural electrodes alone was enough to decode phantom hand and individual finger movements, and as expected, the addition of myoelectric signals reduced classification errors both in offline and in real-time decoding.

Competitive motivation increased home use and improved prosthesis self-perception after Cybathlon 2020 for neuromusculoskeletal prosthesis user.

BACKGROUND: Assistive technologies, such as arm prostheses, are intended to improve the quality of life of individuals with physical disabilities. However, certain training and learning is usually required from the user to make these technologies more effective. Moreover, some people can be encouraged to train more through competitive motivation. METHODS: In this study, we investigated if the training for and participation in a competitive event (Cybathlon 2020) could promote behavioral changes in an individual with upper limb amputation (the pilot). We defined behavioral changes as the active time while his prosthesis was actuated, ratio of opposing and simultaneous movements, and the pilot's ability to finely modulate his movement speeds. The investigation was based on extensive home-use data from the period before, during and after the Cybathlon 2020 competition. RESULTS: Relevant behavioral changes were found from both quantitative and qualitative analyses. The pilot's home use of his prosthesis nearly doubled in the period before the Cybathlon, and remained 66% higher than baseline after the competition. Moreover, he improved his speed modulation when controlling his prosthesis, and he learned and routinely operated new movements in the prosthesis (wrist rotation) at home. Additionally, as confirmed by semi-structured interviews, his self-perception of the prosthetic arm and its functionality also improved. CONCLUSIONS: An event like the Cybathlon may indeed promote behavioral changes in how competitive individuals with amputation use their prostheses. Provided that the prosthesis is suitable in terms of form and function for both competition and at-home daily use, daily activities can become opportunities for training, which in turn can improve prosthesis function and create further opportunities for daily use. Moreover, these changes appeared to remain even well after the event, albeit relevant only for individuals who continue using the technology employed in the competition.

Chronic Use of a Sensitized Bionic Hand Does Not Remap the Sense of Touch.

Electrical stimulation of tactile nerve fibers that innervated an amputated hand results in vivid sensations experienced at a specific location on the phantom hand, a phenomenon that can be leveraged to convey tactile feedback through bionic hands. Ideally, electrically evoked sensations would be experienced on the appropriate part of the hand: touch with the bionic index fingertip, for example, would elicit a sensation experienced on the index fingertip. However, the perceived locations of sensations are determined by the idiosyncratic position of the stimulating electrode in the nerve and thus are difficult to predict or control. This problem could be circumvented if perceived sensations shifted over time to become consistent with the position of the sensor that triggers them. We show that, after long-term use of a neuromusculoskeletal prosthesis that featured a mismatch between the sensor location and the resulting tactile experience, the perceived location of the touch did not change.

Neural feedback strategies to improve grasping coordination in neuromusculoskeletal prostheses.

Conventional prosthetic arms suffer from poor controllability and lack of sensory feedback. Owing to the absence of tactile sensory information, prosthetic users must rely on incidental visual and auditory cues. In this study, we investigated the effect of providing tactile perception on motor coordination during routine grasping and grasping under uncertainty. Three transhumeral amputees were implanted with an osseointegrated percutaneous implant system for direct skeletal attachment and bidirectional communication with implanted neuromuscular electrodes. This neuromusculoskeletal prosthesis is a novel concept of artificial limb replacement that allows to extract control signals from electrodes implanted on viable muscle tissue, and to stimulate severed afferent nerve fibers to provide somatosensory feedback. Subjects received tactile feedback using three biologically inspired stimulation paradigms while performing a pick and lift test. The grasped object was instrumented to record grasping and lifting forces and its weight was either constant or unexpectedly changed in between trials. The results were also compared to the no-feedback control condition. Our findings confirm, in line with the neuroscientific literature, that somatosensory feedback is necessary for motor coordination during grasping. Our results also indicate that feedback is more relevant under uncertainty, and its effectiveness can be influenced by the selected neuromodulation paradigm and arguably also the prior experience of the prosthesis user.

Self-Contained Neuromusculoskeletal Arm Prostheses.

We report the use of a bone-anchored, self-contained robotic arm with both sensory and motor components over 3 to 7 years in four patients after transhumeral amputation. The implant allowed for bidirectional communication between a prosthetic hand and electrodes implanted in the nerves and muscles of the upper arm and was anchored to the humerus through osseointegration, the process in which bone cells attach to an artificial surface without formation of fibrous tissue. Use of the device did not require formal training and depended on the intuitive intent of the user to activate movement and sensory feedback from the prosthesis. Daily use resulted in increasing sensory acuity and effectiveness in work and other activities of daily life. (Funded by the Promobilia Foundation and others.).

Grip control and motor coordination with implanted and surface electrodes while grasping with an osseointegrated prosthetic hand.

BACKGROUND: Replacement of a lost limb by an artificial substitute is not yet ideal. Resolution and coordination of motor control approximating that of a biological limb could dramatically improve the functionality of prosthetic devices, and thus reduce the gap towards a suitable limb replacement. METHODS: In this study, we investigated the control resolution and coordination exhibited by subjects with transhumeral amputation who were implanted with epimysial electrodes and an osseointegrated interface that provides bidirectional communication in addition to skeletal attachment (e-OPRA Implant System). We assessed control resolution and coordination in the context of routine and delicate grasping using the Pick and Lift and the Virtual Eggs Tests. Performance when utilizing implanted electrodes was compared with the standard-of-care technology for myoelectric prostheses, namely surface electrodes. RESULTS: Results showed that implanted electrodes provide superior controllability over the prosthetic terminal device compared to conventional surface electrodes. Significant improvements were found in the control of the grip force and its reliability during object transfer. However, these improvements failed to increase motor coordination, and surprisingly decreased the temporal correlation between grip and load forces observed with surface electrodes. We found that despite being more functional and reliable, prosthetic control via implanted electrodes still depended highly on visual feedback. CONCLUSIONS: Our findings indicate that incidental sensory feedback (visual, auditory, and osseoperceptive in this case) is insufficient for restoring natural grasp behavior in amputees, and support the idea that supplemental tactile sensory feedback is needed to learn and maintain the motor tasks internal model, which could ultimately restore natural grasp behavior in subjects using prosthetic hands.

Myoelectric signals and pattern recognition from implanted electrodes in two TMR subjects with an osseointegrated communication interface.

Permanent implantation of electrodes for prosthetic control is now possible using an osseointegrated implant as a long-term stable communication interface (e-OPRA). The number of myoelectric sites to host such electrodes can be increased by Targeted Muscle Reinnervation (TMR). Traditionally, patients need to wait several months before the TMR signals are strong enough to be recorded by electrodes placed over the skin. In this study, we report the evolution of the TMR myoelectric signals recorded from two subjects via implanted electrodes using e-OPRA, and monitored for up to 48 weeks after surgery. The signals were analyzed with regard to amplitude (signal-to-noise ratio), independence (cross-correlation) and myoelectric pattern recognition (classification accuracy). TMR signals appeared at the first follow-up, one month post-surgery, and developed around 20 dB by the last. Cross-correlation between signals decreased over time and converged to a few percentage points. Classification accuracies were over 97% by the last follow up. These preliminary results suggest that implanted electrodes via the e-OPRA interface allow for an earlier and more effective use of motor signals from TMR sites compared to conventional skin surface electrodes.

An Alternative Myoelectric Pattern Recognition Approach for the Control of Hand Prostheses: A Case Study of Use in Daily Life by a Dysmelia Subject.

The functionality of upper limb prostheses can be improved by intuitive control strategies that use bioelectric signals measured at the stump level. One such strategy is the decoding of motor volition via myoelectric pattern recognition (MPR), which has shown promising results in controlled environments and more recently in clinical practice. Moreover, not much has been reported about daily life implementation and real-time accuracy of these decoding algorithms. This paper introduces an alternative approach in which MPR allows intuitive control of four different grips and open/close in a multifunctional prosthetic hand. We conducted a clinical proof-of-concept in activities of daily life by constructing a self-contained, MPR-controlled, transradial prosthetic system provided with a novel user interface meant to log errors during real-time operation. The system was used for five days by a unilateral dysmelia subject whose hand had never developed, and who nevertheless learned to generate patterns of myoelectric activity, reported as intuitive, for multi-functional prosthetic control. The subject was instructed to manually log errors when they occurred via the user interface mounted on the prosthesis. This allowed the collection of information about prosthesis usage and real-time classification accuracy. The assessment of capacity for myoelectric control test was used to compare the proposed approach to the conventional prosthetic control approach, direct control. Regarding the MPR approach, the subject reported a more intuitive control when selecting the different grips, but also a higher uncertainty during proportional continuous movements. This paper represents an alternative to the conventional use of MPR, and this alternative may be particularly suitable for a certain type of amputee patients. Moreover, it represents a further validation of MPR with dysmelia cases.

Evaluation of Computer-Based Target Achievement Tests for Myoelectric Control.

Real-time evaluation of novel prosthetic control schemes is critical for translational research on artificial limbs. Recently, two computer-based, real-time evaluation tools, the target achievement control (TAC) test and the Fitts' law test (FLT), have been proposed to assess real-time controllability. Whereas TAC tests provides an anthropomorphic visual representation of the limb at the cost of confusing visual feedback, FLT clarifies the current and target locations by simplified non-anthropomorphic representations. Here, we investigated these two approaches and quantified differences in common performance metrics that can result from the chosen method of visual feedback. Ten able-bodied and one amputee subject performed target achievement tasks corresponding to the FLT and TAC test with equivalent indices of difficulty. Able-bodied subjects exhibited significantly (p <0.05) better completion rate, path efficiency, and overshoot when performing the FLT, although no significant difference was seen in throughput performance. The amputee subject showed significantly better performance in overshoot at the FLT, but showed no significant difference in completion rate, path efficiency, and throughput. Results from the FLT showed a strong linear relationship between the movement time and the index of difficulty (R2 = 0.96), whereas TAC test results showed no apparent linear relationship (R2 = 0.19). These results suggest that in relatively similar conditions, the confusing location of virtual limb representation used in the TAC test contributed to poorer performance. Establishing an understanding of the biases of various evaluation protocols is critical to the translation of research into clinical practice.

Real-time Classification of Non-Weight Bearing Lower-Limb Movements Using EMG to Facilitate Phantom Motor Execution: Engineering and Case Study Application on Phantom Limb Pain.

Phantom motor execution (PME), facilitated by myoelectric pattern recognition (MPR) and virtual reality (VR), is positioned to be a viable option to treat phantom limb pain (PLP). A recent clinical trial using PME on upper-limb amputees with chronic intractable PLP yielded promising results. However, further work in the area of signal acquisition is needed if such technology is to be used on subjects with lower-limb amputation. We propose two alternative electrode configurations to conventional, bipolar, targeted recordings for acquiring surface electromyography. We evaluated their performance in a real-time MPR task for non-weight-bearing, lower-limb movements. We found that monopolar recordings using a circumferential electrode of conductive fabric, performed similarly to classical bipolar recordings, but were easier to use in a clinical setting. In addition, we present the first case study of a lower-limb amputee with chronic, intractable PLP treated with PME. The patient's Pain Rating Index dropped by 22 points (from 32 to 10, 68%) after 23 PME sessions. These results represent a methodological advancement and a positive proof-of-concept of PME in lower limbs. Further work remains to be conducted for a high-evidence level clinical validation of PME as a treatment of PLP in lower-limb amputees.

Embedded System for Prosthetic Control Using Implanted Neuromuscular Interfaces Accessed Via an Osseointegrated Implant.

Despite the technological progress in robotics achieved in the last decades, prosthetic limbs still lack functionality, reliability, and comfort. Recently, an implanted neuromusculoskeletal interface built upon osseointegration was developed and tested in humans, namely the Osseointegrated Human-Machine Gateway. Here, we present an embedded system to exploit the advantages of this technology. Our artificial limb controller allows for bioelectric signals acquisition, processing, decoding of motor intent, prosthetic control, and sensory feedback. It includes a neurostimulator to provide direct neural feedback based on sensory information. The system was validated using real-time tasks characterization, power consumption evaluation, and myoelectric pattern recognition performance. Functionality was proven in a first pilot patient from whom results of daily usage were obtained. The system was designed to be reliably used in activities of daily living, as well as a research platform to monitor prosthesis usage and training, machine-learning-based control algorithms, and neural stimulation paradigms.

Analog Front-Ends comparison in the way of a portable, low-power and low-cost EMG controller based on pattern recognition EMBC 2015.

Compact and low-noise Analog Front-Ends (AFEs) are becoming increasingly important for the acquisition of bioelectric signals in portable system. In this work, we compare two popular AFEs available on the market, namely the ADS1299 (Texas Instruments) and the RHA2216 (Intan Technologies). This work develops towards the identification of suitable acquisition modules to design an affordable, reliable and portable device for electromyography (EMG) acquisition and prosthetic control. Device features such as Common Mode Rejection (CMR), Input Referred Noise (IRN) and Signal to Noise Ratio (SNR) were evaluated, as well as the resulting accuracy in myoelectric pattern recognition (MPR) for the decoding of motion intention. Results reported better noise performances and higher MPR accuracy for the ADS1299 and similar SNR values for both devices.