Encoding contact size using static and dynamic electrotactile finger stimulation: natural decoding vs. trained cues.

Electrotactile stimulation through matrix electrodes is a promising technology to restore high-resolution tactile feedback in extended reality applications. One of the fundamental tactile effects that should be simulated is the change in the size of the contact between the finger and a virtual object. The present study investigated how participants perceive the increase of stimulation area when stimulating the index finger using static or dynamic (moving) stimuli produced by activating 1 to 6 electrode pads. To assess the ability to interpret the stimulation from the natural cues (natural decoding), without any prior training, the participants were instructed to draw the size of the stimulated area and identify the size difference when comparing two consecutive stimulations. To investigate if other "non-natural" cues can improve the size estimation, the participants were asked to enumerate the number of active pads following a training protocol. The results demonstrated that participants could perceive the change in size without prior training (e.g., the estimated area correlated with the stimulated area, p < 0.001; ≥ two-pad difference recognized with > 80% success rate). However, natural decoding was also challenging, as the response area changed gradually and sometimes in complex patterns when increasing the number of active pads (e.g., four extra pads needed for the statistically significant difference). Nevertheless, by training the participants to utilize additional cues the limitations of natural perception could be compensated. After the training, the mismatch in the activated and estimated number of pads was less than one pad regardless of the stimulus size. Finally, introducing the movement of the stimulus substantially improved discrimination (e.g., 100% median success rate to recognize ≥ one-pad difference). The present study, therefore, provides insights into stimulation size perception, and practical guidelines on how to modulate pad activation to change the perceived size in static and dynamic scenarios.

Improving electrotactile communication with a multi-pad electrode under cognitive load.

BACKGROUND: Electrotactile systems are compact interfaces that can be used to convey information through the skin by producing a range of haptic sensations. In many applications, however, the user needs to perceive and interpret haptic stimulation while being engaged in parallel activities. Developing methods that ensure reliable recognition of electrotactile messages despite additional cognitive load is, therefore, an important step for the practical application of electrotactile displays. METHODS: This study investigated if a simple strategy of repeating electrotactile messages can improve message identification during multitasking. Ten participants identified 36 spatiotemporal electrotactile messages delivered through a 3 × 2 pad-matrix electrode placed on the torso while performing a concomitant cognitive task in three conditions: the messages were presented once (No-REP), and each message was repeated three (REP3) and five (REP5) times. The main outcome measure was the success rate (SR) of message identification. RESULTS: During multitasking, in the No-REP condition, the SR (median (IQR)) dropped to 56.25% (22.62%), demonstrating that the cognitive task decreased performance. However, the SR significantly improved with message repetitions, reaching 72.92% (21.87%) and 81.25% (18.66%) in REP3 and REP5 conditions respectively, without a statistically significant difference between REP3 and REP5. CONCLUSIONS: Multitasking affected the efficacy of haptic communication, but message repetition was shown to be an effective strategy for improving performance. Additionally, only three repetitions were enough, as an additional increase in the duration of message transmission (5 repetitions) did not lead to further improvement. This study is an important step toward delivering electrotactile communication that can cope with the demands of real-world applications.

Brain computer interface training with motor imagery and functional electrical stimulation for patients with severe upper limb paresis after stroke: a randomized controlled pilot trial.

BACKGROUND: Restorative Brain-Computer Interfaces (BCI) that combine motor imagery with visual feedback and functional electrical stimulation (FES) may offer much-needed treatment alternatives for patients with severely impaired upper limb (UL) function after a stroke. OBJECTIVES: This study aimed to examine if BCI-based training, combining motor imagery with FES targeting finger/wrist extensors, is more effective in improving severely impaired UL motor function than conventional therapy in the subacute phase after stroke, and if patients with preserved cortical-spinal tract (CST) integrity benefit more from BCI training. METHODS: Forty patients with severe UL paresis (< 13 on Action Research Arm Test (ARAT) were randomized to either a 12-session BCI training as part of their rehabilitation or conventional UL rehabilitation. BCI sessions were conducted 3-4 times weekly for 3-4 weeks. At baseline, Transcranial Magnetic Stimulation (TMS) was performed to examine CST integrity. The main endpoint was the ARAT at 3 months post-stroke. A binominal logistic regression was conducted to examine the effect of treatment group and CST integrity on achieving meaningful improvement. In the BCI group, electroencephalographic (EEG) data were analyzed to investigate changes in event-related desynchronization (ERD) during the course of therapy. RESULTS: Data from 35 patients (15 in the BCI group and 20 in the control group) were analyzed at 3-month follow-up. Few patients (10/35) improved above the minimally clinically important difference of 6 points on ARAT, 5/15 in the BCI group, 5/20 in control. An independent-samples Mann-Whitney U test revealed no differences between the two groups, p = 0.382. In the logistic regression only CST integrity was a significant predictor for improving UL motor function, p = 0.007. The EEG analysis showed significant changes in ERD of the affected hemisphere and its lateralization only during unaffected UL motor imagery at the end of the therapy. CONCLUSION: This is the first RCT examining BCI training in the subacute phase where only patients with severe UL paresis were included. Though more patients in the BCI group improved relative to the group size, the difference between the groups was not significant. In the present study, preserved CTS integrity was much more vital for UL improvement than which type of intervention the patients received. Larger studies including only patients with some preserved CST integrity should be attempted.

A compact solution for vibrotactile proprioceptive feedback of wrist rotation and hand aperture.

BACKGROUND: Closing the control loop between users and their prostheses by providing artificial sensory feedback is a fundamental step toward the full restoration of lost sensory-motor functions. METHODS: We propose a novel approach to provide artificial proprioceptive feedback about two degrees of freedom using a single array of 8 vibration motors (compact solution). The performance afforded by the novel method during an online closed-loop control task was compared to that achieved using the conventional approach, in which the same information was conveyed using two arrays of 8 and 4 vibromotors (one array per degree of freedom), respectively. The new method employed Gaussian interpolation to modulate the intensity profile across a single array of vibration motors (compact feedback) to convey wrist rotation and hand aperture by adjusting the mean and standard deviation of the Gaussian, respectively. Ten able-bodied participants and four transradial amputees performed a target achievement control test by utilizing pattern recognition with compact and conventional vibrotactile feedback to control the Hannes prosthetic hand (test conditions). A second group of ten able-bodied participants performed the same experiment in control conditions with visual and auditory feedback as well as no-feedback. RESULTS: Conventional and compact approaches resulted in similar positioning accuracy, time and path efficiency, and total trial time. The comparison with control condition revealed that vibrational feedback was intuitive and useful, but also underlined the power of incidental feedback sources. Notably, amputee participants achieved similar performance to that of able-bodied participants. CONCLUSIONS: The study therefore shows that the novel feedback strategy conveys useful information about prosthesis movements while reducing the number of motors without compromising performance. This is an important step toward the full integration of such an interface into a prosthesis socket for clinical use.

Measuring and monitoring skill learning in closed-loop myoelectric hand prostheses using speed-accuracy tradeoffs.

Objective.Closed-loop myoelectric prostheses, which combine supplementary sensory feedback and electromyography (EMG) based control, hold the potential to narrow the divide between natural and bionic hands. The use of these devices, however, requires dedicated training. Therefore, it is crucial to develop methods that quantify how users acquire skilled control over their prostheses to effectively monitor skill progression and inform the development of interfaces that optimize this process.Approach.Building on theories of skill learning in human motor control, we measured speed-accuracy tradeoff functions (SAFs) to comprehensively characterize learning-induced changes in skill-as opposed to merely tracking changes in task success across training-facilitated by a closed-loop interface that combined proportional control and EMG feedback. Sixteen healthy participants and one individual with a transradial limb loss participated in a three-day experiment where they were instructed to perform the box-and-blocks task using a timed force-matching paradigm at four specified speeds to reach two target force levels, such that the SAF could be determined.Main results.We found that the participants' accuracy increased in a similar way across all speeds we tested. Consequently, the shape of the SAF remained similar across days, at both force levels. Further, we observed that EMG feedback enabled participants to improve their motor execution in terms of reduced trial-by-trial variability, a hallmark of skilled behavior. We then fit a power law model of the SAF, and demonstrated how the model parameters could be used to identify and monitor changes in skill.Significance.We comprehensively characterized how an EMG feedback interface enabled skill acquisition, both at the level of task performance and movement execution. More generally, we believe that the proposed methods are effective for measuring and monitoring user skill progression in closed-loop prosthesis control.

Using mobile eye tracking to measure cognitive load through gaze behavior during walking in lower limb prosthesis users: A preliminary assessment.

BACKGROUND: Lower limb amputation does not affect only physical and psychological functioning but the use of a prosthetic device can also lead to increased cognitive demands. Measuring cognitive load objectively is challenging, and therefore, most studies use questionnaires that are easy to apply but can suffer from subjective bias. Motivated by this, the present study investigated whether a mobile eye tracker can be used to objectively measure cognitive load by monitoring gaze behavior during a set of motor tasks. METHODS: Five prosthetic users and eight able-bodied controls participated in this study. Eye tracking data and kinematics were recorded during a set of motor tasks (level ground walking, walking on uneven terrain, obstacle avoidance, stairs up and ramp down, as well as ramp up and stairs down) while the participants were asked to focus their gaze on a visual target for as long as possible. Target fixation times and increase in pupil diameters were determined and correlated to subjective ratings of cognitive load. FINDINGS: Overall, target fixation time and pupil diameter showed strong negative and positive correlations, respectively, to the subjective rating of cognitive load in the able-bodied controls (-0.75 and 0.80, respectively). However, the individual correlation strength, and in some cases, even the sign, was different across participants. A similar trend could be observed in prosthetic users. INTERPRETATION: The results of this study showed that a mobile eye tracker may be used to estimate cognitive load in prosthesis users during locomotor tasks. This paves the way to establish a new approach to assessing cognitive load, which is objective and yet practical and simple to administer. Nevertheless, future studies should corroborate these results by comparing them to other objective measures as well as focus on translating the proposed approach outside of a laboratory.

Modulating the fidelity and spatial extent of electrotactile stimulation to elicit the embodiment of a virtual hand.

Restoring tactile feedback in virtual reality can improve user experience and facilitate the feeling of embodiment. Electrotactile stimulation can be an attractive technology in this context as it is compact and allows for high-resolution spatially distributed stimulation. In the present study, a 32-channel tactile glove worn on the fingertips was used to provide tactile sensations during a virtual version of a rubber hand illusion experiment. To assess the benefits of multichannel stimulation, we modulated the spatial extent of feedback and its fidelity. Thirty-six participants performed the experiment in two conditions, in which stimulation was delivered to a single finger or all fingers, and three tactile stimulation types within each condition: no tactile feedback, simple single-point stimulation, and complex sliding stimulation mimicking the movements of the brush. Following each trial, the participants answered a multi-item embodiment questionnaire and reported the proprioceptive drift. The results confirmed that modulating the spatial extent of stimulation, from a single finger to all fingers, was indeed a successful strategy. When stimulating all fingers, tactile stimulation significantly improved all subjective measures compared to receiving no tactile stimulation. However, unexpectedly, the second strategy, that of modulating the fidelity of feedback, was not successful since there was no difference between the simple and complex tactile feedback in any of the measures. The results, therefore, imply that the effects of tactile feedback are better expressed in a more dynamic scenario (i.e., making/breaking contact and delivering stimulation to different body locations), while it still needs to be investigated if further improvements of the complex feedback can make it more effective compared to the simple approach.

Combining robotics and functional electrical stimulation for assist-as-needed support of leg movements in stroke patients: A feasibility study.

PURPOSE: Rehabilitation technology can be used to provide intensive training in the early phases after stroke. The current study aims to assess the feasibility of combining robotics and functional electrical stimulation (FES), with an assist-as-needed approach to support actively-initiated leg movements in (sub-)acute stroke patients. METHOD: Nine subacute stroke patients performed repetitions of ankle dorsiflexion and/or knee extension movements, with and without assistance. The assist-as-needed algorithm determined the amount and type of support needed per repetition. The number of repetitions and range of motion with and without assistance were compared with descriptive statistics. Fatigue scores were obtained using the visual analogue scale (score 0-10). RESULTS: Support was required in 44 % of the repetitions for ankle dorsiflexion and in 5 % of the repetitions of knee extension, The median fatigue score was 2.0 (IQR: 0.2) and 4.0 (IQR: 1.5) for knee and ankle, respectively, indicating mild to moderate perceived fatigue. CONCLUSION: This study demonstrated the feasibility of assist-as-needed assistance through combined robotic and FES support of leg movements in stroke patients. It proved particularly useful for ankle dorsiflexion. Future research should focus on implementing this approach in a clinical setting, to assess clinical applicability and potential effects on leg function.

A robot-based hybrid lower limb system for Assist-As-Needed rehabilitation of stroke patients: Technical evaluation and clinical feasibility.

BACKGROUND: Although early rehabilitation is important following a stroke, severely affected patients have limited options for intensive rehabilitation as they are often bedridden. To create a system for early rehabilitation of lower extremities in these patients, we combined the robotic manipulator ROBERT® with electromyography (EMG)-triggered functional electrical stimulation (FES) and developed a novel user-driven Assist-As-Needed (AAN) control. The method is based on a state machine able to detect user movement capability, assessed by the presence of an EMG-trigger and the movement velocity, and provide different levels of assistance as required by the patient (no support, FES only, and simultaneous FES and mechanical assistance). METHODS: To technically validate the system, we tested 10 able-bodied participants who were instructed to perform specific behaviors to test the system states while conducting knee extension and ankle dorsal flexion exercises. The system was also tested on two stroke patients to establish its clinical feasibility. RESULTS: The technical validation showed that the state machine correctly detected the participants' behavior and activated the target AAN state in more than 96% of the exercise repetitions. The clinical feasibility test showed that the system successfully recognized the patients' movement capacity and activated assistive states according to their needs providing the minimal level of support required to exercise successfully. CONCLUSIONS: The system was technically validated and preliminarily proved clinically feasible. The present study shows that the novel system can be used to deliver exercises with a high number of repetitions while engaging the participants' residual capabilities through the AAN strategy.