Modulating the fidelity and spatial extent of electrotactile stimulation to elicit the embodiment of a virtual hand.

Restoring tactile feedback in virtual reality can improve user experience and facilitate the feeling of embodiment. Electrotactile stimulation can be an attractive technology in this context as it is compact and allows for high-resolution spatially distributed stimulation. In the present study, a 32-channel tactile glove worn on the fingertips was used to provide tactile sensations during a virtual version of a rubber hand illusion experiment. To assess the benefits of multichannel stimulation, we modulated the spatial extent of feedback and its fidelity. Thirty-six participants performed the experiment in two conditions, in which stimulation was delivered to a single finger or all fingers, and three tactile stimulation types within each condition: no tactile feedback, simple single-point stimulation, and complex sliding stimulation mimicking the movements of the brush. Following each trial, the participants answered a multi-item embodiment questionnaire and reported the proprioceptive drift. The results confirmed that modulating the spatial extent of stimulation, from a single finger to all fingers, was indeed a successful strategy. When stimulating all fingers, tactile stimulation significantly improved all subjective measures compared to receiving no tactile stimulation. However, unexpectedly, the second strategy, that of modulating the fidelity of feedback, was not successful since there was no difference between the simple and complex tactile feedback in any of the measures. The results, therefore, imply that the effects of tactile feedback are better expressed in a more dynamic scenario (i.e., making/breaking contact and delivering stimulation to different body locations), while it still needs to be investigated if further improvements of the complex feedback can make it more effective compared to the simple approach.

Encoding contact size using static and dynamic electrotactile finger stimulation: natural decoding vs. trained cues.

Electrotactile stimulation through matrix electrodes is a promising technology to restore high-resolution tactile feedback in extended reality applications. One of the fundamental tactile effects that should be simulated is the change in the size of the contact between the finger and a virtual object. The present study investigated how participants perceive the increase of stimulation area when stimulating the index finger using static or dynamic (moving) stimuli produced by activating 1 to 6 electrode pads. To assess the ability to interpret the stimulation from the natural cues (natural decoding), without any prior training, the participants were instructed to draw the size of the stimulated area and identify the size difference when comparing two consecutive stimulations. To investigate if other "non-natural" cues can improve the size estimation, the participants were asked to enumerate the number of active pads following a training protocol. The results demonstrated that participants could perceive the change in size without prior training (e.g., the estimated area correlated with the stimulated area, p < 0.001; ≥ two-pad difference recognized with > 80% success rate). However, natural decoding was also challenging, as the response area changed gradually and sometimes in complex patterns when increasing the number of active pads (e.g., four extra pads needed for the statistically significant difference). Nevertheless, by training the participants to utilize additional cues the limitations of natural perception could be compensated. After the training, the mismatch in the activated and estimated number of pads was less than one pad regardless of the stimulus size. Finally, introducing the movement of the stimulus substantially improved discrimination (e.g., 100% median success rate to recognize ≥ one-pad difference). The present study, therefore, provides insights into stimulation size perception, and practical guidelines on how to modulate pad activation to change the perceived size in static and dynamic scenarios.

Novel Electrode Designs for Electrotactile Stimulation of the Finger: A Comparative Assessment.

Electrotactile stimulation can be an attractive technology to restore tactile feedback in different application scenarios (e.g., virtual and augmented reality, tele-manipulation). This technology allows designing compact solutions with no mechanical elements that can integrate a high-density matrix of stimulation points. The present study introduced four novel multi-pad finger-electrode designs with different arrangements (two matrix and two circular) and shapes of active pads (producing sensation) and reference pads (ideally, no sensation produced below the pad). The electrodes were used to investigate the subjects' ability to spatially discriminate active pads within phalanges individually (6-9 pads) as well as across the full finger (18-19 pads). The tests were conducted in 12 subjects and the results showed that all designs led to high success rates when applied to the fingertip (70-81%). When tested on the full finger, the matrix and circular designs were characterized with similar performance (54-57%), and when the phalanges were analyzed individually, the spatial discrimination was best at the fingertip. Additionally, new approaches for faster amplitude calibration were proposed and tested, demonstrating that calibration duration can be reduced by approximately 40% compared to the standard approach of calibrating single pads individually. Finally, discrimination tests of dynamic tactile patterns were conducted using circular and matrix designs on the fingertip and full finger, respectively. The tests showed that the different patterns generated by the two arrangements could be clearly discriminated, especially in the case of full-finger matrix-style patterns. The present study, therefore, provides several important insights that are relevant when delivering tactile feedback to the finger using an electrotactile interface.

Closed-Loop Control of a Multifunctional Myoelectric Prosthesis With Full-State Anatomically Congruent Electrotactile Feedback.

State-of-the-art myoelectric hand prostheses provide multi-functional control but lack somatosensory feedback. To accommodate the full functionality of a dexterous prosthesis, the artificial sensory feedback needs to convey several degrees of freedom (DoF) simultaneously. However, this is a challenge with current methods as they are characterized by a low information bandwidth. In this study, we leverage the flexibility of a recently developed system for simultaneous electrotactile stimulation and electromyography (EMG) recording to present the first solution for closed-loop myoelectric control of a multifunctional prosthesis with full-state anatomically congruent electrotactile feedback. The novel feedback scheme (coupled encoding) conveyed proprioceptive (hand aperture, wrist rotation) and exteroceptive information (grasping force). The coupled encoding was compared to the conventional approach (sectorized encoding) and incidental feedback in 10 non-disabled and one amputee participant who used the system to perform a functional task. The results showed that both feedback approaches increased the accuracy of position control compared to incidental feedback. However, the feedback increased completion time, and it did not significantly improve grasping force control. Importantly, the performance of the coupled feedback was not significantly different compared to the conventional scheme, despite the latter being easier to learn during training. Overall, the results indicate that the developed feedback can improve prosthesis control across multiple DoFs but they also highlight the subjects' ability to exploit minimal incidental information. Importantly, the current setup is the first to convey three feedback variables simultaneously using electrotactile stimulation while providing multi-DoF myoelectric control with all hardware components mounted on the same forearm.

A compact system for simultaneous stimulation and recording for closed-loop myoelectric control.

BACKGROUND: Despite important advancements in control and mechatronics of myoelectric prostheses, the communication between the user and his/her bionic limb is still unidirectional, as these systems do not provide somatosensory feedback. Electrotactile stimulation is an attractive technology to close the control loop since it allows flexible modulation of multiple parameters and compact interface design via multi-pad electrodes. However, the stimulation interferes with the recording of myoelectric signals and this can be detrimental to control. METHODS: We present a novel compact solution for simultaneous recording and stimulation through dynamic blanking of stimulation artefacts. To test the system, a feedback coding scheme communicating wrist rotation and hand aperture was developed specifically to stress the myoelectric control while still providing meaningful information to the subjects. Ten subjects participated in an experiment, where the quality of closed-loop myoelectric control was assessed by controlling a cursor in a two degrees of freedom target-reaching task. The benchmark performance with visual feedback was compared to that achieved by combining visual feedback and electrotactile stimulation as well as by using electrotactile feedback only. RESULTS: There was no significant difference in performance between visual and combined feedback condition with regards to successfully reached targets, time to reach a target, path efficiency and the number of overshoots. Therefore, the quality of myoelectric control was preserved in spite of the stimulation. As expected, the tactile condition was significantly poorer in completion rate (100/4% and 78/25% for combined and tactile condition, respectively) and time to reach a target (9/2 s and 13/4 s for combined and tactile condition, respectively). However, the performance in the tactile condition was still good, with no significant difference in path efficiency (38/8%) and the number of overshoots (0.5/0.4 overshoots), indicating that the stimulation was meaningful for the subjects and useful for closed-loop control. CONCLUSIONS: Overall, the results demonstrated that the developed system can provide robust closed-loop control using electrotactile stimulation. The system supports different encoding schemes and allows placing the recording and stimulation electrodes next to each other. This is an important step towards an integrated solution where the developed unit will be embedded into a prosthetic socket.

Amplitude versus spatially modulated electrotactile feedback for myoelectric control of two degrees of freedom.

OBJECTIVE: Artificial proprioceptive feedback from a myoelectric prosthesis is an important aspect in enhancing embodiment and user satisfaction, possibly lowering the demand for visual attention while controlling a prosthesis in everyday tasks. Contemporary myoelectric prostheses are advanced mechatronic systems with multiple degrees of freedom, and therefore, to communicate the prosthesis state, the feedback interface needs to transmit several variables simultaneously. In the present study, two different configurations for conveying proprioceptive information of wrist rotation and hand aperture through multichannel electrotactile stimulation were developed and evaluated during online myoelectric control. APPROACH: Myoelectric recordings were acquired from the dominant forearm and electrotactile stimulation was delivered on the non-dominant forearm using a compact interface. The first feedback configuration, which was based on spatial coding, transmitted the information using a moving tactile stimulus, whereas the second, amplitude-based configuration conveyed the position via sensation intensity. Thirteen able-bodied subjects used pattern classification-based myoelectric control with both feedback configurations to accomplish a target-reaching task. MAIN RESULTS: High task performance (completion rate > 90%) was observed for both configurations, with no significant difference in completion rate, time to reach the target, distance error and path efficiency, respectively. SIGNIFICANCE: Overall, the results demonstrated that both feedback configurations allowed subjects to perceive and interpret two feedback variables delivered simultaneously, despite using a compact stimulation interface. This is an encouraging result for the prospect of communicating the full state of a multifunctional hand prosthesis.