Automated calibration of somatosensory stimulation using reinforcement learning.

BACKGROUND: The identification of the electrical stimulation parameters for neuromodulation is a subject-specific and time-consuming procedure that presently mostly relies on the expertise of the user (e.g., clinician, experimenter, bioengineer). Since the parameters of stimulation change over time (due to displacement of electrodes, skin status, etc.), patients undergo recurrent, long calibration sessions, along with visits to the clinics, which are inefficient and expensive. To address this issue, we developed an automatized calibration system based on reinforcement learning (RL) allowing for accurate and efficient identification of the peripheral nerve stimulation parameters for somatosensory neuroprostheses. METHODS: We developed an RL algorithm to automatically select neurostimulation parameters for restoring sensory feedback with transcutaneous electrical nerve stimulation (TENS). First, the algorithm was trained offline on a dataset comprising 49 subjects. Then, the neurostimulation was then integrated with a graphical user interface (GUI) to create an intuitive AI-based mapping platform enabling the user to autonomously perform the sensation characterization procedure. We assessed the algorithm against the performance of both experienced and naïve and of a brute force algorithm (BFA), on 15 nerves from five subjects. Then, we validated the AI-based platform on six neuropathic nerves affected by distal sensory loss. RESULTS: Our automatized approach demonstrated the ability to find the optimal values of neurostimulation achieving reliable and comfortable elicited sensations. When compared to alternatives, RL outperformed the naïve and BFA, significantly decreasing the time for mapping and the number of delivered stimulation trains, while improving the overall quality. Furthermore, the RL algorithm showed performance comparable to trained experimenters. Finally, we exploited it successfully for eliciting sensory feedback in neuropathic patients. CONCLUSIONS: Our findings demonstrated that the AI-based platform based on a RL algorithm can automatically and efficiently calibrate parameters for somatosensory nerve stimulation. This holds promise to avoid experts' employment in similar scenarios, thanks to the merging between AI and neurotech. Our RL algorithm has the potential to be used in other neuromodulation fields requiring a mapping process of the stimulation parameters. TRIAL REGISTRATION: ClinicalTrial.gov (Identifier: NCT04217005).

Supraspinal control of motoneurons after paralysis enabled by spinal cord stimulation.

Spinal cord stimulation (SCS) restores motor control after spinal cord injury (SCI) and stroke. This evidence led to the hypothesis that SCS facilitates residual supraspinal inputs to spinal motoneurons. Instead, here we show that SCS does not facilitate residual supraspinal inputs but directly triggers motoneurons action potentials. However, supraspinal inputs can shape SCS-mediated activity, mimicking volitional control of motoneuron firing. Specifically, by combining simulations, intraspinal electrophysiology in monkeys and single motor unit recordings in humans with motor paralysis, we found that residual supraspinal inputs transform subthreshold SCS-induced excitatory postsynaptic potentials into suprathreshold events. We then demonstrated that only a restricted set of stimulation parameters enables volitional control of motoneuron firing and that lesion severity further restricts the set of effective parameters. Our results explain the facilitation of voluntary motor control during SCS while predicting the limitations of this neurotechnology in cases of severe loss of supraspinal axons.

SUPRASPINAL CONTROL OF MOTONEURONS AFTER PARALYSIS ENABLED BY SPINAL CORD STIMULATION.

Spinal cord stimulation (SCS) restores motor control after spinal cord injury (SCI) and stroke. This evidence led to the hypothesis that SCS facilitates residual supraspinal inputs to spinal motoneurons. Instead, here we show that SCS does not facilitate residual supraspinal inputs but directly triggers motoneurons action potentials. However, supraspinal inputs can shape SCS-mediated activity, mimicking volitional control of motoneuron firing. Specifically, by combining simulations, intraspinal electrophysiology in monkeys and single motor unit recordings in humans with motor paralysis, we found that residual supraspinal inputs transform subthreshold SCS-induced excitatory postsynaptic potentials into suprathreshold events. We then demonstrated that only a restricted set of stimulation parameters enables volitional control of motoneuron firing and that lesion severity further restricts the set of effective parameters. Our results explain the facilitation of voluntary motor control during SCS while predicting the limitations of this neurotechnology in cases of severe loss of supraspinal axons.