Vagus nerve stimulation for stroke rehabilitation: Neural substrates, neuromodulatory effects and therapeutic implications.

Paired vagus nerve stimulation (VNS) has emerged as a promising strategy to potentiate recovery after neurological injury. This approach, which combines short bursts of electrical stimulation of the vagus nerve with rehabilitation exercises, received approval from the US Food and Drug Aministration in 2021 as the first neuromodulation-based therapy for chronic stroke. Because this treatment is increasingly implemented in clinical practice, there is a need to take stock of what we know about this approach and what we have yet to learn. Here, we provide a survey on the foundational basis of VNS therapy for stroke and offer insight into the mechanisms that underlie potentiated recovery, focusing on the principles of neuromodulatory reinforcement. We discuss the current state of observations regarding synaptic reorganization in motor networks that are enhanced by VNS, and we propose other prospective loci of neuromodulation that should be evaluated in the future. Finally, we highlight the future opportunities and challenges to be faced as this approach is increasingly translated to clinical use. Collectively, a clearer understanding of the mechanistic basis of VNS therapy may reveal ways to maximize its benefits.

Dual-Tasking in Daily Activities Among Adults With and Without Stroke.

IMPORTANCE: In laboratory settings, dual-tasking is a performance strategy affected by dominance and stroke. However, the volitional use of dual-tasking has not been examined during naturalistic performance of activities of daily living (ADLs). OBJECTIVE: To examine dual-tasking in the context of ADLs and identify whether dominance and stroke influence its use. DESIGN: Cross-sectional, observational. SETTING: Academic medical center. PARTICIPANTS: Forty-three participants with chronic stroke and upper extremity (UE) motor impairment and 19 control participants without stroke. OUTCOMES AND MEASURES: We identified dual-tasking as the performance of dual-object primitives (DOPs), a functional strategy to manage two objects simultaneously. We videotaped participants performing feeding and toothbrushing tasks and identified the initiation and frequency of DOPs. We assessed whether these outcomes were influenced by UE dominance or paresis and whether among participants with stroke these outcomes were influenced by motor impairment (using the Fugl-Meyer Assessment) or cognitive impairment (using the Montreal Cognitive Assessment). RESULTS: DOP initiation was reduced on the nondominant side of control UEs and in the paretic UE of participants with stroke. After DOPs were initiated, however, their frequency was not significantly related to dominance or paresis. Among participants with stroke, DOP initiation but not DOP frequency was influenced by motor impairment, and neither were influenced by cognitive impairment. CONCLUSIONS AND RELEVANCE: The initiation of dual-tasking is curtailed in the nondominant and paretic UEs, extending previous laboratory-based findings to a more naturalistic setting. These results may reflect a demand on neural resources that is exceeded when these limbs are used. What This Article Adds: DOPs, a functional strategy to simultaneously engage two objects during ADLs, could serve as a behavioral marker of dual-tasking in real-world activities, supporting their investigation more broadly. Practicing DOPs in rehabilitation could also train the integration of dual-tasking strategies in activity execution.

Corticoreticulospinal tract neurophysiology in an arm and hand muscle in healthy and stroke subjects.

KEY POINTS: The corticoreticulospinal tract (CReST) is a descending motor pathway that reorganizes after corticospinal tract (CST) injury in animals. In humans, the pattern of CReST innervation to upper limb muscles has not been carefully examined in healthy individuals or individuals with CST injury. In the present study, we assessed CReST projections to an arm and hand muscle on the same side of the body in healthy and chronic stoke subjects using transcranial magnetic stimulation. We show that CReST connection strength to the muscles differs between healthy and stroke subjects, with stronger connections to the hand than arm in healthy subjects, and stronger connections to the arm than hand in stroke subjects. These results help us better understand CReST innervation patterns in the upper limb, and may point to its role in normal motor function and motor recovery in humans. ABSTRACT: The corticoreticulospinal tract (CReST) is a major descending motor pathway in many animals, but little is known about its innervation patterns in proximal and distal upper extremity muscles in humans. The contralesional CReST furthermore reorganizes after corticospinal tract (CST) injury in animals, but it is less clear whether CReST innervation changes after stroke in humans. We thus examined CReST functional connectivity, connection strength, and modulation in an arm and hand muscle of healthy (n = 15) and chronic stroke (n = 16) subjects. We delivered transcranial magnetic stimulation to the contralesional hemisphere (assigned in healthy subjects) to elicit ipsilateral motor evoked potentials (iMEPs) from the paretic biceps (BIC) and first dorsal interosseous (FDI) muscle. We operationalized CReST functional connectivity as iMEP presence/absence, CReST projection strength as iMEP size and CReST modulation as change in iMEP size by head rotation. We found comparable CReST functional connectivity to the BICs and FDIs in both subject groups. However, the pattern of CReST connection strength to the muscles diverged between groups, with stronger connections to FDIs than BICs in healthy subjects and stronger connections to BICs than FDIs in stroke subjects. Head rotation modulated only FDI iMEPs of healthy subjects. Our findings indicate that the healthy CReST does not have a proximal innervation bias, and its strong FDI connections may have functional relevance to finger individuation. The reversed CReST innervation pattern in stroke subjects confirms its reorganization after CST injury, and its strong BIC connections may indicate upregulation for particular upper extremity muscles or their functional actions.

NE-Motion: Visual Analysis of Stroke Patients Using Motion Sensor Networks.

A large number of stroke survivors suffer from a significant decrease in upper extremity (UE) function, requiring rehabilitation therapy to boost recovery of UE motion. Assessing the efficacy of treatment strategies is a challenging problem in this context, and is typically accomplished by observing the performance of patients during their execution of daily activities. A more detailed assessment of UE impairment can be undertaken with a clinical bedside test, the UE Fugl-Meyer Assessment, but it fails to examine compensatory movements of functioning body segments that are used to bypass impairment. In this work, we use a graph learning method to build a visualization tool tailored to support the analysis of stroke patients. Called NE-Motion, or Network Environment for Motion Capture Data Analysis, the proposed analytic tool handles a set of time series captured by motion sensors worn by patients so as to enable visual analytic resources to identify abnormalities in movement patterns. Developed in close collaboration with domain experts, NE-Motion is capable of uncovering important phenomena, such as compensation while revealing differences between stroke patients and healthy individuals. The effectiveness of NE-Motion is shown in two case studies designed to analyze particular patients and to compare groups of subjects.

Rethinking interhemispheric imbalance as a target for stroke neurorehabilitation.

OBJECTIVE: Patients with chronic stroke have been shown to have failure to release interhemispheric inhibition (IHI) from the intact to the damaged hemisphere before movement execution (premovement IHI). This inhibitory imbalance was found to correlate with poor motor performance in the chronic stage after stroke and has since become a target for therapeutic interventions. The logic of this approach, however, implies that abnormal premovement IHI is causal to poor behavioral outcome and should therefore be present early after stroke when motor impairment is at its worst. To test this idea, in a longitudinal study, we investigated interhemispheric interactions by tracking patients' premovement IHI for one year following stroke. METHODS: We assessed premovement IHI and motor behavior five times over a 1-year period after ischemic stroke in 22 patients and 11 healthy participants. RESULTS: We found that premovement IHI was normal during the acute/subacute period and only became abnormal at the chronic stage; specifically, release of IHI in movement preparation worsened as motor behavior improved. In addition, premovement IHI did not correlate with behavioral measures cross-sectionally, whereas the longitudinal emergence of abnormal premovement IHI from the acute to the chronic stage was inversely correlated with recovery of finger individuation. INTERPRETATION: These results suggest that interhemispheric imbalance is not a cause of poor motor recovery, but instead might be the consequence of underlying recovery processes. These findings call into question the rehabilitation strategy of attempting to rebalance interhemispheric interactions in order to improve motor recovery after stroke. Ann Neurol 2019;85:502-513.

Evidence for a subcortical origin of mirror movements after stroke: a longitudinal study.

Following a stroke, mirror movements are unintended movements that appear in the non-paretic hand when the paretic hand voluntarily moves. Mirror movements have previously been linked to overactivation of sensorimotor areas in the non-lesioned hemisphere. In this study, we hypothesized that mirror movements might instead have a subcortical origin, and are the by-product of subcortical motor pathways upregulating their contributions to the paretic hand. To test this idea, we first characterized the time course of mirroring in 53 first-time stroke patients, and compared it to the time course of activities in sensorimotor areas of the lesioned and non-lesioned hemispheres (measured using functional MRI). Mirroring in the non-paretic hand was exaggerated early after stroke (Week 2), but progressively diminished over the year with a time course that parallelled individuation deficits in the paretic hand. We found no evidence of cortical overactivation that could explain the time course changes in behaviour, contrary to the cortical model of mirroring. Consistent with a subcortical origin of mirroring, we predicted that subcortical contributions should broadly recruit fingers in the non-paretic hand, reflecting the limited capacity of subcortical pathways in providing individuated finger control. We therefore characterized finger recruitment patterns in the non-paretic hand during mirroring. During mirroring, non-paretic fingers were broadly recruited, with mirrored forces in homologous fingers being only slightly larger (1.76 times) than those in non-homologous fingers. Throughout recovery, the pattern of finger recruitment during mirroring for patients looked like a scaled version of the corresponding control mirroring pattern, suggesting that the system that is responsible for mirroring in controls is upregulated after stroke. Together, our results suggest that post-stroke mirror movements in the non-paretic hand, like enslaved movements in the paretic hand, are caused by the upregulation of a bilaterally organized subcortical system.

Repetitive Transcranial Magnetic Stimulation for Upper Extremity Motor Recovery: Does It Help?

PURPOSE OF REVIEW: Repetitive transcranial magnetic stimulation (rTMS) noninvasively modulates brain excitability in humans and influences mediators of plasticity in animals. When applied in humans in the months to years after stroke, potentiation of motor recovery has been limited. Recently, investigators have shifted rTMS administration into the early weeks following stroke, when injury-induced plasticity could be maximally engaged. This article provides an overview of basic mechanisms of rTMS, consideration of its interaction with various forms of neuroplasticity, and a summary of the highest quality clinical evidence for rTMS given early after stroke. RECENT FINDINGS: Studies of repetitive magnetic stimulation in vitro and in vivo have found modulation of excitatory and inhibitory neurotransmission and induction of cellular mechanisms supporting plasticity. A handful of clinical studies have shown sustained improvements in grip strength and UE motor impairment when rTMS is delivered in the first weeks after stroke. Though in its infancy, recent research suggests a plasticity-enhancing influence and modest motor recovery potentiation when rTMS is delivered early after stroke.

Recovery and Rehabilitation after Intracerebral Hemorrhage.

About half of patients survive intracerebral hemorrhage (ICH), but most are left with significant disability. Rehabilitation after ICH is the mainstay of treatment to reduce impairment, improve independence in activities, and return patients to meaningful participation in the community. The authors discuss the neuroplastic mechanisms underlying recovery in ICH, preclinical and clinical interventional studies to augment recovery, and the rehabilitative and medical management of post-ICH patients.

Evidence and sources of placebo effects in transcranial direct current stimulation during a single session of visuospatial working memory practice.

Transcranial direct current stimulation (tDCS) can be used to non-invasively augment cognitive training. However, the benefits of tDCS may be due in part to placebo effects, which have not been well-characterized. The purpose of this study was to determine whether tDCS can have a measurable placebo effect on cognitive training and to identify potential sources of this effect. Eighty-three right-handed adults were randomly assigned to one of three groups: control (no exposure to tDCS), sham tDCS, or active tDCS. The sham and active tDCS groups were double-blinded. Each group performed 20 min of an adapted Corsi Block Tapping Task (CBTT), a visuospatial working memory task. Anodal or sham tDCS was applied during CBTT training in a right parietal-left supraorbital montage. After training, active and sham tDCS groups were surveyed on expectations about tDCS efficacy. Linear mixed effects models showed that the tDCS groups (active and sham combined) improved more on the CBTT with training than the control group, suggesting a placebo effect of tDCS. Participants' tDCS expectations were significantly related to the placebo effect, as was the belief of receiving active stimulation. This placebo effect shows that the benefits of tDCS on cognitive training can occur even in absence of active stimulation. Future tDCS studies should consider how treatment expectations may be a source of the placebo effect in tDCS research, and identify ways to potentially leverage them to maximize treatment benefit.

Quantifying impairment and disease severity using AI models trained on healthy subjects.

Automatic assessment of impairment and disease severity is a key challenge in data-driven medicine. We propose a framework to address this challenge, which leverages AI models trained exclusively on healthy individuals. The COnfidence-Based chaRacterization of Anomalies (COBRA) score exploits the decrease in confidence of these models when presented with impaired or diseased patients to quantify their deviation from the healthy population. We applied the COBRA score to address a key limitation of current clinical evaluation of upper-body impairment in stroke patients. The gold-standard Fugl-Meyer Assessment (FMA) requires in-person administration by a trained assessor for 30-45 minutes, which restricts monitoring frequency and precludes physicians from adapting rehabilitation protocols to the progress of each patient. The COBRA score, computed automatically in under one minute, is shown to be strongly correlated with the FMA on an independent test cohort for two different data modalities: wearable sensors (ρ = 0.814, 95% CI [0.700,0.888]) and video (ρ = 0.736, 95% C.I [0.584, 0.838]). To demonstrate the generalizability of the approach to other conditions, the COBRA score was also applied to quantify severity of knee osteoarthritis from magnetic-resonance imaging scans, again achieving significant correlation with an independent clinical assessment (ρ = 0.644, 95% C.I [0.585,0.696]).

Improvisation and live accompaniment increase motor response and reward during a music playing task.

Music provides a reward that can enhance learning and motivation in humans. While music is often combined with exercise to improve performance and upregulate mood, the relationship between music-induced reward and motor output is poorly understood. Here, we study music reward and motor output at the same time by capitalizing on music playing. Specifically, we investigate the effects of music improvisation and live accompaniment on motor, autonomic, and affective responses. Thirty adults performed a drumming task while (i) improvising or maintaining the beat and (ii) with live or recorded accompaniment. Motor response was characterized by acceleration of hand movements (accelerometry), wrist flexor and extensor muscle activation (electromyography), and the drum strike count (i.e., the number of drum strikes played). Autonomic arousal was measured by tonic response of electrodermal activity (EDA) and heart rate (HR). Affective responses were measured by a 12-item Likert scale. The combination of improvisation and live accompaniment, as compared to all other conditions, significantly increased acceleration of hand movements and muscle activation, as well as participant reports of reward during music playing. Improvisation, regardless of type of accompaniment, increased the drum strike count and autonomic arousal (including tonic EDA responses and several measures of HR), as well as participant reports of challenge. Importantly, increased motor response was associated with increased reward ratings during music improvisation, but not while participants were maintaining the beat. The increased motor responses achieved with improvisation and live accompaniment have important implications for enhancing dose of movement during exercise and physical rehabilitation.

Corticospinal and corticoreticulospinal projections benefit motor behaviors in chronic stroke.

After corticospinal tract (CST) stroke, several motor deficits in the upper extremity (UE) emerge, including diminished muscle strength, motor control, and muscle individuation. Both the ipsilesional CST and contralesional corticoreticulospinal tract (CReST) innervate the paretic UE and may have different innervation patterns for the proximal and distal UE segments. These patterns may underpin distinct pathway relationships to separable motor behaviors. In this cross-sectional study of 15 chronic stroke patients and 28 healthy subjects, we examined two key questions: (1) whether segmental motor behaviors differentially relate to ipsilesional CST and contralesional CReST projection strengths, and (2) whether motor behaviors segmentally differ in the paretic UE. We measured strength, motor control, and muscle individuation in a proximal (biceps, BIC) and distal muscle (first dorsal interosseous, FDI) of the paretic UE. We measured the projection strengths of the ipsilesional CST and contralesional CReST to these muscles using transcranial magnetic stimulation (TMS). Stroke subjects had abnormal motor control and muscle individuation despite strength comparable to healthy subjects. In stroke subjects, stronger ipsilesional CST projections were linked to superior motor control in both UE segments, whereas stronger contralesional CReST projections were linked to superior muscle strength and individuation in both UE segments. Notably, both pathways also shared associations with behaviors in the proximal segment. Motor control deficits were segmentally comparable, but muscle individuation was worse for distal motor performance. These results suggest that each pathway has specialized contributions to chronic motor behaviors but also work together, with varying levels of success in supporting chronic deficits. Key points summary: Individuals with chronic stroke typically have deficits in strength, motor control, and muscle individuation in their paretic upper extremity (UE). It remains unclear how these altered behaviors relate to descending motor pathways and whether they differ by proximal and distal UE segment.In this study, we used transcranial magnetic stimulation (TMS) to examine projection strengths of the ipsilesional corticospinal tract (CST) and contralesional corticoreticulospinal tract (CReST) with respect to quantitated motor behaviors in chronic stroke.We found that stronger ipsilesional CST projections were associated with better motor control in both UE segments, whereas stronger contralesional CReST projections were associated with better strength and individuation in both UE segments. In addition, projections of both pathways shared associations with motor behaviors in the proximal UE segment.We also found that deficits in strength and motor control were comparable across UE segments, but muscle individuation was worse with controlled movement in the distal UE segment.These results suggest that the CST and CReST have specialized contributions to chronic motor behaviors and also work together, although with different degrees of efficacy.

The distribution of transcallosal inhibition to upper extremity muscles is altered in chronic stroke.

OBJECTIVE: To determine if the distribution of transcallosal inhibition (TI) acting on proximal and distal upper extremity muscles is altered in chronic stroke. METHODS: We examined thirteen healthy controls and sixteen mildly to moderately impaired chronic stroke patients. We used transcranial magnetic stimulation (TMS) to probe TI from the contralesional onto ipsilesional hemisphere (assigned in controls). We recorded the ipsilateral silent period in the paretic biceps (BIC) and first dorsal interosseous (FDI). We measured TI strength, distribution gradient (TI difference between muscles), and motor impairment (Fugl-Meyer Assessment). RESULTS: Both groups had stronger TI acting on their FDIs than BICs (p < 0.001). However, stroke patients also had stronger TI acting on their BICs than controls (p = 0.034), resulting in a flatter distribution of inhibition (p = 0.028). In patients, stronger FDI inhibition correlated with less hand impairment (p = 0.031); BIC inhibition was not correlated to impairment. CONCLUSION: TI is more evenly distributed to the paretic FDI and BIC in chronic stroke. The relative increase in proximal inhibition does not relate to better function, as it does distally. SIGNIFICANCE: The results expand our knowledge about segment-specific neurophysiology and its relevance to impairment after stroke.

Quantifying Impairment and Disease Severity Using AI Models Trained on Healthy Subjects.

Automatic assessment of impairment and disease severity is a key challenge in data-driven medicine. We propose a novel framework to address this challenge, which leverages AI models trained exclusively on healthy individuals. The COnfidence-Based chaRacterization of Anomalies (COBRA) score exploits the decrease in confidence of these models when presented with impaired or diseased patients to quantify their deviation from the healthy population. We applied the COBRA score to address a key limitation of current clinical evaluation of upper-body impairment in stroke patients. The gold-standard Fugl-Meyer Assessment (FMA) requires in-person administration by a trained assessor for 30-45 minutes, which restricts monitoring frequency and precludes physicians from adapting rehabilitation protocols to the progress of each patient. The COBRA score, computed automatically in under one minute, is shown to be strongly correlated with the FMA on an independent test cohort for two different data modalities: wearable sensors ($\rho = 0.845$, 95% CI [0.743,0.908]) and video ($\rho = 0.746$, 95% C.I [0.594, 0.847]). To demonstrate the generalizability of the approach to other conditions, the COBRA score was also applied to quantify severity of knee osteoarthritis from magnetic-resonance imaging scans, again achieving significant correlation with an independent clinical assessment ($\rho = 0.644$, 95% C.I [0.585,0.696]).

Data-Driven Quantitation of Movement Abnormality after Stroke.

Stroke commonly affects the ability of the upper extremities (UEs) to move normally. In clinical settings, identifying and measuring movement abnormality is challenging due to the imprecision and impracticality of available assessments. These challenges interfere with therapeutic tracking, communication, and treatment. We thus sought to develop an approach that blends precision and pragmatism, combining high-dimensional motion capture with out-of-distribution (OOD) detection. We used an array of wearable inertial measurement units to capture upper body motion in healthy and chronic stroke subjects performing a semi-structured, unconstrained 3D tabletop task. After data were labeled by human coders, we trained two deep learning models exclusively on healthy subject data to classify elemental movements (functional primitives). We tested these healthy subject-trained models on previously unseen healthy and stroke motion data. We found that model confidence, indexed by prediction probabilities, was generally high for healthy test data but significantly dropped when encountering OOD stroke data. Prediction probabilities worsened with more severe motor impairment categories and were directly correlated with individual impairment scores. Data inputs from the paretic UE, rather than trunk, most strongly influenced model confidence. We demonstrate for the first time that using OOD detection with high-dimensional motion data can reveal clinically meaningful movement abnormality in subjects with chronic stroke.

Noninvasive cortical stimulation enhances motor skill acquisition over multiple days through an effect on consolidation.

Motor skills can take weeks to months to acquire and can diminish over time in the absence of continued practice. Thus, strategies that enhance skill acquisition or retention are of great scientific and practical interest. Here we investigated the effect of noninvasive cortical stimulation on the extended time course of learning a novel and challenging motor skill task. A skill measure was chosen to reflect shifts in the task's speed-accuracy tradeoff function (SAF), which prevented us from falsely interpreting variations in position along an unchanged SAF as a change in skill. Subjects practiced over 5 consecutive days while receiving transcranial direct current stimulation (tDCS) over the primary motor cortex (M1). Using the skill measure, we assessed the impact of anodal (relative to sham) tDCS on both within-day (online) and between-day (offline) effects and on the rate of forgetting during a 3-month follow-up (long-term retention). There was greater total (online plus offline) skill acquisition with anodal tDCS compared to sham, which was mediated through a selective enhancement of offline effects. Anodal tDCS did not change the rate of forgetting relative to sham across the 3-month follow-up period, and consequently the skill measure remained greater with anodal tDCS at 3 months. This prolonged enhancement may hold promise for the rehabilitation of brain injury. Furthermore, these findings support the existence of a consolidation mechanism, susceptible to anodal tDCS, which contributes to offline effects but not to online effects or long-term retention.

The use of wearable sensors to assess and treat the upper extremity after stroke: a scoping review.

PURPOSE: To address the gap in the literature and clarify the expanding role of wearable sensor data in stroke rehabilitation, we summarized the methods for upper extremity (UE) sensor-based assessment and sensor-based treatment. MATERIALS AND METHODS: The guideline outlined by the preferred reporting items for systematic reviews and meta-analysis extension for scoping reviews was used to complete this scoping review. Information pertaining to participant demographics, sensory information, data collection, data processing, data analysis, and study results were extracted from the studies for analysis and synthesis. RESULTS: We included 43 articles in the final review. We organized the results into assessment and treatment categories. The included articles used wearable sensors to identify UE functional motion, categorize motor impairment/activity limitation, and quantify real-world use. Wearable sensors were also used to augment UE training by triggering sensory cues or providing instructional feedback about the affected UE. CONCLUSIONS: Sensors have the potential to greatly expand assessment and treatment beyond traditional clinic-based approaches. This capability could support the quantification of rehabilitation dose, the nuanced assessment of impairment and activity limitation, the characterization of daily UE use patterns in real-world settings, and augment UE training adherence for home-based rehabilitation.IMPLICATIONS FOR REHABILITATIONSensor data have been used to assess UE functional motion, motor impairment/activity limitation, and real-world use.Sensor-assisted treatment approaches are emerging, and may be a promising tool to augment UE adherence in home-based rehabilitation.Wearable sensors may extend our ability to objectively assess UE motion beyond supervised clinical settings, and into home and community settings.

StrokeRehab: A Benchmark Dataset for Sub-second Action Identification.

Automatic action identification from video and kinematic data is an important machine learning problem with applications ranging from robotics to smart health. Most existing works focus on identifying coarse actions such as running, climbing, or cutting vegetables, which have relatively long durations and a complex series of motions. This is an important limitation for applications that require identification of more elemental motions at high temporal resolution. For example, in the rehabilitation of arm impairment after stroke, quantifying the training dose (number of repetitions) requires differentiating motions with sub-second durations. Our goal is to bridge this gap. To this end, we introduce a large-scale, multimodal dataset, StrokeRehab, as a new action-recognition benchmark that includes elemental short-duration actions labeled at a high temporal resolution. StrokeRehab consists of high-quality inertial measurement unit sensor and video data of 51 stroke-impaired patients and 20 healthy subjects performing activities of daily living like feeding, brushing teeth, etc. Because it contains data from both healthy and impaired individuals, StrokeRehab can be used to study the influence of distribution shift in action-recognition tasks. When evaluated on StrokeRehab, current state-of-the-art models for action segmentation produce noisy predictions, which reduces their accuracy in identifying the corresponding sequence of actions. To address this, we propose a novel approach for high-resolution action identification, inspired by speech-recognition techniques, which is based on a sequence-to-sequence model that directly predicts the sequence of actions. This approach outperforms current state-of-the-art methods on StrokeRehab, as well as on the standard benchmark datasets 50Salads, Breakfast, and Jigsaws.

PrimSeq: A deep learning-based pipeline to quantitate rehabilitation training.

Stroke rehabilitation seeks to accelerate motor recovery by training functional activities, but may have minimal impact because of insufficient training doses. In animals, training hundreds of functional motions in the first weeks after stroke can substantially boost upper extremity recovery. The optimal quantity of functional motions to boost recovery in humans is currently unknown, however, because no practical tools exist to measure them during rehabilitation training. Here, we present PrimSeq, a pipeline to classify and count functional motions trained in stroke rehabilitation. Our approach integrates wearable sensors to capture upper-body motion, a deep learning model to predict motion sequences, and an algorithm to tally motions. The trained model accurately decomposes rehabilitation activities into elemental functional motions, outperforming competitive machine learning methods. PrimSeq furthermore quantifies these motions at a fraction of the time and labor costs of human experts. We demonstrate the capabilities of PrimSeq in previously unseen stroke patients with a range of upper extremity motor impairment. We expect that our methodological advances will support the rigorous measurement required for quantitative dosing trials in stroke rehabilitation.