The Berlin Bimanual Test for Tetraplegia (BeBiTT): development, psychometric properties, and sensitivity to change in assistive hand exoskeleton application.

BACKGROUND: Assistive hand exoskeletons are promising tools to restore hand function after cervical spinal cord injury (SCI) but assessing their specific impact on bimanual hand and arm function is limited due to lack of reliable and valid clinical tests. Here, we introduce the Berlin Bimanual Test for Tetraplegia (BeBiTT) and demonstrate its psychometric properties and sensitivity to assistive hand exoskeleton-related improvements in bimanual task performance. METHODS: Fourteen study participants with subacute cervical SCI performed the BeBiTT unassisted (baseline). Thereafter, participants repeated the BeBiTT while wearing a brain/neural hand exoskeleton (B/NHE) (intervention). Online control of the B/NHE was established via a hybrid sensorimotor rhythm-based brain-computer interface (BCI) translating electroencephalographic (EEG) and electrooculographic (EOG) signals into open/close commands. For reliability assessment, BeBiTT scores were obtained by four independent observers. Besides internal consistency analysis, construct validity was assessed by correlating baseline BeBiTT scores with the Spinal Cord Independence Measure III (SCIM III) and Quadriplegia Index of Function (QIF). Sensitivity to differences in bimanual task performance was assessed with a bootstrapped paired t-test. RESULTS: The BeBiTT showed excellent interrater reliability (intraclass correlation coefficients > 0.9) and internal consistency (α = 0.91). Validity of the BeBiTT was evidenced by strong correlations between BeBiTT scores and SCIM III as well as QIF. Wearing a B/NHE (intervention) improved the BeBiTT score significantly (p < 0.05) with high effect size (d = 1.063), documenting high sensitivity to intervention-related differences in bimanual task performance. CONCLUSION: The BeBiTT is a reliable and valid test for evaluating bimanual task performance in persons with tetraplegia, suitable to assess the impact of assistive hand exoskeletons on bimanual function.

Hybrid brain/neural interface and autonomous vision-guided whole-arm exoskeleton control to perform activities of daily living (ADLs).

BACKGROUND: The aging of the population and the progressive increase of life expectancy in developed countries is leading to a high incidence of age-related cerebrovascular diseases, which affect people's motor and cognitive capabilities and might result in the loss of arm and hand functions. Such conditions have a detrimental impact on people's quality of life. Assistive robots have been developed to help people with motor or cognitive disabilities to perform activities of daily living (ADLs) independently. Most of the robotic systems for assisting on ADLs proposed in the state of the art are mainly external manipulators and exoskeletal devices. The main objective of this study is to compare the performance of an hybrid EEG/EOG interface to perform ADLs when the user is controlling an exoskeleton rather than using an external manipulator. METHODS: Ten impaired participants (5 males and 5 females, mean age 52 ± 16 years) were instructed to use both systems to perform a drinking task and a pouring task comprising multiple subtasks. For each device, two modes of operation were studied: synchronous mode (the user received a visual cue indicating the sub-tasks to be performed at each time) and asynchronous mode (the user started and finished each of the sub-tasks independently). Fluent control was assumed when the time for successful initializations ranged below 3 s and a reliable control in case it remained below 5 s. NASA-TLX questionnaire was used to evaluate the task workload. For the trials involving the use of the exoskeleton, a custom Likert-Scale questionnaire was used to evaluate the user's experience in terms of perceived comfort, safety, and reliability. RESULTS: All participants were able to control both systems fluently and reliably. However, results suggest better performances of the exoskeleton over the external manipulator (75% successful initializations remain below 3 s in case of the exoskeleton and bellow 5s in case of the external manipulator). CONCLUSIONS: Although the results of our study in terms of fluency and reliability of EEG control suggest better performances of the exoskeleton over the external manipulator, such results cannot be considered conclusive, due to the heterogeneity of the population under test and the relatively limited number of participants.

User activity recognition system to improve the performance of environmental control interfaces: a pilot study with patients.

BACKGROUND: Assistive technologies aim to increase quality of life, reduce dependence on care giver and on the long term care system. Several studies have demonstrated the effectiveness in the use of assistive technology for environment control and communication systems. The progress of brain-computer interfaces (BCI) research together with exoskeleton enable a person with motor impairment to interact with new elements in the environment. This paper aims to evaluate the environment control interface (ECI) developed under the AIDE project conditions, a multimodal interface able to analyze and extract relevant information from the environments as well as from the identification of residual abilities, behaviors, and intentions of the user. METHODS: This study evaluated the ECI in a simulated scenario using a two screen layout: one with the ECI and the other with a simulated home environment, developed for this purpose. The sensorimotor rhythms and the horizontal oculoversion, acquired through BCI2000, a multipurpose standard BCI platform, were used to online control the ECI after the user training and system calibration. Eight subjects with different neurological diseases and spinal cord injury participated in this study. The subjects performed simulated activities of daily living (ADLs), i.e. actions in the simulated environment as drink, switch on a lamp or raise the bed head, during ten minutes in two different modes, AIDE mode, using a prediction model, to recognize the user intention facilitating the scan, and Manual mode, without a prediction model. RESULTS: The results show that the mean task time spent in the AIDE mode was less than in the Manual, i.e the users were able to perform more tasks in the AIDE mode during the same time. The results showed a statistically significant differences with p<0.001. Regarding the steps, i.e the number of abstraction levels crossed in the ECI to perform an ADL, the users performed one step in the 90% of the tasks using the AIDE mode and three steps, at least, were necessary in the Manual mode. The user's intention prediction was performed through conditional random fields (CRF), with a global accuracy about 87%. CONCLUSIONS: The environment analysis and the identification of the user's behaviors can be used to predict the user intention opening a new paradigm in the design of the ECIs. Although the developed ECI was tested only in a simulated home environment, it can be easily adapted to a real environment increasing the user independence at home.

Physiological Responses During Hybrid BNCI Control of an Upper-Limb Exoskeleton.

When combined with assistive robotic devices, such as wearable robotics, brain/neural-computer interfaces (BNCI) have the potential to restore the capabilities of handicapped people to carry out activities of daily living. To improve applicability of such systems, workload and stress should be reduced to a minimal level. Here, we investigated the user's physiological reactions during the exhaustive use of the interfaces of a hybrid control interface. Eleven BNCI-naive healthy volunteers participated in the experiments. All participants sat in a comfortable chair in front of a desk and wore a whole-arm exoskeleton as well as wearable devices for monitoring physiological, electroencephalographic (EEG) and electrooculographic (EoG) signals. The experimental protocol consisted of three phases: (i) Set-up, calibration and BNCI training; (ii) Familiarization phase; and (iii) Experimental phase during which each subject had to perform EEG and EoG tasks. After completing each task, the NASA-TLX questionnaire and self-assessment manikin (SAM) were completed by the user. We found significant differences (p-value < 0.05) in heart rate variability (HRV) and skin conductance level (SCL) between participants during the use of the two different biosignal modalities (EEG, EoG) of the BNCI. This indicates that EEG control is associated with a higher level of stress (associated with a decrease in HRV) and mental work load (associated with a higher level of SCL) when compared to EoG control. In addition, HRV and SCL modulations correlated with the subject's workload perception and emotional responses assessed through NASA-TLX questionnaires and SAM.

Heart rate variability predicts decline in sensorimotor rhythm control.

Objective.Voluntary control of sensorimotor rhythms (SMRs, 8-12 Hz) can be used for brain-computer interface (BCI)-based operation of an assistive hand exoskeleton, e.g. in finger paralysis after stroke. To gain SMR control, stroke survivors are usually instructed to engage in motor imagery (MI) or to attempt moving the paralyzed fingers resulting in task- or event-related desynchronization (ERD) of SMR (SMR-ERD). However, as these tasks are cognitively demanding, especially for stroke survivors suffering from cognitive impairments, BCI control performance can deteriorate considerably over time. Therefore, it would be important to identify biomarkers that predict decline in BCI control performance within an ongoing session in order to optimize the man-machine interaction scheme.Approach.Here we determine the link between BCI control performance over time and heart rate variability (HRV). Specifically, we investigated whether HRV can be used as a biomarker to predict decline of SMR-ERD control across 17 healthy participants using Granger causality. SMR-ERD was visually displayed on a screen. Participants were instructed to engage in MI-based SMR-ERD control over two consecutive runs of 8.5 min each. During the 2nd run, task difficulty was gradually increased.Main results.While control performance (p= .18) and HRV (p= .16) remained unchanged across participants during the 1st run, during the 2nd run, both measures declined over time at high correlation (performance: -0.61%/10 s,p= 0; HRV: -0.007 ms/10 s,p< .001). We found that HRV exhibited predictive characteristics with regard to within-session BCI control performance on an individual participant level (p< .001).Significance.These results suggest that HRV can predict decline in BCI performance paving the way for adaptive BCI control paradigms, e.g. to individualize and optimize assistive BCI systems in stroke.

Feasibility and Safety of Bilateral Hybrid EEG/EOG Brain/Neural-Machine Interaction.

Cervical spinal cord injuries (SCIs) often lead to loss of motor function in both hands and legs, limiting autonomy and quality of life. While it was shown that unilateral hand function can be restored after SCI using a hybrid electroencephalography/electrooculography (EEG/EOG) brain/neural hand exoskeleton (B/NHE), it remained unclear whether such hybrid paradigm also could be used for operating two hand exoskeletons, e.g., in the context of bimanual tasks such as eating with fork and knife. To test whether EEG/EOG signals allow for fluent and reliable as well as safe and user-friendly bilateral B/NHE control, eight healthy participants (six females, mean age 24.1 ± 3.2 years) as well as four chronic tetraplegics (four males, mean age 51.8 ± 15.2 years) performed a complex sequence of EEG-controlled bilateral grasping and EOG-controlled releasing motions of two exoskeletons visually presented on a screen. A novel EOG command performed by prolonged horizontal eye movements (>1 s) to the left or right was introduced as a reliable switch to activate either the left or right exoskeleton. Fluent EEG control was defined as average "time to initialize" (TTI) grasping motions below 3 s. Reliable EEG control was assumed when classification accuracy exceeded 80%. Safety was defined as "time to stop" (TTS) all unintended grasping motions within 2 s. After the experiment, tetraplegics were asked to rate the user-friendliness of bilateral B/NHE control using Likert scales. Average TTI and accuracy of EEG-controlled operations ranged at 2.14 ± 0.66 s and 85.89 ± 15.81% across healthy participants and at 1.90 ± 0.97 s and 81.25 ± 16.99% across tetraplegics. Except for one tetraplegic, all participants met the safety requirements. With 88 ± 11% of the maximum achievable score, tetraplegics rated the control paradigm as user-friendly and reliable. These results suggest that hybrid EEG/EOG B/NHE control of two assistive devices is feasible and safe, paving the way to test this paradigm in larger clinical trials performing bimanual tasks in everyday life environments.

Synchronization of Slow Cortical Rhythms During Motor Imagery-Based Brain-Machine Interface Control.

Modulation of sensorimotor rhythm (SMR) power, a rhythmic brain oscillation physiologically linked to motor imagery, is a popular Brain-Machine Interface (BMI) paradigm, but its interplay with slower cortical rhythms, also involved in movement preparation and cognitive processing, is not entirely understood. In this study, we evaluated the changes in phase and power of slow cortical activity in delta and theta bands, during a motor imagery task controlled by an SMR-based BMI system. In Experiment I, EEG of 20 right-handed healthy volunteers was recorded performing a motor-imagery task using an SMR-based BMI controlling a visual animation, and during task-free intervals. In Experiment II, 10 subjects were evaluated along five daily sessions, while BMI-controlling same visual animation, a buzzer, and a robotic hand exoskeleton. In both experiments, feedback received from the controlled device was proportional to SMR power (11-14 Hz) detected by a real-time EEG-based system. Synchronization of slow EEG frequencies along the trials was evaluated using inter-trial-phase coherence (ITPC). Results: cortical oscillations of EEG in delta and theta frequencies synchronized at the onset and at the end of both active and task-free trials; ITPC was significantly modulated by feedback sensory modality received during the tasks; and ITPC synchronization progressively increased along the training. These findings suggest that phase-locking of slow rhythms and resetting by sensory afferences might be a functionally relevant mechanism in cortical control of motor function. We propose that analysis of phase synchronization of slow cortical rhythms might also improve identification of temporal edges in BMI tasks and might help to develop physiological markers for identification of context task switching and practice-related changes in brain function, with potentially important implications for design and monitoring of motor imagery-based BMI systems, an emerging tool in neurorehabilitation of stroke.

Feasibility and safety of shared EEG/EOG and vision-guided autonomous whole-arm exoskeleton control to perform activities of daily living.

Arm and finger paralysis, e.g. due to brain stem stroke, often results in the inability to perform activities of daily living (ADLs) such as eating and drinking. Recently, it was shown that a hybrid electroencephalography/electrooculography (EEG/EOG) brain/neural hand exoskeleton can restore hand function to quadriplegics, but it was unknown whether such control paradigm can be also used for fluent, reliable and safe operation of a semi-autonomous whole-arm exoskeleton restoring ADLs. To test this, seven abled-bodied participants (seven right-handed males, mean age 30 ± 8 years) were instructed to use an EEG/EOG-controlled whole-arm exoskeleton attached to their right arm to perform a drinking task comprising multiple sub-tasks (reaching, grasping, drinking, moving back and releasing a cup). Fluent and reliable control was defined as average 'time to initialize' (TTI) execution of each sub-task below 3 s with successful initializations of at least 75% of sub-tasks within 5 s. During use of the system, no undesired side effects were reported. All participants were able to fluently and reliably control the vision-guided autonomous whole-arm exoskeleton (average TTI 2.12 ± 0.78 s across modalities with 75% successful initializations reached at 1.9 s for EOG and 4.1 s for EEG control) paving the way for restoring ADLs in severe arm and hand paralysis.

Task-Dependent Intermuscular Motor Unit Synchronization between Medial and Lateral Vastii Muscles during Dynamic and Isometric Squats.

PURPOSE: Motor unit activity is coordinated between many synergistic muscle pairs but the functional role of this coordination for the motor output is unclear. The purpose of this study was to investigate the short-term modality of coordinated motor unit activity-the synchronized discharge of individual motor units across muscles within time intervals of 5ms-for the Vastus Medialis (VM) and Lateralis (VL). Furthermore, we studied the task-dependency of intermuscular motor unit synchronization between VM and VL during static and dynamic squatting tasks to provide insight into its functional role. METHODS: Sixteen healthy male and female participants completed four tasks: Bipedal squats, single-leg squats, an isometric squat, and single-leg balance. Monopolar surface electromyography (EMG) was used to record motor unit activity of VM and VL. For each task, intermuscular motor unit synchronization was determined using a coherence analysis between the raw EMG signals of VM and VL and compared to a reference coherence calculated from two desynchronized EMG signals. The time shift between VM and VL EMG signals was estimated according to the slope of the coherence phase angle spectrum. RESULTS: For all tasks, except for singe-leg balance, coherence between 15-80Hz significantly exceeded the reference. The corresponding time shift between VM and VL was estimated as 4ms. Coherence between 30-60Hz was highest for the bipedal squat, followed by the single-leg squat and the isometric squat. CONCLUSION: There is substantial short-term motor unit synchronization between VM and VL. Intermuscular motor unit synchronization is enhanced for contractions during dynamic activities, possibly to facilitate a more accurate control of the joint torque, and reduced during single-leg tasks that require balance control and thus, a more independent muscle function. It is proposed that the central nervous system scales the degree of intermuscular motor unit synchronization according to the requirements of the movement task at hand.