Physiological Responses During Hybrid BNCI Control of an Upper-Limb Exoskeleton.

When combined with assistive robotic devices, such as wearable robotics, brain/neural-computer interfaces (BNCI) have the potential to restore the capabilities of handicapped people to carry out activities of daily living. To improve applicability of such systems, workload and stress should be reduced to a minimal level. Here, we investigated the user's physiological reactions during the exhaustive use of the interfaces of a hybrid control interface. Eleven BNCI-naive healthy volunteers participated in the experiments. All participants sat in a comfortable chair in front of a desk and wore a whole-arm exoskeleton as well as wearable devices for monitoring physiological, electroencephalographic (EEG) and electrooculographic (EoG) signals. The experimental protocol consisted of three phases: (i) Set-up, calibration and BNCI training; (ii) Familiarization phase; and (iii) Experimental phase during which each subject had to perform EEG and EoG tasks. After completing each task, the NASA-TLX questionnaire and self-assessment manikin (SAM) were completed by the user. We found significant differences (p-value < 0.05) in heart rate variability (HRV) and skin conductance level (SCL) between participants during the use of the two different biosignal modalities (EEG, EoG) of the BNCI. This indicates that EEG control is associated with a higher level of stress (associated with a decrease in HRV) and mental work load (associated with a higher level of SCL) when compared to EoG control. In addition, HRV and SCL modulations correlated with the subject's workload perception and emotional responses assessed through NASA-TLX questionnaires and SAM.

Customizable Optical Force Sensor for Fast Prototyping and Cost-Effective Applications.

This paper presents the development of an optical force sensor architecture directed to prototyping and cost-effective applications, where the actual force requirements are still not well defined or the most suitable commercial technologies would highly increase the cost of the device. The working principle of this sensor consists of determining the displacement of a lens by measuring the distortion of a refracted light beam. This lens is attached to an elastic interface whose elastic constant is known, allowing the estimation of the force that disturbs the optical system. In order to satisfy the requirements of the design process in an inexpensive way, this sensor can be built by fast prototyping technologies and using non-optical grade elements. To deal with the imperfections of this kind of manufacturing procedures and materials, four fitting models are proposed to calibrate the implemented sensor. In order to validate the system, two different sensor implementations with measurement ranges of ±45 N and ±10 N are tested with the proposed models, comparing the resulting force estimation with respect to an industrial-grade load cell. Results show that all models can estimate the loads with an error of about 6% of the measurement range.

Human arm joints reconstruction algorithm in rehabilitation therapies assisted by end-effector robotic devices.

BACKGROUND: End-effector robots are commonly used in robot-assisted neuro-rehabilitation therapies for upper limbs where the patient's hand can be easily attached to a splint. Nevertheless, they are not able to estimate and control the kinematic configuration of the upper limb during the therapy. However, the Range of Motion (ROM) together with the clinical assessment scales offers a comprehensive assessment to the therapist. Our aim is to present a robust and stable kinematic reconstruction algorithm to accurately measure the upper limb joints using only an accelerometer placed onto the upper arm. METHODS: The proposed algorithm is based on the inverse of the augmented Jaciobian as the algorithm (Papaleo, et al., Med Biol Eng Comput 53(9):815-28, 2015). However, the estimation of the elbow joint location is performed through the computation of the rotation measured by the accelerometer during the arm movement, making the algorithm more robust against shoulder movements. Furthermore, we present a method to compute the initial configuration of the upper limb necessary to start the integration method, a protocol to manually measure the upper arm and forearm lengths, and a shoulder position estimation. An optoelectronic system was used to test the accuracy of the proposed algorithm whilst healthy subjects were performing upper limb movements holding the end effector of the seven Degrees of Freedom (DoF) robot. In addition, the previous and the proposed algorithms were studied during a neuro-rehabilitation therapy assisted by the 'PUPArm' planar robot with three post-stroke patients. RESULTS: The proposed algorithm reports a Root Mean Square Error (RMSE) of 2.13cm in the elbow joint location and 1.89cm in the wrist joint location with high correlation. These errors lead to a RMSE about 3.5 degrees (mean of the seven joints) with high correlation in all the joints with respect to the real upper limb acquired through the optoelectronic system. Then, the estimation of the upper limb joints through both algorithms reveal an instability on the previous when shoulder movement appear due to the inevitable trunk compensation in post-stroke patients. CONCLUSIONS: The proposed algorithm is able to accurately estimate the human upper limb joints during a neuro-rehabilitation therapy assisted by end-effector robots. In addition, the implemented protocol can be followed in a clinical environment without optoelectronic systems using only one accelerometer attached in the upper arm. Thus, the ROM can be perfectly determined and could become an objective assessment parameter for a comprehensive assessment.

When Playing Is a Problem: An Atypical Case of Alien Hand Syndrome in a Professional Pianist.

Alien hand syndrome (AHS) is a neurological illness characterized by limb movements which are carried out without being aware of it. Many patients describe these movements as aggressive and some perceive a strong feeling of estrangement and go so far as to deny ownership. The sense of body ownership is the perception that parts of one's body pertain to oneself, despite it is moving or not and if movement is intentional or unintentional. These anomalous self-experiences may arise in patients with focal brain lesions and provide unique opportunities to disclose the neural components underlying self-body perception. The feeling of foreignness described in AHS is often observed in post-central cortical lesions in the non-dominant hemisphere and is typical of the "posterior alien hand variant". We used Diffusion-Tensor magnetic resonance imaging (DT-MRI) in an unusual case of posterior AHS of the dominant hand in a professional pianist with corticobasal syndrome (CBS). The patient showed uncontrolled levitation with the right arm while playing the piano and perceived as if her hand had a "mind of its own" which prevented her from playing. MRI-scans show asymmetric brain atrophy, mainly involving left post-central regions and SPECT-Tc99m-ECD patterns of hypometabolism over the left parietal-occipital cortices. DT-MRI revealed extensive damage which comprised left fronto-temporal cortex and extends into the ipsilateral parietal cortex causing a disruption of corpus callosum (CC) projections from the rostrum to the splenium. Our case illustrates that posterior AHS may occur in the dominant hemisphere due to widespread damage, which exceed parietal cortex. The parietal lobe has been recognized as a multimodal association region that gets input from several networks and organizes motor output. We suggest that the disturbance to this pathway could result in disruption of motor output and associate an abnormal motor control and anomalous self-body perception.

A Comparative Analysis of 2D and 3D Tasks for Virtual Reality Therapies Based on Robotic-Assisted Neurorehabilitation for Post-stroke Patients.

Post-stroke neurorehabilitation based on virtual therapies are performed completing repetitive exercises shown in visual electronic devices, whose content represents imaginary or daily life tasks. Currently, there are two ways of visualization of these task. 3D virtual environments are used to get a three dimensional space that represents the real world with a high level of detail, whose realism is determinated by the resolucion and fidelity of the objects of the task. Furthermore, 2D virtual environments are used to represent the tasks with a low degree of realism using techniques of bidimensional graphics. However, the type of visualization can influence the quality of perception of the task, affecting the patient's sensorimotor performance. The purpose of this paper was to evaluate if there were differences in patterns of kinematic movements when post-stroke patients performed a reach task viewing a virtual therapeutic game with two different type of visualization of virtual environment: 2D and 3D. Nine post-stroke patients have participated in the study receiving a virtual therapy assisted by PUPArm rehabilitation robot. Horizontal movements of the upper limb were performed to complete the aim of the tasks, which consist in reaching peripheral or perspective targets depending on the virtual environment shown. Various parameter types such as the maximum speed, reaction time, path length, or initial movement are analyzed from the data acquired objectively by the robotic device to evaluate the influence of the task visualization. At the end of the study, a usability survey was provided to each patient to analysis his/her satisfaction level. For all patients, the movement trajectories were enhanced when they completed the therapy. This fact suggests that patient's motor recovery was increased. Despite of the similarity in majority of the kinematic parameters, differences in reaction time and path length were higher using the 3D task. Regarding the success rates were very similar. In conclusion, the using of 2D environments in virtual therapy may be a more appropriate and comfortable way to perform tasks for upper limb rehabilitation of post-stroke patients, in terms of accuracy in order to effectuate optimal kinematic trajectories.

Estimation of Human Arm Joints Using Two Wireless Sensors in Robotic Rehabilitation Tasks.

This paper presents a novel kinematic reconstruction of the human arm chain with five degrees of freedom and the estimation of the shoulder location during rehabilitation therapy assisted by end-effector robotic devices. This algorithm is based on the pseudoinverse of the Jacobian through the acceleration of the upper arm, measured using an accelerometer, and the orientation of the shoulder, estimated with a magnetic angular rate and gravity (MARG) device. The results show a high accuracy in terms of arm joints and shoulder movement with respect to the real arm measured through an optoelectronic system. Furthermore, the range of motion (ROM) of 50 healthy subjects is studied from two different trials, one trying to avoid shoulder movements and the second one forcing them. Moreover, the shoulder movement in the second trial is also estimated accurately. Besides the fact that the posture of the patient can be corrected during the exercise, the therapist could use the presented algorithm as an objective assessment tool. In conclusion, the joints' estimation enables a better adjustment of the therapy, taking into account the needs of the patient, and consequently, the arm motion improves faster.

Supervised and dynamic neuro-fuzzy systems to classify physiological responses in robot-assisted neurorehabilitation.

This paper presents the application of an Adaptive Resonance Theory (ART) based on neural networks combined with Fuzzy Logic systems to classify physiological reactions of subjects performing robot-assisted rehabilitation therapies. First, the theoretical background of a neuro-fuzzy classifier called S-dFasArt is presented. Then, the methodology and experimental protocols to perform a robot-assisted neurorehabilitation task are described. Our results show that the combination of the dynamic nature of S-dFasArt classifier with a supervisory module are very robust and suggest that this methodology could be very useful to take into account emotional states in robot-assisted environments and help to enhance and better understand human-robot interactions.

Auto-adaptive robot-aided therapy using machine learning techniques.

This paper presents an application of a classification method to adaptively and dynamically modify the therapy and real-time displays of a virtual reality system in accordance with the specific state of each patient using his/her physiological reactions. First, a theoretical background about several machine learning techniques for classification is presented. Then, nine machine learning techniques are compared in order to select the best candidate in terms of accuracy. Finally, first experimental results are presented to show that the therapy can be modulated in function of the patient state using machine learning classification techniques.

Distributed smart device for monitoring, control and management of electric loads in domotic environments.

This paper presents a microdevice for monitoring, control and management of electric loads at home. The key idea is to compact the electronic design as much as possible in order to install it inside a Schuko socket. Moreover, the electronic Schuko socket (electronic microdevice + Schuko socket) has the feature of communicating with a central unit and with other microdevices over the existing powerlines. Using the existing power lines, the proposed device can be installed in new buildings or in old ones. The main use of this device is to monitor, control and manage electric loads to save energy and prevent accidents produced by different kind of devices (e.g., iron) used in domestic tasks. The developed smart device is based on a single phase multifunction energy meter manufactured by Analog Devices (ADE7753) to measure the consumption of electrical energy and then to transmit it using a serial interface. To provide current measurement information to the ADE7753, an ultra flat SMD open loop integrated circuit current transducer based on the Hall effect principle manufactured by Lem (FHS-40P/SP600) has been used. Moreover, each smart device has a PL-3120 smart transceiver manufactured by LonWorks to execute the user's program, to communicate with the ADE7753 via serial interface and to transmit information to the central unit via powerline communication. Experimental results show the exactitude of the measurements made using the developed smart device.

Robust and cooperative image-based visual servoing system using a redundant architecture.

The reliability and robustness of image-based visual servoing systems is still unsolved by the moment. In order to address this issue, a redundant and cooperative 2D visual servoing system based on the information provided by two cameras in eye-in-hand/eye-to-hand configurations is proposed. Its control law has been defined to assure that the whole system is stable if each subsystem is stable and to allow avoiding typical problems of image-based visual servoing systems like task singularities, features extraction errors, disappearance of image features, local minima, etc. Experimental results with an industrial robot manipulator based on Schunk modular motors to demonstrate the stability, performance and robustness of the proposed system are presented.