Expressivity attributed to music affects the smoothness of bowing movements in violinists.

Playing music is a complex task that relies on the combination of musicians' technical and expressive skills. While the literature has investigated the effects of musical expressivity on the listeners, the way how technical difficulty and emotional expressivity affect musicians during playing has surprisingly received no attention. In an attempt to fill this gap in the literature, we collected behavioral and physiological data from twelve violinists playing 29 pieces that included both technical exercises and excerpts from classical repertoire for violin. After playing each stimulus, participants rated it for emotional expressivity and technical difficulty. During the entire session, cardiac parameters and electrodermal activity were collected, together with the kinematic parameters of the bowing gesture. A set of Linear Mixed-Effect (LME) models suggested that emotional expressivity attributed to music affected the fluidity of bowing (i.e., smoothness), with the excerpts rated as more expressive being performed in a less smooth way. In contrast, LME models revealed no effects of expressivity and technical difficulty on any of the physiological parameters of violinists. Our results offer novel insights into the psychophysiological dynamics that link motor parameters with musical expressivity. These findings could influence educational practices in music and deepen our understanding of aesthetic emotions.

Tele-Impedance control of a virtual avatar based on EMG and M-IMU sensors: a proof-of-concept.

The broad spread of cooperative robots into many application domains has resulted in a demand for intuitive and effective solutions for teleoperated control. A relevant role in teleoperation has been assumed by impedance controllers, that allow the increase of stability and accuracy during interaction. This paper aims to test a teleoperation method based on an impedance controller, namely tele-impedance control, that is usable in unstructured environments since it relies only on wearable sensors. The proposed solution maps the joint stiffness and position of the human user, computed through six EMG and two M-IMU sensors, into the remote system to be teleoperated. We developed a 2-DoFs virtual task involving virtual physical interactions to compare the performance of our solution with the one of a traditional position-based controller. The study has been conducted on five healthy participants, who experienced both controllers in two different sessions. The tele-impedance approach has proved to be less physically demanding and more intuitive than the position-based one. Experimental data also allow us to investigate the strategy employed by the volunteers in the case of remote interactions, while using the two controllers. Of note, even though with the position controller the variation of subject impedance has no effect on the virtual arm, participants still tend to regulate both impedance and position of their own arm.

Real-Time Visual Feedback Based on MIMUs Technology Reduces Bowing Errors in Beginner Violin Students.

Violin is one of the most complex musical instruments to learn. The learning process requires constant training and many hours of exercise and is primarily based on a student-teacher interaction where the latter guides the beginner through verbal instructions, visual demonstrations, and physical guidance. The teacher's instruction and practice allow the student to learn gradually how to perform the correct gesture autonomously. Unfortunately, these traditional teaching methods require the constant supervision of a teacher and the interpretation of non-real-time feedback provided after the performance. To address these limitations, this work presents a novel interface (Visual Interface for Bowing Evaluation-VIBE) to facilitate student's progression throughout the learning process, even in the absence of direct teacher intervention. The proposed interface allows two key parameters of bowing movements to be monitored, namely, the angle between the bow and the string (i.e., α angle) and the bow tilt (i.e., ß angle), providing real-time visual feedback on how to correctly move the bow. Results collected on 24 beginners (12 exposed to visual feedback, 12 in a control group) showed a positive effect of the real-time visual feedback on the improvement of bow control. Moreover, the subjects exposed to visual feedback judged the latter as useful to correct their movement and clear in terms of the presentation of data. Although the task was rated as harder when performed with the additional feedback, the subjects did not perceive the presence of a violin teacher as essential to interpret the feedback.

Experiencing an Elongated Limb in Virtual Reality Modifies the Tactile Distance Perception of the Corresponding Real Limb.

In measurement, a reference frame is needed to compare the measured object to something already known. This raises the neuroscientific question of which reference frame is used by humans when exploring the environment. Previous studies suggested that, in touch, the body employed as measuring tool also serves as reference frame. Indeed, an artificial modification of the perceived dimensions of the body changes the tactile perception of external object dimensions. However, it is unknown if such a change in tactile perception would occur when the body schema is modified through the illusion of owning a limb altered in size. Therefore, employing a virtual hand illusion paradigm with an elongated forearm of different lengths, we systematically tested the subjective perception of distance between two points [tactile distance perception (TDP) task] on the corresponding real forearm following the illusion. Thus, the TDP task is used as a proxy to gauge changes in the body schema. Embodiment of the virtual arm was found significantly greater after the synchronous visuotactile stimulation condition compared with the asynchronous one, and the forearm elongation significantly increased the TDP. However, we did not find any link between the visuotactile-induced ownership over the elongated arm and TDP variation, suggesting that vision plays the main role in the modification of the body schema. Additionally, significant effect of elongation found on TDP but not on proprioception suggests that these are affected differently by body schema modifications. These findings confirm the body schema malleability and its role as a reference frame in touch.

Comparing end-effector position and joint angle feedback for online robotic limb tracking.

Somatosensation greatly increases the ability to control our natural body. This suggests that supplementing vision with haptic sensory feedback would also be helpful when a user aims at controlling a robotic arm proficiently. However, whether the position of the robot and its continuous update should be coded in a extrinsic or intrinsic reference frame is not known. Here we compared two different supplementary feedback contents concerning the status of a robotic limb in 2-DoFs configuration: one encoding the Cartesian coordinates of the end-effector of the robotic arm (i.e., Task-space feedback) and another and encoding the robot joints angles (i.e., Joint-space feedback). Feedback was delivered to blindfolded participants through vibrotactile stimulation applied on participants' leg. After a 1.5-hour training with both feedbacks, participants were significantly more accurate with Task compared to Joint-space feedback, as shown by lower position and aiming errors, albeit not faster (i.e., similar onset delay). However, learning index during training was significantly higher in Joint space feedback compared to Task-space feedback. These results suggest that Task-space feedback is probably more intuitive and more suited for activities which require short training sessions, while Joint space feedback showed potential for long-term improvement. We speculate that the latter, despite performing worse in the present work, might be ultimately more suited for applications requiring long training, such as the control of supernumerary robotic limbs for surgical robotics, heavy industrial manufacturing, or more generally, in the context of human movement augmentation.

Wrist redundancy management during pointing tasks remains stable over time and in presence of a visuomotor perturbation.

Pointing at a screen using wrist and forearm movements is a kinematically redundant task, and the Central Nervous System seems to manage this redundancy by using a simplifying strategy, named Donders' Law for the wrist. In this work we investigated (1) whether this simplifying approach is stable over time and (2) whether a visuomotor perturbation provided in the task space influences the strategy used to solve the redundancy problem. We conducted two experiments asking participants to perform the same pointing task in four different days (first experiment), and providing a visual perturbation, i.e. a visuomotor rotation to the controlled cursor (second experiment), while recording their wrist and forearm rotations. Results showed that the participant-specific wrist redundancy management (described by the Donders' surfaces) (1) neither changes over time (2) nor varies when a visuomotor perturbation is provided in the task space.

Linear and Non-Linear Heart Rate Variability Indexes from Heart-Induced Mechanical Signals Recorded with a Skin-Interfaced IMU.

Heart rate variability (HRV) indexes are becoming useful in various applications, from better diagnosis and prevention of diseases to predicting stress levels. Typically, HRV indexes are retrieved from the heart's electrical activity collected with an electrocardiographic signal (ECG). Heart-induced mechanical signals recorded from the body's surface can be utilized to record the mechanical activity of the heart and, in turn, extract HRV indexes from interbeat intervals (IBIs). Among others, accelerometers and gyroscopes can be used to register IBIs from precordial accelerations and chest wall angular velocities. However, unlike electrical signals, the morphology of mechanical ones is strongly affected by body posture. In this paper, we investigated the feasibility of estimating the most common linear and non-linear HRV indexes from accelerometer and gyroscope data collected with a wearable skin-interfaced Inertial Measurement Unit (IMU) positioned at the xiphoid level. Data were collected from 21 healthy volunteers assuming two common postures (i.e., seated and lying). Results show that using the gyroscope signal in the lying posture allows accurate results in estimating IBIs, thus allowing extracting of linear and non-linear HRV parameters that are not statistically significantly different from those extracted from reference ECG.

Comparison between Chest-Worn Accelerometer and Gyroscope Performance for Heart Rate and Respiratory Rate Monitoring.

The demand for wearable devices to simultaneously monitor heart rate (HR) and respiratory rate (RR) values has grown due to the incidence increase in cardiovascular and respiratory diseases. The use of inertial measurement unit (IMU) sensors, embedding both accelerometers and gyroscopes, may ensure a non-intrusive and low-cost monitoring. While both accelerometers and gyroscopes have been assessed independently for both HR and RR monitoring, there lacks a comprehensive comparison between them when used simultaneously. In this study, we used both accelerometers and gyroscopes embedded in a single IMU sensor for the simultaneous monitoring of HR and RR. The following main findings emerged: (i) the accelerometer outperformed the gyroscope in terms of accuracy in both HR and RR estimation; (ii) the window length used to estimate HR and RR values influences the accuracy; and (iii) increasing the length over 25 s does not provide a relevant improvement, but accuracy improves when the subject is seated or lying down, and deteriorates in the standing posture. Our study provides a comprehensive comparison between two promising systems, highlighting their potentiality for real-time cardiorespiratory monitoring. Furthermore, we give new insights into the influence of window length and posture on the systems' performance, which can be useful to spread this approach in clinical settings.

Evaluating Handwriting Skills through Human-Machine Interaction: A New Digitalized System for Parameters Extraction.

Handwriting is an important component of academic curricula and grapho-motor skills (GMS) support learning, reading, memory and self-confidence. Teachers and clinicians report increase in children experiencing problems with acquiring fluid and legible handwriting. To date gold-standard tests evaluating children's GMS, mostly rely on pen and paper tests, requiring extensive coding time and subject to high inter-rater variability. This work presents preliminary data on a new digital platform for Grapho-motor Handwriting Evaluation & Exercise (GHEE), attempting to overcome limitations of available digitalized methods for GMS evalution. In fact, contrary to previous systems, GHEE design originated from comparisons among multiple standardized tests and was based on a human-machine interaction approach. GHEE hardware and software is presented as well as data on preliminary testing. Cursive handwriting data from six adult volunteers was analyzed according to six parameters of relevance, both automatically (i.e., using GHEE software) and manually (i.e., by a human coder). Comparisons among machine and human data sets allowed parsing out parameters to be extracted automatically and parameters requiring human-machine interaction. Results confirmed platform efficacy and feasibility of the proposed approach.

New Methods for Unraveling Imitation Accuracy Differences Between Children with Autism and Typically Developing Peers.

This study applies methods used in sign language and gesture research to better understand reduced imitation accuracy (IA) of actions and gestures in children with autism spectrum disorder (ASD), and we addressed contrasting theories on IA in ASD and the role of objects and meanings in imitation. Eight male children with ASD with a mean chronological age (CA) of 86.76 months (SD = 10.74, range 70.5-104.4) and 22 male and female peers with typical development (TD) and a mean CA of 85.44 months (SD = 7.95, range 73.4-96.7) imitated videos of an adult performing actions with objects, representational gestures, conventional gestures and meaningless gestures. We measured accuracy as ability to effectively reproduce features (handshape, palm orientation, location, movement direction and type) and timing (speed) of observed actions/gestures, after ruling out cases of specular (i.e., mirror-like) versus anatomical imitation. Results highlighted significantly lower feature and timing accuracy in children with ASD with respect to the TD group across tasks, and these findings supported sensory-motor theories of IA in ASD. Our data also showed the different impact of objects and meanings within groups. Overall, these results suggest validity to our assessment method and suggested the importance of considering both discreet variables (i.e., variables describing action/gesture feature accuracy, e.g. handshape, movement direction) and continuous variables (i.e., kinematic variables, e.g. speed) in evaluating IA in autism.

Design of multi-pad electrotactile system envisioned as a feedback channel for supernumerary robotic limbs.

BACKGROUND: Providing real-time haptic feedback is an important, but still not sufficiently explored aspect of the use of supernumerary robotic limbs (SRLs). We present a multi-pad electrode for conveying multi-modal proprioceptive and sensory information from SRL to the user's thigh and propose a method for stimuli calibration. METHODS: Within two pilot tests, we investigated return electrode configuration and active electrode discrimination in three healthy subjects to select the appropriate electrode pad topology. Based on the obtained results and anthropometric data from the literature, the electrode was designed to have three branches of 10 pads and two additional pads that can be displaced over/under the electrode branches. The electrode was designed to be connected to the stimulator that allows full multiplexing so that specific branches can serve as a common return electrode. To define the procedure for application of this system, the sensation, localization, and discomfort thresholds applicable for the novel electrode were determined and analyzed in 10 subjects. RESULTS: The results showed no overlaps between the three thresholds for individual pads, with significantly different average values, suggesting that the selected electrode positioning and design provide a good active range of useful current amplitude. The results of the subsequent analysis suggested that the stimuli intensity level of 200% of the sensation threshold is the most probable value of the localization threshold. Furthermore, this level ensures a low chance (i.e., 0.7%) of reaching the discomfort. CONCLUSIONS: We believe that envisioned electrotactile system could serve as a high bandwidth feedback channel that can be easily set up to provide proprioceptive and sensory feedback from supernumerary limbs.

A multi-point heart rate monitoring using a soft wearable system based on fiber optic technology.

Early diagnosis can be crucial to limit both the mortality and economic burden of cardiovascular diseases. Recent developments have focused on the continuous monitoring of cardiac activity for a prompt diagnosis. Nowadays, wearable devices are gaining broad interest for a continuous monitoring of the heart rate (HR). One of the most promising methods to estimate HR is the seismocardiography (SCG) which allows to record the thoracic vibrations with high non-invasiveness in out-of-laboratory settings. Despite significant progress on SCG, the current state-of-the-art lacks both information on standardized sensor positioning and optimization of wearables design. Here, we introduce a soft wearable system (SWS), whose novel design, based on a soft polymer matrix embedding an array of fiber Bragg gratings, provides a good adhesion to the body and enables the simultaneous recording of SCG signals from multiple measuring sites. The feasibility assessment on healthy volunteers revealed that the SWS is a suitable wearable solution for HR monitoring and its performance in HR estimation is strongly influenced by sensor positioning and improved by a multi-sensor configuration. These promising characteristics open the possibility of using the SWS in monitoring patients with cardiac pathologies in clinical (e.g., during cardiac magnetic resonance procedures) and everyday life settings.

Skin Strain Analysis of the Scapular Region and Wearables Design.

Monitoring scapular movements is of relevance in the contexts of rehabilitation and clinical research. Among many technologies, wearable systems instrumented by strain sensors are emerging in these applications. An open challenge for the design of these systems is the optimal positioning of the sensing elements, since their response is related to the strain of the underlying substrates. This study aimed to provide a method to analyze the human skin strain of the scapular region. Experiments were conducted on five healthy volunteers to assess the skin strain during upper limb movements in the frontal, sagittal, and scapular planes at different degrees of elevation. A 6 × 5 grid of passive markers was placed posteriorly to cover the entire anatomic region of interest. Results showed that the maximum strain values, in percentage, were 28.26%, and 52.95%, 60.12% and 60.87%, 40.89%, and 48.20%, for elevation up to 90° and maximum elevation in the frontal, sagittal, and scapular planes, respectively. In all cases, the maximum extension is referred to the pair of markers placed horizontally near the axillary fold. Accordingly, this study suggests interesting insights for designing and positioning textile-based strain sensors in wearable systems for scapular movements monitoring.

A Wearable System with Embedded Conductive Textiles and an IMU for Unobtrusive Cardio-Respiratory Monitoring.

The continuous and simultaneous monitoring of physiological parameters represents a key aspect in clinical environments, remote monitoring and occupational settings. In this regard, respiratory rate (RR) and heart rate (HR) are correlated with several physiological and pathological conditions of the patients/workers, and with environmental stressors. In this work, we present and validate a wearable device for the continuous monitoring of such parameters. The proposed system embeds four conductive sensors located on the user's chest which allow retrieving the breathing activity through their deformation induced during cyclic expansion and contraction of the rib cage. For monitoring HR we used an embedded IMU located on the left side of the chest wall. We compared the proposed device in terms of estimating HR and RR against a reference system in three scenarios: sitting, standing and supine. The proposed system reliably estimated both RR and HR, showing low error averaged along subjects in all scenarios. This is the first study focused on the feasibility assessment of a wearable system based on a multi-sensor configuration (i.e., conductive sensors and IMU) for RR and HR monitoring. The promising results encourage the application of this approach in clinical and occupational settings.

Smart Sensors for Healthcare and Medical Applications.

This special issue on "Smart Sensors for Healthcare and Medical Applications" focuses on new sensing technologies, measurement techniques, and their applications in medicine and healthcare [...].

An fMRI Compatible Smart Device for Measuring Palmar Grasping Actions in Newborns.

Grasping is one of the first dominant motor behaviors that enable interaction of a newborn infant with its surroundings. Although atypical grasping patterns are considered predictive of neuromotor disorders and injuries, their clinical assessment suffers from examiner subjectivity, and the neuropathophysiology is poorly understood. Therefore, the combination of technology with functional magnetic resonance imaging (fMRI) may help to precisely map the brain activity associated with grasping and thus provide important insights into how functional outcomes can be improved following cerebral injury. This work introduces an MR-compatible device (i.e., smart graspable device (SGD)) for detecting grasping actions in newborn infants. Electromagnetic interference immunity (EMI) is achieved using a fiber Bragg grating sensor. Its biocompatibility and absence of electrical signals propagating through the fiber make the safety profile of the SGD particularly favorable for use with fragile infants. Firstly, the SGD design, fabrication, and metrological characterization are described, followed by preliminary assessments on a preterm newborn infant and an adult during an fMRI experiment. The results demonstrate that the combination of the SGD and fMRI can safely and precisely identify the brain activity associated with grasping behavior, which may enable early diagnosis of motor impairment and help guide tailored rehabilitation programs.

Manipulating The Body Representation: Assessment Of A Novel Platform.

The Rubber Hand Illusion can be used to induce the illusion that a fake hand is part of one's own body. Thus, it can be used to alter the body representation. It was also reported that the Rubber Hand Illusion induces a proprioceptive drift of one's real hand toward the fake hand. The Rubber Hand Illusion can be induced when the fake hand is placed farther in the sagittal plane (distally) compared to the real hand. In this case, the induced update of the body representation is an elongation of the arm. Virtual Reality and haptic technologies can be used to manipulate the perceived scenario in a virtual version of the Rubber Hand Illusion, the Virtual Hand Illusion. We developed a novel platform consisting in a virtual reality application integrating an optical motion capture device and haptic stimulators to study the manipulation of the body representation. We developed two experimental protocols to induce embodiment of an elongated arm: one validated in previous studies, that employs congruent visuo-motor-tactile stimulation, and one reproducing the typical Virtual Hand Illusion where only congruent visuo-tactile stimulation was employed. We tested both protocols with healthy participants.

A Complementary Filter Design on SE(3) to IdentifyMicro-Motions during 3D Motion Tracking.

In 3D motion capture, multiple methods have been developed in order to optimize thequality of the captured data. While certain technologies, such as inertial measurement units (IMU),are mostly suitable for 3D orientation estimation at relatively high frequencies, other technologies,such as marker-based motion capture, are more suitable for 3D position estimations at a lower frequencyrange. In this work, we introduce a complementary filter that complements 3D motion capture datawith high-frequency acceleration signals from an IMU. While the local optimization reduces the error ofthe motion tracking, the additional accelerations can help to detect micro-motions that are useful whendealing with high-frequency human motions or robotic applications. The combination of high-frequencyaccelerometers improves the accuracy of the data and helps to overcome limitations in motion capturewhen micro-motions are not traceable with 3D motion tracking system. In our experimental evaluation,we demonstrate the improvements of the motion capture results during translational, rotational,and combined movements.

A Wearable Device Based on a Fiber Bragg Grating Sensor for Low Back Movements Monitoring.

Low back pain (LBP) is one of the musculoskeletal disorders that most affects workers. Among others, one of the working categories which mainly experiences such disease are video terminal workers. As it causes exploitation of the National Health Service and absenteeism in workplaces, LBP constitutes a relevant socio-economic burden. In such a scenario, a prompt detection of wrong seating postures can be useful to prevent the occurrence of this disorder. To date, many tools capable of monitoring the spinal range of motions (ROMs) are marketed, but most of them are unusable in working environments due to their bulkiness, discomfort and invasiveness. In the last decades, fiber optic sensors have made their mark allowing the creation of light and compact wearable systems. In this study, a novel wearable device embedding a Fiber Bragg Grating sensor for the detection of lumbar flexion-extensions (F/E) in seated subjects is proposed. At first, the manufacturing process of the sensing element was shown together with its mechanical characterization, that shows linear response to strain with a high correlation coefficient (R2 > 0.99) and a sensitivity value (Sε) of 0.20 nm∙mε-1. Then, the capability of the wearable device in measuring F/E in the sagittal body plane was experimentally assessed on a small population of volunteers, using a Motion Capture system (MoCap) as gold standard showing good ability of the system to match the lumbar F/E trend in time. Additionally, the lumbar ROMs were evaluated in terms of intervertebral lumbar distances (Δ d L 3 - L 1 ) and angles, exhibiting moderate to good agreement with the MoCap outputs (the maximum Mean Absolute Error obtained is ~16% in detecting Δ d L 3 - L 1 ). The proposed wearable device is the first attempt for the development of FBG-based wearable systems for workers' safety monitoring.

PDMeter: A Wrist Wearable Device for an at-Home Assessment of the Parkinson's Disease Rigidity.

This work focuses on the design and the validation of a wearable mechatronic device for an at-home assessment of wrist stiffness in patients affected by Parkinson's Disease (PD). The device includes one actuated joint and four passive revolute joints with a high overall intrinsic backdriveability. In order to allow the user to freely move the wrist during activities of daily living, we implemented a transparent controller on the basis of the interaction force sensed by the embedded load cell. Conversely, in order to provide perturbations for estimating the wrist flexion-extension rigidity, we implemented a torque controller. Firstly, we report a pilot study that aimed at characterizing the device in terms of range of motion (ROM) allowed, transparency perceived and torque-tracking capability. Then, we present a case study in which we tested our device with seven PD patients in both drug-OFF and drug-ON conditions and we compared the measured stiffness with the one measured in fourteen healthy controls and with the outcome of the most used clinical scale (MDS-UPDRS). The device allowed to successfully estimate the stiffness as different depending on the movement direction. Indeed, extension stiffness was higher than the flexion one, accordingly to the literature. Moreover, the device allowed to discriminate both Healthy subjects from PD subjects, and PD subjects in OFF condition from PD subjects in ON condition. In conclusion, we demonstrate the feasibility of the device in measuring wrist rigidity, thus enabling the possibility to implement an at-home assessment of the PD rigidity.