Real-Time Visual Feedback Based on MIMUs Technology Reduces Bowing Errors in Beginner Violin Students.

Violin is one of the most complex musical instruments to learn. The learning process requires constant training and many hours of exercise and is primarily based on a student-teacher interaction where the latter guides the beginner through verbal instructions, visual demonstrations, and physical guidance. The teacher's instruction and practice allow the student to learn gradually how to perform the correct gesture autonomously. Unfortunately, these traditional teaching methods require the constant supervision of a teacher and the interpretation of non-real-time feedback provided after the performance. To address these limitations, this work presents a novel interface (Visual Interface for Bowing Evaluation-VIBE) to facilitate student's progression throughout the learning process, even in the absence of direct teacher intervention. The proposed interface allows two key parameters of bowing movements to be monitored, namely, the angle between the bow and the string (i.e., α angle) and the bow tilt (i.e., ß angle), providing real-time visual feedback on how to correctly move the bow. Results collected on 24 beginners (12 exposed to visual feedback, 12 in a control group) showed a positive effect of the real-time visual feedback on the improvement of bow control. Moreover, the subjects exposed to visual feedback judged the latter as useful to correct their movement and clear in terms of the presentation of data. Although the task was rated as harder when performed with the additional feedback, the subjects did not perceive the presence of a violin teacher as essential to interpret the feedback.

Linear and Non-Linear Heart Rate Variability Indexes from Heart-Induced Mechanical Signals Recorded with a Skin-Interfaced IMU.

Heart rate variability (HRV) indexes are becoming useful in various applications, from better diagnosis and prevention of diseases to predicting stress levels. Typically, HRV indexes are retrieved from the heart's electrical activity collected with an electrocardiographic signal (ECG). Heart-induced mechanical signals recorded from the body's surface can be utilized to record the mechanical activity of the heart and, in turn, extract HRV indexes from interbeat intervals (IBIs). Among others, accelerometers and gyroscopes can be used to register IBIs from precordial accelerations and chest wall angular velocities. However, unlike electrical signals, the morphology of mechanical ones is strongly affected by body posture. In this paper, we investigated the feasibility of estimating the most common linear and non-linear HRV indexes from accelerometer and gyroscope data collected with a wearable skin-interfaced Inertial Measurement Unit (IMU) positioned at the xiphoid level. Data were collected from 21 healthy volunteers assuming two common postures (i.e., seated and lying). Results show that using the gyroscope signal in the lying posture allows accurate results in estimating IBIs, thus allowing extracting of linear and non-linear HRV parameters that are not statistically significantly different from those extracted from reference ECG.

Design of multi-pad electrotactile system envisioned as a feedback channel for supernumerary robotic limbs.

BACKGROUND: Providing real-time haptic feedback is an important, but still not sufficiently explored aspect of the use of supernumerary robotic limbs (SRLs). We present a multi-pad electrode for conveying multi-modal proprioceptive and sensory information from SRL to the user's thigh and propose a method for stimuli calibration. METHODS: Within two pilot tests, we investigated return electrode configuration and active electrode discrimination in three healthy subjects to select the appropriate electrode pad topology. Based on the obtained results and anthropometric data from the literature, the electrode was designed to have three branches of 10 pads and two additional pads that can be displaced over/under the electrode branches. The electrode was designed to be connected to the stimulator that allows full multiplexing so that specific branches can serve as a common return electrode. To define the procedure for application of this system, the sensation, localization, and discomfort thresholds applicable for the novel electrode were determined and analyzed in 10 subjects. RESULTS: The results showed no overlaps between the three thresholds for individual pads, with significantly different average values, suggesting that the selected electrode positioning and design provide a good active range of useful current amplitude. The results of the subsequent analysis suggested that the stimuli intensity level of 200% of the sensation threshold is the most probable value of the localization threshold. Furthermore, this level ensures a low chance (i.e., 0.7%) of reaching the discomfort. CONCLUSIONS: We believe that envisioned electrotactile system could serve as a high bandwidth feedback channel that can be easily set up to provide proprioceptive and sensory feedback from supernumerary limbs.

Smart Sensors for Healthcare and Medical Applications.

This special issue on "Smart Sensors for Healthcare and Medical Applications" focuses on new sensing technologies, measurement techniques, and their applications in medicine and healthcare [...].

Skin Strain Analysis of the Scapular Region and Wearables Design.

Monitoring scapular movements is of relevance in the contexts of rehabilitation and clinical research. Among many technologies, wearable systems instrumented by strain sensors are emerging in these applications. An open challenge for the design of these systems is the optimal positioning of the sensing elements, since their response is related to the strain of the underlying substrates. This study aimed to provide a method to analyze the human skin strain of the scapular region. Experiments were conducted on five healthy volunteers to assess the skin strain during upper limb movements in the frontal, sagittal, and scapular planes at different degrees of elevation. A 6 × 5 grid of passive markers was placed posteriorly to cover the entire anatomic region of interest. Results showed that the maximum strain values, in percentage, were 28.26%, and 52.95%, 60.12% and 60.87%, 40.89%, and 48.20%, for elevation up to 90° and maximum elevation in the frontal, sagittal, and scapular planes, respectively. In all cases, the maximum extension is referred to the pair of markers placed horizontally near the axillary fold. Accordingly, this study suggests interesting insights for designing and positioning textile-based strain sensors in wearable systems for scapular movements monitoring.

A Wearable System with Embedded Conductive Textiles and an IMU for Unobtrusive Cardio-Respiratory Monitoring.

The continuous and simultaneous monitoring of physiological parameters represents a key aspect in clinical environments, remote monitoring and occupational settings. In this regard, respiratory rate (RR) and heart rate (HR) are correlated with several physiological and pathological conditions of the patients/workers, and with environmental stressors. In this work, we present and validate a wearable device for the continuous monitoring of such parameters. The proposed system embeds four conductive sensors located on the user's chest which allow retrieving the breathing activity through their deformation induced during cyclic expansion and contraction of the rib cage. For monitoring HR we used an embedded IMU located on the left side of the chest wall. We compared the proposed device in terms of estimating HR and RR against a reference system in three scenarios: sitting, standing and supine. The proposed system reliably estimated both RR and HR, showing low error averaged along subjects in all scenarios. This is the first study focused on the feasibility assessment of a wearable system based on a multi-sensor configuration (i.e., conductive sensors and IMU) for RR and HR monitoring. The promising results encourage the application of this approach in clinical and occupational settings.

Modulation of Body Representation Impacts on Efferent Autonomic Activity.

The afferent branch of the autonomic nervous system contributes with interoception to the multimodal sensory correlation continuously needed to update our representation of the body. To test whether the modulation of body representation would have an impact on the efferent branch of the autonomic nervous system, nonspecific skin conductance has been measured in three rubber hand illusion (RHI) experiments, controlled with asynchronous brush-stroking and incongruent fake hand position. Nonspecific skin conductance standard deviation (SCSD) computed along the whole 90 sec of stroking was found to be increased by the illusion and to correlate with all the typical measures of embodiment. Computing SCSD in shorter time windows strongly enhanced the difference between illusion and controls. The highest difference was found in the 10-55 sec window, being the 14-34 sec window as the most informative one. The higher correlations with the validated measures of embodiment (all but the proprioceptive drift) were found for time windows ranging between 35 and 65 sec. The SCSD was no longer significantly higher when the RHI was repeated twice (two trials each iteration), but it was still significantly higher in synchronous stroking even when considering only the second trial. However, after the first iteration of the RHI paradigm, the effect of the embodiment on nonspecific skin conductance response results to be attenuated, suggesting that novelty in presentation of the RHI can contribute to the effect on nonspecific skin conductance response. Results candidate SCSD as a noninvasive, cheap, easy, and objective measure of embodiment, especially sensible to onset and strength of the illusion. Alike the already known enhanced autonomic reaction to a threatening, SCSD does not interfere with the collection of other behavioral measures. Correlations and their dynamics, presence of the effect in the second presentation of the setup but relative low robustness against multiple repetition, suggest that the increased fluctuations of skin conductance caught by SCSD are not just the effect of different presented sensory stimuli but more likely a stronger arousal response to the novelty of the updated perceptual status.

A Complementary Filter Design on SE(3) to IdentifyMicro-Motions during 3D Motion Tracking.

In 3D motion capture, multiple methods have been developed in order to optimize thequality of the captured data. While certain technologies, such as inertial measurement units (IMU),are mostly suitable for 3D orientation estimation at relatively high frequencies, other technologies,such as marker-based motion capture, are more suitable for 3D position estimations at a lower frequencyrange. In this work, we introduce a complementary filter that complements 3D motion capture datawith high-frequency acceleration signals from an IMU. While the local optimization reduces the error ofthe motion tracking, the additional accelerations can help to detect micro-motions that are useful whendealing with high-frequency human motions or robotic applications. The combination of high-frequencyaccelerometers improves the accuracy of the data and helps to overcome limitations in motion capturewhen micro-motions are not traceable with 3D motion tracking system. In our experimental evaluation,we demonstrate the improvements of the motion capture results during translational, rotational,and combined movements.

A Wearable Device Based on a Fiber Bragg Grating Sensor for Low Back Movements Monitoring.

Low back pain (LBP) is one of the musculoskeletal disorders that most affects workers. Among others, one of the working categories which mainly experiences such disease are video terminal workers. As it causes exploitation of the National Health Service and absenteeism in workplaces, LBP constitutes a relevant socio-economic burden. In such a scenario, a prompt detection of wrong seating postures can be useful to prevent the occurrence of this disorder. To date, many tools capable of monitoring the spinal range of motions (ROMs) are marketed, but most of them are unusable in working environments due to their bulkiness, discomfort and invasiveness. In the last decades, fiber optic sensors have made their mark allowing the creation of light and compact wearable systems. In this study, a novel wearable device embedding a Fiber Bragg Grating sensor for the detection of lumbar flexion-extensions (F/E) in seated subjects is proposed. At first, the manufacturing process of the sensing element was shown together with its mechanical characterization, that shows linear response to strain with a high correlation coefficient (R2 > 0.99) and a sensitivity value (Sε) of 0.20 nm∙mε-1. Then, the capability of the wearable device in measuring F/E in the sagittal body plane was experimentally assessed on a small population of volunteers, using a Motion Capture system (MoCap) as gold standard showing good ability of the system to match the lumbar F/E trend in time. Additionally, the lumbar ROMs were evaluated in terms of intervertebral lumbar distances (Δ d L 3 - L 1 ) and angles, exhibiting moderate to good agreement with the MoCap outputs (the maximum Mean Absolute Error obtained is ~16% in detecting Δ d L 3 - L 1 ). The proposed wearable device is the first attempt for the development of FBG-based wearable systems for workers' safety monitoring.

Breath-Jockey: Development and Feasibility Assessment of a Wearable System for Respiratory Rate and Kinematic Parameter Estimation for Gallop Athletes.

In recent years, wearable devices for physiological parameter monitoring in sports and physical activities have been gaining momentum. In particular, some studies have focused their attention on using available commercial monitoring systems mainly on horses during training sessions or competitions. Only a few studies have focused on the jockey's physiological and kinematic parameters. Although at a glance, it seems jockeys do not make a lot of effort during riding, it is quite the opposite. Indeed, especially during competitions, they profuse a short but high intensity effort. To this extend, we propose a wearable system integrating conductive textiles and an M-IMU to simultaneously monitor the respiratory rate (RR) and kinematic parameters of the riding activity. Firstly, we tested the developed wearable system on a healthy volunteer mimicking the typical riding movements of jockeys and compared the performances with a reference instrument. Lastly, we tested the system on two gallop jockeys during the "137∘ Derby Italiano di Galoppo". The proposed system is able to track both the RR and the kinematic parameters during the various phases of the competition both at rest and during the race.

An fMRI Compatible Smart Device for Measuring Palmar Grasping Actions in Newborns.

Grasping is one of the first dominant motor behaviors that enable interaction of a newborn infant with its surroundings. Although atypical grasping patterns are considered predictive of neuromotor disorders and injuries, their clinical assessment suffers from examiner subjectivity, and the neuropathophysiology is poorly understood. Therefore, the combination of technology with functional magnetic resonance imaging (fMRI) may help to precisely map the brain activity associated with grasping and thus provide important insights into how functional outcomes can be improved following cerebral injury. This work introduces an MR-compatible device (i.e., smart graspable device (SGD)) for detecting grasping actions in newborn infants. Electromagnetic interference immunity (EMI) is achieved using a fiber Bragg grating sensor. Its biocompatibility and absence of electrical signals propagating through the fiber make the safety profile of the SGD particularly favorable for use with fragile infants. Firstly, the SGD design, fabrication, and metrological characterization are described, followed by preliminary assessments on a preterm newborn infant and an adult during an fMRI experiment. The results demonstrate that the combination of the SGD and fMRI can safely and precisely identify the brain activity associated with grasping behavior, which may enable early diagnosis of motor impairment and help guide tailored rehabilitation programs.

A Multi-Parametric Wearable System to Monitor Neck Movements and Respiratory Frequency of Computer Workers.

Musculoskeletal disorders are the most common form of occupational ill-health. Neck pain is one of the most prevalent musculoskeletal disorders experienced by computer workers. Wrong postural habits and non-compliance of the workstation to ergonomics guidelines are the leading causes of neck pain. These factors may also alter respiratory functions. Health and safety interventions can reduce neck pain and, more generally, the symptoms of musculoskeletal disorders and reduce the consequent economic burden. In this work, a multi-parametric wearable system based on two fiber Bragg grating sensors is proposed for monitoring neck movements and breathing activity of computer workers. The sensing elements were positioned on the neck, in the frontal and sagittal planes, to monitor: (i) flexion-extension and axial rotation repetitions, and (ii) respiratory frequency. In this pilot study, five volunteers were enrolled and performed five repetitions of both flexion-extension and axial rotation, and ten breaths of both quite breathing and tachypnea. Results showed the good performances of the proposed system in monitoring the aforementioned parameters when compared to optical reference systems. The wearable system is able to well-match the trend in time of the neck movements (both flexion-extension and axial rotation) and to estimate mean and breath-by-breath respiratory frequency values with percentage errors ≤6.09% and ≤1.90%, during quiet breathing and tachypnea, respectively.

Non-Contact Monitoring of Breathing Pattern and Respiratory Rate via RGB Signal Measurement.

Among all the vital signs, respiratory rate remains the least measured in several scenarios, mainly due to the intrusiveness of the sensors usually adopted. For this reason, all contactless monitoring systems are gaining increasing attention in this field. In this paper, we present a measuring system for contactless measurement of the respiratory pattern and the extraction of breath-by-breath respiratory rate. The system consists of a laptop's built-in RGB camera and an algorithm for post-processing of acquired video data. From the recording of the chest movements of a subject, the analysis of the pixel intensity changes yields a waveform indicating respiratory pattern. The proposed system has been tested on 12 volunteers, both males and females seated in front of the webcam, wearing both slim-fit and loose-fit t-shirts. The pressure-drop signal recorded at the level of nostrils with a head-mounted wearable device was used as reference respiratory pattern. The two methods have been compared in terms of mean of absolute error, standard error, and percentage error. Additionally, a Bland-Altman plot was used to investigate the bias between methods. Results show the ability of the system to record accurate values of respiratory rate, with both slim-fit and loose-fit clothing. The measuring system shows better performance on females. Bland-Altman analysis showed a bias of -0.01 breaths · min - 1 , with respiratory rate values between 10 and 43 breaths · min - 1 . Promising performance has been found in the preliminary tests simulating tachypnea.

Cardio-Respiratory Monitoring in Archery Using a Smart Textile Based on Flexible Fiber Bragg Grating Sensors.

In precision sports, the control of breathing and heart rate is crucial to help the body to remain stable in the shooting position. To improve stability, archers try to adopt similar breathing patterns and to have a low heartbeat during each shot. We proposed an easy-to-use and unobtrusive smart textile (ST) which is able to detect chest wall excursions due to breathing and heart beating. The sensing part is based on two FBGs housed into a soft polymer matrix to optimize the adherence to the chest wall and the system robustness. The ST was assessed on volunteers to figure out its performance in the estimation of respiratory frequency (fR) and heart rate (HR). Then, the system was tested on two archers during four shooting sessions. This is the first study to monitor cardio-respiratory activity on archers during shooting. The good performance of the ST is supported by the low mean absolute percentage error for fR and HR estimation (≤1.97% and ≤5.74%, respectively), calculated with respect to reference signals (flow sensor for fR, photopletismography sensor for HR). Moreover, results showed the capability of the ST to estimate fR and HR during different phases of shooting action. The promising results motivate future investigations to speculate about the influence of fR and HR on archers' performance.

Performance Evaluation of Bluetooth Low Energy: A Systematic Review.

Small, compact and embedded sensors are a pervasive technology in everyday life for a wide number of applications (e.g., wearable devices, domotics, e-health systems, etc.). In this context, wireless transmission plays a key role, and among available solutions, Bluetooth Low Energy (BLE) is gaining more and more popularity. BLE merges together good performance, low-energy consumption and widespread diffusion. The aim of this work is to review the main methodologies adopted to investigate BLE performance. The first part of this review is an in-depth description of the protocol, highlighting the main characteristics and implementation details. The second part reviews the state of the art on BLE characteristics and performance. In particular, we analyze throughput, maximum number of connectable sensors, power consumption, latency and maximum reachable range, with the aim to identify what are the current limits of BLE technology. The main results can be resumed as follows: throughput may theoretically reach the limit of ~230 kbps, but actual applications analyzed in this review show throughputs limited to ~100 kbps; the maximum reachable range is strictly dependent on the radio power, and it goes up to a few tens of meters; the maximum number of nodes in the network depends on connection parameters, on the network architecture and specific device characteristics, but it is usually lower than 10; power consumption and latency are largely modeled and analyzed and are strictly dependent on a huge number of parameters. Most of these characteristics are based on analytical models, but there is a need for rigorous experimental evaluations to understand the actual limits.

Exploration and learning in capuchin monkeys (Sapajus spp.): the role of action-outcome contingencies.

Animals have a strong propensity to explore the environment. Spontaneous exploration has a great biological significance since it allows animals to discover and learn the relation between specific behaviours and their consequences. The role of the contingency between action and outcome for learning has been mainly investigated in instrumental learning settings and much less in free exploration contexts. We tested 16 capuchin monkeys (Sapajus spp.) with a mechatronic platform that allowed complex modules to be manipulated and to produce different outcomes. Experimental subjects could manipulate the modules and discover the contingencies between their own specific actions and the outcomes produced (i.e., the opening and lighting of a box). By contrast, Control subjects could operate on the modules, but the outcomes experienced were those performed by their paired Experimental subjects ("yoked-control" paradigm). In the exploration phase, in which no food reward was present, Experimental subjects spent more time on the board and manipulated the modules more than Yoked subjects. Experimental subjects outperformed Yoked subjects in the following test phase, where success required recalling the effective action so to open the box, now baited with food. These findings demonstrate that the opportunity to experience action-outcome contingencies in the absence of extrinsic rewards promotes capuchins' exploration and facilitates learning processes. Thus, this intrinsically motivated learning represents a powerful mechanism allowing the acquisition of skills and cognitive competence that the individual can later exploit for adaptive purposes.

Development of goal-directed action selection guided by intrinsic motivations: an experiment with children.

Action selection is extremely important, particularly when the accomplishment of competitive tasks may require access to limited motor resources. The spontaneous exploration of the world plays a fundamental role in the development of this capacity, providing subjects with an increasingly diverse set of opportunities to acquire, practice and refine the understanding of action-outcome connection. The computational modeling literature proposed a number of specific mechanisms for autonomous agents to discover and target interesting outcomes: intrinsic motivations hold a central importance among those mechanisms. Unfortunately, the study of the acquisition of action-outcome relation was mostly carried out with experiments involving extrinsic tasks, either based on rewards or on predefined task goals. This work presents a new experimental paradigm to study the effect of intrinsic motivation on action-outcome relation learning and action selection during free exploration of the world. Three- and four-year-old children were observed during the free exploration of a new toy: half of them were allowed to develop the knowledge concerning its functioning; the other half were not allowed to learn anything. The knowledge acquired during the free exploration of the toy was subsequently assessed and compared.

Shoulder motor performance assessment in the sagittal plane in children with hemiplegia during single joint pointing tasks.

BACKGROUND: Pointing is a motor task extensively used during daily life activities and it requires complex visuo-motor transformation to select the appropriate movement strategy. The study of invariant characteristics of human movements has led to several theories on how the brain solves the redundancy problem, but the application of these theories on children affected by hemiplegia is limited. This study aims at giving a quantitative assessment of the shoulder motor behaviour in children with hemiplegia during pointing tasks. METHODS: Eight children with hemiplegia were involved in the study and were asked to perform movements on the sagittal plane with both arms, at low and high speed. Subject movements were recorded using an optoelectronic system; a 4-DOF model of children arm has been developed to calculate kinematic and dynamic variables. A set of evaluation indexes has been extracted in order to quantitatively assess whether and how children modify their motor control strategies when perform movements with the more affected or less affected arm. RESULTS: In low speed movements, no differences can be seen in terms of movement duration and peak velocity between the More Affected arm (MA) and the Less Affected arm (LA), as well as in the main characteristics of movement kinematics and dynamics. As regards fast movements, remarkable differences in terms of strategies of motor control can be observed: while movements with LA did not show any significant difference in Dimensionless Jerk Index (JI) and Dimensionless Torque-change Cost index (TC) between the elevation and lowering phases, suggesting that motor control optimization is similar for movements performed with or against gravity, movements with MA showed a statistically significant increase of both JI and TC during lowering phase. CONCLUSIONS: Results suggest the presence of a different control strategy for fast movements in particular during lowering phase. Results suggest that motor control is not able to optimize Jerk and Torque-change cost functions in the same way when controls the two arms, suggesting that children with hemiplegia do not actively control MA lowering fast movements, in order to take advantage of the passive inertial body properties, rather than to attempt its optimal control.

A new calibration methodology for thorax and upper limbs motion capture in children using magneto and inertial sensors.

Recent advances in wearable sensor technologies for motion capture have produced devices, mainly based on magneto and inertial measurement units (M-IMU), that are now suitable for out-of-the-lab use with children. In fact, the reduced size, weight and the wireless connectivity meet the requirement of minimum obtrusivity and give scientists the possibility to analyze children's motion in daily life contexts. Typical use of magneto and inertial measurement units (M-IMU) motion capture systems is based on attaching a sensing unit to each body segment of interest. The correct use of this setup requires a specific calibration methodology that allows mapping measurements from the sensors' frames of reference into useful kinematic information in the human limbs' frames of reference. The present work addresses this specific issue, presenting a calibration protocol to capture the kinematics of the upper limbs and thorax in typically developing (TD) children. The proposed method allows the construction, on each body segment, of a meaningful system of coordinates that are representative of real physiological motions and that are referred to as functional frames (FFs). We will also present a novel cost function for the Levenberg-Marquardt algorithm, to retrieve the rotation matrices between each sensor frame (SF) and the corresponding FF. Reported results on a group of 40 children suggest that the method is repeatable and reliable, opening the way to the extensive use of this technology for out-of-the-lab motion capture in children.

Technological solutions and main indices for the assessment of newborns' nutritive sucking: a review.

Nutritive Sucking (NS) is a highly organized process that is essential for infants' feeding during the first six months of their life. It requires the complex coordination of sucking, swallowing and breathing. The infant's inability to perform a safe and successful oral feeding can be an early detector of immaturity of the Central Nervous System (CNS). Even though the importance of early sucking measures has been confirmed over the years, the need for standardized instrumental assessment tools still exists. Clinicians would benefit from specifically designed devices to assess oral feeding ability in their routine clinical monitoring and decision-making process. This work is a review of the main instrumental solutions developed to assess an infant's NS behavior, with a detailed survey of the main quantities and indices measured and/or estimated to characterize sucking behavior skills and their development. The adopted sensing measuring systems will be described, and their main advantages and weaknesses will be discussed, taking into account their application to clinical practice, or to at-home monitoring as post-discharge assessment tools. Finally, the study will highlight the most suitable sensing solutions and give some prompts for further research.