Extension of the Rigid-Constraint Method for the Heuristic Suboptimal Parameter Tuning to Ten Sensor Fusion Algorithms Using Inertial and Magnetic Sensing.

The orientation of a magneto-inertial measurement unit can be estimated using a sensor fusion algorithm (SFA). However, orientation accuracy is greatly affected by the choice of the SFA parameter values which represents one of the most critical steps. A commonly adopted approach is to fine-tune parameter values to minimize the difference between estimated and true orientation. However, this can only be implemented within the laboratory setting by requiring the use of a concurrent gold-standard technology. To overcome this limitation, a Rigid-Constraint Method (RCM) was proposed to estimate suboptimal parameter values without relying on any orientation reference. The RCM method effectiveness was successfully tested on a single-parameter SFA, with an average error increase with respect to the optimal of 1.5 deg. In this work, the applicability of the RCM was evaluated on 10 popular SFAs with multiple parameters under different experimental scenarios. The average residual between the optimal and suboptimal errors amounted to 0.6 deg with a maximum of 3.7 deg. These encouraging results suggest the possibility to properly tune a generic SFA on different scenarios without using any reference. The synchronized dataset also including the optical data and the SFA codes are available online.

Analysis of the Accuracy of Ten Algorithms for Orientation Estimation Using Inertial and Magnetic Sensing under Optimal Conditions: One Size Does Not Fit All.

The orientation of a magneto and inertial measurement unit (MIMU) is estimated by means of sensor fusion algorithms (SFAs) thus enabling human motion tracking. However, despite several SFAs implementations proposed over the last decades, there is still a lack of consensus about the best performing SFAs and their accuracy. As suggested by recent literature, the filter parameters play a central role in determining the orientation errors. The aim of this work is to analyze the accuracy of ten SFAs while running under the best possible conditions (i.e., their parameter values are set using the orientation reference) in nine experimental scenarios including three rotation rates and three commercial products. The main finding is that parameter values must be specific for each SFA according to the experimental scenario to avoid errors comparable to those obtained when the default parameter values are used. Overall, when optimally tuned, no statistically significant differences are observed among the different SFAs in all tested experimental scenarios and the absolute errors are included between 3.8 deg and 7.1 deg. Increasing the rotation rate generally leads to a significant performance worsening. Errors are also influenced by the MIMU commercial model. SFA MATLAB implementations have been made available online.

Tongue Rehabilitation Device for Dysphagic Patients.

Dysphagia refers to difficulty in swallowing often associated with syndromic disorders. In dysphagic patients' rehabilitation, tongue motility is usually treated and monitored via simple exercises, in which the tongue is pushed against a depressor held by the speech therapist in different directions. In this study, we developed and tested a simple pressure/force sensor device, named "Tonic Tongue (ToTo)", intended to support training and monitoring tasks for the rehabilitation of tongue musculature. It consists of a metallic frame holding a ball bearing support equipped with a sterile disposable depressor, whose angular displacements are counterbalanced by extensional springs. The conversion from angular displacement to force is managed using a simple mechanical model of ToTo operation. Since the force exerted by the tongue in various directions can be estimated, quantitative assessment of the outcome of a given training program is possible. A first prototype of ToTo was tested on 26 healthy adults, who were trained for one month. After the treatment, we observed a statistically significant improvement with a force up to 2.2 N (median value) in all tested directions of pushing, except in the downward direction, in which the improvement was slightly higher than 5 N (median value). ToTo promises to be an innovative and reliable device that can be used for the rehabilitation of dysphagic patients. Moreover, since it is a self-standing device, it could be used as a point-of-care solution for in-home rehabilitation management of dysphasia.

Ambulatory Assessment of the Dynamic Margin of Stability Using an Inertial Sensor Network.

Loss of stability is a precursor to falling and therefore represents a leading cause of injury, especially in fragile people. Thus, dynamic stability during activities of daily living (ADLs) needs to be considered to assess balance control and fall risk. The dynamic margin of stability (MOS) is often used as an indicator of how the body center of mass is located and moves relative to the base of support. In this work, we propose a magneto-inertial measurement unit (MIMU)-based method to assess the MOS of a gait. Six young healthy subjects were asked to walk on a treadmill at different velocities while wearing MIMUs on their lower limbs and pelvis. We then assessed the MOS by computing the lower body displacement with respect to the leading inverse kinematics approach. The results were compared with those obtained using a camera-based system in terms of root mean square deviation (RMSD) and correlation coefficient (ρ). We obtained a RMSD of ≤1.80 cm and ρ ≥ 0.85 for each walking velocity. The findings revealed that our method is comparable to camera-based systems in terms of accuracy, suggesting that it may represent a strategy to assess stability during ADLs in unstructured environments.

Ambulatory Assessment of Instantaneous Velocity during Walking Using Inertial Sensor Measurements.

A novel approach for estimating the instantaneous velocity of the pelvis during walking was developed based on Inertial Measurement Units (IMUs). The instantaneous velocity was modeled by the sum of a cyclical component, decomposed in the Medio-Lateral (ML), VerTical (VT) and Antero-Posterior (AP) directions, and the Average Progression Velocity (APV) over each gait cycle. The proposed method required the availability of two IMUs, attached to the pelvis and one shank. Gait cycles were identified from the shank angular velocity; for each cycle, the Fourier series coefficients of the pelvis and shank acceleration signals were computed. The cyclical component was estimated by Fourier-based time-integration of the pelvis acceleration. A Bayesian Linear Regression (BLR) with Automatic Relevance Determination (ARD) predicted the APV from the stride time, the stance duration, and the Fourier series coefficients of the shank acceleration. Healthy subjects performed tasks of Treadmill Walking (TW) and Overground Walking (OW), and an optical motion capture system (OMCS) was used as reference for algorithm performance assessment. The widths of the limits of agreements (±1.96 standard deviation) were computed between the proposed method and the reference OMCS, yielding, for the cyclical component in the different directions: ML: ±0.07 m/s (±0.10 m/s); VT: ±0.03 m/s (±0.05 m/s); AP: ±0.06 m/s (±0.10 m/s), in TW (OW) conditions. The ARD-BLR achieved an APV root mean square error of 0.06 m/s (0.07 m/s) in the same conditions.

Assessing the Performance of Sensor Fusion Methods: Application to Magnetic-Inertial-Based Human Body Tracking.

Information from complementary and redundant sensors are often combined within sensor fusion algorithms to obtain a single accurate observation of the system at hand. However, measurements from each sensor are characterized by uncertainties. When multiple data are fused, it is often unclear how all these uncertainties interact and influence the overall performance of the sensor fusion algorithm. To address this issue, a benchmarking procedure is presented, where simulated and real data are combined in different scenarios in order to quantify how each sensor's uncertainties influence the accuracy of the final result. The proposed procedure was applied to the estimation of the pelvis orientation using a waist-worn magnetic-inertial measurement unit. Ground-truth data were obtained from a stereophotogrammetric system and used to obtain simulated data. Two Kalman-based sensor fusion algorithms were submitted to the proposed benchmarking procedure. For the considered application, gyroscope uncertainties proved to be the main error source in orientation estimation accuracy for both tested algorithms. Moreover, although different performances were obtained using simulated data, these differences became negligible when real data were considered. The outcome of this evaluation may be useful both to improve the design of new sensor fusion methods and to drive the algorithm tuning process.

Fourier-based integration of quasi-periodic gait accelerations for drift-free displacement estimation using inertial sensors.

BACKGROUND: In biomechanical studies Optical Motion Capture Systems (OMCS) are considered the gold standard for determining the orientation and the position (pose) of an object in a global reference frame. However, the use of OMCS can be difficult, which has prompted research on alternative sensing technologies, such as body-worn inertial sensors. METHODS: We developed a drift-free method to estimate the three-dimensional (3D) displacement of a body part during cyclical motions using body-worn inertial sensors. We performed the Fourier analysis of the stride-by-stride estimates of the linear acceleration, which were obtained by transposing the specific forces measured by the tri-axial accelerometer into the global frame using a quaternion-based orientation estimation algorithm and detecting when each stride began using a gait-segmentation algorithm. The time integration was performed analytically using the Fourier series coefficients; the inverse Fourier series was then taken for reconstructing the displacement over each single stride. The displacement traces were concatenated and spline-interpolated to obtain the entire trace. RESULTS: The method was applied to estimate the motion of the lower trunk of healthy subjects that walked on a treadmill and it was validated using OMCS reference 3D displacement data; different approaches were tested for transposing the measured specific force into the global frame, segmenting the gait and performing time integration (numerically and analytically). The width of the limits of agreements were computed between each tested method and the OMCS reference method for each anatomical direction: Medio-Lateral (ML), VerTical (VT) and Antero-Posterior (AP); using the proposed method, it was observed that the vertical component of displacement (VT) was within ±4 mm (±1.96 standard deviation) of OMCS data and each component of horizontal displacement (ML and AP) was within ±9 mm of OMCS data. CONCLUSIONS: Fourier harmonic analysis was applied to model stride-by-stride linear accelerations during walking and to perform their analytical integration. Our results showed that analytical integration based on Fourier series coefficients was a useful approach to accurately estimate 3D displacement from noisy acceleration data.

A Simulation Environment for Benchmarking Sensor Fusion-Based Pose Estimators.

In-depth analysis and performance evaluation of sensor fusion-based estimators may be critical when performed using real-world sensor data. For this reason, simulation is widely recognized as one of the most powerful tools for algorithm benchmarking. In this paper, we present a simulation framework suitable for assessing the performance of sensor fusion-based pose estimators. The systems used for implementing the framework were magnetic/inertial measurement units (MIMUs) and a camera, although the addition of further sensing modalities is straightforward. Typical nuisance factors were also included for each sensor. The proposed simulation environment was validated using real-life sensor data employed for motion tracking. The higher mismatch between real and simulated sensors was about 5% of the measured quantity (for the camera simulation), whereas a lower correlation was found for an axis of the gyroscope (0.90). In addition, a real benchmarking example of an extended Kalman filter for pose estimation from MIMU and camera data is presented.

How Angular Velocity Features and Different Gyroscope Noise Types Interact and Determine Orientation Estimation Accuracy.

In human movement analysis, 3D body segment orientation can be obtained through the numerical integration of gyroscope signals. These signals, however, are affected by errors that, for the case of micro-electro-mechanical systems, are mainly due to: constant bias, scale factor, white noise, and bias instability. The aim of this study is to assess how the orientation estimation accuracy is affected by each of these disturbances, and whether it is influenced by the angular velocity magnitude and 3D distribution across the gyroscope axes. Reference angular velocity signals, either constant or representative of human walking, were corrupted with each of the four noise types within a simulation framework. The magnitude of the angular velocity affected the error in the orientation estimation due to each noise type, except for the white noise. Additionally, the error caused by the constant bias was also influenced by the angular velocity 3D distribution. As the orientation error depends not only on the noise itself but also on the signal it is applied to, different sensor placements could enhance or mitigate the error due to each disturbance, and special attention must be paid in providing and interpreting measures of accuracy for orientation estimation algorithms.

A sensor fusion method for tracking vertical velocity and height based on inertial and barometric altimeter measurements.

A sensor fusion method was developed for vertical channel stabilization by fusing inertial measurements from an Inertial Measurement Unit (IMU) and pressure altitude measurements from a barometric altimeter integrated in the same device (baro-IMU). An Extended Kalman Filter (EKF) estimated the quaternion from the sensor frame to the navigation frame; the sensed specific force was rotated into the navigation frame and compensated for gravity, yielding the vertical linear acceleration; finally, a complementary filter driven by the vertical linear acceleration and the measured pressure altitude produced estimates of height and vertical velocity. A method was also developed to condition the measured pressure altitude using a whitening filter, which helped to remove the short-term correlation due to environment-dependent pressure changes from raw pressure altitude. The sensor fusion method was implemented to work on-line using data from a wireless baro-IMU and tested for the capability of tracking low-frequency small-amplitude vertical human-like motions that can be critical for stand-alone inertial sensor measurements. Validation tests were performed in different experimental conditions, namely no motion, free-fall motion, forced circular motion and squatting. Accurate on-line tracking of height and vertical velocity was achieved, giving confidence to the use of the sensor fusion method for tracking typical vertical human motions: velocity Root Mean Square Error (RMSE) was in the range 0.04-0.24 m/s; height RMSE was in the range 5-68 cm, with statistically significant performance gains when the whitening filter was used by the sensor fusion method to track relatively high-frequency vertical motions.

Estimating orientation using magnetic and inertial sensors and different sensor fusion approaches: accuracy assessment in manual and locomotion tasks.

Magnetic and inertial measurement units are an emerging technology to obtain 3D orientation of body segments in human movement analysis. In this respect, sensor fusion is used to limit the drift errors resulting from the gyroscope data integration by exploiting accelerometer and magnetic aiding sensors. The present study aims at investigating the effectiveness of sensor fusion methods under different experimental conditions. Manual and locomotion tasks, differing in time duration, measurement volume, presence/absence of static phases, and out-of-plane movements, were performed by six subjects, and recorded by one unit located on the forearm or the lower trunk, respectively. Two sensor fusion methods, representative of the stochastic (Extended Kalman Filter) and complementary (Non-linear observer) filtering, were selected, and their accuracy was assessed in terms of attitude (pitch and roll angles) and heading (yaw angle) errors using stereophotogrammetric data as a reference. The sensor fusion approaches provided significantly more accurate results than gyroscope data integration. Accuracy improved mostly for heading and when the movement exhibited stationary phases, evenly distributed 3D rotations, it occurred in a small volume, and its duration was greater than approximately 20 s. These results were independent from the specific sensor fusion method used. Practice guidelines for improving the outcome accuracy are provided.

Extended Kalman filter-based methods for pose estimation using visual, inertial and magnetic sensors: comparative analysis and performance evaluation.

In this paper measurements from a monocular vision system are fused with inertial/magnetic measurements from an Inertial Measurement Unit (IMU) rigidly connected to the camera. Two Extended Kalman filters (EKFs) were developed to estimate the pose of the IMU/camera sensor moving relative to a rigid scene (ego-motion), based on a set of fiducials. The two filters were identical as for the state equation and the measurement equations of the inertial/magnetic sensors. The DLT-based EKF exploited visual estimates of the ego-motion using a variant of the Direct Linear Transformation (DLT) method; the error-driven EKF exploited pseudo-measurements based on the projection errors from measured two-dimensional point features to the corresponding three-dimensional fiducials. The two filters were off-line analyzed in different experimental conditions and compared to a purely IMU-based EKF used for estimating the orientation of the IMU/camera sensor. The DLT-based EKF was more accurate than the error-driven EKF, less robust against loss of visual features, and equivalent in terms of computational complexity. Orientation root mean square errors (RMSEs) of 1° (1.5°), and position RMSEs of 3.5 mm (10 mm) were achieved in our experiments by the DLT-based EKF (error-driven EKF); by contrast, orientation RMSEs of 1.6° were achieved by the purely IMU-based EKF.

A stochastic approach to noise modeling for barometric altimeters.

The question whether barometric altimeters can be applied to accurately track human motions is still debated, since their measurement performance are rather poor due to either coarse resolution or drifting behavior problems. As a step toward accurate short-time tracking of changes in height (up to few minutes), we develop a stochastic model that attempts to capture some statistical properties of the barometric altimeter noise. The barometric altimeter noise is decomposed in three components with different physical origin and properties: a deterministic time-varying mean, mainly correlated with global environment changes, and a first-order Gauss-Markov (GM) random process, mainly accounting for short-term, local environment changes, the effects of which are prominent, respectively, for long-time and short-time motion tracking; an uncorrelated random process, mainly due to wideband electronic noise, including quantization noise. Autoregressive-moving average (ARMA) system identification techniques are used to capture the correlation structure of the piecewise stationary GM component, and to estimate its standard deviation, together with the standard deviation of the uncorrelated component. M-point moving average filters used alone or in combination with whitening filters learnt from ARMA model parameters are further tested in few dynamic motion experiments and discussed for their capability of short-time tracking small-amplitude, low-frequency motions.

Evaluation of a spring-loaded upper-limb exoskeleton in cleaning activities.

In the past few years, companies have started considering the adoption of upper-limb occupational exoskeletons as a solution to reduce the health and cost issues associated with work-related shoulder overuse injuries. Most of the previous research studies have evaluated the efficacy of these devices in laboratories by measuring the reduction in muscle exertion resulting from device use in stereotyped tasks and controlled conditions. However, to date, uncertainties exist about generalizing laboratory results to more realistic conditions of use. The current study aims to investigate the in-field efficacy (through electromyography and perceived exertion), usability, and acceptance of a commercial spring-loaded upper-limb exoskeleton in cleaning job activities. The operators were required to maintain prolonged overhead postures while holding and moving a pole equipped with tools for window and ceiling cleaning. Compared to the normal working condition, the exoskeleton significantly reduced the total shoulder muscle activity (∼17%), the activity of the anterior deltoid (∼26%), medial deltoid (∼28%), and upper trapezius (∼24%). With the exoskeleton, the operators perceived reduced global effort (∼17%) as well as a reduced local effort in the shoulder (∼18%), arm (∼22%), upper back (∼14%), and lower back (∼16%). The beneficial effect of the exoskeleton and its suitability in cleaning settings are corroborated by the acceptance and usability scores assigned by operators, which averaged ∼5.5 out of 7 points. To the authors' knowledge, this study is the first to present an experience of exoskeleton use in cleaning contexts. The outcomes of this research invite further studies to test occupational exoskeletons in various realistic applications to foster scientific-grounded ergonomic evaluations and encourage the informed adoption of the technology.

Variable-State-Dimension Kalman-based Filter for orientation determination using inertial and magnetic sensors.

In this paper a quaternion-based Variable-State-Dimension Extended Kalman Filter (VSD-EKF) is developed for estimating the three-dimensional orientation of a rigid body using the measurements from an Inertial Measurement Unit (IMU) integrated with a triaxial magnetic sensor. Gyro bias and magnetic disturbances are modeled and compensated by including them in the filter state vector. The VSD-EKF switches between a quiescent EKF, where the magnetic disturbance is modeled as a first-order Gauss-Markov stochastic process (GM-1), and a higher-order EKF where extra state components are introduced to model the time-rate of change of the magnetic field as a GM-1 stochastic process, namely the magnetic disturbance is modeled as a second-order Gauss-Markov stochastic process (GM-2). Experimental validation tests show the effectiveness of the VSD-EKF, as compared to either the quiescent EKF or the higher-order EKF when they run separately.

Exoskeletons for workers: A case series study in an enclosures production line.

This case-series study aims to investigate the effects of a passive shoulder support exoskeleton on experienced workers during their regular work shifts in an enclosures production site. Experimental activities included three sessions, two of which were conducted in-field (namely, at two workstations of the painting line, where panels were mounted and dismounted from the line; each session involved three participants), and one session was carried out in a realistic simulated environment (namely, the workstations were recreated in a laboratory; this session involved four participants). The effect of the exoskeleton was evaluated through electromyographic activity and perceived effort. After in-field sessions, device usability and user acceptance were also assessed. Data were reported individually for each participant. Results showed that the use of the exoskeleton reduced the total shoulder muscular activity compared to normal working conditions, in all subjects and experimental sessions. Similarly, the use of the exoskeleton resulted in reductions of the perceived effort in the shoulder, arm, and lower back. Overall, participants indicated high usability and acceptance of the device. This case series invites larger validation studies, also in diverse operational contexts.

Kalman-filter-based orientation determination using inertial/magnetic sensors: observability analysis and performance evaluation.

In this paper we present a quaternion-based Extended Kalman Filter (EKF) for estimating the three-dimensional orientation of a rigid body. The EKF exploits the measurements from an Inertial Measurement Unit (IMU) that is integrated with a tri-axial magnetic sensor. Magnetic disturbances and gyro bias errors are modeled and compensated by including them in the filter state vector. We employ the observability rank criterion based on Lie derivatives to verify the conditions under which the nonlinear system that describes the process of motion tracking by the IMU is observable, namely it may provide sufficient information for performing the estimation task with bounded estimation errors. The observability conditions are that the magnetic field, perturbed by first-order Gauss-Markov magnetic variations, and the gravity vector are not collinear and that the IMU is subject to some angular motions. Computer simulations and experimental testing are presented to evaluate the algorithm performance, including when the observability conditions are critical.

Estimating three-dimensional orientation of human body parts by inertial/magnetic sensing.

User-worn sensing units composed of inertial and magnetic sensors are becoming increasingly popular in various domains, including biomedical engineering, robotics, virtual reality, where they can also be applied for real-time tracking of the orientation of human body parts in the three-dimensional (3D) space. Although they are a promising choice as wearable sensors under many respects, the inertial and magnetic sensors currently in use offer measuring performance that are critical in order to achieve and maintain accurate 3D-orientation estimates, anytime and anywhere. This paper reviews the main sensor fusion and filtering techniques proposed for accurate inertial/magnetic orientation tracking of human body parts; it also gives useful recipes for their actual implementation.

Machine learning methods for classifying human physical activity from on-body accelerometers.

The use of on-body wearable sensors is widespread in several academic and industrial domains. Of great interest are their applications in ambulatory monitoring and pervasive computing systems; here, some quantitative analysis of human motion and its automatic classification are the main computational tasks to be pursued. In this paper, we discuss how human physical activity can be classified using on-body accelerometers, with a major emphasis devoted to the computational algorithms employed for this purpose. In particular, we motivate our current interest for classifiers based on Hidden Markov Models (HMMs). An example is illustrated and discussed by analysing a dataset of accelerometer time series.

Locomotory behaviour of the intertidal marble crab (Pachygrapsus marmoratus) supports the underwater spring-loaded inverted pendulum as a fundamental model for punting in animals.

In aquatic pedestrian locomotion the dynamics of terrestrial and aquatic environments are coupled. Here we study terrestrial running and aquatic punting locomotion of the marine-living crab Pachygrapsus marmoratus. We detected both active and passive phases of running and punting through the observation of crab locomotory behaviour in standardized settings and by three-dimensional kinematic analysis of its dynamic gaits using high-speed video cameras. Variations in different stride parameters were studied and compared. The comparison was done based on the dimensionless parameter the Froude number (Fr) to account for the effect of buoyancy and size variability among the crabs. The underwater spring-loaded inverted pendulum (USLIP) model better fitted the dynamics of aquatic punting. USLIP takes account of the damping effect of the aquatic environment, a variable not considered by the spring-loaded inverted pendulum (SLIP) model in reduced gravity. Our results highlight the underlying principles of aquatic terrestrial locomotion by comparing it with terrestrial locomotion. Comparing punting with running, we show and increased stride period, decreased duty cycle and orientation of the carapace more inclined with the horizontal plane, indicating the significance of fluid forces on the dynamics due to the aquatic environment. Moreover, we discovered periodicity in punting locomotion of crabs and two different gaits, namely, long-flight punting and short-flight punting, distinguished by both footfall patterns and kinematic parameters. The generic fundamental model which belongs to all animals performing both terrestrial and aquatic legged locomotion has implications for control strategies, evolution and translation to robotic artefacts.