Estimating 3D kinematics and kinetics from virtual inertial sensor data through musculoskeletal movement simulations.

Portable measurement systems using inertial sensors enable motion capture outside the lab, facilitating longitudinal and large-scale studies in natural environments. However, estimating 3D kinematics and kinetics from inertial data for a comprehensive biomechanical movement analysis is still challenging. Machine learning models or stepwise approaches performing Kalman filtering, inverse kinematics, and inverse dynamics can lead to inconsistencies between kinematics and kinetics. We investigated the reconstruction of 3D kinematics and kinetics of arbitrary running motions from inertial sensor data using optimal control simulations of full-body musculoskeletal models. To evaluate the feasibility of the proposed method, we used marker tracking simulations created from optical motion capture data as a reference and for computing virtual inertial data such that the desired solution was known exactly. We generated the inertial tracking simulations by formulating optimal control problems that tracked virtual acceleration and angular velocity while minimizing effort without requiring a task constraint or an initial state. To evaluate the proposed approach, we reconstructed three trials each of straight running, curved running, and a v-cut of 10 participants. We compared the estimated inertial signals and biomechanical variables of the marker and inertial tracking simulations. The inertial data was tracked closely, resulting in low mean root mean squared deviations for pelvis translation (≤20.2 mm), angles (≤1.8 deg), ground reaction forces (≤1.1 BW%), joint moments (≤0.1 BWBH%), and muscle forces (≤5.4 BW%) and high mean coefficients of multiple correlation for all biomechanical variables (≥0.99). Accordingly, our results showed that optimal control simulations tracking 3D inertial data could reconstruct the kinematics and kinetics of individual trials of all running motions. The simulations led to mutually and dynamically consistent kinematics and kinetics, which allows researching causal chains, for example, to analyze anterior cruciate ligament injury prevention. Our work proved the feasibility of the approach using virtual inertial data. When using the approach in the future with measured data, the sensor location and alignment on the segment must be estimated, and soft-tissue artifacts are potential error sources. Nevertheless, we demonstrated that optimal control simulation tracking inertial data is highly promising for estimating 3D kinematics and kinetics for a comprehensive biomechanical analysis.

EarGait: Estimation of Temporal Gait Parameters from Hearing Aid Integrated Inertial Sensors.

Wearable sensors are able to monitor physical health in a home environment and detect changes in gait patterns over time. To ensure long-term user engagement, wearable sensors need to be seamlessly integrated into the user's daily life, such as hearing aids or earbuds. Therefore, we present EarGait, an open-source Python toolbox for gait analysis using inertial sensors integrated into hearing aids. This work contributes a validation for gait event detection algorithms and the estimation of temporal parameters using ear-worn sensors. We perform a comparative analysis of two algorithms based on acceleration data and propose a modified version of one of the algorithms. We conducted a study with healthy young and elderly participants to record walking data using the hearing aid's integrated sensors and an optical motion capture system as a reference. All algorithms were able to detect gait events (initial and terminal contacts), and the improved algorithm performed best, detecting 99.8% of initial contacts and obtaining a mean stride time error of 12 ± 32 ms. The existing algorithms faced challenges in determining the laterality of gait events. To address this limitation, we propose modifications that enhance the determination of the step laterality (ipsi- or contralateral), resulting in a 50% reduction in stride time error. Moreover, the improved version is shown to be robust to different study populations and sampling frequencies but is sensitive to walking speed. This work establishes a solid foundation for a comprehensive gait analysis system integrated into hearing aids that will facilitate continuous and long-term home monitoring.

Perspective on "in the wild" movement analysis using machine learning.

Recent advances in wearable sensing and machine learning have created ample opportunities for "in the wild" movement analysis in sports, since the combination of both enables real-time feedback to be provided to athletes and coaches, as well as long-term monitoring of movements. The potential for real-time feedback is useful for performance enhancement or technique analysis, and can be achieved by training efficient models and implementing them on dedicated hardware. Long-term monitoring of movement can be used for injury prevention, among others. Such applications are often enabled by training a machine learned model from large datasets that have been collected using wearable sensors. Therefore, in this perspective paper, we provide an overview of approaches for studies that aim to analyze sports movement "in the wild" using wearable sensors and machine learning. First, we discuss how a measurement protocol can be set up by answering six questions. Then, we discuss the benefits and pitfalls and provide recommendations for effective training of machine learning models from movement data, focusing on data pre-processing, feature calculation, and model selection and tuning. Finally, we highlight two application domains where "in the wild" data recording was combined with machine learning for injury prevention and technique analysis, respectively.

Efficient trajectory optimization for curved running using a 3D musculoskeletal model with implicit dynamics.

Trajectory optimization with musculoskeletal models can be used to reconstruct measured movements and to predict changes in movements in response to environmental changes. It enables an exhaustive analysis of joint angles, joint moments, ground reaction forces, and muscle forces, among others. However, its application is still limited to simplified problems in two dimensional space or straight motions. The simulation of movements with directional changes, e.g. curved running, requires detailed three dimensional models which lead to a high-dimensional solution space. We extended a full-body three dimensional musculoskeletal model to be specialized for running with directional changes. Model dynamics were implemented implicitly and trajectory optimization problems were solved with direct collocation to enable efficient computation. Standing, straight running, and curved running were simulated starting from a random initial guess to confirm the capabilities of our model and approach: efficacy, tracking and predictive power. Altogether the simulations required 1 h 17 min and corresponded well to the reference data. The prediction of curved running using straight running as tracking data revealed the necessity of avoiding interpenetration of body segments. In summary, the proposed formulation is able to efficiently predict a new motion task while preserving dynamic consistency. Hence, labor-intensive and thus costly experimental studies could be replaced by simulations for movement analysis and virtual product design.

CNN-Based Estimation of Sagittal Plane Walking and Running Biomechanics From Measured and Simulated Inertial Sensor Data.

Machine learning is a promising approach to evaluate human movement based on wearable sensor data. A representative dataset for training data-driven models is crucial to ensure that the model generalizes well to unseen data. However, the acquisition of sufficient data is time-consuming and often infeasible. We present a method to create realistic inertial sensor data with corresponding biomechanical variables by 2D walking and running simulations. We augmented a measured inertial sensor dataset with simulated data for the training of convolutional neural networks to estimate sagittal plane joint angles, joint moments, and ground reaction forces (GRFs) of walking and running. When adding simulated data, the root mean square error (RMSE) of the test set of hip, knee, and ankle joint angles decreased up to 17%, 27% and 23%, the RMSE of knee and ankle joint moments up to 6% and the RMSE of anterior-posterior and vertical GRF up to 2 and 6%. Simulation-aided estimation of joint moments and GRFs was limited by inaccuracies of the biomechanical model. Improving the physics-based model and domain adaptation learning may further increase the benefit of simulated data. Future work can exploit biomechanical simulations to connect different data sources in order to create representative datasets of human movement. In conclusion, machine learning can benefit from available domain knowledge on biomechanical simulations to supplement cumbersome data collections.

Estimation of gait kinematics and kinetics from inertial sensor data using optimal control of musculoskeletal models.

Inertial sensing enables field studies of human movement and ambulant assessment of patients. However, the challenge is to obtain a comprehensive analysis from low-quality data and sparse measurements. In this paper, we present a method to estimate gait kinematics and kinetics directly from raw inertial sensor data performing a single dynamic optimization. We formulated an optimal control problem to track accelerometer and gyroscope data with a planar musculoskeletal model. In addition, we minimized muscular effort to ensure a unique solution and to prevent the model from tracking noisy measurements too closely. For evaluation, we recorded data of ten subjects walking and running at six different speeds using seven inertial measurement units (IMUs). Results were compared to a conventional analysis using optical motion capture and a force plate. High correlations were achieved for gait kinematics (ρ⩾0.93) and kinetics (ρ⩾0.90). In contrast to existing IMU processing methods, a dynamically consistent simulation was obtained and we were able to estimate running kinetics. Besides kinematics and kinetics, further metrics such as muscle activations and metabolic cost can be directly obtained from simulated model movements. In summary, the method is insensitive to sensor noise and drift and provides a detailed analysis solely based on inertial sensor data.

Optimal control simulation predicts effects of midsole materials on energy cost of running.

Testing sports equipment with athletes is costly, time-consuming, hazardous and sometimes impracticable. We propose a method for virtual testing of running shoes and predict how midsoles made of BOOSTTM affect energy cost of running. We contribute a visco-elastic contact model and identified model parameters based on load-displacement measurements. We propose a virtual study using optimal control simulation of musculoskeletal models. The predicted reduction in energy cost of ∼1% for BOOSTTM in comparison to conventional materials is consistent with experimental studies. This indicates that the proposed method is capable of replacing experimental studies in the future.

A metabolic energy expenditure model with a continuous first derivative and its application to predictive simulations of gait.

Whether humans minimize metabolic energy in gait is unknown. Gradient-based optimization could be used to predict gait without using walking data but requires a twice differentiable metabolic energy model. Therefore, the metabolic energy model of Umberger et al. ( 2003 ) was adapted to be twice differentiable. Predictive simulations of a reaching task and gait were solved using this continuous model and by minimizing effort. The reaching task simulation showed that energy minimization predicts unrealistic movements when compared to effort minimization. The predictive gait simulations showed that objectives other than metabolic energy are also important in gait.

Blood glucose level prediction based on support vector regression using mobile platforms.

The correct treatment of diabetes is vital to a patient's health: Staying within defined blood glucose levels prevents dangerous short- and long-term effects on the body. Mobile devices informing patients about their future blood glucose levels could enable them to take counter-measures to prevent hypo or hyper periods. Previous work addressed this challenge by predicting the blood glucose levels using regression models. However, these approaches required a physiological model, representing the human body's response to insulin and glucose intake, or are not directly applicable to mobile platforms (smart phones, tablets). In this paper, we propose an algorithm for mobile platforms to predict blood glucose levels without the need for a physiological model. Using an online software simulator program, we trained a Support Vector Regression (SVR) model and exported the parameter settings to our mobile platform. The prediction accuracy of our mobile platform was evaluated with pre-recorded data of a type 1 diabetes patient. The blood glucose level was predicted with an error of 19 % compared to the true value. Considering the permitted error of commercially used devices of 15 %, our algorithm is the basis for further development of mobile prediction algorithms.