Assessing real-world gait with digital technology? Validation, insights and recommendations from the Mobilise-D consortium.

BACKGROUND: Although digital mobility outcomes (DMOs) can be readily calculated from real-world data collected with wearable devices and ad-hoc algorithms, technical validation is still required. The aim of this paper is to comparatively assess and validate DMOs estimated using real-world gait data from six different cohorts, focusing on gait sequence detection, foot initial contact detection (ICD), cadence (CAD) and stride length (SL) estimates. METHODS: Twenty healthy older adults, 20 people with Parkinson's disease, 20 with multiple sclerosis, 19 with proximal femoral fracture, 17 with chronic obstructive pulmonary disease and 12 with congestive heart failure were monitored for 2.5 h in the real-world, using a single wearable device worn on the lower back. A reference system combining inertial modules with distance sensors and pressure insoles was used for comparison of DMOs from the single wearable device. We assessed and validated three algorithms for gait sequence detection, four for ICD, three for CAD and four for SL by concurrently comparing their performances (e.g., accuracy, specificity, sensitivity, absolute and relative errors). Additionally, the effects of walking bout (WB) speed and duration on algorithm performance were investigated. RESULTS: We identified two cohort-specific top performing algorithms for gait sequence detection and CAD, and a single best for ICD and SL. Best gait sequence detection algorithms showed good performances (sensitivity > 0.73, positive predictive values > 0.75, specificity > 0.95, accuracy > 0.94). ICD and CAD algorithms presented excellent results, with sensitivity > 0.79, positive predictive values > 0.89 and relative errors < 11% for ICD and < 8.5% for CAD. The best identified SL algorithm showed lower performances than other DMOs (absolute error < 0.21 m). Lower performances across all DMOs were found for the cohort with most severe gait impairments (proximal femoral fracture). Algorithms' performances were lower for short walking bouts; slower gait speeds (< 0.5 m/s) resulted in reduced performance of the CAD and SL algorithms. CONCLUSIONS: Overall, the identified algorithms enabled a robust estimation of key DMOs. Our findings showed that the choice of algorithm for estimation of gait sequence detection and CAD should be cohort-specific (e.g., slow walkers and with gait impairments). Short walking bout length and slow walking speed worsened algorithms' performances. Trial registration ISRCTN - 12246987.

Base of Support, Step Length and Stride Width Estimation during Walking Using an Inertial and Infrared Wearable System.

The analysis of the stability of human gait may be effectively performed when estimates of the base of support are available. The base of support area is defined by the relative position of the feet when they are in contact with the ground and it is closely related to additional parameters such as step length and stride width. These parameters may be determined in the laboratory using either a stereophotogrammetric system or an instrumented mat. Unfortunately, their estimation in the real world is still an unaccomplished goal. This study aims at proposing a novel, compact wearable system, including a magneto-inertial measurement unit and two time-of-flight proximity sensors, suitable for the estimation of the base of support parameters. The wearable system was tested and validated on thirteen healthy adults walking at three self-selected speeds (slow, comfortable, and fast). Results were compared with the concurrent stereophotogrammetric data, used as the gold standard. The root mean square errors for the step length, stride width and base of support area varied from slow to high speed between 10-46 mm, 14-18 mm, and 39-52 cm2, respectively. The mean overlap of the base of support area as obtained with the wearable system and with the stereophotogrammetric system ranged between 70% and 89%. Thus, this study suggested that the proposed wearable solution is a valid tool for the estimation of the base of support parameters out of the laboratory.

Design and validation of a multi-task, multi-context protocol for real-world gait simulation.

BACKGROUND: Measuring mobility in daily life entails dealing with confounding factors arising from multiple sources, including pathological characteristics, patient specific walking strategies, environment/context, and purpose of the task. The primary aim of this study is to propose and validate a protocol for simulating real-world gait accounting for all these factors within a single set of observations, while ensuring minimisation of participant burden and safety. METHODS: The protocol included eight motor tasks at varying speed, incline/steps, surface, path shape, cognitive demand, and included postures that may abruptly alter the participants' strategy of walking. It was deployed in a convenience sample of 108 participants recruited from six cohorts that included older healthy adults (HA) and participants with potentially altered mobility due to Parkinson's disease (PD), multiple sclerosis (MS), proximal femoral fracture (PFF), chronic obstructive pulmonary disease (COPD) or congestive heart failure (CHF). A novelty introduced in the protocol was the tiered approach to increase difficulty both within the same task (e.g., by allowing use of aids or armrests) and across tasks. RESULTS: The protocol proved to be safe and feasible (all participants could complete it and no adverse events were recorded) and the addition of the more complex tasks allowed a much greater spread in walking speeds to be achieved compared to standard straight walking trials. Furthermore, it allowed a representation of a variety of daily life relevant mobility aspects and can therefore be used for the validation of monitoring devices used in real life. CONCLUSIONS: The protocol allowed for measuring gait in a variety of pathological conditions suggests that it can also be used to detect changes in gait due to, for example, the onset or progression of a disease, or due to therapy. TRIAL REGISTRATION: ISRCTN-12246987.

Static and Dynamic Accuracy of an Innovative Miniaturized Wearable Platform for Short Range Distance Measurements for Human Movement Applications.

Magneto-inertial measurement units (MIMU) are a suitable solution to assess human motor performance both indoors and outdoors. However, relevant quantities such as step width and base of support, which play an important role in gait stability, cannot be directly measured using MIMU alone. To overcome this limitation, we developed a wearable platform specifically designed for human movement analysis applications, which integrates a MIMU and an Infrared Time-of-Flight proximity sensor (IR-ToF), allowing for the estimate of inter-object distance. We proposed a thorough testing protocol for evaluating the IR-ToF sensor performances under experimental conditions resembling those encountered during gait. In particular, we tested the sensor performance for different (i) target colors; (ii) sensor-target distances (up to 200 mm) and (iii) sensor-target angles of incidence (AoI) (up to 60 ∘ ). Both static and dynamic conditions were analyzed. A pendulum, simulating the oscillation of a human leg, was used to generate highly repeatable oscillations with a maximum angular velocity of 6 rad/s. Results showed that the IR-ToF proximity sensor was not sensitive to variations of both distance and target color (except for black). Conversely, a relationship between error magnitude and AoI values was found. For AoI equal to 0 ∘ , the IR-ToF sensor performed equally well both in static and dynamic acquisitions with a distance mean absolute error <1.5 mm. Errors increased up to 3.6 mm (static) and 11.9 mm (dynamic) for AoI equal to ± 30 ∘ , and up to 7.8 mm (static) and 25.6 mm (dynamic) for AoI equal to ± 60 ∘ . In addition, the wearable platform was used during a preliminary experiment for the estimation of the inter-foot distance on a single healthy subject while walking. In conclusion, the combination of magneto-inertial unit and IR-ToF technology represents a valuable alternative solution in terms of accuracy, sampling frequency, dimension and power consumption, compared to existing technologies.

Mobilise-D insights to estimate real-world walking speed in multiple conditions with a wearable device.

This study aimed to validate a wearable device's walking speed estimation pipeline, considering complexity, speed, and walking bout duration. The goal was to provide recommendations on the use of wearable devices for real-world mobility analysis. Participants with Parkinson's Disease, Multiple Sclerosis, Proximal Femoral Fracture, Chronic Obstructive Pulmonary Disease, Congestive Heart Failure, and healthy older adults (n = 97) were monitored in the laboratory and the real-world (2.5 h), using a lower back wearable device. Two walking speed estimation pipelines were validated across 4408/1298 (2.5 h/laboratory) detected walking bouts, compared to 4620/1365 bouts detected by a multi-sensor reference system. In the laboratory, the mean absolute error (MAE) and mean relative error (MRE) for walking speed estimation ranged from 0.06 to 0.12 m/s and - 2.1 to 14.4%, with ICCs (Intraclass correlation coefficients) between good (0.79) and excellent (0.91). Real-world MAE ranged from 0.09 to 0.13, MARE from 1.3 to 22.7%, with ICCs indicating moderate (0.57) to good (0.88) agreement. Lower errors were observed for cohorts without major gait impairments, less complex tasks, and longer walking bouts. The analytical pipelines demonstrated moderate to good accuracy in estimating walking speed. Accuracy depended on confounding factors, emphasizing the need for robust technical validation before clinical application.Trial registration: ISRCTN - 12246987.

Real-World Gait Detection Using a Wrist-Worn Inertial Sensor: Validation Study.

BACKGROUND: Wrist-worn inertial sensors are used in digital health for evaluating mobility in real-world environments. Preceding the estimation of spatiotemporal gait parameters within long-term recordings, gait detection is an important step to identify regions of interest where gait occurs, which requires robust algorithms due to the complexity of arm movements. While algorithms exist for other sensor positions, a comparative validation of algorithms applied to the wrist position on real-world data sets across different disease populations is missing. Furthermore, gait detection performance differences between the wrist and lower back position have not yet been explored but could yield valuable information regarding sensor position choice in clinical studies. OBJECTIVE: The aim of this study was to validate gait sequence (GS) detection algorithms developed for the wrist position against reference data acquired in a real-world context. In addition, this study aimed to compare the performance of algorithms applied to the wrist position to those applied to lower back-worn inertial sensors. METHODS: Participants with Parkinson disease, multiple sclerosis, proximal femoral fracture (hip fracture recovery), chronic obstructive pulmonary disease, and congestive heart failure and healthy older adults (N=83) were monitored for 2.5 hours in the real-world using inertial sensors on the wrist, lower back, and feet including pressure insoles and infrared distance sensors as reference. In total, 10 algorithms for wrist-based gait detection were validated against a multisensor reference system and compared to gait detection performance using lower back-worn inertial sensors. RESULTS: The best-performing GS detection algorithm for the wrist showed a mean (per disease group) sensitivity ranging between 0.55 (SD 0.29) and 0.81 (SD 0.09) and a mean (per disease group) specificity ranging between 0.95 (SD 0.06) and 0.98 (SD 0.02). The mean relative absolute error of estimated walking time ranged between 8.9% (SD 7.1%) and 32.7% (SD 19.2%) per disease group for this algorithm as compared to the reference system. Gait detection performance from the best algorithm applied to the wrist inertial sensors was lower than for the best algorithms applied to the lower back, which yielded mean sensitivity between 0.71 (SD 0.12) and 0.91 (SD 0.04), mean specificity between 0.96 (SD 0.03) and 0.99 (SD 0.01), and a mean relative absolute error of estimated walking time between 6.3% (SD 5.4%) and 23.5% (SD 13%). Performance was lower in disease groups with major gait impairments (eg, patients recovering from hip fracture) and for patients using bilateral walking aids. CONCLUSIONS: Algorithms applied to the wrist position can detect GSs with high performance in real-world environments. Those periods of interest in real-world recordings can facilitate gait parameter extraction and allow the quantification of gait duration distribution in everyday life. Our findings allow taking informed decisions on alternative positions for gait recording in clinical studies and public health. TRIAL REGISTRATION: ISRCTN Registry 12246987; https://www.isrctn.com/ISRCTN12246987. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.1136/bmjopen-2021-050785.

Mobility recorded by wearable devices and gold standards: the Mobilise-D procedure for data standardization.

Wearable devices are used in movement analysis and physical activity research to extract clinically relevant information about an individual's mobility. Still, heterogeneity in protocols, sensor characteristics, data formats, and gold standards represent a barrier for data sharing, reproducibility, and external validation. In this study, we aim at providing an example of how movement data (from the real-world and the laboratory) recorded from different wearables and gold standard technologies can be organized, integrated, and stored. We leveraged on our experience from a large multi-centric study (Mobilise-D) to provide guidelines that can prove useful to access, understand, and re-use the data that will be made available from the study. These guidelines highlight the encountered challenges and the adopted solutions with the final aim of supporting standardization and integration of data in other studies and, in turn, to increase and facilitate comparison of data recorded in the scientific community. We also provide samples of standardized data, so that both the structure of the data and the procedure can be easily understood and reproduced.

A multi-sensor wearable system for the assessment of diseased gait in real-world conditions.

Introduction: Accurately assessing people's gait, especially in real-world conditions and in case of impaired mobility, is still a challenge due to intrinsic and extrinsic factors resulting in gait complexity. To improve the estimation of gait-related digital mobility outcomes (DMOs) in real-world scenarios, this study presents a wearable multi-sensor system (INDIP), integrating complementary sensing approaches (two plantar pressure insoles, three inertial units and two distance sensors). Methods: The INDIP technical validity was assessed against stereophotogrammetry during a laboratory experimental protocol comprising structured tests (including continuous curvilinear and rectilinear walking and steps) and a simulation of daily-life activities (including intermittent gait and short walking bouts). To evaluate its performance on various gait patterns, data were collected on 128 participants from seven cohorts: healthy young and older adults, patients with Parkinson's disease, multiple sclerosis, chronic obstructive pulmonary disease, congestive heart failure, and proximal femur fracture. Moreover, INDIP usability was evaluated by recording 2.5-h of real-world unsupervised activity. Results and discussion: Excellent absolute agreement (ICC >0.95) and very limited mean absolute errors were observed for all cohorts and digital mobility outcomes (cadence ≤0.61 steps/min, stride length ≤0.02 m, walking speed ≤0.02 m/s) in the structured tests. Larger, but limited, errors were observed during the daily-life simulation (cadence 2.72-4.87 steps/min, stride length 0.04-0.06 m, walking speed 0.03-0.05 m/s). Neither major technical nor usability issues were declared during the 2.5-h acquisitions. Therefore, the INDIP system can be considered a valid and feasible solution to collect reference data for analyzing gait in real-world conditions.

Laboratory and free-living gait performance in adults with COPD and healthy controls.

Background: Gait characteristics are important risk factors for falls, hospitalisations and mortality in older adults, but the impact of COPD on gait performance remains unclear. We aimed to identify differences in gait characteristics between adults with COPD and healthy age-matched controls during 1) laboratory tests that included complex movements and obstacles, 2) simulated daily-life activities (supervised) and 3) free-living daily-life activities (unsupervised). Methods: This case-control study used a multi-sensor wearable system (INDIP) to obtain seven gait characteristics for each walking bout performed by adults with mild-to-severe COPD (n=17; forced expiratory volume in 1 s 57±19% predicted) and controls (n=20) during laboratory tests, and during simulated and free-living daily-life activities. Gait characteristics were compared between adults with COPD and healthy controls for all walking bouts combined, and for shorter (≤30 s) and longer (>30 s) walking bouts separately. Results: Slower walking speed (-11 cm·s-1, 95% CI: -20 to -3) and lower cadence (-6.6 steps·min-1, 95% CI: -12.3 to -0.9) were recorded in adults with COPD compared to healthy controls during longer (>30 s) free-living walking bouts, but not during shorter (≤30 s) walking bouts in either laboratory or free-living settings. Double support duration and gait variability measures were generally comparable between the two groups. Conclusion: Gait impairment of adults with mild-to-severe COPD mainly manifests during relatively long walking bouts (>30 s) in free-living conditions. Future research should determine the underlying mechanism(s) of this impairment to facilitate the development of interventions that can improve free-living gait performance in adults with COPD.

Ecological validity of a deep learning algorithm to detect gait events from real-life walking bouts in mobility-limiting diseases.

Introduction: The clinical assessment of mobility, and walking specifically, is still mainly based on functional tests that lack ecological validity. Thanks to inertial measurement units (IMUs), gait analysis is shifting to unsupervised monitoring in naturalistic and unconstrained settings. However, the extraction of clinically relevant gait parameters from IMU data often depends on heuristics-based algorithms that rely on empirically determined thresholds. These were mainly validated on small cohorts in supervised settings. Methods: Here, a deep learning (DL) algorithm was developed and validated for gait event detection in a heterogeneous population of different mobility-limiting disease cohorts and a cohort of healthy adults. Participants wore pressure insoles and IMUs on both feet for 2.5 h in their habitual environment. The raw accelerometer and gyroscope data from both feet were used as input to a deep convolutional neural network, while reference timings for gait events were based on the combined IMU and pressure insoles data. Results and discussion: The results showed a high-detection performance for initial contacts (ICs) (recall: 98%, precision: 96%) and final contacts (FCs) (recall: 99%, precision: 94%) and a maximum median time error of -0.02 s for ICs and 0.03 s for FCs. Subsequently derived temporal gait parameters were in good agreement with a pressure insoles-based reference with a maximum mean difference of 0.07, -0.07, and <0.01 s for stance, swing, and stride time, respectively. Thus, the DL algorithm is considered successful in detecting gait events in ecologically valid environments across different mobility-limiting diseases.

An Algorithm for Accurate Marker-Based Gait Event Detection in Healthy and Pathological Populations During Complex Motor Tasks.

There is growing interest in the quantification of gait as part of complex motor tasks. This requires gait events (GEs) to be detected under conditions different from straight walking. This study aimed to propose and validate a new marker-based GE detection method, which is also suitable for curvilinear walking and step negotiation. The method was first tested against existing algorithms using data from healthy young adults (YA, n = 20) and then assessed in data from 10 individuals from the following five cohorts: older adults, chronic obstructive pulmonary disease, multiple sclerosis, Parkinson's disease, and proximal femur fracture. The propagation of the errors associated with GE detection on the calculation of stride length, duration, speed, and stance/swing durations was investigated. All participants performed a variety of motor tasks including curvilinear walking and step negotiation, while reference GEs were identified using a validated methodology exploiting pressure insole signals. Sensitivity, positive predictive values (PPV), F1-score, bias, precision, and accuracy were calculated. Absolute agreement [intraclass correlation coefficient ( I C C 2,1 )] between marker-based and pressure insole stride parameters was also tested. In the YA cohort, the proposed method outperformed the existing ones, with sensitivity, PPV, and F1 scores ≥ 99% for both GEs and conditions, with a virtually null bias (<10 ms). Overall, temporal inaccuracies minimally impacted stride duration, length, and speed (median absolute errors ≤1%). Similar algorithm performances were obtained for all the other five cohorts in GE detection and propagation to the stride parameters, where an excellent absolute agreement with the pressure insoles was also found ( I C C 2,1 = 0.817 -   0.999 ). In conclusion, the proposed method accurately detects GE from marker data under different walking conditions and for a variety of gait impairments.

Technical validation of real-world monitoring of gait: a multicentric observational study.

INTRODUCTION: Existing mobility endpoints based on functional performance, physical assessments and patient self-reporting are often affected by lack of sensitivity, limiting their utility in clinical practice. Wearable devices including inertial measurement units (IMUs) can overcome these limitations by quantifying digital mobility outcomes (DMOs) both during supervised structured assessments and in real-world conditions. The validity of IMU-based methods in the real-world, however, is still limited in patient populations. Rigorous validation procedures should cover the device metrological verification, the validation of the algorithms for the DMOs computation specifically for the population of interest and in daily life situations, and the users' perspective on the device. METHODS AND ANALYSIS: This protocol was designed to establish the technical validity and patient acceptability of the approach used to quantify digital mobility in the real world by Mobilise-D, a consortium funded by the European Union (EU) as part of the Innovative Medicine Initiative, aiming at fostering regulatory approval and clinical adoption of DMOs.After defining the procedures for the metrological verification of an IMU-based device, the experimental procedures for the validation of algorithms used to calculate the DMOs are presented. These include laboratory and real-world assessment in 120 participants from five groups: healthy older adults; chronic obstructive pulmonary disease, Parkinson's disease, multiple sclerosis, proximal femoral fracture and congestive heart failure. DMOs extracted from the monitoring device will be compared with those from different reference systems, chosen according to the contexts of observation. Questionnaires and interviews will evaluate the users' perspective on the deployed technology and relevance of the mobility assessment. ETHICS AND DISSEMINATION: The study has been granted ethics approval by the centre's committees (London-Bloomsbury Research Ethics committee; Helsinki Committee, Tel Aviv Sourasky Medical Centre; Medical Faculties of The University of Tübingen and of the University of Kiel). Data and algorithms will be made publicly available. TRIAL REGISTRATION NUMBER: ISRCTN (12246987).

A wearable solution for accurate step detection based on the direct measurement of the inter-foot distance.

Accurate step detection is crucial for the estimation of gait spatio-temporal parameters. Although several step detection methods based on the use of inertial measurement units (IMUs) have been successfully proposed, they may not perform adequately when the foot is dragged while walking, when walking aids are used, or when walking at low speed. The aim of this study was to test an original step-detection method, the inter-foot distance step counter (IFOD), based on the direct measurement of the distance between feet. Gait data were recorded using a wearable prototype system (SWING2DS), which integrates an IMU and two time-of-flight distance sensors (DSs). The system was attached to the medial side of the right foot with one DS positioned close to the forefoot (FOREDS) and the other close to the rearfoot (REARDS). Sixteen healthy adults were asked to walk over ground for two minutes along a loop, including both rectilinear and curvilinear portions, during two experimental sessions. The accuracy of the IFOD step counter was assessed using a stereo-photogrammetric system as gold standard. The best performance was obtained for REARDS with an accuracy higher than 99.8% for the instrumented foot step and 88.8% for the non-instrumented foot step during both rectilinear and curvilinear walks. Key features of the IFOD step counter are that it is possible to detect both right and left steps by instrumenting one foot only and that it does not rely on foot impact dynamics. The IFOD step counter can be combined with existing IMU-based methods for increasing step-detection accuracy.