Gait and Balance Assessments with Augmented Reality Glasses in People with Parkinson's Disease: Concurrent Validity and Test-Retest Reliability.

State-of-the-art augmented reality (AR) glasses record their 3D pose in space, enabling measurements and analyses of clinical gait and balance tests. This study's objective was to evaluate concurrent validity and test-retest reliability for common clinical gait and balance tests in people with Parkinson's disease: Five Times Sit To Stand (FTSTS) and Timed Up and Go (TUG) tests. Position and orientation data were collected in 22 participants with Parkinson's disease using HoloLens 2 and Magic Leap 2 AR glasses, from which test completion durations and durations of distinct sub-parts (e.g., sit to stand, turning) were derived and compared to reference systems and over test repetitions. Regarding concurrent validity, for both tests, an excellent between-systems agreement was found for position and orientation time series (ICC(C,1) > 0.933) and test completion durations (ICC(A,1) > 0.984). Between-systems agreement for FTSTS (sub-)durations were all excellent (ICC(A,1) > 0.921). TUG turning sub-durations were excellent (turn 1, ICC(A,1) = 0.913) and moderate (turn 2, ICC(A,1) = 0.589). Regarding test-retest reliability, the within-system test-retest variation in test completion times and sub-durations was always much greater than the between-systems variation, implying that (sub-)durations may be derived interchangeably from AR and reference system data. In conclusion, AR data are of sufficient quality to evaluate gait and balance aspects in people with Parkinson's disease, with valid quantification of test completion durations and sub-durations of distinct FTSTS and TUG sub-parts.

Quantifying Spatiotemporal Gait Parameters with HoloLens in Healthy Adults and People with Parkinson's Disease: Test-Retest Reliability, Concurrent Validity, and Face Validity.

Microsoft's HoloLens, a mixed-reality headset, provides, besides holograms, rich position data of the head, which can be used to quantify what the wearer is doing (e.g., walking) and to parameterize such acts (e.g., speed). The aim of the current study is to determine test-retest reliability, concurrent validity, and face validity of HoloLens 1 for quantifying spatiotemporal gait parameters. This was done in a group of 23 healthy young adults (mean age 21 years) walking at slow, comfortable, and fast speeds, as well as in a group of 24 people with Parkinson's disease (mean age 67 years) walking at comfortable speed. Walking was concurrently measured with HoloLens 1 and a previously validated markerless reference motion-registration system. We comprehensively evaluated HoloLens 1 for parameterizing walking (i.e., walking speed, step length and cadence) in terms of test-retest reliability (i.e., consistency over repetitions) and concurrent validity (i.e., between-systems agreement), using the intraclass correlation coefficient (ICC) and Bland-Altman's bias and limits of agreement. Test-retest reliability and between-systems agreement were excellent for walking speed (ICC ≥ 0.861), step length (ICC ≥ 0.884), and cadence (ICC ≥ 0.765), with narrower between-systems than over-repetitions limits of agreement. Face validity was demonstrated with significantly different walking speeds, step lengths and cadences over walking-speed conditions. To conclude, walking speed, step length, and cadence can be reliably and validly quantified from the position data of the wearable HoloLens 1 measurement system, not only for a broad range of speeds in healthy young adults, but also for self-selected comfortable speed in people with Parkinson's disease.

Avoiding 3D Obstacles in Mixed Reality: Does It Differ from Negotiating Real Obstacles?

Mixed-reality technologies are evolving rapidly, allowing for gradually more realistic interaction with digital content while moving freely in real-world environments. In this study, we examined the suitability of the Microsoft HoloLens mixed-reality headset for creating locomotor interactions in real-world environments enriched with 3D holographic obstacles. In Experiment 1, we compared the obstacle-avoidance maneuvers of 12 participants stepping over either real or holographic obstacles of different heights and depths. Participants' avoidance maneuvers were recorded with three spatially and temporally integrated Kinect v2 sensors. Similar to real obstacles, holographic obstacles elicited obstacle-avoidance maneuvers that scaled with obstacle dimensions. However, with holographic obstacles, some participants showed dissimilar trail or lead foot obstacle-avoidance maneuvers compared to real obstacles: they either consistently failed to raise their trail foot or crossed the obstacle with extreme lead-foot margins. In Experiment 2, we examined the efficacy of mixed-reality video feedback in altering such dissimilar avoidance maneuvers. Participants quickly adjusted their trail-foot crossing height and gradually lowered extreme lead-foot crossing heights in the course of mixed-reality video feedback trials, and these improvements were largely retained in subsequent trials without feedback. Participant-specific differences in real and holographic obstacle avoidance notwithstanding, the present results suggest that 3D holographic obstacles supplemented with mixed-reality video feedback may be used for studying and perhaps also training 3D obstacle avoidance.

A larger augmented-reality field of view improves interaction with nearby holographic objects.

Augmented-reality (AR) applications have shown potential for assisting and modulating gait in health-related fields, like AR cueing of foot-placement locations in people with Parkinson's disease. However, the size of the AR field of view (AR-FOV), which is smaller than one's own FOV, might affect interaction with nearby floor-based holographic objects. The study's primary objective was to evaluate the effect of AR-FOV size on the required head orientations for viewing and interacting with real-world and holographic floor-based objects during standstill and walking conditions. Secondary, we evaluated the effect of AR-FOV size on gait speed when interacting with real-world and holographic objects. Sixteen healthy middle-aged adults participated in two experiments wearing HoloLens 1 and 2 AR headsets that differ in AR-FOV size. To confirm participants' perceived differences in AR-FOV size, we examined the head orientations required for viewing nearby and far objects from a standstill position (Experiment 1). In Experiment 2, we examined the effect of AR-FOV size on head orientations and gait speeds for negotiating 2D and 3D objects during walking. Less downward head orientation was required for looking at nearby holographic objects with HoloLens 2 than with HoloLens 1, as expected given differences in perceived AR-FOV size (Experiment 1). In Experiment 2, a greater downward head orientation was observed for interacting with holographic objects compared to real-world objects, but again less so for HoloLens 2 than HoloLens 1 along the line of progression. Participants walked slightly but significantly slower when interacting with holographic objects compared to real-world objects, without any differences between the HoloLenses. To conclude, the increased size of the AR-FOV did not affect gait speed, but resulted in more real-world-like head orientations for seeing and picking up task-relevant information when interacting with floor-based holographic objects, improving the potential efficacy of AR cueing applications.

Gait-modifying effects of augmented-reality cueing in people with Parkinson's disease.

Introduction: External cueing can improve gait in people with Parkinson's disease (PD), but there is a need for wearable, personalized and flexible cueing techniques that can exploit the power of action-relevant visual cues. Augmented Reality (AR) involving headsets or glasses represents a promising technology in those regards. This study examines the gait-modifying effects of real-world and AR cueing in people with PD. Methods: 21 people with PD performed walking tasks augmented with either real-world or AR cues, imposing changes in gait speed, step length, crossing step length, and step height. Two different AR headsets, differing in AR field of view (AR-FOV) size, were used to evaluate potential AR-FOV-size effects on the gait-modifying effects of AR cues as well as on the head orientation required for interacting with them. Results: Participants modified their gait speed, step length, and crossing step length significantly to changes in both real-world and AR cues, with step lengths also being statistically equivalent to those imposed. Due to technical issues, step-height modulation could not be analyzed. AR-FOV size had no significant effect on gait modifications, although small differences in head orientation were observed when interacting with nearby objects between AR headsets. Conclusion: People with PD can modify their gait to AR cues as effectively as to real-world cues with state-of-the-art AR headsets, for which AR-FOV size is no longer a limiting factor. Future studies are warranted to explore the merit of a library of cue modalities and individually-tailored AR cueing for facilitating gait in real-world environments.

Remotely prescribed, monitored, and tailored home-based gait-and-balance exergaming using augmented reality glasses: a clinical feasibility study in people with Parkinson's disease.

Background: Exergaming has the potential to increase adherence to exercise through play, individually tailored training, and (online) remote monitoring. Reality Digital Therapeutics (Reality DTx®) is a digital therapeutic software platform for augmented reality (AR) glasses that enables a home-based gait-and-balance exergaming intervention specifically designed for people with Parkinson's disease (pwPD). Objective: The primary objective was to evaluate the feasibility and potential efficacy of Reality DTx® AR exergaming intervention for improving gait, balance, and walking-adaptability fall-risk indicators. The secondary objective was to evaluate the potential superiority of AR glasses [Magic Leap 2 (ML2) vs. HoloLens 2 (HL2)]. Methods: This waitlist-controlled clinical feasibility study comprised three laboratory visits (baseline; pre-intervention; and post-intervention), a home visit, and a 6-week AR exergaming intervention. Five complementary gait-and-balance exergames were remotely prescribed (default five sessions/week of 30 active minutes/session), monitored, and tailored. Feasibility was assessed in terms of safety, adherence, and user experience. During laboratory visits, gait-and-balance capacity was assessed using standard clinical gait-and-balance tests and advanced walking-adaptability fall-risk assessments. Results: In total, 24 pwPD participated. No falls and four near falls were reported. Session adherence was 104%. The User Experience Questionnaire scores for Reality DTx® ranged from above average to excellent, with superior scores for HL2 over ML2 for Perspicuity and Dependability. Intervention effects were observed for the Timed Up and Go test (albeit small), the Five Times Sit to Stand test, and walking speed. Walking-adaptability fall-risk indicators all improved post-intervention. Conclusion: Reality DTx® is a safe, adherable, usable, well-accepted, and potentially effective intervention in pwPD. These promising results warrant future randomized controlled trials on the (cost-)effectiveness of home-based AR exergaming interventions for improving gait, balance, and fall risk. Clinical trial registration: ClinicalTrials.gov, identifier NCT05605249.

Holocue: A Wearable Holographic Cueing Application for Alleviating Freezing of Gait in Parkinson's Disease.

External visual cueing is a well-known means to target freezing of gait (FOG) in Parkinson's disease patients. Holocue is a wearable visual cueing application that allows the HoloLens 1 mixed-reality headset to present on-demand patient-tailored action-relevant 2D and 3D holographic visual cues in free-living environments. The aim of this study involving 24 Parkinson's disease patients with dopaminergic "ON state" FOG was two-fold. First, to explore unfamiliarity and habituation effects associated with wearing the HoloLens on FOG. Second, to evaluate the potential immediate effect of Holocue on alleviating FOG in the home environment. Three sessions were conducted to examine (1) the effect of wearing the unfamiliar HoloLens on FOG by comparing walking with and without the HoloLens, (2) habituation effects to wearing the HoloLens by comparing FOG while walking with HoloLens over sessions, and (3) the potential immediate effect of Holocue on FOG by comparing walking with HoloLens with and without Holocue. Wearing the HoloLens (without Holocue) did significantly increase the number and duration of FOG episodes, but this unfamiliarity effect disappeared with habituation over sessions. This not only emphasizes the need for sufficient habituation to unfamiliar devices, but also testifies to the need for research designs with appropriate control conditions when examining effects of unfamiliar wearable cueing devices. Holocue had overall no immediate effect on FOG, although objective and subjective benefits were observed for some individuals, most notably those with long and/or many FOG episodes. Our participants raised valuable opportunities to improve Holocue and confirmed our assumptions about current and anticipated future design choices, which supports ongoing Holocue development for and with end users.

'Haste makes waste': The tradeoff between walking speed and target-stepping accuracy.

BACKGROUND: When environmental conditions require accurate foot placement during walking (e.g., on a rough path), we typically walk slower to avoid tripping, slipping or stumbling. Likewise, hurrying too much is a common situational circumstance of walking-related falls. This suggests a tradeoff between walking speed and stepping accuracy in situations that demand precise foot placement. RESEARCH QUESTION: How can this expected tradeoff between walking speed and stepping accuracy best be parameterized? METHODS: In Experiment 1, participants (n = 20) walked at five different speeds over an irregularly spaced sequence of projected stepping targets. Participants were instructed to place their feet accurately onto the targets, while following a constant-speed cue running alongside the walkway. Stepping accuracy was parameterized as overall (RMSE, root mean square error), variable (VE) and constant (CE) stepping errors, quantified over targets as well as per target. In Experiment 2, we determined preferred walking speed and stepping accuracy for regularly and irregularly spaced stepping targets. RESULTS: Repeated-measures ANOVAs revealed that RMSE and VE grew linearly with increasing speeds, both over targets as well as per target. Per target CE varied in magnitude and sign with variations in inter-target spacing: for shorter inter-target spacing targets were overshot (CE > 0), while for longer inter-target spacing targets were undershot (CE < 0). This effect was stronger for faster speeds and for targets preceded by the shortest and longest inter-target spacing. Preferred walking speed and per-target VE did not differ between regularly and irregularly spaced targets. SIGNIFICANCE: Participants stepped less precisely when walking faster. The linear increase in VE with faster speeds was consistent with Schmidt's law regarding the speed-accuracy tradeoff. The systematic comparison of stepping errors over regularly and irregularly spaced stepping-target conditions further provided important clues on how to best parameterize stepping accuracy: per stepping target using VE (i.e., stepping inconsistency), complemented with CE (i.e., stepping bias) in case of irregular inter-target spacing.

Assessing walking adaptability in stroke patients.

PURPOSE: The ability to adapt walking is important for safe ambulation. Assessments of impairments in walking adaptability with the Interactive Walkway may aid in the development of individualized therapy strategies of stroke patients. The Interactive Walkway is an overground walkway with Kinect v2 sensors for a markerless registration of full-body kinematics, which can be augmented with (gait-dependent) visual context to assess walking adaptability. This study aims to evaluate the potential of the Interactive Walkway as a new technology for assessing walking adaptability in stroke patients. Materials and methods: 30 stroke patients and 30 controls performed clinical tests, quantitative gait assessments and various walking-adaptability tasks on the Interactive Walkway. Outcome measures were compared between stroke patients and controls to examine known-groups validity. Pearson's correlation coefficients were calculated to assess the relationship between walking-adaptability outcomes and commonly used clinical test scores of walking ability and spatiotemporal gait parameters of unconstrained walking. Results: Good known-groups validity for walking-adaptability outcomes was demonstrated. In addition, the vast majority of walking-adaptability outcomes did not or only moderately correlate with clinical test scores of walking ability and unconstrained walking parameters. Conclusion: Interactive Walkway walking-adaptability outcomes have good known-groups validity and complement standard clinical tests and spatiotemporal gait parameters.IMPLICATIONS FOR REHABILITATIONThe Interactive Walkway allows for a comprehensive walking-adaptability assessment.Good known-groups validity for walking-adaptability tasks was demonstrated and walking-adaptability tasks complemented clinical tests and gait parameters.The Interactive Walkway has potential for monitoring recovery of walking after stroke.Assessments of walking adaptability may contribute to individualized interventions.

Walking adaptability for targeted fall-risk assessments.

BACKGROUND: Most falls occur during walking and are due to trips, slips or misplaced steps, which suggests a reduced walking adaptability. The objective of this study was to evaluate the potential merit of a walking-adaptability assessment for identifying prospective fallers and risk factors for future falls in a cohort of stroke patients, Parkinson's disease patients, and controls (n = 30 for each group). RESEARCH QUESTION: Does an assessment of walking-adaptability improve the identification of fallers compared to generic fall-risk factors alone? METHODS: This study comprised an evaluation of subject characteristics, clinical gait and balance tests, a quantitative gait assessment and a walking-adaptability assessment with the Interactive Walkway. Subjects' falls were registered prospectively with falls calendars during a 6-month follow-up period. Generic and walking-related fall-risk factors were compared between prospective fallers and non-fallers. Binary logistic regression and Chi-square Automatic Interaction Detector analyses were performed to identify fallers and predictor variables for future falls. RESULTS: In addition to fall history, obstacle-avoidance success rate and normalized walking speed during goal-directed stepping correctly classified prospective fallers and were predictors of future falls. Compared to the use of generic fall-risk factors only, the inclusion of walking-related fall-risk factors improved the identification of prospective fallers. SIGNIFICANCE: If cross-validated in future studies with larger samples, these fall-risk factors may serve as quick entry tests for falls prevention programs. In addition, the identification of these walking-related fall-risk factors may help in developing falls prevention strategies.

Assessing Walking Adaptability in Parkinson's Disease: "The Interactive Walkway".

Introduction: In people with Parkinson's disease (PD) many aspects of walking ability deteriorate with advancing disease. Clinical tests typically evaluate single aspects of walking and to a lesser extent assess more complex walking tasks involving a combination of the three key aspects of walking ability (i.e., generating stepping, maintaining postural equilibrium, adapting walking). The Interactive Walkway allows for assessing more complex walking tasks to address features that are relevant for daily life walking of patients, including adaptive walking and dual-task walking. Methods: To evaluate the expected added value of Interactive Walkway assessments in people with PD, we first evaluated its known-groups validity for outcome measures of unconstrained walking, adaptive walking and dual-task walking. Subsequently, these outcome measures were related to commonly used clinical test scores. Finally, we evaluated the expected added value of these outcomes over clinical tests scores in discriminating people with PD with and without freezing of gait. Results: Interactive Walkway outcome measures showed significant differences between freezers, non-freezers and healthy controls, in expected directions. Most Interactive Walkway outcome measures were not or at best moderately correlated with clinical test scores. Finally, Interactive Walkway outcome measures of adaptive walking slightly better discriminated freezers from non-freezers than clinical tests scores. Conclusion: We confirmed the added value of Interactive Walkway assessments, which provides a comprehensive evaluation of walking ability incorporating features of its three key aspects. Future studies are warranted to examine the potential of the Interactive Walkway for the assessment of fall risk and informing on tailored falls prevention programs in people with PD and in other populations with impaired walking ability.

Walking-adaptability assessments with the Interactive Walkway: Between-systems agreement and sensitivity to task and subject variations.

The ability to adapt walking to environmental circumstances is an important aspect of walking, yet difficult to assess. The Interactive Walkway was developed to assess walking adaptability by augmenting a multi-Kinect-v2 10-m walkway with gait-dependent visual context (stepping targets, obstacles) using real-time processed markerless full-body kinematics. In this study we determined Interactive Walkway's usability for walking-adaptability assessments in terms of between-systems agreement and sensitivity to task and subject variations. Under varying task constraints, 21 healthy subjects performed obstacle-avoidance, sudden-stops-and-starts and goal-directed-stepping tasks. Various continuous walking-adaptability outcome measures were concurrently determined with the Interactive Walkway and a gold-standard motion-registration system: available response time, obstacle-avoidance and sudden-stop margins, step length, stepping accuracy and walking speed. The same holds for dichotomous classifications of success and failure for obstacle-avoidance and sudden-stops tasks and performed short-stride versus long-stride obstacle-avoidance strategies. Continuous walking-adaptability outcome measures generally agreed well between systems (high intraclass correlation coefficients for absolute agreement, low biases and narrow limits of agreement) and were highly sensitive to task and subject variations. Success and failure ratings varied with available response times and obstacle types and agreed between systems for 85-96% of the trials while obstacle-avoidance strategies were always classified correctly. We conclude that Interactive Walkway walking-adaptability outcome measures are reliable and sensitive to task and subject variations, even in high-functioning subjects. We therefore deem Interactive Walkway walking-adaptability assessments usable for obtaining an objective and more task-specific examination of one's ability to walk, which may be feasible for both high-functioning and fragile populations since walking adaptability can be assessed at various levels of difficulty.

Kinematic Validation of a Multi-Kinect v2 Instrumented 10-Meter Walkway for Quantitative Gait Assessments.

Walking ability is frequently assessed with the 10-meter walking test (10MWT), which may be instrumented with multiple Kinect v2 sensors to complement the typical stopwatch-based time to walk 10 meters with quantitative gait information derived from Kinect's 3D body point's time series. The current study aimed to evaluate a multi-Kinect v2 set-up for quantitative gait assessments during the 10MWT against a gold-standard motion-registration system by determining between-systems agreement for body point's time series, spatiotemporal gait parameters and the time to walk 10 meters. To this end, the 10MWT was conducted at comfortable and maximum walking speed, while 3D full-body kinematics was concurrently recorded with the multi-Kinect v2 set-up and the Optotrak motion-registration system (i.e., the gold standard). Between-systems agreement for body point's time series was assessed with the intraclass correlation coefficient (ICC). Between-systems agreement was similarly determined for the gait parameters' walking speed, cadence, step length, stride length, step width, step time, stride time (all obtained for the intermediate 6 meters) and the time to walk 10 meters, complemented by Bland-Altman's bias and limits of agreement. Body point's time series agreed well between the motion-registration systems, particularly so for body points in motion. For both comfortable and maximum walking speeds, the between-systems agreement for the time to walk 10 meters and all gait parameters except step width was high (ICC ≥ 0.888), with negligible biases and narrow limits of agreement. Hence, body point's time series and gait parameters obtained with a multi-Kinect v2 set-up match well with those derived with a gold standard in 3D measurement accuracy. Future studies are recommended to test the clinical utility of the multi-Kinect v2 set-up to automate 10MWT assessments, thereby complementing the time to walk 10 meters with reliable spatiotemporal gait parameters obtained objectively in a quick, unobtrusive and patient-friendly manner.