Markerless Motion Capture to Quantify Functional Performance in Neurodegeneration: Systematic Review.

BACKGROUND: Markerless motion capture (MMC) uses video cameras or depth sensors for full body tracking and presents a promising approach for objectively and unobtrusively monitoring functional performance within community settings, to aid clinical decision-making in neurodegenerative diseases such as dementia. OBJECTIVE: The primary objective of this systematic review was to investigate the application of MMC using full-body tracking, to quantify functional performance in people with dementia, mild cognitive impairment, and Parkinson disease. METHODS: A systematic search of the Embase, MEDLINE, CINAHL, and Scopus databases was conducted between November 2022 and February 2023, which yielded a total of 1595 results. The inclusion criteria were MMC and full-body tracking. A total of 157 studies were included for full-text screening, out of which 26 eligible studies that met the selection criteria were included in the review. . RESULTS: Primarily, the selected studies focused on gait analysis (n=24), while other functional tasks, such as sit to stand (n=5) and stepping in place (n=1), were also explored. However, activities of daily living were not evaluated in any of the included studies. MMC models varied across the studies, encompassing depth cameras (n=18) versus standard video cameras (n=5) or mobile phone cameras (n=2) with postprocessing using deep learning models. However, only 6 studies conducted rigorous comparisons with established gold-standard motion capture models. CONCLUSIONS: Despite its potential as an effective tool for analyzing movement and posture in individuals with dementia, mild cognitive impairment, and Parkinson disease, further research is required to establish the clinical usefulness of MMC in quantifying mobility and functional performance in the real world.

Remote Gait Analysis Using Ultra-Wideband Radar Technology Based on Joint Range-Doppler-Time Representation.

OBJECTIVE: In recent years, radar technology has been extensively utilized in contactless human behavior monitoring systems. The unique capabilities of ultra-wideband (UWB) radars compared to conventional radar technologies, due to time-of-flight measurements, present new untapped opportunities for in-depth monitoring of human movement during overground locomotion. This study aims to investigate the deployability of UWB radars in accurately capturing the gait patterns of healthy individuals with no known walking impairments. METHODS: A novel algorithm was developed that can extract ten clinical spatiotemporal gait features using the Doppler information captured from three monostatic UWB radar sensors during a 6-meter walking task. Key gait events are detected from lower-extremity movements based on the joint range-Doppler-time representation of recorded radar data. The estimated gait parameters were validated against a gold-standard optical motion tracking system using 12 healthy volunteers. RESULTS: On average, nine gait parameters can be consistently estimated with 90-98% accuracy, while capturing 94.5% of participants' gait variability and 90.8% of inter-limb symmetry. Correlation and Bland-Altman analysis revealed a strong correlation between radar-based parameters and the ground-truth values, with average discrepancies consistently close to 0. CONCLUSION: Results prove that radar sensing can provide accurate biomarkers to supplement clinical human gait analysis, with quality similar to gold standard assessment. SIGNIFICANCE: Radars can potentially allow a transition from expensive and cumbersome lab-based gait analysis tools toward a completely unobtrusive and affordable solution for in-home deployment, enabling continuous long-term monitoring of individuals for research and healthcare applications.

Embedding Patient Input in Outcome Measures for Long-Term Disease-Modifying Parkinson Disease Trials.

BACKGROUND: Clinical trials of disease-modifying therapies in PD require valid and responsive primary outcome measures that are relevant to patients. OBJECTIVES: The objective is to select a patient-centered primary outcome measure for disease-modification trials over three or more years. METHODS: Experts in Parkinson's disease (PD), statistics, and health economics and patient and public involvement and engagement (PPIE) representatives reviewed and discussed potential outcome measures. A larger PPIE group provided input on their key considerations for such an endpoint. Feasibility, clinimetric properties, and relevance to patients were assessed and synthesized. RESULTS: Although initial considerations favored the Movement Disorder Society-sponsored revision of the Unified Parkinson's Disease Rating Scale (MDS-UPDRS) Part III in Off, feasibility, PPIE input, and clinimetric properties supported the MDS-UPDRS Part II. However, PPIE input also highlighted the importance of nonmotor symptoms, especially in the longer term, leading to the selection of the MDS-UPDRS Parts I + II sum score. CONCLUSIONS: The MDS-UPDRS Parts I + II sum score was chosen as the primary outcome for large 3-year disease-modification trials. © 2023 The Authors. Movement Disorders published by Wiley Periodicals LLC on behalf of International Parkinson and Movement Disorder Society.

Bill-EVR: An Embodied Virtual Reality Framework for Reward-and-Error-Based Motor Rehab-Learning.

VR rehabilitation is an established field by now, however, it often refers to computer screen-based interactive rehabilitation activities. In recent years, there was an increased use of VR-headsets, which can provide an immersive virtual environment for real-world tasks, but they are lacking any physical interaction with the task objects and any proprioceptive feedback. Here, we focus on Embodied Virtual Reality (EVR), an emerging field where not only the visual input via VR-headset but also the haptic feedback is physically correct. This happens because subjects interact with physical objects that are veridically aligned in Virtual Reality. This technology lets us manipulate motor performance and motor learning through visual feedback perturbations. Bill-EVR is a framework that allows interventions in the performance of real-world tasks, such as playing pool billiard, engaging end-users in motivating life-like situations to trigger motor (re)learning - subjects see in VR and handle the real-world cue stick, the pool table and shoot physical balls. Specifically, we developed our platform to isolate and evaluate different mechanisms of motor learning to investigate its two main components, error-based and reward-based motor adaptation. This understanding can provide insights for improvements in neurorehabilitation: indeed, reward-based mechanisms are putatively impaired by degradation of the dopaminergic system, such as in Parkinson's disease, while error-based mechanisms are essential for recovering from stroke-induced movement errors. Due to its fully customisable features, our EVR framework can be used to facilitate the improvement of several conditions, providing a valid extension of VR-based implementations and constituting a motor learning tool that can be completely tailored to the individual needs of patients.

Multicohort cross-sectional study of cognitive and behavioural digital biomarkers in neurodegeneration: the Living Lab Study protocol.

INTRODUCTION AND AIMS: Digital biomarkers can provide a cost-effective, objective and robust measure for neurological disease progression, changes in care needs and the effect of interventions. Motor function, physiology and behaviour can provide informative measures of neurological conditions and neurodegenerative decline. New digital technologies present an opportunity to provide remote, high-frequency monitoring of patients from within their homes. The purpose of the living lab study is to develop novel digital biomarkers of functional impairment in those living with neurodegenerative disease (NDD) and neurological conditions. METHODS AND ANALYSIS: The Living Lab study is a cross-sectional observational study of cognition and behaviour in people living with NDDs and other, non-degenerative neurological conditions. Patients (n≥25 for each patient group) with dementia, Parkinson's disease, amyotrophic lateral sclerosis, mild cognitive impairment, traumatic brain injury and stroke along with controls (n≥60) will be pragmatically recruited. Patients will carry out activities of daily living and functional assessments within the Living Lab. The Living Lab is an apartment-laboratory containing a functional kitchen, bathroom, bed and living area to provide a controlled environment to develop novel digital biomarkers. The Living Lab provides an important intermediary stage between the conventional laboratory and the home. Multiple passive environmental sensors, internet-enabled medical devices, wearables and electroencephalography (EEG) will be used to characterise functional impairments of NDDs and non-NDD conditions. We will also relate these digital technology measures to clinical and cognitive outcomes. ETHICS AND DISSEMINATION: Ethical approvals have been granted by the Imperial College Research Ethics Committee (reference number: 21IC6992). Results from the study will be disseminated at conferences and within peer-reviewed journals.

Subtly altered topological asymmetry of brain structural covariance networks in autism spectrum disorder across 43 datasets from the ENIGMA consortium.

Small average differences in the left-right asymmetry of cerebral cortical thickness have been reported in individuals with autism spectrum disorder (ASD) compared to typically developing controls, affecting widespread cortical regions. The possible impacts of these regional alterations in terms of structural network effects have not previously been characterized. Inter-regional morphological covariance analysis can capture network connectivity between different cortical areas at the macroscale level. Here, we used cortical thickness data from 1455 individuals with ASD and 1560 controls, across 43 independent datasets of the ENIGMA consortium's ASD Working Group, to assess hemispheric asymmetries of intra-individual structural covariance networks, using graph theory-based topological metrics. Compared with typical features of small-world architecture in controls, the ASD sample showed significantly altered average asymmetry of networks involving the fusiform, rostral middle frontal, and medial orbitofrontal cortex, involving higher randomization of the corresponding right-hemispheric networks in ASD. A network involving the superior frontal cortex showed decreased right-hemisphere randomization. Based on comparisons with meta-analyzed functional neuroimaging data, the altered connectivity asymmetry particularly affected networks that subserve executive functions, language-related and sensorimotor processes. These findings provide a network-level characterization of altered left-right brain asymmetry in ASD, based on a large combined sample. Altered asymmetrical brain development in ASD may be partly propagated among spatially distant regions through structural connectivity.

Playing the piano with a robotic third thumb: assessing constraints of human augmentation.

Contemporary robotics gives us mechatronic capabilities for augmenting human bodies with extra limbs. However, how our motor control capabilities pose limits on such augmentation is an open question. We developed a Supernumerary Robotic 3rd Thumbs (SR3T) with two degrees-of-freedom controlled by the user's body to endow them with an extra contralateral thumb on the hand. We demonstrate that a pianist can learn to play the piano with 11 fingers within an hour. We then evaluate 6 naïve and 6 experienced piano players in their prior motor coordination and their capability in piano playing with the robotic augmentation. We show that individuals' augmented performance with the SR3T could be explained by our new custom motor coordination assessment, the Human Augmentation Motor Coordination Assessment (HAMCA) performed pre-augmentation. Our work demonstrates how supernumerary robotics can augment humans in skilled tasks and that individual differences in their augmentation capability are explainable by their individual motor coordination abilities.

Natural history, trajectory, and management of mechanically ventilated COVID-19 patients in the United Kingdom.

PURPOSE: The trajectory of mechanically ventilated patients with coronavirus disease 2019 (COVID-19) is essential for clinical decisions, yet the focus so far has been on admission characteristics without consideration of the dynamic course of the disease in the context of applied therapeutic interventions. METHODS: We included adult patients undergoing invasive mechanical ventilation (IMV) within 48 h of intensive care unit (ICU) admission with complete clinical data until ICU death or discharge. We examined the importance of factors associated with disease progression over the first week, implementation and responsiveness to interventions used in acute respiratory distress syndrome (ARDS), and ICU outcome. We used machine learning (ML) and Explainable Artificial Intelligence (XAI) methods to characterise the evolution of clinical parameters and our ICU data visualisation tool is available as a web-based widget ( https://www.CovidUK.ICU ). RESULTS: Data for 633 adults with COVID-19 who underwent IMV between 01 March 2020 and 31 August 2020 were analysed. Overall mortality was 43.3% and highest with non-resolution of hypoxaemia [60.4% vs17.6%; P < 0.001; median PaO2/FiO2 on the day of death was 12.3(8.9-18.4) kPa] and non-response to proning (69.5% vs.31.1%; P < 0.001). Two ML models using weeklong data demonstrated an increased predictive accuracy for mortality compared to admission data (74.5% and 76.3% vs 60%, respectively). XAI models highlighted the increasing importance, over the first week, of PaO2/FiO2 in predicting mortality. Prone positioning improved oxygenation only in 45% of patients. A higher peak pressure (OR 1.42[1.06-1.91]; P < 0.05), raised respiratory component (OR 1.71[ 1.17-2.5]; P < 0.01) and cardiovascular component (OR 1.36 [1.04-1.75]; P < 0.05) of the sequential organ failure assessment (SOFA) score and raised lactate (OR 1.33 [0.99-1.79]; P = 0.057) immediately prior to application of prone positioning were associated with lack of oxygenation response. Prone positioning was not applied to 76% of patients with moderate hypoxemia and 45% of those with severe hypoxemia and patients who died without receiving proning interventions had more missed opportunities for prone intervention [7 (3-15.5) versus 2 (0-6); P < 0.001]. Despite the severity of gas exchange deficit, most patients received lung-protective ventilation with tidal volumes less than 8 mL/kg and plateau pressures less than 30cmH2O. This was despite systematic errors in measurement of height and derived ideal body weight. CONCLUSIONS: Refractory hypoxaemia remains a major association with mortality, yet evidence based ARDS interventions, in particular prone positioning, were not implemented and had delayed application with an associated reduced responsiveness. Real-time service evaluation techniques offer opportunities to assess the delivery of care and improve protocolised implementation of evidence-based ARDS interventions, which might be associated with improvements in survival.

Embodied virtual reality for the study of real-world motor learning.

Motor-learning literature focuses on simple laboratory-tasks due to their controlled manner and the ease to apply manipulations to induce learning and adaptation. Recently, we introduced a billiards paradigm and demonstrated the feasibility of real-world-neuroscience using wearables for naturalistic full-body motion-tracking and mobile-brain-imaging. Here we developed an embodied virtual-reality (VR) environment to our real-world billiards paradigm, which allows to control the visual feedback for this complex real-world task, while maintaining sense of embodiment. The setup was validated by comparing real-world ball trajectories with the trajectories of the virtual balls, calculated by the physics engine. We then ran our short-term motor learning protocol in the embodied VR. Subjects played billiard shots when they held the physical cue and hit a physical ball on the table while seeing it all in VR. We found comparable short-term motor learning trends in the embodied VR to those we previously reported in the physical real-world task. Embodied VR can be used for learning real-world tasks in a highly controlled environment which enables applying visual manipulations, common in laboratory-tasks and rehabilitation, to a real-world full-body task. Embodied VR enables to manipulate feedback and apply perturbations to isolate and assess interactions between specific motor-learning components, thus enabling addressing the current questions of motor-learning in real-world tasks. Such a setup can potentially be used for rehabilitation, where VR is gaining popularity but the transfer to the real-world is currently limited, presumably, due to the lack of embodiment.

Motor learning in real-world pool billiards.

The neurobehavioral mechanisms of human motor-control and learning evolved in free behaving, real-life settings, yet this is studied mostly in reductionistic lab-based experiments. Here we take a step towards a more real-world motor neuroscience using wearables for naturalistic full-body motion-tracking and the sports of pool billiards to frame a real-world skill learning experiment. First, we asked if well-known features of motor learning in lab-based experiments generalize to a real-world task. We found similarities in many features such as multiple learning rates, and the relationship between task-related variability and motor learning. Our data-driven approach reveals the structure and complexity of movement, variability, and motor learning, enabling an in-depth understanding of the structure of motor learning in three ways: First, while expecting most of the movement learning is done by the cue-wielding arm, we find that motor learning affects the whole body, changing motor-control from head to toe. Second, during learning, all subjects decreased their movement variability and their variability in the outcome. Subjects who were initially more variable were also more variable after learning. Lastly, when screening the link across subjects between initial variability in individual joints and learning, we found that only the initial variability in the right forearm supination shows a significant correlation to the subjects' learning rates. This is in-line with the relationship between learning and variability: while learning leads to an overall reduction in movement variability, only initial variability in specific task-relevant dimensions can facilitate faster learning.

Brain Activity Reveals Multiple Motor-Learning Mechanisms in a Real-World Task.

Many recent studies found signatures of motor learning in neural beta oscillations (13-30 Hz), and specifically in the post-movement beta rebound (PMBR). All these studies were in controlled laboratory-tasks in which the task designed to induce the studied learning mechanism. Interestingly, these studies reported opposing dynamics of the PMBR magnitude over learning for the error-based and reward-based tasks (increase vs. decrease, respectively). Here, we explored the PMBR dynamics during real-world motor-skill-learning in a billiards task using mobile-brain-imaging. Our EEG recordings highlight the opposing dynamics of PMBR magnitudes (increase vs. decrease) between different subjects performing the same task. The groups of subjects, defined by their neural dynamics, also showed behavioral differences expected for different learning mechanisms. Our results suggest that when faced with the complexity of the real-world different subjects might use different learning mechanisms for the same complex task. We speculate that all subjects combine multi-modal mechanisms of learning, but different subjects have different predominant learning mechanisms.

A Revised Computational Neuroanatomy for Motor Control.

We discuss a new framework for understanding the structure of motor control. Our approach integrates existing models of motor control with the reality of hierarchical cortical processing and the parallel segregated loops that characterize cortical-subcortical connections. We also incorporate the recent claim that cortex functions via predictive representation and optimal information utilization. Our framework assumes that each cortical area engaged in motor control generates a predictive model of a different aspect of motor behavior. In maintaining these predictive models, each area interacts with a different part of the cerebellum and BG. These subcortical areas are thus engaged in domain-appropriate system identification and optimization. This refocuses the question of division of function among different cortical areas. What are the different aspects of motor behavior that are predictively modeled? We suggest that one fundamental division is between modeling of task and body whereas another is the model of state and action. Thus, we propose that the posterior parietal cortex, somatosensory cortex, premotor cortex, and motor cortex represent task state, body state, task action, and body action, respectively. In the second part of this review, we demonstrate how this division of labor can better account for many recent findings of movement encoding, especially in the premotor and posterior parietal cortices.

Neurobehavioural signatures in race car driving: a case study.

Recent technological developments in mobile brain and body imaging are enabling new frontiers of real-world neuroscience. Simultaneous recordings of body movement and brain activity from highly skilled individuals as they demonstrate their exceptional skills in real-world settings, can shed new light on the neurobehavioural structure of human expertise. Driving is a real-world skill which many of us acquire to different levels of expertise. Here we ran a case-study on a subject with the highest level of driving expertise-a Formula E Champion. We studied the driver's neural and motor patterns while he drove a sports car on the "Top Gear" race track under extreme conditions (high speed, low visibility, low temperature, wet track). His brain activity, eye movements and hand/foot movements were recorded. Brain activity in the delta, alpha, and beta frequency bands showed causal relation to hand movements. We herein demonstrate the feasibility of using mobile brain and body imaging even in very extreme conditions (race car driving) to study the sensory inputs, motor outputs, and brain states which characterise complex human skills.

Eye Movements during Visuomotor Adaptation Represent Only Part of the Explicit Learning.

Visuomotor rotations are learned through a combination of explicit strategy and implicit recalibration. However, measuring the relative contribution of each remains a challenge and the possibility of multiple explicit and implicit components complicates the issue. Recent interest has focused on the possibility that eye movements reflects explicit strategy. Here we compared eye movements during adaptation to two accepted measures of explicit learning: verbal report and the exclusion test. We found that while reporting, all subjects showed a match among all three measures. However, when subjects did not report their intention, the eye movements of some subjects suggested less explicit adaptation than what was measured in an exclusion test. Interestingly, subjects whose eye movements did match their exclusion could be clustered into the following two subgroups: fully implicit learners showing no evidence of explicit adaptation and explicit learners with little implicit adaptation. Subjects showing a mix of both explicit and implicit adaptation were also those where eye movements showed less explicit adaptation than did exclusion. Thus, our results support the idea of multiple components of explicit learning as only part of the explicit learning is reflected in the eye movements. Individual subjects may use explicit components that are reflected in the eyes or those that are not or some mixture of the two. Analysis of reaction times suggests that the explicit components reflected in the eye movements involve longer reaction times. This component, according to recent literature, may be related to mental rotation.

Altered structural brain asymmetry in autism spectrum disorder in a study of 54 datasets.

Altered structural brain asymmetry in autism spectrum disorder (ASD) has been reported. However, findings have been inconsistent, likely due to limited sample sizes. Here we investigated 1,774 individuals with ASD and 1,809 controls, from 54 independent data sets of the ENIGMA consortium. ASD was significantly associated with alterations of cortical thickness asymmetry in mostly medial frontal, orbitofrontal, cingulate and inferior temporal areas, and also with asymmetry of orbitofrontal surface area. These differences generally involved reduced asymmetry in individuals with ASD compared to controls. Furthermore, putamen volume asymmetry was significantly increased in ASD. The largest case-control effect size was Cohen's d = -0.13, for asymmetry of superior frontal cortical thickness. Most effects did not depend on age, sex, IQ, severity or medication use. Altered lateralized neurodevelopment may therefore be a feature of ASD, affecting widespread brain regions with diverse functions. Large-scale analysis was necessary to quantify subtle alterations of brain structural asymmetry in ASD.

Cortical and Subcortical Brain Morphometry Differences Between Patients With Autism Spectrum Disorder and Healthy Individuals Across the Lifespan: Results From the ENIGMA ASD Working Group.

OBJECTIVE: Neuroimaging studies show structural differences in both cortical and subcortical brain regions in children and adults with autism spectrum disorder (ASD) compared with healthy subjects. Findings are inconsistent, however, and it is unclear how differences develop across the lifespan. The authors investigated brain morphometry differences between individuals with ASD and healthy subjects, cross-sectionally across the lifespan, in a large multinational sample from the Enhancing Neuroimaging Genetics Through Meta-Analysis (ENIGMA) ASD working group. METHOD: The sample comprised 1,571 patients with ASD and 1,651 healthy control subjects (age range, 2-64 years) from 49 participating sites. MRI scans were preprocessed at individual sites with a harmonized protocol based on a validated automated-segmentation software program. Mega-analyses were used to test for case-control differences in subcortical volumes, cortical thickness, and surface area. Development of brain morphometry over the lifespan was modeled using a fractional polynomial approach. RESULTS: The case-control mega-analysis demonstrated that ASD was associated with smaller subcortical volumes of the pallidum, putamen, amygdala, and nucleus accumbens (effect sizes [Cohen's d], 0.13 to -0.13), as well as increased cortical thickness in the frontal cortex and decreased thickness in the temporal cortex (effect sizes, -0.21 to 0.20). Analyses of age effects indicate that the development of cortical thickness is altered in ASD, with the largest differences occurring around adolescence. No age-by-ASD interactions were observed in the subcortical partitions. CONCLUSIONS: The ENIGMA ASD working group provides the largest study of brain morphometry differences in ASD to date, using a well-established, validated, publicly available analysis pipeline. ASD patients showed altered morphometry in the cognitive and affective parts of the striatum, frontal cortex, and temporal cortex. Complex developmental trajectories were observed for the different regions, with a developmental peak around adolescence. These findings suggest an interplay in the abnormal development of the striatal, frontal, and temporal regions in ASD across the lifespan.

Effector-Invariant Movement Encoding in the Human Motor System.

Ipsilateral motor areas of cerebral cortex are active during arm movements and even reliably predict movement direction. Is coding similar during ipsilateral and contralateral movements? If so, is it in extrinsic (world-centered) or intrinsic (joint-configuration) coordinates? We addressed these questions by examining the similarity of multivoxel fMRI patterns in visuomotor cortical regions during unilateral reaching movements with both arms. The results of three complementary analyses revealed that fMRI response patterns were similar across right and left arm movements to identical targets (extrinsic coordinates) in visual cortices, and across movements with equivalent joint-angles (intrinsic coordinates) in motor cortices. We interpret this as evidence for the existence of distributed neural populations in multiple motor system areas that encode ipsilateral and contralateral movements in a similar manner: according to their intrinsic/joint coordinates.SIGNIFICANCE STATEMENT Cortical motor control exhibits clear lateralization: each hemisphere controls the motor output of the contralateral body. Nevertheless, neural populations in ipsilateral areas across the visuomotor hierarchy are active during unilateral movements. We show that fMRI response patterns in the motor cortices are similar for both arms if the movement direction is mirror-reversed across the midline. This suggests that in both ipsilateral and contralateral motor cortices, neural populations have effector-invariant coding of movements in intrinsic coordinates. This not only affects our understanding of motor control, it may serve in the development of brain machine interfaces that also use ipsilateral neural activity.