Digital endpoints in clinical trials: emerging themes from a multi-stakeholder Knowledge Exchange event.

BACKGROUND: Digital technologies, such as wearable devices and smartphone applications (apps), can enable the decentralisation of clinical trials by measuring endpoints in people's chosen locations rather than in traditional clinical settings. Digital endpoints can allow high-frequency and sensitive measurements of health outcomes compared to visit-based endpoints which provide an episodic snapshot of a person's health. However, there are underexplored challenges in this emerging space that require interdisciplinary and cross-sector collaboration. A multi-stakeholder Knowledge Exchange event was organised to facilitate conversations across silos within this research ecosystem. METHODS: A survey was sent to an initial list of stakeholders to identify potential discussion topics. Additional stakeholders were identified through iterative discussions on perspectives that needed representation. Co-design meetings with attendees were held to discuss the scope, format and ethos of the event. The event itself featured a cross-disciplinary selection of talks, a panel discussion, small-group discussions facilitated via a rolling seating plan and audience participation via Slido. A transcript was generated from the day, which, together with the output from Slido, provided a record of the day's discussions. Finally, meetings were held following the event to identify the key challenges for digital endpoints which emerged and reflections and recommendations for dissemination. RESULTS: Several challenges for digital endpoints were identified in the following areas: patient adherence and acceptability; algorithms and software for devices; design, analysis and conduct of clinical trials with digital endpoints; the environmental impact of digital endpoints; and the need for ongoing ethical support. Learnings taken for next generation events include the need to include additional stakeholder perspectives, such as those of funders and regulators, and the need for additional resources and facilitation to allow patient and public contributors to engage meaningfully during the event. CONCLUSIONS: The event emphasised the importance of consortium building and highlighted the critical role that collaborative, multi-disciplinary, and cross-sector efforts play in driving innovation in research design and strategic partnership building moving forward. This necessitates enhanced recognition by funders to support multi-stakeholder projects with patient involvement, standardised terminology, and the utilisation of open-source software.

Evaluation of walking activity and gait to identify physical and mental fatigue in neurodegenerative and immune disorders: preliminary insights from the IDEA-FAST feasibility study.

BACKGROUND: Many individuals with neurodegenerative (NDD) and immune-mediated inflammatory disorders (IMID) experience debilitating fatigue. Currently, assessments of fatigue rely on patient reported outcomes (PROs), which are subjective and prone to recall biases. Wearable devices, however, provide objective and reliable estimates of gait, an essential component of health, and may present objective evidence of fatigue. This study explored the relationships between gait characteristics derived from an inertial measurement unit (IMU) and patient-reported fatigue in the IDEA-FAST feasibility study. METHODS: Participants with IMIDs and NDDs (Parkinson's disease (PD), Huntington's disease (HD), rheumatoid arthritis (RA), systemic lupus erythematosus (SLE), primary Sjogren's syndrome (PSS), and inflammatory bowel disease (IBD)) wore a lower-back IMU continuously for up to 10 days at home. Concurrently, participants completed PROs (physical fatigue (PF) and mental fatigue (MF)) up to four times a day. Macro (volume, variability, pattern, and acceleration vector magnitude) and micro (pace, rhythm, variability, asymmetry, and postural control) gait characteristics were extracted from the accelerometer data. The associations of these measures with the PROs were evaluated using a generalised linear mixed-effects model (GLMM) and binary classification with machine learning. RESULTS: Data were recorded from 72 participants: PD = 13, HD = 9, RA = 12, SLE = 9, PSS = 14, IBD = 15. For the GLMM, the variability of the non-walking bouts length (in seconds) with PF returned the highest conditional R2, 0.165, and with MF the highest marginal R2, 0.0018. For the machine learning classifiers, the highest accuracy of the current analysis was returned by the micro gait characteristics with an intrasubject cross validation method and MF as 56.90% (precision = 43.9%, recall = 51.4%). Overall, the acceleration vector magnitude, bout length variation, postural control, and gait rhythm were the most interesting characteristics for future analysis. CONCLUSIONS: Counterintuitively, the outcomes indicate that there is a weak relationship between typical gait measures and abnormal fatigue. However, factors such as the COVID-19 pandemic may have impacted gait behaviours. Therefore, further investigations with a larger cohort are required to fully understand the relationship between gait and abnormal fatigue.

Identification of Fatigue and Sleepiness in Immune and Neurodegenerative Disorders from Measures of Real-World Gait Variability.

Current assessments of fatigue and sleepiness rely on patient reported outcomes (PROs), which are subjective and prone to recall bias. The current study investigated the use of gait variability in the "real world" to identify patient fatigue and daytime sleepiness. Inertial measurement units were worn on the lower backs of 159 participants (117 with six different immune and neurodegenerative disorders and 42 healthy controls) for up to 20 days, whom completed regular PROs. To address walking bouts that were short and sparse, four feature groups were considered: sequence-independent variability (SIV), sequence-dependant variability (SDV), padded SDV (PSDV), and typical gait variability (TGV) measures. These gait variability measures were extracted from step, stride, stance, and swing time, step length, and step velocity. These different approaches were compared using correlations and four machine learning classifiers to separate low/high fatigue and sleepiness.Most balanced accuracies were above 50%, the highest was 57.04% from TGV measures. The strongest correlation was 0.262 from an SDV feature against sleepiness. Overall, TGV measures had lower correlations and classification accuracies.Identifying fatigue or sleepiness from gait variability is extremely complex and requires more investigation with a larger data set, but these measures have shown performances that could contribute to a larger feature set.Clinical relevance- Gait variability has been repeatedly used to assess fatigue in the lab. The current study, however, explores gait variability for fatigue and daytime sleepiness in real-world scenarios with multiple gait-impacted disorders.

Electroencephalogram Connectivity for the Diagnosis of Psychogenic Non-epileptic Seizures.

Psychogenic non-epileptic seizures (PNES) are attacks that resemble epilepsy but are not associated with epileptic brain activity and are regularly misdiagnosed. The current gold standard method of diagnosis is expensive and complex. Electroencephalogram (EEG) analysis with machine learning could improve this. A k-nearest neighbours (kNN) and support vector machine (SVM) were used to classify EEG connectivity measures from 48 patients with PNES and 29 patients with epilepsy. The synchronisation method - correlation or coherence - and the binarisation threshold were defined through experimentation. Ten network parameters were extracted from the synchronisation matrix. The broad, delta, theta, alpha, beta, gamma, and combined 'all' frequency bands were compared along with three feature selection methods: the full feature set (no selection), light gradient boosting machine (LGBM) and k-Best. Coherence was the highest performing synchronisation method and 0.6 was the best coherence threshold. The highest balanced accuracy was 89.74%, produced by combining all six frequency bands and selecting features with LGBM, classified by the SVM. This method returned a comparatively high accuracy but at a high computation cost. Future research should focus on identifying specific frequency bands and network parameters to reduce this cost. Clinical relevance - This study found that EEG connectivity and machine learning methods can be used to differentiate PNES from epilepsy using interictal recordings to a high accuracy. Thus, this method could be an effective tool in assisting clinicians in PNES diagnosis without a video- EEG recording of a habitual seizure.

Entropy Measures of Electroencephalograms towards the Diagnosis of Psychogenic Non-Epileptic Seizures.

Psychogenic non-epileptic seizures (PNES) may resemble epileptic seizures but are not caused by epileptic activity. However, the analysis of electroencephalogram (EEG) signals with entropy algorithms could help identify patterns that differentiate PNES and epilepsy. Furthermore, the use of machine learning could reduce the current diagnosis costs by automating classification. The current study extracted the approximate sample, spectral, singular value decomposition, and Renyi entropies from interictal EEGs and electrocardiograms (ECG)s of 48 PNES and 29 epilepsy subjects in the broad, delta, theta, alpha, beta, and gamma frequency bands. Each feature-band pair was classified by a support vector machine (SVM), k-nearest neighbour (kNN), random forest (RF), and gradient boosting machine (GBM). In most cases, the broad band returned higher accuracy, gamma returned the lowest, and combining the six bands together improved classifier performance. The Renyi entropy was the best feature and returned high accuracy in every band. The highest balanced accuracy, 95.03%, was obtained by the kNN with Renyi entropy and combining all bands except broad. This analysis showed that entropy measures can differentiate between interictal PNES and epilepsy with high accuracy, and improved performances indicate that combining bands is an effective improvement for diagnosing PNES from EEGs and ECGs.