A generalizable speech emotion recognition model reveals depression and remission.

OBJECTIVE: Affective disorders are associated with atypical voice patterns; however, automated voice analyses suffer from small sample sizes and untested generalizability on external data. We investigated a generalizable approach to aid clinical evaluation of depression and remission from voice using transfer learning: We train machine learning models on easily accessible non-clinical datasets and test them on novel clinical data in a different language. METHODS: A Mixture of Experts machine learning model was trained to infer happy/sad emotional state using three publicly available emotional speech corpora in German and US English. We examined the model's predictive ability to classify the presence of depression on Danish speaking healthy controls (N = 42), patients with first-episode major depressive disorder (MDD) (N = 40), and the subset of the same patients who entered remission (N = 25) based on recorded clinical interviews. The model was evaluated on raw, de-noised, and speaker-diarized data. RESULTS: The model showed separation between healthy controls and depressed patients at the first visit, obtaining an AUC of 0.71. Further, speech from patients in remission was indistinguishable from that of the control group. Model predictions were stable throughout the interview, suggesting that 20-30 s of speech might be enough to accurately screen a patient. Background noise (but not speaker diarization) heavily impacted predictions. CONCLUSION: A generalizable speech emotion recognition model can effectively reveal changes in speaker depressive states before and after remission in patients with MDD. Data collection settings and data cleaning are crucial when considering automated voice analysis for clinical purposes.

A Remote Digital Monitoring Platform to Assess Cognitive and Motor Symptoms in Huntington Disease: Cross-sectional Validation Study.

BACKGROUND: Remote monitoring of Huntington disease (HD) signs and symptoms using digital technologies may enhance early clinical diagnosis and tracking of disease progression, guide treatment decisions, and monitor response to disease-modifying agents. Several recent studies in neurodegenerative diseases have demonstrated the feasibility of digital symptom monitoring. OBJECTIVE: The aim of this study was to evaluate a novel smartwatch- and smartphone-based digital monitoring platform to remotely monitor signs and symptoms of HD. METHODS: This analysis aimed to determine the feasibility and reliability of the Roche HD Digital Monitoring Platform over a 4-week period and cross-sectional validity over a 2-week interval. Key criteria assessed were feasibility, evaluated by adherence and quality control failure rates; test-retest reliability; known-groups validity; and convergent validity of sensor-based measures with existing clinical measures. Data from 3 studies were used: the predrug screening phase of an open-label extension study evaluating tominersen (NCT03342053) and 2 untreated cohorts-the HD Natural History Study (NCT03664804) and the Digital-HD study. Across these studies, controls (n=20) and individuals with premanifest (n=20) or manifest (n=179) HD completed 6 motor and 2 cognitive tests at home and in the clinic. RESULTS: Participants in the open-label extension study, the HD Natural History Study, and the Digital-HD study completed 89.95% (1164/1294), 72.01% (2025/2812), and 68.98% (1454/2108) of the active tests, respectively. All sensor-based features showed good to excellent test-retest reliability (intraclass correlation coefficient 0.89-0.98) and generally low quality control failure rates. Good overall convergent validity of sensor-derived features to Unified HD Rating Scale outcomes and good overall known-groups validity among controls, premanifest, and manifest participants were observed. Among participants with manifest HD, the digital cognitive tests demonstrated the strongest correlations with analogous in-clinic tests (Pearson correlation coefficient 0.79-0.90). CONCLUSIONS: These results show the potential of the HD Digital Monitoring Platform to provide reliable, valid, continuous remote monitoring of HD symptoms, facilitating the evaluation of novel treatments and enhanced clinical monitoring and care for individuals with HD.

Evaluation of smartphone-based testing to generate exploratory outcome measures in a phase 1 Parkinson's disease clinical trial.

BACKGROUND: Ubiquitous digital technologies such as smartphone sensors promise to fundamentally change biomedical research and treatment monitoring in neurological diseases such as PD, creating a new domain of digital biomarkers. OBJECTIVES: The present study assessed the feasibility, reliability, and validity of smartphone-based digital biomarkers of PD in a clinical trial setting. METHODS: During a 6-month, phase 1b clinical trial with 44 Parkinson participants, and an independent, 45-day study in 35 age-matched healthy controls, participants completed six daily motor active tests (sustained phonation, rest tremor, postural tremor, finger-tapping, balance, and gait), then carried the smartphone during the day (passive monitoring), enabling assessment of, for example, time spent walking and sit-to-stand transitions by gyroscopic and accelerometer data. RESULTS: Adherence was acceptable: Patients completed active testing on average 3.5 of 7 times/week. Sensor-based features showed moderate-to-excellent test-retest reliability (average intraclass correlation coefficient = 0.84). All active and passive features significantly differentiated PD from controls with P < 0.005. All active test features except sustained phonation were significantly related to corresponding International Parkinson and Movement Disorder Society-Sponsored UPRDS clinical severity ratings. On passive monitoring, time spent walking had a significant (P = 0.005) relationship with average postural instability and gait disturbance scores. Of note, for all smartphone active and passive features except postural tremor, the monitoring procedure detected abnormalities even in those Parkinson participants scored as having no signs in the corresponding International Parkinson and Movement Disorder Society-Sponsored UPRDS items at the site visit. CONCLUSIONS: These findings demonstrate the feasibility of smartphone-based digital biomarkers and indicate that smartphone-sensor technologies provide reliable, valid, clinically meaningful, and highly sensitive phenotypic data in Parkinson's disease. © 2018 The Authors. Movement Disorders published by Wiley Periodicals, Inc. on behalf of International Parkinson and Movement Disorder Society.

Digital measures of respiratory and upper limb function in spinal muscular atrophy: design, feasibility, reliability, and preliminary validity of a smartphone sensor-based assessment suite.

Spinal muscular atrophy (SMA) is characterized by progressive muscle weakness and paralysis. Motor function is monitored in the clinical setting using assessments including the 32-item Motor Function Measure (MFM-32), but changes in disease severity between clinical visits may be missed. Digital health technologies may assist evaluation of disease severity by bridging gaps between clinical visits. We developed a smartphone sensor-based assessment suite, comprising nine tasks, to assess motor and muscle function in people with SMA. We used data from the risdiplam phase 2 JEWELFISH trial to assess the test-retest reliability and convergent validity of each task. In the first 6 weeks, 116 eligible participants completed assessments on a median of 6.3 days per week. Eight of the nine tasks demonstrated good or excellent test-retest reliability (intraclass correlation coefficients >0.75 and >0.9, respectively). Seven tasks showed a significant association (P < 0.05) with related clinical measures of motor function (individual items from the MFM-32 or Revised Upper Limb Module scales) and seven showed significant association (P < 0.05) with disease severity measured using the MFM-32 total score. This cross-sectional study supports the feasibility, reliability, and validity of using smartphone-based digital assessments to measure function in people living with SMA.

Reliability and validity of the Roche PD Mobile Application for remote monitoring of early Parkinson's disease.

Digital health technologies enable remote and therefore frequent measurement of motor signs, potentially providing reliable and valid estimates of motor sign severity and progression in Parkinson's disease (PD). The Roche PD Mobile Application v2 was developed to measure bradykinesia, bradyphrenia and speech, tremor, gait and balance. It comprises 10 smartphone active tests (with ½ tests administered daily), as well as daily passive monitoring via a smartphone and smartwatch. It was studied in 316 early-stage PD participants who performed daily active tests at home then carried a smartphone and wore a smartwatch throughout the day for passive monitoring (study NCT03100149). Here, we report baseline data. Adherence was excellent (96.29%). All pre-specified sensor features exhibited good-to-excellent test-retest reliability (median intraclass correlation coefficient = 0.9), and correlated with corresponding Movement Disorder Society-Unified Parkinson's Disease Rating Scale items (rho: 0.12-0.71). These findings demonstrate the preliminary reliability and validity of remote at-home quantification of motor sign severity with the Roche PD Mobile Application v2 in individuals with early PD.

A machine learning perspective on the emotional content of Parkinsonian speech.

Patients with Parkinson's disease (PD) have distinctive voice patterns, often perceived as expressing sad emotion. While this characteristic of Parkinsonian speech has been supported through the perspective of listeners, where both PD and healthy control (HC) subjects repeat the same speaking tasks, it has never been explored through a machine learning modelling approach. Our work provides an objective evaluation of this characteristic of the PD speech, by building a transfer learning system to assess how the PD pathology affects the sadness perception. To do so we introduce a Mixture-of-Experts (MoE) architecture for speech emotion recognition designed to be transferable across datasets. Firstly, by relying on publicly available emotional speech corpora, we train the MoE model and then we use it to quantify perceived sadness in never seen before PD and matched HC speech recordings. To build our models (experts), we extracted spectral features of the voicing parts of speech and we trained a gradient boosting decision trees model in each corpus to predict happiness vs. sadness. MoE predictions are created by weighting each expert's prediction according to the distance between the new sample and the expert-specific training samples. The MoE approach systematically infers more negative emotional characteristics in PD speech than in HC. Crucially, these judgments are related to the disease severity and the severity of speech impairment in the PD patients: the more impairment, the more likely the speech is to be judged as sad. Our findings pave the way towards a better understanding of the characteristics of PD speech and show how publicly available datasets can be used to train models that provide interesting insights on clinical data.

An Objective and Child-friendly Assessment of Arm Function by Using a 3-D Sensor.

Progressive and irreversible muscle atrophy characterizes Spinal Muscular Atrophy (SMA) and other similar muscle disorder diseases. Objective assessment of muscle functions is an essential and important, although challenging, prerequisite for successful clinical trials. Current clinical rating scales restrain the movement abnormalities to certain predefined coarse-grained individual items. The Kinect 3-D sensor has emerged as a low-cost and portable motion sensing technology used to capture and track people's movement in many medical and research fields. A novel approach using this 3-D sensor was developed and a game-like test was designed to objectively measure the upper limb function of patients with SMA. The prototype test targeted joint movement capability. While sitting in a virtual scene, the patient was instructed to extend, flex, and lift the whole arm in order to reach and place some objects. Both kinematic and spatiotemporal characteristics of upper limb movement were extracted and analyzed, e.g., elbow extension and flexion angles, hand velocity, and acceleration. The first study included a small cohort of 18 ambulant SMA patients and 19 age- and gender-matched healthy controls. A comprehensive analysis of arm movement was achieved; however, no significant difference between the groups were found due to the mismatch of patient's capability and the test difficulty. Based on this experience, a second version of the test consisting of a modified version of the first game with increased difficulties and a second game targeting muscle endurance were designed and implemented. The new test has not been conducted in any patient groups yet. Our work has demonstrated the potential capability of the 3-D sensor in assessing such muscle function and suggested an objective approach to complement the clinical rating scales.

Feasibility of Using Microsoft Kinect to Assess Upper Limb Movement in Type III Spinal Muscular Atrophy Patients.

Although functional rating scales are being used increasingly as primary outcome measures in spinal muscular atrophy (SMA), sensitive and objective assessment of early-stage disease progression and drug efficacy remains challenging. We have developed a game based on the Microsoft Kinect sensor, specifically designed to measure active upper limb movement. An explorative study was conducted to determine the feasibility of this new tool in 18 ambulant SMA type III patients and 19 age- and gender-matched healthy controls. Upper limb movement was analysed elaborately through derived features such as elbow flexion and extension angles, arm lifting angle, velocity and acceleration. No significant differences were found in the active range of motion between ambulant SMA type III patients and controls. Hand velocity was found to be different but further validation is necessary. This study presents an important step in the process of designing and handling digital biomarkers as complementary outcome measures for clinical trials.