A wearable device perspective on the standard definitions of disability progression in multiple sclerosis.

INTRODUCTION: Multiple sclerosis (MS) is a leading cause of disability among young adults, but standard clinical scales may not accurately detect subtle changes in disability occurring between visits. This study aims to explore whether wearable device data provides more granular and objective measures of disability progression in MS. METHODS: Remote Assessment of Disease and Relapse in Central Nervous System Disorders (RADAR-CNS) is a longitudinal multicenter observational study in which 400 MS patients have been recruited since June 2018 and prospectively followed up for 24 months. Monitoring of patients included standard clinical visits with assessment of disability through use of the Expanded Disability Status Scale (EDSS), 6-minute walking test (6MWT) and timed 25-foot walk (T25FW), as well as remote monitoring through the use of a Fitbit. RESULTS: Among the 306 patients who completed the study (mean age, 45.6 years; females 67%), confirmed disability progression defined by the EDSS was observed in 74 patients, who had approximately 1392 fewer daily steps than patients without disability progression. However, the decrease in the number of steps experienced over time by patients with EDSS progression and stable patients was not significantly different. Similar results were obtained with disability progression defined by the 6MWT and the T25FW. CONCLUSION: The use of continuous activity monitoring holds great promise as a sensitive and ecologically valid measure of disability progression in MS.

Characterising illness stages and recovery trajectories of eating disorders in young people via remote measurement technology (STORY): a multi-centre prospective cohort study protocol.

BACKGROUND: Eating disorders (EDs) are serious, often chronic, conditions associated with pronounced morbidity, mortality, and dysfunction increasingly affecting young people worldwide. Illness progression, stages and recovery trajectories of EDs are still poorly characterised. The STORY study dynamically and longitudinally assesses young people with different EDs (restricting; bingeing/bulimic presentations) and illness durations (earlier; later stages) compared to healthy controls. Remote measurement technology (RMT) with active and passive sensing is used to advance understanding of the heterogeneity of earlier and more progressed clinical presentations and predictors of recovery or relapse. METHODS: STORY follows 720 young people aged 16-25 with EDs and 120 healthy controls for 12 months. Online self-report questionnaires regularly assess ED symptoms, psychiatric comorbidities, quality of life, and socioeconomic environment. Additional ongoing monitoring using multi-parametric RMT via smartphones and wearable smart rings ('Oura ring') unobtrusively measures individuals' daily behaviour and physiology (e.g., Bluetooth connections, sleep, autonomic arousal). A subgroup of participants completes additional in-person cognitive and neuroimaging assessments at study-baseline and after 12 months. DISCUSSION: By leveraging these large-scale longitudinal data from participants across ED diagnoses and illness durations, the STORY study seeks to elucidate potential biopsychosocial predictors of outcome, their interplay with developmental and socioemotional changes, and barriers and facilitators of recovery. STORY holds the promise of providing actionable findings that can be translated into clinical practice by informing the development of both early intervention and personalised treatment that is tailored to illness stage and individual circumstances, ultimately disrupting the long-term burden of EDs on individuals and their families.

Data Visualization Preferences in Remote Measurement Technology for Individuals Living With Depression, Epilepsy, and Multiple Sclerosis: Qualitative Study.

BACKGROUND: Remote measurement technology (RMT) involves the use of wearable devices and smartphone apps to measure health outcomes in everyday life. RMT with feedback in the form of data visual representations can facilitate self-management of chronic health conditions, promote health care engagement, and present opportunities for intervention. Studies to date focus broadly on multiple dimensions of service users' design preferences and RMT user experiences (eg, health variables of perceived importance and perceived quality of medical advice provided) as opposed to data visualization preferences. OBJECTIVE: This study aims to explore data visualization preferences and priorities in RMT, with individuals living with depression, those with epilepsy, and those with multiple sclerosis (MS). METHODS: A triangulated qualitative study comparing and thematically synthesizing focus group discussions with user reviews of existing self-management apps and a systematic review of RMT data visualization preferences. A total of 45 people participated in 6 focus groups across the 3 health conditions (depression, n=17; epilepsy, n=11; and MS, n=17). RESULTS: Thematic analysis validated a major theme around design preferences and recommendations and identified a further four minor themes: (1) data reporting, (2) impact of visualization, (3) moderators of visualization preferences, and (4) system-related factors and features. CONCLUSIONS: When used effectively, data visualizations are valuable, engaging components of RMT. Easy to use and intuitive data visualization design was lauded by individuals with neurological and psychiatric conditions. Apps design needs to consider the unique requirements of service users. Overall, this study offers RMT developers a comprehensive outline of the data visualization preferences of individuals living with depression, epilepsy, and MS.

Longitudinal Assessment of Seasonal Impacts and Depression Associations on Circadian Rhythm Using Multimodal Wearable Sensing: Retrospective Analysis.

BACKGROUND: Previous mobile health (mHealth) studies have revealed significant links between depression and circadian rhythm features measured via wearables. However, the comprehensive impact of seasonal variations was not fully considered in these studies, potentially biasing interpretations in real-world settings. OBJECTIVE: This study aims to explore the associations between depression severity and wearable-measured circadian rhythms while accounting for seasonal impacts. METHODS: Data were sourced from a large longitudinal mHealth study, wherein participants' depression severity was assessed biweekly using the 8-item Patient Health Questionnaire (PHQ-8), and participants' behaviors, including sleep, step count, and heart rate (HR), were tracked via Fitbit devices for up to 2 years. We extracted 12 circadian rhythm features from the 14-day Fitbit data preceding each PHQ-8 assessment, including cosinor variables, such as HR peak timing (HR acrophase), and nonparametric features, such as the onset of the most active continuous 10-hour period (M10 onset). To investigate the association between depression severity and circadian rhythms while also assessing the seasonal impacts, we used three nested linear mixed-effects models for each circadian rhythm feature: (1) incorporating the PHQ-8 score as an independent variable, (2) adding seasonality, and (3) adding an interaction term between season and the PHQ-8 score. RESULTS: Analyzing 10,018 PHQ-8 records alongside Fitbit data from 543 participants (n=414, 76.2% female; median age 48, IQR 32-58 years), we found that after adjusting for seasonal effects, higher PHQ-8 scores were associated with reduced daily steps (ß=-93.61, P<.001), increased sleep variability (ß=0.96, P<.001), and delayed circadian rhythms (ie, sleep onset: ß=0.55, P=.001; sleep offset: ß=1.12, P<.001; M10 onset: ß=0.73, P=.003; HR acrophase: ß=0.71, P=.001). Notably, the negative association with daily steps was more pronounced in spring (ß of PHQ-8 × spring = -31.51, P=.002) and summer (ß of PHQ-8 × summer = -42.61, P<.001) compared with winter. Additionally, the significant correlation with delayed M10 onset was observed solely in summer (ß of PHQ-8 × summer = 1.06, P=.008). Moreover, compared with winter, participants experienced a shorter sleep duration by 16.6 minutes, an increase in daily steps by 394.5, a delay in M10 onset by 20.5 minutes, and a delay in HR peak time by 67.9 minutes during summer. CONCLUSIONS: Our findings highlight significant seasonal influences on human circadian rhythms and their associations with depression, underscoring the importance of considering seasonal variations in mHealth research for real-world applications. This study also indicates the potential of wearable-measured circadian rhythms as digital biomarkers for depression.

Challenges in Using mHealth Data From Smartphones and Wearable Devices to Predict Depression Symptom Severity: Retrospective Analysis.

BACKGROUND: Major depressive disorder (MDD) affects millions of people worldwide, but timely treatment is not often received owing in part to inaccurate subjective recall and variability in the symptom course. Objective and frequent MDD monitoring can improve subjective recall and help to guide treatment selection. Attempts have been made, with varying degrees of success, to explore the relationship between the measures of depression and passive digital phenotypes (features) extracted from smartphones and wearables devices to remotely and continuously monitor changes in symptomatology. However, a number of challenges exist for the analysis of these data. These include maintaining participant engagement over extended time periods and therefore understanding what constitutes an acceptable threshold of missing data; distinguishing between the cross-sectional and longitudinal relationships for different features to determine their utility in tracking within-individual longitudinal variation or screening individuals at high risk; and understanding the heterogeneity with which depression manifests itself in behavioral patterns quantified by the passive features. OBJECTIVE: We aimed to address these 3 challenges to inform future work in stratified analyses. METHODS: Using smartphone and wearable data collected from 479 participants with MDD, we extracted 21 features capturing mobility, sleep, and smartphone use. We investigated the impact of the number of days of available data on feature quality using the intraclass correlation coefficient and Bland-Altman analysis. We then examined the nature of the correlation between the 8-item Patient Health Questionnaire (PHQ-8) depression scale (measured every 14 days) and the features using the individual-mean correlation, repeated measures correlation, and linear mixed effects model. Furthermore, we stratified the participants based on their behavioral difference, quantified by the features, between periods of high (depression) and low (no depression) PHQ-8 scores using the Gaussian mixture model. RESULTS: We demonstrated that at least 8 (range 2-12) days were needed for reliable calculation of most of the features in the 14-day time window. We observed that features such as sleep onset time correlated better with PHQ-8 scores cross-sectionally than longitudinally, whereas features such as wakefulness after sleep onset correlated well with PHQ-8 longitudinally but worse cross-sectionally. Finally, we found that participants could be separated into 3 distinct clusters according to their behavioral difference between periods of depression and periods of no depression. CONCLUSIONS: This work contributes to our understanding of how these mobile health-derived features are associated with depression symptom severity to inform future work in stratified analyses.

Automatic Assessment of the 2-Minute Walk Distance for Remote Monitoring of People with Multiple Sclerosis.

The aim of this study was to investigate the feasibility of automatically assessing the 2-Minute Walk Distance (2MWD) for monitoring people with multiple sclerosis (pwMS). For 154 pwMS, MS-related clinical outcomes as well as the 2MWDs as evaluated by clinicians and derived from accelerometer data were collected from a total of 323 periodic clinical visits. Accelerometer data from a wearable device during 100 home-based 2MWD assessments were also acquired. The error in estimating the 2MWD was validated for walk tests performed at hospital, and then the correlation (r) between clinical outcomes and home-based 2MWD assessments was evaluated. Robust performance in estimating the 2MWD from the wearable device was obtained, yielding an error of less than 10% in about two-thirds of clinical visits. Correlation analysis showed that there is a strong association between the actual and the estimated 2MWD obtained either at hospital (r = 0.71) or at home (r = 0.58). Furthermore, the estimated 2MWD exhibits moderate-to-strong correlation with various MS-related clinical outcomes, including disability and fatigue severity scores. Automatic assessment of the 2MWD in pwMS is feasible with the usage of a consumer-friendly wearable device in clinical and non-clinical settings. Wearable devices can also enhance the assessment of MS-related clinical outcomes.

Fitbeat: COVID-19 estimation based on wristband heart rate using a contrastive convolutional auto-encoder.

This study proposes a contrastive convolutional auto-encoder (contrastive CAE), a combined architecture of an auto-encoder and contrastive loss, to identify individuals with suspected COVID-19 infection using heart-rate data from participants with multiple sclerosis (MS) in the ongoing RADAR-CNS mHealth research project. Heart-rate data was remotely collected using a Fitbit wristband. COVID-19 infection was either confirmed through a positive swab test, or inferred through a self-reported set of recognised symptoms of the virus. The contrastive CAE outperforms a conventional convolutional neural network (CNN), a long short-term memory (LSTM) model, and a convolutional auto-encoder without contrastive loss (CAE). On a test set of 19 participants with MS with reported symptoms of COVID-19, each one paired with a participant with MS with no COVID-19 symptoms, the contrastive CAE achieves an unweighted average recall of 95.3 % , a sensitivity of 100 % and a specificity of 90.6 % , an area under the receiver operating characteristic curve (AUC-ROC) of 0.944, indicating a maximum successful detection of symptoms in the given heart rate measurement period, whilst at the same time keeping a low false alarm rate.

Automatic Emotion Recognition in Children with Autism: A Systematic Literature Review.

The automatic emotion recognition domain brings new methods and technologies that might be used to enhance therapy of children with autism. The paper aims at the exploration of methods and tools used to recognize emotions in children. It presents a literature review study that was performed using a systematic approach and PRISMA methodology for reporting quantitative and qualitative results. Diverse observation channels and modalities are used in the analyzed studies, including facial expressions, prosody of speech, and physiological signals. Regarding representation models, the basic emotions are the most frequently recognized, especially happiness, fear, and sadness. Both single-channel and multichannel approaches are applied, with a preference for the first one. For multimodal recognition, early fusion was the most frequently applied. SVM and neural networks were the most popular for building classifiers. Qualitative analysis revealed important clues on participant group construction and the most common combinations of modalities and methods. All channels are reported to be prone to some disturbance, and as a result, information on a specific symptoms of emotions might be temporarily or permanently unavailable. The challenges of proper stimuli, labelling methods, and the creation of open datasets were also identified.

Investigating the impact of COVID-19 lockdown on adults with a recent history of recurrent major depressive disorder: a multi-Centre study using remote measurement technology.

BACKGROUND: The outbreak of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), which causes a clinical illness Covid-19, has had a major impact on mental health globally. Those diagnosed with major depressive disorder (MDD) may be negatively impacted by the global pandemic due to social isolation, feelings of loneliness or lack of access to care. This study seeks to assess the impact of the 1st lockdown - pre-, during and post - in adults with a recent history of MDD across multiple centres. METHODS: This study is a secondary analysis of an on-going cohort study, RADAR-MDD project, a multi-centre study examining the use of remote measurement technology (RMT) in monitoring MDD. Self-reported questionnaire and passive data streams were analysed from participants who had joined the project prior to 1st December 2019 and had completed Patient Health and Self-esteem Questionnaires during the pandemic (n = 252). We used mixed models for repeated measures to estimate trajectories of depressive symptoms, self-esteem, and sleep duration. RESULTS: In our sample of 252 participants, 48% (n = 121) had clinically relevant depressive symptoms shortly before the pandemic. For the sample as a whole, we found no evidence that depressive symptoms or self-esteem changed between pre-, during- and post-lockdown. However, we found evidence that mean sleep duration (in minutes) decreased significantly between during- and post- lockdown (- 12.16; 95% CI - 18.39 to - 5.92; p <  0.001). We also found that those experiencing clinically relevant depressive symptoms shortly before the pandemic showed a decrease in depressive symptoms, self-esteem and sleep duration between pre- and during- lockdown (interaction p = 0.047, p = 0.045 and p <  0.001, respectively) as compared to those who were not. CONCLUSIONS: We identified changes in depressive symptoms and sleep duration over the course of lockdown, some of which varied according to whether participants were experiencing clinically relevant depressive symptoms shortly prior to the pandemic. However, the results of this study suggest that those with MDD do not experience a significant worsening in symptoms during the first months of the Covid - 19 pandemic.

Real-time assessment of COVID-19 prevalence among multiple sclerosis patients: a multicenter European study.

We assessed the prevalence and impact of COVID-19 among multiple sclerosis (MS) patients across Europe by leveraging participant data collected as part of the ongoing EU IMI2 RADAR-CNS major programme aimed at finding new ways of monitoring neurological disorders using wearable devices and smartphone technology. In the present study, 399 patients of RADAR-MS have been included (mean age 43.9 years, 60.7% females) with 87/399 patients (21.8%) reporting major symptoms suggestive of COVID-19. A trend for an increased risk of COVID-19 symptoms under alemtuzumab and cladribine treatments in comparison to injectables was observed. Remote monitoring technologies may support health authorities in monitoring and containing the ongoing pandemic.

Using Smartphones and Wearable Devices to Monitor Behavioral Changes During COVID-19.

BACKGROUND: In the absence of a vaccine or effective treatment for COVID-19, countries have adopted nonpharmaceutical interventions (NPIs) such as social distancing and full lockdown. An objective and quantitative means of passively monitoring the impact and response of these interventions at a local level is needed. OBJECTIVE: We aim to explore the utility of the recently developed open-source mobile health platform Remote Assessment of Disease and Relapse (RADAR)-base as a toolbox to rapidly test the effect and response to NPIs intended to limit the spread of COVID-19. METHODS: We analyzed data extracted from smartphone and wearable devices, and managed by the RADAR-base from 1062 participants recruited in Italy, Spain, Denmark, the United Kingdom, and the Netherlands. We derived nine features on a daily basis including time spent at home, maximum distance travelled from home, the maximum number of Bluetooth-enabled nearby devices (as a proxy for physical distancing), step count, average heart rate, sleep duration, bedtime, phone unlock duration, and social app use duration. We performed Kruskal-Wallis tests followed by post hoc Dunn tests to assess differences in these features among baseline, prelockdown, and during lockdown periods. We also studied behavioral differences by age, gender, BMI, and educational background. RESULTS: We were able to quantify expected changes in time spent at home, distance travelled, and the number of nearby Bluetooth-enabled devices between prelockdown and during lockdown periods (P<.001 for all five countries). We saw reduced sociality as measured through mobility features and increased virtual sociality through phone use. People were more active on their phones (P<.001 for Italy, Spain, and the United Kingdom), spending more time using social media apps (P<.001 for Italy, Spain, the United Kingdom, and the Netherlands), particularly around major news events. Furthermore, participants had a lower heart rate (P<.001 for Italy and Spain; P=.02 for Denmark), went to bed later (P<.001 for Italy, Spain, the United Kingdom, and the Netherlands), and slept more (P<.001 for Italy, Spain, and the United Kingdom). We also found that young people had longer homestay than older people during the lockdown and fewer daily steps. Although there was no significant difference between the high and low BMI groups in time spent at home, the low BMI group walked more. CONCLUSIONS: RADAR-base, a freely deployable data collection platform leveraging data from wearables and mobile technologies, can be used to rapidly quantify and provide a holistic view of behavioral changes in response to public health interventions as a result of infectious outbreaks such as COVID-19. RADAR-base may be a viable approach to implementing an early warning system for passively assessing the local compliance to interventions in epidemics and pandemics, and could help countries ease out of lockdown.

Speech analysis for health: Current state-of-the-art and the increasing impact of deep learning.

Due to the complex and intricate nature associated with their production, the acoustic-prosodic properties of a speech signal are modulated with a range of health related effects. There is an active and growing area of machine learning research in this speech and health domain, focusing on developing paradigms to objectively extract and measure such effects. Concurrently, deep learning is transforming intelligent signal analysis, such that machines are now reaching near human capabilities in a range of recognition and analysis tasks. Herein, we review current state-of-the-art approaches with speech-based health detection, placing a particular focus on the impact of deep learning within this domain. Based on this overview, it is evident while that deep learning based solutions be become more present in the literature, it has not had the same overall dominating effect seen in other related fields. In this regard, we suggest some possible research directions aimed at fully leveraging the advantages that deep learning can offer speech-based health detection.

Emotional expression in psychiatric conditions: New technology for clinicians.

AIM: Emotional expressions are one of the most widely studied topics in neuroscience, from both clinical and non-clinical perspectives. Atypical emotional expressions are seen in various psychiatric conditions, including schizophrenia, depression, and autism spectrum conditions. Understanding the basics of emotional expressions and recognition can be crucial for diagnostic and therapeutic procedures. Emotions can be expressed in the face, gesture, posture, voice, and behavior and affect physiological parameters, such as the heart rate or body temperature. With modern technology, clinicians can use a variety of tools ranging from sophisticated laboratory equipment to smartphones and web cameras. The aim of this paper is to review the currently used tools using modern technology and discuss their usefulness as well as possible future directions in emotional expression research and treatment strategies. METHODS: The authors conducted a literature review in the PubMed, EBSCO, and SCOPUS databases, using the following key words: 'emotions,' 'emotional expression,' 'affective computing,' and 'autism.' The most relevant and up-to-date publications were identified and discussed. Search results were supplemented by the authors' own research in the field of emotional expression. RESULTS: We present a critical review of the currently available technical diagnostic and therapeutic methods. The most important studies are summarized in a table. CONCLUSION: Most of the currently available methods have not been adequately validated in clinical settings. They may be a great help in everyday practice; however, they need further testing. Future directions in this field include more virtual-reality-based and interactive interventions, as well as development and improvement of humanoid robots.

Automatic detection of expressed emotion from Five-Minute Speech Samples: Challenges and opportunities.

Research into clinical applications of speech-based emotion recognition (SER) technologies has been steadily increasing over the past few years. One such potential application is the automatic recognition of expressed emotion (EE) components within family environments. The identification of EE is highly important as they have been linked with a range of adverse life events. Manual coding of these events requires time-consuming specialist training, amplifying the need for automated approaches. Herein we describe an automated machine learning approach for determining the degree of warmth, a key component of EE, from acoustic and text natural language features. Our dataset of 52 recorded interviews is taken from recordings, collected over 20 years ago, from a nationally representative birth cohort of British twin children, and was manually coded for EE by two researchers (inter-rater reliability 0.84-0.90). We demonstrate that the degree of warmth can be predicted with an F1-score of 64.7% despite working with audio recordings of highly variable quality. Our highly promising results suggest that machine learning may be able to assist in the coding of EE in the near future.

Towards a scalable approach to assess speech organization across the psychosis-spectrum -online assessment in conjunction with automated transcription and extraction of speech measures.

Automatically extracted measures of speech constitute a promising marker of psychosis as disorganized speech is associated with psychotic symptoms and predictive of psychosis-onset. The potential of speech markers is, however, hampered by (i) lengthy assessments in laboratory settings and (ii) manual transcriptions. We investigated whether a short, scalable data collection (online) and processing (automated transcription) procedure would provide data of sufficient quality to extract previously validated speech measures. To evaluate the fit of our approach for purpose, we assessed speech in relation to psychotic-like experiences in the general population. Participants completed an 8-minute-long speech task online. Sample 1 included measures of psychometric schizotypy and delusional ideation (N = 446). Sample 2 included a low and high psychometric schizotypy group (N = 144). Recordings were transcribed both automatically and manually, and connectivity, semantic, and syntactic speech measures were extracted for both types of transcripts. 73%/86% participants in sample 1/2 completed the experiment. Nineteen out of 25 speech measures were strongly (r > 0.7) and significantly correlated between automated and manual transcripts in both samples. Amongst the 14 connectivity measures, 11 showed a significant relationship with delusional ideation. For the semantic and syntactic measures, On Topic score and the Frequency of personal pronouns were negatively correlated with both schizotypy and delusional ideation. Combined with demographic information, the speech markers could explain 11-14% of the variation of delusional ideation and schizotypy in Sample 1 and could discriminate between high-low schizotypy with high accuracy (0.72-0.70, AUC = 0.78-0.79) in Sample 2. The moderate to high retention rate, strong correlation of speech measures across manual and automated transcripts and sensitivity to psychotic-like experiences provides initial evidence that online collected speech in combination with automatic transcription is a feasible approach to increase accessibility and scalability of speech-based assessment of psychosis.

Physiological presentation and risk factors of long COVID in the UK using smartphones and wearable devices: a longitudinal, citizen science, case-control study.

BACKGROUND: The emergence of long COVID as a COVID-19 sequela was largely syndromic in characterisation. Digital health technologies such as wearable devices open the possibility to study this condition with passive, objective data in addition to self-reported symptoms. We aimed to quantify the prevalence and severity of symptoms across collected mobile health metrics over 12 weeks following COVID-19 diagnosis and to identify risk factors for the development of post-COVID-19 condition (also known as long COVID). METHODS: The Covid Collab study was a longitudinal, self-enrolled, community, case-control study. We recruited participants from the UK through a smartphone app, media publications, and promotion within the Fitbit app between Aug 28, 2020, and May 31, 2021. Adults (aged ≥18 years) who reported a COVID-19 diagnosis with a positive antigen or PCR test before Feb 1, 2022, were eligible for inclusion. We compared a cohort of 1200 patients who tested positive for COVID-19 with a cohort of 3600 sex-matched and age-matched controls without a COVID-19 diagnosis. Participants could provide information on COVID-19 symptoms and mental health through self-reported questionnaires (active data) and commercial wearable fitness devices (passive data). Data were compared between cohorts at three periods following diagnosis: acute COVID-19 (0-4 weeks), ongoing COVID-19 (4-12 weeks), and post-COVID-19 (12-16 weeks). We assessed sociodemographic and mobile health risk factors for the development of long COVID (defined as either a persistent change in a physiological signal or self-reported symptoms for ≥12 weeks after COVID-19 diagnosis). FINDINGS: By Aug 1, 2022, 17 667 participants had enrolled into the study, of whom 1200 (6·8%) cases and 3600 (20·4%) controls were included in the analyses. Compared with baseline (65 beats per min), resting heart rate increased significantly during the acute (0·47 beats per min; odds ratio [OR] 1·06 [95% CI 1·03-1·09]; p<0·0001), ongoing (0·99 beats per min; 1·11 [1·08-1·14]; p<0·0001), and post-COVID-19 (0·52 beats per min; 1·04 [1·02-1·07]; p=0·0017) phases. An increased level of historical activity in the period from 24 months to 6 months preceding COVID-19 diagnosis was protective against long COVID (coefficient -0·017 [95% CI -0·030 to -0·003]; p=0·015). Depressive symptoms were persistently elevated following COVID-19 (OR 1·03 [95% CI 1·01-1·06]; p=0·0033) and were a potential risk factor for developing long COVID (1·14 [1·07-1·22]; p<0·0001). INTERPRETATION: Mobile health technologies and commercial wearable devices might prove to be a useful resource for tracking recovery from COVID-19 and the prevalence of its long-term sequelae, as well as representing an abundant source of historical data. Mental wellbeing can be impacted negatively for an extended period following COVID-19. FUNDING: National Institute for Health and Care Research (NIHR), NIHR Maudsley Biomedical Research Centre, UK Research and Innovation, and Medical Research Council.

Identifying depression-related topics in smartphone-collected free-response speech recordings using an automatic speech recognition system and a deep learning topic model.

BACKGROUND: Prior research has associated spoken language use with depression, yet studies often involve small or non-clinical samples and face challenges in the manual transcription of speech. This paper aimed to automatically identify depression-related topics in speech recordings collected from clinical samples. METHODS: The data included 3919 English free-response speech recordings collected via smartphones from 265 participants with a depression history. We transcribed speech recordings via automatic speech recognition (Whisper tool, OpenAI) and identified principal topics from transcriptions using a deep learning topic model (BERTopic). To identify depression risk topics and understand the context, we compared participants' depression severity and behavioral (extracted from wearable devices) and linguistic (extracted from transcribed texts) characteristics across identified topics. RESULTS: From the 29 topics identified, we identified 6 risk topics for depression: 'No Expectations', 'Sleep', 'Mental Therapy', 'Haircut', 'Studying', and 'Coursework'. Participants mentioning depression risk topics exhibited higher sleep variability, later sleep onset, and fewer daily steps and used fewer words, more negative language, and fewer leisure-related words in their speech recordings. LIMITATIONS: Our findings were derived from a depressed cohort with a specific speech task, potentially limiting the generalizability to non-clinical populations or other speech tasks. Additionally, some topics had small sample sizes, necessitating further validation in larger datasets. CONCLUSION: This study demonstrates that specific speech topics can indicate depression severity. The employed data-driven workflow provides a practical approach for analyzing large-scale speech data collected from real-world settings.

Automated analysis of speech as a marker of sub-clinical psychotic experiences.

Automated speech analysis techniques, when combined with artificial intelligence and machine learning, show potential in capturing and predicting a wide range of psychosis symptoms, garnering attention from researchers. These techniques hold promise in predicting the transition to clinical psychosis from at-risk states, as well as relapse or treatment response in individuals with clinical-level psychosis. However, challenges in scientific validation hinder the translation of these techniques into practical applications. Although sub-clinical research could aid to tackle most of these challenges, there have been only few studies conducted in speech and psychosis research in non-clinical populations. This work aims to facilitate this work by summarizing automated speech analytical concepts and the intersection of this field with psychosis research. We review psychosis continuum and sub-clinical psychotic experiences, and the benefits of researching them. Then, we discuss the connection between speech and psychotic symptoms. Thirdly, we overview current and state-of-the art approaches to the automated analysis of speech both in terms of language use (text-based analysis) and vocal features (audio-based analysis). Then, we review techniques applied in subclinical population and findings in these samples. Finally, we discuss research challenges in the field, recommend future research endeavors and outline how research in subclinical populations can tackle the listed challenges.

Online speech assessment of the psychotic spectrum: Exploring the relationship between overlapping acoustic markers of schizotypy, depression and anxiety.

BACKGROUND: Remote assessment of acoustic alterations in speech holds promise to increase scalability and validity in research across the psychosis spectrum. A feasible first step in establishing a procedure for online assessments is to assess acoustic alterations in psychometric schizotypy. However, to date, the complex relationship between alterations in speech related to schizotypy and those related to comorbid conditions such as symptoms of depression and anxiety has not been investigated. This study tested whether (1) depression, generalized anxiety and high psychometric schizotypy have similar voice characteristics, (2) which acoustic markers of online collected speech are the strongest predictors of psychometric schizotypy, (3) whether including generalized anxiety and depression symptoms in the model can improve the prediction of schizotypy. METHODS: We collected cross-sectional, online-recorded speech data from 441 participants, assessing demographics, symptoms of depression, generalized anxiety and psychometric schizotypy. RESULTS: Speech samples collected online could predict psychometric schizotypy, depression, and anxiety symptoms with weak to moderate predictive power, and with moderate and good predictive power when basic demographic variables were added to the models. Most influential features of these models largely overlapped. The predictive power of speech marker-based models of schizotypy significantly improved after including symptom scores of depression and generalized anxiety in the models (from R2 = 0.296 to R2 = 0. 436). CONCLUSIONS: Acoustic features of online collected speech are predictive of psychometric schizotypy as well as generalized anxiety and depression symptoms. The acoustic characteristics of schizotypy, depression and anxiety symptoms significantly overlap. Speech models that are designed to predict schizotypy or symptoms of the schizophrenia spectrum might therefore benefit from controlling for symptoms of depression and anxiety.