Using Wearable Digital Devices to Screen Children for Mental Health Conditions: Ethical Promises and Challenges.

In response to a burgeoning pediatric mental health epidemic, recent guidelines have instructed pediatricians to regularly screen their patients for mental health disorders with consistency and standardization. Yet, gold-standard screening surveys to evaluate mental health problems in children typically rely solely on reports given by caregivers, who tend to unintentionally under-report, and in some cases over-report, child symptomology. Digital phenotype screening tools (DPSTs), currently being developed in research settings, may help overcome reporting bias by providing objective measures of physiology and behavior to supplement child mental health screening. Prior to their implementation in pediatric practice, however, the ethical dimensions of DPSTs should be explored. Herein, we consider some promises and challenges of DPSTs under three broad categories: accuracy and bias, privacy, and accessibility and implementation. We find that DPSTs have demonstrated accuracy, may eliminate concerns regarding under- and over-reporting, and may be more accessible than gold-standard surveys. However, we also find that if DPSTs are not responsibly developed and deployed, they may be biased, raise privacy concerns, and be cost-prohibitive. To counteract these potential shortcomings, we identify ways to support the responsible and ethical development of DPSTs for clinical practice to improve mental health screening in children.

Expecting the Unexpected: Predicting Panic Attacks From Mood, Twitter, and Apple Watch Data.

OBJECTIVE: Panic attacks are an impairing mental health problem that affects 11% of adults every year. Current criteria describe them as occurring without warning, despite evidence suggesting individuals can often identify attack triggers. We aimed to prospectively explore qualitative and quantitative factors associated with the onset of panic attacks. RESULTS: Of 87 participants, 95% retrospectively identified a trigger for their panic attacks. Worse individually reported mood and state-level mood, as indicated by Twitter ratings, were related to greater likelihood of next-day panic attack. In a subsample of participants who uploaded their wearable sensor data (n = 32), louder ambient noise and higher resting heart rate were related to greater likelihood of next-day panic attack. CONCLUSIONS: These promising results suggest that individuals who experience panic attacks may be able to anticipate their next attack which could be used to inform future prevention and intervention efforts.

The ChAMP App: A Scalable mHealth Technology for Detecting Digital Phenotypes of Early Childhood Mental Health.

Childhood mental health problems are common, impairing, and can become chronic if left untreated. Children are not reliable reporters of their emotional and behavioral health, and caregivers often unintentionally under- or over-report child symptoms, making assessment challenging. Objective physiological and behavioral measures of emotional and behavioral health are emerging. However, these methods typically require specialized equipment and expertise in data and sensor engineering to administer and analyze. To address this challenge, we have developed the ChAMP (Childhood Assessment and Management of digital Phenotypes) System, which includes a mobile application for collecting movement and audio data during a battery of mood induction tasks and an open-source platform for extracting digital biomarkers. As proof of principle, we present ChAMP System data from 101 children 4-8 years old, with and without diagnosed mental health disorders. Machine learning models trained on these data detect the presence of specific disorders with 70-73% balanced accuracy, with similar results to clinical thresholds on established parent-report measures (63-82% balanced accuracy). Features favored in model architectures are described using Shapley Additive Explanations (SHAP). Canonical Correlation Analysis reveals moderate to strong associations between predictors of each disorder and associated symptom severity (r = .51-.83). The open-source ChAMP System provides clinically-relevant digital biomarkers that may later complement parent-report measures of emotional and behavioral health for detecting kids with underlying mental health conditions and lowers the barrier to entry for researchers interested in exploring digital phenotyping of childhood mental health.

Toward Digital Phenotypes of Early Childhood Mental Health via Unsupervised and Supervised Machine Learning.

Childhood mental health disorders such as anxiety, depression, and ADHD are commonly-occurring and often go undetected into adolescence or adulthood. This can lead to detrimental impacts on long-term wellbeing and quality of life. Current parent-report assessments for pre-school aged children are often biased, and thus increase the need for objective mental health screening tools. Leveraging digital tools to identify the behavioral signature of childhood mental disorders may enable increased intervention at the time with the highest chance of long-term impact. We present data from 84 participants (4-8 years old, 50% diagnosed with anxiety, depression, and/or ADHD) collected during a battery of mood induction tasks using the ChAMP System. Unsupervised Kohonen Self-Organizing Maps (SOM) constructed from movement and audio features indicate that age did not tend to explain clusters as consistently as gender within task-specific and cross-task SOMs. Symptom prevalence and diagnostic status also showed some evidence of clustering. Case studies suggest that high impairment (>80th percentile symptom counts) and diagnostic subtypes (ADHD-Combined) may account for most behaviorally distinct children. Based on this same dataset, we also present results from supervised modeling for the binary classification of diagnoses. Our top performing models yield moderate but promising results (ROC AUC .6-.82, TPR .36-.71, Accuracy .62-.86) on par with our previous efforts for isolated behavioral tasks. Enhancing features, tuning model parameters, and incorporating additional wearable sensor data will continue to enable the rapid progression towards the discovery of digital phenotypes of childhood mental health.Clinical Relevance- This work advances the use of wearables for detecting childhood mental health disorders.

Preterm Preeclampsia Risk Modelling: Examining Hemodynamic, Biochemical, and Biophysical Markers Prior to Pregnancy.

Preeclampsia (PE) is a leading cause of maternal and perinatal death globally and can lead to unplanned preterm birth. Predicting risk for preterm or early-onset PE, has been investigated primarily after conception, and particularly in the early and mid-gestational periods. However, there is a distinct clinical advantage in identifying individuals at risk for PE prior to conception, when a wider array of preventive interventions are available. In this work, we leverage machine learning techniques to identify potential pre-pregnancy biomarkers of PE in a sample of 80 women, 10 of whom were diagnosed with preterm preeclampsia during their subsequent pregnancy. We explore prospective biomarkers derived from hemodynamic, biophysical, and biochemical measurements and several modeling approaches. A support vector machine (SVM) optimized with stochastic gradient descent yields the highest overall performance with ROC AUC and detection rates up to .88 and .70, respectively on subject-wise cross validation. The best performing models leverage biophysical and hemodynamic biomarkers. While preliminary, these results indicate the promise of a machine learning based approach for detecting individuals who are at risk for developing preterm PE before they become pregnant. These efforts may inform gestational planning and care, reducing risk for adverse PE-related outcomes.Clinical Relevance- This work considers the development and optimization of pre-pregnancy biomarkers for improving the identification of preterm (early-onset) preeclampsia risk prior to conception.

Discovering Digital Biomarkers of Panic Attack Risk in Consumer Wearables Data.

Panic attacks are an impairing mental health problem that impacts more than one out of every 10 adults in the United States (US). Clinical guidelines suggest panic attacks occur without warning and their unexpected nature worsens their impact on quality of life. Individuals who experience panic attacks would benefit from advance warning of when an attack is likely to occur so that appropriate steps could be taken to manage or prevent it. Our recent work suggests that an individual's likelihood of experiencing a panic attack can be predicted by self-reported mood and community-level Twitter-derived mood the previous day. Prior work also suggests that physiological markers may indicate a pending panic attack. However, the ability of objective physiological, behavioral, and environmental measures collected via consumer wearable sensors (referred to as digital biomarkers) to predict next-day panic attacks has not yet been explored. To address this question, we consider data from 38 individuals who regularly experienced panic attacks recruited from across the US. Participants responded to daily questions about their panic attacks for 28 days and provided access to data from their Apple Watches. Mixed Regressions, with an autoregressive covariance structure were used to estimate the prevalence of a next-day panic attack Results indicate that digital biomarkers of ambient noise (louder) and resting heart rate (higher) are indicative of experiencing a panic attack the next day. These preliminary results suggest, for the first time, that panic attacks may be predictable from digital biomarkers, opening the door to improvements in how panic attacks are managed and to the development of new preventative interventions.Clinical Relevance- Objective data from consumer wearables may predict when an individual is at high risk for experiencing a next-day panic attack. This information could guide treatment decisions, help individuals manage their panic, and inform the development of new preventative interventions.

The ChAMP App: A Scalable mHealth Technology for Detecting Digital Phenotypes of Early Childhood Mental Health.

Childhood mental health problems are common, impairing, and can become chronic if left untreated. Children are not reliable reporters of their emotional and behavioral health, and caregivers often unintentionally under- or over-report child symptoms, making assessment challenging. Objective physiological and behavioral measures of emotional and behavioral health are emerging. However, these methods typically require specialized equipment and expertise in data and sensor engineering to administer and analyze. To address this challenge, we have developed the ChAMP (Childhood Assessment and Management of digital Phenotypes) System, which includes a mobile application for collecting movement and audio data during a battery of mood induction tasks and an open-source platform for extracting digital biomarkers. As proof of principle, we present ChAMP System data from 101 children 4-8 years old, with and without diagnosed mental health disorders. Machine learning models trained on these data detect the presence of specific disorders with 70-73% balanced accuracy, with similar results to clinical thresholds on established parent-report measures (63-82% balanced accuracy). Features favored in model architectures are described using Shapley Additive Explanations (SHAP). Canonical Correlation Analysis reveals moderate to strong associations between predictors of each disorder and associated symptom severity (r = .51-.83). The open-source ChAMP System provides clinically-relevant digital biomarkers that may later complement parent-report measures of emotional and behavioral health for detecting kids with underlying mental health conditions and lowers the barrier to entry for researchers interested in exploring digital phenotyping of childhood mental health.

Discovering Digital Biomarkers of Panic Attack Risk in Consumer Wearables Data.

Panic attacks are an impairing mental health problem that impacts more than one out of every 10 adults in the United States (US). Clinical guidelines suggest panic attacks occur without warning and their unexpected nature worsens their impact on quality of life. Individuals who experience panic attacks would benefit from advance warning of when an attack is likely to occur so that appropriate steps could be taken to manage or prevent it. Our recent work suggests that an individual's likelihood of experiencing a panic attack can be predicted by self-reported mood and community-level Twitter-derived mood the previous day. Prior work also suggests that physiological markers may indicate a pending panic attack. However, the ability of objective physiological, behavioral, and environmental measures to predict next-day panic attacks has not yet been explored. To address this question, we consider data from 38 individuals who regularly experienced panic attacks recruited from across the US. Participants responded to daily questions about their panic attacks for 28 days and provided access to data from their Apple Watches. Results indicate that objective measures of ambient noise (louder) and resting heart rate (higher) are related to the likelihood of experiencing a panic attack the next day. These preliminary results suggest, for the first time, that panic attacks may be predictable from data passively collected by consumer wearable devices, opening the door to improvements in how panic attacks are managed and to the development of new preventative interventions. Clinical Relevance: Objective data from consumer wearables may predict when an individual is at high risk for experiencing a next-day panic attack. This information could guide treatment decisions, help individuals manage their panic, and inform the development of new preventative interventions.

Preterm Preeclampsia Risk Modelling: Examining Hemodynamic, Biochemical, and Biophysical Markers Prior to Pregnancy.

Preeclampsia (PE) is a leading cause of maternal and perinatal death globally and can lead to unplanned preterm birth. Predicting risk for preterm or early-onset PE, has been investigated primarily after conception, and particularly in the early and mid-gestational periods. However, there is a distinct clinical advantage in identifying individuals at risk for PE prior to conception, when a wider array of preventive interventions are available. In this work, we leverage machine learning techniques to identify potential pre-pregnancy biomarkers of PE in a sample of 80 women, 10 of whom were diagnosed with preterm preeclampsia during their subsequent pregnancy. We explore biomarkers derived from hemodynamic, biophysical, and biochemical measurements and several modeling approaches. A support vector machine (SVM) optimized with stochastic gradient descent yields the highest overall performance with ROC AUC and detection rates up to .88 and .70, respectively on subject-wise cross validation. The best performing models leverage biophysical and hemodynamic biomarkers. While preliminary, these results indicate the promise of a machine learning based approach for detecting individuals who are at risk for developing preterm PE before they become pregnant. These efforts may inform gestational planning and care, reducing risk for adverse PE-related outcomes.

Multimodal surveillance of SARS-CoV-2 at a university enables development of a robust outbreak response framework.

BACKGROUND: Universities are vulnerable to infectious disease outbreaks, making them ideal environments to study transmission dynamics and evaluate mitigation and surveillance measures. Here, we analyze multimodal COVID-19-associated data collected during the 2020-2021 academic year at Colorado Mesa University and introduce a SARS-CoV-2 surveillance and response framework. METHODS: We analyzed epidemiological and sociobehavioral data (demographics, contact tracing, and WiFi-based co-location data) alongside pathogen surveillance data (wastewater and diagnostic testing, and viral genomic sequencing of wastewater and clinical specimens) to characterize outbreak dynamics and inform policy. We applied relative risk, multiple linear regression, and social network assortativity to identify attributes or behaviors associated with contracting SARS-CoV-2. To characterize SARS-CoV-2 transmission, we used viral sequencing, phylogenomic tools, and functional assays. FINDINGS: Athletes, particularly those on high-contact teams, had the highest risk of testing positive. On average, individuals who tested positive had more contacts and longer interaction durations than individuals who never tested positive. The distribution of contacts per individual was overdispersed, although not as overdispersed as the distribution of phylogenomic descendants. Corroboration via technical replicates was essential for identification of wastewater mutations. CONCLUSIONS: Based on our findings, we formulate a framework that combines tools into an integrated disease surveillance program that can be implemented in other congregate settings with limited resources. FUNDING: This work was supported by the National Science Foundation, the Hertz Foundation, the National Institutes of Health, the Centers for Disease Control and Prevention, the Massachusetts Consortium on Pathogen Readiness, the Howard Hughes Medical Institute, the Flu Lab, and the Audacious Project.

UVM KID Study: Identifying Multimodal Features and Optimizing Wearable Instrumentation to Detect Child Anxiety.

Anxiety and depression, collectively known as internalizing disorders, begin as early as the preschool years and impact nearly 1 out of every 5 children. Left undiagnosed and untreated, childhood internalizing disorders predict later health problems including substance abuse, development of comorbid psychopathology, increased risk for suicide, and substantial functional impairment. Current diagnostic procedures require access to clinical experts, take considerable time to complete, and inherently assume that child symptoms are observable by caregivers. Multi-modal wearable sensors may enable development of rapid point-of-care diagnostics that address these challenges. Building on our prior work, here we present an assessment battery for the development of a digital phenotype for internalizing disorders in young children and an early feasibility case study of multi-modal wearable sensor data from two participants, one of whom has been clinically diagnosed with an internalizing disorder. Results lend support that sacral movement responses and R-R interval during a short stress-induction task may facilitate child diagnosis. Multi-modal sensors measuring movement and surface biopotentials of the chest and trapezius are also shown to have significant redundancy, introducing the potential for sensor optimization moving forward. Future work aims to further optimize sensor placement, signals, features, and assessments to enable deployment in clinical practice. Clinical Relevance- This work considers the development and optimization of technologies for improving the identification of children with internalizing disorders.

How Much Data Is Enough? A Reliable Methodology to Examine Long-Term Wearable Data Acquisition in Gait and Postural Sway.

Wearable sensors facilitate the evaluation of gait and balance impairment in the free-living environment, often with observation periods spanning weeks, months, and even years. Data supporting the minimal duration of sensor wear, which is necessary to capture representative variability in impairment measures, are needed to balance patient burden, data quality, and study cost. Prior investigations have examined the duration required for resolving a variety of movement variables (e.g., gait speed, sit-to-stand tests), but these studies use differing methodologies and have only examined a small subset of potential measures of gait and balance impairment. Notably, postural sway measures have not yet been considered in these analyses. Here, we propose a three-level framework for examining this problem. Difference testing and intra-class correlations (ICC) are used to examine the agreement in features computed from potential wear durations (levels one and two). The association between features and established patient reported outcomes at each wear duration is also considered (level three) for determining the necessary wear duration. Utilizing wearable accelerometer data continuously collected from 22 persons with multiple sclerosis (PwMS) for 6 weeks, this framework suggests that 2 to 3 days of monitoring may be sufficient to capture most of the variability in gait and sway; however, longer periods (e.g., 3 to 6 days) may be needed to establish strong correlations to patient-reported clinical measures. Regression analysis indicates that the required wear duration depends on both the observation frequency and variability of the measure being considered. This approach provides a framework for evaluating wear duration as one aspect of the comprehensive assessment, which is necessary to ensure that wearable sensor-based methods for capturing gait and balance impairment in the free-living environment are fit for purpose.

Analyzing the impact of a real-life outbreak simulator on pandemic mitigation: An epidemiological modeling study.

An app-based educational outbreak simulator, Operation Outbreak (OO), seeks to engage and educate participants to better respond to outbreaks. Here, we examine the utility of OO for understanding epidemiological dynamics. The OO app enables experience-based learning about outbreaks, spreading a virtual pathogen via Bluetooth among participating smartphones. Deployed at many colleges and in other settings, OO collects anonymized spatiotemporal data, including the time and duration of the contacts among participants of the simulation. We report the distribution, timing, duration, and connectedness of student social contacts at two university deployments and uncover cryptic transmission pathways through individuals' second-degree contacts. We then construct epidemiological models based on the OO-generated contact networks to predict the transmission pathways of hypothetical pathogens with varying reproductive numbers. Finally, we demonstrate that the granularity of OO data enables institutions to mitigate outbreaks by proactively and strategically testing and/or vaccinating individuals based on individual social interaction levels.

Transmission from vaccinated individuals in a large SARS-CoV-2 Delta variant outbreak.

An outbreak of over 1,000 COVID-19 cases in Provincetown, Massachusetts (MA), in July 2021-the first large outbreak mostly in vaccinated individuals in the US-prompted a comprehensive public health response, motivating changes to national masking recommendations and raising questions about infection and transmission among vaccinated individuals. To address these questions, we combined viral genomic and epidemiological data from 467 individuals, including 40% of outbreak-associated cases. The Delta variant accounted for 99% of cases in this dataset; it was introduced from at least 40 sources, but 83% of cases derived from a single source, likely through transmission across multiple settings over a short time rather than a single event. Genomic and epidemiological data supported multiple transmissions of Delta from and between fully vaccinated individuals. However, despite its magnitude, the outbreak had limited onward impact in MA and the US overall, likely due to high vaccination rates and a robust public health response.

Evidence of transmission from fully vaccinated individuals in a large outbreak of the SARS-CoV-2 Delta variant in Provincetown, Massachusetts.

Multiple summer events, including large indoor gatherings, in Provincetown, Massachusetts (MA), in July 2021 contributed to an outbreak of over one thousand COVID-19 cases among residents and visitors. Most cases were fully vaccinated, many of whom were also symptomatic, prompting a comprehensive public health response, motivating changes to national masking recommendations, and raising questions about infection and transmission among vaccinated individuals. To characterize the outbreak and the viral population underlying it, we combined genomic and epidemiological data from 467 individuals, including 40% of known outbreak-associated cases. The Delta variant accounted for 99% of sequenced outbreak-associated cases. Phylogenetic analysis suggests over 40 sources of Delta in the dataset, with one responsible for a single cluster containing 83% of outbreak-associated genomes. This cluster was likely not the result of extensive spread at a single site, but rather transmission from a common source across multiple settings over a short time. Genomic and epidemiological data combined provide strong support for 25 transmission events from, including many between, fully vaccinated individuals; genomic data alone provides evidence for an additional 64. Together, genomic epidemiology provides a high-resolution picture of the Provincetown outbreak, revealing multiple cases of transmission of Delta from fully vaccinated individuals. However, despite its magnitude, the outbreak was restricted in its onward impact in MA and the US, likely due to high vaccination rates and a robust public health response.