Evaluation of a Machine Learning Approach Utilizing Wearable Data for Prediction of SARS-CoV-2 Infection in Healthcare Workers

ImportancePassive and non-invasive identification of SARS-CoV-2 infection remains a challenge. Widespread use of wearable devices represents an opportunity to leverage physiological metrics and fill this knowledge gap. ObjectiveTo determine whether a machine learning model can detect SARS-CoV-2 infection from physiological metrics collected from wearable devices. DesignA multicenter observational study enrolling health care workers with remote follow-up. SettingSeven hospitals from the Mount Sinai Health System in New York City ParticipantsEligibility criteria included health care workers who were [≥]18 years, employees of one of the participating hospitals, with at least an iPhone series 6, and willing to wear an Apple Watch Series 4 or higher. We excluded participants with underlying autoimmune/inflammatory diseases, and medications known to interfere with autonomic function. We enrolled participants between April 29th, 2020, and March 2nd, 2021, and followed them for a median of 73 days (range, 3-253 days). Participants provided patient-reported outcome measures through a custom smartphone application and wore an Apple Watch, collecting heart rate variability and heart rate data, throughout the follow-up period. ExposureParticipants were exposed to SARS-CoV-2 infection over time due to ongoing community spread. Main Outcome and MeasureThe primary outcome was SARS-CoV-2 infection, defined as {+/-}7 days from a self-reported positive SARS-CoV-2 nasal PCR test. ResultsWe enrolled 407 participants with 49 (12%) having a positive SARS-CoV-2 test during follow-up. We examined five machine-learning approaches and found that gradient-boosting machines (GBM) had the most favorable 10-CV performance. Across all testing sets, our GBM model predicted SARS-CoV-2 infection with an average area under the receiver operating characteristic (auROC)=85% (Confidence Interval 83-88%). The model was calibrated to improve sensitivity over specificity, achieving an average sensitivity of 76% (CI {+/-}[~]4%) and specificity of 84% (CI {+/-}[~]0.4%). The most important predictors included parameters describing the circadian HRV mean (MESOR) and peak-timing (acrophase), and age. Conclusions and RelevanceWe show that a tree-based ML algorithm applied to physiological metrics passively collected from a wearable device can identify and predict SARS-CoV2 infection. Utilizing physiological metrics from wearable devices may improve screening methods and infection tracking.

Factors Associated with Longitudinal Psychological and Physiological Stress in Health Care Workers During the COVID-19 Pandemic

IntroductionThe Coronavirus Disease 2019 (COVID-19) pandemic has resulted in psychological distress in health care workers (HCWs). There is a need to characterize which HCWs are at increased risk of psychological sequela from the pandemic. MethodsHCWs across seven hospitals in New York City were prospectively followed in an ongoing observational digital study using the custom Warrior Watch Study App. Participants wore an Apple Watch for the duration of the study measuring HRV throughout the follow up period. Surveys were obtained daily. ResultsThree hundred and sixty-one HCWs were enrolled. Multivariable analysis found New York City COVID-19 case count to be significantly associated with increased longitudinal stress (p=0.008). A non-significant decrease in stress (p=0.23) was observed following COVID-19 diagnosis, though there was a borderline significant increase following the 4-week period after a COVID-19 diagnosis via nasal PCR (p=0.05). Baseline emotional support, baseline quality of life and baseline resilience were associated with decreased longitudinal stress (p<0.001). Baseline resilience and emotional support were found to buffer against stressors, with a significant reduction in stress during the 4-week period after COVID-19 diagnosis observed only in participants in the highest tertial of emotional support and resilience (effect estimate -0.97, p=0.03; estimate -1.78, p=0.006). A significant trend between New York City COVID-19 case count and longitudinal stress was observed only in the high tertial emotional support group (estimate 1.22, p=0.005), and was borderline significant in the high and medium resilience tertials (estimate 1.29, p=0.098; estimate 1.14, p=0.09). Participants in the highest tertial of baseline emotional support and resilience had significantly reduced amplitude and acrophase of the circadian pattern of longitudinally collected heart rate variability. ConclusionOur findings demonstrate that low resilience, emotional support, and quality of life identify HCWs at risk of high perceived longitudinal stress secondary to the COVID-19 pandemic and have a distinct physiological stress profile. Assessment of HCWs for these features can identify and permit allocation of psychological support to these at-risk individuals as the COVID-19 pandemic and its psychological effects continue in this vulnerable population.

Longitudinal Physiological Data from a Wearable Device Identifies SARS-CoV-2 Infection and Symptoms and Predicts COVID-19 Diagnosis

BackgroundChanges in autonomic nervous system function, characterized by heart rate variability (HRV), have been associated with and observed prior to the clinical identification of infection. We performed an evaluation of this metric collected by wearable devices, to identify and predict Coronavirus disease 2019 (COVID-19) and its related symptoms. MethodsHealth care workers in the Mount Sinai Health System were prospectively followed in an ongoing observational study using the custom Warrior Watch Study App which was downloaded to their smartphones. Participants wore an Apple Watch for the duration of the study measuring HRV throughout the follow up period. Surveys assessing infection and symptom related questions were obtained daily. FindingsUsing a mixed-effect COSINOR model the mean amplitude of the circadian pattern of the standard deviation of the interbeat interval of normal sinus beats (SDNN), a HRV metric, differed between subjects with and without COVID-19 (p=0.006). The mean amplitude of this circadian pattern differed between individuals during the 7 days before and the 7 days after a COVID-19 diagnosis compared to this metric during uninfected time periods (p=0.01). Significant changes in the mean MESOR and amplitude of the circadian pattern of the SDNN was observed between the first day of reporting a COVID-19 related symptom compared to all other symptom free days (p=0.01). InterpretationLongitudinally collected HRV metrics from a commonly worn commercial wearable device (Apple Watch) can identify the diagnosis of COVID-19 and COVID-19 related symptoms. Prior to the diagnosis of COVID-19 by nasal PCR, significant changes in HRV were observed demonstrating its predictive ability to identify COVID-19 infection. FundingSupport was provided by the Ehrenkranz Lab For Human Resilience, the BioMedical Engineering and Imaging Institute, The Hasso Plattner Institute for Digital Health at Mount Sinai, The Mount Sinai Clinical Intelligence Center and The Dr. Henry D. Janowitz Division of Gastroenterology.

Acute Kidney Injury in Hospitalized Patients with COVID-19

ImportancePreliminary reports indicate that acute kidney injury (AKI) is common in coronavirus disease (COVID)-19 patients and is associated with worse outcomes. AKI in hospitalized COVID-19 patients in the United States is not well-described. ObjectiveTo provide information about frequency, outcomes and recovery associated with AKI and dialysis in hospitalized COVID-19 patients. DesignObservational, retrospective study. SettingAdmitted to hospital between February 27 and April 15, 2020. ParticipantsPatients aged [≥]18 years with laboratory confirmed COVID-19 ExposuresAKI (peak serum creatinine increase of 0.3 mg/dL or 50% above baseline). Main Outcomes and MeasuresFrequency of AKI and dialysis requirement, AKI recovery, and adjusted odds ratios (aOR) with mortality. We also trained and tested a machine learning model for predicting dialysis requirement with independent validation. ResultsA total of 3,235 hospitalized patients were diagnosed with COVID-19. AKI occurred in 1406 (46%) patients overall and 280 (20%) with AKI required renal replacement therapy. The incidence of AKI (admission plus new cases) in patients admitted to the intensive care unit was 68% (553 of 815). In the entire cohort, the proportion with stages 1, 2, and 3 AKI were 35%, 20%, 45%, respectively. In those needing intensive care, the respective proportions were 20%, 17%, 63%, and 34% received acute renal replacement therapy. Independent predictors of severe AKI were chronic kidney disease, systolic blood pressure, and potassium at baseline. In-hospital mortality in patients with AKI was 41% overall and 52% in intensive care. The aOR for mortality associated with AKI was 9.6 (95% CI 7.4-12.3) overall and 20.9 (95% CI 11.7-37.3) in patients receiving intensive care. 56% of patients with AKI who were discharged alive recovered kidney function back to baseline. The area under the curve (AUC) for the machine learned predictive model using baseline features for dialysis requirement was 0.79 in a validation test. Conclusions and RelevanceAKI is common in patients hospitalized with COVID-19, associated with worse mortality, and the majority of patients that survive do not recover kidney function. A machine-learned model using admission features had good performance for dialysis prediction and could be used for resource allocation. Key PointsO_ST_ABSQuestionC_ST_ABSWhat is incidence and outcomes of acute kidney injury (AKI) in patients hospitalized with COVID-19? FindingsIn this observational study of 3,235 hospitalized patients with COVID-19 in New York City, AKI occurred in 46% of patients and 20% of those patients required dialysis. AKI was associated with increased mortality. 44% of patients discharged alive had residual acute kidney disease. A machine learned predictive model using baseline features for dialysis requirement had an AUC Of 0.79. MeaningAKI was common in patients with COVID-19, associated with increased mortality, and nearly half of patients had acute kidney disease on discharge.

Machine Learning to Predict Mortality and Critical Events in COVID-19 Positive New York City Patients

Coronavirus 2019 (COVID-19), caused by the SARS-CoV-2 virus, has become the deadliest pandemic in modern history, reaching nearly every country worldwide and overwhelming healthcare institutions. As of April 20, there have been more than 2.4 million confirmed cases with over 160,000 deaths. Extreme case surges coupled with challenges in forecasting the clinical course of affected patients have necessitated thoughtful resource allocation and early identification of high-risk patients. However, effective methods for achieving this are lacking. In this paper, we use electronic health records from over 3,055 New York City confirmed COVID-19 positive patients across five hospitals in the Mount Sinai Health System and present a decision tree-based machine learning model for predicting in-hospital mortality and critical events. This model is first trained on patients from a single hospital and then externally validated on patients from four other hospitals. We achieve strong performance, notably predicting mortality at 1 week with an AUC-ROC of 0.84. Finally, we establish model interpretability by calculating SHAP scores to identify decisive features, including age, inflammatory markers (procalcitonin and LDH), and coagulation parameters (PT, PTT, D-Dimer). To our knowledge, this is one of the first models with external validation to both predict outcomes in COVID-19 patients with strong validation performance and identify key contributors in outcome prediction that may assist clinicians in making effective patient management decisions. One-Sentence SummaryWe identify clinical features that robustly predict mortality and critical events in a large cohort of COVID-19 positive patients in New York City.

Clinical Characteristics of Hospitalized Covid-19 Patients in New York City

BackgroundThe coronavirus 2019 (Covid-19) pandemic is a global public health crisis, with over 1.6 million cases and 95,000 deaths worldwide. Data are needed regarding the clinical course of hospitalized patients, particularly in the United States. MethodsDemographic, clinical, and outcomes data for patients admitted to five Mount Sinai Health System hospitals with confirmed Covid-19 between February 27 and April 2, 2020 were identified through institutional electronic health records. We conducted a descriptive study of patients who had in-hospital mortality or were discharged alive. ResultsA total of 2,199 patients with Covid-19 were hospitalized during the study period. As of April 2nd, 1,121 (51%) patients remained hospitalized, and 1,078 (49%) completed their hospital course. Of the latter, the overall mortality was 29%, and 36% required intensive care. The median age was 65 years overall and 75 years in those who died. Pre-existing conditions were present in 65% of those who died and 46% of those discharged. In those who died, the admission median lymphocyte percentage was 11.7%, D-dimer was 2.4 ug/ml, C-reactive protein was 162 mg/L, and procalcitonin was 0.44 ng/mL. In those discharged, the admission median lymphocyte percentage was 16.6%, D-dimer was 0.93 ug/ml, C-reactive protein was 79 mg/L, and procalcitonin was 0.09 ng/mL. ConclusionsThis is the largest and most diverse case series of hospitalized patients with Covid-19 in the United States to date. Requirement of intensive care and mortality were high. Patients who died typically had pre-existing conditions and severe perturbations in inflammatory markers.