Association of Remote Patient-Reported Outcomes and Step Counts With Hospitalization or Death Among Patients With Advanced Cancer Undergoing Chemotherapy: Secondary Analysis of the PROStep Randomized Trial.

BACKGROUND: Patients with advanced cancer undergoing chemotherapy experience significant symptoms and declines in functional status, which are associated with poor outcomes. Remote monitoring of patient-reported outcomes (PROs; symptoms) and step counts (functional status) may proactively identify patients at risk of hospitalization or death. OBJECTIVE: The aim of this study is to evaluate the association of (1) longitudinal PROs with step counts and (2) PROs and step counts with hospitalization or death. METHODS: The PROStep randomized trial enrolled 108 patients with advanced gastrointestinal or lung cancers undergoing cytotoxic chemotherapy at a large academic cancer center. Patients were randomized to weekly text-based monitoring of 8 PROs plus continuous step count monitoring via Fitbit (Google) versus usual care. This preplanned secondary analysis included 57 of 75 patients randomized to the intervention who had PRO and step count data. We analyzed the associations between PROs and mean daily step counts and the associations of PROs and step counts with the composite outcome of hospitalization or death using bootstrapped generalized linear models to account for longitudinal data. RESULTS: Among 57 patients, the mean age was 57 (SD 10.9) years, 24 (42%) were female, 43 (75%) had advanced gastrointestinal cancer, 14 (25%) had advanced lung cancer, and 25 (44%) were hospitalized or died during follow-up. A 1-point weekly increase (on a 32-point scale) in aggregate PRO score was associated with 247 fewer mean daily steps (95% CI -277 to -213; P<.001). PROs most strongly associated with step count decline were patient-reported activity (daily step change -892), nausea score (-677), and constipation score (524). A 1-point weekly increase in aggregate PRO score was associated with 20% greater odds of hospitalization or death (adjusted odds ratio [aOR] 1.2, 95% CI 1.1-1.4; P=.01). PROs most strongly associated with hospitalization or death were pain (aOR 3.2, 95% CI 1.6-6.5; P<.001), decreased activity (aOR 3.2, 95% CI 1.4-7.1; P=.01), dyspnea (aOR 2.6, 95% CI 1.2-5.5; P=.02), and sadness (aOR 2.1, 95% CI 1.1-4.3; P=.03). A decrease in 1000 steps was associated with 16% greater odds of hospitalization or death (aOR 1.2, 95% CI 1.0-1.3; P=.03). Compared with baseline, mean daily step count decreased 7% (n=274 steps), 9% (n=351 steps), and 16% (n=667 steps) in the 3, 2, and 1 weeks before hospitalization or death, respectively. CONCLUSIONS: In this secondary analysis of a randomized trial among patients with advanced cancer, higher symptom burden and decreased step count were independently associated with and predictably worsened close to hospitalization or death. Future interventions should leverage longitudinal PRO and step count data to target interventions toward patients at risk for poor outcomes. TRIAL REGISTRATION: ClinicalTrials.gov NCT04616768; https://clinicaltrials.gov/study/NCT04616768. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.1136/bmjopen-2021-054675.

Neurological diagnoses in hospitalized COVID-19 patients associated with adverse outcomes: A multinational cohort study.

Few studies examining the patient outcomes of concurrent neurological manifestations during acute COVID-19 leveraged multinational cohorts of adults and children or distinguished between central and peripheral nervous system (CNS vs. PNS) involvement. Using a federated multinational network in which local clinicians and informatics experts curated the electronic health records data, we evaluated the risk of prolonged hospitalization and mortality in hospitalized COVID-19 patients from 21 healthcare systems across 7 countries. For adults, we used a federated learning approach whereby we ran Cox proportional hazard models locally at each healthcare system and performed a meta-analysis on the aggregated results to estimate the overall risk of adverse outcomes across our geographically diverse populations. For children, we reported descriptive statistics separately due to their low frequency of neurological involvement and poor outcomes. Among the 106,229 hospitalized COVID-19 patients (104,031 patients ≥18 years; 2,198 patients <18 years, January 2020-October 2021), 15,101 (14%) had at least one CNS diagnosis, while 2,788 (3%) had at least one PNS diagnosis. After controlling for demographics and pre-existing conditions, adults with CNS involvement had longer hospital stay (11 versus 6 days) and greater risk of (Hazard Ratio = 1.78) and faster time to death (12 versus 24 days) than patients with no neurological condition (NNC) during acute COVID-19 hospitalization. Adults with PNS involvement also had longer hospital stay but lower risk of mortality than the NNC group. Although children had a low frequency of neurological involvement during COVID-19 hospitalization, a substantially higher proportion of children with CNS involvement died compared to those with NNC (6% vs 1%). Overall, patients with concurrent CNS manifestation during acute COVID-19 hospitalization faced greater risks for adverse clinical outcomes than patients without any neurological diagnosis. Our global informatics framework using a federated approach (versus a centralized data collection approach) has utility for clinical discovery beyond COVID-19.

Using Natural Language Processing to Extract and Classify Symptoms Among Patients with Thyroid Dysfunction.

In the United States, more than 12% of the population will experience thyroid dysfunction. Patient symptoms often reported with thyroid dysfunction include fatigue and weight change. However, little is understood about the relationship between these symptoms documented in the outpatient setting and ordering patterns for thyroid testing among various patient groups by age and sex. We developed a natural language processing and deep learning pipeline to identify patient-reported outcomes of weight change and fatigue among patients with a thyroid stimulating hormone test. We built upon prior works by comparing 5 open-source, Bidirectional Encoder Representations from Transformers (BERT) to determine which models could accurately identify these symptoms from clinical texts. For both fatigue (f) and weight change (wc), Bio_ClinicalBERT achieved the highest F1-score (f: 0.900; wc: 0.906) compared BERT (f: 0.899; wc: 0.890), DistilBERT (f: 0.852; wc: 0.912), Biomedical RoBERTa (f: 0.864; wc: 0.904), and PubMedBERT (f: 0.882; wc: 0.892).

Remote Patient-Reported Outcomes and Activity Monitoring to Improve Patient-Clinician Communication Regarding Symptoms and Functional Status: A Randomized Controlled Trial.

PURPOSE: Routine collection of patient-generated health data (PGHD) may promote earlier recognition of symptomatic and functional decline. This trial assessed the impact of an intervention integrating remote PGHD collection with patient nudges on symptom and functional status understanding between patients with advanced cancer and their oncology team. METHODS: This three-arm randomized controlled trial was conducted from November 19, 2020, to December 17, 2021, at a large tertiary oncology practice. We enrolled patients with stage IV GI and lung cancers undergoing chemotherapy. Over 6 months, patients in two intervention arms received PROStep-weekly text message-based symptom surveys and passive activity monitoring using a wearable accelerometer. PGHD were summarized in dashboards given to patients' oncology team before appointments. One intervention arm received an additional text-based active choice prompt to discuss worsening symptoms or functional status with their clinician. Control patients did not receive PROStep. The coprimary outcomes patient perceptions of oncology team symptom and functional understanding at 6 months were measured on a 1-5 Likert scale (5 = high understanding). RESULTS: One hundred eight patients enrolled: 55% male, 81% White, and 77% had GI cancers. Patient-reported clinician understanding did not differ between control and intervention arms for symptoms (4.5 v 4.5; P = .87) or functional status (4.5 v 4.3; P = .31). In the intervention arms, combined patient adherence to weekly symptom reports and daily activity monitoring was 64% and 53%, respectively. Intervention patients in the PROStep versus PROStep + active choice arms reported low burden from wearing the accelerometer (mean burden [standard deviation], 2.7 [1.3] v 2.1 [1.3]; P = .15) and completing surveys (2.1 [1.2] v 1.9 [1.3]; P = .44). CONCLUSION: Patients receiving PROStep reported high understanding of symptoms and functional status from their oncology team, although this did not differ from controls.

Characterizing the treatment gap in the United States among adult patients with a new diagnosis of epilepsy.

OBJECTIVE: Epilepsy is largely a treatable condition with antiseizure medication (ASM). Recent national administrative claims data suggest one third of newly diagnosed adult epilepsy patients remain untreated 3 years after diagnosis. We aimed to quantify and characterize this treatment gap within a large US academic health system leveraging the electronic health record for enriched clinical detail. METHODS: This retrospective cohort study evaluated the proportion of adult patients in the health system from 2012 to 2020 who remained untreated 3 years after initial epilepsy diagnosis. To identify incident epilepsy, we applied validated administrative health data criteria of two encounters for epilepsy/seizures and/or convulsions, and we required no ASM prescription preceding the first encounter. Engagement with the health system at least 2 years before and at least 3 years after diagnosis was required. Among subjects who met administrative data diagnosis criteria, we manually reviewed medical records for a subset of 240 subjects to verify epilepsy diagnosis, confirm treatment status, and elucidate reason for nontreatment. These results were applied to estimate the proportion of the full cohort with untreated epilepsy. RESULTS: Of 831 patients who were automatically classified as having incident epilepsy by inclusion criteria, 80 (10%) remained untreated 3 years after incident epilepsy diagnosis. Manual chart review of incident epilepsy classification revealed only 33% (78/240) had true incident epilepsy. We found untreated patients were more frequently misclassified (p < .001). Using corrected counts, we extrapolated to the full cohort (831) and estimated <1%-3% had true untreated epilepsy. SIGNIFICANCE: We found a substantially lower proportion of patients with newly diagnosed epilepsy remained untreated compared to previous estimates from administrative data analysis. Manual chart review revealed patients were frequently misclassified as having incident epilepsy, particularly patients who were not treated with an ASM. Administrative data analyses utilizing only diagnosis codes may misclassify patients as having incident epilepsy.

Acute respiratory distress syndrome after SARS-CoV-2 infection on young adult population: International observational federated study based on electronic health records through the 4CE consortium.

PURPOSE: In young adults (18 to 49 years old), investigation of the acute respiratory distress syndrome (ARDS) after severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection has been limited. We evaluated the risk factors and outcomes of ARDS following infection with SARS-CoV-2 in a young adult population. METHODS: A retrospective cohort study was conducted between January 1st, 2020 and February 28th, 2021 using patient-level electronic health records (EHR), across 241 United States hospitals and 43 European hospitals participating in the Consortium for Clinical Characterization of COVID-19 by EHR (4CE). To identify the risk factors associated with ARDS, we compared young patients with and without ARDS through a federated analysis. We further compared the outcomes between young and old patients with ARDS. RESULTS: Among the 75,377 hospitalized patients with positive SARS-CoV-2 PCR, 1001 young adults presented with ARDS (7.8% of young hospitalized adults). Their mortality rate at 90 days was 16.2% and they presented with a similar complication rate for infection than older adults with ARDS. Peptic ulcer disease, paralysis, obesity, congestive heart failure, valvular disease, diabetes, chronic pulmonary disease and liver disease were associated with a higher risk of ARDS. We described a high prevalence of obesity (53%), hypertension (38%- although not significantly associated with ARDS), and diabetes (32%). CONCLUSION: Trough an innovative method, a large international cohort study of young adults developing ARDS after SARS-CoV-2 infection has been gather. It demonstrated the poor outcomes of this population and associated risk factor.

Long-term kidney function recovery and mortality after COVID-19-associated acute kidney injury: An international multi-centre observational cohort study.

Background: While acute kidney injury (AKI) is a common complication in COVID-19, data on post-AKI kidney function recovery and the clinical factors associated with poor kidney function recovery is lacking. Methods: A retrospective multi-centre observational cohort study comprising 12,891 hospitalized patients aged 18 years or older with a diagnosis of SARS-CoV-2 infection confirmed by polymerase chain reaction from 1 January 2020 to 10 September 2020, and with at least one serum creatinine value 1-365 days prior to admission. Mortality and serum creatinine values were obtained up to 10 September 2021. Findings: Advanced age (HR 2.77, 95%CI 2.53-3.04, p < 0.0001), severe COVID-19 (HR 2.91, 95%CI 2.03-4.17, p < 0.0001), severe AKI (KDIGO stage 3: HR 4.22, 95%CI 3.55-5.00, p < 0.0001), and ischemic heart disease (HR 1.26, 95%CI 1.14-1.39, p < 0.0001) were associated with worse mortality outcomes. AKI severity (KDIGO stage 3: HR 0.41, 95%CI 0.37-0.46, p < 0.0001) was associated with worse kidney function recovery, whereas remdesivir use (HR 1.34, 95%CI 1.17-1.54, p < 0.0001) was associated with better kidney function recovery. In a subset of patients without chronic kidney disease, advanced age (HR 1.38, 95%CI 1.20-1.58, p < 0.0001), male sex (HR 1.67, 95%CI 1.45-1.93, p < 0.0001), severe AKI (KDIGO stage 3: HR 11.68, 95%CI 9.80-13.91, p < 0.0001), and hypertension (HR 1.22, 95%CI 1.10-1.36, p = 0.0002) were associated with post-AKI kidney function impairment. Furthermore, patients with COVID-19-associated AKI had significant and persistent elevations of baseline serum creatinine 125% or more at 180 days (RR 1.49, 95%CI 1.32-1.67) and 365 days (RR 1.54, 95%CI 1.21-1.96) compared to COVID-19 patients with no AKI. Interpretation: COVID-19-associated AKI was associated with higher mortality, and severe COVID-19-associated AKI was associated with worse long-term post-AKI kidney function recovery. Funding: Authors are supported by various funders, with full details stated in the acknowledgement section.

SurvMaximin: Robust federated approach to transporting survival risk prediction models.

OBJECTIVE: For multi-center heterogeneous Real-World Data (RWD) with time-to-event outcomes and high-dimensional features, we propose the SurvMaximin algorithm to estimate Cox model feature coefficients for a target population by borrowing summary information from a set of health care centers without sharing patient-level information. MATERIALS AND METHODS: For each of the centers from which we want to borrow information to improve the prediction performance for the target population, a penalized Cox model is fitted to estimate feature coefficients for the center. Using estimated feature coefficients and the covariance matrix of the target population, we then obtain a SurvMaximin estimated set of feature coefficients for the target population. The target population can be an entire cohort comprised of all centers, corresponding to federated learning, or a single center, corresponding to transfer learning. RESULTS: Simulation studies and a real-world international electronic health records application study, with 15 participating health care centers across three countries (France, Germany, and the U.S.), show that the proposed SurvMaximin algorithm achieves comparable or higher accuracy compared with the estimator using only the information of the target site and other existing methods. The SurvMaximin estimator is robust to variations in sample sizes and estimated feature coefficients between centers, which amounts to significantly improved estimates for target sites with fewer observations. CONCLUSIONS: The SurvMaximin method is well suited for both federated and transfer learning in the high-dimensional survival analysis setting. SurvMaximin only requires a one-time summary information exchange from participating centers. Estimated regression vectors can be very heterogeneous. SurvMaximin provides robust Cox feature coefficient estimates without outcome information in the target population and is privacy-preserving.

Changes in laboratory value improvement and mortality rates over the course of the pandemic: an international retrospective cohort study of hospitalised patients infected with SARS-CoV-2.

OBJECTIVE: To assess changes in international mortality rates and laboratory recovery rates during hospitalisation for patients hospitalised with SARS-CoV-2 between the first wave (1 March to 30 June 2020) and the second wave (1 July 2020 to 31 January 2021) of the COVID-19 pandemic. DESIGN, SETTING AND PARTICIPANTS: This is a retrospective cohort study of 83 178 hospitalised patients admitted between 7 days before or 14 days after PCR-confirmed SARS-CoV-2 infection within the Consortium for Clinical Characterization of COVID-19 by Electronic Health Record, an international multihealthcare system collaborative of 288 hospitals in the USA and Europe. The laboratory recovery rates and mortality rates over time were compared between the two waves of the pandemic. PRIMARY AND SECONDARY OUTCOME MEASURES: The primary outcome was all-cause mortality rate within 28 days after hospitalisation stratified by predicted low, medium and high mortality risk at baseline. The secondary outcome was the average rate of change in laboratory values during the first week of hospitalisation. RESULTS: Baseline Charlson Comorbidity Index and laboratory values at admission were not significantly different between the first and second waves. The improvement in laboratory values over time was faster in the second wave compared with the first. The average C reactive protein rate of change was -4.72 mg/dL vs -4.14 mg/dL per day (p=0.05). The mortality rates within each risk category significantly decreased over time, with the most substantial decrease in the high-risk group (42.3% in March-April 2020 vs 30.8% in November 2020 to January 2021, p<0.001) and a moderate decrease in the intermediate-risk group (21.5% in March-April 2020 vs 14.3% in November 2020 to January 2021, p<0.001). CONCLUSIONS: Admission profiles of patients hospitalised with SARS-CoV-2 infection did not differ greatly between the first and second waves of the pandemic, but there were notable differences in laboratory improvement rates during hospitalisation. Mortality risks among patients with similar risk profiles decreased over the course of the pandemic. The improvement in laboratory values and mortality risk was consistent across multiple countries.

Determinants of hospital outcomes for patients with COVID-19 in the University of Pennsylvania Health System.

There is growing evidence that racial and ethnic minorities bear a disproportionate burden from COVID-19. Temporal changes in the pandemic epidemiology and diversity in the clinical course require careful study to identify determinants of poor outcomes. We analyzed 6255 hospitalized individuals with PCR-confirmed SARS-CoV-2 infection from one of 5 hospitals in the University of Pennsylvania Health System between March 2020 and March 2021, using electronic health records to assess risk factors and outcomes through 8 weeks post-admission. Discharge, readmission and mortality outcomes were analyzed in a multi-state model with multivariable Cox models for each transition. Mortality varied markedly over time, with cumulative incidence (95% CI) 30 days post-admission of 19.1% (16.9, 21.3) in March-April 2020, 5.7% (4.2, 7.5) in July-October 2020 and 10.5% (9.1,12.0) in January-March 2021; 26% of deaths occurred after discharge. Average age (SD) at admission varied from 62.7 (17.6) to 54.8 (19.9) to 60.5 (18.1); mechanical ventilation use declined from 21.3% to 9-11%. Compared to Caucasian, Black race was associated with more severe disease at admission, higher rates of co-morbidities and residing in a low-income zip code. Between-race risk differences in mortality risk diminished in multivariable models; while admitting hospital, increasing age, admission early in the pandemic, and severe disease and low blood pressure at admission were associated with increased mortality hazard. Hispanic ethnicity was associated with fewer baseline co-morbidities and lower mortality hazard (0.57, 95% CI: 0.37, .087). Multi-state modeling allows for a unified framework to analyze multiple outcomes throughout the disease course. Morbidity and mortality for hospitalized COVID-19 patients varied over time but post-discharge mortality remained non-trivial. Black race was associated with more risk factors for morbidity and with treatment at hospitals with lower mortality. Multivariable models suggest there are not between-race differences in outcomes. Future work is needed to better understand the identified between-hospital differences in mortality.

Improving Vancomycin Stewardship in Critically Ill Children.

BACKGROUND AND OBJECTIVES: Inappropriate vancomycin use is common in children's hospitals. We report a quality improvement (QI) intervention to reduce vancomycin use in our tertiary care PICU. METHODS: We retrospectively quantified the prevalence of infections caused by organisms requiring vancomycin therapy, including methicillin-resistant Staphylococcus aureus (MRSA), among patients with suspected bacterial infections. Guided by these data, we performed 3 QI interventions over a 3-year period, including (1) stakeholder education, (2) generation of a consensus-based guideline for empiric vancomycin use, and (3) implementation of this guideline through clinical decision support. Vancomycin use in days of therapy (DOT) per 1000 patient days was measured by using statistical process control charts. Balancing measures included frequency of bacteremia due to an organism requiring vancomycin not covered with empiric therapy, 30-day mortality, and cardiovascular, respiratory, and renal organ dysfunction. RESULTS: Among 1276 episodes of suspected bacterial infection, a total of 19 cases of bacteremia (1.5%) due to organisms requiring vancomycin therapy were identified, including 6 MRSA bacteremias (0.5%). During the 3-year QI project, overall vancomycin DOT per 1000 patient days in the PICU decreased from a baseline mean of 182 DOT per 1000 patient days to 109 DOT per 1000 patient days (a 40% reduction). All balancing measures were unchanged, and all cases of MRSA bacteremia were treated empirically with vancomycin. CONCLUSION: Our interventions reduced overall vancomycin use in the PICU without evidence of harm. Provider education and consensus building surrounding indications for empiric vancomycin use were key strategies.

Multinational characterization of neurological phenotypes in patients hospitalized with COVID-19.

Neurological complications worsen outcomes in COVID-19. To define the prevalence of neurological conditions among hospitalized patients with a positive SARS-CoV-2 reverse transcription polymerase chain reaction test in geographically diverse multinational populations during early pandemic, we used electronic health records (EHR) from 338 participating hospitals across 6 countries and 3 continents (January-September 2020) for a cross-sectional analysis. We assessed the frequency of International Classification of Disease code of neurological conditions by countries, healthcare systems, time before and after admission for COVID-19 and COVID-19 severity. Among 35,177 hospitalized patients with SARS-CoV-2 infection, there was an increase in the proportion with disorders of consciousness (5.8%, 95% confidence interval [CI] 3.7-7.8%, pFDR < 0.001) and unspecified disorders of the brain (8.1%, 5.7-10.5%, pFDR < 0.001) when compared to the pre-admission proportion. During hospitalization, the relative risk of disorders of consciousness (22%, 19-25%), cerebrovascular diseases (24%, 13-35%), nontraumatic intracranial hemorrhage (34%, 20-50%), encephalitis and/or myelitis (37%, 17-60%) and myopathy (72%, 67-77%) were higher for patients with severe COVID-19 when compared to those who never experienced severe COVID-19. Leveraging a multinational network to capture standardized EHR data, we highlighted the increased prevalence of central and peripheral neurological phenotypes in patients hospitalized with COVID-19, particularly among those with severe disease.

A Natural Language Processing-Assisted Extraction System for Gleason Scores: Development and Usability Study.

BACKGROUND: Natural language processing (NLP) offers significantly faster variable extraction compared to traditional human extraction but cannot interpret complicated notes as well as humans can. Thus, we hypothesized that an "NLP-assisted" extraction system, which uses humans for complicated notes and NLP for uncomplicated notes, could produce faster extraction without compromising accuracy. OBJECTIVE: The aim of this study was to develop and pilot an NLP-assisted extraction system to leverage the strengths of both human and NLP extraction of prostate cancer Gleason scores. METHODS: We collected all available clinical and pathology notes for prostate cancer patients in an unselected academic biobank cohort. We developed an NLP system to extract prostate cancer Gleason scores from both clinical and pathology notes. Next, we designed and implemented the NLP-assisted extraction system algorithm to categorize notes into "uncomplicated" and "complicated" notes. Uncomplicated notes were assigned to NLP extraction and complicated notes were assigned to human extraction. We randomly reviewed 200 patients to assess the accuracy and speed of our NLP-assisted extraction system and compared it to NLP extraction alone and human extraction alone. RESULTS: Of the 2051 patients in our cohort, the NLP system extracted a prostate surgery Gleason score from 1147 (55.92%) patients and a prostate biopsy Gleason score from 1624 (79.18%) patients. Our NLP-assisted extraction system had an overall accuracy rate of 98.7%, which was similar to the accuracy of human extraction alone (97.5%; P=.17) and significantly higher than the accuracy of NLP extraction alone (95.3%; P<.001). Moreover, our NLP-assisted extraction system reduced the workload of human extractors by approximately 95%, resulting in an average extraction time of 12.7 seconds per patient (vs 256.1 seconds per patient for human extraction alone). CONCLUSIONS: We demonstrated that an NLP-assisted extraction system was able to achieve much faster Gleason score extraction compared to traditional human extraction without sacrificing accuracy.

Multinational Prevalence of Neurological Phenotypes in Patients Hospitalized with COVID-19.

OBJECTIVE: Neurological complications can worsen outcomes in COVID-19. We defined the prevalence of a wide range of neurological conditions among patients hospitalized with COVID-19 in geographically diverse multinational populations. METHODS: Using electronic health record (EHR) data from 348 participating hospitals across 6 countries and 3 continents between January and September 2020, we performed a cross-sectional study of hospitalized adult and pediatric patients with a positive SARS-CoV-2 reverse transcription polymerase chain reaction test, both with and without severe COVID-19. We assessed the frequency of each disease category and 3-character International Classification of Disease (ICD) code of neurological diseases by countries, sites, time before and after admission for COVID-19, and COVID-19 severity. RESULTS: Among the 35,177 hospitalized patients with SARS-CoV-2 infection, there was increased prevalence of disorders of consciousness (5.8%, 95% confidence interval [CI]: 3.7%-7.8%, p FDR <.001) and unspecified disorders of the brain (8.1%, 95%CI: 5.7%-10.5%, p FDR <.001), compared to pre-admission prevalence. During hospitalization, patients who experienced severe COVID-19 status had 22% (95%CI: 19%-25%) increase in the relative risk (RR) of disorders of consciousness, 24% (95%CI: 13%-35%) increase in other cerebrovascular diseases, 34% (95%CI: 20%-50%) increase in nontraumatic intracranial hemorrhage, 37% (95%CI: 17%-60%) increase in encephalitis and/or myelitis, and 72% (95%CI: 67%-77%) increase in myopathy compared to those who never experienced severe disease. INTERPRETATION: Using an international network and common EHR data elements, we highlight an increase in the prevalence of central and peripheral neurological phenotypes in patients hospitalized with SARS-CoV-2 infection, particularly among those with severe disease.

Validation of an internationally derived patient severity phenotype to support COVID-19 analytics from electronic health record data.

OBJECTIVE: The Consortium for Clinical Characterization of COVID-19 by EHR (4CE) is an international collaboration addressing coronavirus disease 2019 (COVID-19) with federated analyses of electronic health record (EHR) data. We sought to develop and validate a computable phenotype for COVID-19 severity. MATERIALS AND METHODS: Twelve 4CE sites participated. First, we developed an EHR-based severity phenotype consisting of 6 code classes, and we validated it on patient hospitalization data from the 12 4CE clinical sites against the outcomes of intensive care unit (ICU) admission and/or death. We also piloted an alternative machine learning approach and compared selected predictors of severity with the 4CE phenotype at 1 site. RESULTS: The full 4CE severity phenotype had pooled sensitivity of 0.73 and specificity 0.83 for the combined outcome of ICU admission and/or death. The sensitivity of individual code categories for acuity had high variability-up to 0.65 across sites. At one pilot site, the expert-derived phenotype had mean area under the curve of 0.903 (95% confidence interval, 0.886-0.921), compared with an area under the curve of 0.956 (95% confidence interval, 0.952-0.959) for the machine learning approach. Billing codes were poor proxies of ICU admission, with as low as 49% precision and recall compared with chart review. DISCUSSION: We developed a severity phenotype using 6 code classes that proved resilient to coding variability across international institutions. In contrast, machine learning approaches may overfit hospital-specific orders. Manual chart review revealed discrepancies even in the gold-standard outcomes, possibly owing to heterogeneous pandemic conditions. CONCLUSIONS: We developed an EHR-based severity phenotype for COVID-19 in hospitalized patients and validated it at 12 international sites.

Lexicon Development for COVID-19-related Concepts Using Open-source Word Embedding Sources: An Intrinsic and Extrinsic Evaluation.

BACKGROUND: Scientists are developing new computational methods and prediction models to better clinically understand COVID-19 prevalence, treatment efficacy, and patient outcomes. These efforts could be improved by leveraging documented COVID-19-related symptoms, findings, and disorders from clinical text sources in an electronic health record. Word embeddings can identify terms related to these clinical concepts from both the biomedical and nonbiomedical domains, and are being shared with the open-source community at large. However, it's unclear how useful openly available word embeddings are for developing lexicons for COVID-19-related concepts. OBJECTIVE: Given an initial lexicon of COVID-19-related terms, this study aims to characterize the returned terms by similarity across various open-source word embeddings and determine common semantic and syntactic patterns between the COVID-19 queried terms and returned terms specific to the word embedding source. METHODS: We compared seven openly available word embedding sources. Using a series of COVID-19-related terms for associated symptoms, findings, and disorders, we conducted an interannotator agreement study to determine how accurately the most similar returned terms could be classified according to semantic types by three annotators. We conducted a qualitative study of COVID-19 queried terms and their returned terms to detect informative patterns for constructing lexicons. We demonstrated the utility of applying such learned synonyms to discharge summaries by reporting the proportion of patients identified by concept among three patient cohorts: pneumonia (n=6410), acute respiratory distress syndrome (n=8647), and COVID-19 (n=2397). RESULTS: We observed high pairwise interannotator agreement (Cohen kappa) for symptoms (0.86-0.99), findings (0.93-0.99), and disorders (0.93-0.99). Word embedding sources generated based on characters tend to return more synonyms (mean count of 7.2 synonyms) compared to token-based embedding sources (mean counts range from 2.0 to 3.4). Word embedding sources queried using a qualifier term (eg, dry cough or muscle pain) more often returned qualifiers of the similar semantic type (eg, "dry" returns consistency qualifiers like "wet" and "runny") compared to a single term (eg, cough or pain) queries. A higher proportion of patients had documented fever (0.61-0.84), cough (0.41-0.55), shortness of breath (0.40-0.59), and hypoxia (0.51-0.56) retrieved than other clinical features. Terms for dry cough returned a higher proportion of patients with COVID-19 (0.07) than the pneumonia (0.05) and acute respiratory distress syndrome (0.03) populations. CONCLUSIONS: Word embeddings are valuable technology for learning related terms, including synonyms. When leveraging openly available word embedding sources, choices made for the construction of the word embeddings can significantly influence the words learned.

Identifying risk factors for suicidal ideation across a large community healthcare system.

BACKGROUND: Suicide is the tenth leading cause of death in the United States. Several studies have leveraged electronic health record (EHR) data to predict suicide risk in veteran and military samples; however, few studies have investigated suicide risk factors in a large-scale community health population. METHODS: Clinical data was queried for 9,811 patients from the Penn Medicine Health System who had completed a Patient Health Questionnaire-9 (PHQ-9) documented in the EHR between January 2017 and June 2019. Patient demographics, PHQ-9 scores, and psychiatric comorbidities were extracted from the EHR. Univariate and multivariable logistic regressions were applied to determine significant risk factors associated with suicide ideation responses from the PHQ-9. RESULTS: One-quarter (25.8%% of patients endorsed suicide ideation. Univariate analysis found 22 risk factors of suicide ideation. Multivariable logistic regression found significant positive associations (Odds Ratio, (95% Confidence Interval)) with the following: younger ages less than 18 years: 2.1, (1.69, 2.60) and 19-24 years: 1.55, (1.29, 1.87)), single marital status (1.22, (1.08, 1.38)), African American (1.22, (1.08, 1.38)), non-commercial insurance (1.16, (1.03, 1.31)), multiple comorbidities (1 comorbidity (1.65, (1.32, 2.07); 2 comorbidities (2.07, (1.61, 2.64)), 3+ comorbidities (2.49, (1.87, 3.33))), bipolar disorders (Type I: 1.38, (1.14, 1.67) and Type II: 1.94, (1.52, 2.49)), depressive disorders (1.70, (1.49, 1.94)), obsessive compulsive disorder (OCD) (1.43, (1.08, 1.90)), and stress disorders (1.53, (1.33, 1.76)). CONCLUSION: Community EHR information can be used to predict suicidal ideation. This information can be used to design tools for identifying patients at risk for suicide in real-time.

Risk of Persistent Opioid Use following Major Surgery in Matched Samples of Patients with and without Cancer.

BACKGROUND: The opioid crisis has reached epidemic proportions, yet risk of persistent opioid use following curative intent surgery for cancer and factors influencing this risk are not well understood. METHODS: We used electronic health record data from 3,901 adult patients who received a prescription for an opioid analgesic related to hysterectomy or large bowel surgery from January 1, 2013, through June 30, 2018. Patients with and without a cancer diagnosis were matched on the basis of demographic, clinical, and procedural variables and compared for persistent opioid use. RESULTS: Cancer diagnosis was associated with greater risk for persistent opioid use after hysterectomy [18.9% vs. 9.6%; adjusted OR (aOR), 2.26; 95% confidence interval (CI), 1.38-3.69; P = 0.001], but not after large bowel surgery (28.3% vs. 24.1%; aOR 1.25; 95% CI, 0.97-1.59; P = 0.09). In the cancer hysterectomy cohort, persistent opioid use was associated with cancer stage (increased rates among those with stage III cancer compared with stage I) and use of neoadjuvant or adjuvant chemotherapy; however, these factors were not associated with persistent opioid use in the large bowel cohort. CONCLUSIONS: Patients with cancer may have an increased risk of persistent opioid use following hysterectomy. IMPACT: Risks and benefits of opioid analgesia for surgical pain among patients with cancer undergoing hysterectomy should be carefully considered.

Implementation of a Pragmatic Biomarker-Driven Algorithm to Guide Antibiotic Use in the Pediatric Intensive Care Unit: the Optimizing Antibiotic Strategies in Sepsis (OASIS) II Study.

BACKGROUND: Biomarkers can facilitate safe antibiotic discontinuation in critically ill patients without bacterial infection. METHODS: We tested the ability of a biomarker-based algorithm to reduce excess antibiotic administration in patients with systemic inflammatory response syndrome (SIRS) without bacterial infections (uninfected) in our pediatric intensive care unit (PICU). The algorithm suggested that PICU clinicians stop antibiotics if (1) C-reactive protein <4 mg/dL and procalcitonin <1 ng/mL at SIRS onset and (2) no evidence of bacterial infection by exam/testing by 48 hours. We evaluated excess broad-spectrum antibiotic use, defined as administration on days 3-9 after SIRS onset in uninfected children. Incidence rate ratios (IRRs) compared unadjusted excess length of therapy (LOT) in the 34 months before (Period 1) and 12 months after (Period 2) implementation of this algorithm, stratified by biomarker values. Segmented linear regression evaluated excess LOT among all uninfected episodes over time and between the periods. RESULTS: We identified 457 eligible SIRS episodes without bacterial infection, 333 in Period 1 and 124 in Period 2. When both biomarkers were below the algorithm's cut-points (n = 48 Period 1, n = 31 Period 2), unadjusted excess LOT was lower in Period 2 (IRR, 0.53; 95% confidence interval, 0.30-0.93). Among all 457 uninfected episodes, there were no significant differences in LOT (coefficient 0.9, P = .99) between the periods on segmented regression. CONCLUSIONS: Implementation of a biomarker-based algorithm did not decrease overall antibiotic exposure among all uninfected patients in our PICU, although exposures were reduced in the subset of SIRS episodes where biomarkers were low.