Leveraging GPT-4 for Identifying Cancer Phenotypes in Electronic Health Records: A Performance Comparison between GPT-4, GPT-3.5-turbo, Flan-T5 and spaCy's Rule-based & Machine Learning-based methods.

Objective: Accurately identifying clinical phenotypes from Electronic Health Records (EHRs) provides additional insights into patients' health, especially when such information is unavailable in structured data. This study evaluates the application of OpenAI's Generative Pre-trained Transformer (GPT)-4 model to identify clinical phenotypes from EHR text in non-small cell lung cancer (NSCLC) patients. The goal was to identify disease stages, treatments and progression utilizing GPT-4, and compare its performance against GPT-3.5-turbo, Flan-T5-xl, Flan-T5-xxl, and two rule-based and machine learning-based methods, namely, scispaCy and medspaCy. Materials and Methods: Phenotypes such as initial cancer stage, initial treatment, evidence of cancer recurrence, and affected organs during recurrence were identified from 13,646 records for 63 NSCLC patients from Washington University in St. Louis, Missouri. The performance of the GPT-4 model is evaluated against GPT-3.5-turbo, Flan-T5-xxl, Flan-T5-xl, medspaCy and scispaCy by comparing precision, recall, and micro-F1 scores. Results: GPT-4 achieved higher F1 score, precision, and recall compared to Flan-T5-xl, Flan-T5-xxl, medspaCy and scispaCy's models. GPT-3.5-turbo performed similarly to that of GPT-4. GPT and Flan-T5 models were not constrained by explicit rule requirements for contextual pattern recognition. SpaCy models relied on predefined patterns, leading to their suboptimal performance. Discussion and Conclusion: GPT-4 improves clinical phenotype identification due to its robust pre-training and remarkable pattern recognition capability on the embedded tokens. It demonstrates data-driven effectiveness even with limited context in the input. While rule-based models remain useful for some tasks, GPT models offer improved contextual understanding of the text, and robust clinical phenotype extraction.

Association Between Socioeconomic Factors, Race, and Use of a Specialty Memory Clinic.

BACKGROUND AND OBJECTIVES: The capacity of specialty memory clinics in the United States is very limited. If lower socioeconomic status or minoritized racial group is associated with reduced use of memory clinics, this could exacerbate health care disparities, especially if more effective treatments of Alzheimer disease become available. We aimed to understand how use of a memory clinic is associated with neighborhood-level measures of socioeconomic factors and the intersectionality of race. METHODS: We conducted an observational cross-sectional study using electronic health record data to compare the neighborhood advantage of patients seen at the Washington University Memory Diagnostic Center with the catchment area using a geographical information system. Furthermore, we compared the severity of dementia at the initial visit between patients who self-identified as Black or White. We used a multinomial logistic regression model to assess the Clinical Dementia Rating at the initial visit and t tests to compare neighborhood characteristics, including Area Deprivation Index, with those of the catchment area. RESULTS: A total of 4,824 patients seen at the memory clinic between 2008 and 2018 were included in this study (mean age 72.7 [SD 11.0] years, 2,712 [56%] female, 543 [11%] Black). Most of the memory clinic patients lived in more advantaged neighborhoods within the overall catchment area. The percentage of patients self-identifying as Black (11%) was lower than the average percentage of Black individuals by census tract in the catchment area (16%) (p < 0.001). Black patients lived in less advantaged neighborhoods, and Black patients were more likely than White patients to have moderate or severe dementia at their initial visit (odds ratio 1.59, 95% CI 1.11-2.25). DISCUSSION: This study demonstrates that patients living in less affluent neighborhoods were less likely to be seen in one large memory clinic. Black patients were under-represented in the clinic, and Black patients had more severe dementia at their initial visit. These findings suggest that patients with a lower socioeconomic status and who identify as Black are less likely to be seen in memory clinics, which are likely to be a major point of access for any new Alzheimer disease treatments that may become available.

Electronic health record data quality assessment and tools: a systematic review.

OBJECTIVE: We extended a 2013 literature review on electronic health record (EHR) data quality assessment approaches and tools to determine recent improvements or changes in EHR data quality assessment methodologies. MATERIALS AND METHODS: We completed a systematic review of PubMed articles from 2013 to April 2023 that discussed the quality assessment of EHR data. We screened and reviewed papers for the dimensions and methods defined in the original 2013 manuscript. We categorized papers as data quality outcomes of interest, tools, or opinion pieces. We abstracted and defined additional themes and methods though an iterative review process. RESULTS: We included 103 papers in the review, of which 73 were data quality outcomes of interest papers, 22 were tools, and 8 were opinion pieces. The most common dimension of data quality assessed was completeness, followed by correctness, concordance, plausibility, and currency. We abstracted conformance and bias as 2 additional dimensions of data quality and structural agreement as an additional methodology. DISCUSSION: There has been an increase in EHR data quality assessment publications since the original 2013 review. Consistent dimensions of EHR data quality continue to be assessed across applications. Despite consistent patterns of assessment, there still does not exist a standard approach for assessing EHR data quality. CONCLUSION: Guidelines are needed for EHR data quality assessment to improve the efficiency, transparency, comparability, and interoperability of data quality assessment. These guidelines must be both scalable and flexible. Automation could be helpful in generalizing this process.

Extraction of clinical phenotypes for Alzheimer's disease dementia from clinical notes using natural language processing.

Objectives: There is much interest in utilizing clinical data for developing prediction models for Alzheimer's disease (AD) risk, progression, and outcomes. Existing studies have mostly utilized curated research registries, image analysis, and structured electronic health record (EHR) data. However, much critical information resides in relatively inaccessible unstructured clinical notes within the EHR. Materials and Methods: We developed a natural language processing (NLP)-based pipeline to extract AD-related clinical phenotypes, documenting strategies for success and assessing the utility of mining unstructured clinical notes. We evaluated the pipeline against gold-standard manual annotations performed by 2 clinical dementia experts for AD-related clinical phenotypes including medical comorbidities, biomarkers, neurobehavioral test scores, behavioral indicators of cognitive decline, family history, and neuroimaging findings. Results: Documentation rates for each phenotype varied in the structured versus unstructured EHR. Interannotator agreement was high (Cohen's kappa = 0.72-1) and positively correlated with the NLP-based phenotype extraction pipeline's performance (average F1-score = 0.65-0.99) for each phenotype. Discussion: We developed an automated NLP-based pipeline to extract informative phenotypes that may improve the performance of eventual machine learning predictive models for AD. In the process, we examined documentation practices for each phenotype relevant to the care of AD patients and identified factors for success. Conclusion: Success of our NLP-based phenotype extraction pipeline depended on domain-specific knowledge and focus on a specific clinical domain instead of maximizing generalizability.

OpenSep: a generalizable open source pipeline for SOFA score calculation and Sepsis-3 classification.

EHR-based sepsis research often uses heterogeneous definitions of sepsis leading to poor generalizability and difficulty in comparing studies to each other. We have developed OpenSep, an open-source pipeline for sepsis phenotyping according to the Sepsis-3 definition, as well as determination of time of sepsis onset and SOFA scores. The Minimal Sepsis Data Model was developed alongside the pipeline to enable the execution of the pipeline to diverse sources of electronic health record data. The pipeline's accuracy was validated by applying it to the MIMIC-IV version 1.0 data and comparing sepsis onset and SOFA scores to those produced by the pipeline developed by the curators of MIMIC. We demonstrated high reliability between both the sepsis onsets and SOFA scores, however the use of the Minimal Sepsis Data model developed for this work allows our pipeline to be applied to more broadly to data sources beyond MIMIC.

Modifications to student quarantine policies in K-12 schools implementing multiple COVID-19 prevention strategies restores in-person education without increasing SARS-CoV-2 transmission risk, January-March 2021.

OBJECTIVE: To determine whether modified K-12 student quarantine policies that allow some students to continue in-person education during their quarantine period increase schoolwide SARS-CoV-2 transmission risk following the increase in cases in winter 2020-2021. METHODS: We conducted a prospective cohort study of COVID-19 cases and close contacts among students and staff (n = 65,621) in 103 Missouri public schools. Participants were offered free, saliva-based RT-PCR testing. The projected number of school-based transmission events among untested close contacts was extrapolated from the percentage of events detected among tested asymptomatic close contacts and summed with the number of detected events for a projected total. An adjusted Cox regression model compared hazard rates of school-based SARS-CoV-2 infections between schools with a modified versus standard quarantine policy. RESULTS: From January-March 2021, a projected 23 (1%) school-based transmission events occurred among 1,636 school close contacts. There was no difference in the adjusted hazard rates of school-based SARS-CoV-2 infections between schools with a modified versus standard quarantine policy (hazard ratio = 1.00; 95% confidence interval: 0.97-1.03). DISCUSSION: School-based SARS-CoV-2 transmission was rare in 103 K-12 schools implementing multiple COVID-19 prevention strategies. Modified student quarantine policies were not associated with increased school incidence of COVID-19. Modifications to student quarantine policies may be a useful strategy for K-12 schools to safely reduce disruptions to in-person education during times of increased COVID-19 community incidence.

Sepsis Prediction for the General Ward Setting.

Objective: To develop and evaluate a sepsis prediction model for the general ward setting and extend the evaluation through a novel pseudo-prospective trial design. Design: Retrospective analysis of data extracted from electronic health records (EHR). Setting: Single, tertiary-care academic medical center in St. Louis, MO, USA. Patients: Adult, non-surgical inpatients admitted between January 1, 2012 and June 1, 2019. Interventions: None. Measurements and Main Results: Of the 70,034 included patient encounters, 3.1% were septic based on the Sepsis-3 criteria. Features were generated from the EHR data and were used to develop a machine learning model to predict sepsis 6-h ahead of onset. The best performing model had an Area Under the Receiver Operating Characteristic curve (AUROC or c-statistic) of 0.862 ± 0.011 and Area Under the Precision-Recall Curve (AUPRC) of 0.294 ± 0.021 compared to that of Logistic Regression (0.857 ± 0.008 and 0.256 ± 0.024) and NEWS 2 (0.699 ± 0.012 and 0.092 ± 0.009). In the pseudo-prospective trial, 388 (69.7%) septic patients were alerted on with a specificity of 81.4%. Within 24 h of crossing the alert threshold, 20.9% had a sepsis-related event occur. Conclusions: A machine learning model capable of predicting sepsis in the general ward setting was developed using the EHR data. The pseudo-prospective trial provided a more realistic estimation of implemented performance and demonstrated a 29.1% Positive Predictive Value (PPV) for sepsis-related intervention or outcome within 48 h.

Respiratory support status from EHR data for adult population: classification, heuristics, and usage in predictive modeling.

OBJECTIVE: Respiratory support status is critical in understanding patient status, but electronic health record data are often scattered, incomplete, and contradictory. Further, there has been limited work on standardizing representations for respiratory support. The objective of this work was to (1) propose a practical terminology system for respiratory support methods; (2) develop (meta-)heuristics for constructing respiratory support episodes; and (3) evaluate the utility of respiratory support information for mortality prediction. MATERIALS AND METHODS: All analyses were performed using electronic health record data of COVID-19-tested, emergency department-admit, adult patients at a large, Midwestern healthcare system between March 1, 2020 and April 1, 2021. Logistic regression and XGBoost models were trained with and without respiratory support information, and performance metrics were compared. Importance of respiratory-support-based features was explored using absolute coefficient values for logistic regression and SHapley Additive exPlanations values for the XGBoost model. RESULTS: The proposed terminology system for respiratory support methods is as follows: Low-Flow Oxygen Therapy (LFOT), High-Flow Oxygen Therapy (HFOT), Non-Invasive Mechanical Ventilation (NIMV), Invasive Mechanical Ventilation (IMV), and ExtraCorporeal Membrane Oxygenation (ECMO). The addition of respiratory support information significantly improved mortality prediction (logistic regression area under receiver operating characteristic curve, median [IQR] from 0.855 [0.852-0.855] to 0.881 [0.876-0.884]; area under precision recall curve from 0.262 [0.245-0.268] to 0.319 [0.313-0.325], both P < 0.01). The proposed generalizable, interpretable, and episodic representation had commensurate performance compared to alternate representations despite loss of granularity. Respiratory support features were among the most important in both models. CONCLUSION: Respiratory support information is critical in understanding patient status and can facilitate downstream analyses.

Comparison of early warning scores for sepsis early identification and prediction in the general ward setting.

The objective of this study was to directly compare the ability of commonly used early warning scores (EWS) for early identification and prediction of sepsis in the general ward setting. For general ward patients at a large, academic medical center between early-2012 and mid-2018, common EWS and patient acuity scoring systems were calculated from electronic health records (EHR) data for patients that both met and did not meet Sepsis-3 criteria. For identification of sepsis at index time, National Early Warning Score 2 (NEWS 2) had the highest performance (area under the receiver operating characteristic curve: 0.803 [95% confidence interval [CI]: 0.795-0.811], area under the precision recall curves: 0.130 [95% CI: 0.121-0.140]) followed NEWS, Modified Early Warning Score, and quick Sequential Organ Failure Assessment (qSOFA). Using validated thresholds, NEWS 2 also had the highest recall (0.758 [95% CI: 0.736-0.778]) but qSOFA had the highest specificity (0.950 [95% CI: 0.948-0.952]), positive predictive value (0.184 [95% CI: 0.169-0.198]), and F1 score (0.236 [95% CI: 0.220-0.253]). While NEWS 2 outperformed all other compared EWS and patient acuity scores, due to the low prevalence of sepsis, all scoring systems were prone to false positives (low positive predictive value without drastic sacrifices in sensitivity), thus leaving room for more computationally advanced approaches.

SARS-CoV-2 screening testing in schools for children with intellectual and developmental disabilities.

BACKGROUND: Transmission of SARS-CoV-2 in schools primarily for typically developing children is rare. However, less is known about transmission in schools for children with intellectual and developmental disabilities (IDD), who are often unable to mask or maintain social distancing. The objectives of this study were to determine SARS-CoV-2 positivity and in-school transmission rates using weekly screening tests for school staff and students and describe the concurrent deployment of mitigation strategies in six schools for children with IDD. METHODS: From November 23, 2020, to May, 28, 2021, weekly voluntary screening for SARS-CoV-2 with a high sensitivity molecular-based saliva test was offered to school staff and students. Weekly positivity rates were determined and compared to local healthcare system and undergraduate student screening data. School-based transmission was assessed among participants quarantined for in-school exposure. School administrators completed a standardized survey to assess school mitigation strategies. RESULTS: A total of 59 students and 416 staff participated. An average of 304 school staff and students were tested per week. Of 7289 tests performed, 21 (0.29%) new SARS-CoV-2 positive cases were identified. The highest weekly positivity rate was 1.2% (n = 4) across all schools, which was less than community positivity rates. Two cases of in-school transmission were identified, each among staff, representing 2% (2/103) of participants quarantined for in-school exposure. Mitigation strategies included higher than expected student mask compliance, reduced room capacity, and phased reopening. CONCLUSIONS: During 24 weeks that included the peak of the COVID-19 pandemic in winter 2020-21, we found lower rates of SARS-CoV-2 screening test positivity among staff and students of six schools for children with IDD compared to community rates. In-school transmission of SARS-CoV-2 was low among those quarantined for in-school exposure. However, the impact of the emerging SARS-CoV-2 Delta variant on the effectiveness of these proven mitigation strategies remains unknown. TRIAL REGISTRATION: Prior to enrollment, this study was registered at ClinicalTrials.gov on September 25, 2020, identifier NCT04565509 , titled Supporting the Health and Well-being of Children with Intellectual and Developmental Disability During COVID-19 Pandemic.

Machine learning for modeling the progression of Alzheimer disease dementia using clinical data: a systematic literature review.

OBJECTIVE: Alzheimer disease (AD) is the most common cause of dementia, a syndrome characterized by cognitive impairment severe enough to interfere with activities of daily life. We aimed to conduct a systematic literature review (SLR) of studies that applied machine learning (ML) methods to clinical data derived from electronic health records in order to model risk for progression of AD dementia. MATERIALS AND METHODS: We searched for articles published between January 1, 2010, and May 31, 2020, in PubMed, Scopus, ScienceDirect, IEEE Explore Digital Library, Association for Computing Machinery Digital Library, and arXiv. We used predefined criteria to select relevant articles and summarized them according to key components of ML analysis such as data characteristics, computational algorithms, and research focus. RESULTS: There has been a considerable rise over the past 5 years in the number of research papers using ML-based analysis for AD dementia modeling. We reviewed 64 relevant articles in our SLR. The results suggest that majority of existing research has focused on predicting progression of AD dementia using publicly available datasets containing both neuroimaging and clinical data (neurobehavioral status exam scores, patient demographics, neuroimaging data, and laboratory test values). DISCUSSION: Identifying individuals at risk for progression of AD dementia could potentially help to personalize disease management to plan future care. Clinical data consisting of both structured data tables and clinical notes can be effectively used in ML-based approaches to model risk for AD dementia progression. Data sharing and reproducibility of results can enhance the impact, adaptation, and generalizability of this research.

SARS-CoV-2 Screening Testing in Schools for Children with Intellectual and Developmental Disabilities.

BACKGROUNDTransmission of SARS-CoV-2 in schools primarily for typically developing children is rare. However, less is known about transmission in schools for children with intellectual and developmental disabilities (IDD), who are often unable to mask or maintain social distancing. The objectives of this study were to determine SARS-CoV-2 positivity and in-school transmission rates using weekly screening tests for school staff and students and describe the concurrent deployment of mitigation strategies in six schools for children with IDD.METHODSFrom 11/23/20 to 5/28/21, weekly voluntary screening for SARS-CoV-2 with a high sensitivity molecular-based saliva test was offered to school staff and students. Weekly positivity rates were determined and compared to local healthcare system and undergraduate student screening data. School-based transmission was assessed among participants quarantined for in-school exposure. School administrators completed a standardized survey to assess school mitigation strategies.RESULTSA total of 59 students and 416 staff participated. An average of 304 school staff and students were tested per week. Of 7,289 tests performed, 21 (0.29%) new SARS-CoV-2 positive cases were identified. The highest weekly positivity rate was 1.2% (n = 4) across all schools, which was less than community positivity rates. Two cases of in-school transmission were identified, each among staff, representing 2% (2/103) of participants quarantined for in-school exposure. Mitigation strategies included higher than expected student mask compliance, reduced room capacity, and phased reopening.CONCLUSIONSDuring 24 weeks that included the peak of the COVID-19 pandemic, we found no evidence for elevated SARS-CoV-2 screening test positivity among staff and students of six schools for children with IDD compared to community rates. In-school transmission of SARS-CoV-2 was low among those quarantined for in-school exposure.Clinical Trial RegistryPrior to enrollment, this study was registered at ClinicalTrials.gov on 9/25/2020, identifier NCT04565509, titled Supporting the Health and Well-being of Children with Intellectual and Developmental Disability During COVID-19 Pandemic (https://clinicaltrials.gov/ct2/show/NCT04565509?term=NCT04565509).

Addressing cancer survivors' cardiovascular health using the automated heart health assessment (AH-HA) EHR tool: Initial protocol and modifications to address COVID-19 challenges.

BACKGROUND: The purpose of this paper is to describe the Automated Heart-Health Assessment (AH-HA) study protocol, which demonstrates an agile approach to cancer care delivery research. This study aims to assess the effect of a clinical decision support tool for cancer survivors on cardiovascular health (CVH) discussions, referrals, completed visits with primary care providers and cardiologists, and control of modifiable CVH factors and behaviors. The COVID-19 pandemic has caused widespread disruption to clinical trial accrual and operations. Studies conducted with potentially vulnerable populations, including cancer survivors, must shift towards virtual consent, data collection, and study visits to reduce risk for participants and study staff. Studies examining cancer care delivery innovations may also need to accommodate the increased use of virtual visits. METHODS/DESIGN: This group-randomized, mixed methods study will recruit 600 cancer survivors from 12 National Cancer Institute Community Oncology Research Program (NCORP) practices. Survivors at intervention sites will use the AH-HA tool with their oncology provider; survivors at usual care sites will complete routine survivorship visits. Outcomes will be measured immediately after the study visit, with follow-up at 6 and 12 months. The study was amended during the COVID-19 pandemic to allow for virtual consent, data collection, and intervention options, with the goal of minimizing participant-staff in-person contact and accommodating virtual survivorship visits. CONCLUSIONS: Changes to the study protocol and procedures allow important cancer care delivery research to continue safely during the COVID-19 pandemic and give sites and survivors flexibility to conduct study activities in-person or remotely.

A Pragmatic Machine Learning Model To Predict Carbapenem Resistance.

Infection caused by carbapenem-resistant (CR) organisms is a rising problem in the United States. While the risk factors for antibiotic resistance are well known, there remains a large need for the early identification of antibiotic-resistant infections. Using machine learning (ML), we sought to develop a prediction model for carbapenem resistance. All patients >18 years of age admitted to a tertiary-care academic medical center between 1 January 2012 and 10 October 2017 with ≥1 bacterial culture were eligible for inclusion. All demographic, medication, vital sign, procedure, laboratory, and culture/sensitivity data were extracted from the electronic health record. Organisms were considered CR if a single isolate was reported as intermediate or resistant. Patients with CR and non-CR organisms were temporally matched to maintain the positive/negative case ratio. Extreme gradient boosting was used for model development. In total, 68,472 patients met inclusion criteria, with 1,088 patients identified as having CR organisms. Sixty-seven features were used for predictive modeling. The most important features were number of prior antibiotic days, recent central venous catheter placement, and inpatient surgery. After model training, the area under the receiver operating characteristic curve was 0.846. The sensitivity of the model was 30%, with a positive predictive value (PPV) of 30% and a negative predictive value of 99%. Using readily available clinical data, we were able to create a ML model capable of predicting CR infections at the time of culture collection with a high PPV.

Pilot Investigation of SARS-CoV-2 Secondary Transmission in Kindergarten Through Grade 12 Schools Implementing Mitigation Strategies - St. Louis County and City of Springfield, Missouri, December 2020.

Many kindergarten through grade 12 (K-12) schools offering in-person learning have adopted strategies to limit the spread of SARS-CoV-2, the virus that causes COVID-19 (1). These measures include mandating use of face masks, physical distancing in classrooms, increasing ventilation with outdoor air, identification of close contacts,* and following CDC isolation and quarantine guidance† (2). A 2-week pilot investigation was conducted to investigate occurrences of SARS-CoV-2 secondary transmission in K-12 schools in the city of Springfield, Missouri, and in St. Louis County, Missouri, during December 7-18, 2020. Schools in both locations implemented COVID-19 mitigation strategies; however, Springfield implemented a modified quarantine policy permitting student close contacts aged ≤18 years who had school-associated contact with a person with COVID-19 and met masking requirements during their exposure to continue in-person learning.§ Participating students, teachers, and staff members with COVID-19 (37) from 22 schools and their school-based close contacts (contacts) (156) were interviewed, and contacts were offered SARS-CoV-2 testing. Among 102 school-based contacts who received testing, two (2%) had positive test results indicating probable school-based SARS-CoV-2 secondary transmission. Both contacts were in Springfield and did not meet criteria to participate in the modified quarantine. In Springfield, 42 student contacts were permitted to continue in-person learning under the modified quarantine; among the 30 who were interviewed, 21 were tested, and none received a positive test result. Despite high community transmission, SARS-CoV-2 transmission in schools implementing COVID-19 mitigation strategies was lower than that in the community. Until additional data are available, K-12 schools should continue implementing CDC-recommended mitigation measures (2) and follow CDC isolation and quarantine guidance to minimize secondary transmission in schools offering in-person learning.

Comparison of Sepsis Definitions as Automated Criteria.

OBJECTIVES: Assess the impact of heterogeneity among established sepsis criteria (Sepsis-1, Sepsis-3, Centers for Disease Control and Prevention Adult Sepsis Event, and Centers for Medicare and Medicaid severe sepsis core measure 1) through the comparison of corresponding sepsis cohorts. DESIGN: Retrospective analysis of data extracted from electronic health record. SETTING: Single, tertiary-care center in St. Louis, MO. PATIENTS: Adult, nonsurgical inpatients admitted between January 1, 2012, and January 6, 2018. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: In the electronic health record data, 286,759 encounters met inclusion criteria across the study period. Application of established sepsis criteria yielded cohorts varying in prevalence: Centers for Disease Control and Prevention Adult Sepsis Event (4.4%), Centers for Medicare and Medicaid severe sepsis core measure 1 (4.8%), International Classification of Disease code (7.2%), Sepsis-3 (7.5%), and Sepsis-1 (11.3%). Between the two modern established criteria, Sepsis-3 (n = 21,550) and Centers for Disease Control and Prevention Adult Sepsis Event (n = 12,494), the size of the overlap was 7,763. The sepsis cohorts also varied in time from admission to sepsis onset (hr): Sepsis-1 (2.9), Sepsis-3 (4.1), Centers for Disease Control and Prevention Adult Sepsis Event (4.6), and Centers for Medicare and Medicaid severe sepsis core measure 1 (7.6); sepsis discharge International Classification of Disease code rate: Sepsis-1 (37.4%), Sepsis-3 (40.1%), Centers for Medicare and Medicaid severe sepsis core measure 1 (48.5%), and Centers for Disease Control and Prevention Adult Sepsis Event (54.5%); and inhospital mortality rate: Sepsis-1 (13.6%), Sepsis-3 (18.8%), International Classification of Disease code (20.4%), Centers for Medicare and Medicaid severe sepsis core measure 1 (22.5%), and Centers for Disease Control and Prevention Adult Sepsis Event (24.1%). CONCLUSIONS: The application of commonly used sepsis definitions on a single population produced sepsis cohorts with low agreement, significantly different baseline demographics, and clinical outcomes.

Transmission dynamics: Data sharing in the COVID-19 era.

Problem: The current coronavirus disease 2019 (COVID-19) pandemic underscores the need for building and sustaining public health data infrastructure to support a rapid local, regional, national, and international response. Despite a historical context of public health crises, data sharing agreements and transactional standards do not uniformly exist between institutions which hamper a foundational infrastructure to meet data sharing and integration needs for the advancement of public health. Approach: There is a growing need to apply population health knowledge with technological solutions to data transfer, integration, and reasoning, to improve health in a broader learning health system ecosystem. To achieve this, data must be combined from healthcare provider organizations, public health departments, and other settings. Public health entities are in a unique position to consume these data, however, most do not yet have the infrastructure required to integrate data sources and apply computable knowledge to combat this pandemic. Outcomes: Herein, we describe lessons learned and a framework to address these needs, which focus on: (a) identifying and filling technology "gaps"; (b) pursuing collaborative design of data sharing requirements and transmission mechanisms; (c) facilitating cross-domain discussions involving legal and research compliance; and (d) establishing or participating in multi-institutional convening or coordinating activities. Next steps: While by no means a comprehensive evaluation of such issues, we envision that many of our experiences are universal. We hope those elucidated can serve as the catalyst for a robust community-wide dialogue on what steps can and should be taken to ensure that our regional and national health care systems can truly learn, in a rapid manner, so as to respond to this and future emergent public health crises.

When past is not a prologue: Adapting informatics practice during a pandemic.

Data and information technology are key to every aspect of our response to the current coronavirus disease 2019 (COVID-19) pandemic-including the diagnosis of patients and delivery of care, the development of predictive models of disease spread, and the management of personnel and equipment. The increasing engagement of informaticians at the forefront of these efforts has been a fundamental shift, from an academic to an operational role. However, the past history of informatics as a scientific domain and an area of applied practice provides little guidance or prologue for the incredible challenges that we are now tasked with performing. Building on our recent experiences, we present 4 critical lessons learned that have helped shape our scalable, data-driven response to COVID-19. We describe each of these lessons within the context of specific solutions and strategies we applied in addressing the challenges that we faced.

Spot the difference: comparing results of analyses from real patient data and synthetic derivatives.

BACKGROUND: Synthetic data may provide a solution to researchers who wish to generate and share data in support of precision healthcare. Recent advances in data synthesis enable the creation and analysis of synthetic derivatives as if they were the original data; this process has significant advantages over data deidentification. OBJECTIVES: To assess a big-data platform with data-synthesizing capabilities (MDClone Ltd., Beer Sheva, Israel) for its ability to produce data that can be used for research purposes while obviating privacy and confidentiality concerns. METHODS: We explored three use cases and tested the robustness of synthetic data by comparing the results of analyses using synthetic derivatives to analyses using the original data using traditional statistics, machine learning approaches, and spatial representations of the data. We designed these use cases with the purpose of conducting analyses at the observation level (Use Case 1), patient cohorts (Use Case 2), and population-level data (Use Case 3). RESULTS: For each use case, the results of the analyses were sufficiently statistically similar (P > 0.05) between the synthetic derivative and the real data to draw the same conclusions. DISCUSSION AND CONCLUSION: This article presents the results of each use case and outlines key considerations for the use of synthetic data, examining their role in clinical research for faster insights and improved data sharing in support of precision healthcare.

Novel Visualization of Clostridium difficile Infections in Intensive Care Units.

BACKGROUND: Accurate and timely surveillance and diagnosis of healthcare-facility onset Clostridium difficile infection (HO-CDI) is vital to controlling infections within the hospital, but there are limited tools to assist with timely outbreak investigations. OBJECTIVES: To integrate spatiotemporal factors with HO-CDI cases and develop a map-based dashboard to support infection preventionists (IPs) in performing surveillance and outbreak investigations for HO-CDI. METHODS: Clinical laboratory results and Admit-Transfer-Discharge data for admitted patients over two years were extracted from the Information Warehouse of a large academic medical center and processed according to Center for Disease Control (CDC) National Healthcare Safety Network (NHSN) definitions to classify Clostridium difficile infection (CDI) cases by onset date. Results were validated against the internal infection surveillance database maintained by IPs in Clinical Epidemiology of this Academic Medical Center (AMC). Hospital floor plans were combined with HO-CDI case data, to create a dashboard of intensive care units. Usability testing was performed with a think-aloud session and a survey. RESULTS: The simple classification algorithm identified all 265 HO-CDI cases from 1/1/15-11/30/15 with a positive predictive value (PPV) of 96.3%. When applied to data from 2014, the PPV was 94.6% All users "strongly agreed" that the dashboard would be a positive addition to Clinical Epidemiology and would enable them to present Hospital Acquired Infection (HAI) information to others more efficiently. CONCLUSIONS: The CDI dashboard demonstrates the feasibility of mapping clinical data to hospital patient care units for more efficient surveillance and potential outbreak investigations.