RESUMO
OBJECTIVE: To address challenges in large-scale electronic health record (EHR) data exchange, we sought to develop, deploy, and test an open source, cloud-hosted app "listener" that accesses standardized data across the SMART/HL7 Bulk FHIR Access application programming interface (API). METHODS: We advance a model for scalable, federated, data sharing and learning. Cumulus software is designed to address key technology and policy desiderata including local utility, control, and administrative simplicity as well as privacy preservation during robust data sharing, and artificial intelligence (AI) for processing unstructured text. RESULTS: Cumulus relies on containerized, cloud-hosted software, installed within a healthcare organization's security envelope. Cumulus accesses EHR data via the Bulk FHIR interface and streamlines automated processing and sharing. The modular design enables use of the latest AI and natural language processing tools and supports provider autonomy and administrative simplicity. In an initial test, Cumulus was deployed across 5 healthcare systems each partnered with public health. Cumulus output is patient counts which were aggregated into a table stratifying variables of interest to enable population health studies. All code is available open source. A policy stipulating that only aggregate data leave the institution greatly facilitated data sharing agreements. DISCUSSION AND CONCLUSION: Cumulus addresses barriers to data sharing based on (1) federally required support for standard APIs, (2) increasing use of cloud computing, and (3) advances in AI. There is potential for scalability to support learning across myriad network configurations and use cases.
Assuntos
Inteligência Artificial , Registros Eletrônicos de Saúde , Humanos , Software , Computação em Nuvem , Interoperabilidade da Informação em Saúde , Disseminação de InformaçãoRESUMO
Genetic testing has become an essential component in the diagnosis and management of a wide range of clinical conditions, from cancer to developmental disorders, especially in rare Mendelian diseases. Efforts to identify rare phenotype-associated variants have predominantly focused on protein-truncating variants, while the interpretation of missense variants presents a considerable challenge. Deep learning algorithms excel in various applications across biomedical tasks1,2, yet accurately distinguishing between pathogenic and benign genetic variants remains an elusive goal3-5. Specifically, even the most sophisticated models encounter difficulties in accurately assessing the pathogenicity of missense variants of uncertain significance (VUS). Our investigation of AlphaMissense (AM)5, the latest iteration of deep learning methods for predicting the potential functional impact of missense variants and assessing gene essentiality, reveals important limitations in its ability to identify pathogenic missense variants within a rare disease cohort. Indeed, AM struggles to accurately assess the pathogenicity of variants in intrinsically disordered regions (IDRs), leading to unreliable gene-level essentiality scores for certain genes containing IDRs. This limitation highlights the challenges in applying AM faces in the context of clinical genetics6.
RESUMO
BACKGROUND: Real-time surveillance of emerging infectious diseases necessitates a dynamically evolving, computable case definition, which frequently incorporates symptom-related criteria. For symptom detection, both population health monitoring platforms and research initiatives primarily depend on structured data extracted from electronic health records. OBJECTIVE: This study sought to validate and test an artificial intelligence (AI)-based natural language processing (NLP) pipeline for detecting COVID-19 symptoms from physician notes in pediatric patients. We specifically study patients presenting to the emergency department (ED) who can be sentinel cases in an outbreak. METHODS: Subjects in this retrospective cohort study are patients who are 21 years of age and younger, who presented to a pediatric ED at a large academic children's hospital between March 1, 2020, and May 31, 2022. The ED notes for all patients were processed with an NLP pipeline tuned to detect the mention of 11 COVID-19 symptoms based on Centers for Disease Control and Prevention (CDC) criteria. For a gold standard, 3 subject matter experts labeled 226 ED notes and had strong agreement (F1-score=0.986; positive predictive value [PPV]=0.972; and sensitivity=1.0). F1-score, PPV, and sensitivity were used to compare the performance of both NLP and the International Classification of Diseases, 10th Revision (ICD-10) coding to the gold standard chart review. As a formative use case, variations in symptom patterns were measured across SARS-CoV-2 variant eras. RESULTS: There were 85,678 ED encounters during the study period, including 4% (n=3420) with patients with COVID-19. NLP was more accurate at identifying encounters with patients that had any of the COVID-19 symptoms (F1-score=0.796) than ICD-10 codes (F1-score =0.451). NLP accuracy was higher for positive symptoms (sensitivity=0.930) than ICD-10 (sensitivity=0.300). However, ICD-10 accuracy was higher for negative symptoms (specificity=0.994) than NLP (specificity=0.917). Congestion or runny nose showed the highest accuracy difference (NLP: F1-score=0.828 and ICD-10: F1-score=0.042). For encounters with patients with COVID-19, prevalence estimates of each NLP symptom differed across variant eras. Patients with COVID-19 were more likely to have each NLP symptom detected than patients without this disease. Effect sizes (odds ratios) varied across pandemic eras. CONCLUSIONS: This study establishes the value of AI-based NLP as a highly effective tool for real-time COVID-19 symptom detection in pediatric patients, outperforming traditional ICD-10 methods. It also reveals the evolving nature of symptom prevalence across different virus variants, underscoring the need for dynamic, technology-driven approaches in infectious disease surveillance.
Assuntos
Biovigilância , COVID-19 , Médicos , SARS-CoV-2 , Estados Unidos , Humanos , Criança , Inteligência Artificial , Estudos Retrospectivos , COVID-19/diagnóstico , COVID-19/epidemiologiaRESUMO
Objective: This study assesses the application of interpretable machine learning modeling using electronic medical record data for the prediction of conversion to neurological disease. Methods: A retrospective dataset of Cleveland Clinic patients diagnosed with Alzheimer's disease, amyotrophic lateral sclerosis, multiple sclerosis, or Parkinson's disease, and matched controls based on age, sex, race, and ethnicity was compiled. Individualized risk prediction models were created using eXtreme Gradient Boosting for each neurological disease at four timepoints in patient history. The prediction models were assessed for transparency and fairness. Results: At timepoints 0-months, 12-months, 24-months, and 60-months prior to diagnosis, Alzheimer's disease models achieved the area under the receiver operating characteristic curve on a holdout test dataset of 0.794, 0.742, 0.709, and 0.645; amyotrophic lateral sclerosis of 0.883, 0.710, 0.658, and 0.620; multiple sclerosis of 0.922, 0.877, 0.849, and 0.781; and Parkinson's disease of 0.809, 0.738, 0.700, and 0.651, respectively. Conclusions: The results demonstrate that electronic medical records contain latent information that can be used for risk stratification for neurological disorders. In particular, patient-reported outcomes, sleep assessments, falls data, additional disease diagnoses, and longitudinal changes in patient health, such as weight change, are important predictors.
RESUMO
Inhaled corticosteroids (ICS) are efficacious in the treatment of asthma, which affects more than 300 million people in the world. While genome-wide association studies have identified genes involved in differential treatment responses to ICS in asthma, few studies have evaluated the effects of combined rare and common variants on ICS response among children with asthma. Among children with asthma treated with ICS with whole exome sequencing (WES) data in the PrecisionLink Biobank (91 White and 20 Black children), we examined the effect and contribution of rare and common variants with hospitalizations or emergency department visits. For 12 regions previously associated with asthma and ICS response (DPP10, FBXL7, NDFIP1, TBXT, GLCCI1, HDAC9, TBXAS1, STAT6, GSDMB/ORMDL3, CRHR1, GNGT2, FCER2), we used the combined sum test for the sequence kernel association test (SKAT) adjusting for age, sex, and BMI and stratified by race. Validation was conducted in the Biorepository and Integrative Genomics (BIG) Initiative (83 White and 134 Black children). Using a Bonferroni threshold for the 12 regions tested (i.e., 0.05/12 = 0.004), GSDMB/ORMDL3 was significantly associated with ICS response for the combined effect of rare and common variants (p-value = 0.003) among White children in the PrecisionLink Biobank and replicated in the BIG Initiative (p-value = 0.02). Using WES data, the combined effect of rare and common variants for GSDMB/ORMDL3 was associated with ICS response among asthmatic children in the PrecisionLink Biobank and replicated in the BIG Initiative. This proof-of-concept study demonstrates the power of biobanks of pediatric real-life populations in asthma genomic investigations.
Assuntos
Corticosteroides , Asma , Gasderminas , Proteínas de Membrana , Humanos , Asma/tratamento farmacológico , Asma/genética , Criança , Feminino , Masculino , Corticosteroides/uso terapêutico , Corticosteroides/administração & dosagem , Administração por Inalação , Proteínas de Membrana/genética , Estudo de Associação Genômica Ampla , Adolescente , Pré-Escolar , Sequenciamento do Exoma , Polimorfismo de Nucleotídeo ÚnicoRESUMO
OBJECTIVE: To evaluate the real-world performance of the SMART/HL7 Bulk Fast Health Interoperability Resources (FHIR) Access Application Programming Interface (API), developed to enable push button access to electronic health record data on large populations, and required under the 21st Century Cures Act Rule. MATERIALS AND METHODS: We used an open-source Bulk FHIR Testing Suite at 5 healthcare sites from April to September 2023, including 4 hospitals using electronic health records (EHRs) certified for interoperability, and 1 Health Information Exchange (HIE) using a custom, standards-compliant API build. We measured export speeds, data sizes, and completeness across 6 types of FHIR. RESULTS: Among the certified platforms, Oracle Cerner led in speed, managing 5-16 million resources at over 8000 resources/min. Three Epic sites exported a FHIR data subset, achieving 1-12 million resources at 1555-2500 resources/min. Notably, the HIE's custom API outperformed, generating over 141 million resources at 12 000 resources/min. DISCUSSION: The HIE's custom API showcased superior performance, endorsing the effectiveness of SMART/HL7 Bulk FHIR in enabling large-scale data exchange while underlining the need for optimization in existing EHR platforms. Agility and scalability are essential for diverse health, research, and public health use cases. CONCLUSION: To fully realize the interoperability goals of the 21st Century Cures Act, addressing the performance limitations of Bulk FHIR API is critical. It would be beneficial to include performance metrics in both certification and reporting processes.
Assuntos
Troca de Informação em Saúde , Nível Sete de Saúde , Software , Registros Eletrônicos de Saúde , Atenção à SaúdeRESUMO
Objective: To address challenges in large-scale electronic health record (EHR) data exchange, we sought to develop, deploy, and test an open source, cloud-hosted app 'listener' that accesses standardized data across the SMART/HL7 Bulk FHIR Access application programming interface (API). Methods: We advance a model for scalable, federated, data sharing and learning. Cumulus software is designed to address key technology and policy desiderata including local utility, control, and administrative simplicity as well as privacy preservation during robust data sharing, and AI for processing unstructured text. Results: Cumulus relies on containerized, cloud-hosted software, installed within a healthcare organization's security envelope. Cumulus accesses EHR data via the Bulk FHIR interface and streamlines automated processing and sharing. The modular design enables use of the latest AI and natural language processing tools and supports provider autonomy and administrative simplicity. In an initial test, Cumulus was deployed across five healthcare systems each partnered with public health. Cumulus output is patient counts which were aggregated into a table stratifying variables of interest to enable population health studies. All code is available open source. A policy stipulating that only aggregate data leave the institution greatly facilitated data sharing agreements. Discussion and Conclusion: Cumulus addresses barriers to data sharing based on (1) federally required support for standard APIs (2), increasing use of cloud computing, and (3) advances in AI. There is potential for scalability to support learning across myriad network configurations and use cases.
RESUMO
OBJECTIVE: The 21st Century Cures Act Final Rule requires that certified electronic health records (EHRs) be able to export a patient's full set of electronic health information (EHI). This requirement becomes more powerful if EHI exports use interoperable application programming interfaces (APIs). We sought to advance the ecosystem, instantiating policy desiderata in a working reference implementation based on a consensus design. MATERIALS AND METHODS: We formulate a model for interoperable, patient-controlled, app-driven access to EHI exports in an open source reference implementation following the Argonaut FHIR Accelerator consensus implementation guide for EHI Export. RESULTS: The reference implementation, which asynchronously provides EHI across an API, has three central components: a web application for patients to request EHI exports, an EHI server to respond to requests, and an administrative export management web application to manage requests. It leverages mandated SMART on FHIR/Bulk FHIR APIs. DISCUSSION: A patient-controlled app enabling full EHI export from any EHR across an API could facilitate national-scale patient-directed information exchange. We hope releasing these tools sparks engagement from the health IT community to evolve the design, implement and test in real-world settings, and develop patient-facing apps. CONCLUSION: To advance regulatory innovation, we formulate a model that builds on existing requirements under the Cures Act Rule and takes a step toward an interoperable, scalable approach, simplifying patient access to their own health data; supporting the sharing of clinical data for both improved patient care and medical research; and encouraging the growth of an ecosystem of third-party applications.
Assuntos
Ecossistema , Software , Humanos , Registros Eletrônicos de Saúde , Assistência ao Paciente , Cooperação do PacienteRESUMO
Patients' online record access (ORA) is growing worldwide. In some countries, including the United States and Sweden, access is advanced with patients obtaining rapid access to their full records on the web including laboratory and test results, lists of prescribed medications, vaccinations, and even the very narrative reports written by clinicians (the latter, commonly referred to as "open notes"). In the United States, patient's ORA is also available in a downloadable form for use with other apps. While survey studies have shown that some patients report many benefits from ORA, there remain challenges with implementation around writing clinical documentation that patients may now read. With ORA, the functionality of the record is evolving; it is no longer only an aide memoire for doctors but also a communication tool for patients. Studies suggest that clinicians are changing how they write documentation, inviting worries about accuracy and completeness. Other concerns include work burdens; while few objective studies have examined the impact of ORA on workload, some research suggests that clinicians are spending more time writing notes and answering queries related to patients' records. Aimed at addressing some of these concerns, clinician and patient education strategies have been proposed. In this viewpoint paper, we explore these approaches and suggest another longer-term strategy: the use of generative artificial intelligence (AI) to support clinicians in documenting narrative summaries that patients will find easier to understand. Applied to narrative clinical documentation, we suggest that such approaches may significantly help preserve the accuracy of notes, strengthen writing clarity and signals of empathy and patient-centered care, and serve as a buffer against documentation work burdens. However, we also consider the current risks associated with existing generative AI. We emphasize that for this innovation to play a key role in ORA, the cocreation of clinical notes will be imperative. We also caution that clinicians will need to be supported in how to work alongside generative AI to optimize its considerable potential.
Assuntos
Inteligência Artificial , Idioma , Humanos , Comunicação , Documentação , EmpatiaRESUMO
OBJECTIVE: To quantify the increase in pediatric patients presenting to the emergency department with suicidality before and during the COVID-19 pandemic, and the subsequent impact on emergency department length of stay and boarding. METHODS: This retrospective cohort study from June 1, 2016, to October 31, 2022, identified patients ages 6 to 21 presenting to the emergency department at a pediatric academic medical center with suicidality using ICD-10 codes. Number of emergency department encounters for suicidality, demographic characteristics of patients with suicidality, and emergency department length of stay were compared before and during the COVID-19 pandemic. Unobserved components models were used to describe monthly counts of emergency department encounters for suicidality. RESULTS: There were 179,736 patient encounters to the emergency department during the study period, 6,215 (3.5%) for suicidality. There were, on average, more encounters for suicidality each month during the COVID-19 pandemic than before the COVID-19 pandemic. A time series unobserved components model demonstrated a temporary drop of 32.7 encounters for suicidality in April and May of 2020 (p<0.001), followed by a sustained increase of 31.2 encounters starting in July 2020 (p = 0.003). The average length of stay for patients that boarded in the emergency department with a diagnosis of suicidality was 37.4 hours longer during the COVID-19 pandemic compared to before the COVID-19 pandemic (p<0.001). CONCLUSIONS: The number of encounters for suicidality among pediatric patients and the emergency department length of stay for psychiatry boarders has increased during the COVID-19 pandemic. There is a need for acute care mental health services and solutions to emergency department capacity issues.
Assuntos
COVID-19 , Suicídio , Humanos , Criança , Estudos Retrospectivos , Pandemias , COVID-19/epidemiologia , Serviço Hospitalar de EmergênciaRESUMO
Though electronic health record (EHR) systems are a rich repository of clinical information with large potential, the use of EHR-based phenotyping algorithms is often hindered by inaccurate diagnostic records, the presence of many irrelevant features, and the requirement for a human-labeled training set. In this paper, we describe a knowledge-driven online multimodal automated phenotyping (KOMAP) system that i) generates a list of informative features by an online narrative and codified feature search engine (ONCE) and ii) enables the training of a multimodal phenotyping algorithm based on summary data. Powered by composite knowledge from multiple EHR sources, online article corpora, and a large language model, features selected by ONCE show high concordance with the state-of-the-art AI models (GPT4 and ChatGPT) and encourage large-scale phenotyping by providing a smaller but highly relevant feature set. Validation of the KOMAP system across four healthcare centers suggests that it can generate efficient phenotyping algorithms with robust performance. Compared to other methods requiring patient-level inputs and gold-standard labels, the fully online KOMAP provides a significant opportunity to enable multi-center collaboration.
RESUMO
Objective: To evaluate the real-world performance in delivering patient data on populations, of the SMART/HL7 Bulk FHIR Access API, required in Electronic Health Records (EHRs) under the 21st Century Cures Act Rule. Materials and Methods: We used an open-source Bulk FHIR Testing Suite at five healthcare sites from April to September 2023, including four hospitals using EHRs certified for interoperability, and one Health Information Exchange (HIE) using a custom, standards-compliant API build. We measured export speeds, data sizes, and completeness across six types of FHIR resources. Results: Among the certified platforms, Oracle Cerner led in speed, managing 5-16 million resources at over 8,000 resources/min. Three Epic sites exported a FHIR data subset, achieving 1-12 million resources at 1,555-2,500 resources/min. Notably, the HIE's custom API outperformed, generating over 141 million resources at 12,000 resources/min. Discussion: The HIE's custom API showcased superior performance, endorsing the effectiveness of SMART/HL7 Bulk FHIR in enabling large-scale data exchange while underlining the need for optimization in existing EHR platforms. Agility and scalability are essential for diverse health, research, and public health use cases. Conclusion: To fully realize the interoperability goals of the 21st Century Cures Act, addressing the performance limitations of Bulk FHIR API is critical. It would be beneficial to include performance metrics in both certification and reporting processes.
RESUMO
Participatory surveillance systems crowdsource individual reports to rapidly assess population health phenomena. The value of these systems increases when more people join and persistently contribute. We examine the level of and factors associated with engagement in participatory surveillance among a retrospective, national-scale cohort of individuals using smartphone-connected thermometers with a companion app that allows them to report demographic and symptom information. Between January 1, 2020 and October 29, 2022, 1,325,845 participants took 20,617,435 temperature readings, yielding 3,529,377 episodes of consecutive readings. There were 1,735,805 (49.2%) episodes with self-reported symptoms (including reports of no symptoms). Compared to before the pandemic, participants were more likely to report their symptoms during pandemic waves, especially after the winter wave began (September 13, 2020) (OR across pandemic periods range from 3.0 to 4.0). Further, symptoms were more likely to be reported during febrile episodes (OR = 2.6, 95% CI = 2.6-2.6), and for new participants, during their first episode (OR = 2.4, 95% CI = 2.4-2.5). Compared with participants aged 50-65 years old, participants over 65 years were less likely to report their symptoms (OR = 0.3, 95% CI = 0.3-0.3). Participants in a household with both adults and children (OR = 1.6 [1.6-1.7]) were more likely to report symptoms. We find that the use of smart thermometers with companion apps facilitates the collection of data on a large, national scale, and provides real time insight into transmissible disease phenomena. Nearly half of individuals using these devices are willing to report their symptoms after taking their temperature, although participation varies among individuals and over pandemic stages.
RESUMO
Background: Multisystem inflammatory syndrome in children (MIS-C) is a severe complication of SARS-CoV-2 infection. It remains unclear how MIS-C phenotypes vary across SARS-CoV-2 variants. We aimed to investigate clinical characteristics and outcomes of MIS-C across SARS-CoV-2 eras. Methods: We performed a multicentre observational retrospective study including seven paediatric hospitals in four countries (France, Spain, U.K., and U.S.). All consecutive confirmed patients with MIS-C hospitalised between February 1st, 2020, and May 31st, 2022, were included. Electronic Health Records (EHR) data were used to calculate pooled risk differences (RD) and effect sizes (ES) at site level, using Alpha as reference. Meta-analysis was used to pool data across sites. Findings: Of 598 patients with MIS-C (61% male, 39% female; mean age 9.7 years [SD 4.5]), 383 (64%) were admitted in the Alpha era, 111 (19%) in the Delta era, and 104 (17%) in the Omicron era. Compared with patients admitted in the Alpha era, those admitted in the Delta era were younger (ES -1.18 years [95% CI -2.05, -0.32]), had fewer respiratory symptoms (RD -0.15 [95% CI -0.33, -0.04]), less frequent non-cardiogenic shock or systemic inflammatory response syndrome (SIRS) (RD -0.35 [95% CI -0.64, -0.07]), lower lymphocyte count (ES -0.16 × 109/uL [95% CI -0.30, -0.01]), lower C-reactive protein (ES -28.5 mg/L [95% CI -46.3, -10.7]), and lower troponin (ES -0.14 ng/mL [95% CI -0.26, -0.03]). Patients admitted in the Omicron versus Alpha eras were younger (ES -1.6 years [95% CI -2.5, -0.8]), had less frequent SIRS (RD -0.18 [95% CI -0.30, -0.05]), lower lymphocyte count (ES -0.39 × 109/uL [95% CI -0.52, -0.25]), lower troponin (ES -0.16 ng/mL [95% CI -0.30, -0.01]) and less frequently received anticoagulation therapy (RD -0.19 [95% CI -0.37, -0.04]). Length of hospitalization was shorter in the Delta versus Alpha eras (-1.3 days [95% CI -2.3, -0.4]). Interpretation: Our study suggested that MIS-C clinical phenotypes varied across SARS-CoV-2 eras, with patients in Delta and Omicron eras being younger and less sick. EHR data can be effectively leveraged to identify rare complications of pandemic diseases and their variation over time. Funding: None.
RESUMO
BACKGROUND: Unravelling the relationships between candidate genes and autism spectrum disorder (ASD) phenotypes remains an outstanding challenge. Endophenotypes, defined as inheritable, measurable quantitative traits, might provide intermediary links between genetic risk factors and multifaceted ASD phenotypes. In this study, we sought to determine whether plasma metabolite levels could serve as endophenotypes in individuals with ASD and their family members. METHODS: We employed an untargeted, high-resolution metabolomics platform to analyse 14,342 features across 1099 plasma samples. These samples were collected from probands and their family members participating in the Autism Genetic Resource Exchange (AGRE) (N = 658), compared with neurotypical individuals enrolled in the PrecisionLink Health Discovery (PLHD) program at Boston Children's Hospital (N = 441). We conducted a metabolite quantitative trait loci (mQTL) analysis using whole-genome genotyping data from each cohort in AGRE and PLHD, aiming to prioritize significant mQTL and metabolite pairs that were exclusively observed in AGRE. FINDINGS: Within the AGRE group, we identified 54 significant associations between genotypes and metabolite levels (P < 5.27 × 10-11), 44 of which were not observed in the PLHD group. Plasma glutamine levels were found to be associated with variants in the NLGN1 gene, a gene that encodes post-synaptic cell-adhesion molecules in excitatory neurons. This association was not detected in the PLHD group. Notably, a significant negative correlation between plasma glutamine and glutamate levels was observed in the AGRE group, but not in the PLHD group. Furthermore, plasma glutamine levels showed a negative correlation with the severity of restrictive and repetitive behaviours (RRB) in ASD, although no direct association was observed between RRB severity and the NLGN1 genotype. INTERPRETATION: Our findings suggest that plasma glutamine levels could potentially serve as an endophenotype, thus establishing a link between the genetic risk associated with NLGN1 and the severity of RRB in ASD. This identified association could facilitate the development of novel therapeutic targets, assist in selecting specific cohorts for clinical trials, and provide insights into target symptoms for future ASD treatment strategies. FUNDING: This work was supported by the National Institute of Health (grant numbers: R01MH107205, U01TR002623, R24OD024622, OT2OD032720, and R01NS129188) and the PrecisionLink Biobank for Health Discovery at Boston Children's Hospital.
Assuntos
Transtorno do Espectro Autista , Glutamina , Criança , Humanos , Transtorno do Espectro Autista/sangue , Transtorno do Espectro Autista/genética , Transtorno do Espectro Autista/metabolismo , Endofenótipos , Genótipo , Glutamina/sangue , Polimorfismo de Nucleotídeo ÚnicoRESUMO
Objective: To identify a cohort of COVID-19 cases, including when evidence of virus positivity was only mentioned in the clinical text, not in structured laboratory data in the electronic health record (EHR). Materials and Methods: Statistical classifiers were trained on feature representations derived from unstructured text in patient EHRs. We used a proxy dataset of patients with COVID-19 polymerase chain reaction (PCR) tests for training. We selected a model based on performance on our proxy dataset and applied it to instances without COVID-19 PCR tests. A physician reviewed a sample of these instances to validate the classifier. Results: On the test split of the proxy dataset, our best classifier obtained 0.56 F1, 0.6 precision, and 0.52 recall scores for SARS-CoV2 positive cases. In an expert validation, the classifier correctly identified 97.6% (81/84) as COVID-19 positive and 97.8% (91/93) as not SARS-CoV2 positive. The classifier labeled an additional 960 cases as not having SARS-CoV2 lab tests in hospital, and only 177 of those cases had the ICD-10 code for COVID-19. Discussion: Proxy dataset performance may be worse because these instances sometimes include discussion of pending lab tests. The most predictive features are meaningful and interpretable. The type of external test that was performed is rarely mentioned. Conclusion: COVID-19 cases that had testing done outside of the hospital can be reliably detected from the text in EHRs. Training on a proxy dataset was a suitable method for developing a highly performant classifier without labor-intensive labeling efforts.
RESUMO
Importance: Children's role in spreading virus during the COVID-19 pandemic is yet to be elucidated, and measuring household transmission traditionally requires contact tracing. Objective: To discern children's role in household viral transmission during the pandemic when enveloped viruses were at historic lows and the predominance of viral illnesses were attributed to COVID-19. Design, Setting, and Participants: This cohort study of a voluntary US cohort tracked data from participatory surveillance using commercially available thermometers with a companion smartphone app from October 2019 to October 2022. Eligible participants were individuals with temperature measurements in households with multiple members between October 2019 and October 2022 who opted into data sharing. Main Outcomes and Measures: Proportion of household transmissions with a pediatric index case and changes in transmissions during school breaks were assessed using app and thermometer data. Results: A total of 862â¯577 individuals from 320â¯073 households with multiple participants (462â¯000 female [53.6%] and 463â¯368 adults [53.7%]) were included. The number of febrile episodes forecast new COVID-19 cases. Within-household transmission was inferred in 54â¯506 (15.4%) febrile episodes and increased from the fourth pandemic period, March to July 2021 (3263 of 32â¯294 [10.1%]) to the Omicron BA.1/BA.2 wave (16â¯516 of 94â¯316 [17.5%]; P < .001). Among 38â¯787 transmissions in 166â¯170 households with adults and children, a median (IQR) 70.4% (61.4%-77.6%) had a pediatric index case; proportions fluctuated weekly from 36.9% to 84.6%. A pediatric index case was 0.6 to 0.8 times less frequent during typical school breaks. The winter break decrease was from 68.4% (95% CI, 57.1%-77.8%) to 41.7% (95% CI, 34.3%-49.5%) at the end of 2020 (P < .001). At the beginning of 2022, it dropped from 80.3% (95% CI, 75.1%-84.6%) to 54.5% (95% CI, 51.3%-57.7%) (P < .001). During summer breaks, rates dropped from 81.4% (95% CI, 74.0%-87.1%) to 62.5% (95% CI, 56.3%-68.3%) by August 2021 (P = .02) and from 83.8% (95% CI, 79.2%-87.5) to 62.8% (95% CI, 57.1%-68.1%) by July 2022 (P < .001). These patterns persisted over 2 school years. Conclusions and Relevance: In this cohort study using participatory surveillance to measure within-household transmission at a national scale, we discerned an important role for children in the spread of viral infection within households during the COVID-19 pandemic, heightened when schools were in session, supporting a role for school attendance in COVID-19 spread.
Assuntos
COVID-19 , Viroses , Adulto , Criança , Humanos , Feminino , COVID-19/epidemiologia , Pandemias , Termômetros , Estudos de Coortes , Viroses/epidemiologiaRESUMO
Objective: To implement an open source, free, and easily deployable high throughput natural language processing module to extract concepts from clinician notes and map them to Fast Healthcare Interoperability Resources (FHIR). Materials and Methods: Using a popular open-source NLP tool (Apache cTAKES), we create FHIR resources that use modifier extensions to represent negation and NLP sourcing, and another extension to represent provenance of extracted concepts. Results: The SMART Text2FHIR Pipeline is an open-source tool, released through standard package managers, and publicly available container images that implement the mappings, enabling ready conversion of clinical text to FHIR. Discussion: With the increased data liquidity because of new interoperability regulations, NLP processes that can output FHIR can enable a common language for transporting structured and unstructured data. This framework can be valuable for critical public health or clinical research use cases. Conclusion: Future work should include mapping more categories of NLP-extracted information into FHIR resources and mappings from additional open-source NLP tools.
RESUMO
Objective: To identify a cohort of COVID-19 cases, including when evidence of virus positivity was only mentioned in the clinical text, not in structured laboratory data in the electronic health record (EHR). Materials and Methods: Statistical classifiers were trained on feature representations derived from unstructured text in patient electronic health records (EHRs). We used a proxy dataset of patients with COVID-19 polymerase chain reaction (PCR) tests for training. We selected a model based on performance on our proxy dataset and applied it to instances without COVID-19 PCR tests. A physician reviewed a sample of these instances to validate the classifier. Results: On the test split of the proxy dataset, our best classifier obtained 0.56 F1, 0.6 precision, and 0.52 recall scores for SARS-CoV2 positive cases. In an expert validation, the classifier correctly identified 90.8% (79/87) as COVID-19 positive and 97.8% (91/93) as not SARS-CoV2 positive. The classifier identified an additional 960 positive cases that did not have SARS-CoV2 lab tests in hospital, and only 177 of those cases had the ICD-10 code for COVID-19. Discussion: Proxy dataset performance may be worse because these instances sometimes include discussion of pending lab tests. The most predictive features are meaningful and interpretable. The type of external test that was performed is rarely mentioned. Conclusion: COVID-19 cases that had testing done outside of the hospital can be reliably detected from the text in EHRs. Training on a proxy dataset was a suitable method for developing a highly performant classifier without labor intensive labeling efforts.