Retrospective study of propionic acidemia using natural language processing in Mayo Clinic electronic health record data.

BACKGROUND: Propionic acidemia (PA) is a rare autosomal recessive organic acidemia that classically presents within the first days of life with a metabolic crisis or via newborn screening and is confirmed with laboratory tests. Limited data exist on the natural history of patients with PA describing presentation, treatments, and clinical outcomes. OBJECTIVE: To retrospectively describe the natural history of patients with PA in a clinical setting from a real-world database using both structured and unstructured electronic health record (EHR) data using novel data extraction techniques in a unique care setting. DESIGN/METHODS: This retrospective study used EHR data to identify patients with PA seen at the Mayo Clinic. Unstructured clinical text (medical notes, pathology reports) were analyzed using augmented curation natural language processing models to enhance analysis of data extracted by structured data fields (International Classification of Diseases 9th or 10th revision [ICD-9/-10] codes, Current Procedural Terminology [CPT] codes, and medication orders). De-identified health records were also manually reviewed by clinical scientists to ensure data accuracy and completeness. The index date was defined as the patient's date of PA diagnosis at the Mayo Clinic. Results were reported as aggregate descriptive statistics relative to patients' index dates. Complications, therapeutic interventions, laboratory tests, procedures, and hospitalization encounters related to PA were described at and within 6 months of the patient's index date, and from medical history available before the index date. RESULTS: In total, 13 patients with PA were identified, with visits occurring from 1998 to 2022. Age at diagnosis ranged from birth to 3 years; age at initial evaluation at the Mayo Clinic ranged from 3 days to 28 years. The mean number of Mayo Clinic outpatient visits was 31 (median duration of care, 2 years). PA-related complications were documented in 85% of patients and included nutritional difficulties (46%), metabolic decompensation events (MDEs; 38%), neurologic abnormalities (38%), and cardiomyopathy (7%). One pair of affected siblings had mild symptoms and no complications or MDEs. All 5 patients with a history of MDEs presented with developmental delays. Among patients with MDEs, the mean frequency of outpatient clinical care visits was 10 per year, and 3 patients required inpatient hospitalization (mean duration, 16 days). The incidence of severe complications was higher among patients with MDEs than those without MDEs. Of the patients with MDEs, 2 experienced crises while receiving treatment at the Mayo Clinic, with 9 total MDEs occurring between the 2 patients. Symptoms at presentation included hyperammonemia (78%), fever and/or decreased nutritional intake (67%), hyperglycemia/hypoglycemia (56%), intercurrent upper respiratory infection and/or lethargy (44%), constipation (33%), altered mental status (33%), and cough (33%). CONCLUSIONS: This study highlights the range and frequency of clinical outcomes experienced by patients with PA and demonstrates the clinical burden of MDEs.

Identification and Characterization of Immune Checkpoint Inhibitor-Induced Toxicities From Electronic Health Records Using Natural Language Processing.

PURPOSE: Immune checkpoint inhibitors (ICIs) have revolutionized cancer treatment, yet their use is associated with immune-related adverse events (irAEs). Estimating the prevalence and patient impact of these irAEs in the real-world data setting is critical for characterizing the benefit/risk profile of ICI therapies beyond the clinical trial population. Diagnosis codes, such as International Classification of Diseases codes, do not comprehensively illustrate a patient's care journey and offer no insight into drug-irAE causality. This study aims to capture the relationship between ICIs and irAEs more accurately by using augmented curation (AC), a natural language processing-based innovation, on unstructured data in electronic health records. METHODS: In a cohort of 9,290 patients treated with ICIs at Mayo Clinic from 2005 to 2021, we compared the prevalence of irAEs using diagnosis codes and AC models, which classify drug-irAE pairs in clinical notes with implied textual causality. Four illustrative irAEs with high patient impact-myocarditis, encephalitis, pneumonitis, and severe cutaneous adverse reactions, abbreviated as MEPS-were analyzed using corticosteroid administration and ICI discontinuation as proxies of severity. RESULTS: For MEPS, only 70% (n = 118) of patients found by AC were also identified by diagnosis codes. Using AC models, patients with MEPS received corticosteroids for their respective irAE 82% of the time and permanently discontinued the ICI because of the irAE 35.9% (n = 115) of the time. CONCLUSION: Overall, AC models enabled more accurate identification and assessment of patient impact of ICI-induced irAEs not found using diagnosis codes, demonstrating a novel and more efficient strategy to assess real-world clinical outcomes in patients treated with ICIs.

Expanding repertoire of SARS-CoV-2 deletion mutations contributes to evolution of highly transmissible variants.

The emergence of highly transmissible SARS-CoV-2 variants and vaccine breakthrough infections globally mandated the characterization of the immuno-evasive features of SARS-CoV-2. Here, we systematically analyzed 2.13 million SARS-CoV-2 genomes from 188 countries/territories (up to June 2021) and performed whole-genome viral sequencing from 102 COVID-19 patients, including 43 vaccine breakthrough infections. We identified 92 Spike protein mutations that increased in prevalence during at least one surge in SARS-CoV-2 test positivity in any country over a 3-month window. Deletions in the Spike protein N-terminal domain were highly enriched for these 'surge-associated mutations' (Odds Ratio = 14.19, 95% CI 6.15-32.75, p value = 3.41 × 10-10). Based on a longitudinal analysis of mutational prevalence globally, we found an expanding repertoire of Spike protein deletions proximal to an antigenic supersite in the N-terminal domain that may be one of the key contributors to the evolution of highly transmissible variants. Finally, we generated clinically annotated SARS-CoV-2 whole genome sequences from 102 patients and identified 107 unique mutations, including 78 substitutions and 29 deletions. In five patients, we identified distinct deletions between residues 85-90, which reside within a linear B cell epitope. Deletions in this region arose contemporaneously on a diverse background of variants across the globe since December 2020. Overall, our findings based on genomic-epidemiology and clinical surveillance suggest that the genomic deletion of dispensable antigenic regions in SARS-CoV-2 may contribute to the evasion of immune responses and the evolution of highly transmissible variants.

SARS-CoV-2 and influenza coinfection throughout the COVID-19 pandemic: an assessment of coinfection rates, cohort characteristics, and clinical outcomes.

Case reports of patients infected with COVID-19 and influenza virus ("flurona") have raised questions around the prevalence and severity of coinfection. Using data from HHS Protect Public Data Hub, NCBI Virus, and CDC FluView, we analyzed trends in SARS-CoV-2 and influenza hospitalized coinfection cases and strain prevalences. We also characterized coinfection cases across the Mayo Clinic Enterprise from January 2020 to April 2022. We compared expected and observed coinfection case counts across different waves of the pandemic and assessed symptoms and outcomes of coinfection and COVID-19 monoinfection cases after propensity score matching on clinically relevant baseline characteristics. From both the Mayo Clinic and nationwide datasets, the observed coinfection rate for SARS-CoV-2 and influenza has been higher during the Omicron era (2021 December 14 to 2022 April 2) compared to previous waves, but no higher than expected assuming infection rates are independent. At the Mayo Clinic, only 120 coinfection cases were observed among 197,364 SARS-CoV-2 cases. Coinfected patients were relatively young (mean age: 26.7 years) and had fewer serious comorbidities compared to monoinfected patients. While there were no significant differences in 30-day hospitalization, ICU admission, or mortality rates between coinfected and matched COVID-19 monoinfection cases, coinfection cases reported higher rates of symptoms including congestion, cough, fever/chills, headache, myalgia/arthralgia, pharyngitis, and rhinitis. While most coinfection cases observed at the Mayo Clinic occurred among relatively healthy individuals, further observation is needed to assess outcomes among subpopulations with risk factors for severe COVID-19 such as older age, obesity, and immunocompromised status.

Surveillance of Safety of 3 Doses of COVID-19 mRNA Vaccination Using Electronic Health Records.

Importance: Recent reports on waning of COVID-19 vaccine-induced immunity have led to the approval and rollout of additional doses and booster vaccinations. Individuals at increased risk of SARS-CoV-2 infection are receiving additional vaccine doses in addition to the regimen that was tested in clinical trials. Risks and adverse event profiles associated with additional vaccine doses are currently not well understood. Objective: To evaluate the safety of third-dose vaccination with US Food and Drug Administration (FDA)-approved COVID-19 mRNA vaccines. Design, Setting, and Participants: This cohort study was conducted using electronic health record (EHR) data from December 2020 to October 2021 from the multistate Mayo Clinic Enterprise. Participants included all 47 999 individuals receiving 3-dose COVID-19 mRNA vaccines within the study setting who met study inclusion criteria. Participants were divided into 2 cohorts by vaccine brand administered and served as their own control groups, with no comparison made between cohorts. Data were analyzed from September through November 2021. Exposures: Three doses of an FDA-authorized COVID-19 mRNA vaccine, BNT162b2 or mRNA-1273. Main Outcomes and Measures: Vaccine-associated adverse events were assessed via EHR report. Adverse event risk was quantified using the percentage of study participants who reported the adverse event within 14 days after each vaccine dose and during a 14-day control period, immediately preceding the first vaccine dose. Results: Among 47 999 individuals who received 3-dose COVID-19 mRNA vaccines, 38 094 individuals (21 835 [57.3%] women; median [IQR] age, 67.4 [52.5-76.5] years) received BNT162b2 (79.4%) and 9905 individuals (5099 [51.5%] women; median [IQR] age, 67.7 [59.5-73.9] years) received mRNA-1273 (20.6%). Reporting of severe adverse events remained low after the third vaccine dose, with rates of pericarditis (0.01%; 95% CI, 0%-0.02%), anaphylaxis (0%; 95% CI, 0%-0.01%), myocarditis (0%; 95% CI, 0%-0.01%), and cerebral venous sinus thrombosis (no individuals) consistent with results from earlier studies. Significantly more individuals reported low-severity adverse events after the third dose compared with after the second dose, including fatigue (2360 individuals [4.92%] vs 1665 individuals [3.47%]; P < .001), lymphadenopathy (1387 individuals [2.89%] vs 995 individuals [2.07%]; P < .001), nausea (1259 individuals [2.62%] vs 979 individuals [2.04%]; P < .001), headache (1185 individuals [2.47%] vs 992 individuals [2.07%]; P < .001), arthralgia (1019 individuals [2.12%] vs 816 individuals [1.70%]; P < .001), myalgia (956 individuals [1.99%] vs 784 individuals [1.63%]; P < .001), diarrhea (817 individuals [1.70%] vs 595 individuals [1.24%]; P < .001), fever (533 individuals [1.11%] vs 391 individuals [0.81%]; P < .001), vomiting (528 individuals [1.10%] vs 385 individuals [0.80%]; P < .001), and chills (224 individuals [0.47%] vs 175 individuals [0.36%]; P = .01). Conclusions and Relevance: This study found that although third-dose vaccination against SARS-CoV-2 infection was associated with increased reporting of low-severity adverse events, risk of severe adverse events remained comparable with risk associated with the standard 2-dose regime. These findings suggest the safety of third vaccination doses in individuals who were eligible for booster vaccination at the time of this study.

Comparative effectiveness of mRNA-1273 and BNT162b2 against symptomatic SARS-CoV-2 infection.

BACKGROUND: mRNA coronavirus disease 2019 (COVID-19) vaccines are safe and effective, but increasing reports of breakthrough infections highlight the need to vigilantly monitor and compare the effectiveness of these vaccines. METHODS: We retrospectively compared protection against symptomatic infection conferred by mRNA-1273 and BNT162b2 at Mayo Clinic sites from December 2020 to September 2021. We used a test-negative case-control design to estimate vaccine effectiveness (VE) and to compare the odds of symptomatic infection after full vaccination with mRNA-1273 versus BNT162b2, while adjusting for age, sex, race, ethnicity, geography, comorbidities, and calendar time of vaccination and testing. FINDINGS: Both vaccines were highly effective over the study duration (VEmRNA-1273: 84.1%, 95% confidence interval [CI]: 81.6%-86.2%; VEBNT162b2: 75.6%, 95% CI: 72.2%-78.7%), but their effectiveness was reduced during July-September (VEmRNA-1273: 75.6%, 95% CI: 70.1%-80%; VEBNT162b2: 63.5%, 95% CI: 55.8%-69.9%) as compared to December-May (VEmRNA-1273: 93.7%, 95% CI: 90.4%-95.9%; VEBNT162b2: 85.7%, 95% CI: 81.4%-88.9%). Adjusted for demographic characteristics, clinical comorbidities, time of vaccination, and time of testing, the odds of experiencing a symptomatic breakthrough infection were lower after full vaccination with mRNA-1273 than with BNT162b2 (odds ratio: 0.60; 95% CI: 0.55-0.67). CONCLUSIONS: Both mRNA-1273 and BNT162b2 strongly protect against symptomatic severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection. It is imperative to continue monitoring and comparing available vaccines over time and with respect to emerging variants to inform public and global health decisions. FUNDING: This study was funded by nference.

Comparison of two highly-effective mRNA vaccines for COVID-19 during periods of Alpha and Delta variant prevalence.

Although clinical trials and real-world studies have affirmed the effectiveness and safety of the FDA-authorized COVID-19 vaccines, reports of breakthrough infections and persistent emergence of new variants highlight the need to vigilantly monitor the effectiveness of these vaccines. Here we compare the effectiveness of two full-length Spike protein-encoding mRNA vaccines from Moderna (mRNA-1273) and Pfizer/BioNTech (BNT162b2) in the Mayo Clinic Health System over time from January to July 2021, during which either the Alpha or Delta variant was highly prevalent. We defined cohorts of vaccinated and unvaccinated individuals from Minnesota (n = 25,589 each) matched on age, sex, race, history of prior SARS-CoV-2 PCR testing, and date of full vaccination. Both vaccines were highly effective during this study period against SARS-CoV-2 infection (mRNA-1273: 86%, 95%CI: 81-90.6%; BNT162b2: 76%, 95%CI: 69-81%) and COVID-19 associated hospitalization (mRNA-1273: 91.6%, 95% CI: 81-97%; BNT162b2: 85%, 95% CI: 73-93%). In July, vaccine effectiveness against hospitalization has remained high (mRNA-1273: 81%, 95% CI: 33-96.3%; BNT162b2: 75%, 95% CI: 24-93.9%), but effectiveness against infection was lower for both vaccines (mRNA-1273: 76%, 95% CI: 58-87%; BNT162b2: 42%, 95% CI: 13-62%), with a more pronounced reduction for BNT162b2. Notably, the Delta variant prevalence in Minnesota increased from 0.7% in May to over 70% in July whereas the Alpha variant prevalence decreased from 85% to 13% over the same time period. Comparing rates of infection between matched individuals fully vaccinated with mRNA-1273 versus BNT162b2 across Mayo Clinic Health System sites in multiple states (Minnesota, Wisconsin, Arizona, Florida, and Iowa), mRNA-1273 conferred a two-fold risk reduction against breakthrough infection compared to BNT162b2 (IRR = 0.50, 95% CI: 0.39-0.64). In Florida, which is currently experiencing its largest COVID-19 surge to date, the risk of infection in July after full vaccination with mRNA-1273 was about 60% lower than after full vaccination with BNT162b2 (IRR: 0.39, 95% CI: 0.24-0.62). Our observational study highlights that while both mRNA COVID-19 vaccines strongly protect against infection and severe disease, further evaluation of mechanisms underlying differences in their effectiveness such as dosing regimens and vaccine composition are warranted.

Real-time analysis of a mass vaccination effort confirms the safety of FDA-authorized mRNA COVID-19 vaccines.

BACKGROUND: As the coronavirus disease 2019 (COVID-19) vaccination campaign unfolds, it is important to continuously assess the real-world safety of Food and Drug Administration (FDA)-authorized vaccines. Curation of large-scale electronic health records (EHRs) enables near-real-time safety evaluations that were not previously possible. METHODS: In this retrospective study, we deployed deep neural networks over a large EHR system to automatically curate the adverse effects mentioned by physicians in over 1.2 million clinical notes between December 1, 2020 and April 20, 2021. We compared notes from 68,266 individuals who received at least one dose of BNT162b2 (n = 51,795) or mRNA-1273 (n = 16,471) to notes from 68,266 unvaccinated individuals who were matched by demographic, geographic, and clinical features. FINDINGS: Individuals vaccinated with BNT162b2 or mRNA-1273 had a higher rate of return to the clinic, but not the emergency department, after both doses compared to unvaccinated controls. The most frequently documented adverse effects within 7 days of each vaccine dose included myalgia, headache, and fatigue, but the rates of EHR documentation for each side effect were remarkably low compared to those derived from active solicitation during clinical trials. Severe events, including anaphylaxis, facial paralysis, and cerebral venous sinus thrombosis, were rare and occurred at similar frequencies in vaccinated and unvaccinated individuals. CONCLUSIONS: This analysis of vaccine-related adverse effects from over 1.2 million EHR notes of more than 130,000 individuals reaffirms the safety and tolerability of the FDA-authorized mRNA COVID-19 vaccines in practice. FUNDING: This study was funded by nference.

Augmented curation of clinical notes from a massive EHR system reveals symptoms of impending COVID-19 diagnosis.

Understanding temporal dynamics of COVID-19 symptoms could provide fine-grained resolution to guide clinical decision-making. Here, we use deep neural networks over an institution-wide platform for the augmented curation of clinical notes from 77,167 patients subjected to COVID-19 PCR testing. By contrasting Electronic Health Record (EHR)-derived symptoms of COVID-19-positive (COVIDpos; n = 2,317) versus COVID-19-negative (COVIDneg; n = 74,850) patients for the week preceding the PCR testing date, we identify anosmia/dysgeusia (27.1-fold), fever/chills (2.6-fold), respiratory difficulty (2.2-fold), cough (2.2-fold), myalgia/arthralgia (2-fold), and diarrhea (1.4-fold) as significantly amplified in COVIDpos over COVIDneg patients. The combination of cough and fever/chills has 4.2-fold amplification in COVIDpos patients during the week prior to PCR testing, in addition to anosmia/dysgeusia, constitutes the earliest EHR-derived signature of COVID-19. This study introduces an Augmented Intelligence platform for the real-time synthesis of institutional biomedical knowledge. The platform holds tremendous potential for scaling up curation throughput, thus enabling EHR-powered early disease diagnosis.