Using Large Language Models to Annotate Complex Cases of Social Determinants of Health in Longitudinal Clinical Records.

Social Determinants of Health (SDoH) are an important part of the exposome and are known to have a large impact on variation in health outcomes. In particular, housing stability is known to be intricately linked to a patient's health status, and pregnant women experiencing housing instability (HI) are known to have worse health outcomes. Most SDoH information is stored in electronic health records (EHRs) as free text (unstructured) clinical notes, which traditionally required natural language processing (NLP) for automatic identification of relevant text or keywords. A patient's housing status can be ambiguous or subjective, and can change from note to note or within the same note, making it difficult to use existing NLP solutions. New developments in NLP allow researchers to prompt LLMs to perform complex, subjective annotation tasks that require reasoning that previously could only be attempted by human annotators. For example, large language models (LLMs) such as GPT (Generative Pre-trained Transformer) enable researchers to analyze complex, unstructured data using simple prompts. We used a secure platform within a large healthcare system to compare the ability of GPT-3.5 and GPT-4 to identify instances of both current and past housing instability, as well as general housing status, from 25,217 notes from 795 pregnant women. Results from these LLMs were compared with results from manual annotation, a named entity recognition (NER) model, and regular expressions (RegEx). We developed a chain-of-thought prompt requiring evidence and justification for each note from the LLMs, to help maximize the chances of finding relevant text related to HI while minimizing hallucinations and false positives. Compared with GPT-3.5 and the NER model, GPT-4 had the highest performance and had a much higher recall (0.924) than human annotators (0.702) in identifying patients experiencing current or past housing instability, although precision was lower (0.850) compared with human annotators (0.971). In most cases, the evidence output by GPT-4 was similar or identical to that of human annotators, and there was no evidence of hallucinations in any of the outputs from GPT-4. Most cases where the annotators and GPT-4 differed were ambiguous or subjective, such as "living in an apartment with too many people". We also looked at GPT-4 performance on de-identified versions of the same notes and found that precision improved slightly (0.936 original, 0.939 de-identified), while recall dropped (0.781 original, 0.704 de-identified). This work demonstrates that, while manual annotation is likely to yield slightly more accurate results overall, LLMs, when compared with manual annotation, provide a scalable, cost-effective solution with the advantage of greater recall. At the same time, further evaluation is needed to address the risk of missed cases and bias in the initial selection of housing-related notes. Additionally, while it was possible to reduce confabulation, signs of unusual justifications remained. Given these factors, together with changes in both LLMs and charting over time, this approach is not yet appropriate for use as a fully-automated process. However, these results demonstrate the potential for using LLMs for computer-assisted annotation with human review, reducing cost and increasing recall. More efficient methods for obtaining structured SDoH data can help accelerate inclusion of exposome variables in biomedical research, and support healthcare systems in identifying patients who could benefit from proactive outreach.

Fokker-Planck diffusion maps of multiple single cell microglial transcriptomes reveals radial differentiation into substates associated with Alzheimer's pathology.

The identification of microglia subtypes is important for understanding the role of innate immunity in neurodegenerative diseases. Current methods of unsupervised cell type identification assume a small noise-to-signal ratio of transcriptome measurements that would produce well-separated cell clusters. However, identification of subtypes is obscured by gene expression noise, diminishing the distances in transcriptome space between distinct cell types and blurring boundaries. Here we use Fokker-Planck (FP) diffusion maps to model cellular differentiation as a stochastic process whereby cells settle into local minima, corresponding to cell subtypes, in a potential landscape constructed from transcriptome data using a nearest neighbor graph approach. By applying critical transition fields, we identify individual cells on the verge of transitioning between subtypes, revealing microglial cells in inactivated, homeostatic state before radially transitioning into various specialized subtypes. Specifically, we show that cells from Alzheimer's disease patients are enriched in a microglia subtype associated to antigen presentation and T-cell recruitment.

A simplified pneumonia severity index (PSI) for clinical outcome prediction in COVID-19.

BACKGROUND: The Pneumonia Score Index (PSI) was developed to estimate the risk of dying within 30 days of presentation for community-acquired pneumonia patients and is a strong predictor of 30-day mortality after COVID-19. However, three of its required 20 variables (skilled nursing home, altered mental status and pleural effusion) are not discreetly available in the electronic medical record (EMR), resulting in manual chart review for these 3 factors. The goal of this study is to compare a simplified 17-factor version (PSI-17) to the original (denoted PSI-20) in terms of prediction of 30-day mortality in COVID-19. METHODS: In this retrospective cohort study, the hospitalized patients with confirmed SARS-CoV-2 infection between 2/28/20-5/28/20 were identified to compare the predictive performance between PSI-17 and PSI-20. Correlation was assessed between PSI-17 and PSI-20, and logistic regressions were performed for 30-day mortality. The predictive abilities were compared by discrimination, calibration, and overall performance. RESULTS: Based on 1,138 COVID-19 patients, the correlation between PSI-17 and PSI-20 was 0.95. Univariate logistic regression showed that PSI-17 had performance similar to PSI-20, based on AUC, ICI and Brier Score. After adjusting for confounding variables by multivariable logistic regression, PSI-17 and PSI-20 had AUCs (95% CI) of 0.85 (0.83-0.88) and 0.86 (0.84-0.89), respectively, indicating no significant difference in AUC at significance level of 0.05. CONCLUSION: PSI-17 and PSI-20 are equally effective predictors of 30-day mortality in terms of several performance metrics. PSI-17 can be obtained without the manual chart review, which allows for automated risk calculations within an EMR. PSI-17 can be easily obtained and may be a comparable alternative to PSI-20.

Maternal-fetal outcomes in patients with immune-mediated inflammatory diseases, with consideration of comorbidities: a retrospective cohort study in a large U.S. healthcare system.

Background: Immune-mediated inflammatory diseases (IMIDs) are likely to complicate maternal health. However, literature on patients with IMIDs undergoing pregnancy is scarce and often overlooks the presence of comorbidities. We aimed to evaluate the impact of IMIDs on adverse pregnancy outcomes after assessing and addressing any discrepancies in the distribution of covariates associated with adverse pregnancy outcomes between patients with and without IMIDs. Methods: We conducted a retrospective cohort study using data from an integrated U.S. community healthcare system that provides care across Alaska, California, Montana, Oregon, New Mexico, Texas, and Washington. We used a database containing all structured data from electronic health record (EHRs) and analyzed the cohort of pregnant people who had live births from January 1, 2013, through December 31, 2022. We investigated 12 selected IMIDs: psoriasis, inflammatory bowel disease, rheumatoid arthritis, spondyloarthritis, multiple sclerosis, systemic lupus erythematosus, psoriatic arthritis, antiphospholipid syndrome, Sjögren's syndrome, vasculitides, sarcoidosis, and systemic sclerosis. We characterized patients with IMIDs prior to pregnancy (IMIDs group) based on pregnancy/maternal characteristics, comorbidities, and pre-pregnancy/prenatal immunomodulatory medications (IMMs) prescription patterns. We 1:1 propensity score matched the IMIDs cohort with people who had no IMID diagnoses prior to pregnancy (non-IMIDs cohort). Outcome measures were preterm birth (PTB), low birth weight (LBW), small for gestational age (SGA), and caesarean section. Findings: Our analytic cohort had 365,075 people, of which 5784 were in the IMIDs group and 359,291 were in the non-IMIDs group. The prevalence rate of pregnancy of at least 20 weeks duration in people with a previous IMID diagnosis has doubled in the past ten years. 17% of the IMIDs group had at least one prenatal IMM prescription. Depending on the type of IMM, 48%-70% of the patients taking IMMs before pregnancy continued them throughout pregnancy. Overall, patients with one or more of these 12 IMIDs had increased risk of PTB (Relative risk (RR) = 1.1 [1.0, 1.3]; p = 0.08), LBW (RR = 1.2 [1.0, 1.4]; p = 0.02), SGA (RR = 1.1 [1.0, 1.2]; p = 0.03), and caesarean section (RR = 1.1 [1.1, 1.2], p < 0.0001) compared to a matched cohort of people without IMIDs. When adjusted for comorbidities, patients with rheumatoid arthritis (PTB RR = 1.2, p = 0.5; LBW RR = 1.1, p = 0.6) and/or inflammatory bowel disease (PTB RR = 1.2, p = 0.3; LBW RR = 1.0, p = 0.8) did not have significantly increased risk for PTB and LBW. Interpretation: For patients who have been pregnant for 20 weeks or greater, the association between IMIDs and adverse pregnancy outcomes depends on both the nature of the IMID and the presence of comorbidities. Because this study was limited to pregnancies resulting in live births, results must be interpreted together with other studies on early pregnancy loss and stillbirth in patient with IMIDs. Funding: National Institutes of Health.

Machine learning to understand risks for severe COVID-19 outcomes: a retrospective cohort study of immune-mediated inflammatory diseases, immunomodulatory medications, and comorbidities in a large US health-care system.

BACKGROUND: In the context of immune-mediated inflammatory diseases (IMIDs), COVID-19 outcomes are incompletely understood and vary considerably depending on the patient population studied. We aimed to analyse severe COVID-19 outcomes and to investigate the effects of the pandemic time period and the risks associated with individual IMIDs, classes of immunomodulatory medications (IMMs), chronic comorbidities, and COVID-19 vaccination status. METHODS: In this retrospective cohort study, clinical data were derived from the electronic health records of an integrated health-care system serving patients in 51 hospitals and 1085 clinics across seven US states (Providence St Joseph Health). Data were observed for patients (no age restriction) with one or more IMID and for unmatched controls without IMIDs. COVID-19 was identified with a positive nucleic acid amplification test result for SARS-CoV-2. Two timeframes were analysed: March 1, 2020-Dec 25, 2021 (pre-omicron period), and Dec 26, 2021-Aug 30, 2022 (omicron-predominant period). Primary outcomes were hospitalisation, mechanical ventilation, and mortality in patients with COVID-19. Factors, including IMID diagnoses, comorbidities, long-term use of IMMs, and COVID-19 vaccination status, were analysed with multivariable logistic regression (LR) and extreme gradient boosting (XGB). FINDINGS: Of 2 167 656 patients tested for SARS-CoV-2, 290 855 (13·4%) had confirmed COVID-19: 15 397 (5·3%) patients with IMIDs and 275 458 (94·7%) without IMIDs. In the pre-omicron period, 169 993 (11·2%) of 1 517 295 people who were tested for COVID-19 tested positive, of whom 23 330 (13·7%) were hospitalised, 1072 (0·6%) received mechanical ventilation, and 5294 (3·1%) died. Compared with controls, patients with IMIDs and COVID-19 had higher rates of hospitalisation (1176 [14·6%] vs 22 154 [13·7%]; p=0·024) and mortality (314 [3·9%] vs 4980 [3·1%]; p<0·0001). In the omicron-predominant period, 120 862 (18·6%) of 650 361 patients tested positive for COVID-19, of whom 14 504 (12·0%) were hospitalised, 567 (0·5%) received mechanical ventilation, and 2001 (1·7%) died. Compared with controls, patients with IMIDs and COVID-19 (7327 [17·3%] of 42 249) had higher rates of hospitalisation (13 422 [11·8%] vs 1082 [14·8%]; p<0·0001) and mortality (1814 [1·6%] vs 187 [2·6%]; p<0·0001). Age was a risk factor for worse outcomes (adjusted odds ratio [OR] from 2·1 [95% CI 2·0-2·1]; p<0·0001 to 3·0 [2·9-3·0]; p<0·0001), whereas COVID-19 vaccination (from 0·082 [0·080-0·085]; p<0·0001 to 0·52 [0·50-0·53]; p<0·0001) and booster vaccination (from 2·1 [2·0-2·2]; p<0·0001 to 3·0 [2·9-3·0]; p<0·0001) status were associated with better outcomes. Seven chronic comorbidities were significant risk factors during both time periods for all three outcomes: atrial fibrillation, coronary artery disease, heart failure, chronic kidney disease, chronic obstructive pulmonary disease, chronic liver disease, and cancer. Two IMIDs, asthma (adjusted OR from 0·33 [0·32-0·34]; p<0·0001 to 0·49 [0·48-0·51]; p<0·0001) and psoriasis (from 0·52 [0·48-0·56] to 0·80 [0·74-0·87]; p<0·0001), were associated with a reduced risk of severe outcomes. IMID diagnoses did not appear to be significant risk factors themselves, but results were limited by small sample size, and vasculitis had high feature importance in LR. IMMs did not appear to be significant, but less frequently used IMMs were limited by sample size. XGB outperformed LR, with the area under the receiver operating characteristic curve for models across different time periods and outcomes ranging from 0·77 to 0·92. INTERPRETATION: Our results suggest that age, chronic comorbidities, and not being fully vaccinated might be greater risk factors for severe COVID-19 outcomes in patients with IMIDs than the use of IMMs or the IMIDs themselves. Overall, there is a need to take age and comorbidities into consideration when developing COVID-19 guidelines for patients with IMIDs. Further research is needed for specific IMIDs (including IMID severity at the time of SARS-CoV-2 infection) and IMMs (considering dosage and timing before a patient's first COVID-19 infection). FUNDING: Pfizer, Novartis, Janssen, and the National Institutes of Health.

Timing of selective serotonin reuptake inhibitor use and risk for preterm birth and related adverse events: with a consideration of the COVID-19 pandemic period.

OBJECTIVE: There is uncertainty around the safety of SSRIs for treating depression during pregnancy. Nevertheless, the use of SSRIs has been gradually increasing, especially during the COVID-19 pandemic period. We aimed to (1) characterize maternal depression rate and use of SSRIs in a recent 10-year period, (2) address confounding by indication, as well as socioeconomic and environmental factors, and (3) evaluate associations of the timing of SSRI exposure in pregnancy with risk for preterm birth (PTB), low birthweight (LBW), and small for gestational age (SGA) infants among women with depression before pregnancy. METHODS: We conducted propensity score-adjusted regression to calculate odds ratios (ORs) of PTB, LBW, and SGA. We accounted for maternal/pregnancy characteristics, comorbidity, depression severity, time of delivery, social vulnerability, and rural residence. RESULTS: There were 50.3% and 40.3% increases in the prevalence rate of prenatal depression and prenatal SSRI prescription rate during the pandemic. We identified women with depression ≤180 days before pregnancy (n = 8406). Women with no SSRI order during pregnancy (n = 3760) constituted the unexposed group. The late SSRI exposure group consisted of women with an SSRI order after the first trimester (n = 3759). The early-only SSRI exposure group consisted of women with SSRI orders only in the first trimester (n = 887). The late SSRI exposure group had an increased risk of PTB of OR = 1.5 ([1.2,1.8]) and LBW of OR = 1.5 ([1.2,2.0]), relative to the unexposed group. Associations between late SSRI exposure and risk of PTB/LBW were similar among a subsample of patients who delivered during the pandemic. CONCLUSIONS: These findings suggest an association between PTB/LBW and SSRI exposure is dependent on exposure timing during pregnancy. Small for gestational age is not associated with SSRI exposure.

Aberrant bowel movement frequencies coincide with increased microbe-derived blood metabolites associated with reduced organ function.

Bowel movement frequency (BMF) directly impacts the gut microbiota and is linked to diseases like chronic kidney disease or dementia. In particular, prior work has shown that constipation is associated with an ecosystem-wide switch from fiber fermentation and short-chain fatty acid production to more detrimental protein fermentation and toxin production. Here, we analyze multi-omic data from generally healthy adults to see how BMF affects their molecular phenotypes, in a pre-disease context. Results show differential abundances of gut microbial genera, blood metabolites, and variation in lifestyle factors across BMF categories. These differences relate to inflammation, heart health, liver function, and kidney function. Causal mediation analysis indicates that the association between lower BMF and reduced kidney function is partially mediated by the microbially derived toxin 3-indoxyl sulfate (3-IS). This result, in a generally healthy context, suggests that the accumulation of microbiota-derived toxins associated with abnormal BMF precede organ damage and may be drivers of chronic, aging-related diseases.

Post-Acute Sequelae of Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) After Infection During Pregnancy.

OBJECTIVE: To estimate the prevalence of post-acute sequelae of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection (PASC) after infection with SARS-CoV-2 during pregnancy and to characterize associated risk factors. METHODS: In a multicenter cohort study (NIH RECOVER [Researching COVID to Enhance Recovery]-Pregnancy Cohort), individuals who were pregnant during their first SARS-CoV-2 infection were enrolled across the United States from December 2021 to September 2023, either within 30 days of their infection or at differential time points thereafter. The primary outcome was PASC , defined as score of 12 or higher based on symptoms and severity as previously published by the NIH RECOVER-Adult Cohort, at the first study visit at least 6 months after the participant's first SARS-CoV-2 infection. Risk factors for PASC were evaluated, including sociodemographic characteristics, clinical characteristics before SARS-CoV-2 infection (baseline comorbidities, trimester of infection, vaccination status), and acute infection severity (classified by need for oxygen therapy). Multivariable logistic regression models were fitted to estimate associations between these characteristics and presence of PASC. RESULTS: Of the 1,502 participants, 61.1% had their first SARS-CoV-2 infection on or after December 1, 2021 (ie, during Omicron variant dominance); 51.4% were fully vaccinated before infection; and 182 (12.1%) were enrolled within 30 days of their acute infection. The prevalence of PASC was 9.3% (95% CI, 7.9-10.9%) measured at a median of 10.3 months (interquartile range 6.1-21.5) after first infection. The most common symptoms among individuals with PASC were postexertional malaise (77.7%), fatigue (76.3%), and gastrointestinal symptoms (61.2%). In a multivariable model, the proportion PASC positive with vs without history of obesity (14.9% vs 7.5%, adjusted odds ratio [aOR] 1.65, 95% CI, 1.12-2.43), depression or anxiety disorder (14.4% vs 6.1%, aOR 2.64, 95% CI, 1.79-3.88) before first infection, economic hardship (self-reported difficulty covering expenses) (12.5% vs 6.9%, aOR 1.57, 95% CI, 1.05-2.34), and treatment with oxygen during acute SARS-CoV-2 infection (18.1% vs 8.7%, aOR 1.86, 95% CI, 1.00-3.44) were associated with increased prevalence of PASC. CONCLUSION: The prevalence of PASC at a median time of 10.3 months after SARS-CoV-2 infection during pregnancy was 9.3% in the NIH RECOVER-Pregnancy Cohort. The predominant symptoms were postexertional malaise, fatigue, and gastrointestinal symptoms. Several socioeconomic and clinical characteristics were associated with PASC after infection during pregnancy. CLINICAL TRIAL REGISTRATION: ClinicalTrials.gov , NCT05172024.