Large Language Models Improve the Identification of Emergency Department Visits for Symptomatic Kidney Stones.

Background: Recent advancements of large language models (LLMs) like Generative Pre-trained Transformer 4 (GPT-4) have generated significant interest among the scientific community. Yet, the potential of these models to be utilized in clinical settings remains largely unexplored. This study investigated the abilities of multiple LLMs and traditional machine learning models to analyze emergency department (ED) reports and determine if the corresponding visits were caused by symptomatic kidney stones. Methods: Leveraging a dataset of manually annotated ED reports, we developed strategies to enhance the performance of GPT-4, GPT-3.5, and Llama-2 including prompt optimization, zero- and few-shot prompting, fine-tuning, and prompt augmentation. Further, we implemented fairness assessment and bias mitigation methods to investigate the potential disparities by these LLMs with respect to race and gender. A clinical expert manually assessed the explanations generated by GPT-4 for its predictions to determine if they were sound, factually correct, unrelated to the input prompt, or potentially harmful. The evaluation includes a comparison between LLMs, traditional machine learning models (logistic regression, extreme gradient boosting, and light gradient boosting machine), and a baseline system utilizing International Classification of Diseases (ICD) codes for kidney stones. Results: The best results were achieved by GPT-4 (macro-F1=0.833, 95% confidence interval [CI]=0.826-0.841) and GPT-3.5 (macro-F1=0.796, 95% CI=0.796-0.796), both being statistically significantly better than the ICD-based baseline result (macro-F1=0.71). Ablation studies revealed that the initial pre-trained GPT-3.5 model benefits from fine-tuning when using the same parameter configuration. Adding demographic information and prior disease history to the prompts allows LLMs to make more accurate decisions. The evaluation of bias found that GPT-4 exhibited no racial or gender disparities, in contrast to GPT-3.5, which failed to effectively model racial diversity. The analysis of explanations provided by GPT-4 demonstrates advanced capabilities of this model in understanding clinical text and reasoning with medical knowledge.

PheMIME: an interactive web app and knowledge base for phenome-wide, multi-institutional multimorbidity analysis.

OBJECTIVES: To address the need for interactive visualization tools and databases in characterizing multimorbidity patterns across different populations, we developed the Phenome-wide Multi-Institutional Multimorbidity Explorer (PheMIME). This tool leverages three large-scale EHR systems to facilitate efficient analysis and visualization of disease multimorbidity, aiming to reveal both robust and novel disease associations that are consistent across different systems and to provide insight for enhancing personalized healthcare strategies. MATERIALS AND METHODS: PheMIME integrates summary statistics from phenome-wide analyses of disease multimorbidities, utilizing data from Vanderbilt University Medical Center, Mass General Brigham, and the UK Biobank. It offers interactive and multifaceted visualizations for exploring multimorbidity. Incorporating an enhanced version of associationSubgraphs, PheMIME also enables dynamic analysis and inference of disease clusters, promoting the discovery of complex multimorbidity patterns. A case study on schizophrenia demonstrates its capability for generating interactive visualizations of multimorbidity networks within and across multiple systems. Additionally, PheMIME supports diverse multimorbidity-based discoveries, detailed further in online case studies. RESULTS: The PheMIME is accessible at https://prod.tbilab.org/PheMIME/. A comprehensive tutorial and multiple case studies for demonstration are available at https://prod.tbilab.org/PheMIME_supplementary_materials/. The source code can be downloaded from https://github.com/tbilab/PheMIME. DISCUSSION: PheMIME represents a significant advancement in medical informatics, offering an efficient solution for accessing, analyzing, and interpreting the complex and noisy real-world patient data in electronic health records. CONCLUSION: PheMIME provides an extensive multimorbidity knowledge base that consolidates data from three EHR systems, and it is a novel interactive tool designed to analyze and visualize multimorbidities across multiple EHR datasets. It stands out as the first of its kind to offer extensive multimorbidity knowledge integration with substantial support for efficient online analysis and interactive visualization.

Evaluation of Genetic Associations with Clinical Phenotypes of Kidney Stone Disease.

Background and objective: Previous studies have reported a strong genetic contribution to kidney stone risk. This study aims to identify genetic associations of kidney stone disease within a large-scale electronic health record system. Methods: We performed genome-wide association studies (GWASs) for nephrolithiasis from genotyped samples of 5571 cases and 83 692 controls. This analysis included a primary GWAS focused on nephrolithiasis and subsequent subgroup GWASs stratified by stone composition types. For significant risk variants, we performed association analyses with stone composition and first-time 24-h urine parameters. To assess disease severity, we investigated the associations with age at first stone diagnosis, age at first stone-related procedure, and time between first and second stone-related procedures. Key findings and limitations: The primary GWAS analysis identified ten significant loci, all located on chromosome 16 within coding regions of the UMOD gene. The strongest signal was rs28544423 (odds ratio 1.17, 95% confidence interval 1.11-1.23, p = 2.7 × 10-9). In subgroup GWASs stratified by six kidney stone composition subtypes, 19 significant loci were identified including two loci in coding regions (brushite; NXPH1, rs79970906 and rs4725104). The UMOD single nucleotide polymorphism rs28544423 was associated with differences in 24-h excretion of urinary analytes, and the minor allele was positively associated with calcium oxalate dihydrate stone composition (p < 0.05). No associations were found between UMOD variants and disease severity. Limitations include an omitted variable bias and a misclassification bias. Conclusions and clinical implications: We replicated germline variants associated with kidney stone disease risk at UMOD and reported novel variants associated with stone composition. Genetic variants of UMOD are associated with differences in 24-h urine parameters and stone composition, but not disease severity. Patient summary: We identify genetic variants linked to kidney stone disease within an electronic health record (EHR) system. These findings suggest a role for the EHR to enable a precision-medicine approach for stone disease.

Defining Suicidal Thought and Behavior Phenotypes for Genetic Studies.

Background: Standardized definitions of suicidality phenotypes, including suicidal ideation (SI), attempt (SA), and death (SD) are a critical step towards improving understanding and comparison of results in suicide research. The complexity of suicidality contributes to heterogeneity in phenotype definitions, impeding evaluation of clinical and genetic risk factors across studies and efforts to combine samples within consortia. Here, we present expert and data-supported recommendations for defining suicidality and control phenotypes to facilitate merging current/legacy samples with definition variability and aid future sample creation. Methods: A subgroup of clinician researchers and experts from the Suicide Workgroup of the Psychiatric Genomics Consortium (PGC) reviewed existing PGC definitions for SI, SA, SD, and control groups and generated preliminary consensus guidelines for instrument-derived and international classification of disease (ICD) data. ICD lists were validated in two independent datasets (N = 9,151 and 12,394). Results: Recommendations are provided for evaluated instruments for SA and SI, emphasizing selection of lifetime measures phenotype-specific wording. Recommendations are also provided for defining SI and SD from ICD data. As the SA ICD definition is complex, SA code list recommendations were validated against instrument results with sensitivity (range = 15.4% to 80.6%), specificity (range = 67.6% to 97.4%), and positive predictive values (range = 0.59-0.93) reported. Conclusions: Best-practice guidelines are presented for the use of existing information to define SI/SA/SD in consortia research. These proposed definitions are expected to facilitate more homogeneous data aggregation for genetic and multisite studies. Future research should involve refinement, improved generalizability, and validation in diverse populations.

Overcome the Limitation of Phenome-Wide Association Studies (PheWAS): Extension of PheWAS to Efficient and Robust Large-Scale ICD Codes Analysis.

The Phenome-wide association studies (PheWAS) have become widely used for efficient, high-throughput evaluation of relationship between a genetic factor and a large number of disease phenotypes, typically extracted from a DNA biobank linked with electronic medical records (EMR). Phecodes, billing code-derived disease case-control status, are usually used as outcome variables in PheWAS and logistic regression has been the standard choice of analysis method. Since the clinical diagnoses in EMR are often inaccurate with errors which can lead to biases in the odds ratio estimates, much effort has been put to accurately define the cases and controls to ensure an accurate analysis. Specifically in order to correctly classify controls in the population, an exclusion criteria list for each Phecode was manually compiled to obtain unbiased odds ratios. However, the accuracy of the list cannot be guaranteed without extensive data curation process. The costly curation process limits the efficiency of large-scale analyses that take full advantage of all structured phenotypic information available in EMR. Here, we proposed to estimate relative risks (RR) instead. We first demonstrated the desired nature of RR that overcomes the inaccuracy in the controls via theoretical formula. With simulation and real data application, we further confirmed that RR is unbiased without compiling exclusion criteria lists. With RR as estimates, we are able to efficiently extend PheWAS to a larger-scale, phenome construction agnostic analysis of phenotypes, using ICD 9/10 codes, which preserve much more disease-related clinical information than Phecodes.

Cost-Effective and Scalable Clonal Hematopoiesis Assay Provides Insight into Clonal Dynamics.

Clonal hematopoiesis of indeterminate potential (CHIP) is a common age-related phenomenon in which hematopoietic stem cells acquire mutations in a select set of genes commonly mutated in myeloid neoplasia which then expand clonally. Current sequencing assays to detect CHIP mutations are not optimized for the detection of these variants and can be cost-prohibitive when applied to large cohorts or to serial sequencing. In this study, an affordable (approximately US $8 per sample), accurate, and scalable sequencing assay for CHIP is introduced and validated. The efficacy of the assay was demonstrated by identifying CHIP mutations in a cohort of 456 individuals with DNA collected at multiple time points in Vanderbilt University's biobank and quantifying clonal expansion rates over time. A total of 101 individuals with CHIP/clonal cytopenia of undetermined significance were identified, and individual-level clonal expansion rate was calculated using the variant allele fraction at both time points. Differences in clonal expansion rate by driver gene were observed, but there was also significant individual-level heterogeneity, emphasizing the multifactorial nature of clonal expansion. Additionally, mutation co-occurrence and clonal competition between multiple driver mutations were explored.

Interoperability of phenome-wide multimorbidity patterns: a comparative study of two large-scale EHR systems.

Background: Electronic health records (EHR) are increasingly used for studying multimorbidities. However, concerns about accuracy, completeness, and EHRs being primarily designed for billing and administrative purposes raise questions about the consistency and reproducibility of EHR-based multimorbidity research. Methods: Utilizing phecodes to represent the disease phenome, we analyzed pairwise comorbidity strengths using a dual logistic regression approach and constructed multimorbidity as an undirected weighted graph. We assessed the consistency of the multimorbidity networks within and between two major EHR systems at local (nodes and edges), meso (neighboring patterns), and global (network statistics) scales. We present case studies to identify disease clusters and uncover clinically interpretable disease relationships. We provide an interactive web tool and a knowledge base combining data from multiple sources for online multimorbidity analysis. Findings: Analyzing data from 500,000 patients across Vanderbilt University Medical Center and Mass General Brigham health systems, we observed a strong correlation in disease frequencies (Kendall's τ = 0.643) and comorbidity strengths (Pearson ρ = 0.79). Consistent network statistics across EHRs suggest similar structures of multimorbidity networks at various scales. Comorbidity strengths and similarities of multimorbidity connection patterns align with the disease genetic correlations. Graph-theoretic analyses revealed a consistent core-periphery structure, implying efficient network clustering through threshold graph construction. Using hydronephrosis as a case study, we demonstrated the network's ability to uncover clinically relevant disease relationships and provide novel insights. Interpretation: Our findings demonstrate the robustness of large-scale EHR data for studying phenome-wide multimorbidities. The alignment of multimorbidity patterns with genetic data suggests the potential utility for uncovering shared biology of diseases. The consistent core-periphery structure offers analytical insights to discover complex disease interactions. This work also sets the stage for advanced disease modeling, with implications for precision medicine. Funding: VUMC Biostatistics Development Award, the National Institutes of Health, and the VA CSRD.

Polygenic risk score for ulcerative colitis predicts immune checkpoint inhibitor-mediated colitis.

Immune checkpoint inhibitor-mediated colitis (IMC) is a common adverse event of treatment with immune checkpoint inhibitors (ICI). We hypothesize that genetic susceptibility to Crohn's disease (CD) and ulcerative colitis (UC) predisposes to IMC. In this study, we first develop a polygenic risk scores for CD (PRSCD) and UC (PRSUC) in cancer-free individuals and then test these PRSs on IMC in a cohort of 1316 patients with ICI-treated non-small cell lung cancer and perform a replication in 873 ICI-treated pan-cancer patients. In a meta-analysis, the PRSUC predicts all-grade IMC (ORmeta=1.35 per standard deviation [SD], 95% CI = 1.12-1.64, P = 2×10-03) and severe IMC (ORmeta=1.49 per SD, 95% CI = 1.18-1.88, P = 9×10-04). PRSCD is not associated with IMC. Furthermore, PRSUC predicts severe IMC among patients treated with combination ICIs (ORmeta=2.20 per SD, 95% CI = 1.07-4.53, P = 0.03). Overall, PRSUC can identify patients receiving ICI at risk of developing IMC and may be useful to monitor patients and improve patient outcomes.

Evaluation of genetic associations with clinical phenotypes of kidney stone disease.

Introduction and Objective: We sought to replicate and discover genetic associations of kidney stone disease within a large-scale electronic health record (EHR) system. Methods: We performed genome-wide association studies (GWASs) for nephrolithiasis from genotyped samples of 5,571 cases and 83,692 controls. Among the significant risk variants, we performed association analyses of stone composition and first-time 24-hour urine parameters. To assess disease severity, we investigated the associations of risk variants with age at first stone diagnosis, age at first procedure, and time from first to second procedure. Results: The main GWAS analysis identified 10 significant loci, each located on chromosome 16 within coding regions of the UMOD gene, which codes for uromodulin, a urine protein with inhibitory activity for calcium crystallization. The strongest signal was from SNP 16:20359633-C-T (odds ratio [OR] 1.17, 95% CI 1.11-1.23), with the remaining significant SNPs having similar effect sizes. In subgroup GWASs by stone composition, 19 significant loci were identified, of which two loci were located in coding regions (brushite; NXPH1 , rs79970906 and rs4725104). The UMOD SNP 16:20359633-C-T was associated with differences in 24-hour excretion of urinary calcium, uric acid, phosphorus, sulfate; and the minor allele was positively associated with calcium oxalate dihydrate stone composition (p<0.05). No associations were found between UMOD variants and disease severity. Conclusions: We replicated germline variants associated with kidney stone disease risk at UMOD and reported novel variants associated with stone composition. Genetic variants of UMOD are associated with differences in 24-hour urine parameters and stone composition, but not disease severity.

Driver mutation zygosity is a critical factor in predicting clonal hematopoiesis transformation risk.

Clonal hematopoiesis (CH) can be caused by either single gene mutations (eg point mutations in JAK2 causing CHIP) or mosaic chromosomal alterations (e.g., loss of heterozygosity at chromosome 9p). CH is associated with a significantly increased risk of hematologic malignancies. However, the absolute rate of transformation on an annualized basis is low. Improved prognostication of transformation risk is urgently needed for routine clinical practice. We hypothesized that the co-occurrence of CHIP and mCAs at the same locus (e.g., transforming a heterozygous JAK2 CHIP mutation into a homozygous mutation through concomitant loss of heterozygosity at chromosome 9) might have important prognostic implications for malignancy transformation risk. We tested this hypothesis using our discovery cohort, the UK Biobank (n = 451,180), and subsequently validated it in the BioVU cohort (n = 91,335). We find that individuals with a concurrent somatic mutation and mCA were at significantly increased risk of hematologic malignancy (for example, In BioVU cohort incidence of hematologic malignancies is higher in individuals with co-occurring JAK2 V617F and 9p CN-LOH; HR = 54.76, 95% CI = 33.92-88.41, P < 0.001 vs. JAK2 V617F alone; HR = 44.05, 95% CI = 35.06-55.35, P < 0.001). Currently, the 'zygosity' of the CHIP mutation is not routinely reported in clinical assays or considered in prognosticating CHIP transformation risk. Based on these observations, we propose that clinical reports should include 'zygosity' status of CHIP mutations and that future prognostication systems should take mutation 'zygosity' into account.

Scalable Incident Detection via Natural Language Processing and Probabilistic Language Models.

Post marketing safety surveillance depends in part on the ability to detect concerning clinical events at scale. Spontaneous reporting might be an effective component of safety surveillance, but it requires awareness and understanding among healthcare professionals to achieve its potential. Reliance on readily available structured data such as diagnostic codes risk under-coding and imprecision. Clinical textual data might bridge these gaps, and natural language processing (NLP) has been shown to aid in scalable phenotyping across healthcare records in multiple clinical domains. In this study, we developed and validated a novel incident phenotyping approach using unstructured clinical textual data agnostic to Electronic Health Record (EHR) and note type. It's based on a published, validated approach (PheRe) used to ascertain social determinants of health and suicidality across entire healthcare records. To demonstrate generalizability, we validated this approach on two separate phenotypes that share common challenges with respect to accurate ascertainment: 1) suicide attempt; 2) sleep-related behaviors. With samples of 89,428 records and 35,863 records for suicide attempt and sleep-related behaviors, respectively, we conducted silver standard (diagnostic coding) and gold standard (manual chart review) validation. We showed Area Under the Precision-Recall Curve of ∼ 0.77 (95% CI 0.75-0.78) for suicide attempt and AUPR ∼ 0.31 (95% CI 0.28-0.34) for sleep-related behaviors. We also evaluated performance by coded race and demonstrated differences in performance by race were dissimilar across phenotypes and require algorithmovigilance and debiasing prior to implementation.

Cost-effective and scalable clonal hematopoiesis assay provides insight into clonal dynamics.

Clonal hematopoiesis of indeterminate potential (CHIP) is a common age-related phenomenon that occurs when hematopoietic stem cells acquire mutations in a select set of genes commonly mutated in myeloid neoplasia which then expand clonally. Current sequencing assays to detect CHIP are not optimized for the detection of these variants and can be cost-prohibitive when applied to large cohorts or serial sequencing. Here, we present and validate a CHIP targeted sequencing assay that is affordable (∼$8/sample), accurate and highly scalable. To demonstrate the utility of this assay, we detected CHIP in a cohort of 456 individuals with DNA collected at multiple timepoints in the Vanderbilt BioVU biobank and quantified clonal expansion rates over time. A total of 101 individuals with CHIP were identified, and individual-level clonal expansion rate was calculated using the variant allele fraction (VAF) at both timepoints. Differences in clonal expansion rate by driver gene were observed, but there was also significant individual-level heterogeneity, emphasizing the multifactorial nature of clonal expansion. We further describe the mutation co-occurrence and clonal competition between multiple driver mutations.

PheMIME: An Interactive Web App and Knowledge Base for Phenome-Wide, Multi-Institutional Multimorbidity Analysis.

Motivation: Multimorbidity, characterized by the simultaneous occurrence of multiple diseases in an individual, is an increasing global health concern, posing substantial challenges to healthcare systems. Comprehensive understanding of disease-disease interactions and intrinsic mechanisms behind multimorbidity can offer opportunities for innovative prevention strategies, targeted interventions, and personalized treatments. Yet, there exist limited tools and datasets that characterize multimorbidity patterns across different populations. To bridge this gap, we used large-scale electronic health record (EHR) systems to develop the Phenome-wide Multi-Institutional Multimorbidity Explorer (PheMIME), which facilitates research in exploring and comparing multimorbidity patterns among multiple institutions, potentially leading to the discovery of novel and robust disease associations and patterns that are interoperable across different systems and organizations. Results: PheMIME integrates summary statistics from phenome-wide analyses of disease multimorbidities. These are currently derived from three major institutions: Vanderbilt University Medical Center, Mass General Brigham, and the UK Biobank. PheMIME offers interactive exploration of multimorbidity through multi-faceted visualization. Incorporating an enhanced version of associationSubgraphs, PheMIME enables dynamic analysis and inference of disease clusters, promoting the discovery of multimorbidity patterns. Once a disease of interest is selected, the tool generates interactive visualizations and tables that users can delve into multimorbidities or multimorbidity networks within a single system or compare across multiple systems. The utility of PheMIME is demonstrated through a case study on schizophrenia. Availability and implementation: The PheMIME knowledge base and web application are accessible at https://prod.tbilab.org/PheMIME/. A comprehensive tutorial, including a use-case example, is available at https://prod.tbilab.org/PheMIME_supplementary_materials/. Furthermore, the source code for PheMIME can be freely downloaded from https://github.com/tbilab/PheMIME. Data availability statement: The data underlying this article are available in the article and in its online web application or supplementary material.

Global trends of monkeypox-related articles: A bibliometric analysis over the last five decades (1964 - July 14, 2022).

BACKGROUND: The first human monkeypox (MPX) case was identified in the Democratic Republic of Congo (DRC) in 1970 with an outbreak in 2010 and the first human MPX case in the UK in 2022. In this study, we conducted a bibliometric analysis of the literature on monkeypox based on the Web of Science Core Collection (WOSCC) of the Institute for Scientific Information (ISI) to identify relevant topics and trends in monkeypox research. METHODS: We searched the Web of Science from 1964 until July 14, 2022, for all publications using the keywords "Monkeypox" and "Monkeypox virus." Results were compared using numerous bibliometric methodologies and stratified by journal, author, year, institution, and country-specific metrics. RESULTS: Out of 1170 publications initially selected, 1163 entered our analysis, with 65.26 % (n = 759) being original research articles and 9.37 % (n = 109) being review articles. Most MPX publications were in 2010, with 6.02 % (n = 70), followed by 2009 and 2022 at 5.67 % (n = 66) each. The USA was the country with the highest number of publications, with n = 662 (56.92 %) of total publications, followed by Germany with n = 82 (7.05 %), the UK with n = 74 (6.36 %), and Congo with n = 65 (5.59 %). Journal of Virology published the highest number of MPX publications, followed by Virology Journal and Emerging Infectious Diseases with n = 52 (9.25 %), n = 43 (7.65 %), and n = 32 (5.69 %) publications, respectively. The top contributing institutions were the Centers for Disease Control and Prevention (CDC), the US Army Medical Research Institute of Infectious Diseases, and the National Institutes of Health (NIH)National Institute of Allergy and Infectious Diseases (NIAID). CONCLUSION: Our analysis provides an objective and robust overview of the current literature on MPX and its global trends; this information could serve as a reference guide for those aiming to conduct further MPX-related research and as a source for those seeking information about MPX.

Polygenic risk score for ulcerative colitis predicts immune checkpoint inhibitor-mediated colitis.

Immune checkpoint inhibitors (ICIs) are a remarkable advancement in cancer therapeutics; however, a substantial proportion of patients develop severe immune-related adverse events (irAEs). Understanding and predicting irAEs is a key to advancing precision immuno-oncology. Immune checkpoint inhibitor-mediated colitis (IMC) is a significant complication from ICI and can have life-threatening consequences. Based on clinical presentation, IMC mimics inflammatory bowel disease, however the link is poorly understood. We hypothesized that genetic susceptibility to Crohn's disease (CD) and ulcerative colitis (UC) may predispose to IMC. We developed and validated polygenic risk scores for CD (PRSCD) and UC (PRSUC) in cancer-free individuals and assessed the role of each of these PRSs on IMC in a cohort of 1,316 patients with non-small cell lung cancer who received ICIs. Prevalence of all-grade IMC in our cohort was 4% (55 cases), and for severe IMC, 2.5% (32 cases). The PRSUC predicted the development of all-grade IMC (HR=1.34 per standard deviation [SD], 95% CI=1.02-1.76, P=0.04) and severe IMC (HR=1.62 per SD, 95% CI=1.12-2.35, P=0.01). PRSCD was not associated with IMC or severe IMC. The association between PRSUC and IMC (all-grade and severe) was consistent in an independent pan-cancer cohort of patients treated with ICIs. Furthermore, PRSUC predicted severe IMC among patients treated with combination ICIs (OR = 2.20 per SD, 95% CI = 1.07-4.53, P=0.03). This is the first study to demonstrate the potential clinical utility of a PRS for ulcerative colitis in identifying patients receiving ICI at high risk of developing IMC, where risk reduction and close monitoring strategies could help improve overall patient outcomes.

PI3K Inhibition Restores and Amplifies Response to Ruxolitinib in Patients with Myelofibrosis.

PURPOSE: Treatment options are limited beyond JAK inhibitors for patients with primary myelofibrosis (MF) or secondary MF. Preclinical studies have revealed that PI3Kδ inhibition cooperates with ruxolitinib, a JAK1/2 inhibitor, to reduce proliferation and induce apoptosis of JAK2V617F-mutant cell lines. PATIENTS AND METHODS: In a phase I dose-escalation and -expansion study, we evaluated the safety and efficacy of a selective PI3Kδ inhibitor, umbralisib, in combination with ruxolitinib in patients with MF who had a suboptimal response or lost response to ruxolitinib. Enrolled subjects were required to be on a stable dose of ruxolitinib for ≥8 weeks and continue that MTD at study enrollment. The recommended dose of umbralisib in combination with ruxolitinib was determined using a modified 3+3 dose-escalation design. Safety, pharmacokinetics, and efficacy outcomes were evaluated, and spleen size was measured with a novel automated digital atlas. RESULTS: Thirty-seven patients with MF (median age, 67 years) with prior exposure to ruxolitinib were enrolled. A total of 2 patients treated with 800 mg umbralisib experienced reversible grade 3 asymptomatic pancreatic enzyme elevation, but no dose-limiting toxicities were seen at lower umbralisib doses. Two patients (5%) achieved a durable complete response, and 12 patients (32%) met the International Working Group-Myeloproliferative Neoplasms Research and Treatment response criteria of clinical improvement. With a median follow-up of 50.3 months for censored patients, overall survival was greater than 70% after 3 years of follow-up. CONCLUSIONS: Adding umbralisib to ruxolitinib in patients was well tolerated and may resensitize patients with MF to ruxolitinib without unacceptable rates of adverse events seen with earlier generation PI3Kδ inhibitors. Randomized trials testing umbralisib in the treatment of MF should be pursued.

Improving Methods of Identifying Anaphylaxis for Medical Product Safety Surveillance Using Natural Language Processing and Machine Learning.

We sought to determine whether machine learning and natural language processing (NLP) applied to electronic medical records could improve performance of automated health-care claims-based algorithms to identify anaphylaxis events using data on 516 patients with outpatient, emergency department, or inpatient anaphylaxis diagnosis codes during 2015-2019 in 2 integrated health-care institutions in the Northwest United States. We used one site's manually reviewed gold-standard outcomes data for model development and the other's for external validation based on cross-validated area under the receiver operating characteristic curve (AUC), positive predictive value (PPV), and sensitivity. In the development site 154 (64%) of 239 potential events met adjudication criteria for anaphylaxis compared with 180 (65%) of 277 in the validation site. Logistic regression models using only structured claims data achieved a cross-validated AUC of 0.58 (95% CI: 0.54, 0.63). Machine learning improved cross-validated AUC to 0.62 (0.58, 0.66); incorporating NLP-derived covariates further increased cross-validated AUCs to 0.70 (0.66, 0.75) in development and 0.67 (0.63, 0.71) in external validation data. A classification threshold with cross-validated PPV of 79% and cross-validated sensitivity of 66% in development data had cross-validated PPV of 78% and cross-validated sensitivity of 56% in external data. Machine learning and NLP-derived data improved identification of validated anaphylaxis events.

Kidney Stone Prevalence Based on Self-Report and Electronic Health Records: Insight into the Prevalence of Active Medical Care for Kidney Stones.

OBJECTIVE: To compare rates of patient-reported kidney stone disease to Electronic Health Records (EHR) kidney stone diagnosis using a common dataset to evaluate for socio-demographic differences, including between those with and without active care. METHODS: From the All of Us research database, we identified 21,687 adult participants with both patient-reported and EHR data. We compared differences in age, sex, race, education, employment status and healthcare access between patients with self-reported kidney stone history without EHR data to those with EHR-based diagnoses. RESULTS: In this population, the self-reported prevalence of kidney stones was 8.6% overall (n = 1877), including 4.6% (n = 1004) who had self-reported diagnoses but no EHR data. Among those with self-reported kidney stone diagnoses only, the median age was 66. The EHR-based prevalence of kidney stones was 5.7% (n = 1231), median age 67. No differences were observed in age, sex, education, employment status, rural/urban status, or ability to afford healthcare between groups with EHR diagnosis or self-reported diagnosis only. Of patients who had a self-reported history of kidney stones, 24% reported actively seeing a provider for kidney stones. CONCLUSION: Kidney stone prevalence by self-report is higher than EHR-based prevalence in this national dataset. Using either method alone to estimate kidney stone prevalence may exclude some patients with the condition, although the demographic profile of both groups is similar. Approximately 1 in 4 patients report actively seeing a provider for stone disease.

Patient-specific comorbidities as prognostic variables for survival in myelofibrosis.

Treatment decisions in primary myelofibrosis (PMF) are guided by numerous prognostic systems. Patient-specific comorbidities have influence on treatment-related survival and are considered in clinical contexts but have not been routinely incorporated into current prognostic models. We hypothesized that patient-specific comorbidities would inform prognosis and could be incorporated into a quantitative score. All patients with PMF or secondary myelofibrosis with available DNA and comprehensive electronic health record (EHR) data treated at Vanderbilt University Medical Center between 1995 and 2016 were identified within Vanderbilt's Synthetic Derivative and BioVU Biobank. We recapitulated established PMF risk scores (eg, Dynamic International Prognostic Scoring System [DIPSS], DIPSS plus, Genetics-Based Prognostic Scoring System, Mutation-Enhanced International Prognostic Scoring System 70+) and comorbidities through EHR chart extraction and next-generation sequencing on biobanked peripheral blood DNA. The impact of comorbidities was assessed via DIPSS-adjusted overall survival using Bonferroni correction. Comorbidities associated with inferior survival include renal failure/dysfunction (hazard ratio [HR], 4.3; 95% confidence interval [95% CI], 2.1-8.9; P = .0001), intracranial hemorrhage (HR, 28.7; 95% CI, 7.0-116.8; P = 2.83e-06), invasive fungal infection (HR, 41.2; 95% CI, 7.2-235.2; P = 2.90e-05), and chronic encephalopathy (HR, 15.1; 95% CI, 3.8-59.4; P = .0001). The extended DIPSS model including all 4 significant comorbidities showed a significantly higher discriminating power (C-index 0.81; 95% CI, 0.78-0.84) than the original DIPSS model (C-index 0.73; 95% CI, 0.70-0.77). In summary, we repurposed an institutional biobank to identify and risk-classify an uncommon hematologic malignancy by established (eg, DIPSS) and other clinical and pathologic factors (eg, comorbidities) in an unbiased fashion. The inclusion of comorbidities into risk evaluation may augment prognostic capability of future genetics-based scoring systems.

Interactive network-based clustering and investigation of multimorbidity association matrices with associationSubgraphs.

MOTIVATION: Making sense of networked multivariate association patterns is vitally important to many areas of high-dimensional analysis. Unfortunately, as the data-space dimensions grow, the number of association pairs increases in O(n2); this means that traditional visualizations such as heatmaps quickly become too complicated to parse effectively. RESULTS: Here, we present associationSubgraphs: a new interactive visualization method to quickly and intuitively explore high-dimensional association datasets using network percolation and clustering. The goal is to provide an efficient investigation of association subgraphs, each containing a subset of variables with stronger and more frequent associations among themselves than the remaining variables outside the subset, by showing the entire clustering dynamics and providing subgraphs under all possible cutoff values at once. Particularly, we apply associationSubgraphs to a phenome-wide multimorbidity association matrix generated from an electronic health record and provide an online, interactive demonstration for exploring multimorbidity subgraphs. AVAILABILITY AND IMPLEMENTATION: An R package implementing both the algorithm and visualization components of associationSubgraphs is available at https://github.com/tbilab/associationsubgraphs. Online documentation is available at https://prod.tbilab.org/associationsubgraphs_info/. A demo using a multimorbidity association matrix is available at https://prod.tbilab.org/associationsubgraphs-example/.