Stratifying heart failure patients with graph neural network and transformer using Electronic Health Records to optimize drug response prediction.

OBJECTIVES: Heart failure (HF) impacts millions of patients worldwide, yet the variability in treatment responses remains a major challenge for healthcare professionals. The current treatment strategies, largely derived from population based evidence, often fail to consider the unique characteristics of individual patients, resulting in suboptimal outcomes. This study aims to develop computational models that are patient-specific in predicting treatment outcomes, by utilizing a large Electronic Health Records (EHR) database. The goal is to improve drug response predictions by identifying specific HF patient subgroups that are likely to benefit from existing HF medications. MATERIALS AND METHODS: A novel, graph-based model capable of predicting treatment responses, combining Graph Neural Network and Transformer was developed. This method differs from conventional approaches by transforming a patient's EHR data into a graph structure. By defining patient subgroups based on this representation via K-Means Clustering, we were able to enhance the performance of drug response predictions. RESULTS: Leveraging EHR data from 11 627 Mayo Clinic HF patients, our model significantly outperformed traditional models in predicting drug response using NT-proBNP as a HF biomarker across five medication categories (best RMSE of 0.0043). Four distinct patient subgroups were identified with differential characteristics and outcomes, demonstrating superior predictive capabilities over existing HF subtypes (best mean RMSE of 0.0032). DISCUSSION: These results highlight the power of graph-based modeling of EHR in improving HF treatment strategies. The stratification of patients sheds light on particular patient segments that could benefit more significantly from tailored response predictions. CONCLUSIONS: Longitudinal EHR data have the potential to enhance personalized prognostic predictions through the application of graph-based AI techniques.

Synoptic Reporting by Summarizing Cancer Pathology Reports using Large Language Models.

Background: Synoptic reporting, the documenting of clinical information in a structured manner, is known to improve patient care by reducing errors, increasing readability, interoperability, and report completeness. Despite its advantages, manually synthesizing synoptic reports from narrative reports is expensive and error prone when the number of structured fields are many. While the recent revolutionary developments in Large Language Models (LLMs) have significantly advanced natural language processing, their potential for innovations in medicine is yet to be fully evaluated. Objectives: In this study, we explore the strengths and challenges of utilizing the state-of-the-art language models in the automatic synthesis of synoptic reports. Materials and Methods: We use a corpus of 7,774 cancer related, narrative pathology reports, which have annotated reference synoptic reports from Mayo Clinic EHR. Using these annotations as a reference, we reconfigure the state-of-the-art large language models, such as LLAMA-2, to generate the synoptic reports. Our annotated reference synoptic reports contain 22 unique data elements. To evaluate the accuracy of the reports generated by the LLMs, we use several metrics including the BERT F1 Score and verify our results by manual validation. Results: We show that using fine-tuned LLAMA-2 models, we can obtain BERT Score F1 of 0.86 or higher across all data elements and BERT F1 scores of 0.94 or higher on over 50% (11 of 22) of the questions. The BERT F1 scores translate to average accuracies of 76% and as high as 81% for short clinical reports. Conclusions: We demonstrate successful automatic synoptic report generation by fine-tuning large language models.

Artificial Intelligence-based Efficacy Prediction of Phase 3 Clinical Trial for Repurposing Heart Failure Therapies.

Introduction: Drug repurposing involves finding new therapeutic uses for already approved drugs, which can save costs as their pharmacokinetics and pharmacodynamics are already known. Predicting efficacy based on clinical endpoints is valuable for designing phase 3 trials and making Go/No-Go decisions, given the potential for confounding effects in phase 2. Objectives: This study aims to predict the efficacy of the repurposed Heart Failure (HF) drugs for the Phase 3 Clinical Trial. Methods: Our study presents a comprehensive framework for predicting drug efficacy in phase 3 trials, which combines drug-target prediction using biomedical knowledgebases with statistical analysis of real-world data. We developed a novel drug-target prediction model that uses low-dimensional representations of drug chemical structures and gene sequences, and biomedical knowledgebase. Furthermore, we conducted statistical analyses of electronic health records to assess the effectiveness of repurposed drugs in relation to clinical measurements (e.g., NT-proBNP). Results: We identified 24 repurposed drugs (9 with a positive effect and 15 with a non-positive) for heart failure from 266 phase 3 clinical trials. We used 25 genes related to heart failure for drug-target prediction, as well as electronic health records (EHR) from the Mayo Clinic for screening, which contained over 58,000 heart failure patients treated with various drugs and categorized by heart failure subtypes. Our proposed drug-target predictive model performed exceptionally well in all seven tests in the BETA benchmark compared to the six cutting-edge baseline methods (i.e., best performed in 266 out of 404 tasks). For the overall prediction of the 24 drugs, our model achieved an AUCROC of 82.59% and PRAUC (average precision) of 73.39%. Conclusion: The study demonstrated exceptional results in predicting the efficacy of repurposed drugs for phase 3 clinical trials, highlighting the potential of this method to facilitate computational drug repurposing.

Predicting Physiological Response in Heart Failure Management: A Graph Representation Learning Approach using Electronic Health Records.

Heart failure management is challenging due to the complex and heterogenous nature of its pathophysiology which makes the conventional treatments based on the "one size fits all" ideology not suitable. Coupling the longitudinal medical data with novel deep learning and network-based analytics will enable identifying the distinct patient phenotypic characteristics to help individualize the treatment regimen through the accurate prediction of the physiological response. In this study, we develop a graph representation learning framework that integrates the heterogeneous clinical events in the electronic health records (EHR) as graph format data, in which the patient-specific patterns and features are naturally infused for personalized predictions of lab test response. The framework includes a novel Graph Transformer Network that is equipped with a self-attention mechanism to model the underlying spatial interdependencies among the clinical events characterizing the cardiac physiological interactions in the heart failure treatment and a graph neural network (GNN) layer to incorporate the explicit temporality of each clinical event, that would help summarize the therapeutic effects induced on the physiological variables, and subsequently on the patient's health status as the heart failure condition progresses over time. We introduce a global attention mask that is computed based on event co-occurrences and is aggregated across all patient records to enhance the guidance of neighbor selection in graph representation learning. We test the feasibility of our model through detailed quantitative and qualitative evaluations on observational EHR data.

BETA: a comprehensive benchmark for computational drug-target prediction.

Internal validation is the most popular evaluation strategy used for drug-target predictive models. The simple random shuffling in the cross-validation, however, is not always ideal to handle large, diverse and copious datasets as it could potentially introduce bias. Hence, these predictive models cannot be comprehensively evaluated to provide insight into their general performance on a variety of use-cases (e.g. permutations of different levels of connectiveness and categories in drug and target space, as well as validations based on different data sources). In this work, we introduce a benchmark, BETA, that aims to address this gap by (i) providing an extensive multipartite network consisting of 0.97 million biomedical concepts and 8.5 million associations, in addition to 62 million drug-drug and protein-protein similarities and (ii) presenting evaluation strategies that reflect seven cases (i.e. general, screening with different connectivity, target and drug screening based on categories, searching for specific drugs and targets and drug repurposing for specific diseases), a total of seven Tests (consisting of 344 Tasks in total) across multiple sampling and validation strategies. Six state-of-the-art methods covering two broad input data types (chemical structure- and gene sequence-based and network-based) were tested across all the developed Tasks. The best-worst performing cases have been analyzed to demonstrate the ability of the proposed benchmark to identify limitations of the tested methods for running over the benchmark tasks. The results highlight BETA as a benchmark in the selection of computational strategies for drug repurposing and target discovery.