NephroCAGE-German-Canadian Consortium on AI for Improved Kidney Transplantation Outcome: Protocol for an Algorithm Development and Validation Study.

BACKGROUND: Recent advances in hardware and software enabled the use of artificial intelligence (AI) algorithms for analysis of complex data in a wide range of daily-life use cases. We aim to explore the benefits of applying AI to a specific use case in transplant nephrology: risk prediction for severe posttransplant events. For the first time, we combine multinational real-world transplant data, which require specific legal and technical protection measures. OBJECTIVE: The German-Canadian NephroCAGE consortium aims to develop and evaluate specific processes, software tools, and methods to (1) combine transplant data of more than 8000 cases over the past decades from leading transplant centers in Germany and Canada, (2) implement specific measures to protect sensitive transplant data, and (3) use multinational data as a foundation for developing high-quality prognostic AI models. METHODS: To protect sensitive transplant data addressing the first and second objectives, we aim to implement a decentralized NephroCAGE federated learning infrastructure upon a private blockchain. Our NephroCAGE federated learning infrastructure enables a switch of paradigms: instead of pooling sensitive data into a central database for analysis, it enables the transfer of clinical prediction models (CPMs) to clinical sites for local data analyses. Thus, sensitive transplant data reside protected in their original sites while the comparable small algorithms are exchanged instead. For our third objective, we will compare the performance of selected AI algorithms, for example, random forest and extreme gradient boosting, as foundation for CPMs to predict severe short- and long-term posttransplant risks, for example, graft failure or mortality. The CPMs will be trained on donor and recipient data from retrospective cohorts of kidney transplant patients. RESULTS: We have received initial funding for NephroCAGE in February 2021. All clinical partners have applied for and received ethics approval as of 2022. The process of exploration of clinical transplant database for variable extraction has started at all the centers in 2022. In total, 8120 patient records have been retrieved as of August 2023. The development and validation of CPMs is ongoing as of 2023. CONCLUSIONS: For the first time, we will (1) combine kidney transplant data from nephrology centers in Germany and Canada, (2) implement federated learning as a foundation to use such real-world transplant data as a basis for the training of CPMs in a privacy-preserving way, and (3) develop a learning software system to investigate population specifics, for example, to understand population heterogeneity, treatment specificities, and individual impact on selected posttransplant outcomes. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/48892.

Software-Tool Support for Collaborative, Virtual, Multi-Site Molecular Tumor Boards.

The availability of high-throughput molecular diagnostics builds the foundation for Molecular Tumor Boards (MTBs). Although more fine-grained data is expected to support decision making of oncologists, assessment of data is complex and time-consuming slowing down the implementation of MTBs, e.g., due to retrieval of the latest medical publications, assessment of clinical evidence, or linkage to the latest clinical guidelines. We share our findings from analysis of existing tumor board processes and defininion of clinical processes for the adoption of MTBs. Building on our findings, we have developed a real-world software prototype together with oncologists and medical professionals, which supports the preparation and conduct of MTBs and enables collaboration between medical experts by sharing medical knowledge even across the hospital locations. We worked in interdisciplinary teams of clinicians, oncologists, medical experts, medical informaticians, and software engineers using design thinking methodology. With their input, we identified challenges and limitations of the current MTB approaches, derived clinical process models using Business Process and Modeling Notation (BMPN), and defined personas, functional and non-functional requirements for software tool support. Based on it, we developed software prototypes and evaluated them with clinical experts from major university hospitals across Germany. We extended the Kanban methodology enabling holistic tracking of patient cases from "backlog" to "follow-up" in our app. The feedback from interviewed medical professionals showed that our clinical process models and software prototype provide suitable process support for the preparation and conduction of molecular tumor boards. The combination of oncology knowledge across hospitals and the documentation of treatment decision can be used to form a unique medical knowledge base by oncologists for oncologists. Due to the high heterogeneity of tumor diseases and the spread of the latest medical knowledge, a cooperative decision-making process including insights from similar patient cases was considered as a very valuable feature. The ability to transform prepared case data into a screen presentation was recognized as an essential feature speeding up the preparation process. Oncologists require special software tool support to incorporate and assess molecular data for the decision-making process. In particular, the need for linkage to the latest medical knowledge, clinical evidence, and collaborative tools to discuss individual cases were named to be of importance. With the experiences from the COVID-19 pandemic, the acceptance of online tools and collaborative working is expected to grow. Our virtual multi-site approach proved to allow a collaborative decision-making process for the first time, which we consider to have a positive impact on the overall treatment quality.

Disease- and sex-specific differences in patients with heart valve disease: a proteome study.

Pressure overload in patients with aortic valve stenosis and volume overload in mitral valve regurgitation trigger specific forms of cardiac remodeling; however, little is known about similarities and differences in myocardial proteome regulation. We performed proteome profiling of 75 human left ventricular myocardial biopsies (aortic stenosis = 41, mitral regurgitation = 17, and controls = 17) using high-resolution tandem mass spectrometry next to clinical and hemodynamic parameter acquisition. In patients of both disease groups, proteins related to ECM and cytoskeleton were more abundant, whereas those related to energy metabolism and proteostasis were less abundant compared with controls. In addition, disease group-specific and sex-specific differences have been observed. Male patients with aortic stenosis showed more proteins related to fibrosis and less to energy metabolism, whereas female patients showed strong reduction in proteostasis-related proteins. Clinical imaging was in line with proteomic findings, showing elevation of fibrosis in both patient groups and sex differences. Disease- and sex-specific proteomic profiles provide insight into cardiac remodeling in patients with heart valve disease and might help improve the understanding of molecular mechanisms and the development of individualized treatment strategies.

Knowledge bases and software support for variant interpretation in precision oncology.

Precision oncology is a rapidly evolving interdisciplinary medical specialty. Comprehensive cancer panels are becoming increasingly available at pathology departments worldwide, creating the urgent need for scalable cancer variant annotation and molecularly informed treatment recommendations. A wealth of mainly academia-driven knowledge bases calls for software tools supporting the multi-step diagnostic process. We derive a comprehensive list of knowledge bases relevant for variant interpretation by a review of existing literature followed by a survey among medical experts from university hospitals in Germany. In addition, we review cancer variant interpretation tools, which integrate multiple knowledge bases. We categorize the knowledge bases along the diagnostic process in precision oncology and analyze programmatic access options as well as the integration of knowledge bases into software tools. The most commonly used knowledge bases provide good programmatic access options and have been integrated into a range of software tools. For the wider set of knowledge bases, access options vary across different parts of the diagnostic process. Programmatic access is limited for information regarding clinical classifications of variants and for therapy recommendations. The main issue for databases used for biological classification of pathogenic variants and pathway context information is the lack of standardized interfaces. There is no single cancer variant interpretation tool that integrates all identified knowledge bases. Specialized tools are available and need to be further developed for different steps in the diagnostic process.

Using interpretability approaches to update "black-box" clinical prediction models: an external validation study in nephrology.

Despite advances in machine learning-based clinical prediction models, only few of such models are actually deployed in clinical contexts. Among other reasons, this is due to a lack of validation studies. In this paper, we present and discuss the validation results of a machine learning model for the prediction of acute kidney injury in cardiac surgery patients initially developed on the MIMIC-III dataset when applied to an external cohort of an American research hospital. To help account for the performance differences observed, we utilized interpretability methods based on feature importance, which allowed experts to scrutinize model behavior both at the global and local level, making it possible to gain further insights into why it did not behave as expected on the validation cohort. The knowledge gleaned upon derivation can be potentially useful to assist model update during validation for more generalizable and simpler models. We argue that interpretability methods should be considered by practitioners as a further tool to help explain performance differences and inform model update in validation studies.

Eatomics: Shiny Exploration of Quantitative Proteomics Data.

Quantitative proteomics data are becoming increasingly more available, and as a consequence are being analyzed and interpreted by a larger group of users. However, many of these users have less programming experience. Furthermore, experimental designs and setups are getting more complicated, especially when tissue biopsies are analyzed. Luckily, the proteomics community has already established some best practices on how to conduct quality control, differential abundance analysis and enrichment analysis. However, an easy-to-use application that wraps together all steps for the exploration and flexible analysis of quantitative proteomics data is not yet available. For Eatomics, we utilize the R Shiny framework to implement carefully chosen parts of established analysis workflows to (i) make them accessible in a user-friendly way, (ii) add a multitude of interactive exploration possibilities, and (iii) develop a unique experimental design setup module, which interactively translates a given research hypothesis into a differential abundance and enrichment analysis formula. In this, we aim to fulfill the needs of a growing group of inexperienced quantitative proteomics data analysts. Eatomics may be tested with demo data directly online via https://we.analyzegenomes.com/now/eatomics/ or with the user's own data by installation from the Github repository at https://github.com/Millchmaedchen/Eatomics.

Controversial Trials First: Identifying Disagreement Between Clinical Guidelines and New Evidence.

Clinical guidelines integrate latest evidence to support clinical decision-making. As new research findings are published at an increasing rate, it would be helpful to detect when such results disagree with current guideline recommendations. In this work, we describe a software system for the automatic identification of disagreement between clinical guidelines and published research. A critical feature of the system is the extraction and cross-lingual normalization of information through natural language processing. The initial version focuses on the detection of cancer treatments in clinical trial reports that are not addressed in oncology guidelines. We evaluate the relevance of trials retrieved by our system retrospectively by comparison with historic guideline updates and also prospectively through manual evaluation by guideline experts. The system improves precision over state-of-the-art literature research strategies while maintaining near-total recall. Detailed error analysis highlights challenges for fine-grained clinical information extraction, in particular when extracting population definitions for tumor-agnostic therapies.