Analyses of 1,236 genotyped primary ciliary dyskinesia individuals identify regional clusters of distinct DNA variants and significant genotype-phenotype correlations.

BACKGROUND: Primary ciliary dyskinesia (PCD) represents a group of rare hereditary disorders characterized by deficient ciliary airway clearance that can be associated with laterality defects. We aimed to describe the underlying gene defects, geographical differences in genotypes and their relationship to diagnostic findings and clinical phenotypes. METHODS: Genetic variants and clinical findings (age, sex, body mass index, laterality defects, FEV1) were collected from 19 countries using the ERN LUNG International PCD Registry. Genetic data were evaluated according to ACMG guidelines. We assessed regional distribution of implicated genes and genetic variants as well as genotype correlations with laterality defects and FEV1. RESULTS: 1236 individuals carried 908 distinct pathogenic DNA variants in 46 PCD genes. We found considerable variation in the distribution of PCD genotypes across countries due to the presence of distinct founder variants. The prevalence of PCD genotypes associated with pathognomonic ultrastructural defects (mean 72%; 47-100%) and laterality defects (mean 42%; 28-69%) varied widely among the countries. The prevalence of laterality defects was significantly lower in PCD individuals without pathognomonic ciliary ultrastructure defects (18%). The PCD cohort had a reduced median FEV1 z-score (-1.66). In the group of individuals with CCNO (-3.26), CCDC39 (-2.49), and CCDC40 (-2.96) variants, FEV1 z-scores were significantly lower, while the group of DNAH11 (-0.83) and ODAD1 (-0.85) variant individuals had significantly milder FEV1 z-score reductions compared to the whole PCD cohort. CONCLUSION: This unprecedented multinational dataset of DNA variants and information on their distribution across countries facilitates interpretation of genetic epidemiology of PCD and provides prediction of diagnostic and phenotypic features such as the course of lung function.

Europe's Largest Research Infrastructure for Curated Medical Data Models with Semantic Annotations.

BACKGROUND: Structural metadata from the majority of clinical studies and routine health care systems is currently not yet available to the scientific community. OBJECTIVE: To provide an overview of available contents in the Portal of Medical Data Models (MDM Portal). METHODS: The MDM Portal is a registered European information infrastructure for research and health care, and its contents are curated and semantically annotated by medical experts. It enables users to search, view, discuss, and download existing medical data models. RESULTS: The most frequent keyword is "clinical trial" (n = 18,777), and the most frequent disease-specific keyword is "breast neoplasms" (n = 1,943). Most data items are available in English (n = 545,749) and German (n = 109,267). Manually curated semantic annotations are available for 805,308 elements (554,352 items, 58,101 item groups, and 192,855 code list items), which were derived from 25,257 data models. In total, 1,609,225 Unified Medical Language System (UMLS) codes have been assigned, with 66,373 unique UMLS codes. CONCLUSION: To our knowledge, the MDM Portal constitutes Europe's largest collection of medical data models with semantically annotated elements. As such, it can be used to increase compatibility of medical datasets and can be utilized as a large expert-annotated medical text corpus for natural language processing.

Systematic analysis of ChatGPT, Google search and Llama 2 for clinical decision support tasks.

It is likely that individuals are turning to Large Language Models (LLMs) to seek health advice, much like searching for diagnoses on Google. We evaluate clinical accuracy of GPT-3·5 and GPT-4 for suggesting initial diagnosis, examination steps and treatment of 110 medical cases across diverse clinical disciplines. Moreover, two model configurations of the Llama 2 open source LLMs are assessed in a sub-study. For benchmarking the diagnostic task, we conduct a naïve Google search for comparison. Overall, GPT-4 performed best with superior performances over GPT-3·5 considering diagnosis and examination and superior performance over Google for diagnosis. Except for treatment, better performance on frequent vs rare diseases is evident for all three approaches. The sub-study indicates slightly lower performances for Llama models. In conclusion, the commercial LLMs show growing potential for medical question answering in two successive major releases. However, some weaknesses underscore the need for robust and regulated AI models in health care. Open source LLMs can be a viable option to address specific needs regarding data privacy and transparency of training.

Integration of Patient-Reported Outcome Data Collected Via Web Applications and Mobile Apps Into a Nation-Wide COVID-19 Research Platform Using Fast Healthcare Interoperability Resources: Development Study.

BACKGROUND: The Network University Medicine projects are an important part of the German COVID-19 research infrastructure. They comprise 2 subprojects: COVID-19 Data Exchange (CODEX) and Coordination on Mobile Pandemic Apps Best Practice and Solution Sharing (COMPASS). CODEX provides a centralized and secure data storage platform for research data, whereas in COMPASS, expert panels were gathered to develop a reference app framework for capturing patient-reported outcomes (PROs) that can be used by any researcher. OBJECTIVE: Our study aims to integrate the data collected with the COMPASS reference app framework into the central CODEX platform, so that they can be used by secondary researchers. Although both projects used the Fast Healthcare Interoperability Resources (FHIR) standard, it was not used in a way that data could be shared directly. Given the short time frame and the parallel developments within the CODEX platform, a pragmatic and robust solution for an interface component was required. METHODS: We have developed a means to facilitate and promote the use of the German Corona Consensus (GECCO) data set, a core data set for COVID-19 research in Germany. In this way, we ensured semantic interoperability for the app-collected PRO data with the COMPASS app. We also developed an interface component to sustain syntactic interoperability. RESULTS: The use of different FHIR types by the COMPASS reference app framework (the general-purpose FHIR Questionnaire) and the CODEX platform (eg, Patient, Condition, and Observation) was found to be the most significant obstacle. Therefore, we developed an interface component that realigns the Questionnaire items with the corresponding items in the GECCO data set and provides the correct resources for the CODEX platform. We extended the existing COMPASS questionnaire editor with an import function for GECCO items, which also tags them for the interface component. This ensures syntactic interoperability and eases the reuse of the GECCO data set for researchers. CONCLUSIONS: This paper shows how PRO data, which are collected across various studies conducted by different researchers, can be captured in a research-compatible way. This means that the data can be shared with a central research infrastructure and be reused by other researchers to gain more insights about COVID-19 and its sequelae.

ODM-DQA-Reporter: A Generic Approach to Assess and Monitor Basic Data Quality of Medical Research Data in Operational Data Model (ODM) Format.

A generic approach for assessment and continuous monitoring of data quality in ODM-based research data has been developed. The focus is on the two data quality indicators completeness and syntactic correctness. The main idea is to enable the generation of a data quality report without additional programming effort.

Linking EMR Data to REDCap: Implementation in the SOLKID Register.

Secondary use, the reuse of medical patient data stored during routine care in the hospital's electronic medical records (EMR) for research purpose is common, especially for registers and pragmatic trials. Often the medical data items are copied manually from the EMR into the used research database. This process is time consuming and error prone. In the "Safety of the Living Kidney Donor - The German National Register" (SOLKID-GNR), laboratory results gathered during control check-ups of the living donors before and after the transplantation are to be transferred from the EMR into the electronic data capture system REDCap of the register. In this work, we present our approach of realizing an automated transfer of time-dependent laboratory results from the EMR of the University Hospital of Münster to REDCap. A challenge lies in the multi-center structure of SOLKID-GNR. The participating transplant centers are using different EMR systems, which requires a flexible architecture design. In addition, we aimed to support reuse of the implementation for other research settings with other medical data items of interest.

ELaPro, a LOINC-mapped core dataset for top laboratory procedures of eligibility screening for clinical trials.

BACKGROUND: Screening for eligible patients continues to pose a great challenge for many clinical trials. This has led to a rapidly growing interest in standardizing computable representations of eligibility criteria (EC) in order to develop tools that leverage data from electronic health record (EHR) systems. Although laboratory procedures (LP) represent a common entity of EC that is readily available and retrievable from EHR systems, there is a lack of interoperable data models for this entity of EC. A public, specialized data model that utilizes international, widely-adopted terminology for LP, e.g. Logical Observation Identifiers Names and Codes (LOINC®), is much needed to support automated screening tools. OBJECTIVE: The aim of this study is to establish a core dataset for LP most frequently requested to recruit patients for clinical trials using LOINC terminology. Employing such a core dataset could enhance the interface between study feasibility platforms and EHR systems and significantly improve automatic patient recruitment. METHODS: We used a semi-automated approach to analyze 10,516 screening forms from the Medical Data Models (MDM) portal's data repository that are pre-annotated with Unified Medical Language System (UMLS). An automated semantic analysis based on concept frequency is followed by an extensive manual expert review performed by physicians to analyze complex recruitment-relevant concepts not amenable to automatic approach. RESULTS: Based on analysis of 138,225 EC from 10,516 screening forms, 55 laboratory procedures represented 77.87% of all UMLS laboratory concept occurrences identified in the selected EC forms. We identified 26,413 unique UMLS concepts from 118 UMLS semantic types and covered the vast majority of Medical Subject Headings (MeSH) disease domains. CONCLUSIONS: Only a small set of common LP covers the majority of laboratory concepts in screening EC forms which supports the feasibility of establishing a focused core dataset for LP. We present ELaPro, a novel, LOINC-mapped, core dataset for the most frequent 55 LP requested in screening for clinical trials. ELaPro is available in multiple machine-readable data formats like CSV, ODM and HL7 FHIR. The extensive manual curation of this large number of free-text EC as well as the combining of UMLS and LOINC terminologies distinguishes this specialized dataset from previous relevant datasets in the literature.

Portal of Medical Data Models: Stakeholder Feedback and Requirements.

The Portal of Medical Data Models has been developed since 2011 by the University of Münster. Its main goals are transparency, standardization and secondary use of medical metadata. Via two online surveys feedback from stakeholders of German health research was collected regarding the portal's contents. The surveys confirmed great interest in secondary use of medical forms.

Comparing SDTM and FHIR® for Real World Data from Electronic Health Records for Clinical Trial Submissions.

Real world data for use in clinical trials is promising. We compared the SDTM for clinical trial data submission with FHIR® for routine documentation. After categorization of variables by relevance, clinically relevant SDTM items were mapped to FHIR®. About 30% in both were seen as clinically relevant. The majority of these SDTM items were mappable to FHIR® Observation resource.

Pragmatic MDR: a metadata repository with bottom-up standardization of medical metadata through reuse.

BACKGROUND: The variety of medical documentation often leads to incompatible data elements that impede data integration between institutions. A common approach to standardize and distribute metadata definitions are ISO/IEC 11179 norm-compliant metadata repositories with top-down standardization. To the best of our knowledge, however, it is not yet common practice to reuse the content of publicly accessible metadata repositories for creation of case report forms or routine documentation. We suggest an alternative concept called pragmatic metadata repository, which enables a community-driven bottom-up approach for agreeing on data collection models. A pragmatic metadata repository collects real-world documentation and considers frequent metadata definitions as high quality with potential for reuse. METHODS: We implemented a pragmatic metadata repository proof of concept application and filled it with medical forms from the Portal of Medical Data Models. We applied this prototype in two use cases to demonstrate its capabilities for reusing metadata: first, integration into a study editor for the suggestion of data elements and, second, metadata synchronization between two institutions. Moreover, we evaluated the emergence of bottom-up standards in the prototype and two medical data managers assessed their quality for 24 medical concepts. RESULTS: The resulting prototype contained 466,569 unique metadata definitions. Integration into the study editor led to a reuse of 1836 items and item groups. During the metadata synchronization, semantic codes of 4608 data elements were transferred. Our evaluation revealed that for less complex medical concepts weak bottom-up standards could be established. However, more diverse disease-related concepts showed no convergence of data elements due to an enormous heterogeneity of metadata. The survey showed fair agreement (Kalpha = 0.50, 95% CI 0.43-0.56) for good item quality of bottom-up standards. CONCLUSIONS: We demonstrated the feasibility of the pragmatic metadata repository concept for medical documentation. Applications of the prototype in two use cases suggest that it facilitates the reuse of data elements. Our evaluation showed that bottom-up standardization based on a large collection of real-world metadata can yield useful results. The proposed concept shall not replace existing top-down approaches, rather it complements them by showing what is commonly used in the community to guide other researchers.

Compatible Data Models at Design Stage of Medical Information Systems: Leveraging Related Data Elements from the MDM Portal.

Compatible data models are key for data integration. Data transformation after data collection has many limitations. Therefore compatible data structures should be addressed already during the design of information systems. The portal of Medical Data Models (MDM), which contains 20.000+ models and 495.000+ data items, was enhanced with a web service to identify data elements, which are frequently collected together in real information systems. Using Apache Solr, a fast search functionality to identify those elements with semantic annotations was implemented. This service was integrated into the metadata registry (MDR) component of MDM to make it available to the scientific community. It can be used to build intelligent data model editors, which suggest and import frequent data element definitions according to the current medical context.

Portal of Medical Data Models: Status 2018.

The Portal of Medical Data Models is an open-access platform for medical forms and data models. Annotation with UMLS codes enables semantic interoperability and secondary use of data. The number of forms and users are growing. The site has been updated and two analyzing tools have been added.