Improving Eye-Tracking Data Quality: A Framework for Reproducible Evaluation of Detection Algorithms.

High-quality eye-tracking data are crucial in behavioral sciences and medicine. Even with a solid understanding of the literature, selecting the most suitable algorithm for a specific research project poses a challenge. Empowering applied researchers to choose the best-fitting detector for their research needs is the primary contribution of this paper. We developed a framework to systematically assess and compare the effectiveness of 13 state-of-the-art algorithms through a unified application interface. Hence, we more than double the number of algorithms that are currently usable within a single software package and allow researchers to identify the best-suited algorithm for a given scientific setup. Our framework validation on retrospective data underscores its suitability for algorithm selection. Through a detailed and reproducible step-by-step workflow, we hope to contribute towards significantly improved data quality in scientific experiments.

A Unified Data Architecture for Assessing Motor Symptoms in Parkinson's Disease.

INTRODUCTION: The diagnosis and treatment of Parkinson's disease depend on the assessment of motor symptoms. Wearables and machine learning algorithms have emerged to collect large amounts of data and potentially support clinicians in clinical and ambulant settings. STATE OF THE ART: However, a systematical and reusable data architecture for storage, processing, and analysis of inertial sensor data is not available. Consequently, datasets vary significantly between studies and prevent comparability. CONCEPT: To simplify research on the neurodegenerative disorder, we propose an efficient and real-time-optimized architecture compatible with HL7 FHIR backed by a relational database schema. LESSONS LEARNED: We can verify the adequate performance of the system on an experimental benchmark and in a clinical experiment. However, existing standards need to be further optimized to be fully sufficient for data with high temporal resolution.

Evaluating REDCap as the Central Data Collection Tool for the Hamburg City Health Study.

INTRODUCTION: The collection of examination data for large clinical studies is often done with proprietary systems, which are accompanied by several disadvantages such as high cost and low flexibility. With the use of open-source tools, these disadvantages can be overcome and thereby improve data collection as well as data quality. Here we exemplary use the data collection process of the Hamburg City Health Study (HCHS), carried out at the University Medical Center Hamburg-Eppendorf (UKE). We evaluated how the recording of the examination data can be converted from an established, proprietary electronic healthcare record (EHR) system to the free-to-use Research Electronic Data Capture (REDCap) software. METHODS: For this purpose, a technical conversion of the EHR system is described first. Metafiles derived from the EHR system were used for REDCap electronic case report form (eCRF) building. The REDCap system was tested by HCHS study assistants via completion of self-developed tasks mimicking their everyday study life. Usability was quantitatively evaluated via the IBM Computer System Usability Questionnaire (CSUQ) and qualitatively assessed with a semi-structured interview. RESULTS: With the IBM CSUQ, the study assistants rated the usage of the basic REDCap system for HCHS examination data collection with an overall score of 4.39, which represents a medium acceptance. The interview feedback was used to formulate user stories to subsequently increase the administrative sovereignty and to conceptualize a REDCap HCHS information technology (IT) infrastructure. CONCLUSION: Our work aims to serve as a template for evaluating the feasibility of a conversion from a proprietary to a free-to-use data collection tool for large clinical studies such as the HCHS. REDCap has great potential, but extensions and an integration to the current IT infrastructure are required.

Mapping the Oncological Basis Dataset to the Standardized Vocabularies of a Common Data Model: A Feasibility Study.

In their joint effort against cancer, all involved parties within the German healthcare system are obligated to report diagnostics, treatments, progression, and follow-up information for tumor patients to the respective cancer registries. Given the federal structure of Germany, the oncological basis dataset (oBDS) operates as the legally required national standard for oncological reporting. Unfortunately, the usage of various documentation software solutions leads to semantic and technical heterogeneity of the data, complicating the establishment of research networks and collective data analysis. Within this feasibility study, we evaluated the transferability of all oBDS characteristics to the standardized vocabularies, a metadata repository of the observational medical outcomes partnership (OMOP) common data model (CDM). A total of 17,844 oBDS expressions were mapped automatically or manually to standardized concepts of the OMOP CDM. In a second step, we converted real patient data retrieved from the Hamburg Cancer Registry to the new terminologies. Given our pipeline, we transformed 1773.373 cancer-related data elements to the OMOP CDM. The mapping of the oBDS to the standardized vocabularies of the OMOP CDM promotes the semantic interoperability of oncological data in Germany. Moreover, it allows the participation in network studies of the observational health data sciences and informatics under the usage of federated analysis beyond the level of individual countries.

Pragmatic screening for heart failure in the general population using an electrocardiogram-based neural network.

AIMS: We aim to develop a pragmatic screening tool for heart failure at the general population level. METHODS AND RESULTS: This study was conducted within the Hamburg-City-Health-Study, an ongoing, prospective, observational study enrolling randomly selected inhabitants of the city of Hamburg aged 45-75 years. Heart failure was diagnosed per current guidelines. Using only digital electrocardiograms (ECGs), a convolutional neural network (CNN) was built to discriminate participants with and without heart failure. As comparisons, known risk variables for heart failure were fitted into a logistic regression model and a random forest classifier. Of the 5299 individuals included into this study, 318 individuals (6.0%) had heart failure. Using only the digital ECGs instead of several risk variables as an input, the CNN provided a comparable predictive accuracy for heart failure versus the logistic regression model and the random forest classifier [area under the curve (AUC) of 0.75, a sensitivity of 0.67 and a specificity of 0.69 for the CNN; AUC 0.77, a sensitivity of 0.63 and a specificity of 0.76 for the logistic regression; AUC 0.79, a sensitivity of 0.67 and a specificity of 0.72 for the random forest classifier]. CONCLUSIONS: Using a CNN build on digital ECGs only and requiring no additional input, we derived a screening tool for heart failure in the general population. This could be perfectly embedded into clinical routine of general practitioners, as it builds on an already established diagnostic tool and does not require additional, time-consuming input. This could help to alleviate the underdiagnosis of heart failure.

Surgical data science - from concepts toward clinical translation.

Recent developments in data science in general and machine learning in particular have transformed the way experts envision the future of surgery. Surgical Data Science (SDS) is a new research field that aims to improve the quality of interventional healthcare through the capture, organization, analysis and modeling of data. While an increasing number of data-driven approaches and clinical applications have been studied in the fields of radiological and clinical data science, translational success stories are still lacking in surgery. In this publication, we shed light on the underlying reasons and provide a roadmap for future advances in the field. Based on an international workshop involving leading researchers in the field of SDS, we review current practice, key achievements and initiatives as well as available standards and tools for a number of topics relevant to the field, namely (1) infrastructure for data acquisition, storage and access in the presence of regulatory constraints, (2) data annotation and sharing and (3) data analytics. We further complement this technical perspective with (4) a review of currently available SDS products and the translational progress from academia and (5) a roadmap for faster clinical translation and exploitation of the full potential of SDS, based on an international multi-round Delphi process.

Analysis of Not Structurable Oncological Study Eligibility Criteria for Improved Patient-Trial Matching.

BACKGROUND: Higher enrolment rates of cancer patients into clinical trials are necessary to increase cancer survival. As a prerequisite, an improved semiautomated matching of patient characteristics with clinical trial eligibility criteria is needed. This is based on the computer interpretability, i.e., structurability of eligibility criteria texts. To increase structurability, the common content, phrasing, and structuring problems of oncological eligibility criteria need to be better understood. OBJECTIVES: We aimed to identify oncological eligibility criteria that were not possible to be structured by our manual approach and categorize them by the underlying structuring problem. Our results shall contribute to improved criteria phrasing in the future as a prerequisite for increased structurability. METHODS: The inclusion and exclusion criteria of 159 oncological studies from the Clinical Trial Information System of the National Center for Tumor Diseases Heidelberg were manually structured and grouped into content-related subcategories. Criteria identified as not structurable were analyzed further and manually categorized by the underlying structuring problem. RESULTS: The structuring of criteria resulted in 4,742 smallest meaningful components (SMCs) distributed across seven main categories (Diagnosis, Therapy, Laboratory, Study, Findings, Demographics, and Lifestyle, Others). A proportion of 645 SMCs (13.60%) was not possible to be structured due to content- and structure-related issues. Of these, a subset of 415 SMCs (64.34%) was considered not remediable, as supplementary medical knowledge would have been needed or the linkage among the sentence components was too complex. The main category "Diagnosis and Study" contained these two subcategories to the largest parts and thus were the least structurable. In the inclusion criteria, reasons for lacking structurability varied, while missing supplementary medical knowledge was the largest factor within the exclusion criteria. CONCLUSION: Our results suggest that further improvement of eligibility criterion phrasing only marginally contributes to increased structurability. Instead, physician-based confirmation of the matching results and the exclusion of factors harming the patient or biasing the study is needed.

A Detailed Catalogue of Multi-Omics Methodologies for Identification of Putative Biomarkers and Causal Molecular Networks in Translational Cancer Research.

Recent advances in sequencing and biotechnological methodologies have led to the generation of large volumes of molecular data of different omics layers, such as genomics, transcriptomics, proteomics and metabolomics. Integration of these data with clinical information provides new opportunities to discover how perturbations in biological processes lead to disease. Using data-driven approaches for the integration and interpretation of multi-omics data could stably identify links between structural and functional information and propose causal molecular networks with potential impact on cancer pathophysiology. This knowledge can then be used to improve disease diagnosis, prognosis, prevention, and therapy. This review will summarize and categorize the most current computational methodologies and tools for integration of distinct molecular layers in the context of translational cancer research and personalized therapy. Additionally, the bioinformatics tools Multi-Omics Factor Analysis (MOFA) and netDX will be tested using omics data from public cancer resources, to assess their overall robustness, provide reproducible workflows for gaining biological knowledge from multi-omics data, and to comprehensively understand the significantly perturbed biological entities in distinct cancer types. We show that the performed supervised and unsupervised analyses result in meaningful and novel findings.

[Patient registries for rare diseases in Germany: concept paper of the NAMSE strategy group]. / Patientenregister für Seltene Erkrankungen in Deutschland: Konzeptpapier der Strategiegruppe "Register" des Nationalen Aktionsbündnisses für Menschen mit Seltenen Erkrankungen (NAMSE).

The National Action Plan for People with Rare Diseases contains 52 concrete actions, including in the fields of care, research, diagnosis, and information management. With the aim of improving the quality and interoperability of national registries in the long term, action 28 proposed the establishment of a "Rare Diseases Registry" strategy group. The strategy group began its work in 2016. In this report, the group takes into account developments at the national and international level in order to develop recommendations for national initiatives.In addition to this, the group reports on consent and implementation as well as on the adaptation of a minimal dataset for use in rare disease registries and mapping the used data elements and schemata in a metadata repository. This position paper was created by the strategy group together with additional authors. The paper reached a consensus within the strategy group and can be seen as a concept paper of the Rare Diseases Registry strategy group.

Modern Information Technology for Cancer Research: What's in IT for Me? An Overview of Technologies and Approaches.

Information technology (IT) can enhance or change many scenarios in cancer research for the better. In this paper, we introduce several examples, starting with clinical data reuse and collaboration including data sharing in research networks. Key challenges are semantic interoperability and data access (including data privacy). We deal with gathering and analyzing genomic information, where cloud computing, uncertainties and reproducibility challenge researchers. Also, new sources for additional phenotypical data are shown in patient-reported outcome and machine learning in imaging. Last, we focus on therapy assistance, introducing tools used in molecular tumor boards and techniques for computer-assisted surgery. We discuss the need for metadata to aggregate and analyze data sets reliably. We conclude with an outlook towards a learning health care system in oncology, which connects bench and bedside by employing modern IT solutions.

An Interactive Timeline Visualization for Patient Cohorts in the Oncological Routine: A Use Case on Multiple Myeloma.

With the growing interdisciplinarity of cancer treatment and increasing amounts of data and patients, it is getting increasingly difficult for physicians to capture a patient's medical history as a basis for adequate treatment and to compare different medical histories of similar patients to each other. Furthermore, in order to tackle the etiological mechanisms of cancer, it is crucial to identify patients exhibiting a different disease course than their corresponding cohort. Several timeline visualizations have already been proposed. However, the functions and design of such visualizations are always use case dependent. We constructed a cohort timeline prototype mock-up for a specific oncological use case involving multiple myeloma, where the chronological monitoring of various parameters is crucial for patient diagnosis and treatment. Our proposed cohort timeline is a synthesis between elements described in the literature and our own approaches regarding function and design.

Finding Options Beyond Standard of Care in Oncology: A Proposal for Workflows Utilizing Knowledge Databases.

With the novel approach of molecularly stratified therapies based on genetic characteristics of individual tumors, the need for databases providing information on molecular alterations and targeted treatment options is increasing rapidly. In Molecular Tumor Boards (MTB) professionals discuss molecular alterations and provide biological context for therapeutic options using external knowledge databases. The identification of informative databases and the information on their specific contents can greatly facilitate and standardize the functioning of a MTB. In this work we present a list of databases which have been deemed useful and relevant for MTB in a clinical setting. We describe workflows to recommend the use of specific databases at different steps in the clinical curation process. Information obtained from these databases is a necessary prerequisite to evaluate molecular alterations and devise rational targeted therapies in MTB.

MAGIC: once upon a time in consent management-a FHIR® tale.

BACKGROUND: The use of medical data for research purposes requires an informed consent of the patient that is compliant with the EU General Data Protection Regulation. In the context of multi-centre research initiatives and a multitude of clinical and epidemiological studies scalable and automatable measures for digital consent management are required. Modular form, structure, and contents render a patient's consent reusable for varying project settings in order to effectively manage and minimise organisational and technical efforts. RESULTS: Within the DFG-funded project "MAGIC" (Grant Number HO 1937/5-1) the digital consent management service tool gICS was enhanced to comply with the recommendations published in the TMF data protection guideline for medical research. In addition, a structured exchange format for modular consent templates considering established standards and formats in the area of digital informed consent management was designed. Using the new FHIR standard and the HAPI FHIR library, the first version for an exchange format and necessary import-/export-functionalities were successfully implemented. CONCLUSIONS: The proposed exchange format is a "work in progress". It represents a starting point for current discussions concerning digital consent management. It also attempts to improve interoperability between different approaches within the wider IHE-/HL7-/FHIR community. Independent of the exchange format, providing the possibility to export, modify and import templates for consents and withdrawals to be reused in similar clinical and epidemiological studies is an essential precondition for the sustainable operation of digital consent management.

A Method to Use Metadata in Legacy Web Applications: The Samply.MDR.Injector.

Whenever medical data is integrated from multiple sources, it is regarded good practice to separate data from information about its meaning, such as designations, definitions or permissible values (in short: metadata). However, the ways in which applications work with metadata are imperfect: Many applications do not support fetching metadata from externalized sources such as metadata repositories. In order to display human-readable metadata in any application, we propose not to change the application, but to provide a library that makes a change to the user interface. The goal of this work is to provide a way to "inject" the meaning of metadata keys into the web-based frontend of an application to make it "metadata aware".

Samply.MDR - A Metadata Repository and Its Application in Various Research Networks.

Collaboration in medical research is becoming common, especially for collecting relevant cases across institutional boundaries. If the data, which is usually very heterogeneously formalized and structured, can be integrated, such a collaboration can facilitate research. An absolute prerequisite for this is an extensive description about the formalization and exact meaning of every data element contained in a dataset. This information is commonly known as metadata. Various research networking projects tackle this challenge with the development of concepts and IT tools. The Samply Metadata Repository (Samply.MDR) is a solution for managing and publishing such metadata in a standardized and reusable way. In this article we present the structure and features of the Samply.MDR as well as its flexible usability by giving an overview about its application in various projects.

OSSE Goes FAIR - Implementation of the FAIR Data Principles for an Open-Source Registry for Rare Diseases.

The Open Source Registry for Rare Diseases (OSSE) provides a concept and a software for the management of registries for patients with rare diseases. A disease is defined as rare if less than 5 out of 10,000 people are affected. Up to date, approximately 6,000 rare diseases are catalogued. Networking and data exchange for research purposes remains challenging due to the paucity of interoperability and due to the fact that small data stocks are stored locally. The so called "Findable, Accessible, Interoperable, Reusable" (FAIR) Data Principles have been developed to improve research in the field of rare diseases. Subsequently, the OSSE architecture was adapted to implement the FAIR Data Principles. Therefore, the so-called FAIR Data Point was integrated into OSSE to provide a description of metadata in a FAIR manner. OSSE relies on the existing metadata repository (MDR), which is used in to define data elements in the system. This is an important step towards unified documentation across multiple registries. The integration and use of new procedures to improve interoperability plays an important role in the context of registries for rare diseases.

An Architecture for Translational Cancer Research As Exemplified by the German Cancer Consortium.

Networking of medical institutions by means of a capable data infrastructure has the potential to open up vast amounts of routine data to translational cancer research. However, the secondary use of information collected independently in several institutions is a challenging task of data integration. In this review, we discuss the requirements and common challenges involved in the establishment of such a platform. We present methods and tools from the field of medical informatics as solutions to semantic and technical heterogeneity, questions of data protection and record linkage, as well as issues of trust and data ownership. We also describe the architecture of an existing cancer research network as an exemplary application of these methods.

A Decentralized IT Architecture for Locating and Negotiating Access to Biobank Samples.

There is a need among researchers for the easy discoverability of biobank samples. Currently, there is no uniform way for finding samples and negotiate access. Instead, researchers have to communicate with each biobank separately. We present the architecture for the BBMRI-CS IT platform, whose goal is to facilitate sample location and access. We chose a decentral approach, which allows for strong data protection and provides the high flexibility needed in the highly heterogeneous landscape of European biobanks. This is the first implementation of a decentral search in the biobank field. With the addition of a Negotiator component, it also allows for easy communication and a follow-through of the lengthy approval process for accessing samples.

Optimizing a Query by Transformation and Expansion.

In the biomedical sector not only the amount of information produced and uploaded into the web is enormous, but also the number of sources where these data can be found. Clinicians and researchers spend huge amounts of time on trying to access this information and to filter the most important answers to a given question. As the formulation of these queries is crucial, automated query expansion is an effective tool to optimize a query and receive the best possible results. In this paper we introduce the concept of a workflow for an optimization of queries in the medical and biological sector by using a series of tools for expansion and transformation of the query. After the definition of attributes by the user, the query string is compared to previous queries in order to add semantic co-occurring terms to the query. Additionally, the query is enlarged by an inclusion of synonyms. The translation into database specific ontologies ensures the optimal query formulation for the chosen database(s). As this process can be performed in various databases at once, the results are ranked and normalized in order to achieve a comparable list of answers for a question.

The experience of physicians in pharmacogenomic clinical decision support within eight German university hospitals.

AIM: The aim of this study was to assess the physicians' attitude, their knowledge and their experience in pharmacogenomic clinical decision support in German hospitals. MATERIALS & METHODS: We conducted an online survey to address physicians of 13 different medical specialties across eight German university hospitals. In total, 564 returned questionnaires were analyzed. RESULTS: The remaining knowledge gap, the uncertainty of test reimbursement and the physicians' lack of awareness of existing pharmacogenomic clinical decision support systems (CDSS) are the major barriers for implementing pharmacogenomic CDSS into German hospitals. Furthermore, pharmacogenomic CDSS are most effective in the form of real-time decision support for internists. CONCLUSION: Physicians in German hospitals require additional education of both genetics and pharmacogenomics. They need to be provided with access to relevant pharmacogenomic CDSS.