Electronic health records (EHRs) in clinical research and platform trials: Application of the innovative EHR-based methods developed by EU-PEARL.

OBJECTIVE: Electronic Health Record (EHR) systems are digital platforms in clinical practice used to collect patients' clinical information related to their health status and represents a useful storage of real-world data. EHRs have a potential role in research studies, in particular, in platform trials. Platform trials are innovative trial designs including multiple trial arms (conducted simultaneously and/or sequentially) on different treatments under a single master protocol. However, the use of EHRs in research comes with important challenges such as incompleteness of records and the need to translate trial eligibility criteria into interoperable queries. In this paper, we aim to review and to describe our proposed innovative methods to tackle some of the most important challenges identified. This work is part of the Innovative Medicines Initiative (IMI) EU Patient-cEntric clinicAl tRial pLatforms (EU-PEARL) project's work package 3 (WP3), whose objective is to deliver tools and guidance for EHR-based protocol feasibility assessment, clinical site selection, and patient pre-screening in platform trials, investing in the building of a data-driven clinical network framework that can execute these complex innovative designs for which feasibility assessments are critically important. METHODS: ISO standards and relevant references informed a readiness survey, producing 354 criteria with corresponding questions selected and harmonised through a 7-round scoring process (0-1) in stakeholder meetings, with 85% of consensus being the threshold of acceptance for a criterium/question. ATLAS cohort definition and Cohort Diagnostics were mainly used to create the trial feasibility eligibility (I/E) criteria as executable interoperable queries. RESULTS: The WP3/EU-PEARL group developed a readiness survey (eSurvey) for an efficient selection of clinical sites with suitable EHRs, consisting of yes-or-no questions, and a set-up of interoperable proxy queries using physicians' defined trial criteria. Both actions facilitate recruiting trial participants and alignment between study costs/timelines and data-driven recruitment potential. CONCLUSION: The eSurvey will help create an archive of clinical sites with mature EHR systems suitable to participate in clinical trials/platform trials, and the interoperable proxy queries of trial eligibility criteria will help identify the number of potential participants. Ultimately, these tools will contribute to the production of EHR-based protocol design.

Mobilizing Patient and Public Involvement in the Development of Real-World Digital Technology Solutions: Tutorial.

Although the value of patient and public involvement and engagement (PPIE) activities in the development of new interventions and tools is well known, little guidance exists on how to perform these activities in a meaningful way. This is particularly true within large research consortia that target multiple objectives, include multiple patient groups, and work across many countries. Without clear guidance, there is a risk that PPIE may not capture patient opinions and needs correctly, thereby reducing the usefulness and effectiveness of new tools. Mobilise-D is an example of a large research consortium that aims to develop new digital outcome measures for real-world walking in 4 patient cohorts. Mobility is an important indicator of physical health. As such, there is potential clinical value in being able to accurately measure a person's mobility in their daily life environment to help researchers and clinicians better track changes and patterns in a person's daily life and activities. To achieve this, there is a need to create new ways of measuring walking. Recent advancements in digital technology help researchers meet this need. However, before any new measure can be used, researchers, health care professionals, and regulators need to know that the digital method is accurate and both accepted by and produces meaningful outcomes for patients and clinicians. Therefore, this paper outlines how PPIE structures were developed in the Mobilise-D consortium, providing details about the steps taken to implement PPIE, the experiences PPIE contributors had within this process, the lessons learned from the experiences, and recommendations for others who may want to do similar work in the future. The work outlined in this paper provided the Mobilise-D consortium with a foundation from which future PPIE tasks can be created and managed with clearly defined collaboration between researchers and patient representatives across Europe. This paper provides guidance on the work required to set up PPIE structures within a large consortium to promote and support the creation of meaningful and efficient PPIE related to the development of digital mobility outcomes.

Laboratory and free-living gait performance in adults with COPD and healthy controls.

Background: Gait characteristics are important risk factors for falls, hospitalisations and mortality in older adults, but the impact of COPD on gait performance remains unclear. We aimed to identify differences in gait characteristics between adults with COPD and healthy age-matched controls during 1) laboratory tests that included complex movements and obstacles, 2) simulated daily-life activities (supervised) and 3) free-living daily-life activities (unsupervised). Methods: This case-control study used a multi-sensor wearable system (INDIP) to obtain seven gait characteristics for each walking bout performed by adults with mild-to-severe COPD (n=17; forced expiratory volume in 1 s 57±19% predicted) and controls (n=20) during laboratory tests, and during simulated and free-living daily-life activities. Gait characteristics were compared between adults with COPD and healthy controls for all walking bouts combined, and for shorter (≤30 s) and longer (>30 s) walking bouts separately. Results: Slower walking speed (-11 cm·s-1, 95% CI: -20 to -3) and lower cadence (-6.6 steps·min-1, 95% CI: -12.3 to -0.9) were recorded in adults with COPD compared to healthy controls during longer (>30 s) free-living walking bouts, but not during shorter (≤30 s) walking bouts in either laboratory or free-living settings. Double support duration and gait variability measures were generally comparable between the two groups. Conclusion: Gait impairment of adults with mild-to-severe COPD mainly manifests during relatively long walking bouts (>30 s) in free-living conditions. Future research should determine the underlying mechanism(s) of this impairment to facilitate the development of interventions that can improve free-living gait performance in adults with COPD.

TransFAIR study: a European multicentre experimental comparison of EHR2EDC technology to the usual manual method for eCRF data collection.

PURPOSE: Regulatory authorities including the Food and Drug Administration and the European Medicines Agency are encouraging to conduct clinical trials using routinely collected data. The aim of the TransFAIR experimental comparison was to evaluate, within real-life conditions, the ability of the Electronic Health Records to Electronic Data Capture (EHR2EDC) module to accurately transfer from EHRs to EDC systems patients' data of clinical studies in various therapeutic areas. METHODS: A prospective study including six clinical trials from three different sponsors running in three hospitals across Europe has been conducted. The same data from the six studies were collected using both traditional manual data entry and the EHR2EDC module. The outcome variable was the percentage of data accurately transferred using the EHR2EDC technology. This percentage was calculated considering all collected data and the data in four domains: demographics (DM), vital signs (VS), laboratories (LB) and concomitant medications (CM). RESULTS: Overall, 6143 data points (39.6% of the data in the scope of the TransFAIR study and 16.9% when considering all data) were accurately transferred using the platform. LB data represented 65.4% of the data transferred; VS data, 30.8%; DM data, 0.7% and CM data, 3.1%. CONCLUSIONS: The objective of accurately transferring at least 15% of the manually entered trial datapoints using the EHR2EDC module was achieved. Collaboration and codesign by hospitals, industry, technology company, supported by the Institute of Innovation through Health Data was a success factor in accomplishing these results. Further work should focus on the harmonisation of data standards and improved interoperability to extend the scope of transferable EHR data.

Connecting real-world digital mobility assessment to clinical outcomes for regulatory and clinical endorsement-the Mobilise-D study protocol.

BACKGROUND: The development of optimal strategies to treat impaired mobility related to ageing and chronic disease requires better ways to detect and measure it. Digital health technology, including body worn sensors, has the potential to directly and accurately capture real-world mobility. Mobilise-D consists of 34 partners from 13 countries who are working together to jointly develop and implement a digital mobility assessment solution to demonstrate that real-world digital mobility outcomes have the potential to provide a better, safer, and quicker way to assess, monitor, and predict the efficacy of new interventions on impaired mobility. The overarching objective of the study is to establish the clinical validity of digital outcomes in patient populations impacted by mobility challenges, and to support engagement with regulatory and health technology agencies towards acceptance of digital mobility assessment in regulatory and health technology assessment decisions. METHODS/DESIGN: The Mobilise-D clinical validation study is a longitudinal observational cohort study that will recruit 2400 participants from four clinical cohorts. The populations of the Innovative Medicine Initiative-Joint Undertaking represent neurodegenerative conditions (Parkinson's Disease), respiratory disease (Chronic Obstructive Pulmonary Disease), neuro-inflammatory disorder (Multiple Sclerosis), fall-related injuries, osteoporosis, sarcopenia, and frailty (Proximal Femoral Fracture). In total, 17 clinical sites in ten countries will recruit participants who will be evaluated every six months over a period of two years. A wide range of core and cohort specific outcome measures will be collected, spanning patient-reported, observer-reported, and clinician-reported outcomes as well as performance-based outcomes (physical measures and cognitive/mental measures). Daily-living mobility and physical capacity will be assessed directly using a wearable device. These four clinical cohorts were chosen to obtain generalizable clinical findings, including diverse clinical, cultural, geographical, and age representation. The disease cohorts include a broad and heterogeneous range of subject characteristics with varying chronic care needs, and represent different trajectories of mobility disability. DISCUSSION: The results of Mobilise-D will provide longitudinal data on the use of digital mobility outcomes to identify, stratify, and monitor disability. This will support the development of widespread, cost-effective access to optimal clinical mobility management through personalised healthcare. Further, Mobilise-D will provide evidence-based, direct measures which can be endorsed by regulatory agencies and health technology assessment bodies to quantify the impact of disease-modifying interventions on mobility. TRIAL REGISTRATION: ISRCTN12051706.

Performances of a Solution to Semi-Automatically Fill eCRF with Data from the Electronic Health Record: Protocol for a Prospective Individual Participant Data Meta-Analysis.

Clinical trial data collection still relies on a manual entry from information available in the medical record. This process introduces delay and error risk. Automating data transfer from Electronic Health Record (EHR) to Electronic Data Capture (EDC) system, under investigators' supervision, would gracefully solve these issues. The present paper describes the design of the evaluation of a technology allowing EHR to act as eSource for clinical trials. As part of the EHR2EDC project, for 6 ongoing clinical trials, running at 3 hospitals, a parallel semi-automated data collection using such technology will be conducted focusing on a limited scope of data (demographic data, local laboratory results, concomitant medication and vital signs). The evaluation protocol consists in an individual participant data prospective meta-analysis comparing regular clinical trial data collection to the semi-automated one. The main outcome is the proportion of data correctly entered. Data quality and associated workload for hospital staff will be compared as secondary outcomes. Results should be available in 2020.

A Roadmap to Inform Development, Validation and Approval of Digital Mobility Outcomes: The Mobilise-D Approach.

Health care has had to adapt rapidly to COVID-19, and this in turn has highlighted a pressing need for tools to facilitate remote visits and monitoring. Digital health technology, including body-worn devices, offers a solution using digital outcomes to measure and monitor disease status and provide outcomes meaningful to both patients and health care professionals. Remote monitoring of physical mobility is a prime example, because mobility is among the most advanced modalities that can be assessed digitally and remotely. Loss of mobility is also an important feature of many health conditions, providing a read-out of health as well as a target for intervention. Real-world, continuous digital measures of mobility (digital mobility outcomes or DMOs) provide an opportunity for novel insights into health care conditions complementing existing mobility measures. Accepted and approved DMOs are not yet widely available. The need for large collaborative efforts to tackle the critical steps to adoption is widely recognised. Mobilise-D is an example. It is a multidisciplinary consortium of 34 institutions from academia and industry funded through the European Innovative Medicines Initiative 2 Joint Undertaking. Members of Mobilise-D are collaborating to address the critical steps for DMOs to be adopted in clinical trials and ultimately health care. To achieve this, the consortium has developed a roadmap to inform the development, validation and approval of DMOs in Parkinson's disease, multiple sclerosis, chronic obstructive pulmonary disease and recovery from proximal femoral fracture. Here we aim to describe the proposed approach and provide a high-level view of the ongoing and planned work of the Mobilise-D consortium. Ultimately, Mobilise-D aims to stimulate widespread adoption of DMOs through the provision of device agnostic software, standards and robust validation in order to bring digital outcomes from concept to use in clinical trials and health care.

Federated electronic health records research technology to support clinical trial protocol optimization: Evidence from EHR4CR and the InSite platform.

OBJECTIVE: To determine if inclusion/exclusion (I/E) criteria of clinical trial protocols can be represented as structured queries and executed using a secure federated research platform (InSite) on hospital electronic health records (EHR) systems, to estimate the number of potentially eligible patients. METHODS: Twenty-three clinical trial protocols completed during 2011-2017 across diverse disease areas were analyzed to construct queries that were executed with InSite using EHR records from 24 European hospitals containing records of >14 million patients. The number of patients matching I/E criteria of each protocol was estimated. RESULTS: All protocols could be formalized to some extent into a medical coding system (e.g. ICD-10CM, ATC, LOINC, SNOMED) and mapped to local hospital coding systems. The median number of I/E criteria of protocols tested was 29 (range: 14-47). A median of 55% (range 38-89%) of I/E criteria in each protocol could be transformed into a computable format. The median number of eligible patients identified was 26 per hospital site (range: 1-134). CONCLUSION: Clinical trial I/E eligibility criteria can be structured computationally and executed as queries on EHR systems to estimate the patient recruitment pool at each site. The results further suggest that an increase in structured coded information in EHRs would increase the number of I/E criteria that could be evaluated. Additional work is needed on broader deployment of federated platforms such as InSite.

The Reliability of Using Tablet Technology for Screening the Health of Older Adults.

In this study, we assessed the reliability of using a tablet application for collecting health data among older adults, in comparison to using paper surveys for this goal. Test-retest reliability between the two modalities, usability, user experience factors, and older adults' preference were determined. The results show perfect agreement between tablet and paper for the SARC-F and high agreement for the SF-36 physical scale and EQ-5D. Usability and user experience factors were perceived the same for both modalities. The majority of the participants preferred the tablet for health screening purposes, mainly because of its ease of use. This study shows that using tablets for health screenings among older adults does not affect test reliability, and that older adults prefer the tablet to paper for completing these tests.

A Pilot Study to Assess the Feasibility of Collecting and Transmitting Clinical Trial Data with Mobile Technologies.

BACKGROUND: The use of mobile technologies for data capture and transmission has the potential to streamline clinical trials, but researchers lack methods for collecting, processing, and interpreting data from these tools. OBJECTIVES: To assess the performance of a technical platform for collecting and transmitting data from six mobile technologies in the clinic and at home, to apply methods for comparing them to clinical standard devices, and to measure their usability, including how willing subjects were to use them on a regular basis. METHODS: In part 1 of the study, conducted over 3 weeks in the clinic, we tested two device pairs (mobile vs. clinical standard blood pressure monitor and mobile vs. clinical standard spirometer) on 25 healthy volunteers. In part 2 of the study, conducted over 3 days both in the clinic and at home, we tested the same two device pairs as in part 1, plus four additional pairs (mobile vs. clinical standard pulse oximeter, glucose meter, weight scale, and activity monitor), on 22 healthy volunteers. RESULTS: Data collection reliability was 98.1% in part 1 of the study and 95.8% in part 2 (the percentages exclude the wearable activity monitor, which collects data continuously). In part 1, 20 of 1,049 overall expected measurements were missing (1.9%), and in part 2, 45 of 1,083 were missing (4.2%). The most common reason for missing data was a single malfunctioning spirometer (13 of 20 total missed readings) in part 1, and that the subject did not take the measurement (22 of 45 total missed readings) in part 2. Also in part 2, a higher proportion of at-home measurements than in-clinic readings were missing (12.6 vs. 2.7%). The data from this experimental study were unable to establish repeatability or agreement for every mobile technology; only the pulse oximeter demonstrated repeatability, and only the weight scale demonstrated agreement with the clinical standard device. Most mobile technologies received high "willingness to use" ratings from the patients on the questionnaires. CONCLUSIONS: This study demonstrated that the wireless data transmission and processing platform was dependable. It also identified three critical areas of study for advancing the use of mobile technologies in clinical research: (1) if a mobile technology captures more than one type of endpoint (such as blood pressure and pulse), repeatability and agreement may need to be established for each endpoint to be included in a clinical trial; (2) researchers need to develop criteria for excluding invalid device readings (to be identified by algorithms in real time) for the population studied using ranges based on accumulated subject data and established norms; and (3) careful examination of a mobile technology's performance (reliability, repeatability, and agreement with accepted reference devices) during pilot testing is essential, even for medical devices approved by regulators.

Cost-benefit assessment of using electronic health records data for clinical research versus current practices: Contribution of the Electronic Health Records for Clinical Research (EHR4CR) European Project.

INTRODUCTION: The widespread adoption of electronic health records (EHR) provides a new opportunity to improve the efficiency of clinical research. The European EHR4CR (Electronic Health Records for Clinical Research) 4-year project has developed an innovative technological platform to enable the re-use of EHR data for clinical research. The objective of this cost-benefit assessment (CBA) is to assess the value of EHR4CR solutions compared to current practices, from the perspective of sponsors of clinical trials. MATERIALS AND METHODS: A CBA model was developed using an advanced modeling approach. The costs of performing three clinical research scenarios (S) applied to a hypothetical Phase II or III oncology clinical trial workflow (reference case) were estimated under current and EHR4CR conditions, namely protocol feasibility assessment (S1), patient identification for recruitment (S2), and clinical study execution (S3). The potential benefits were calculated considering that the estimated reduction in actual person-time and costs for performing EHR4CR S1, S2, and S3 would accelerate time to market (TTM). Probabilistic sensitivity analyses using Monte Carlo simulations were conducted to manage uncertainty. RESULTS: Should the estimated efficiency gains achieved with the EHR4CR platform translate into faster TTM, the expected benefits for the global pharmaceutical oncology sector were estimated at €161.5m (S1), €45.7m (S2), €204.5m (S1+S2), €1906m (S3), and up to €2121.8m (S1+S2+S3) when the scenarios were used sequentially. CONCLUSIONS: The results suggest that optimizing clinical trial design and execution with the EHR4CR platform would generate substantial added value for pharmaceutical industry, as main sponsors of clinical trials in Europe, and beyond.

Efficiency and effectiveness evaluation of an automated multi-country patient count cohort system.

BACKGROUND: With the increase of clinical trial costs during the last decades, the design of feasibility studies has become an essential process to reduce avoidable and costly protocol amendments. This design includes timelines, targeted sites and budget, together with a list of eligibility criteria that potential participants need to match. The present work was designed to assess the value of obtaining potential study participant counts using an automated patient count cohort system for large multi-country and multi-site trials: the Electronic Health Records for Clinical Research (EHR4CR) system. METHODS: The evaluation focuses on the accuracy of the patient counts and the time invested to obtain these using the EHR4CR platform compared to the current questionnaire based process. This evaluation will assess the patient counts from ten clinical trials at two different sites. In order to assess the accuracy of the results, the numbers obtained following the two processes need to be compared to a baseline number, the "alloyed" gold standard, which was produced by a manual check of patient records. RESULTS: The patient counts obtained using the EHR4CR system were in three evaluated trials more accurate than the ones obtained following the current process whereas in six other trials the current process counts were more accurate. In two of the trials both of the processes had counts within the gold standard's confidence interval. In terms of efficiency the EHR4CR protocol feasibility system proved to save approximately seven calendar days in the process of obtaining patient counts compared to the current manual process. CONCLUSIONS: At the current stage, electronic health record data sources need to be enhanced with better structured data so that these can be re-used for research purposes. With this kind of data, systems such as the EHR4CR are able to provide accurate objective patient counts in a more efficient way than the current methods. Additional research using both structured and unstructured data search technology is needed to assess the value of unstructured data and to compare the amount of efforts needed for data preparation.

Using electronic health records for clinical research: the case of the EHR4CR project.

OBJECTIVES: To describe the IMI EHR4CR project which is designing and developing, and aims to demonstrate, a scalable, widely acceptable and efficient approach to interoperability between EHR systems and clinical research systems. METHODS: The IMI EHR4CR project is combining and extending several previously isolated state-of-the-art technical components through a new approach to develop a platform for reusing EHR data to support medical research. This will be achieved through multiple but unified initiatives across different major disease areas (e.g. cardiovascular, cancer) and clinical research use cases (protocol feasibility, patient identification and recruitment, clinical trial execution and serious adverse event reporting), with various local and national stakeholders across several countries and therefore under various legal frameworks. RESULTS: An initial instance of the platform has been built, providing communication, security and terminology services to the eleven participating hospitals and ten pharmaceutical companies located in seven European countries. Proof-of-concept demonstrators have been built and evaluated for the protocol feasibility and patient recruitment scenarios. The specifications of the clinical trial execution and the adverse event reporting scenarios have been documented and reviewed. CONCLUSIONS: Through a combination of a consortium that brings collectively many years of experience from previous relevant EU projects and of the global conduct of clinical trials, of an approach to ethics that engages many important stakeholders across Europe to ensure acceptability, of a robust iterative design methodology for the platform services that is anchored on requirements of an underlying Service Oriented Architecture that has been designed to be scalable and adaptable, EHR4CR could be well placed to deliver a sound, useful and well accepted pan-European solution for the reuse of hospital EHR data to support clinical research studies.