Overcoming Time-Varying Confounding in Self-Controlled Case Series with Active Comparators: Application and Recommendations.

Confounding by indication is a key challenge for pharmacoepidemiologists. Although self-controlled study designs address time-invariant confounding, indications sometimes vary over time. For example, infection might act as a time-varying confounder in a study of antibiotics and uveitis, because it is time-limited and a direct cause both of receiving antibiotics and uveitis. Methods for incorporating active comparators in self-controlled studies to address such time-varying confounding by indication have only recently been developed. In this paper we formalize these methods, and provide a detailed description for how the active comparator rate ratio can be derived in a self-controlled case series (SCCS): either by explicitly comparing the regression coefficients for a drug of interest and an active comparator under certain circumstances using a simple ratio approach, or through the use of a nested regression model. The approaches are compared in two case studies, one examining the association between thiazolidinediones and fractures, and one examining the association between fluoroquinolones and uveitis using the UK Clinical Practice Research DataLink. Finally, we provide recommendations for the use of these methods, which we hope will support the design, execution and interpretation of SCCS using active comparators and thereby increase the robustness of pharmacoepidemiological studies.

Cardiorenal effects of Angiotensin-converting enzyme inhibitors and Angiotensin receptor blockers in people underrepresented in trials: analysis of routinely collected data with emulation of a reference trial (ONTARGET).

Cardiovascular disease (CVD) is a leading cause of death globally. Angiotensin-converting enzyme inhibitors (ACEi) and angiotensin receptor blockers (ARB), compared in the ONTARGET trial, each prevent CVD. However, trial results may not be generalisable and their effectiveness in underrepresented groups is unclear. Using trial emulation methods within routine-care data to validate findings, we explored generalisability of ONTARGET results. For people prescribed an ACEi/ARB in the UK Clinical Practice Research Datalink GOLD from 1/1/2001-31/7/2019, we applied trial criteria and propensity-score methods to create an ONTARGET trial-eligible cohort. Comparing ARB to ACEi, we estimated hazard ratios for the primary composite trial outcome (cardiovascular death, myocardial infarction, stroke, or hospitalisation for heart failure), and secondary outcomes. As the pre-specified criteria were met confirming trial emulation, we then explored treatment heterogeneity among three trial-underrepresented subgroups: females, those aged ≥75 years and those with chronic kidney disease (CKD). In the trial-eligible population (n=137,155), results for the primary outcome demonstrated similar effects of ARB and ACEi, (HR 0.97 [95% CI: 0.93, 1.01]), meeting the pre-specified validation criteria. When extending this outcome to trial-underrepresented groups, similar treatment effects were observed by sex, age and CKD. This suggests that ONTARGET trial findings are generalisable to trial-underrepresented subgroups.

Applying two approaches to detect unmeasured confounding due to time-varying variables in a self-controlled risk interval design evaluating COVID-19 vaccine safety signals, using myocarditis as a case example.

We test the robustness of the self-controlled risk interval (SCRI) design in a setting where time between doses may introduce time-varying confounding, using both negative control outcomes (NCOs) and quantitative bias analysis (QBA). All vaccinated cases identified from 5 European databases between 1 September 2020 and end of data availability were included. Exposures were doses 1-3 of the Pfizer, Moderna, AstraZeneca, and Janssen COVID-19 vaccines; outcomes were myocarditis and otitis externa (NCO). The SCRI used a 60-day control window and dose-specific 28-day risk windows, stratified by vaccine brand and adjusted for calendar time. The QBA included two scenarios: (i) baseline probability of the confounder was higher in the control window and (ii) vice versa. The NCO was not associated with any of the COVID-19 vaccine types or doses except Moderna dose 1 (IRR = 1.09, 95%CI 1.01-1.09). The QBA suggested even the strongest literature-reported confounder (COVID-19; RRmyocarditis = 18.3) could only explain away part of the observed effect from IRR = 3 to IRR = 1.40. The SCRI seems robust to unmeasured confounding in the COVID-19 setting, although a strong unmeasured confounder could bias the observed effect upward. Replication of our findings for other safety signals would strengthen this conclusion.

OpenSAFELY: A platform for analysing electronic health records designed for reproducible research.

Electronic health records (EHRs) and other administrative health data are increasingly used in research to generate evidence on the effectiveness, safety, and utilisation of medical products and services, and to inform public health guidance and policy. Reproducibility is a fundamental step for research credibility and promotes trust in evidence generated from EHRs. At present, ensuring research using EHRs is reproducible can be challenging for researchers. Research software platforms can provide technical solutions to enhance the reproducibility of research conducted using EHRs. In response to the COVID-19 pandemic, we developed the secure, transparent, analytic open-source software platform OpenSAFELY designed with reproducible research in mind. OpenSAFELY mitigates common barriers to reproducible research by: standardising key workflows around data preparation; removing barriers to code-sharing in secure analysis environments; enforcing public sharing of programming code and codelists; ensuring the same computational environment is used everywhere; integrating new and existing tools that encourage and enable the use of reproducible working practices; and providing an audit trail for all code that is run against the real data to increase transparency. This paper describes OpenSAFELY's reproducibility-by-design approach in detail.

Metadata for Data dIscoverability aNd Study rEplicability in obseRVAtional Studies (MINERVA): Development and Pilot of a Metadata List and Catalogue in Europe.

PURPOSE: Metadata for data dIscoverability aNd study rEplicability in obseRVAtional studies (MINERVA), a European Medicines Agency-funded project (EUPAS39322), defined a set of metadata to describe real-world data sources (RWDSs) and piloted metadata collection in a prototype catalogue to assist investigators from data source discoverability through study conduct. METHODS: A list of metadata was created from a review of existing metadata catalogues and recommendations, structured interviews, a stakeholder survey, and a technical workshop. The prototype was designed to comply with the FAIR principles (findable, accessible, interoperable, reusable), using MOLGENIS software. Metadata collection was piloted by 15 data access partners (DAPs) from across Europe. RESULTS: A total of 442 metadata variables were defined in six domains: institutions (organizations connected to a data source); data banks (data collections sustained by an organization); data sources (collections of linkable data banks covering a common underlying population); studies; networks (of institutions); and common data models (CDMs). A total of 26 institutions were recorded in the prototype. Each DAP populated the metadata of one data source and its selected data banks. The number of data banks varied by data source; the most common data banks were hospital administrative records and pharmacy dispensation records (10 data sources each). Quantitative metadata were successfully extracted from three data sources conforming to different CDMs and entered into the prototype. CONCLUSIONS: A metadata list was finalized, a prototype was successfully populated, and a good practice guide was developed. Setting up and maintaining a metadata catalogue on RWDSs will require substantial effort to support discoverability of data sources and reproducibility of studies in Europe.

A comparison of four self-controlled study designs in an analysis of COVID-19 vaccines and myocarditis using five European databases.

INTRODUCTION: The aim of this study was to assess the possible extent of bias due to violation of a core assumption (event-dependent exposures) when using self-controlled designs to analyse the association between COVID-19 vaccines and myocarditis. METHODS: We used data from five European databases (Spain: BIFAP, FISABIO VID, and SIDIAP; Italy: ARS-Tuscany; England: CPRD Aurum) converted to the ConcePTION Common Data Model. Individuals who experienced both myocarditis and were vaccinated against COVID-19 between 1 September 2020 and the end of data availability in each country were included. We compared a self-controlled risk interval study (SCRI) using a pre-vaccination control window, an SCRI using a post-vaccination control window, a standard SCCS and an extension of the SCCS designed to handle violations of the assumption of event-dependent exposures. RESULTS: We included 1,757 cases of myocarditis. For analyses of the first dose of the Pfizer vaccine, to which all databases contributed information, we found results consistent with a null effect in both of the SCRI and extended SCCS, but some indication of a harmful effect in a standard SCCS. For the second dose, we found evidence of a harmful association for all study designs, with relatively similar effect sizes (SCRI pre = 1.99, 1.40 - 2.82; SCRI post 2.13, 95 %CI - 1.43, 3.18; standard SCCS 1.79, 95 %CI 1.31 - 2.44, extended SCCS 1.52, 95 %CI = 1.08 - 2.15). Adjustment for calendar time did not change these conclusions. Findings using all designs were also consistent with a harmful effect following a second dose of the Moderna vaccine. CONCLUSIONS: In the context of the known association between COVID-19 vaccines and myocarditis, we have demonstrated that two forms of SCRI and two forms of SCCS led to largely comparable results, possibly because of limited violation of the assumption of event-dependent exposures.