Implementation of a Taxonomy-Based Framework for the Selection of Appropriate Drugs and Outcomes for Real-World Data Signal Detection Studies.

INTRODUCTION: For signal detection studies investigating either drug safety or method evaluation, the choice of drug-outcome pairs needs to be tailored to the planned study design and vice versa. While this is well understood in hypothesis-testing epidemiology, it should be as important in signal detection, but this has not widely been considered. There is a need for a taxonomy framework to provide guidance and a systematic reproducible approach to the selection of appropriate drugs and outcomes for signal detection studies either investigating drug safety or assessing method performance using real-world data. OBJECTIVE: The aim was to design a general framework for the selection of appropriate drugs and outcomes for signal detection studies given a study design of interest. As a motivating example, we illustrate how the framework is applied to build a reference set for a study aiming to assess the performance of the self-controlled case series with active comparators. METHODS: We reviewed criteria presented in two published studies which aimed to provide practical advice for choosing the appropriate signal evaluation methodology, and assessed their relevance for signal detection. Further characteristics specific to signal detection were added. The final framework is based on: the application of study design requirements, the database(s) of interest, and the clinical importance of the drug(s) and outcome(s) under consideration. This structure was applied by selecting drug-outcome pairs as a reference set (i.e. list of drug-outcome pairs classified as positive or negative controls) for which the method is expected to work well for a signal detection study aiming to assess the performance of self-controlled case series. Eight criteria were used, related to the application of self-controlled case series assumptions, choice of active comparators, coverage in the database of interest and clinical importance of the outcomes. RESULTS: After application of the framework, two classes of antibiotics (seven drugs) were selected for the study, and 28 outcomes from all organ classes were chosen from the drug labels, out of the 273 investigated. In total, this corresponds to 104 positive controls (drug-outcome pairs) and 58 negative controls. CONCLUSIONS: We proposed and applied a framework for the selection of drugs and outcomes for both drug safety signal detection and method assessment used in signal detection to optimise their performance given a study design. This framework will eliminate part of the bias relating to drugs and outcomes not being suited to the method or database. The main difficulty lies in the choice of the criteria and their application to ensure systematic selection, especially as some information remains unknown in signal detection, and clinical judgement was needed on occasions. The same framework could be adapted for other methods.

Association between oral anticoagulants and COVID-19-related outcomes: a population-based cohort study.

BACKGROUND: Early evidence has shown that anticoagulant reduces the risk of thrombotic events in those infected with COVID-19. However, evidence of the role of routinely prescribed oral anticoagulants (OACs) in COVID-19 outcomes is limited. AIM: To investigate the association between OACs and COVID-19 outcomes in those with atrial fibrillation and a CHA2DS2-VASc score of 2. DESIGN AND SETTING: On behalf of NHS England, a population-based cohort study was conducted. METHOD: The study used primary care data and pseudonymously-linked SARS-CoV-2 antigen testing data, hospital admissions, and death records from England. Cox regression was used to estimate hazard ratios (HRs) for COVID-19 outcomes comparing people with current OAC use versus non-use, accounting for age, sex, comorbidities, other medications, deprivation, and general practice. RESULTS: Of 71 103 people with atrial fibrillation and a CHA2DS2-VASc score of 2, there were 52 832 current OAC users and 18 271 non-users. No difference in risk of being tested for SARS-CoV-2 was associated with current use (adjusted HR [aHR] 0.99, 95% confidence interval [CI] = 0.95 to 1.04) versus non-use. A lower risk of testing positive for SARS-CoV-2 (aHR 0.77, 95% CI = 0.63 to 0.95) and a marginally lower risk of COVID-19-related death (aHR, 0.74, 95% CI = 0.53 to 1.04) were associated with current use versus non-use. CONCLUSION: Among those at low baseline stroke risk, people receiving OACs had a lower risk of testing positive for SARS-CoV-2 and severe COVID-19 outcomes than non-users; this might be explained by a causal effect of OACs in preventing severe COVID-19 outcomes or unmeasured confounding, including more cautious behaviours leading to reduced infection risk.

Mortality among Care Home Residents in England during the first and second waves of the COVID-19 pandemic: an observational study of 4.3 million adults over the age of 65.

BACKGROUND: Residents in care homes have been severely impacted by COVID-19. We describe trends in the mortality risk among residents of care homes compared to private homes. METHODS: On behalf of NHS England we used OpenSAFELY-TPP to calculate monthly age-standardised risks of death due to all causes and COVID-19 among adults aged >=65 years between 1/2/2019 and 31/03/2021. Care home residents were identified using linkage to Care and Quality Commission data. FINDINGS: We included 4,340,648 people aged 65 years or older on the 1st of February 2019, 2.2% of whom were classified as residing in a care or nursing home. Age-standardised mortality risks were approximately 10 times higher among care home residents compared to those in private housing in February 2019: comparative mortality figure (CMF) = 10.59 (95%CI = 9.51, 11.81) among women, and 10.87 (9.93, 11.90) among men. By April 2020 these relative differences had increased to more than 17 times with CMFs of 17.57 (16.43, 18.79) among women and 18.17 (17.22, 19.17) among men. CMFs did not increase during the second wave, despite a rise in the absolute age-standardised COVID-19 mortality risks. INTERPRETATION: COVID-19 has had a disproportionate impact on the mortality of care home residents in England compared to older residents of private homes, but only in the first wave. This may be explained by a degree of acquired immunity, improved protective measures or changes in the underlying frailty of the populations. The care home population should be prioritised for measures aimed at controlling COVID-19. FUNDING: Medical Research Council MR/V015737/1.

Rates of serious clinical outcomes in survivors of hospitalisation with COVID-19 in England: a descriptive cohort study within the OpenSAFELY platform.

Background: Patients surviving hospitalisation for COVID-19 are thought to be at high risk of cardiometabolic and pulmonary complications, but quantification of that risk is limited. We aimed to describe the overall burden of these complications in people after discharge from hospital with COVID-19.   Methods: Working on behalf of NHS England, we used linked primary care records, death certificate and hospital data from the OpenSAFELY platform. We constructed three cohorts: patients discharged following hospitalisation with COVID-19, patients discharged following pre-pandemic hospitalisation with pneumonia, and a frequency-matched cohort from the general population in 2019. We studied seven outcomes: deep vein thrombosis (DVT), pulmonary embolism (PE), ischaemic stroke, myocardial infarction (MI), heart failure, AKI and new type 2 diabetes mellitus (T2DM) diagnosis. Absolute rates were measured in each cohort and Fine and Gray models were used to estimate age/sex adjusted subdistribution hazard ratios comparing outcome risk between discharged COVID-19 patients and the two comparator cohorts. Results: Amongst the population of 77,347 patients discharged following hospitalisation with COVID-19, rates for the majority of outcomes peaked in the first month post-discharge, then declined over the following four months. Patients in the COVID-19 population had markedly higher risk of all outcomes compared to matched controls from the 2019 general population. Across the whole study period, the risk of outcomes was more similar when comparing patients discharged with COVID-19 to those discharged with pneumonia in 2019, although COVID-19 patients had higher risk of T2DM (15.2 versus 37.2 [rate per 1,000-person-years for COVID-19 versus pneumonia, respectively]; SHR, 1.46 [95% CI: 1.31 - 1.63]).  Conclusions: Risk of cardiometabolic and pulmonary adverse outcomes is markedly raised following discharge from hospitalisation with COVID-19 compared to the general population. However, excess risks were similar to those seen following discharge post-pneumonia. Overall, this suggests a large additional burden on healthcare resources.

OpenSAFELY NHS Service Restoration Observatory 1: primary care clinical activity in England during the first wave of COVID-19.

BACKGROUND: The COVID-19 pandemic has disrupted healthcare activity. The NHS stopped non-urgent work in March 2020, later recommending services be restored to near-normal levels before winter where possible. AIM: To describe the volume and variation of coded clinical activity in general practice, taking respiratory disease and laboratory procedures as examples. DESIGN AND SETTING: Working on behalf of NHS England, a cohort study was conducted of 23.8 million patient records in general practice, in situ using OpenSAFELY. METHOD: Activity using Clinical Terms Version 3 codes and keyword searches from January 2019 to September 2020 are described. RESULTS: Activity recorded in general practice declined during the pandemic, but largely recovered by September. There was a large drop in coded activity for laboratory tests, with broad recovery to pre-pandemic levels by September. One exception was the international normalised ratio test, with a smaller reduction (median tests per 1000 patients in 2020: February 8.0; April 6.2; September 6.9). The pattern of recording for respiratory symptoms was less affected, following an expected seasonal pattern and classified as 'no change'. Respiratory infections exhibited a sustained drop, not returning to pre-pandemic levels by September. Asthma reviews experienced a small drop but recovered, whereas chronic obstructive pulmonary disease reviews remained below baseline. CONCLUSION: An open-source software framework was delivered to describe trends and variation in clinical activity across an unprecedented scale of primary care data. The COVD-19 pandemic led to a substantial change in healthcare activity. Most laboratory tests showed substantial reduction, largely recovering to near-normal levels by September, with some important tests less affected and recording of respiratory disease codes was mixed.

Trends and clinical characteristics of COVID-19 vaccine recipients: a federated analysis of 57.9 million patients' primary care records in situ using OpenSAFELY.

BACKGROUND: On 8 December 2020 NHS England administered the first COVID-19 vaccination. AIM: To describe trends and variation in vaccine coverage in different clinical and demographic groups in the first 100 days of the vaccine rollout. DESIGN AND SETTING: With the approval of NHS England, a cohort study was conducted of 57.9 million patient records in general practice in England, in situ and within the infrastructure of the electronic health record software vendors EMIS and TPP using OpenSAFELY. METHOD: Vaccine coverage across various subgroups of Joint Committee on Vaccination and Immunisation (JCVI) priority cohorts is described. RESULTS: A total of 20 852 692 patients (36.0%) received a vaccine between 8 December 2020 and 17 March 2021. Of patients aged ≥80 years not in a care home (JCVI group 2) 94.7% received a vaccine, but with substantial variation by ethnicity (White 96.2%, Black 68.3%) and deprivation (least deprived 96.6%, most deprived 90.7%). Patients with pre-existing medical conditions were more likely to be vaccinated with two exceptions: severe mental illness (89.5%) and learning disability (91.4%). There were 275 205 vaccine recipients who were identified as care home residents (JCVI group 1; 91.2% coverage). By 17 March, 1 257 914 (6.0%) recipients had a second dose. CONCLUSION: The NHS rapidly delivered mass vaccination. In this study a data-monitoring framework was deployed using publicly auditable methods and a secure in situ processing model, using linked but pseudonymised patient-level NHS data for 57.9 million patients. Targeted activity may be needed to address lower vaccination coverage observed among certain key groups.

Identifying Care Home Residents in Electronic Health Records - An OpenSAFELY Short Data Report.

Background: Care home residents have been severely affected by the COVID-19 pandemic. Electronic Health Records (EHR) hold significant potential for studying the healthcare needs of this vulnerable population; however, identifying care home residents in EHR is not straightforward. We describe and compare three different methods for identifying care home residents in the newly created OpenSAFELY-TPP data analytics platform.  Methods: Working on behalf of NHS England, we identified individuals aged 65 years or older potentially living in a care home on the 1st of February 2020 using (1) a complex address linkage, in which cleaned GP registered addresses were matched to old age care home addresses using data from the Care and Quality Commission (CQC); (2) coded events in the EHR; (3) household identifiers, age and household size to identify households with more than 3 individuals aged 65 years or older as potential care home residents. Raw addresses were not available to the investigators. Results: Of 4,437,286 individuals aged 65 years or older, 2.27% were identified as potential care home residents using the complex address linkage, 1.96% using coded events, 3.13% using household size and age and 3.74% using either of these methods. 53,210 individuals (32.0% of all potential care home residents) were classified as care home residents using all three methods. Address linkage had the largest overlap with the other methods; 93.3% of individuals identified as care home residents using the address linkage were also identified as such using either coded events or household age and size.  Conclusion: We have described the partial overlap between three methods for identifying care home residents in EHR, and provide detailed instructions for how to implement these in OpenSAFELY-TPP to support research into the impact of the COVID-19 pandemic on care home residents.

Clinical coding of long COVID in English primary care: a federated analysis of 58 million patient records in situ using OpenSAFELY.

BACKGROUND: Long COVID describes new or persistent symptoms at least 4 weeks after onset of acute COVID-19. Clinical codes to describe this phenomenon were recently created. AIM: To describe the use of long-COVID codes, and variation of use by general practice, demographic variables, and over time. DESIGN AND SETTING: Population-based cohort study in English primary care. METHOD: Working on behalf of NHS England, OpenSAFELY data were used encompassing 96% of the English population between 1 February 2020 and 25 May 2021. The proportion of people with a recorded code for long COVID was measured overall and by demographic factors, electronic health record software system (EMIS or TPP), and week. RESULTS: Long COVID was recorded for 23 273 people. Coding was unevenly distributed among practices, with 26.7% of practices having never used the codes. Regional variation ranged between 20.3 per 100 000 people for East of England (95% confidence interval [CI] = 19.3 to 21.4) and 55.6 per 100 000 people in London (95% CI = 54.1 to 57.1). Coding was higher among females (52.1, 95% CI = 51.3 to 52.9) than males (28.1, 95% CI = 27.5 to 28.7), and higher among practices using EMIS (53.7, 95% CI = 52.9 to 54.4) than those using TPP (20.9, 95% CI = 20.3 to 21.4). CONCLUSION: Current recording of long COVID in primary care is very low, and variable between practices. This may reflect patients not presenting; clinicians and patients holding different diagnostic thresholds; or challenges with the design and communication of diagnostic codes. Increased awareness of diagnostic codes is recommended to facilitate research and planning of services, and also surveys with qualitative work to better evaluate clinicians' understanding of the diagnosis.

Case fatality risk of the SARS-CoV-2 variant of concern B.1.1.7 in England, 16 November to 5 February.

The SARS-CoV-2 B.1.1.7 variant of concern (VOC) is increasing in prevalence across Europe. Accurate estimation of disease severity associated with this VOC is critical for pandemic planning. We found increased risk of death for VOC compared with non-VOC cases in England (hazard ratio: 1.67; 95% confidence interval: 1.34-2.09; p < 0.0001). Absolute risk of death by 28 days increased with age and comorbidities. This VOC has potential to spread faster with higher mortality than the pandemic to date.

Use of non-steroidal anti-inflammatory drugs and risk of death from COVID-19: an OpenSAFELY cohort analysis based on two cohorts.

OBJECTIVES: To assess the association between routinely prescribed non-steroidal anti-inflammatory drugs (NSAIDs) and deaths from COVID-19 using OpenSAFELY, a secure analytical platform. METHODS: We conducted two cohort studies from 1 March to 14 June 2020. Working on behalf of National Health Service England, we used routine clinical data in England linked to death data. In study 1, we identified people with an NSAID prescription in the last 3 years from the general population. In study 2, we identified people with rheumatoid arthritis/osteoarthritis. We defined exposure as current NSAID prescription within the 4 months before 1 March 2020. We used Cox regression to estimate HRs for COVID-19 related death in people currently prescribed NSAIDs, compared with those not currently prescribed NSAIDs, accounting for age, sex, comorbidities, other medications and geographical region. RESULTS: In study 1, we included 536 423 current NSAID users and 1 927 284 non-users in the general population. We observed no evidence of difference in risk of COVID-19 related death associated with current use (HR 0.96, 95% CI 0.80 to 1.14) in the multivariable-adjusted model. In study 2, we included 1 708 781 people with rheumatoid arthritis/osteoarthritis, of whom 175 495 (10%) were current NSAID users. In the multivariable-adjusted model, we observed a lower risk of COVID-19 related death (HR 0.78, 95% CI 0.64 to 0.94) associated with current use of NSAID versus non-use. CONCLUSIONS: We found no evidence of a harmful effect of routinely prescribed NSAIDs on COVID-19 related deaths. Risks of COVID-19 do not need to influence decisions about the routine therapeutic use of NSAIDs.

Association of Alendronate and Risk of Cardiovascular Events in Patients With Hip Fracture.

The risk of cardiovascular events (CVEs) with alendronate use in real-world hip fracture patients is unknown. This study aimed to investigate the risk of CVE with and without use of alendronate in patients with hip fracture. We conducted a retrospective cohort study using a population-wide database managed by the Hong Kong Hospital Authority. Patients newly diagnosed with hip fracture from 2005 through 2013 were followed until November 6, 2016. Alendronate and other antiosteoporosis medications use during the study period were examined. We matched treated and nontreated patients based on time-dependent propensity score. The risks of cardiovascular mortality, myocardial infarction, and stroke between treatment groups were evaluated using conditional Cox regression stratified by match pairs. To examine the associations over time, outcomes were assessed at 1 year, 3 years, 5 years, and 10 years. Among 34,991 patients with newly diagnosed hip fracture, 4602 (13.2%) received antiosteoporosis treatment during follow-up. Physical functioning or survival prospect was not significantly different between treated and nontreated patients. A total of 4594 treated patients were matched with 13,568 nontreated patients. Results of Cox regression analysis revealed that alendronate was associated with a significantly lower risk of 1-year cardiovascular mortality (HR 0.33; 95% CI, 0.17 to 0.65) and incident myocardial infarction (HR 0.55; 95% CI, 0.34 to 0.89), whereas marginally significant reduction in risk of stroke was observed at 5 years and 10 years (HR at 5 years: 0.82; 95% CI, 0.67 to 1.00; p = 0.049; HR at 10 years: 0.83; 95% CI, 0.69 to 1.01; p = 0.065). The strength of the association declined over time but remained significant. Similar results were observed when all nitrogen-containing bisphosphonates (N-BPs) were analyzed together. These findings were robust in multiple sensitivity analyses. Additional studies in other population samples and randomized clinical trials may be warranted to further understand the relationship between use of various antiosteoporosis medication and risk of CVE in patients with hip fracture. © 2018 American Society for Bone and Mineral Research.