The role of real-world evidence for regulatory and public health decision-making for Accelerated Vaccine Deployment- a meeting report.

The COVID-19 pandemic underscored the need for rapid evidence generation to inform public health decisions beyond the limitations of conventional clinical trials. This report summarises presentations and discussions from a conference on the role of Real-World Evidence (RWE) in expediting vaccine deployment. Attended by regulatory bodies, public health entities, and industry experts, the gathering was a collaborative exchange of experiences and recommendations for leveraging RWE for vaccine deployment. RWE proved instrumental in refining decision-making processes to optimise dosing regimens, enhance guidance on target populations, and steer vaccination strategies against emerging variants. Participants felt that RWE was successfully integrated into lifecycle management, encompassing boosters and safety considerations. However, challenges emerged, prompting a call for improvements in data quality, standardisation, and availability, acknowledging the variability and potential inaccuracies in data across diverse healthcare systems. Regulatory transparency should also be prioritised to foster public trust, and improved collaborations with governments are needed to streamline data collection and navigate data privacy regulations. Moreover, building and sustaining resources, expertise, and infrastructure in LMICs emerged as imperative for RWE-generating capabilities. Continued stakeholder collaboration and securing adequate funding emerged as vital pillars for advancing the use of RWE in shaping responsive and effective public health strategies.

Protection against COVID-19 hospitalisation conferred by primary-series vaccination with AZD1222 in non-boosted individuals: first vaccine effectiveness results of the European COVIDRIVE study and meta-regression analysis.

Background: Vaccine effectiveness (VE) studies with long-term follow-up are needed to understand durability of protection against severe COVID-19 outcomes conferred by primary-series vaccination in individuals not receiving boosters. COVIDRIVE is a European public-private partnership evaluating brand-specific vaccine effectiveness (VE). We report a prespecified interim analysis of primary-series AZD1222 (ChAdOx1 nCoV-19) VE. Methods: Seven Study Contributors in Europe collected data on individuals aged ≥18 years who were hospitalised with severe acute respiratory infection (June 1st, 2021-September 5th, 2022) and eligible for COVID-19 vaccination prior to hospitalisation. In this test-negative case-control study, individuals were defined as test-positive cases or test-negative controls (SARS-CoV-2 RT-PCR) and were either fully vaccinated (two AZD1222 doses, 4-12 weeks apart, completed ≥14 days prior to symptom onset; no booster doses) or unvaccinated (no COVID-19 vaccine prior to hospitalisation). The primary objective was to estimate AZD1222 VE against COVID-19 hospitalisation. A literature review and meta-regression were conducted to contextualise findings on durability of protection. Findings: 761 individuals were included during the 15-month analysis period. Overall AZD1222 VE estimate was 72.8% (95% CI, 53.4-84.1). VE was 93.8% (48.6-99.3) in participants who received second AZD1222 doses ≤8 weeks prior to hospitalisation, with spline-based VE estimates demonstrating protection (VE ≥ 50%) 30 weeks post-second dose. Meta-regression analysis (data from seven publications) showed consistent results, with ≥80% protection against COVID-19 hospitalisation through ∼43 weeks post-second dose, with some degree of waning. Interpretation: Primary-series AZD1222 vaccination confers protection against COVID-19 hospitalisation with enduring levels of VE through ≥6 months. Funding: AstraZeneca.

Vaccine-Preventable Disease Incidence Based on Clinically, Radiologically, and Etiologically Confirmed Outcomes: Systematic Literature Review and Re-analysis of Pneumococcal Conjugate Vaccine Efficacy Trials.

BACKGROUND: Vaccine regulatory decision making is based on vaccine efficacy against etiologically confirmed outcomes, which may underestimate the preventable disease burden. To quantify this underestimation, we compared vaccine-preventable disease incidence (VPDI) of clinically defined outcomes with radiologically/etiologically confirmed outcomes. METHODS: We performed a systematic review of efficacy trials for several vaccines (1997-2019) and report results for pneumococcal conjugate vaccines. Data were extracted for outcomes within a clinical syndrome, organized from most sensitive to most specific. VPDI was determined for each outcome, and VPDI ratios were calculated, with a clinically defined outcome (numerator) and a radiologically/etiologically confirmed outcome (denominator). RESULTS: Among 9 studies, we calculated 27 VPDI ratios; 24 had a value >1. Among children, VPDI ratios for clinically defined versus vaccine serotype otitis media were 0.6 (95% CI not calculable), 2.1 (1.5-3.0), and 3.7 (1.0-10.2); the VPDI ratios comparing clinically defined with radiologically confirmed pneumonia ranged from not calculable to 2.7 (1.2-10.4); the VPDI ratio comparing clinically suspected invasive pneumococcal disease (IPD) with laboratory-confirmed IPD was 3.8 (95% CI not calculable). Among adults, the ratio comparing clinically defined with radiologically confirmed pneumonia was 1.9 (-6.0 to 9.1) and with vaccine serotype-confirmed pneumonia was 2.9 (.5-7.8). CONCLUSIONS: While there is substantial uncertainty around individual point estimates, there is a consistent trend in VPDI ratios, most commonly showing under-ascertainment of 1.5- to 4-fold, indicating that use of clinically defined outcomes is likely to provide a more accurate estimate of a pneumococcal conjugate vaccine's public health value.

Public health impact of low-dose aspirin on colorectal cancer, cardiovascular disease and safety in the UK - Results from micro-simulation model.

BACKGROUND: Low-dose aspirin therapy reduces the risk of cardiovascular disease and may have a positive effect on the prevention of colorectal cancer. We evaluated the population-level expected effect of regular low-dose aspirin use on cardiovascular disease (CVD), colorectal cancer (CRC), gastrointestinal bleeding, symptomatic peptic ulcers, and intracranial hemorrhage, using a microsimulation study design. METHODS: We used individual-level state transition modeling to assess the impact of aspirin in populations aged 50-59 or 60-69 years old indicated for low-dose aspirin usage for primary or secondary CVD prevention. Model parameters were based on data from governmental agencies from the UK or recent publications. RESULTS: In the 50-59 years cohort, a decrease in incidence rates (IRs per 100 000 person years) of non-fatal CVD (-203 and -794) and fatal CVD (-97 and-381) was reported in the primary and secondary CVD prevention setting, respectively. The IR reduction of CRC (-96 and -93) was similar for primary and secondary CVD prevention. The IR increase of non-fatal (116 and 119) and fatal safety events (6 and 6) was similar for primary and secondary CVD prevention. Similar results were obtained for the 60-69 years cohort. CONCLUSIONS: The decrease in fatal CVD and CRC events was larger than the increase in fatal safety events and this difference was more pronounced when low-dose aspirin was used for secondary compared to primary CVD prevention. These results provide a comprehensive image of the expected effect of regular low-dose aspirin therapy in a UK population indicated to use aspirin for CVD prevention.

European data sources for computing burden of (potential) vaccine-preventable diseases in ageing adults.

BACKGROUND: To guide decision-making on immunisation programmes for ageing adults in Europe, one of the aims of the Vaccines and InfecTious diseases in the Ageing popuLation (IMI2-VITAL) project is to assess the burden of disease (BoD) of (potentially) vaccine-preventable diseases ((P)VPD). We aimed to identify the available data sources to calculate the BoD of (P)VPD in participating VITAL countries and to pinpoint data gaps. Based on epidemiological criteria and vaccine availability, we prioritized (P) VPD caused by Extra-intestinal pathogenic Escherichia coli (ExPEC), norovirus, respiratory syncytial virus, Staphylococcus aureus, and pneumococcal pneumonia. METHODS: We conducted a survey on available data (e.g. incidence, mortality, disability-adjusted life years (DALY), quality-adjusted life years (QALY), sequelae, antimicrobial resistance (AMR), etc.) among national experts from European countries, and carried out five pathogen-specific literature reviews by searching MEDLINE for peer-reviewed publications published between 2009 and 2019. RESULTS: Morbidity and mortality data were generally available for all five diseases, while summary BoD estimates were mostly lacking. Available data were not always stratified by age and risk group, which is especially important when calculating BoD for ageing adults. AMR data were available in several countries for S. aureus and ExPEC. CONCLUSION: This study provides an exhaustive overview of the available data sources and data gaps for the estimation of BoD of five (P) VPD in ageing adults in the EU/EAA, which is useful to guide pathogen-specific BoD studies and contribute to calculation of (P)VPDs BoD.

Benefit-Risk Assessment of Vaccines. Part I: A Systematic Review to Identify and Describe Studies About Quantitative Benefit-Risk Models Applied to Vaccines.

INTRODUCTION: Understanding the balance between the benefits and risks of vaccination is essential to ensure informed and adequate public health decision making. Quantitative benefit-risk models (qBRm) represent useful tools to help decision makers with supporting benefit-risk assessment throughout the lifecycle of a medical product. However, few initiatives have been launched to harmonise qBRm approaches, specifically for vaccines. OBJECTIVES: The aim of this paper was to identify publications about qBRm applied to vaccines through a systematic literature review, and to describe their characteristics. METHODS: Medline, Scopus and Institute for Scientific Information Web of Knowledge databases were searched to identify articles in English, published from database inceptions up to December 2019. The search strategy included the combination of three key concepts: 'benefit-risk', 'modelling' and 'vaccines'. Data extracted included the modelling context and the methodological approaches used. RESULTS: Of 3172 publications screened, 48 original publications were included. Most of the selected studies were published over the past decade and focused on rotavirus (15), dengue (10) and influenza (6) vaccines. The majority (30) of studies reported analyses related to high-income countries. The methodology of the studies differed, particularly in modelling techniques, benefit-risk measures, and sensitivity analyses. The present work also pointed out a high level of variability in the quality of reporting across studies, with particular regard to input parameters and methodological approaches. CONCLUSIONS: This review provides an extensive list of qBRm applied to vaccines. Discrepancies across studies were identified during our review. While the number of published qBRm studies is increasing, no reporting guidance for qBRm applied to vaccines is currently available. This may affect decision makers' confidence in the results and their benefit-risk assessment(s); therefore, the development of such reporting guidance is highly needed.

Benefit-Risk Assessment of Vaccines. Part II: Proposal Towards Consolidated Standards of Reporting Quantitative Benefit-Risk Models Applied to Vaccines (BRIVAC).

INTRODUCTION: Quantitative benefit-risk models (qBRm) applied to vaccines are increasingly used by public health authorities and pharmaceutical companies as an important tool to help decision makers with supporting benefit-risk assessment (BRA). However, many publications on vaccine qBRm provide insufficient details on the methodological approaches used. Incomplete and/or inadequate qBRm reporting may affect result interpretation and confidence in BRA, highlighting a need for the development of standard reporting guidance. OBJECTIVES: Our objective was to provide an operational checklist for improved reporting of vaccine qBRm. METHODS: The consolidated standards of reporting quantitative Benefit-RIsk models applied to VACcines (BRIVAC) were designed as a checklist of key information to report in qBRm scientific publications regarding the assessed vaccines, the methodological considerations and the results and their interpretation. RESULTS: In total, 22 items and accompanying definitions, recommendations, explanations and examples were provided and divided into six main sections corresponding to the classic subdivisions of a scientific publication: title and abstract (items 1-2), introduction (items 3-4), methods (items 5-15), results (items 16-17), discussion (items 18-20) and other (items 21-22). CONCLUSIONS: The BRIVAC checklist is the first initiative providing an operational checklist for improved reporting of qBRm applied to vaccines in scientific articles. It is intended to assist authors, peer-reviewers, editors and readers in their critical appraisal. Future initiatives are needed to provide methodological guidance to perform qBRm while taking into account the vaccine specificities.

Vaccine effectiveness against laboratory-confirmed influenza in Europe - Results from the DRIVE network during season 2018/19.

The DRIVE project aims to establish a sustainable network to estimate brand-specific influenza vaccine effectiveness (IVE) annually. DRIVE is a public-private partnership launched in response to EMA guidance that requires effectiveness evaluation from manufacturers for all individual influenza vaccine brands every season. IVE studies are conducted by public partners in DRIVE. Private partners (vaccine manufacturers from the European Federation of Pharmaceutical Industries and Association (EFPIA)) provide written feedback moderated by an independent scientific committee. Test-negative design (TND) case-control studies (4 in primary care and five in hospital) were conducted in six countries in Europe during the 2018/19 season. Site-specific confounder-adjusted vaccine effectiveness (VE) estimates for any vaccine exposure were calculated by age group (<18 years (y), 18-64y and 65 + y) and pooled by setting (primary care, hospital) through random effects meta-analysis. In addition, one population-based cohort study was conducted in Finland. TND studies included 3339 cases and 6012 controls; seven vaccine brands were reported. For ages 65 + y, pooled VE against any influenza strain was estimated at 27% (95%CI 6-44) in hospital setting. Sample size was insufficient for meaningful IVE estimates in other age groups, in the primary care setting, or by vaccine brand. The population-based cohort study included 274,077 vaccinated and 494,337 unvaccinated person-years, two vaccine brands were reported. Brand-specific IVE was estimated for Fluenz Tetra (36% [95%CI 24-45]) for ages 2-6y, Vaxigrip Tetra (54% [43-62]) for ages 6 months to 6y, and Vaxigrip Tetra (30% [25-35]) for ages 65 + y. The results presented are from the second influenza season covered by the DRIVE network. While sample size from the pooled TND studies was still too low for precise (brand-specific) IVE estimates, the network has approximately doubled in size compared to the pilot season. Taking measures to increase sample size is an important focus of DRIVE for the coming years.

Outcome misclassification: Impact, usual practice in pharmacoepidemiology database studies and an online aid to correct biased estimates of risk ratio or cumulative incidence.

PURPOSE: It is well documented that outcome misclassification can bias a point estimate. We aimed to understand current practice in addressing this bias in pharmacoepidemiology database studies and to develop an open source application (app) from existing methodology to demonstrate the impact and mechanism of this bias on results. METHODS: Studies of an exposure and a clinical outcome were selected from all Pharmacoepidemiology and Drug Safety publications during 2017 and any reference to outcome misclassification described. An app to correct risk ratio (RR) and cumulative incidence for outcome misclassification was developed from a published methodology and used to demonstrate the impact of correction on point estimates. RESULTS: Eight (19%) of 43 papers selected reported estimates of outcome ascertainment accuracy with positive predictive value (PPV) the most commonly reported measure (7 of 8 studies). Three studies (7%) corrected for the bias, 1 by exposure strata, and 5 (12%) restricted analyses to confirmed cases. The app (app http://apps.p-95.com/ISPE/) uses values of PPV and sensitivity (or a range of possible values) in each exposure strata and returns corrected point estimates and confidence intervals. The app demonstrates that small differences between comparison groups in PPV or sensitivity can introduce bias even when accuracy estimates are high. CONCLUSIONS: Outcome misclassification is not usually corrected in pharmacoepidemiology database studies although correction methods using routinely measured indices are available. Error indices are needed for each comparison group to correct RR estimates for these errors. The app should encourage understanding of this bias and increase adjustment.

Preventing infectious diseases for healthy ageing: The VITAL public-private partnership project.

Prevention of infectious diseases through immunisation of the growing ageing adult population is essential to improve healthy ageing. However, many licenced and recommended vaccines for this age group show signs of waning of the protective effect due to declining immune responses (immuno-senescence) and decreasing vaccine uptake. Today's major challenge is to improve vaccine effectiveness and uptake and to deploy efficient vaccination strategies for this age group. The Vaccines and InfecTious diseases in the Ageing popuLation (VITAL) project, with partners from 17 academic & research groups and public institutes as well as seven industry collaborators, aims to address this challenge. The ambition is to provide evidence-based knowledge to local decision makers. Using a holistic and multidisciplinary approach and novel analytical methods, VITAL will provide tools that allow the development of targeted immunisation programs for ageing adults in European countries. The project is based on four pillars focussing on the assessment of the burden of vaccine-preventable diseases in ageing adults, the dissection of the mechanisms underlying immuno-senescence, the analysis of the clinical and economic public health impact of vaccination strategies and the development of educational resources for healthcare professionals. By the end of the project, a clear, detailed, and integrated program should be available for implementing a consistent, affordable, and sustainable vaccination strategy for ageing adults with regular evaluations of its impact over time.

Disease misclassification in electronic healthcare database studies: Deriving validity indices-A contribution from the ADVANCE project.

There is a strong and continuously growing interest in using large electronic healthcare databases to study health outcomes and the effects of pharmaceutical products. However, concerns regarding disease misclassification (i.e. classification errors of the disease status) and its impact on the study results are legitimate. Validation is therefore increasingly recognized as an essential component of database research. In this work, we elucidate the interrelations between the true prevalence of a disease in a database population (i.e. prevalence assuming no disease misclassification), the observed prevalence subject to disease misclassification, and the most common validity indices: sensitivity, specificity, positive and negative predictive value. Based on this, we obtained analytical expressions to derive all the validity indices and true prevalence from the observed prevalence and any combination of two other parameters. The analytical expressions can be used for various purposes. Most notably, they can be used to obtain an estimate of the observed prevalence adjusted for outcome misclassification from any combination of two validity indices and to derive validity indices from each other which would otherwise be difficult to obtain. To allow researchers to easily use the analytical expressions, we additionally developed a user-friendly and freely available web-application.

ADVANCE system testing: Can safety studies be conducted using electronic healthcare data? An example using pertussis vaccination.

INTRODUCTION: The Accelerated Development of Vaccine benefit-risk Collaboration in Europe (ADVANCE) public-private collaboration, aimed to develop and test a system for rapid benefit-risk monitoring of vaccines using healthcare databases in Europe. The objective of this proof-of-concept (POC) study was to test the feasibility of the ADVANCE system to generate incidence rates (IRs) per 1000 person-years and incidence rate ratios (IRRs) for risks associated with whole cell- (wP) and acellular- (aP) pertussis vaccines, occurring in event-specific risk windows in children prior to their pre-school-entry booster. METHODS: The study population comprised almost 5.1 million children aged 1 month to <6 years vaccinated with wP or aP vaccines during the study period from 1 January 1990 to 31 December 2015. Data from two Danish hospital (H) databases (AUH and SSI) and five primary care (PC) databases from, UK (THIN and RCGP RSC), Spain (SIDIAP and BIFAP) and Italy (Pedianet) were analysed. Database-specific IRRs between risk vs. non-risk periods were estimated in a self-controlled case series study and pooled using random-effects meta-analyses. RESULTS: The overall IRs were: fever, 58.2 (95% CI: 58.1; 58.3), 96.9 (96.7; 97.1) for PC DBs and 8.56 (8.5; 8.6) for H DBs; convulsions, 7.6 (95% CI: 7.6; 7.7), 3.55 (3.5; 3.6) for PC and 12.87 (12.8; 13) for H; persistent crying, 3.9 (95% CI: 3.8; 3.9) for PC, injection-site reactions, 2.2 (95% CI 2.1; 2.2) for PC, hypotonic hypo-responsive episode (HHE), 0.4 (95% CI: 0.4; 0.4), 0.6 (0.6; 0.6) for PC and 0.2 (0.2; 0.3) for H; and somnolence: 0.3 (95% CI: 0.3; 0.3) for PC. The pooled IRRs for persistent crying, fever, and ISR, adjusted for age and healthy vaccinee period were higher after wP vs. aP vaccination, and lower for convulsions, for all doses. The IRR for HHE was slightly lower for wP than aP, while wP was associated with somnolence only for dose 1 and dose 3 compared with aP. CONCLUSIONS: The estimated IRs and IRRs were comparable with published data, therefore demonstrating that the ADVANCE system was able to combine several European healthcare databases to assess vaccine safety data for wP and aP vaccination.

ADVANCE system testing: Benefit-risk analysis of a marketed vaccine using multi-criteria decision analysis and individual-level state transition modelling.

BACKGROUND: The Accelerated Development of VAccine beNefit-risk Collaboration in Europe (ADVANCE) is a public-private collaboration aiming to develop and test a system for rapid benefit-risk (B/R) monitoring of vaccines using electronic health record (eHR) databases in Europe. Proof-of-concept studies were designed to assess the proposed processes and system for generating the required evidence to perform B/R assessment and near-real time monitoring of vaccines. We aimed to test B/R methodologies for vaccines, using the comparison of the B/R profiles of whole-cell (wP) and acellular pertussis (aP) vaccine formulations in children as an example. METHODS: We used multi-criteria decision analysis (MCDA) to structure the B/R assessment combined with individual-level state transition modelling to build the B/R effects table. In the state transition model, we simulated the number of events in two hypothetical cohorts of 1 million children followed from first pertussis dose till pre-school-entry booster (or six years of age, whichever occurred first), with one cohort receiving wP, and the other aP. The benefits were reductions in pertussis incidence and complications. The risks were increased incidences of febrile convulsions, fever, hypotonic-hyporesponsive episodes, injection-site reactions and persistent crying. Most model parameters were informed by estimates (coverage, background incidences, relative risks) from eHR databases from Denmark (SSI), Spain (BIFAP and SIDIAP), Italy (Pedianet) and the UK (RCGP-RSC and THIN). Preferences were elicited from clinical and epidemiological experts. RESULTS: Using state transition modelling to build the B/R effects table facilitated the comparison of different vaccine effects (e.g. immediate vaccine risks vs long-term vaccine benefits). Estimates from eHR databases could be used to inform the simulation model. The model results could be easily combined with preference weights to obtain B/R scores. CONCLUSION: Existing B/R methodology, modelling and estimates from eHR databases can be successfully used for B/R assessment of vaccines.

Advance system testing: Vaccine benefit studies using multi-country electronic health data - The example of pertussis vaccination.

The Accelerated Development of VAccine benefit-risk Collaboration in Europe (ADVANCE), a public-private consortium, implemented and tested a distributed network system for the generation of evidence on the benefits-risks of marketed vaccines in Europe. We tested the system by estimating the incidence rate (IR) of pertussis and pertussis-related complications in children vaccinated with acellular (aP) and whole-cell (wP) pertussis vaccine. Data from seven electronic databases from four countries (Denmark: AUH and SSI, Spain: SIDIAP and BIFAP, UK: THIN and RCGP RSC and Italy: Pedianet) were included in a retrospective cohort analysis. Exposure was defined as any pertussis vaccination (aP or wP). The follow-up time started 14 days after the first dose. Children who had received any pertussis vaccine from January 1990 to December 2015 were included (those who switched type, or had unknown type were excluded). The outcomes of interest were confirmed or suspected pertussis and pertussis-related pneumonia and generalised convulsions within one month of pertussis diagnosis and death within three months of pertussis diagnosis. The cohort comprised 2,886,367 children ≤5 years of age. Data on wP and aP vaccination were available in three and seven databases, respectively. The IRs (per 100,000 person-years) for pertussis varied largely and ranged between 0.15 (95% CI: 0.12; 0.19) and 1.15 (95% CI: 1.07; 1.23), and the trends over time was consistent with those observed from national surveillance databases for confirmed pertussis. The pertussis IRs decreased as the number of wP and aP vaccine doses increased. Pertussis-related complications were rare (89 pneumonia, 7 generalised convulsions and no deaths) and their relative risk (vs. non-pertussis) could not be reliably estimated. The study demonstrated the feasibility of the ADVANCE system to estimate the change in pertussis IRs following pertussis vaccination. Larger sample sizes would provide additional power to compare the risk for complications between children with and without pertussis. The feasibility of vaccine-type specific effectiveness studies may be considered in the future.

Quantifying outcome misclassification in multi-database studies: The case study of pertussis in the ADVANCE project.

BACKGROUND: The Accelerated Development of VAccine beNefit-risk Collaboration in Europe (ADVANCE) is a public-private collaboration aiming to develop and test a system for rapid benefit-risk (B/R) monitoring of vaccines using European healthcare databases. Event misclassification can result in biased estimates. Using different algorithms for identifying cases of Bordetella pertussis (BorPer) infection as a test case, we aimed to describe a strategy to quantify event misclassification, when manual chart review is not feasible. METHODS: Four participating databases retrieved data from primary care (PC) setting: BIFAP: (Spain), THIN and RCGP RSC (UK) and PEDIANET (Italy); SIDIAP (Spain) retrieved data from both PC and hospital settings. BorPer algorithms were defined by healthcare setting, data domain (diagnoses, drugs, or laboratory tests) and concept sets (specific or unspecified pertussis). Algorithm- and database-specific BorPer incidence rates (IRs) were estimated in children aged 0-14 years enrolled in 2012 and 2014 and followed up until the end of each calendar year and compared with IRs of confirmed pertussis from the ECDC surveillance system (TESSy). Novel formulas were used to approximate validity indices, based on a small set of assumptions. They were applied to approximately estimate positive predictive value (PPV) and sensitivity in SIDIAP. RESULTS: The number of cases and the estimated BorPer IRs per 100,000 person-years in PC, using data representing 3,173,268 person-years, were 0 (IR = 0.0), 21 (IR = 4.3), 21 (IR = 5.1), 79 (IR = 5.7), and 2 (IR = 2.3) in BIFAP, SIDIAP, THIN, RCGP RSC and PEDIANET respectively. The IRs for combined specific/unspecified pertussis were higher than TESSy, suggesting that some false positives had been included. In SIDIAP the estimated IR was 45.0 when discharge diagnoses were included. The sensitivity and PPV of combined PC specific and unspecific diagnoses for BorPer cases in SIDIAP were approximately 85% and 72%, respectively. CONCLUSION: Retrieving BorPer cases using only specific concepts has low sensitivity in PC databases, while including cases retrieved by unspecified concepts introduces false positives, which were approximately estimated to be 28% in one database. The share of cases that cannot be retrieved from a PC database because they are only seen in hospital was approximately estimated to be 15% in one database. This study demonstrated that quantifying the impact of different event-finding algorithms across databases and benchmarking with disease surveillance data can provide approximate estimates of algorithm validity.

ADVANCE: Towards near real-time monitoring of vaccination coverage, benefits and risks using European electronic health record databases.

BACKGROUND: The Accelerated Development of VAccine beNefit-risk Collaboration in Europe (ADVANCE) is a public-private partnership aiming to develop and test a system for rapid benefit-risk (B/R) monitoring of vaccines using European electronic health record (eHR) databases. This proof-of-concept study aimed to test the feasibility of near real-time (NRT) monitoring of vaccination coverage, benefits and risks based on multiple European eHR databases, using acellular pertussis vaccination in children aged <6 years as test case. METHODS: A qualitative feasibility assessment on NRT monitoring was carried out using a survey and face-to-face discussion with ADVANCE data partners. Subsequently, a dynamic cohort study was conducted containing two distinct observation periods: a first period to establish a baseline (Jan 2014 to Mar 2018) and a subsequent 3-month period to test the actual feasibility of weekly NRT monitoring, based on which data latencies were calculated. An interactive web-application was additionally developed to facilitate the visual monitoring of vaccination coverage, the vaccine preventable disease incidence rates (benefits) and the incidence rates of adverse events (risks). RESULTS: Nine databases from four countries (Denmark, Italy, Spain and UK) participated in the qualitative feasibility assessment. Of them, five databases took part in the dynamic cohort study, with 5 databases providing baseline data and 3 databases participating to the NRT monitoring, providing data extractions on an almost weekly basis. The median data latency (time between event date and data release date) was between 1 and 2 weeks except for the benefit and risk events in one of the databases (latency 16 weeks). CONCLUSION: Three European eHR databases successfully demonstrated the feasibility of providing data for weekly NRT monitoring, with short data latencies of 1-2 weeks for most events.

ADVANCE system testing: Can coverage of pertussis vaccination be estimated in European countries using electronic healthcare databases: An example.

INTRODUCTION: The Accelerated Development of VAccine beNefit-risk Collaboration in Europe (ADVANCE) is a public-private collaboration aiming to develop and test a system for rapid benefit-risk (B/R) monitoring of vaccines, using existing healthcare databases in Europe. The objective of this paper was to assess the feasibility of using electronic healthcare databases to estimate dose-specific acellular pertussis (aP) and whole cell pertussis (wP) vaccine coverage. METHODS: Seven electronic healthcare databases in four European countries (Denmark (n = 2), UK (n = 2), Spain (n = 2) and Italy (n = 1)) participated in this study. Children were included from birth and followed up to age six years. Vaccination exposure was obtained from the databases and classified by type (aP or wP), and dose 1, 2 or 3. Coverage was estimated using period prevalence. For the 2006 birth cohort, two estimation methods for pertussis vaccine coverage, period prevalence and cumulative incidence were compared for each database. RESULTS: The majority of the 2,575,576 children included had been vaccinated at the country-specific recommended ages. Overall, the estimated dose 3 coverage was 88-97% in Denmark (birth cohorts from 2003 to 2014), 96-100% in the UK (2003-2014), 95-98% in Spain (2004-2014) and 94% in Italy (2006-2007). The estimated dose 3 coverage per birth cohort in Denmark and the UK differed by 1-6% compared with national estimates, with our estimates mostly higher. The estimated dose 3 coverage in Spain differed by 0-2% with no consistent over- or underestimation. In Italy, the estimates were 3% lower compared with the national estimates. Except for Italy, for which the two coverage estimation methods generated the same results, the estimated cumulative incidence coverages were consistently 1-10% lower than period prevalence estimates. CONCLUSION: This study showed that it was possible to provide consistent estimates of pertussis immunisation coverage from the electronic healthcare databases included, and that the estimates were comparable with the national estimates.

Estimation of vaccination coverage from electronic healthcare records; methods performance evaluation - A contribution of the ADVANCE-project.

INTRODUCTION: The Accelerated Development of VAccine beNefit-risk Collaboration in Europe (ADVANCE) is a public private collaboration aiming to develop and test a system for rapid benefit-risk (B/R) monitoring of vaccines, using existing electronic healthcare record (eHR) databases in Europe. Part of the data in such sources is missing due to incomplete follow-up hampering the accurate estimation of vaccination coverage. We compared different methods for coverage estimation from eHR databases; naïve period prevalence, complete case period prevalence, period prevalence adjusted for follow-up time, Kaplan-Meier (KM) analysis and (adjusted) inverse probability weighing (IPW). METHODS: We created simulation scenarios with different proportions of completeness of follow-up. Both completeness independent and dependent from vaccination date and status were considered. The root mean squared error (RMSE) and relative difference between the estimated and true coverage were used to assess the performance of the different methods for each of the scenarios. We included data examples on the vaccination coverage of human papilloma virus and pertussis component containing vaccines from the Spanish BIFAP database. RESULTS: Under completeness independent from vaccination date or status, several methods provided estimates with bias close to zero. However, when dependence between completeness of follow-up and vaccination date or status was present, all methods generated biased estimates. The IPW/CDF methods were generally the least biased. Preference for a specific method should be based on the type of censoring and type of dependence between completeness of follow-up and vaccination. Additional insights into these aspects, might be gained by applying several methods.

Risk factors for modified vaccine effectiveness of the live attenuated zoster vaccine among the elderly in England.

BACKGROUND: The United Kingdom introduced routine vaccination with the live-attenuated zoster vaccine for 70 year-olds in 2013, with the vaccine also offered to 79 year-olds as part of a catch-up campaign. In the subsequent years, the catch-up campaign was extended to also include adults aged 78 years. We investigated 14 pre-identified potential risk factors for potential modified vaccine effectiveness. METHODS: This retrospective cohort study in England included subjects born in 1943-1946 (the routine cohort) and in 1934-1937 (the catch-up cohort). We used the Clinical Practice Research Datalink (CPRD) to identify herpes zoster (HZ) cases and the risk factors: age, gender, ethnicity, socio-economic status, asthma, type 2 diabetes, chronic obstructive pulmonary disease, smoking, body mass index, immunosuppression, history of HZ, co-administration with influenza or pneumococcal vaccine. We derived HZ incidence by risk groups, overall vaccine effectiveness (VE) and modified VE expressed as relative differences in VE from Poisson regression models. RESULTS: Overall VE was 66.8% [95% CI: 62.2; 71.0]. Two out of the 14 investigated risk factors modified the HZ VE. Notably, lower VE was observed in diabetics and in persons with a history of HZ with relative differences in VE of -22·2%, [95% CI: -39·6, -4·5] and -22·5%, [95% CI: -44·9, -0·1]. CONCLUSIONS: Live-attenuated zoster vaccine protection against HZ was lower in type 2 diabetics and in subjects with a history of HZ. Contrary to clinical trial results, age did not affect the observed VE. Further study is required to gain insights into why certain risk groups are less protected. Identifying and understanding the effect modifiers of VE is important for future vaccine development as well as vaccine recommendations.

Observational studies of non-specific effects of Diphtheria-Tetanus-Pertussis vaccines in low-income countries: Assessing the potential impact of study characteristics, bias and confounding through meta-regression.

INTRODUCTION: It has been suggested that some vaccines have effects beyond protection against the diseases they target, called non-specific effects (NSEs). In 2016, a systematic review by Higgins et al., commissioned by the WHO Strategic Advisory Group of Experts (SAGE) on immunization, estimated the relative risk (RR) of all-cause mortality after whole-cell Diphtheria-Tetanus-Pertussis (DTwP) vaccination to be 1.38 (95% CI: 0.92-2.08), and described these potential NSEs as inconsistent. However, the selection of studies for meta-analysis, based on their proneness to bias and confounding, was debated. OBJECTIVE: To identify study characteristics and postulated risks of bias and confounding that might have impacted the RR of all-cause mortality after DTwP vaccination in observational studies conducted in low-income countries. METHODS: Based on methodological considerations on study design and analysis, we systematically assessed all 17 DTwP studies from the Higgins et al. review for risk of selection bias, exposure and outcome misclassification, confounding and differential co-interventions. We used meta-regression to assess the impact of study characteristics and the postulated risks of bias and confounding on the RR estimates, and looked for outlying and influential risk estimates. Permutation tests were performed to control for false-positive findings. RESULTS: The overall RR of all-cause mortality after DTwP vaccination including all but one outlying and influential study was 1.32 (95% CI: 0.83-2.08). Based on uni-variable meta-regression, we found that study location (p = 0.01), studies using the landmark approach (p = 0.015) and studies at high risk of exposure misclassification (p = 0.036) were significantly associated with increased RR estimates whereas studies at high risk of selection bias (p = 0.059) showed borderline significance. The results further suggest these effect modifiers are clustered in studies conducted in West-Africa. CONCLUSION: The increased RR of all-cause mortality after DTwP might be confined to West-African countries and/or certain postulated risks of bias might have inflated these RRs.