The role of real-world evidence for regulatory and public health decision-making for Accelerated Vaccine Deployment- a meeting report.

The COVID-19 pandemic underscored the need for rapid evidence generation to inform public health decisions beyond the limitations of conventional clinical trials. This report summarises presentations and discussions from a conference on the role of Real-World Evidence (RWE) in expediting vaccine deployment. Attended by regulatory bodies, public health entities, and industry experts, the gathering was a collaborative exchange of experiences and recommendations for leveraging RWE for vaccine deployment. RWE proved instrumental in refining decision-making processes to optimise dosing regimens, enhance guidance on target populations, and steer vaccination strategies against emerging variants. Participants felt that RWE was successfully integrated into lifecycle management, encompassing boosters and safety considerations. However, challenges emerged, prompting a call for improvements in data quality, standardisation, and availability, acknowledging the variability and potential inaccuracies in data across diverse healthcare systems. Regulatory transparency should also be prioritised to foster public trust, and improved collaborations with governments are needed to streamline data collection and navigate data privacy regulations. Moreover, building and sustaining resources, expertise, and infrastructure in LMICs emerged as imperative for RWE-generating capabilities. Continued stakeholder collaboration and securing adequate funding emerged as vital pillars for advancing the use of RWE in shaping responsive and effective public health strategies.

Vaccine-Preventable Disease Incidence Based on Clinically, Radiologically, and Etiologically Confirmed Outcomes: Systematic Literature Review and Re-analysis of Pneumococcal Conjugate Vaccine Efficacy Trials.

BACKGROUND: Vaccine regulatory decision making is based on vaccine efficacy against etiologically confirmed outcomes, which may underestimate the preventable disease burden. To quantify this underestimation, we compared vaccine-preventable disease incidence (VPDI) of clinically defined outcomes with radiologically/etiologically confirmed outcomes. METHODS: We performed a systematic review of efficacy trials for several vaccines (1997-2019) and report results for pneumococcal conjugate vaccines. Data were extracted for outcomes within a clinical syndrome, organized from most sensitive to most specific. VPDI was determined for each outcome, and VPDI ratios were calculated, with a clinically defined outcome (numerator) and a radiologically/etiologically confirmed outcome (denominator). RESULTS: Among 9 studies, we calculated 27 VPDI ratios; 24 had a value >1. Among children, VPDI ratios for clinically defined versus vaccine serotype otitis media were 0.6 (95% CI not calculable), 2.1 (1.5-3.0), and 3.7 (1.0-10.2); the VPDI ratios comparing clinically defined with radiologically confirmed pneumonia ranged from not calculable to 2.7 (1.2-10.4); the VPDI ratio comparing clinically suspected invasive pneumococcal disease (IPD) with laboratory-confirmed IPD was 3.8 (95% CI not calculable). Among adults, the ratio comparing clinically defined with radiologically confirmed pneumonia was 1.9 (-6.0 to 9.1) and with vaccine serotype-confirmed pneumonia was 2.9 (.5-7.8). CONCLUSIONS: While there is substantial uncertainty around individual point estimates, there is a consistent trend in VPDI ratios, most commonly showing under-ascertainment of 1.5- to 4-fold, indicating that use of clinically defined outcomes is likely to provide a more accurate estimate of a pneumococcal conjugate vaccine's public health value.

European data sources for computing burden of (potential) vaccine-preventable diseases in ageing adults.

BACKGROUND: To guide decision-making on immunisation programmes for ageing adults in Europe, one of the aims of the Vaccines and InfecTious diseases in the Ageing popuLation (IMI2-VITAL) project is to assess the burden of disease (BoD) of (potentially) vaccine-preventable diseases ((P)VPD). We aimed to identify the available data sources to calculate the BoD of (P)VPD in participating VITAL countries and to pinpoint data gaps. Based on epidemiological criteria and vaccine availability, we prioritized (P) VPD caused by Extra-intestinal pathogenic Escherichia coli (ExPEC), norovirus, respiratory syncytial virus, Staphylococcus aureus, and pneumococcal pneumonia. METHODS: We conducted a survey on available data (e.g. incidence, mortality, disability-adjusted life years (DALY), quality-adjusted life years (QALY), sequelae, antimicrobial resistance (AMR), etc.) among national experts from European countries, and carried out five pathogen-specific literature reviews by searching MEDLINE for peer-reviewed publications published between 2009 and 2019. RESULTS: Morbidity and mortality data were generally available for all five diseases, while summary BoD estimates were mostly lacking. Available data were not always stratified by age and risk group, which is especially important when calculating BoD for ageing adults. AMR data were available in several countries for S. aureus and ExPEC. CONCLUSION: This study provides an exhaustive overview of the available data sources and data gaps for the estimation of BoD of five (P) VPD in ageing adults in the EU/EAA, which is useful to guide pathogen-specific BoD studies and contribute to calculation of (P)VPDs BoD.

Outcome misclassification: Impact, usual practice in pharmacoepidemiology database studies and an online aid to correct biased estimates of risk ratio or cumulative incidence.

PURPOSE: It is well documented that outcome misclassification can bias a point estimate. We aimed to understand current practice in addressing this bias in pharmacoepidemiology database studies and to develop an open source application (app) from existing methodology to demonstrate the impact and mechanism of this bias on results. METHODS: Studies of an exposure and a clinical outcome were selected from all Pharmacoepidemiology and Drug Safety publications during 2017 and any reference to outcome misclassification described. An app to correct risk ratio (RR) and cumulative incidence for outcome misclassification was developed from a published methodology and used to demonstrate the impact of correction on point estimates. RESULTS: Eight (19%) of 43 papers selected reported estimates of outcome ascertainment accuracy with positive predictive value (PPV) the most commonly reported measure (7 of 8 studies). Three studies (7%) corrected for the bias, 1 by exposure strata, and 5 (12%) restricted analyses to confirmed cases. The app (app http://apps.p-95.com/ISPE/) uses values of PPV and sensitivity (or a range of possible values) in each exposure strata and returns corrected point estimates and confidence intervals. The app demonstrates that small differences between comparison groups in PPV or sensitivity can introduce bias even when accuracy estimates are high. CONCLUSIONS: Outcome misclassification is not usually corrected in pharmacoepidemiology database studies although correction methods using routinely measured indices are available. Error indices are needed for each comparison group to correct RR estimates for these errors. The app should encourage understanding of this bias and increase adjustment.

Methodology for computing the burden of disease of adverse events following immunization.

PURPOSE: Composite disease burden measures such as disability-adjusted life-years (DALY) have been widely used to quantify the population-level health impact of disease or injury, but application has been limited for the estimation of the burden of adverse events following immunization. Our objective was to assess the feasibility of adapting the DALY approach for estimating adverse event burden. METHODS: We developed a practical methodological framework, explicitly describing all steps involved: acquisition of relative or absolute risks and background event incidence rates, selection of disability weights and durations, and computation of the years lived with disability (YLD) measure, with appropriate estimation of uncertainty. We present a worked example, in which YLD is computed for 3 recognized adverse reactions following 3 childhood vaccination types, based on background incidence rates and relative/absolute risks retrieved from the literature. RESULTS: YLD provided extra insight into the health impact of an adverse event over presentation of incidence rates only, as severity and duration are additionally incorporated. As well as providing guidance for the deployment of DALY methodology in the context of adverse events associated with vaccination, we also identified where data limitations potentially occur. CONCLUSIONS: Burden of disease methodology can be applied to estimate the health burden of adverse events following vaccination in a systematic way. As with all burden of disease studies, interpretation of the estimates must consider the quality and accuracy of the data sources contributing to the DALY computation.

Estimation of the burden of varicella in Europe before the introduction of universal childhood immunization.

BACKGROUND: Varicella is generally considered a mild disease. Disease burden is not well known and country-level estimation is challenging. As varicella disease is not notifiable, notification criteria and rates vary between countries. In general, existing surveillance systems do not capture cases that do not seek medical care, and most are affected by underreporting and underascertainment. We aimed to estimate the overall varicella disease burden in Europe to provide critical information to support decision-making regarding varicella vaccination. METHODS: We conducted a systematic literature review to identify all available epidemiological data on varicella IgG antibody seroprevalence, primary care and hospitalisation incidence, and mortality. We then developed methods to estimate age-specific varicella incidence and annual number of cases by different levels of severity (cases in the community, health care seekers in primary care and hospitals, and deaths) for all countries belonging to the European Medicines Agency (EMA) region and Switzerland. RESULTS: In the absence of universal varicella immunization, the burden of varicella would be substantial with a total of 5.5 million (95% CI: 4.7-6.4) varicella cases occurring annually across Europe. Variation exists between countries but overall the majority of cases (3 million; 95% CI: 2.7-3.3) would occur in children <5 years. Annually, 3-3.9 million patients would consult a primary care physician, 18,200-23,500 patients would be hospitalised, and 80 varicella-related deaths would occur (95% CI: 19-822). CONCLUSIONS: Varicella disease burden is substantial. Most cases occur in children <5 years old but adults require hospitalisation more often and are at higher risk of death. This information should be considered when planning and evaluating varicella control strategies. A better understanding of the driving factors of country-specific differences in varicella transmission and health care utilization is needed. Improving and standardizing varicella surveillance in Europe, as initiated by the European Centre for Disease Prevention and Control (ECDC), is important to improve data quality to facilitate inter-country comparison.

Protection against COVID-19 hospitalisation conferred by primary-series vaccination with AZD1222 in non-boosted individuals: first vaccine effectiveness results of the European COVIDRIVE study and meta-regression analysis.

Background: Vaccine effectiveness (VE) studies with long-term follow-up are needed to understand durability of protection against severe COVID-19 outcomes conferred by primary-series vaccination in individuals not receiving boosters. COVIDRIVE is a European public-private partnership evaluating brand-specific vaccine effectiveness (VE). We report a prespecified interim analysis of primary-series AZD1222 (ChAdOx1 nCoV-19) VE. Methods: Seven Study Contributors in Europe collected data on individuals aged ≥18 years who were hospitalised with severe acute respiratory infection (June 1st, 2021-September 5th, 2022) and eligible for COVID-19 vaccination prior to hospitalisation. In this test-negative case-control study, individuals were defined as test-positive cases or test-negative controls (SARS-CoV-2 RT-PCR) and were either fully vaccinated (two AZD1222 doses, 4-12 weeks apart, completed ≥14 days prior to symptom onset; no booster doses) or unvaccinated (no COVID-19 vaccine prior to hospitalisation). The primary objective was to estimate AZD1222 VE against COVID-19 hospitalisation. A literature review and meta-regression were conducted to contextualise findings on durability of protection. Findings: 761 individuals were included during the 15-month analysis period. Overall AZD1222 VE estimate was 72.8% (95% CI, 53.4-84.1). VE was 93.8% (48.6-99.3) in participants who received second AZD1222 doses ≤8 weeks prior to hospitalisation, with spline-based VE estimates demonstrating protection (VE ≥ 50%) 30 weeks post-second dose. Meta-regression analysis (data from seven publications) showed consistent results, with ≥80% protection against COVID-19 hospitalisation through ∼43 weeks post-second dose, with some degree of waning. Interpretation: Primary-series AZD1222 vaccination confers protection against COVID-19 hospitalisation with enduring levels of VE through ≥6 months. Funding: AstraZeneca.

Public health impact of low-dose aspirin on colorectal cancer, cardiovascular disease and safety in the UK - Results from micro-simulation model.

BACKGROUND: Low-dose aspirin therapy reduces the risk of cardiovascular disease and may have a positive effect on the prevention of colorectal cancer. We evaluated the population-level expected effect of regular low-dose aspirin use on cardiovascular disease (CVD), colorectal cancer (CRC), gastrointestinal bleeding, symptomatic peptic ulcers, and intracranial hemorrhage, using a microsimulation study design. METHODS: We used individual-level state transition modeling to assess the impact of aspirin in populations aged 50-59 or 60-69 years old indicated for low-dose aspirin usage for primary or secondary CVD prevention. Model parameters were based on data from governmental agencies from the UK or recent publications. RESULTS: In the 50-59 years cohort, a decrease in incidence rates (IRs per 100 000 person years) of non-fatal CVD (-203 and -794) and fatal CVD (-97 and-381) was reported in the primary and secondary CVD prevention setting, respectively. The IR reduction of CRC (-96 and -93) was similar for primary and secondary CVD prevention. The IR increase of non-fatal (116 and 119) and fatal safety events (6 and 6) was similar for primary and secondary CVD prevention. Similar results were obtained for the 60-69 years cohort. CONCLUSIONS: The decrease in fatal CVD and CRC events was larger than the increase in fatal safety events and this difference was more pronounced when low-dose aspirin was used for secondary compared to primary CVD prevention. These results provide a comprehensive image of the expected effect of regular low-dose aspirin therapy in a UK population indicated to use aspirin for CVD prevention.

Evaluation of scenarios for reducing human salmonellosis through household consumption of fresh minced pork meat.

Nontyphoidal salmonellosis is the second most frequently reported zoonotic disease in the European Union (EU) and is considered to be a major threat to human health worldwide. The most reported Salmonella serovar in the EU is S. Enteritidis, mainly associated with egg contamination, followed by S. Typhimurium, with the latter being the most predominant serovar isolated from pork. These findings suggest that reducing the Salmonella contamination in the pork production might be a good strategy to prevent and control human salmonellosis in the EU. Recently, a quantitative microbial risk assessment (QMRA) has been developed to assess the risks for human salmonellosis due to home consumption of fresh minced pork meat in Belgium. The newly developed risk model is called the METZOON model. In the current study, the METZOON model was used to evaluate the effectiveness of different hypothetical Salmonella mitigation strategies implemented at different stages of the minced pork production and consumption chain by means of a scenario analysis. To efficiently evaluate the mitigation strategies, model results were obtained by running simulations using the randomized complete block design. The effectiveness of a mitigation strategy is expressed using point and interval estimates of the effect size for dependent observations, expressed as the standardized difference in population means. The results indicate that the most effective strategies are taken during the slaughter processes of polishing, evisceration, and chilling, and during postprocessing, whereas interventions in the primary production and at the beginning of the slaughter process seem to have only a limited effect. Improving consumer awareness is found to be effective as well.

Benefit-Risk Assessment of Vaccines. Part II: Proposal Towards Consolidated Standards of Reporting Quantitative Benefit-Risk Models Applied to Vaccines (BRIVAC).

INTRODUCTION: Quantitative benefit-risk models (qBRm) applied to vaccines are increasingly used by public health authorities and pharmaceutical companies as an important tool to help decision makers with supporting benefit-risk assessment (BRA). However, many publications on vaccine qBRm provide insufficient details on the methodological approaches used. Incomplete and/or inadequate qBRm reporting may affect result interpretation and confidence in BRA, highlighting a need for the development of standard reporting guidance. OBJECTIVES: Our objective was to provide an operational checklist for improved reporting of vaccine qBRm. METHODS: The consolidated standards of reporting quantitative Benefit-RIsk models applied to VACcines (BRIVAC) were designed as a checklist of key information to report in qBRm scientific publications regarding the assessed vaccines, the methodological considerations and the results and their interpretation. RESULTS: In total, 22 items and accompanying definitions, recommendations, explanations and examples were provided and divided into six main sections corresponding to the classic subdivisions of a scientific publication: title and abstract (items 1-2), introduction (items 3-4), methods (items 5-15), results (items 16-17), discussion (items 18-20) and other (items 21-22). CONCLUSIONS: The BRIVAC checklist is the first initiative providing an operational checklist for improved reporting of qBRm applied to vaccines in scientific articles. It is intended to assist authors, peer-reviewers, editors and readers in their critical appraisal. Future initiatives are needed to provide methodological guidance to perform qBRm while taking into account the vaccine specificities.

Benefit-Risk Assessment of Vaccines. Part I: A Systematic Review to Identify and Describe Studies About Quantitative Benefit-Risk Models Applied to Vaccines.

INTRODUCTION: Understanding the balance between the benefits and risks of vaccination is essential to ensure informed and adequate public health decision making. Quantitative benefit-risk models (qBRm) represent useful tools to help decision makers with supporting benefit-risk assessment throughout the lifecycle of a medical product. However, few initiatives have been launched to harmonise qBRm approaches, specifically for vaccines. OBJECTIVES: The aim of this paper was to identify publications about qBRm applied to vaccines through a systematic literature review, and to describe their characteristics. METHODS: Medline, Scopus and Institute for Scientific Information Web of Knowledge databases were searched to identify articles in English, published from database inceptions up to December 2019. The search strategy included the combination of three key concepts: 'benefit-risk', 'modelling' and 'vaccines'. Data extracted included the modelling context and the methodological approaches used. RESULTS: Of 3172 publications screened, 48 original publications were included. Most of the selected studies were published over the past decade and focused on rotavirus (15), dengue (10) and influenza (6) vaccines. The majority (30) of studies reported analyses related to high-income countries. The methodology of the studies differed, particularly in modelling techniques, benefit-risk measures, and sensitivity analyses. The present work also pointed out a high level of variability in the quality of reporting across studies, with particular regard to input parameters and methodological approaches. CONCLUSIONS: This review provides an extensive list of qBRm applied to vaccines. Discrepancies across studies were identified during our review. While the number of published qBRm studies is increasing, no reporting guidance for qBRm applied to vaccines is currently available. This may affect decision makers' confidence in the results and their benefit-risk assessment(s); therefore, the development of such reporting guidance is highly needed.

Disease misclassification in electronic healthcare database studies: Deriving validity indices-A contribution from the ADVANCE project.

There is a strong and continuously growing interest in using large electronic healthcare databases to study health outcomes and the effects of pharmaceutical products. However, concerns regarding disease misclassification (i.e. classification errors of the disease status) and its impact on the study results are legitimate. Validation is therefore increasingly recognized as an essential component of database research. In this work, we elucidate the interrelations between the true prevalence of a disease in a database population (i.e. prevalence assuming no disease misclassification), the observed prevalence subject to disease misclassification, and the most common validity indices: sensitivity, specificity, positive and negative predictive value. Based on this, we obtained analytical expressions to derive all the validity indices and true prevalence from the observed prevalence and any combination of two other parameters. The analytical expressions can be used for various purposes. Most notably, they can be used to obtain an estimate of the observed prevalence adjusted for outcome misclassification from any combination of two validity indices and to derive validity indices from each other which would otherwise be difficult to obtain. To allow researchers to easily use the analytical expressions, we additionally developed a user-friendly and freely available web-application.

Vaccine effectiveness against laboratory-confirmed influenza in Europe - Results from the DRIVE network during season 2018/19.

The DRIVE project aims to establish a sustainable network to estimate brand-specific influenza vaccine effectiveness (IVE) annually. DRIVE is a public-private partnership launched in response to EMA guidance that requires effectiveness evaluation from manufacturers for all individual influenza vaccine brands every season. IVE studies are conducted by public partners in DRIVE. Private partners (vaccine manufacturers from the European Federation of Pharmaceutical Industries and Association (EFPIA)) provide written feedback moderated by an independent scientific committee. Test-negative design (TND) case-control studies (4 in primary care and five in hospital) were conducted in six countries in Europe during the 2018/19 season. Site-specific confounder-adjusted vaccine effectiveness (VE) estimates for any vaccine exposure were calculated by age group (<18 years (y), 18-64y and 65 + y) and pooled by setting (primary care, hospital) through random effects meta-analysis. In addition, one population-based cohort study was conducted in Finland. TND studies included 3339 cases and 6012 controls; seven vaccine brands were reported. For ages 65 + y, pooled VE against any influenza strain was estimated at 27% (95%CI 6-44) in hospital setting. Sample size was insufficient for meaningful IVE estimates in other age groups, in the primary care setting, or by vaccine brand. The population-based cohort study included 274,077 vaccinated and 494,337 unvaccinated person-years, two vaccine brands were reported. Brand-specific IVE was estimated for Fluenz Tetra (36% [95%CI 24-45]) for ages 2-6y, Vaxigrip Tetra (54% [43-62]) for ages 6 months to 6y, and Vaxigrip Tetra (30% [25-35]) for ages 65 + y. The results presented are from the second influenza season covered by the DRIVE network. While sample size from the pooled TND studies was still too low for precise (brand-specific) IVE estimates, the network has approximately doubled in size compared to the pilot season. Taking measures to increase sample size is an important focus of DRIVE for the coming years.

Preventing infectious diseases for healthy ageing: The VITAL public-private partnership project.

Prevention of infectious diseases through immunisation of the growing ageing adult population is essential to improve healthy ageing. However, many licenced and recommended vaccines for this age group show signs of waning of the protective effect due to declining immune responses (immuno-senescence) and decreasing vaccine uptake. Today's major challenge is to improve vaccine effectiveness and uptake and to deploy efficient vaccination strategies for this age group. The Vaccines and InfecTious diseases in the Ageing popuLation (VITAL) project, with partners from 17 academic & research groups and public institutes as well as seven industry collaborators, aims to address this challenge. The ambition is to provide evidence-based knowledge to local decision makers. Using a holistic and multidisciplinary approach and novel analytical methods, VITAL will provide tools that allow the development of targeted immunisation programs for ageing adults in European countries. The project is based on four pillars focussing on the assessment of the burden of vaccine-preventable diseases in ageing adults, the dissection of the mechanisms underlying immuno-senescence, the analysis of the clinical and economic public health impact of vaccination strategies and the development of educational resources for healthcare professionals. By the end of the project, a clear, detailed, and integrated program should be available for implementing a consistent, affordable, and sustainable vaccination strategy for ageing adults with regular evaluations of its impact over time.

ADVANCE system testing: Benefit-risk analysis of a marketed vaccine using multi-criteria decision analysis and individual-level state transition modelling.

BACKGROUND: The Accelerated Development of VAccine beNefit-risk Collaboration in Europe (ADVANCE) is a public-private collaboration aiming to develop and test a system for rapid benefit-risk (B/R) monitoring of vaccines using electronic health record (eHR) databases in Europe. Proof-of-concept studies were designed to assess the proposed processes and system for generating the required evidence to perform B/R assessment and near-real time monitoring of vaccines. We aimed to test B/R methodologies for vaccines, using the comparison of the B/R profiles of whole-cell (wP) and acellular pertussis (aP) vaccine formulations in children as an example. METHODS: We used multi-criteria decision analysis (MCDA) to structure the B/R assessment combined with individual-level state transition modelling to build the B/R effects table. In the state transition model, we simulated the number of events in two hypothetical cohorts of 1 million children followed from first pertussis dose till pre-school-entry booster (or six years of age, whichever occurred first), with one cohort receiving wP, and the other aP. The benefits were reductions in pertussis incidence and complications. The risks were increased incidences of febrile convulsions, fever, hypotonic-hyporesponsive episodes, injection-site reactions and persistent crying. Most model parameters were informed by estimates (coverage, background incidences, relative risks) from eHR databases from Denmark (SSI), Spain (BIFAP and SIDIAP), Italy (Pedianet) and the UK (RCGP-RSC and THIN). Preferences were elicited from clinical and epidemiological experts. RESULTS: Using state transition modelling to build the B/R effects table facilitated the comparison of different vaccine effects (e.g. immediate vaccine risks vs long-term vaccine benefits). Estimates from eHR databases could be used to inform the simulation model. The model results could be easily combined with preference weights to obtain B/R scores. CONCLUSION: Existing B/R methodology, modelling and estimates from eHR databases can be successfully used for B/R assessment of vaccines.

ADVANCE system testing: Can safety studies be conducted using electronic healthcare data? An example using pertussis vaccination.

INTRODUCTION: The Accelerated Development of Vaccine benefit-risk Collaboration in Europe (ADVANCE) public-private collaboration, aimed to develop and test a system for rapid benefit-risk monitoring of vaccines using healthcare databases in Europe. The objective of this proof-of-concept (POC) study was to test the feasibility of the ADVANCE system to generate incidence rates (IRs) per 1000 person-years and incidence rate ratios (IRRs) for risks associated with whole cell- (wP) and acellular- (aP) pertussis vaccines, occurring in event-specific risk windows in children prior to their pre-school-entry booster. METHODS: The study population comprised almost 5.1 million children aged 1 month to <6 years vaccinated with wP or aP vaccines during the study period from 1 January 1990 to 31 December 2015. Data from two Danish hospital (H) databases (AUH and SSI) and five primary care (PC) databases from, UK (THIN and RCGP RSC), Spain (SIDIAP and BIFAP) and Italy (Pedianet) were analysed. Database-specific IRRs between risk vs. non-risk periods were estimated in a self-controlled case series study and pooled using random-effects meta-analyses. RESULTS: The overall IRs were: fever, 58.2 (95% CI: 58.1; 58.3), 96.9 (96.7; 97.1) for PC DBs and 8.56 (8.5; 8.6) for H DBs; convulsions, 7.6 (95% CI: 7.6; 7.7), 3.55 (3.5; 3.6) for PC and 12.87 (12.8; 13) for H; persistent crying, 3.9 (95% CI: 3.8; 3.9) for PC, injection-site reactions, 2.2 (95% CI 2.1; 2.2) for PC, hypotonic hypo-responsive episode (HHE), 0.4 (95% CI: 0.4; 0.4), 0.6 (0.6; 0.6) for PC and 0.2 (0.2; 0.3) for H; and somnolence: 0.3 (95% CI: 0.3; 0.3) for PC. The pooled IRRs for persistent crying, fever, and ISR, adjusted for age and healthy vaccinee period were higher after wP vs. aP vaccination, and lower for convulsions, for all doses. The IRR for HHE was slightly lower for wP than aP, while wP was associated with somnolence only for dose 1 and dose 3 compared with aP. CONCLUSIONS: The estimated IRs and IRRs were comparable with published data, therefore demonstrating that the ADVANCE system was able to combine several European healthcare databases to assess vaccine safety data for wP and aP vaccination.

ADVANCE: Towards near real-time monitoring of vaccination coverage, benefits and risks using European electronic health record databases.

BACKGROUND: The Accelerated Development of VAccine beNefit-risk Collaboration in Europe (ADVANCE) is a public-private partnership aiming to develop and test a system for rapid benefit-risk (B/R) monitoring of vaccines using European electronic health record (eHR) databases. This proof-of-concept study aimed to test the feasibility of near real-time (NRT) monitoring of vaccination coverage, benefits and risks based on multiple European eHR databases, using acellular pertussis vaccination in children aged <6 years as test case. METHODS: A qualitative feasibility assessment on NRT monitoring was carried out using a survey and face-to-face discussion with ADVANCE data partners. Subsequently, a dynamic cohort study was conducted containing two distinct observation periods: a first period to establish a baseline (Jan 2014 to Mar 2018) and a subsequent 3-month period to test the actual feasibility of weekly NRT monitoring, based on which data latencies were calculated. An interactive web-application was additionally developed to facilitate the visual monitoring of vaccination coverage, the vaccine preventable disease incidence rates (benefits) and the incidence rates of adverse events (risks). RESULTS: Nine databases from four countries (Denmark, Italy, Spain and UK) participated in the qualitative feasibility assessment. Of them, five databases took part in the dynamic cohort study, with 5 databases providing baseline data and 3 databases participating to the NRT monitoring, providing data extractions on an almost weekly basis. The median data latency (time between event date and data release date) was between 1 and 2 weeks except for the benefit and risk events in one of the databases (latency 16 weeks). CONCLUSION: Three European eHR databases successfully demonstrated the feasibility of providing data for weekly NRT monitoring, with short data latencies of 1-2 weeks for most events.

ADVANCE system testing: Can coverage of pertussis vaccination be estimated in European countries using electronic healthcare databases: An example.

INTRODUCTION: The Accelerated Development of VAccine beNefit-risk Collaboration in Europe (ADVANCE) is a public-private collaboration aiming to develop and test a system for rapid benefit-risk (B/R) monitoring of vaccines, using existing healthcare databases in Europe. The objective of this paper was to assess the feasibility of using electronic healthcare databases to estimate dose-specific acellular pertussis (aP) and whole cell pertussis (wP) vaccine coverage. METHODS: Seven electronic healthcare databases in four European countries (Denmark (n = 2), UK (n = 2), Spain (n = 2) and Italy (n = 1)) participated in this study. Children were included from birth and followed up to age six years. Vaccination exposure was obtained from the databases and classified by type (aP or wP), and dose 1, 2 or 3. Coverage was estimated using period prevalence. For the 2006 birth cohort, two estimation methods for pertussis vaccine coverage, period prevalence and cumulative incidence were compared for each database. RESULTS: The majority of the 2,575,576 children included had been vaccinated at the country-specific recommended ages. Overall, the estimated dose 3 coverage was 88-97% in Denmark (birth cohorts from 2003 to 2014), 96-100% in the UK (2003-2014), 95-98% in Spain (2004-2014) and 94% in Italy (2006-2007). The estimated dose 3 coverage per birth cohort in Denmark and the UK differed by 1-6% compared with national estimates, with our estimates mostly higher. The estimated dose 3 coverage in Spain differed by 0-2% with no consistent over- or underestimation. In Italy, the estimates were 3% lower compared with the national estimates. Except for Italy, for which the two coverage estimation methods generated the same results, the estimated cumulative incidence coverages were consistently 1-10% lower than period prevalence estimates. CONCLUSION: This study showed that it was possible to provide consistent estimates of pertussis immunisation coverage from the electronic healthcare databases included, and that the estimates were comparable with the national estimates.

Advance system testing: Vaccine benefit studies using multi-country electronic health data - The example of pertussis vaccination.

The Accelerated Development of VAccine benefit-risk Collaboration in Europe (ADVANCE), a public-private consortium, implemented and tested a distributed network system for the generation of evidence on the benefits-risks of marketed vaccines in Europe. We tested the system by estimating the incidence rate (IR) of pertussis and pertussis-related complications in children vaccinated with acellular (aP) and whole-cell (wP) pertussis vaccine. Data from seven electronic databases from four countries (Denmark: AUH and SSI, Spain: SIDIAP and BIFAP, UK: THIN and RCGP RSC and Italy: Pedianet) were included in a retrospective cohort analysis. Exposure was defined as any pertussis vaccination (aP or wP). The follow-up time started 14 days after the first dose. Children who had received any pertussis vaccine from January 1990 to December 2015 were included (those who switched type, or had unknown type were excluded). The outcomes of interest were confirmed or suspected pertussis and pertussis-related pneumonia and generalised convulsions within one month of pertussis diagnosis and death within three months of pertussis diagnosis. The cohort comprised 2,886,367 children ≤5 years of age. Data on wP and aP vaccination were available in three and seven databases, respectively. The IRs (per 100,000 person-years) for pertussis varied largely and ranged between 0.15 (95% CI: 0.12; 0.19) and 1.15 (95% CI: 1.07; 1.23), and the trends over time was consistent with those observed from national surveillance databases for confirmed pertussis. The pertussis IRs decreased as the number of wP and aP vaccine doses increased. Pertussis-related complications were rare (89 pneumonia, 7 generalised convulsions and no deaths) and their relative risk (vs. non-pertussis) could not be reliably estimated. The study demonstrated the feasibility of the ADVANCE system to estimate the change in pertussis IRs following pertussis vaccination. Larger sample sizes would provide additional power to compare the risk for complications between children with and without pertussis. The feasibility of vaccine-type specific effectiveness studies may be considered in the future.

Quantifying outcome misclassification in multi-database studies: The case study of pertussis in the ADVANCE project.

BACKGROUND: The Accelerated Development of VAccine beNefit-risk Collaboration in Europe (ADVANCE) is a public-private collaboration aiming to develop and test a system for rapid benefit-risk (B/R) monitoring of vaccines using European healthcare databases. Event misclassification can result in biased estimates. Using different algorithms for identifying cases of Bordetella pertussis (BorPer) infection as a test case, we aimed to describe a strategy to quantify event misclassification, when manual chart review is not feasible. METHODS: Four participating databases retrieved data from primary care (PC) setting: BIFAP: (Spain), THIN and RCGP RSC (UK) and PEDIANET (Italy); SIDIAP (Spain) retrieved data from both PC and hospital settings. BorPer algorithms were defined by healthcare setting, data domain (diagnoses, drugs, or laboratory tests) and concept sets (specific or unspecified pertussis). Algorithm- and database-specific BorPer incidence rates (IRs) were estimated in children aged 0-14 years enrolled in 2012 and 2014 and followed up until the end of each calendar year and compared with IRs of confirmed pertussis from the ECDC surveillance system (TESSy). Novel formulas were used to approximate validity indices, based on a small set of assumptions. They were applied to approximately estimate positive predictive value (PPV) and sensitivity in SIDIAP. RESULTS: The number of cases and the estimated BorPer IRs per 100,000 person-years in PC, using data representing 3,173,268 person-years, were 0 (IR = 0.0), 21 (IR = 4.3), 21 (IR = 5.1), 79 (IR = 5.7), and 2 (IR = 2.3) in BIFAP, SIDIAP, THIN, RCGP RSC and PEDIANET respectively. The IRs for combined specific/unspecified pertussis were higher than TESSy, suggesting that some false positives had been included. In SIDIAP the estimated IR was 45.0 when discharge diagnoses were included. The sensitivity and PPV of combined PC specific and unspecific diagnoses for BorPer cases in SIDIAP were approximately 85% and 72%, respectively. CONCLUSION: Retrieving BorPer cases using only specific concepts has low sensitivity in PC databases, while including cases retrieved by unspecified concepts introduces false positives, which were approximately estimated to be 28% in one database. The share of cases that cannot be retrieved from a PC database because they are only seen in hospital was approximately estimated to be 15% in one database. This study demonstrated that quantifying the impact of different event-finding algorithms across databases and benchmarking with disease surveillance data can provide approximate estimates of algorithm validity.