Describing diversity of real world data sources in pharmacoepidemiologic studies: The DIVERSE scoping review.

PURPOSE: Real-world evidence (RWE) is increasingly used for medical regulatory decisions, yet concerns persist regarding its reproducibility and hence validity. This study addresses reproducibility challenges associated with diversity across real-world data sources (RWDS) repurposed for secondary use in pharmacoepidemiologic studies. Our aims were to identify, describe and characterize practices, recommendations and tools for collecting and reporting diversity across RWDSs, and explore how leveraging diversity could improve the quality of evidence. METHODS: In a preliminary phase, keywords for a literature search and selection tool were designed using a set of documents considered to be key by the coauthors. Next, a systematic search was conducted up to December 2021. The resulting documents were screened based on titles and abstracts, then based on full texts using the selection tool. Selected documents were reviewed to extract information on topics related to collecting and reporting RWDS diversity. A content analysis of the topics identified explicit and latent themes. RESULTS: Across the 91 selected documents, 12 topics were identified: 9 dimensions used to describe RWDS (organization accessing the data source, data originator, prompt, inclusion of population, content, data dictionary, time span, healthcare system and culture, and data quality), tools to summarize such dimensions, challenges, and opportunities arising from diversity. Thirty-six themes were identified within the dimensions. Opportunities arising from data diversity included multiple imputation and standardization. CONCLUSIONS: The dimensions identified across a large number of publications lay the foundation for formal guidance on reporting diversity of data sources to facilitate interpretation and enhance replicability and validity of RWE.

A Randomized Trial of Multiple-Patient Simulation Preparation to Improve Novice Nurses' Competence and Self-Efficacy.

AIM: The purpose of the study was to determine best practices for multiple-patient simulation (MPS) preparation and frequency to improve behavioral performance in nursing students. BACKGROUND: MPS provides a safe environment for novice nurses to practice priority setting, delegation, and multitasking, but evidence for best practices is needed. METHOD: A multisite, blinded, randomized trial was conducted to evaluate the effect of three simulation preparation methods (expert modeling, voice-over PowerPoint, and reading assignments) on students' competence and self-efficacy for providing care to multiple patients in the simulation lab. Participants (n = 73) were enrolled in capstone clinical courses at two schools of nursing. RESULTS: Though there was no difference in raw change in competence score among the study groups, there was a statistically significant difference in pretest and posttest scores. The change in self-efficacy did not correlate with the change in competence. CONCLUSION: These findings will help educators understand how novice nurses benefit from repeated MPS activities.

Masking by vaccines in pediatric drug safety signal detection in the EudraVigilance database.

PURPOSE: Postmarketing drug safety surveillance relies upon measures of disproportionate reporting in spontaneous reporting systems. It has been hypothesized that products or events reported frequently may "mask" signals. METHODS: We analyzed the masking effect of vaccines in pediatrics in the EudraVigilance database by conducting disproportionality analysis in the full database (containing vaccine exposures) and in a restricted set (excluding vaccine exposures). We measured performance of the reporting odds ratio (ROR) in both data sets using a pediatric-specific drug reference set and in the absence of a reference set. We assessed masking effects across age groups and conducted a classification tree (CART) analysis. RESULTS: Removal of vaccines decreased the ROR values both in negative and positive controls. Exceptions were drug-event combinations including outcomes frequent in vaccine reports. When restricted to positive control associations, removal of vaccine-related events resulted in increased ROR values for events commonly reported following vaccination. For events rarely associated with vaccination, ROR values decreased for all age groups, especially infants. Analysis in the absence of a reference set showed decrease in ROR following vaccine removal and CART revealed that change in ROR with vaccine removal depended upon age and proportion of reports including a vaccine. CONCLUSIONS: Removal of vaccines for signal detection in a pediatric population has an impact on ROR, dependent upon the reporting frequency of the event of interest in combination with vaccines. We recommend stratification by age and removal of vaccine exposures if the investigated adverse drug reactions include those typically reported in association with vaccines for the age strata.

Parental timing of allergenic food introduction in urban and suburban populations.

BACKGROUND: Recommendations on timing for introduction of allergenic foods in an infant diet have changed twice during the past decade. How families with different demographic characteristics implement the change has not been studied in the United States. OBJECTIVE: To compare the age of introduction of allergenic foods between an urban Medicaid-based population and a suburban private insurance-based population in Cincinnati, Ohio. METHODS: Two hundred parent surveys were distributed at well-child checkups between 4 and 36 months of age. Data were analyzed using distribution mapping to determine the difference in the age of introduction of infant formula, infant solids, whole cow's milk, eggs, peanut, and fish. Random forest analysis was used to determine the most important factors affecting the age of introduction for both populations. RESULTS: There was no statistically significant difference in the age of infant solid introduction, but urban populations introduced allergenic foods earlier than suburban populations, with a statistically significant difference in the age of introduction of infant formula, whole cow's milk, eggs, peanut, and fish. The most important factor for the timing of all food introductions was the recommended age of introduction from health care professionals. CONCLUSION: There is a difference between urban and suburban populations in the timing of introduction of allergenic foods but not in other infant solid foods. The reliance on physician recommendation for both populations supports the need for education and guidance to health care professionals on up-to-date guidance and recommendations.

Pharmacoepidemiological safety studies in children: a systematic review.

PURPOSE: In order to identify challenges in pediatric pharmacoepidemiological safety studies, we assessed the characteristics of such (published) studies. METHODS: Relevant articles from inception to 2013 were retrieved from Embase and Medline. We sequentially screened titles, abstracts and full texts with independent validation. We systematically collected data regarding general information, study methods and results. RESULTS: Out of 4825 unique articles, 268 full texts (5.6%) were retained; 147 (54.9%) pertained to drugs rather than vaccines. Considering the 268 studies, 202 (75.4%) concerned children and adolescents (2 to 11 years) and 14 (5.3%) included preterm newborns. Most studies originated from North America (154 [57.5%]) or Europe (92 [34.3%]). Only 47 studies (17.5%) were privately funded. The majority (174 [64.9%]) were cohort studies. Out of 268 studies, 196 (73.1%) collected data retrospectively; paper medical charts were the most common data source for the exposures (85 [31.7%]) and outcomes (122 [45.5%]). Only 3 (2.0%) drug-only studies investigated rarely used drugs. Considering all 268 studies, only 27 (10.1%) reported sample size or power calculation. Most (75 [51.0%]) drug-only studies corrected confounding by multivariate modeling unlike stratification in 66 (55.9%) vaccine-only studies. Considering 75 child-only studies without any statistically significant result, 41 (54.7%) did not discuss lack of power. CONCLUSIONS: Although the field of pediatric pharmacoepidemiology is steadily developing evaluation seldom includes neonates, is mainly focused on few drug classes and safety outcomes and concerns mainly drug use in developed countries. Small study size is a specific challenge in pediatrics. Reporting should be improved. © 2016 The Authors. Pharmacoepidemiology and Drug Safety Published by John Wiley & Sons Ltd.

A simulation study to compare three self-controlled case series approaches: correction for violation of assumption and evaluation of bias.

PURPOSE: The assumption that the occurrence of outcome event must not alter subsequent exposure probability is critical for preserving the validity of the self-controlled case series (SCCS) method. This assumption is violated in scenarios in which the event constitutes a contraindication for exposure. In this simulation study, we compared the performance of the standard SCCS approach and two alternative approaches when the event-independent exposure assumption was violated. METHODS: Using the 2009 H1N1 and seasonal influenza vaccines and Guillain-Barré syndrome as a model, we simulated a scenario in which an individual may encounter multiple unordered exposures and each exposure may be contraindicated by the occurrence of outcome event. The degree of contraindication was varied at 0%, 50%, and 100%. The first alternative approach used only cases occurring after exposure with follow-up time starting from exposure. The second used a pseudo-likelihood method. RESULTS: When the event-independent exposure assumption was satisfied, the standard SCCS approach produced nearly unbiased relative incidence estimates. When this assumption was partially or completely violated, two alternative SCCS approaches could be used. While the post-exposure cases only approach could handle only one exposure, the pseudo-likelihood approach was able to correct bias for both exposures. CONCLUSIONS: Violation of the event-independent exposure assumption leads to an overestimation of relative incidence which could be corrected by alternative SCCS approaches. In multiple exposure situations, the pseudo-likelihood approach is optimal; the post-exposure cases only approach is limited in handling a second exposure and may introduce additional bias, thus should be used with caution.

Pregnancy modifies the antibody response to trivalent influenza immunization.

We report the immunogenicity of trivalent influenza immunization in 29 pregnant women compared with 22 nonpregnant women. We obtained blood specimens on day 0 prior to 2011-2012 influenza vaccine administration and day 28 after immunization. Hemagglutination inhibition (HAI) geometric mean titers were similar before immunization but were significantly reduced by 40%-50% in pregnant women after immunization for influenza A/California(H1N1) (P = .027) and A/Perth(H3N2) (P = .037). Postimmunization HAI titers were similar between groups for influenza B/Brisbane (P = .390). The geometric mean ratio (fold increase) for influenza A(H1N1) was nonsignificantly reduced in pregnant participants (P = .089). The percentages of participants who seroconverted and achieved seroprotection were similar between groups.

Standardizing case definitions for monitoring the safety of maternal vaccines globally: GAIA definitions, a review of progress to date.

In 2014, the Global Alignment on Immunization safety Assessment in pregnancy consortium (GAIA) was formed, with the goal of developing a harmonized, globally-concerted approach to actively monitor the safety of vaccines in pregnancy. A total of 26 standardized definitions for the classification of adverse events have been developed. The aim of this review was to identify and describe studies undertaken to assess the performance of these definitions. A literature search was undertaken to identify published studies assessing the performance of the definitions, and reference lists were snowballed. Data were abstracted by two investigators and a narrative review of the results is presented. Four studies that have evaluated 13 GAIA case definitions (50%) were identified. Five case definitions have been assessed in high-income settings only. Recommendations have been made by the investigators to improve the performance of the definitions. These include ensuring consistency across definitions, removal of the potential for ambiguity or variations in interpretation and ensuring that higher-level criteria are acceptable at lower levels of confidence. Future research should prioritize the key case definitions that have not been assessed in low- and middle-income settings, as well as the 13 that have not undergone any validation.

Neonatal outcomes after influenza immunization during pregnancy: a randomized controlled trial.

BACKGROUND: There are limited data about the effect of maternal influenza infection on fetuses and newborns. We performed a secondary analysis of data from the Mother's Gift project, a randomized study designed to test the effectiveness of inactivated influenza and pneumococcal vaccines during pregnancy. METHODS: In the Mother's Gift project, 340 pregnant women in Bangladesh received either inactivated influenza vaccine or 23-valent pneumococcal polysaccharide vaccine (control). This study was performed from August 2004 through December 2005. We performed a secondary analysis of outcomes following maternal influenza immunization during two periods: when influenza virus was not circulating (September 2004 through January 2005) and when influenza virus was circulating (February through October 2005). We assessed gestational age, mean birth weight and the proportion of infants who were small for gestational age. RESULTS: During the period with no circulating influenza virus, there were no differences in the incidence of respiratory illness with fever per 100 person-months among mothers and infants in the two groups (influenza vaccine: 3.9; control: 4.0; p > 0.9). The proportion of infants who were small for gestational age and the mean birth weight were similar between groups (small for gestational age: influenza vaccine 29.1%, control 34.3%; mean birth weight: influenza vaccine 3083 g, control 3053 g). During the period with circulating influenza virus, there was a substantial reduction in the incidence per 100 person-months of respiratory illness with fever among the mothers and infants who had received the influenza vaccine (influenza vaccine: 3.7; control: 7.2; p = 0.0003). During this period, the proportion of infants who were small for gestational age was lower in the influenza vaccine group than in the control group (25.9% v. 44.8%; p = 0.03). The mean birth weight was higher among infants whose mothers received the influenza vaccine than among those who received the control vaccine during this period (3178 g v. 2978 g; p = 0.02). INTERPRETATION: During the period with circulating influenza virus, maternal immunization during pregnancy was associated with a lower proportion of infants who were small for gestational age and an increase in mean birth weight. These data need confirmation but suggest that prevention of influenza infection in pregnancy can influence intrauterine growth. TRIAL REGISTRATION: ClinicalTrials.gov: NCT 00142389.

Development of a clinical prediction model for perinatal deaths in low resource settings.

BACKGROUND: Most pregnancy-related deaths in low and middle income countries occur around the time of birth and are avoidable with timely care. This study aimed to develop a prognostic model to identify women at risk of intrapartum-related perinatal deaths in low-resourced settings, by (1) external validation of an existing prediction model, and subsequently (2) development of a novel model. METHODS: A prospective cohort study was conducted among pregnant women who presented consecutively for delivery at the maternity unit of Zanzibar's tertiary hospital, Mnazi Mmoja Hospital, the Republic of Tanzania between October 2017 and May 2018. Candidate predictors of perinatal deaths included maternal and foetal characteristics obtained from routine history and physical examination at the time of admission to the labour ward. The outcomes were intrapartum stillbirths and neonatal death before hospital discharge. An existing stillbirth prediction model with six predictors from Nigeria was applied to the Zanzibar cohort to assess its discrimination and calibration performance. Subsequently, a new prediction model was developed using multivariable logistic regression. Model performance was evaluated through internal validation and corrected for overfitting using bootstrapping methods. FINDINGS: 5747 mother-baby pairs were analysed. The existing model showed poor discrimination performance (c-statistic 0·57). The new model included 15 clinical predictors and showed promising discriminative and calibration performance after internal validation (optimism adjusted c-statistic of 0·78, optimism adjusted calibration slope =0·94). INTERPRETATION: The new model consisted of predictors easily obtained through history-taking and physical examination at the time of admission to the labour ward. It had good performance in predicting risk of perinatal death in women admitted in labour wards. Therefore, it has the potential to assist skilled birth attendance to triage women for appropriate management during labour. Before routine implementation, external validation and usefulness should be determined in future studies. FUNDING: The study received funding from Laerdal Foundation, Otto Kranendonk Fund and UMC Global Health Fellowship. TD acknowledges financial support from the Netherlands Organisation for Health Research and Development (grant 91617050).

From Inception to ConcePTION: Genesis of a Network to Support Better Monitoring and Communication of Medication Safety During Pregnancy and Breastfeeding.

In 2019, the Innovative Medicines Initiative (IMI) funded the ConcePTION project-Building an ecosystem for better monitoring and communicating safety of medicines use in pregnancy and breastfeeding: validated and regulatory endorsed workflows for fast, optimised evidence generation-with the vision that there is a societal obligation to rapidly reduce uncertainty about the safety of medication use in pregnancy and breastfeeding. The present paper introduces the set of concepts used to describe the European data sources involved in the ConcePTION project and illustrates the ConcePTION Common Data Model (CDM), which serves as the keystone of the federated ConcePTION network. Based on data availability and content analysis of 21 European data sources, the ConcePTION CDM has been structured with six tables designed to capture data from routine healthcare, three tables for data from public health surveillance activities, three curated tables for derived data on population (e.g., observation time and mother-child linkage), plus four metadata tables. By its first anniversary, the ConcePTION CDM has enabled 13 data sources to run common scripts to contribute to major European projects, demonstrating its capacity to facilitate effective and transparent deployment of distributed analytics, and its potential to address questions about utilization, effectiveness, and safety of medicines in special populations, including during pregnancy and breastfeeding, and, more broadly, in the general population.

Methodological frontiers in vaccine safety: qualifying available evidence for rare events, use of distributed data networks to monitor vaccine safety issues, and monitoring the safety of pregnancy interventions.

While vaccines are rigorously tested for safety and efficacy in clinical trials, these trials do not include enough subjects to detect rare adverse events, and they generally exclude special populations such as pregnant women. It is therefore necessary to conduct postmarketing vaccine safety assessments using observational data sources. The study of rare events has been enabled in through large linked databases and distributed data networks, in combination with development of case-centred methods. Distributed data networks necessitate common protocols, definitions, data models and analytics and the processes of developing and employing these tools are rapidly evolving. Assessment of vaccine safety in pregnancy is complicated by physiological changes, the challenges of mother-child linkage and the need for long-term infant follow-up. Potential sources of bias including differential access to and utilisation of antenatal care, immortal time bias, seasonal timing of pregnancy and unmeasured determinants of pregnancy outcomes have yet to be fully explored. Available tools for assessment of evidence generated in postmarketing studies may downgrade evidence from observational data and prioritise evidence from randomised controlled trials. However, real-world evidence based on real-world data is increasingly being used for safety assessments, and new tools for evaluating real-world evidence have been developed. The future of vaccine safety surveillance, particularly for rare events and in special populations, comprises the use of big data in single countries as well as in collaborative networks. This move towards the use of real-world data requires continued development of methodologies to generate and assess real world evidence.

Patterns of Immune Activation in HIV and Non HIV Subjects and Its Relation to Cardiovascular Disease Risk.

Introduction: Insight into inflammation patterns is needed to understand the pathophysiology of HIV and related cardiovascular disease (CVD). We assessed patterns of inflammation related to HIV infection and CVD risk assessed with carotid intima media thickness (CIMT). Methods: A cross-sectional study was performed in Johannesburg, South Africa, including participants with HIV who were virally suppressed on anti-retroviral therapy (ART) as well as HIV-negative participants who were family members or friends to the HIV-positive participants. Information was collected on CVD risk factors and CIMT. Inflammation was measured with the Olink panel 'inflammation', allowing to simultaneously assess 92 inflammation markers. Differences in inflammation patterns between HIV-positive and HIV-negative participants were explored using a principal component analysis (PCA) and ANCOVA. The impact of differentiating immune markers, as identified by ANCOVA, on CIMT was assessed using linear regression while adjusting for classic CVD risk factors. Results: In total, 185 HIV-positive and 104 HIV negative participants, 63% females, median age 40.7 years (IQR 35.4 - 47.7) were included. HIV-positive individuals were older (+6 years, p <0.01) and had a higher CIMT (p <0.01). No clear patterns of inflammation were identified by use of PCA. Following ANCOVA, nine immune markers differed significantly between HIV-positive and HIV-negative participants, including PDL1. PDL1 was independently associated with CIMT, but upon stratification this effect remained for HIV-negative individuals only. Conclusion: HIV positive patients on stable ART and HIV negative controls had similar immune activation patterns. CVD risk in HIV-positive participants was mediated by inflammation markers included in this study.

Incidence Rates of Autoimmune Diseases in European Healthcare Databases: A Contribution of the ADVANCE Project.

INTRODUCTION: The public-private ADVANCE collaboration developed and tested a system to generate evidence on vaccine benefits and risks using European electronic healthcare databases. In the safety of vaccines, background incidence rates are key to allow proper monitoring and assessment. The goals of this study were to compute age-, sex-, and calendar-year stratified incidence rates of nine autoimmune diseases in seven European healthcare databases from four countries and to assess validity by comparing with published data. METHODS: Event rates were calculated for the following outcomes: acute disseminated encephalomyelitis, Bell's palsy, Guillain-Barré syndrome, immune thrombocytopenia purpura, Kawasaki disease, optic neuritis, narcolepsy, systemic lupus erythematosus, and transverse myelitis. Cases were identified by diagnosis codes. Participating organizations/databases originated from Denmark, Italy, Spain, and the UK. The source population comprised all persons registered, with at least 1 year of data prior to the study start, or follow-up from birth. Stratified incidence rates were computed per database over the period 2003 to 2014. RESULTS: Between 2003 and 2014, 148,947 incident cases of nine autoimmune diseases were identified. Crude incidence rates were highest for Bell's palsy [23.8/100,000 person-years (PYs), 95% confidence interval (CI) 23.6-24.1] and lowest for Kawasaki disease (0.7/100,000 PYs, 95% CI 0.6-0.7). Specific patterns were observed by sex, age, calendar time, and data sources. Rates were comparable with published estimates. CONCLUSION: A range of autoimmune events could be identified in the ADVANCE system. Estimation of rates indicated consistency across selected European healthcare databases, as well as consistency with US published data.

Applicability of the GAIA Maternal and Neonatal Outcome Case Definitions for the Evaluation of Adverse Events Following Vaccination in Pregnancy in High-income Countries.

BACKGROUND: The Brighton Collaboration Global Alignment of Immunization Safety in Pregnancy (GAIA) project developed case definitions for the assessment of adverse events in mothers and infants following maternal immunization. This study evaluated the applicability of these definitions to data collected in routine clinical care and research trial records across 7 sites in high-resource settings. METHODS: Data collection forms were designed and used to retrospectively abstract the key elements of the GAIA definitions from records for 5 neonatal and 5 maternal outcomes, as well as gestational age. Level of diagnostic certainty was assessed by the data abstractor and an independent clinician, and then verified by Automated Brighton Case logic. The ability to assign a level of diagnostic certainty for each outcome and the positive predictive value (PPV) for their respective ICD-10 codes were evaluated. RESULTS: Data from 1248 case records were abstracted: 624 neonatal and 622 maternal. Neonatal outcomes were most likely to be assessable and assigned by the level of diagnostic certainty. PPV for preterm birth, low birth weight, small for gestational age and respiratory distress were all above 75%. Maternal outcomes for preeclampsia and fetal growth restriction showed PPV over 80%. However, microcephaly (neonatal outcome) and dysfunctional labor (maternal outcome) were often nonassessable, with low PPVs. CONCLUSIONS: The applicability of GAIA case definitions to retrospectively ascertain and classify maternal and neonatal outcomes was variable among sites in high-resource settings. The implementation of the case definitions is largely dependent on the type and quality of documentation in clinical and research records in both high- and low-resource settings. While designed for use in the prospective evaluation of maternal vaccine safety, the GAIA case definitions would likely need to be specifically adapted for observational studies using alternative sources of data, linking various data sources and allowing flexibility in the ascertainment of the elements and levels of certainty of the case definition.

Disease misclassification in electronic healthcare database studies: Deriving validity indices-A contribution from the ADVANCE project.

There is a strong and continuously growing interest in using large electronic healthcare databases to study health outcomes and the effects of pharmaceutical products. However, concerns regarding disease misclassification (i.e. classification errors of the disease status) and its impact on the study results are legitimate. Validation is therefore increasingly recognized as an essential component of database research. In this work, we elucidate the interrelations between the true prevalence of a disease in a database population (i.e. prevalence assuming no disease misclassification), the observed prevalence subject to disease misclassification, and the most common validity indices: sensitivity, specificity, positive and negative predictive value. Based on this, we obtained analytical expressions to derive all the validity indices and true prevalence from the observed prevalence and any combination of two other parameters. The analytical expressions can be used for various purposes. Most notably, they can be used to obtain an estimate of the observed prevalence adjusted for outcome misclassification from any combination of two validity indices and to derive validity indices from each other which would otherwise be difficult to obtain. To allow researchers to easily use the analytical expressions, we additionally developed a user-friendly and freely available web-application.

Cardiovascular Disease Burden in Rural Africa: Does HIV and Antiretroviral Treatment Play a Role?: Baseline Analysis of the Ndlovu Cohort Study.

Background HIV is associated with an increased risk of cardiovascular disease (CVD) in high-income countries. Little is known about the CVD burden in sub-Saharan Africa, where 70% of the world's HIV-positive population lives. This study aims to provide insight into the burden of CVD risk in a rural setting in sub-Saharan Africa considering HIV infection and antiretroviral therapy (ART). Methods and Results A cross-sectional analysis was conducted of the baseline of the Ndlovu Cohort study including HIV-negative and HIV-positive participants in rural South Africa between 2014 and 2017. Information was collected on demographics, socioeconomic status, and CVD risk factors. Carotid intima-media thickness measurement was performed. The influence of HIV and ART on the burden of CVD was determined by comparing HIV-positive participants who were ART naive on first-line or second-line ART with HIV-negative participants. In total, 1927 participants were included, of whom 887 (46%) were HIV positive and 54% women. The median age was 38 years. Overall, 690 participants (79%) were on ART, with 613 (89%) on first-line and 77 (11%) on second-line therapy. Participants with HIV had lower values for most of the CVD risk factors but higher C-reactive protein levels than HIV-negative participants. ART-naive, HIV-positive participants had similar carotid intima-media thickness compared with HIV-negative participants but carotid intima-media thickness was increased for participants on ART aged 30 years and older compared with HIV-negative participants. Conclusions HIV-positive participants presented with a favorable CVD risk profile compared with HIV-negative participants. However, carotid intima-media thickness was increased in HIV-positive participants on ART, indicating a higher burden of subclinical CVD for the HIV-positive population.

ADVANCE system testing: Can safety studies be conducted using electronic healthcare data? An example using pertussis vaccination.

INTRODUCTION: The Accelerated Development of Vaccine benefit-risk Collaboration in Europe (ADVANCE) public-private collaboration, aimed to develop and test a system for rapid benefit-risk monitoring of vaccines using healthcare databases in Europe. The objective of this proof-of-concept (POC) study was to test the feasibility of the ADVANCE system to generate incidence rates (IRs) per 1000 person-years and incidence rate ratios (IRRs) for risks associated with whole cell- (wP) and acellular- (aP) pertussis vaccines, occurring in event-specific risk windows in children prior to their pre-school-entry booster. METHODS: The study population comprised almost 5.1 million children aged 1 month to <6 years vaccinated with wP or aP vaccines during the study period from 1 January 1990 to 31 December 2015. Data from two Danish hospital (H) databases (AUH and SSI) and five primary care (PC) databases from, UK (THIN and RCGP RSC), Spain (SIDIAP and BIFAP) and Italy (Pedianet) were analysed. Database-specific IRRs between risk vs. non-risk periods were estimated in a self-controlled case series study and pooled using random-effects meta-analyses. RESULTS: The overall IRs were: fever, 58.2 (95% CI: 58.1; 58.3), 96.9 (96.7; 97.1) for PC DBs and 8.56 (8.5; 8.6) for H DBs; convulsions, 7.6 (95% CI: 7.6; 7.7), 3.55 (3.5; 3.6) for PC and 12.87 (12.8; 13) for H; persistent crying, 3.9 (95% CI: 3.8; 3.9) for PC, injection-site reactions, 2.2 (95% CI 2.1; 2.2) for PC, hypotonic hypo-responsive episode (HHE), 0.4 (95% CI: 0.4; 0.4), 0.6 (0.6; 0.6) for PC and 0.2 (0.2; 0.3) for H; and somnolence: 0.3 (95% CI: 0.3; 0.3) for PC. The pooled IRRs for persistent crying, fever, and ISR, adjusted for age and healthy vaccinee period were higher after wP vs. aP vaccination, and lower for convulsions, for all doses. The IRR for HHE was slightly lower for wP than aP, while wP was associated with somnolence only for dose 1 and dose 3 compared with aP. CONCLUSIONS: The estimated IRs and IRRs were comparable with published data, therefore demonstrating that the ADVANCE system was able to combine several European healthcare databases to assess vaccine safety data for wP and aP vaccination.

ADVANCE system testing: Estimating the incidence of adverse events following pertussis vaccination in healthcare databases with incomplete exposure data.

The Accelerated Development of VAccine beNefit-risk Collaboration in Europe (ADVANCE) is a public-private collaboration aiming to develop and test a system for rapid vaccine benefit-risk monitoring using existing European healthcare databases. Incidence rate (IR) estimates of vaccination-associated adverse events that are needed to model vaccination risks can be calculated from existing healthcare databases when vaccination (exposure) data are available. We assessed different methods to derive IRs in risk periods following vaccination when exposure data are missing in one database, using estimated IRs and IRRs from other databases for febrile seizures, fever and persistent crying. IRs were estimated for children aged 0-5 years in outcome-specific risk and non-risk periods following the first dose of acellular pertussis (aP) vaccination in four primary care databases and one hospital database. We compared derived and observed IRs in each database using three methods: 1) multiplication of non-risk period IR for database i by IR ratio (IRR) obtained from meta-analysis of IRRs estimated using the self-controlled case-series method, from databases other than i; 2) same method as 1, but multiplying with background IR; and 3) meta-analyses of observed IRs from databases other than i. IRs for febrile seizures were lower in primary care databases than the hospital database. The derived IR for febrile seizures using data from primary care databases was lower than that observed in the hospital database, and using data from the hospital database gave a higher derived IR than that observed in the primary care database. For fever and persistent crying the opposite was observed. We demonstrated that missing IRs for a post-vaccination period can be derived but that the type of database and the method of event data capture can have an impact on potential bias. We recommend IRs are derived using data from similar database types (hospital or primary care) with caution as even this can give heterogeneous results.

Quantifying outcome misclassification in multi-database studies: The case study of pertussis in the ADVANCE project.

BACKGROUND: The Accelerated Development of VAccine beNefit-risk Collaboration in Europe (ADVANCE) is a public-private collaboration aiming to develop and test a system for rapid benefit-risk (B/R) monitoring of vaccines using European healthcare databases. Event misclassification can result in biased estimates. Using different algorithms for identifying cases of Bordetella pertussis (BorPer) infection as a test case, we aimed to describe a strategy to quantify event misclassification, when manual chart review is not feasible. METHODS: Four participating databases retrieved data from primary care (PC) setting: BIFAP: (Spain), THIN and RCGP RSC (UK) and PEDIANET (Italy); SIDIAP (Spain) retrieved data from both PC and hospital settings. BorPer algorithms were defined by healthcare setting, data domain (diagnoses, drugs, or laboratory tests) and concept sets (specific or unspecified pertussis). Algorithm- and database-specific BorPer incidence rates (IRs) were estimated in children aged 0-14 years enrolled in 2012 and 2014 and followed up until the end of each calendar year and compared with IRs of confirmed pertussis from the ECDC surveillance system (TESSy). Novel formulas were used to approximate validity indices, based on a small set of assumptions. They were applied to approximately estimate positive predictive value (PPV) and sensitivity in SIDIAP. RESULTS: The number of cases and the estimated BorPer IRs per 100,000 person-years in PC, using data representing 3,173,268 person-years, were 0 (IR = 0.0), 21 (IR = 4.3), 21 (IR = 5.1), 79 (IR = 5.7), and 2 (IR = 2.3) in BIFAP, SIDIAP, THIN, RCGP RSC and PEDIANET respectively. The IRs for combined specific/unspecified pertussis were higher than TESSy, suggesting that some false positives had been included. In SIDIAP the estimated IR was 45.0 when discharge diagnoses were included. The sensitivity and PPV of combined PC specific and unspecific diagnoses for BorPer cases in SIDIAP were approximately 85% and 72%, respectively. CONCLUSION: Retrieving BorPer cases using only specific concepts has low sensitivity in PC databases, while including cases retrieved by unspecified concepts introduces false positives, which were approximately estimated to be 28% in one database. The share of cases that cannot be retrieved from a PC database because they are only seen in hospital was approximately estimated to be 15% in one database. This study demonstrated that quantifying the impact of different event-finding algorithms across databases and benchmarking with disease surveillance data can provide approximate estimates of algorithm validity.