Sequential Data-Mining for Adverse Events After Recombinant Herpes Zoster Vaccination Using the Tree-Based Scan Statistic.

Tree-based scan statistics have been successfully used to study the safety of several vaccines without prespecifying health outcomes of concern. In this study, the binomial tree-based scan statistic was applied sequentially to detect adverse events in days 1-28 compared with days 29-56 after recombinant herpes zoster (RZV) vaccination, with 5 looks at the data and formal adjustment for the repeated analyses over time. IBM MarketScan data on commercially insured persons ≥50 years of age receiving RZV during January 1, 2018, to May 5, 2020, were used. With 999,876 doses of RZV included, statistically significant signals were detected only for unspecified adverse effects/complications following immunization, with attributable risks as low as 2 excess cases per 100,000 vaccinations. Ninety percent of cases in the signals occurred in the week after vaccination and, based on previous studies, likely represent nonserious events like fever, fatigue, and headache. Strengths of our study include its untargeted nature, self-controlled design, and formal adjustment for repeated testing. Although the method requires prespecification of the risk window of interest and may miss some true signals detectable using the tree-temporal variant of the method, it allows for early detection of potential safety problems through early initiation of ongoing monitoring.

A Broad Safety Assessment of the Recombinant Herpes Zoster Vaccine.

The recombinant herpes zoster vaccine (RZV), approved as a 2-dose series in the United States in October 2017, has proven highly effective and generally safe. However, a small risk of Guillain-Barré syndrome after vaccination was identified after approval, and questions remain about other possible adverse events. This data-mining study assessed RZV safety in the United States using the self-controlled tree-temporal scan statistic, scanning data on thousands of diagnoses recorded during follow-up to detect any statistically unusual temporal clustering of cases within a large hierarchy of diagnoses. IBM MarketScan data on commercially insured persons at least 50 years of age receiving RZV between January 1, 2018, and May 5, 2020, were used, including 56 days of follow-up; 1,014,329 doses were included. Statistically significant clustering was found within a few days of vaccination for unspecified adverse effects, complications, or reactions to immunization or other medical substances/care; fever; unspecified allergy; syncope/collapse; cellulitis; myalgia; and dizziness/giddiness. These findings are consistent with the known safety profile of this and other injected vaccines. No cluster of Guillain-Barré syndrome was detected, possibly due to insufficient sample size. This signal-detection method has now been applied to 5 vaccines, with consistently plausible results, and seems a promising addition to vaccine-safety evaluation methods.

Detecting COVID-19 Clusters at High Spatiotemporal Resolution, New York City, New York, USA, June-July 2020.

A surveillance system that uses census tract resolution and the SaTScan prospective space-time scan statistic detected clusters of increasing severe acute respiratory syndrome coronavirus 2 test percent positivity in New York City, NY, USA. Clusters included one in which patients attended the same social gathering and another that led to targeted testing and outreach.

A Broad Safety Assessment of the 9-Valent Human Papillomavirus Vaccine.

Parents indicate that safety is their top concern about human papillomavirus (HPV) vaccination. A data-mining method not requiring prespecification of health outcome(s) or postexposure period(s) of potentially increased risk can be used to identify possible associations between an exposure and any of thousands of medically attended health outcomes; this method was applied to data on the 9-valent HPV vaccine (HPV9) to detect potential safety problems. Data on 9- to 26-year-olds who had received HPV9 vaccine between November 4, 2016, and August 5, 2018, inclusive, were extracted from the MarketScan database and analyzed for statistically significant clustering of incident diagnoses within the hierarchy of diagnoses coded using the International Classification of Diseases and temporally within the 1 year after vaccination, using the self-controlled tree-temporal scan statistic and TreeScan software. Only 56 days of postvaccination enrollment was required; subsequent follow-up was censored at disenrollment. Multiple testing was adjusted for. The analysis included 493,089 doses of HPV9. Almost all signals resulted from temporal confounding, not unexpected with a 1-year follow-up period. The only plausible signals were for nonspecific adverse events (e.g., injection-site reactions, headache) on days 1-2 after vaccination, with attributable risks as low as 1 per 100,000 vaccinees. Considering the broad scope of the evaluation and the high statistical power, the findings of no specific serious adverse events should provide reassurance about this vaccine's safety.

Active Surveillance of the Safety of Medications Used During Pregnancy.

The scientific community relies on postmarketing approaches to define the risk of using medications in pregnancy because information available at the time of drug approval is limited. Most studies carried out in pregnancy focus on a single outcome or selected outcomes. However, women must balance the benefit of treatment against all possible adverse effects. We aimed to apply and evaluate a tree-based scan statistic data-mining method (TreeScan; Martin Kulldorff, Harvard Medical School, Boston, Massachusetts) as a safety surveillance approach that allows for simultaneous evaluation of a comprehensive range of adverse pregnancy outcomes, while preserving the overall rate of false-positive alerts. We evaluated TreeScan with a cohort design and adjustment via propensity score techniques, using 2 test cases: 1) opioids and neonatal opioid withdrawal syndrome and 2) valproate and congenital malformations, implemented in pregnancy cohorts nested within the Medicaid Analytic eXtract (January 1, 2000-December 31, 2014) and the IBM MarketScan Research Database (IBM, Armonk, New York) (January 1, 2003-September 30, 2015). In both cases, we identified known safety concerns, with only 1 previously unreported alert at the preset statistical alerting threshold. This evaluation shows the promise of TreeScan-based approaches for systematic drug safety monitoring in pregnancy. A targeted screening approach followed by deeper investigation to refine understanding of potential signals will ensure that pregnant women and their physicians have access to the best available evidence to inform treatment decisions.

A General Propensity Score for Signal Identification Using Tree-Based Scan Statistics.

The tree-based scan statistic (TreeScan; Martin Kulldorff, Harvard Medical School, Boston, Massachusetts) is a data-mining method that adjusts for multiple testing of correlated hypotheses when screening thousands of potential adverse events for signal identification. Simulation has demonstrated the promise of TreeScan with a propensity score (PS)-matched cohort design. However, it is unclear which variables to include in a PS for applied signal identification studies to simultaneously adjust for confounding across potential outcomes. We selected 4 pairs of medications with well-understood safety profiles. For each pair, we evaluated 5 candidate PSs with different combinations of 1) predefined general covariates (comorbidity, frailty, utilization), 2) empirically selected (data-driven) covariates, and 3) covariates tailored to the drug pair. For each pair, statistical alerting patterns were similar with alternative PSs (≤11 alerts in 7,996 outcomes scanned). Inclusion of covariates tailored to exposure did not appreciably affect screening results. Inclusion of empirically selected covariates can provide better proxy coverage for confounders but can also decrease statistical power. Unlike tailored covariates, empirical and predefined general covariates can be applied "out of the box" for signal identification. The choice of PS depends on the level of concern about residual confounding versus loss of power. Potential signals should be followed by pharmacoepidemiologic assessment where confounding control is tailored to the specific outcome(s) under investigation.

Screening Medications for Association with Progression to Wet Age-Related Macular Degeneration.

PURPOSE: There is an urgent need for treatments that prevent or delay development to advanced age-related macular degeneration (AMD). Drugs already on the market for other conditions could affect progression to neovascular AMD (nAMD). If identified, these drugs could provide insights for drug development targets. The objective of this study was to use a novel data mining method that can simultaneously evaluate thousands of correlated hypotheses, while adjusting for multiple testing, to screen for associations between drugs and delayed progression to nAMD. DESIGN: We applied a nested case-control study to administrative insurance claims data to identify cases with nAMD and risk-set sampled controls that were 1:4 variable ratio matched on age, gender, and recent healthcare use. PARTICIPANTS: The study population included cases with nAMD and risk set matched controls. METHODS: We used a tree-based scanning method to evaluate associations between hierarchical classifications of drugs that patients were exposed to within 6 months, 7 to 24 months, or ever before their index date. The index date was the date of first nAMD diagnosis in cases. Risk-set sampled controls were assigned the same index date as the case to which they were matched. The study was implemented using Medicare data from New Jersey and Pennsylvania, and national data from IBM MarketScan Research Database. We set an a priori threshold for statistical alerting at P ≤ 0.01 and focused on associations with large magnitude (relative risks ≥ 2.0). MAIN OUTCOME MEASURES: Progression to nAMD. RESULTS: Of approximately 4000 generic drugs and drug classes evaluated, the method detected 19 distinct drug exposures with statistically significant, large relative risks indicating that cases were less frequently exposed than controls. These included (1) drugs with prior evidence for a causal relationship (e.g., megestrol); (2) drugs without prior evidence for a causal relationship, but potentially worth further exploration (e.g., donepezil, epoetin alfa); (3) drugs with alternative biologic explanations for the association (e.g., sevelamer); and (4) drugs that may have resulted in statistical alerts due to their correlation with drugs that alerted for other reasons. CONCLUSIONS: This exploratory drug-screening study identified several potential targets for follow-up studies to further evaluate and determine if they may prevent or delay progression to advanced AMD.

Exact sequential test for clinical trials and post-market drug and vaccine safety surveillance with Poisson and binary data.

In sequential analysis, hypothesis testing is performed repeatedly in a prospective manner as data accrue over time to quickly arrive at an accurate conclusion or decision. In this tutorial paper, detailed explanations are given for both designing and operating sequential testing. We describe the calculation of exact thresholds for stopping or signaling, statistical power, expected time to signal, and expected sample sizes for sequential analysis with Poisson and binary type data. The calculations are run using the package Sequential, constructed in R language. Real data examples are inspired on clinical trials practice, such as the current efforts to develop treatments to face the COVID-19 pandemic, and the comparison of treatments of osteoporosis. In addition, we mimic the monitoring of adverse events following influenza vaccination and Pediarix vaccination.

Empagliflozin and the Risk of Heart Failure Hospitalization in Routine Clinical Care.

BACKGROUND: The EMPA-REG OUTCOME trial (Empagliflozin Cardiovascular Outcome Event Trial in Type 2 diabetes Mellitus Patients) showed that empagliflozin, a sodium-glucose cotransporter-2 inhibitor, reduces the risk of hospitalization for heart failure (HHF) by 35%, on top of standard of care in patients with type 2 diabetes mellitus (T2D) and established cardiovascular disease. The EMPRISE (Empagliflozin Comparative Effectiveness and Safety) study aims to assess empagliflozin's effectiveness, safety, and healthcare utilization in routine care from August 2014 through September 2019. In this first interim analysis, we investigated the risk of HHF among T2D patients initiating empagliflozin versus sitagliptin, a dipeptidyl peptidase-4 inhibitor. METHODS: Within 2 commercial and 1 federal (Medicare) claims data sources in the United States, we identified a 1:1 propensity score-matched cohort of T2D patients ≥18 years old initiating empagliflozin or sitagliptin from August 2014 through September 2016. The HHF outcome was defined as a HF discharge diagnosis in the primary position (HHF-specific); a broader definition was based on a HF discharge diagnosis in any position (HHF-broad). Hazard ratios (HRs) and 95% CIs were estimated controlling for over 140 baseline characteristics in each data source and pooled by fixed-effects meta-analysis. RESULTS: After propensity-score matching, we identified 16,443 patient pairs who initiated empagliflozin or sitagliptin. Average age was approximately 59 years, almost 54% of the participants were males, and approximately 25% had records of existing cardiovascular disease. Compared with sitagliptin, the initiation of empagliflozin decreased the risk of HHF-specific by 50% (HR, 0.50; 95% CI, 0.28-0.91), and the risk of HHF-broad by 49% (HR, 0.51;95% CI, 0.39-0.68), over a mean follow-up of 5.3 months. The results were consistent in patients with and without baseline cardiovascular disease, and for empagliflozin at both the 10- and 25-mg daily doses; analyses comparing empagliflozin versus the dipeptidyl peptidase-4 inhibitor class, and comparing sodium-glucose cotransporter-2 inhibitor versus dipeptidyl peptidase-4 inhibitor classes also produced consistent findings. CONCLUSIONS: The first interim analysis from EMPRISE showed that compared with sitagliptin, the initiation of empagliflozin was associated with a decreased risk of HHF among patients with T2D as treated in routine care, with and without a history of cardiovascular disease. CLINICAL TRIAL REGISTRATION: URL: https://www.clinicaltrials.gov . Unique identifier: NCT03363464.

Individual and Neighborhood Factors Associated With Failure to Vaccinate Against Influenza During Pregnancy.

Uptake of influenza vaccine among pregnant women remains low. We investigated whether unvaccinated pregnant women were clustered geographically and determined factors associated with failure to vaccinate using spatial and multivariate logistic regression analyses. Pregnant women who were members of Kaiser Permanente Northern California in 2015 or 2016 were included in the study. More than half (53%) of the 77,607 included pregnant women were unvaccinated. Spatial analysis identified 5 clusters with a high prevalence of unvaccinated pregnant women. The proportion of unvaccinated women ranged from 57% to 75% within clusters as compared with 51% outside clusters. In covariate-adjusted analyses, residence in a cluster was associated with a 41% increase in the odds of being unvaccinated (odds ratio (OR) = 1.41, 95% confidence interval (CI): 1.36, 1.46). The odds of being unvaccinated were greater for Black women (OR = 1.58, 95% CI: 1.49, 1.69), Hispanic women (OR = 1.15, 95% CI: 1.05, 1.25), women with subsidized health insurance (OR = 1.18, 95% CI: 1.11, 1.24), women with fewer than 5 prenatal-care visits (OR = 1.85, 95% CI: 1.60, 2.16), and neighborhoods with a high deprivation index (fourth quartile vs. first: OR = 1.14, 95% CI: 1.07, 1.21). In conclusion, unvaccinated pregnant women were clustered geographically and by key sociodemographic factors. These findings suggest that interventions to increase influenza vaccine coverage among pregnant women are needed, particularly in vulnerable populations.

Exact sequential analysis for multiple weighted binomial end points.

Sequential analysis is used in clinical trials and postmarket drug safety surveillance to prospectively monitor efficacy and safety to quickly detect benefits and problems, while taking the multiple testing of repeated analyses into account. When there are multiple outcomes, each one may be given a weight corresponding to its severity. This paper introduces an exact sequential analysis procedure for multiple weighted binomial end points; the analysis incorporates a drug's combined benefit and safety profile. It works with a variety of alpha spending functions for continuous, group, or mixed group-continuous sequential analysis. The binomial probabilities may vary over time and do not need to be known a priori. The new method was implemented in the free R Sequential package for both one- and two-tailed sequential analysis. An example is given examining myocardial infarction and major bleeding events in patients who initiated non-steroidal antiinflammatory drugs.

Geospatial analysis of nonmedical vaccine exemptions and pertussis outbreaks in the United States.

Because of increased numbers of recorded pertussis cases in the United States, this study sought to understand the role of nonmedical vaccine exemptions and waning immunity may have had on the resurgence of pertussis in the United States at the community level. We used geospatial scan statistics, SaTScan, version 9.4, to analyze nonmedical vaccine exemptions of children entering kindergarten in 2011 and 2012 and reported pertussis cases in 2012 for children in age groups 5 years and younger and 10 to 14 years. Eight statistically significant clusters of nonmedical vaccine exemptions in kindergarteners and 11 statistically significant clusters of pertussis cases in children and adolescents were identified and geospatially linked. Forty-five percent of the counties in the study had high rates of nonmedical vaccine exemptions. The proportion of kindergarteners with nonmedical vaccine exemptions was 2.8 times larger in the identified exemption clusters. In addition, 31 counties had geographic clusters of high rates of pertussis in children ages 10 to 14 years old, consistent with waning immunity. Our findings are consistent with the view that geographic clusters of nonmedical vaccine exemptions and waning immunity may have been factors contributing to community-level pertussis outbreaks.

Variation in Prescription Drug Prices by Retail Pharmacy Type: A National Cross-sectional Study.

Background: Cash prices for prescription drugs vary widely in the United States. Objective: To describe cash price variation by retail pharmacy type for 10 generic and 6 brand-name drugs throughout the United States and stratified by ZIP code. Design: Cross-sectional study. Setting: Drug pricing data from GoodRx, an online tool for comparing drug prices, representing more than 60 000 U.S. pharmacies (fall 2015). Measurements: Cash prices for a 1-month supply of generic and brand-name drugs were ascertained. Stratified by ZIP code, relative cash prices for groups of generic and brand-name drugs were estimated for big box, grocery-based, small chain, and independent pharmacies compared with a reference group of large chain pharmacies. Results: Across 16 325 ZIP codes, 68 353 unique pharmacy stores contributed cash prices. When stratified by 5-digit ZIP code, the relative cash prices for generic drugs at big box, grocery-based, small chain, and independent pharmacies compared with those at large chain pharmacies were 0.52 (95% CI, 0.51 to 0.53), 0.82 (CI, 0.81 to 0.83), 1.51 (CI, 1.45 to 1.56), and 1.61 (CI, 1.58 to 1.64), respectively. The relative cash prices for brand-name drugs were 0.97 (CI, 0.96 to 0.97), 1.00 (CI, 0.99 to 1.00), 1.06 (CI, 1.05 to 1.08), and 1.03 (CI, 1.02 to 1.04), respectively. Limitation: Results may not reflect current drug prices and do not account for point-of-sale discounts or price matching that may be offered by smaller pharmacies. Conclusion: Compared with large chains, independent pharmacies and small chains had the highest cash prices for generic drugs and big box pharmacies the lowest. Relative differences in cash prices for brand-name drugs were modest across types of retail pharmacies. Primary Funding Source: Arnold Ventures.

Intraseason Waning of Influenza Vaccine Effectiveness.

BACKGROUND: In the United States, it is recommended that healthcare providers offer influenza vaccination by October, if possible. However, if the vaccine's effectiveness soon begins to wane, the optimal time for vaccination may be somewhat later. We examined whether the effectiveness of influenza vaccine wanes during the influenza season with increasing time since vaccination. METHODS: We identified persons who were vaccinated with inactivated influenza vaccine from 1 September 2010 to 31 March 2017 and who were subsequently tested for influenza and respiratory syncytial virus (RSV) by a polymerase chain reaction test. Test-confirmed influenza was the primary outcome and days-since-vaccination was the predictor of interest in conditional logistic regression. Models were adjusted for age and conditioned on calendar day and geographic area. RSV was used as a negative-control outcome. RESULTS: Compared with persons vaccinated 14 to 41 days prior to being tested, persons vaccinated 42 to 69 days prior to being tested had 1.32 (95% confidence interval [CI], 1.11 to 1.55) times the odds of testing positive for any influenza. The odds ratio (OR) increased linearly by approximately 16% for each additional 28 days since vaccination. The OR was 2.06 (95% CI, 1.69 to 2.51) for persons vaccinated 154 or more days prior to being tested. No evidence of waning was found for RSV. CONCLUSIONS: Our results suggest that effectiveness of inactivated influenza vaccine wanes during the course of a single season. These results may lead to reconsideration of the optimal timing of seasonal influenza vaccination.

Kawasaki disease and 13-valent pneumococcal conjugate vaccination among young children: A self-controlled risk interval and cohort study with null results.

BACKGROUND: Kawasaki disease is an acute vasculitis that primarily affects children younger than 5 years of age. Its etiology is unknown. The United States Vaccine Safety Datalink conducted postlicensure safety surveillance for 13-valent pneumococcal conjugate vaccine (PCV13), comparing the risk of Kawasaki disease within 28 days of PCV13 vaccination with the historical risk after 7-valent PCV (PCV7) vaccination and using chart-validation. A relative risk (RR) of 2.38 (95% CI 0.92-6.38) was found. Concurrently, the Food and Drug Administration (FDA) conducted a postlicensure safety review that identified cases of Kawasaki disease through adverse event reporting. The FDA decided to initiate a larger study of Kawasaki disease risk following PCV13 vaccination in the claims-based Sentinel/Postlicensure Rapid Immunization Safety Monitoring (PRISM) surveillance system. The objective of this study was to determine the existence and magnitude of any increased risk of Kawasaki disease in the 28 days following PCV13 vaccination. METHODS AND FINDINGS: The study population included mostly commercially insured children from birth to <24 months of age in 2010 to 2015 from across the US. Using claims data of participating Sentinel/PRISM data-providing organizations, PCV13 vaccinations were identified by means of current procedural terminology (CPT), Healthcare Common Procedure Coding System (HCPCS), and National Drug Code (NDC) codes. Potential cases of Kawasaki disease were identified by first-in-365-days International Classification of Diseases 9th revision (ICD-9) code 446.1 or International Classification of Diseases 10th revision (ICD-10) code M30.3 in the inpatient setting. Medical records were sought for potential cases and adjudicated by board-certified pediatricians. The primary analysis used chart-confirmed cases with adjudicated symptom onset in a self-controlled risk interval (SCRI) design, which controls for time-invariant potential confounders. The prespecified risk interval was Days 1-28 after vaccination; a 28-day-long control interval followed this risk interval. A secondary analytic approach used a cohort design, with alternative potential risk intervals of Days 1-28 and Days 1-42. The varying background risk of Kawasaki disease by age was adjusted for in both designs. In the primary analysis, there were 43 confirmed cases of Kawasaki disease in the risk interval and 44 in the control interval. The age-adjusted risk estimate was 1.07 (95% CI 0.70-1.63; p = 0.76). In the secondary, cohort analyses, which included roughly 700 potential cases and more than 3 million person-years, the risk estimates of potential Kawasaki disease in the risk interval versus in unexposed person-time were 0.84 (95% CI 0.65-1.08; p = 0.18) for the Days 1-28 risk interval and 0.97 (95% CI 0.79-1.19; p = 0.80) for the Days 1-42 risk interval. The main limitation of the study was that we lacked the resources to conduct medical record review for all the potential cases of Kawasaki disease. As a result, potential cases rather than chart-confirmed cases were used in the cohort analyses. CONCLUSIONS: With more than 6 million doses of PCV13 administered, no evidence was found of an association between PCV13 vaccination and Kawasaki disease onset in the 4 weeks after vaccination nor of an elevated risk extending or concentrated somewhat beyond 4 weeks. These null results were consistent across alternative designs, age-adjustment methods, control intervals, and categories of Kawasaki disease case included.

Using the Self-Controlled Tree-Temporal Scan Statistic to Assess the Safety of Live Attenuated Herpes Zoster Vaccine.

The self-controlled tree-temporal scan statistic allows detection of potential vaccine- or drug-associated adverse events without prespecifying the specific events or postexposure risk intervals of concern. It thus opens a promising new avenue for safety studies. The method has been successfully used to evaluate the safety of 2 vaccines for adolescents and young adults, but its suitability to study vaccines for older adults had not been established. The present study applied the method to assess the safety of live attenuated herpes zoster vaccination during 2011-2017 in US adults aged ≥60 years, using claims data from Truven Health MarketScan Research Databases. Counts of International Classification of Diseases diagnosis codes recorded in emergency department or hospital settings were scanned for any statistically unusual clustering within a hierarchical tree structure of diagnoses and within 42 days after vaccination. Among 1.24 million vaccinations, 4 clusters were found: cellulitis on days 1-3, nonspecific erythematous condition on days 2-4, "other complications . . ." on days 1-3, and nonspecific allergy on days 1-6. These results are consistent with local injection-site reactions and other known, generally mild, vaccine-associated adverse events and a favorable safety profile. This method might be useful for assessing the safety of other vaccines for older adults.

Cardiovascular safety of linagliptin compared with other oral glucose-lowering agents in patients with type 2 diabetes: A sequential monitoring programme in routine care.

AIM: To evaluate the safety of linagliptin versus other glucose-lowering medications in a multi-year monitoring programme using insurance claims data. METHODS: In two commercial US claims databases, we identified three pairwise 1:1 propensity-score (PS)-matched cohorts of patients with type 2 diabetes (T2D) aged ≥18 years initiating linagliptin or a comparator (other dipeptidyl peptidase-4 [DPP-4] inhibitors [n = 31 492 pairs], pioglitazone [n = 23 316 pairs], or second-generation sulphonylureas [n = 19 731 pairs]) between May 2011 and December 2015. The primary endpoint was the risk of a composite cardiovascular (CV) outcome (hospitalization for myocardial infarction, stroke, unstable angina, or coronary revascularization). We estimated pooled hazard ratios (HRs) and 95% confidence intervals (CIs), controlling for >100 baseline characteristics. RESULTS: Patient characteristics were well balanced after PS-matching. The mean age was 55 years and mean follow-up was 0.8 years. Linagliptin conferred a similar risk of the composite CV outcome compared to other DPP-4 inhibitors (HR 0.91, 95% CI 0.79-1.05) and pioglitazone (HR 0.98, 95% CI 0.84-1.15), and showed a reduced risk of CV outcomes compared to second-generation sulphonylureas (HR 0.76, 95% CI 0.64--0.92). Key findings were signalled at the first interim analysis in June 2013 and solidified during ongoing monitoring until 2015. CONCLUSION: Analyses from a large monitoring programme in routine care of patients with T2D, showed that linagliptin had similar CV safety compared to other DPP-4 inhibitors and pioglitazone, and a reduced CV risk compared to sulphonylureas.

Assessment of Quadrivalent Human Papillomavirus Vaccine Safety Using the Self-Controlled Tree-Temporal Scan Statistic Signal-Detection Method in the Sentinel System.

The self-controlled tree-temporal scan statistic-a new signal-detection method-can evaluate whether any of a wide variety of health outcomes are temporally associated with receipt of a specific vaccine, while adjusting for multiple testing. Neither health outcomes nor postvaccination potential periods of increased risk need be prespecified. Using US medical claims data in the Food and Drug Administration's Sentinel system, we employed the method to evaluate adverse events occurring after receipt of quadrivalent human papillomavirus vaccine (4vHPV). Incident outcomes recorded in emergency department or inpatient settings within 56 days after first doses of 4vHPV received by 9- through 26.9-year-olds in 2006-2014 were identified using International Classification of Diseases, Ninth Revision, diagnosis codes and analyzed by pairing the new method with a standard hierarchical classification of diagnoses. On scanning diagnoses of 1.9 million 4vHPV recipients, 2 statistically significant categories of adverse events were found: cellulitis on days 2-3 after vaccination and "other complications of surgical and medical procedures" on days 1-3 after vaccination. Cellulitis is a known adverse event. Clinically informed investigation of electronic claims records of the patients with "other complications" did not suggest any previously unknown vaccine safety problem. Considering that thousands of potential short-term adverse events and hundreds of potential risk intervals were evaluated, these findings add significantly to the growing safety record of 4vHPV.

Data Mining for Adverse Drug Events With a Propensity Score-matched Tree-based Scan Statistic.

The tree-based scan statistic is a statistical data mining tool that has been used for signal detection with a self-controlled design in vaccine safety studies. This disproportionality statistic adjusts for multiple testing in evaluation of thousands of potential adverse events. However, many drug safety questions are not well suited for self-controlled analysis. We propose a method that combines tree-based scan statistics with propensity score-matched analysis of new initiator cohorts, a robust design for investigations of drug safety. We conducted plasmode simulations to evaluate performance. In multiple realistic scenarios, tree-based scan statistics in cohorts that were propensity score matched to adjust for confounding outperformed tree-based scan statistics in unmatched cohorts. In scenarios where confounding moved point estimates away from the null, adjusted analyses recovered the prespecified type 1 error while unadjusted analyses inflated type 1 error. In scenarios where confounding moved point estimates toward the null, adjusted analyses preserved power, whereas unadjusted analyses greatly reduced power. Although complete adjustment of true confounders had the best performance, matching on a moderately mis-specified propensity score substantially improved type 1 error and power compared with no adjustment. When there was true elevation in risk of an adverse event, there were often co-occurring signals for clinically related concepts. TreeScan with propensity score matching shows promise as a method for screening and prioritization of potential adverse events. It should be followed by clinical review and safety studies specifically designed to quantify the magnitude of effect, with confounding control targeted to the outcome of interest.

Counter-Point: Early Warning Systems Are Imperfect, but Essential.

Sequential analysis can be used as an early warning system about potential unintended consequences of health policy decisions, generating follow-up investigations, but it should not be used as causal evidence.