Use of existing systematic reviews for the development of evidence-based vaccination recommendations: Guidance from the SYSVAC expert panel.

National immunization technical advisory groups (NITAGs) develop immunization-related recommendations and assist policy-makers in making evidence informed decisions. Systematic reviews (SRs) that summarize the available evidence on a specific topic are a valuable source of evidence in the development of such recommendations. However, conducting SRs requires significant human, time, and financial resources, which many NITAGs lack. Given that SRs already exist for many immunization-related topics, and to prevent duplication and overlap of reviews, a more practical approach may be for NITAGs to use existing SRs. Nevertheless, it can be challenging to identify relevant SRs, to select one SR from among multiple SRs, or to critically assess and effectively use them. To support NITAGs, the London School of Hygiene and Tropical Medicine, Robert Koch Institute and collaborators developed the SYSVAC project, which consists of an online registry of systematic reviews on immunization-related topics and an e-learning course, that supports the use of them (both freely accessible at https://www.nitag-resource.org/sysvac-systematic-reviews). Drawing from the e-learning course and recommendations from an expert panel, this paper outlines methods for using existing systematic reviews when making immunization-related recommendations. With specific examples and reference to the SYSVAC registry and other resources, it offers guidance on locating existing systematic reviews; assessing their relevance to a research question, up-to-dateness, and methodological quality and/or risk of bias; and considering the transferability and applicability of their findings to other populations or settings.

Efficacy and safety of COVID-19 vaccines.

BACKGROUND: Different forms of vaccines have been developed to prevent the SARS-CoV-2 virus and subsequent COVID-19 disease. Several are in widespread use globally.  OBJECTIVES: To assess the efficacy and safety of COVID-19 vaccines (as a full primary vaccination series or a booster dose) against SARS-CoV-2. SEARCH METHODS: We searched the Cochrane COVID-19 Study Register and the COVID-19 L·OVE platform (last search date 5 November 2021). We also searched the WHO International Clinical Trials Registry Platform, regulatory agency websites, and Retraction Watch. SELECTION CRITERIA: We included randomized controlled trials (RCTs) comparing COVID-19 vaccines to placebo, no vaccine, other active vaccines, or other vaccine schedules. DATA COLLECTION AND ANALYSIS: We used standard Cochrane methods. We used GRADE to assess the certainty of evidence for all except immunogenicity outcomes.  We synthesized data for each vaccine separately and presented summary effect estimates with 95% confidence intervals (CIs).  MAIN RESULTS: We included and analyzed 41 RCTs assessing 12 different vaccines, including homologous and heterologous vaccine schedules and the effect of booster doses. Thirty-two RCTs were multicentre and five were multinational. The sample sizes of RCTs were 60 to 44,325 participants. Participants were aged: 18 years or older in 36 RCTs; 12 years or older in one RCT; 12 to 17 years in two RCTs; and three to 17 years in two RCTs. Twenty-nine RCTs provided results for individuals aged over 60 years, and three RCTs included immunocompromized patients. No trials included pregnant women. Sixteen RCTs had two-month follow-up or less, 20 RCTs had two to six months, and five RCTs had greater than six to 12 months or less. Eighteen reports were based on preplanned interim analyses. Overall risk of bias was low for all outcomes in eight RCTs, while 33 had concerns for at least one outcome. We identified 343 registered RCTs with results not yet available.  This abstract reports results for the critical outcomes of confirmed symptomatic COVID-19, severe and critical COVID-19, and serious adverse events only for the 10 WHO-approved vaccines. For remaining outcomes and vaccines, see main text. The evidence for mortality was generally sparse and of low or very low certainty for all WHO-approved vaccines, except AD26.COV2.S (Janssen), which probably reduces the risk of all-cause mortality (risk ratio (RR) 0.25, 95% CI 0.09 to 0.67; 1 RCT, 43,783 participants; high-certainty evidence). Confirmed symptomatic COVID-19 High-certainty evidence found that BNT162b2 (BioNtech/Fosun Pharma/Pfizer), mRNA-1273 (ModernaTx), ChAdOx1 (Oxford/AstraZeneca), Ad26.COV2.S, BBIBP-CorV (Sinopharm-Beijing), and BBV152 (Bharat Biotect) reduce the incidence of symptomatic COVID-19 compared to placebo (vaccine efficacy (VE): BNT162b2: 97.84%, 95% CI 44.25% to 99.92%; 2 RCTs, 44,077 participants; mRNA-1273: 93.20%, 95% CI 91.06% to 94.83%; 2 RCTs, 31,632 participants; ChAdOx1: 70.23%, 95% CI 62.10% to 76.62%; 2 RCTs, 43,390 participants; Ad26.COV2.S: 66.90%, 95% CI 59.10% to 73.40%; 1 RCT, 39,058 participants; BBIBP-CorV: 78.10%, 95% CI 64.80% to 86.30%; 1 RCT, 25,463 participants; BBV152: 77.80%, 95% CI 65.20% to 86.40%; 1 RCT, 16,973 participants). Moderate-certainty evidence found that NVX-CoV2373 (Novavax) probably reduces the incidence of symptomatic COVID-19 compared to placebo (VE 82.91%, 95% CI 50.49% to 94.10%; 3 RCTs, 42,175 participants). There is low-certainty evidence for CoronaVac (Sinovac) for this outcome (VE 69.81%, 95% CI 12.27% to 89.61%; 2 RCTs, 19,852 participants). Severe or critical COVID-19 High-certainty evidence found that BNT162b2, mRNA-1273, Ad26.COV2.S, and BBV152 result in a large reduction in incidence of severe or critical disease due to COVID-19 compared to placebo (VE: BNT162b2: 95.70%, 95% CI 73.90% to 99.90%; 1 RCT, 46,077 participants; mRNA-1273: 98.20%, 95% CI 92.80% to 99.60%; 1 RCT, 28,451 participants; AD26.COV2.S: 76.30%, 95% CI 57.90% to 87.50%; 1 RCT, 39,058 participants; BBV152: 93.40%, 95% CI 57.10% to 99.80%; 1 RCT, 16,976 participants). Moderate-certainty evidence found that NVX-CoV2373 probably reduces the incidence of severe or critical COVID-19 (VE 100.00%, 95% CI 86.99% to 100.00%; 1 RCT, 25,452 participants). Two trials reported high efficacy of CoronaVac for severe or critical disease with wide CIs, but these results could not be pooled. Serious adverse events (SAEs) mRNA-1273, ChAdOx1 (Oxford-AstraZeneca)/SII-ChAdOx1 (Serum Institute of India), Ad26.COV2.S, and BBV152 probably result in little or no difference in SAEs compared to placebo (RR: mRNA-1273: 0.92, 95% CI 0.78 to 1.08; 2 RCTs, 34,072 participants; ChAdOx1/SII-ChAdOx1: 0.88, 95% CI 0.72 to 1.07; 7 RCTs, 58,182 participants; Ad26.COV2.S: 0.92, 95% CI 0.69 to 1.22; 1 RCT, 43,783 participants); BBV152: 0.65, 95% CI 0.43 to 0.97; 1 RCT, 25,928 participants). In each of these, the likely absolute difference in effects was fewer than 5/1000 participants. Evidence for SAEs is uncertain for BNT162b2, CoronaVac, BBIBP-CorV, and NVX-CoV2373 compared to placebo (RR: BNT162b2: 1.30, 95% CI 0.55 to 3.07; 2 RCTs, 46,107 participants; CoronaVac: 0.97, 95% CI 0.62 to 1.51; 4 RCTs, 23,139 participants; BBIBP-CorV: 0.76, 95% CI 0.54 to 1.06; 1 RCT, 26,924 participants; NVX-CoV2373: 0.92, 95% CI 0.74 to 1.14; 4 RCTs, 38,802 participants). For the evaluation of heterologous schedules, booster doses, and efficacy against variants of concern, see main text of review. AUTHORS' CONCLUSIONS: Compared to placebo, most vaccines reduce, or likely reduce, the proportion of participants with confirmed symptomatic COVID-19, and for some, there is high-certainty evidence that they reduce severe or critical disease. There is probably little or no difference between most vaccines and placebo for serious adverse events. Over 300 registered RCTs are evaluating the efficacy of COVID-19 vaccines, and this review is updated regularly on the COVID-NMA platform (covid-nma.com). Implications for practice Due to the trial exclusions, these results cannot be generalized to pregnant women, individuals with a history of SARS-CoV-2 infection, or immunocompromized people. Most trials had a short follow-up and were conducted before the emergence of variants of concern. Implications for research Future research should evaluate the long-term effect of vaccines, compare different vaccines and vaccine schedules, assess vaccine efficacy and safety in specific populations, and include outcomes such as preventing long COVID-19. Ongoing evaluation of vaccine efficacy and effectiveness against emerging variants of concern is also vital.

Using existing systematic reviews for developing vaccination recommendations: Results of an international expert workshop.

National immunization technical advisory groups (NITAGs) develop immunization-related recommendations. Systematic reviews are recommended to be used in this process, but conducting them requires significant resources, which many NITAGs lack. Using existing systematic reviews could help address this problem. The Robert Koch Institute and collaborators set up the SYSVAC2 project to facilitate the retrieval of existing systematic reviews and offer guidance on using them. This will include an online registry of systematic reviews relevant to immunization policy and an online course on how to use existing reviews. This report describes an international expert workshop held in December 2019 to develop consensus on methods for using existing reviews and other relevant factors for the registry and course. Members from NITAGs representing different regions of the world presented their experiences of using systematic reviews and reflected on challenges inhibiting use. Three methodologists considered different aspects of using systematic reviews. Interactive sessions followed, where implications for SYSVAC2 were discussed. Participants supported having critical appraisal ratings, plain language summaries, keyword search, and data visualization functions in the registry. They suggested tailoring course content to different audiences and including overviews of reviews as a topic and examples of how NITAGs have used or could use existing reviews. Participants agreed that whether a review is out-of-date should be decided by those using the review rather than registry staff. The registry could help by highlighting the date of literature search or included primary studies. Participants recommended a visualization function to highlight overlap across reviews and guidance on handling challenges to using reviews, ideally, involving a practical element. No consensus was reached on which critical appraisal tool to use for reviews in the registry, but a majority of participants wanted registry staff to perform appraisals. Formative research is planned before the registry and online course are launched in 2020.

Vaccine hesitancy around the globe: Analysis of three years of WHO/UNICEF Joint Reporting Form data-2015-2017.

In order to gather a global picture of vaccine hesitancy and whether/how it is changing, an analysis was undertaken to review three years of data available as of June 2017 from the WHO/UNICEF Joint Report Form (JRF) to determine the reported rate of vaccine hesitancy across the globe, the cited reasons for hesitancy, if these varied by country income level and/or by WHO region and whether these reasons were based upon an assessment. The reported reasons were classified using the Strategic Advisory Group of Experts (SAGE) on Immunization matrix of hesitancy determinants (www.who.int/immunization/sage/meetings/2014/october/SAGE_working_group_revised_report_vaccine_hesitancy.pdf). Hesitancy was common, reported by >90% of countries. The list of cited reasons was long and covered 22 of 23 WHO determinants matrix categories. Even the most frequently cited category, risk- benefit (scientific evidence e.g. vaccine safety concerns), accounted for less than one quarter of all reasons cited. The reasons varied by country income level, by WHO region and over time and within a country. Thus based upon this JRF data, across the globe countries appear to understand the SAGE vaccine hesitancy definition and use it to report reasons for hesitancy. However, the rigour of the cited reasons could be improved as only just over 1/3 of countries reported that their reasons were assessment based, the rest were opinion based. With respect to any assessment in the previous five years, upper middle income countries were the least likely to have done an assessment. These analyses provided some of the evidence for the 2017 Assessment Report of the Global Vaccine Action Plan recommendation that each country develop a strategy to increase acceptance and demand for vaccination, which should include ongoing community engagement and trust-building, active hesitancy prevention, regular national assessment of vaccine concerns, and crisis response planning (www.who.int/immunization/sage/meetings/2017/october/1_GVAP_Assessment_report_web_version.pdf).

Assessments of global drivers of vaccine hesitancy in 2014-Looking beyond safety concerns.

Vaccine hesitancy has become the focus of growing attention and concern globally despite overwhelming evidence of the value of vaccines in preventing disease and saving the lives of millions of individuals every year. Measuring vaccine hesitancy and its determinants worldwide is important in order to understand the scope of the problem and for the development of evidence-based targeted strategies to reduce hesitancy. Two indicators to assess vaccine hesitancy were developed to capture its nature and scope at the national and subnational level to collect data in 2014: 1) The top 3 reasons for not accepting vaccines according to the national schedule in the past year and whether the response was opinion- or assessment-based and 2) Whether an assessment (or measurement) of the level of confidence in vaccination had taken place at national or subnational level in the previous 5 years. The most frequently cited reasons for vaccine hesitancy globally related to (1) the risk-benefit of vaccines, (2) knowledge and awareness issues, (3) religious, cultural, gender or socio-economic factors. Major issues were fear of side effects, distrust in vaccination and lack of information on immunization or immunization services. The analysis revealed that 29% of all countries had done an assessment of the level of confidence in their country, suggesting that vaccine confidence was an issue of importance. Monitoring vaccine hesitancy is critical because of its influence on the success of immunization programs. To our knowledge, the proposed indicators provide the first global snapshot of reasons driving vaccine hesitancy and depicting its widespread nature, as well as the extent of assessments conducted by countries.

Off-label use of vaccines.

This article reviews the off-label recommendations and use of vaccines, and focuses on the differences between the labelled instructions on how to use the vaccine as approved by the regulatory authorities (or "label"1), and the recommendations for use issued by public health advisory bodies at national and international levels. Differences between public health recommendations and the product label regarding the vaccine use can lead to confusion at the level of vaccinators and vaccinees and possibly result in lower compliance with national vaccination schedules. In particular, in many countries, the label may contain regulatory restrictions and warnings against vaccination of specific population groups (e.g. pregnant women) due to a lack of evidence of safety from controlled trials at the time of initial licensure of the vaccine, while public health authorities may recommend the same vaccine for that group, based on additional post-marketing data and benefit risk analyses. We provide an overview of the different responsibilities between regulatory authorities and public health advisory bodies, and the rationale for off-label use2 of vaccines, the challenges involved based on the impact of off-label use in real-life. We propose to reduce off-label use of vaccines by requiring the manufacturer to regularly adapt the label as much as possible to the public health needs as supported by new evidence. This would require manufacturers to collect and report post-marketing data, communicate them to all stakeholders and regulators to extrapolate existing evidence (when acceptable) to other groups or to other brands of a vaccine (class effect3). Regulatory authorities have a key role to play by requesting additional post-marketing data, e.g. in specific target groups. When public health recommendations for vaccine use that are outside labelled indications are considered necessary, good communication between regulatory bodies, public health authorities, companies and health care providers or vaccinators is crucial. Recommendations as well as labels and label changes should be evidence-based. The rationale for the discrepancy and the recommended off-label use of a vaccine should be communicated to providers.

Global Varicella Vaccine Effectiveness: A Meta-analysis.

CONTEXT: Several varicella vaccines are available worldwide. Countries with a varicella vaccination program use 1- or 2-dose schedules. OBJECTIVE: We examined postlicensure estimates of varicella vaccine effectiveness (VE) among healthy children. DATA SOURCES: Systematic review and descriptive and meta-analysis of Medline, Embase, Cochrane libraries, and CINAHL databases for reports published during 1995-2014. STUDY SELECTION: Publications that reported original data on dose-specific varicella VE among immunocompetent children. DATA EXTRACTION: We used random effects meta-analysis models to obtain pooled one dose VE estimates by disease severity (all varicella and moderate/severe varicella). Within each severity category, we assessed pooled VE by vaccine and by study design. We used descriptive statistics to summarize 1-dose VE against severe disease. For 2-dose VE, we calculated pooled estimates against all varicella and by study design. RESULTS: The pooled 1-dose VE was 81% (95% confidence interval [CI]: 78%-84%) against all varicella and 98% (95% CI: 97%-99%) against moderate/severe varicella with no significant association between VE and vaccine type or study design (P > .1). For 1 dose, median VE for prevention of severe disease was 100% (mean = 99.4%). The pooled 2-dose VE against all varicella was 92% (95% CI: 88%-95%), with similar estimates by study design. LIMITATIONS: VE was assessed primarily during outbreak investigations and using clinically diagnosed varicella. CONCLUSIONS: One dose of varicella vaccine was moderately effective in preventing all varicella and highly effective in preventing moderate/severe varicella, with no differences by vaccine. The second dose adds improved protection against all varicella.