A Practical Guide to Pilot Testing Community-Based Vaccination Coverage Surveys.

Pilot testing is crucial when preparing any community-based vaccination coverage survey. In this paper, we use the term pilot test to mean informative work conducted before a survey protocol has been finalized for the purpose of guiding decisions about how the work will be conducted. We summarize findings from seven pilot tests and provide practical guidance for piloting similar studies. We selected these particular pilots because they are excellent models of preliminary efforts that informed the refinement of data collection protocols and instruments. We recommend survey coordinators devote time and budget to identify aspects of the protocol where testing could mitigate project risk and ensure timely assessment yields, credible estimates of vaccination coverage and related indicators. We list specific items that may benefit from pilot work and provide guidance on how to prioritize what to pilot test when resources are limited.

Estimates of the global burden of Congenital Rubella Syndrome, 1996-2019.

OBJECTIVES: Many countries introduced rubella-containing vaccination (RCV) after 2011, following changes in recommended World Health Organization (WHO) vaccination strategies and external support. We evaluated the impact of these introductions. METHODS: We estimated the country-specific, region-specific, and global Congenital Rubella Syndrome (CRS) incidence during 1996-2019 using mathematical modeling, including routine and campaign vaccination coverage and seroprevalence data. RESULTS: In 2019, WHO African and Eastern Mediterranean regions had the highest estimated CRS incidence (64 [95% confidence intervals (CI): 24-123] and 27 [95% CI: 4-67] per 100,000 live births respectively), where nearly half of births occur in countries that have introduced RCV. Other regions, where >95% of births occurred in countries that had introduced RCV, had a low estimated CRS incidence (<1 [95% CI: <1 to 8] and <1 [95% CI: <1 to 12] per 100,000 live births in South-East Asia [SEAR] and the Western Pacific [WPR] respectively, and similarly in Europe and the Americas). The estimated number of CRS births globally declined by approximately two-thirds during 2010-2019, from 100,000 (95% CI: 54,000-166,000) to 32,000 (95% CI: 13,000-60,000), representing a 73% reduction since 1996, largely following RCV introductions in WPR and SEAR, where the greatest reductions occurred. CONCLUSIONS: Further reductions can occur by introducing RCV in remaining countries and maintaining high RCV coverage.

Health effects of routine measles vaccination and supplementary immunisation activities in 14 high-burden countries: a Dynamic Measles Immunization Calculation Engine (DynaMICE) modelling study.

BACKGROUND: WHO recommends at least 95% population coverage with two doses of measles-containing vaccine (MCV). Most countries worldwide use routine services to offer a first dose of measles-containing vaccine (MCV1) and later, a second dose of measles-containing vaccine (MCV2). Many countries worldwide conduct supplementary immunisation activities (SIAs), offering vaccination to all people in a specific age range irrespective of previous vaccination history. We aimed to estimate the relative effects of each dose and delivery route in 14 countries with high measles burden. METHODS: We used an age-structured compartmental dynamic model, the Dynamic Measles Immunization Calculation Engine (DynaMICE), to assess the effects of different vaccination strategies on measles susceptibility and burden during 2000-20 in 14 countries with high measles incidence (containing 53% of the global birth cohort and 78% of the global measles burden). Country-specific routine MCV1 and MCV2 coverage data during 1980-2020 were obtained from the WHO and UNICEF Estimates of National Immunization Coverage database for all modelled countries and SIA data were obtained from the WHO summary of measles and rubella SIAs. We estimated the incremental health effects of different vaccination strategies using prevented cases of measles and deaths from measles and their efficiency using the incremental number needed to vaccinate (NNV) to prevent an additional measles case. FINDINGS: Compared with no vaccination, MCV1 implementation was estimated to have prevented 824 million cases of measles and 9·6 million deaths from measles, with a median NNV of 1·41 (IQR 1·35-1·44). Adding routine MCV2 to MCV1 was estimated to have prevented 108 million cases and 404 270 deaths, whereas adding SIAs to MCV1 was estimated to have prevented 256 million cases and 4·4 million deaths. Despite larger incremental effects, adding SIAs to MCV1 (median incremental NNV 6·02, 5·30-7·68) showed reduced efficiency compared with adding routine MCV2 (5·41, 4·76-6·11). INTERPRETATION: Vaccination strategies, including non-selective SIAs, reach a greater proportion of children who are unvaccinated and reduce measles burden more than MCV2 alone, but efficiency is lower because of the wide age range targeted by SIAs. This analysis provides information to help improve the health effects and efficiency of measles vaccination strategies. The interplay between MCV1, MCV2, and SIAs should be considered when planning future measles vaccination strategies. FUNDING: Gavi, the Vaccine Alliance and the Bill & Melinda Gates Foundation.

Comparison of measles IgG enzyme immunoassays (EIA) versus plaque reduction neutralization test (PRNT) for measuring measles serostatus: a systematic review of head-to-head analyses of measles IgG EIA and PRNT.

BACKGROUND: As countries move towards or achieve measles elimination status, serosurveillance is an important public health tool. However, a major challenge of serosurveillance is finding a feasible, accurate, cost-effective, and high throughput assay to measure measles antibody concentrations and estimate susceptibility in a population. We conducted a systematic review to assess, characterize, and - to the extent possible - quantify the performance of measles IgG enzyme-linked assays (EIAs) compared to the gold standard, plaque reduction neutralization tests (PRNT). METHODS: We followed the PRISMA statement for a systematic literature search and methods for conducting and reporting systematic reviews and meta-analyses recommended by the Cochrane Screening and Diagnostic Tests Methods Group. We identified studies through PubMed and Embase electronic databases and included serologic studies detecting measles virus IgG antibodies among participants of any age from the same source population that reported an index (any EIA or multiple bead-based assays, MBA) and reference test (PRNT) using sera, whole blood, or plasma. Measures of diagnostic accuracy with 95% confidence intervals (CI) were abstracted for each study result, where reported. RESULTS: We identified 550 unique publications and identified 36 eligible studies for analysis. We classified studies as high, medium, or low quality; results from high quality studies are reported. Because most high quality studies used the Siemens Enzygnost EIA kit, we generate individual and pooled diagnostic accuracy estimates for this assay separately. Median sensitivity of the Enzygnost EIA was 92.1% [IQR = 82.3, 95.7]; median specificity was 96.9 [93.0, 100.0]. Pooled sensitivity and specificity from studies using the Enzygnost kit were 91.6 (95%CI: 80.7,96.6) and 96.0 (95%CI: 90.9,98.3), respectively. The sensitivity of all other EIA kits across high quality studies ranged from 0% to 98.9% with median (IQR) = 90.6 [86.6, 95.2]; specificity ranged from 58.8% to 100.0% with median (IQR) = 100.0 [88.7, 100.0]. CONCLUSIONS: Evidence on the diagnostic accuracy of currently available measles IgG EIAs is variable, insufficient, and may not be fit for purpose for serosurveillance goals. Additional studies evaluating the diagnostic accuracy of measles EIAs, including MBAs, should be conducted among diverse populations and settings (e.g., vaccination status, elimination/endemic status, age groups).

Mapping the distribution of zero-dose children to assess the performance of vaccine delivery strategies and their relationships with measles incidence in Nigeria.

Geographically precise identification and targeting of populations at risk of vaccine-preventable diseases has gained renewed attention within the global health community over the last few years. District level estimates of vaccination coverage and corresponding zero-dose prevalence constitute a potentially useful evidence base to evaluate the performance of vaccination strategies. These estimates are also valuable for identifying missed communities, hence enabling targeted interventions and better resource allocation. Here, we fit Bayesian geostatistical models to map the routine coverage of the first doses of diphtheria-tetanus-pertussis vaccine (DTP1) and measles-containing vaccine (MCV1) and corresponding zero-dose estimates in Nigeria at 1x1 km resolution and the district level using geospatial data sets. We also map MCV1 coverage before and after the 2019 measles vaccination campaign in the northern states to further explore variations in routine vaccine coverage and to evaluate the effectiveness of both routine immunization (RI) and campaigns in reaching zero-dose children. Additionally, we map the spatial distributions of reported measles cases during 2018 to 2020 and explore their relationships with MCV zero-dose prevalence to highlight the public health implications of varying performance of vaccination strategies across the country. Our analysis revealed strong similarities between the spatial distributions of DTP and MCV zero dose prevalence, with districts with the highest prevalence concentrated mostly in the northwest and the northeast, but also in other areas such as Lagos state and the Federal Capital Territory. Although the 2019 campaign reduced MCV zero-dose prevalence substantially in the north, pockets of vulnerabilities remained in areas that had among the highest prevalence prior to the campaign. Importantly, we found strong correlations between measles case counts and MCV RI zero-dose estimates, which provides a strong indication that measles incidence in the country is mostly affected by RI coverage. Our analyses reveal an urgent and highly significant need to strengthen the country's RI program as a longer-term measure for disease control, whilst ensuring effective campaigns in the short term.

Multilevel analysis of predictors of multiple indicators of childhood vaccination in Nigeria.

BACKGROUND: Substantial inequalities exist in childhood vaccination coverage levels. To increase vaccine uptake, factors that predict vaccination coverage in children should be identified and addressed. METHODS: Using data from the 2018 Nigeria Demographic and Health Survey and geospatial data sets, we fitted Bayesian multilevel binomial and multinomial logistic regression models to analyse independent predictors of three vaccination outcomes: receipt of the first dose of Pentavalent vaccine (containing diphtheria-tetanus-pertussis, Hemophilus influenzae type B and Hepatitis B vaccines) (PENTA1) (n = 6059) and receipt of the third dose having received the first (PENTA3/1) (n = 3937) in children aged 12-23 months, and receipt of measles vaccine (MV) (n = 11839) among children aged 12-35 months. RESULTS: Factors associated with vaccination were broadly similar for documented versus recall evidence of vaccination. Based on any evidence of vaccination, we found that health card/document ownership, receipt of vitamin A and maternal educational level were significantly associated with each outcome. Although the coverage of each vaccine dose was higher in urban than rural areas, urban residence was not significant in multivariable analyses that included travel time. Indicators relating to socio-economic status, as well as ethnic group, skilled birth attendance, lower travel time to the nearest health facility and problems seeking health care were significantly associated with both PENTA1 and MV. Maternal religion was related to PENTA1 and PENTA3/1 and maternal age related to MV and PENTA3/1; other significant variables were associated with one outcome each. Substantial residual community level variances in different strata were observed in the fitted models for each outcome. CONCLUSION: Our analysis has highlighted socio-demographic and health care access factors that affect not only beginning but completing the vaccination series in Nigeria. Other factors not measured by the DHS such as health service quality and community attitudes should also be investigated and addressed to tackle inequities in coverage.

Using Household Surveys to Assess Missed Opportunities for Simultaneous Vaccination: Longitudinal Examples from Colombia and Nigeria.

One important strategy to increase vaccination coverage is to minimize missed opportunities for vaccination. Missed opportunities for simultaneous vaccination (MOSV) occur when a child receives one or more vaccines but not all those for which they are eligible at a given visit. Household surveys that record children's vaccination dates can be used to quantify occurrence of MOSVs and their impact on achievable vaccination coverage. We recently automated some MOSV analyses in the World Health Organization's freely available software: Vaccination Coverage Quality Indicators (VCQI) making it straightforward to study MOSVs for any Demographic & Health Survey (DHS), Multi-Indicator Cluster Survey (MICS), or Expanded Programme on Immunization (EPI) survey. This paper uses VCQI to analyze MOSVs for basic vaccine doses among children aged 12-23 months in four rounds of DHS in Colombia (1995, 2000, 2005, and 2010) and five rounds of DHS in Nigeria (1999, 2003, 2008, 2013, and 2018). Outcomes include percent of vaccination visits MOSVs occurred, percent of children who experienced MOSVs, percent of MOSVs that remained uncorrected (that is, the missed vaccine had still not been received at the time of the survey), and the distribution of time-to-correction for children who received the MOSV dose at a later visit.

Correction: Implementing WHO guidance on conducting and analysing vaccination coverage cluster surveys: Two examples from Nigeria.

[This corrects the article DOI: 10.1371/journal.pone.0247415.].

Geospatial variation in measles vaccine coverage through routine and campaign strategies in Nigeria: Analysis of recent household surveys.

Measles vaccination campaigns are conducted regularly in many low- and middle-income countries to boost measles control efforts and accelerate progress towards elimination. National and sometimes first-level administrative division campaign coverage may be estimated through post-campaign coverage surveys (PCCS). However, these large-area estimates mask significant geographic inequities in coverage at more granular levels. Here, we undertake a geospatial analysis of the Nigeria 2017-18 PCCS data to produce coverage estimates at 1 × 1 km resolution and the district level using binomial spatial regression models built on a suite of geospatial covariates and implemented in a Bayesian framework via the INLA-SPDE approach. We investigate the individual and combined performance of the campaign and routine immunization (RI) by mapping various indicators of coverage for children aged 9-59 months. Additionally, we compare estimated coverage before the campaign at 1 × 1 km and the district level with predicted coverage maps produced using other surveys conducted in 2013 and 2016-17. Coverage during the campaign was generally higher and more homogeneous than RI coverage but geospatial differences in the campaign's reach of previously unvaccinated children are shown. Persistent areas of low coverage highlight the need for improved RI performance. The results can help to guide the conduct of future campaigns, improve vaccination monitoring and measles elimination efforts. Moreover, the approaches used here can be readily extended to other countries.

Mapping vaccination coverage to explore the effects of delivery mechanisms and inform vaccination strategies.

The success of vaccination programs depends largely on the mechanisms used in vaccine delivery. National immunization programs offer childhood vaccines through fixed and outreach services within the health system and often, additional supplementary immunization activities (SIAs) are undertaken to fill gaps and boost coverage. Here, we map predicted coverage at 1 × 1 km spatial resolution in five low- and middle-income countries to identify areas that are under-vaccinated via each delivery method using Demographic and Health Surveys data. We compare estimates of the coverage of the third dose of diphtheria-tetanus-pertussis-containing vaccine (DTP3), which is typically delivered through routine immunization (RI), with those of measles-containing vaccine (MCV) for which SIAs are also undertaken. We find that SIAs have boosted MCV coverage in some places, but not in others, particularly where RI had been deficient, as depicted by DTP coverage. The modelling approaches outlined here can help to guide geographical prioritization and strategy design.

Collecting and using reliable vaccination coverage survey estimates: Summary and recommendations from the "Meeting to share lessons learnt from the roll-out of the updated WHO Vaccination Coverage Cluster Survey Reference Manual and to set an operational research agenda around vaccination coverage surveys", Geneva, 18-21 April 2017.

Household surveys are frequently used as means of vaccination coverage measurement, but obtaining accurate survey estimates present several challenges. In 2015, the World Health Organization (WHO) released a working draft of its updated Vaccination Coverage Survey Reference Manual that moved well beyond the traditional Expanded Program on Immunization (EPI) survey design. In April 2017, WHO convened a four-day meeting, to review lessons learned using the updated manual and to define an agenda for operational research about vaccination coverage surveys. About 70 stakeholders, including EPI managers and participants from 10 countries that have used the updated Survey Manual, survey experts, statisticians, partners, representatives from WHO regional offices and headquarters, and providers of technical assistance discussed methodological issues from sampling to accurately ascertaining a person's vaccination status, optimizing data collection and data management and conducting appropriate analyses. Participants also discussed data sharing and how to best survey data for immunization decision-making. The lessons learned from the use of the updated WHO Survey Manual related mainly to operational issues to implement better quality vaccination coverage surveys. It resulted in a list of 23 recommendations for WHO, donors and partners, immunization programs, and household surveys that collect immunization data. Similarly, 14 research topics, categorized in six themes (overall survey conduction, sampling, vaccination ascertainment, data collection, data analysis and use, and inclusion of questions on knowledge, attitudes and practices) were prioritized. Top areas of further work included improving our understanding of the accuracy of caregiver recall when documented evidence of vaccination is not available, improving engagement and coordination between immunization programs and entities conducting multi-purpose household surveys such as Demographic and Health Survey and Multiple Cluster Indicator Survey, improving mechanisms for sharing vaccination survey datasets and documentation, and making better use of survey results to translate data into knowledge for decision-making. This manuscript summarizes the meeting proceedings and provides an update of actions taken by WHO since this meeting.

Benefits and Challenges in Using Seroprevalence Data to Inform Models for Measles and Rubella Elimination.

Background: Control efforts for measles and rubella are intensifying globally. It becomes increasingly important to identify and reach remaining susceptible populations as elimination is approached. Methods: Serological surveys for measles and rubella can potentially measure susceptibility directly, but their use remains rare. In this study, using simulations, we outline key subtleties in interpretation associated with the dynamic context of age-specific immunity, highlighting how the patterns of immunity predicted from disease surveillance and vaccination coverage data may be misleading. Results: High-quality representative serosurveys could provide a more accurate assessment of immunity if challenges of conducting, analyzing, and interpreting them are overcome. We frame the core disease control and elimination questions that could be addressed by improved serological tools, discussing challenges and suggesting approaches to increase the feasibility and sustainability of the tool. Conclusions: Accounting for the dynamical context, serosurveys could play a key role in efforts to achieve and sustain elimination.

Impact on Epidemic Measles of Vaccination Campaigns Triggered by Disease Outbreaks or Serosurveys: A Modeling Study.

BACKGROUND: Routine vaccination supplemented by planned campaigns occurring at 2-5 y intervals is the core of current measles control and elimination efforts. Yet, large, unexpected outbreaks still occur, even when control measures appear effective. Supplementing these activities with mass vaccination campaigns triggered when low levels of measles immunity are observed in a sample of the population (i.e., serosurveys) or incident measles cases occur may provide a way to limit the size of outbreaks. METHODS AND FINDINGS: Measles incidence was simulated using stochastic age-structured epidemic models in settings conducive to high or low measles incidence, roughly reflecting demographic contexts and measles vaccination coverage of four heterogeneous countries: Nepal, Niger, Yemen, and Zambia. Uncertainty in underlying vaccination rates was modeled. Scenarios with case- or serosurvey-triggered campaigns reaching 20% of the susceptible population were compared to scenarios without triggered campaigns. The best performing of the tested case-triggered campaigns prevent an average of 28,613 (95% CI 25,722-31,505) cases over 15 y in our highest incidence setting and 599 (95% CI 464-735) cases in the lowest incidence setting. Serosurvey-triggered campaigns can prevent 89,173 (95% CI, 86,768-91,577) and 744 (612-876) cases, respectively, but are triggered yearly in high-incidence settings. Triggered campaigns reduce the highest cumulative incidence seen in simulations by up to 80%. While the scenarios considered in this strategic modeling exercise are reflective of real populations, the exact quantitative interpretation of the results is limited by the simplifications in country structure, vaccination policy, and surveillance system performance. Careful investigation into the cost-effectiveness in different contexts would be essential before moving forward with implementation. CONCLUSIONS: Serologically triggered campaigns could help prevent severe epidemics in the face of epidemiological and vaccination uncertainty. Hence, small-scale serology may serve as the basis for effective adaptive public health strategies, although, in high-incidence settings, case-triggered approaches are likely more efficient.

Monitoring vaccination coverage: Defining the role of surveys.

Vaccination coverage is a widely used indicator of programme performance, measured by registries, routine administrative reports or household surveys. Because the population denominator and the reported number of vaccinations used in administrative estimates are often inaccurate, survey data are often considered to be more reliable. Many countries obtain survey data on vaccination coverage every 3-5years from large-scale multi-purpose survey programs. Additional surveys may be needed to evaluate coverage in Supplemental Immunization Activities such as measles or polio campaigns, or after major changes have occurred in the vaccination programme or its context. When a coverage survey is undertaken, rigorous statistical principles and field protocols should be followed to avoid selection bias and information bias. This requires substantial time, expertise and resources hence the role of vaccination coverage surveys in programme monitoring needs to be carefully defined. At times, programmatic monitoring may be more appropriate and provides data to guide program improvement. Practical field methods such as health facility-based assessments can evaluate multiple aspects of service provision, costs, coverage (among clinic attendees) and data quality. Similarly, purposeful sampling or censuses of specific populations can help local health workers evaluate their own performance and understand community attitudes, without trying to claim that the results are representative of the entire population. Administrative reports enable programme managers to do real-time monitoring, investigate potential problems and take timely remedial action, thus improvement of administrative estimates is of high priority. Most importantly, investment in collecting data needs to be complemented by investment in acting on results to improve performance.

Seroepidemiology: an underused tool for designing and monitoring vaccination programmes in low- and middle-income countries.

Seroepidemiology, the use of data on the prevalence of bio-markers of infection or vaccination, is a potentially powerful tool to understand the epidemiology of infection before vaccination and to monitor the effectiveness of vaccination programmes. Global and national burden of disease estimates for hepatitis B and rubella are based almost exclusively on serological data. Seroepidemiology has helped in the design of measles, poliomyelitis and rubella elimination programmes, by informing estimates of the required population immunity thresholds for elimination. It contributes to monitoring of these programmes by identifying population immunity gaps and evaluating the effectiveness of vaccination campaigns. Seroepidemiological data have also helped to identify contributing factors to resurgences of diphtheria, Haemophilus Influenzae type B and pertussis. When there is no confounding by antibodies induced by natural infection (as is the case for tetanus and hepatitis B vaccines), seroprevalence data provide a composite picture of vaccination coverage and effectiveness, although they cannot reliably indicate the number of doses of vaccine received. Despite these potential uses, technological, time and cost constraints have limited the widespread application of this tool in low-income countries. The use of venous blood samples makes it difficult to obtain high participation rates in surveys, but the performance of assays based on less invasive samples such as dried blood spots or oral fluid has varied greatly. Waning antibody levels after vaccination may mean that seroprevalence underestimates immunity. This, together with variation in assay sensitivity and specificity and the common need to take account of antibody induced by natural infection, means that relatively sophisticated statistical analysis of data is required. Nonetheless, advances in assays on minimally invasive samples may enhance the feasibility of including serology in large survey programmes in low-income countries. In this paper, we review the potential uses of seroepidemiology to improve vaccination policymaking and programme monitoring and discuss what is needed to broaden the use of this tool in low- and middle-income countries.

Using Seroprevalence and Immunisation Coverage Data to Estimate the Global Burden of Congenital Rubella Syndrome, 1996-2010: A Systematic Review.

BACKGROUND: The burden of Congenital Rubella Syndrome (CRS) is typically underestimated in routine surveillance. Updated estimates are needed following the recent WHO position paper on rubella and recent GAVI initiatives, funding rubella vaccination in eligible countries. Previous estimates considered the year 1996 and only 78 (developing) countries. METHODS: We reviewed the literature to identify rubella seroprevalence studies conducted before countries introduced rubella-containing vaccination (RCV). These data and the estimated vaccination coverage in the routine schedule and mass campaigns were incorporated in mathematical models to estimate the CRS incidence in 1996 and 2000-2010 for each country, region and globally. RESULTS: The estimated CRS decreased in the three regions (Americas, Europe and Eastern Mediterranean) which had introduced widespread RCV by 2010, reaching <2 per 100,000 live births (the Americas and Europe) and 25 (95% CI 4-61) per 100,000 live births (the Eastern Mediterranean). The estimated incidence in 2010 ranged from 90 (95% CI: 46-195) in the Western Pacific, excluding China, to 116 (95% CI: 56-235) and 121 (95% CI: 31-238) per 100,000 live births in Africa and SE Asia respectively. Highest numbers of cases were predicted in Africa (39,000, 95% CI: 18,000-80,000) and SE Asia (49,000, 95% CI: 11,000-97,000). In 2010, 105,000 (95% CI: 54,000-158,000) CRS cases were estimated globally, compared to 119,000 (95% CI: 72,000-169,000) in 1996. CONCLUSIONS: Whilst falling dramatically in the Americas, Europe and the Eastern Mediterranean after vaccination, the estimated CRS incidence remains high elsewhere. Well-conducted seroprevalence studies can help to improve the reliability of these estimates and monitor the impact of rubella vaccination.

Measles elimination: progress, challenges and implications for rubella control.

Measles and rubella are major vaccine-preventable causes of child mortality and disability. They have been eliminated from the Americas and some other regions have also come close to elimination. In this paper, we review regional progress toward measles and rubella control/elimination goals, describe the recent epidemiology of these infections and discuss challenges to achieving the goals. Globally, measles vaccination is estimated to prevent nearly 2 million deaths each year. Despite this remarkable progress, large measles outbreaks have occurred in recent years, often involving older persons who were not vaccinated in earlier years. Such an occurrence would be particularly damaging for rubella control programmes as it could lead to peaks in congenital rubella syndrome. Challenges to achieving and sustaining high vaccination coverage include civil conflict, weak health systems, geographic, cultural and economic barriers to reaching certain population groups and inadequate monitoring and use of data for action. Countries and regions aiming to eliminate measles and control rubella urgently need to improve the implementation and monitoring of both routine and mass vaccination campaign strategies.