Designing appropriate, acceptable and feasible community-engagement approaches to improve routine immunisation outcomes in low- and middle-income countries: A synthesis of 3ie-supported formative evaluations.

INTRODUCTION: As global child vaccination coverage has plateaued, understanding how to increase routine child vaccination rates further is key to avoiding preventable disease and death. To analyse how community engagement strategies can increase child vaccination, we synthesise the results from formative evaluations of interventions that aimed to increase vaccination coverage in Ethiopia, Myanmar, Nigeria, and Pakistan. METHODS: This paper uses an inductive qualitative approach to synthesise the results from the six evaluations, gathering lessons for designing context appropriate interventions that are feasible to implement and acceptable to providers, communities, and caregivers. RESULTS: Assessing contextual, caregiver-level and provider-level barriers to vaccination is key to identifying appropriate engagement strategies. Across all contexts, low knowledge about the schedule of vaccines and the importance of timeliness represented a barrier to child immunisation. Despite the variability in how studies measured and reported caregiver attitudes, vaccine hesitancy was not found to represent an important barrier to immunisation. Frontline health workers played a critical role in community engagement approaches to increase vaccination. Interventions successfully obtained community buy-in by centre-staging community members, especially leaders, ensuring their participation in monitoring, and making immunisation an agenda item on community platforms. Interventions were implemented through existing health systems with substantial assistance from research teams. Limited data was available about intervention costs. CONCLUSIONS: Interventions designed around community engagement strategies can be appropriate, acceptable, and feasible approaches to overcome barriers to vaccination in a variety of low- and middle-income country contexts. However, questions remain about the ability of health systems to implement interventions at scale, both from a cost perspective and a capacity perspective.

Improving routine childhood immunisation outcomes in low-income and middle-income countries: an evidence gap map.

OBJECTIVE: To support evidence-informed decision-making, we created an evidence gap map to characterise the evidence base on the effectiveness of interventions in improving routine childhood immunisation outcomes in low-income and middle-income countries (LMICs). METHODS: We developed an intervention-outcome matrix with 38 interventions and 43 outcomes. We searched academic databases and grey literature sources for relevant impact evaluations (IEs) and systematic reviews (SRs). Search results were screened on title/abstract. Those included on title/abstract were retrieved for full review. Studies meeting the eligibility criteria were included and data were extracted for each included study. All screening and data extraction was done by two independent reviewers. We analysed these data to identify trends in the geographic distribution of evidence, the concentration of evidence across intervention and outcome categories, and attention to vulnerable populations in the literature. RESULTS: We identified 309 studies, comprising 226 completed IEs, 58 completed SRs, 24 ongoing IEs and 1 ongoing SR. Evidence from IEs is heavily concentrated in a handful of countries in sub-Saharan Africa and South Asia. Among interventions, the most frequently evaluated are those related to education and material incentives for caregivers or health workers. There are gaps in the study of non-material incentives and outreach to vulnerable populations. Among outcomes, those related to vaccine coverage and health are well covered. However, evidence on intermediate outcomes related to health system capacity or barriers faced by caregivers is much more limited. CONCLUSIONS: There is valuable evidence available to decision-makers for use in identifying and deploying effective strategies to increase routine immunisation in LMICs. However, additional research is needed to address gaps in the evidence base.

Use of community engagement interventions to improve child immunisation in low-income and middle-income countries: a systematic review and meta-analysis.

OBJECTIVE: To support evidence informed decision-making, we systematically examine the effectiveness and cost-effectiveness of community engagement interventions on routine childhood immunisation outcomes in low-income and middle-income countries (LMICs) and identify contextual, design and implementation features associated with effectiveness. DESIGN: Mixed-methods systematic review and meta-analysis. DATA SOURCES: 21 databases of academic and grey literature and 12 additional websites were searched in May 2019 and May 2020. ELIGIBILITY CRITERIA FOR SELECTING STUDIES: We included experimental and quasi-experimental impact evaluations of community engagement interventions considering outcomes related to routine child immunisation in LMICs. No language, publication type, or date restrictions were imposed. DATA EXTRACTION AND SYNTHESIS: Two independent researchers extracted summary data from published reports and appraised quantitative risk of bias using adapted Cochrane tools. Random effects meta-analysis was used to examine effects on the primary outcome, full immunisation coverage. RESULTS: Our search identified over 43 000 studies and 61 were eligible for analysis. The average pooled effect of community engagement interventions on full immunisation coverage was standardised mean difference 0.14 (95% CI 0.06 to 0.23, I2=94.46). The most common source of risk to the quality of evidence (risk of bias) was outcome reporting bias: most studies used caregiver-reported measures of vaccinations received by a child in the absence or incompleteness of immunisation cards. Reasons consistently cited for intervention success include appropriate intervention design, including building in community engagement features; addressing common contextual barriers of immunisation and leveraging facilitators; and accounting for existing implementation constraints. The median intervention cost per treated child per vaccine dose (excluding the cost of vaccines) to increase absolute immunisation coverage by one percent was US$3.68. CONCLUSION: Community engagement interventions are successful in improving outcomes related to routine child immunisation. The findings are robust to exclusion of studies assessed as high risk of bias.

Use of community engagement interventions to improve child immunisation in low- and middle-income countries: A systematic review and meta-analysis.

Immunisation is one of the most cost-effective interventions to prevent and control life-threatening infectious diseases. Nonetheless, rates of routine vaccination of children in low- and middle-income countries (LMICs) are strikingly low or stagnant. In 2019, an estimated 19.7 million infants did not receive routine immunisations. Community engagement interventions are increasingly being emphasised in international and national policy frameworks as a means to improve immunisation coverage and reach marginalised communities. This systematic review examines the effectiveness and cost-effectiveness of community engagement interventions on outcomes related to childhood immunisation in LMICs and identifies contextual, design and implementation features that may be associated with effectiveness. We identified 61 quantitative and mixed methods impact evaluations and 47 associated qualitative studies related to community engagement interventions for inclusion in the reteview. For cost-effectiveness analysis 14 of the 61 studies had the needed combination of cost and effectiveness data. The 61 included impact evaluations were concentrated in South Asia and Sub-Saharan Africa and spread across 19 LMICs. The review found that community engagement interventions had a small but significant, positive effect on all primary immunisation outcomes related to coverage and their timeliness. The findings are robust to exclusion of studies assessed as high risk of bias. Qualitative evidence indicates appropriate intervention design, including building in community engagement features; addressing common contextual barriers of immunisation and leveraging facilitators; and accounting for existing implementation constraints and practicalities on the ground are consistently cited as reasons for intervention success. Among the studies for which we were able to calculate cost-effectiveness, we find that the median non-vaccine cost per dose of intervention to increase immunisation coverage by 1% was US $3.68. Given the broad scope of the review in terms of interventions and outcomes, there is significant variation in findings. Among the various types of community engagement interventions, those that involve creation of community buy-in or development of new cadres of community-based structures were found to have consistent positive effect on more primary vaccination coverage outcomes than if the engagement is limited to the design or delivery of an intervention or is a combination of the various types. The evidence base for sub-group analysis for female children was sparse (only two studies) and the effect on coverage of both full immunisation and third dose of diphtheria pertussis tetanus for this group was insignificant.