An evaluation of the cost of human papilloma virus (HPV) vaccine delivery in Zambia.

BACKGROUND: Human papillomavirus (HPV) is a common sexually transmitted infection and the leading cause of cervical cancer. The HPV vaccine is a safe and effective way to prevent HPV infection. In Zambia, the vaccine is given during Child Health Week to girls aged 14 years who are in and out of school in two doses over two years. The focus of this evaluation was to establish the cost to administer a single dose of the vaccine as well as for full immunisation of two doses. METHODS: This work was part of a broader study on assessing HPV programme implementation in Zambia. For HPV costing aspect of the study, with a healthcare provider perspective and reference year of 2020, both top-down and micro-costing approaches were used for financial costing, depending on the cost data source, and economic costs were gathered as secondary data from Expanded Programme for Immunisation Costing and Financing Project (EPIC), except human resource costs which were gathered as primary data using existing Ministry of Health salary scales and reported time spent by different health cadres on activities related to HPV vaccination. Data was collected from eight districts in four provinces, mainly using a structured questionnaire, document reviews and key informant interviews with staff at national, provincial, district and health facility levels. Administrative coverage rates were obtained for each district. RESULTS: Findings show that schools made up 53.3% of vaccination sites, community outreach sites 30.9% and finally health facilities 15.8%. In terms of coverage for 2020, for the eight districts sampled, schools had the highest coverage at 96.0%. Community outreach sites were at 6.0% of the coverage and health facilities accounted for only 1.0% of the coverage. School based delivery had the lowest economic cost at USD13.2 per dose and USD 28.1 per fully immunised child (FIC). Overall financial costs for school based delivery were US$6.0 per dose and US$12.4 per FIC. Overall economic costs taking all delivery models into account were US$23.0 per dose and US$47.6 per FIC. The main financial cost drivers were microplanning, supplies, service delivery/outreach and vaccine co-financing; while the main economic cost drivers were human resources, building overhead and vehicles. Nurses, environmental health technicians and community-based volunteers spent the most time on HPV related vaccination activities compared to other cadres and represented the greatest human resource costs. CONCLUSIONS: The financial cost of HPV vaccination in Zambia aligns favourably with similar studies conducted in other countries. However, the economic costs appear significantly higher than those observed in most international studies. This discrepancy underscores the substantial strain placed on healthcare resources by the program, a burden that often remains obscured. While the vaccine costs are currently subsidized through the generous support of Gavi, the Vaccine Alliance, it's crucial to recognize that these expenses pose a considerable threat to long-term sustainability. Consequently, countries such as Zambia must proactively devise strategies to address this challenge.

Uganda's increasing dependence on development partner's support for immunization - a five year resource tracking study (2012 - 2016).

BACKGROUND: In Uganda, there are persistent weaknesses in obtaining accurate, reliable and complete data on local and external investments in immunization to guide planning, financing, and resource mobilization. This study aimed to measure and describe the financial envelope for immunization from 2012 to 2016 and analyze expenditures at sub-national level. METHODS: The Systems of Health Accounts (SHA) 2011 methodology was used to quantify and map the resource envelope for immunization. Data was collected at national and sub-national levels from public and external sources of immunization. Data were coded, categorized and disaggregated by expenditure on immunization activities using the SHA 2011. RESULTS: Over the five-year period, funding for immunization increased fourfold from US$20.4 million in 2012 to US$ 85.6 million in 2016. The Ugandan government was the main contributor (55%) to immunization resources from 2012 to 2014 however, Gavi, the Vaccine Alliance contributed the majority (59%) of the resources to immunization in 2015 and 2016. Majority (66%) of the funds were managed by the National Medical Stores. Over the five-year period, 80% of the funds allocated to immunization activities were spent on facility based routine immunization (expenditure on human resources and outreaches). At sub-national level, districts allocated 15% of their total annual resources to immunization to support supervision of lower health facilities and distribution of vaccines. Health facilities spent 5.5% of their total annual resources on immunization to support outreaches. CONCLUSION: Development partner support has aided the improvement of vaccine coverage and increased access to vaccines however, there is an increasing dependence on this support for a critical national program raising sustainability concerns alongside other challenges like being off-budget and unpredictable. To ensure financial sustainability, there is need to operationalize the immunization fund, advocate and mobilize additional resources for immunization from the Government of Uganda and the private sector, increase the reliability of resources for immunization as well as leverage on health financing reforms like the National Health Insurance.

Small area estimation of under-5 mortality in Bangladesh, Cameroon, Chad, Mozambique, Uganda, and Zambia using spatially misaligned data.

BACKGROUND: The under-5 mortality rate (U5MR) is an important metric of child health and survival. Country-level estimates of U5MR are readily available, but efforts to estimate U5MR subnationally have been limited, in part, due to spatial misalignment of available data sources (e.g., use of different administrative levels, or as a result of historical boundary changes). METHODS: We analyzed all available complete and summary birth history data in surveys and censuses in six countries (Bangladesh, Cameroon, Chad, Mozambique, Uganda, and Zambia) at the finest geographic level available in each data source. We then developed small area estimation models capable of incorporating spatially misaligned data. These small area estimation models were applied to the birth history data in order to estimate trends in U5MR from 1980 to 2015 at the second administrative level in Cameroon, Chad, Mozambique, Uganda, and Zambia and at the third administrative level in Bangladesh. RESULTS: We found substantial variation in U5MR in all six countries: there was more than a two-fold difference in U5MR between the area with the highest rate and the area with the lowest rate in every country. All areas in all countries experienced declines in U5MR between 1980 and 2015, but the degree varied both within and between countries. In Cameroon, Chad, Mozambique, and Zambia we found areas with U5MRs in 2015 that were higher than in other parts of the same country in 1980. Comparing subnational U5MR to country-level targets for the Millennium Development Goals (MDG), we find that 12.8% of areas in Bangladesh did not meet the country-level target, although the country as whole did. A minority of areas in Chad, Mozambique, Uganda, and Zambia met the country-level MDG targets while these countries as a whole did not. CONCLUSIONS: Subnational estimates of U5MR reveal significant within-country variation. These estimates could be used for identifying high-need areas and positive deviants, tracking trends in geographic inequalities, and evaluating progress towards international development targets such as the Sustainable Development Goals.

Fiscal space for the immunisation program in Zambia- an efficiency analysis approach.

OBJECTIVE: The immunisation programme in Zambia remains one of the most effective public health programmes. Its financial sustainability is, however, uncertain. Using administrative data on immunisation coverage rate, vaccine utilisation, the number of health facilities and human resources, expenditure on health promotion, and the provision of outreach services from 24 districts, we used Data Envelopment Analysis to determine the level of technical efficiency in the provision of immunisation services. Based on our calculated levels of technical efficiency, we determined the available fiscal space for immunisation. RESULTS: Out of the 24 districts in our sample, 9 (38%) were technically inefficient in the provision of immunisation services. The average efficiency score, however, was quite high, at 0.92 (CRS technology) and 0.95 (VRS technology). Based on the calculated level of technical efficiency, we estimated that an improvement in technical efficiency can save enough vaccine doses to supply between 5 and 14 additional districts. The challenge, however, lies in identifying and correcting for the sources of technical inefficiency.

An Evaluation of the Cost of Human Papilloma Virus (HPV) Vaccine Delivery In Zambia.

Background: Human papillomavirus (HPV) is a common sexually transmitted infection and the leading cause of cervical cancer. The HPV vaccine is a safe and effective way to prevent HPV infection. In Zambia, the vaccine is given during Child Health to girls aged 14 years who are in and out of school in two doses over two years. The focus of this evaluation was to establish the cost to administer a single dose of the vaccine well as for full immunisation of two doses. Methods: For HPV costing, both top-down and micro-costing approaches were used, depending on the cost data source, and economic costs were gathered from Expanded Programme for Immunisation Costing and Financing Project (EPIC). Data was collected from eight districts in four provinces, mainly using a structured questionnaire, document reviews and key informant interviews with staff at national, district and provincial levels. Results: Findings show that schools made up 53.3% of vaccination sites, community outreach sites 30.9% and finally health facilities 15.8%. In terms of coverage for 2020, for the eight districts sampled, schools had the highest coverage at 96.0%. Community outreach sites were at 6.0% of the coverage and health facilities accounted for only 1.0% of the coverage. School based delivery had the lowest cost economic cost at USD13.2 per dose and USD 26.4 per fully immunised child (FIC). Overall financial costs were US$6.0 per dose and US$11.9 per fully immunised child. Overall economic costs taking all delivery models into account were US$23.0 per dose and US$46.0 per FIC. The main cost drivers were human resources, building overhead and vehicles, microplanning, supplies and service delivery/outreach. were the top cost drivers. Nurses, environmental health technicians and community-based volunteers were the most involved in HPV vaccination. Conclusions: Future planning in Zambia and other African countries conducting HPV vaccination needs to prioritise these cost drivers as well as possibly find strategies to minimise some costs. Although not a challenge now due to Gavi support, vaccine costs are a major threat to sustainability in the long run. Countries like Zambia must find strategies to mitigate against this.

Evaluating the functionality and effectiveness of ZITAG and related expanded programme on immunisation technical committees in Zambia.

The Zambia Immunisation Technical Advisory Group (ZITAG) was established in 2016 as an advisory body to provide evidence-based recommendations on vaccine policy. As part of the Gave Full Country Evaluation, we evaluated the functionality and effectiveness of ZITAG and related EPI committees through an online stakeholder survey of Interagnecy Coordinating Committee (ICC), ZITAG and Extended programme on Immunisation Technical Working Group (EPI-TWG) members, document review and key informant interviews. The survey was sent out via SurveyMonkey between May and July 2020 to 69 members of ZITAG, ICC or the EPI TWG. A total of 52 individuals responded (75%). Eight key informant interviews were also carried out at the national and global level in September 2020 to elaborate further on some of the quantitative findings and for triangulation. Findingsrevealed that the EPI committees were reasonably functional and effective entities, each with its unique role, though some overlaps occurred. Functionality was shown by having a broad membership with wide expertise and long-serving members; sub-committees existed and meetings were occurring regularly. Leadership and coordination structures also existed and were largely felt to be working well. Funding challenges however persisted, in particular for ZITAG operations and functionality of its subcommittees. Effectiveness and value addition fo the committees to the EPI was illustrated through decision-making processes and evidence use as well as relatively good country ownership in terms of commitment, legitimacy, capacity and accountability. Full independence and ownership may however be compromised by funding challenges. Recent changes to ICC terms of reference and focus beyond immunisation side-lined the EPI and weakened the linkage between ICC and ZITAG with many ZITAG recommendations not having been followed through by ICC as the ultimate endorsing entity.

Lessons Learned From Implementing Prospective, Multicountry Mixed-Methods Evaluations for Gavi and the Global Fund.

INTRODUCTION: As global health programs have become increasingly complex, corresponding evaluations must be designed to assess the full complexity of these programs. Gavi and the Global Fund have commissioned 2 such evaluations to assess the full spectrum of their investments using a prospective mixed-methods approach. We aim to describe lessons learned from implementing these evaluations. METHODS: This article presents a synthesis of lessons learned based on the Gavi and Global Fund prospective mixed-methods evaluations, with each evaluation considered a case study. The lessons are based on the evaluation team's experience from over 7 years (2013-2020) implementing these evaluations. The Centers for Disease Control and Prevention Framework for Evaluation in Public Health was used to ground the identification of lessons learned. RESULTS: We identified 5 lessons learned that build on existing evaluation best practices and include a mix of practical and conceptual considerations. The lessons cover the importance of (1) including an inception phase to engage stakeholders and inform a relevant, useful evaluation design; (2) aligning on the degree to which the evaluation is embedded in the program implementation; (3) monitoring programmatic, organizational, or contextual changes and adapting the evaluation accordingly; (4) hiring evaluators with mixed-methods expertise and using tools and approaches that facilitate mixing methods; and (5) contextualizing recommendations and clearly communicating their underlying strength of evidence. CONCLUSION: Global health initiatives, particularly those leveraging complex interventions, should consider embedding evaluations to understand how and why the programs are working. These initiatives can learn from the lessons presented here to inform the design and implementation of such evaluations.

How to evaluate the implementation of complex health programmes in low-income settings: the approach of the Gavi Full Country Evaluations.

Vaccination, like most other public health services, relies on a complex package of intervention components, functioning systems and committed actors to achieve universal coverage. Despite significant investment in immunization programmes, national coverage trends have slowed and equity gaps have grown. This paper describes the design and implementation of the Gavi Full Country Evaluations, a multi-country, prospective, mixed-methods approach whose goal was to monitor and evaluate processes, inputs, outputs and outcomes of immunization programmes in Bangladesh, Mozambique, Uganda and Zambia. We implemented the Full Country Evaluations from 2013 to 2018 with the goal of identifying the drivers of immunization programme improvement to support programme implementation and increase equitable immunization coverage. The framework supported methodological and paradigmatic flexibility to respond to a broad range of evaluation and implementation research questions at global, national and cross-country levels, but was primarily underpinned by a focus on evaluating processes and identifying the root causes of implementation breakdowns. Process evaluation was driven by theories of change for each Gavi funding stream (e.g. Health Systems Strengthening) or activity, ranging from global policy development to district-level programme implementation. Mixing of methods increased in relevance and rigour over time as we learned to build multiple methods into increasingly tailored evaluation questions. Evaluation teams in country-based research institutes increasingly strengthened their level of embeddedness with immunization programmes as the emphasis shifted over time to focus more heavily on the use of findings for programme learning and adaptation. Based on our experiences implementing this approach, we recommend it for the evaluation of other complex interventions, health programmes or development assistance.

Evaluating Global Health Partnerships: A Case Study of a Gavi HPV Vaccine Application Process in Uganda.

BACKGROUND: Global health partnerships have grown rapidly in number and scope, yet there has been less emphasis on their evaluation. Gavi, the Vaccine Alliance, is one such public-private partnership; in Gavi-eligible countries partnerships are dynamic networks of immunization actors who work together to support all stages and aspects of Gavi support. This paper describes a conceptual framework - the partnership framework - and analytic approach for evaluating the perceptions of partnerships' added value as well as the results from an application to one case in Uganda. METHODS: We used a mixed-methods case study design embedded in the Gavi Full Country Evaluations (FCE) to test the partnership framework on Uganda's human papillomavirus (HPV) vaccine application partnership. Data from document review, interviews, and social network surveys enabled the testing of the relationships between partnership framework domains (context, structure, practices, performance, and outcomes). Topic guides were based on the framework domains and network surveys identified working together relationships, professional trust, and perceptions of the effectiveness, efficiency, and legitimacy of the partnership's role in this process. RESULTS: Data from seven in-depth interviews, 11 network surveys and document review were analyzed according to the partnership framework, confirming relationships between the framework domains. Trust was an important contributor to the perceived effectiveness of the process. The network was structured around the EPI program, who was considered the leader of this process. While the structure and composition of the network was largely viewed as supporting an effective and legitimate process, the absence of the Ministry of Education (MoE) may have had downstream consequences if this study's results had not been shared with the Ministry of Health (MoH) and acted upon. The partnership was not perceived to have increased the efficiency of the process, perhaps as a result of unclear or absent guidelines around roles and responsibilities. CONCLUSION: The health and functioning of global health partnerships can be evaluated using the framework and approach presented here. Network theory and methods added value to the conceptual and analytic processes and we recommend applying this approach to other global health partnerships to ensure that they are meeting the complex challenges they were designed to address.