Design, Development, and Deployment of an Electronic Immunization Registry: Experiences From Vietnam, Tanzania, and Zambia.

INTRODUCTION: There is growing interest among low- and middle-income countries to introduce electronic immunization registries (EIRs) that capture individual-level vaccine data. We compare the design, development, and deployment of EIRs in Vietnam, Tanzania, and Zambia. Through desk review and the authors' firsthand implementation experiences, we describe experiences related to timeline, partnerships, financial costs, and technology and infrastructure. IMPLEMENTATION EXPERIENCE: The country cases highlight the multi-year timeline required to implement an EIR at scale and the benefit of multiple iterative cycles to pilot and redesign the system before achieving scale. Of the 3 countries, only Vietnam has achieved nationwide scale of the EIR, which took 7 years. In all 3 countries, national government leadership as part of an interdisciplinary team (with experience in leadership, technology, and immunization) was important to ensure country ownership and sustainability. Where international software developers were contracted, partnering with a local software company helped improve responsiveness and sustainability. Across all 3 countries, governments contributed significant in-kind time in addition to investments from donors. Cost savings were observed in Tanzania and Zambia, largely driven by health worker time savings from using the EIR. All 3 case countries underscore the need to understand the local technology and infrastructure context and design the EIR to fit the context. In Vietnam, an initial landscape assessment was conducted to assess technology and infrastructure, whereas in Tanzania and Zambia, user advisory groups provided insights. Existing infrastructure informed EIR design decisions, such as choosing a system with offline functionality in Tanzania and Zambia. All 3 countries have a local partner to provide ongoing technical support. CONCLUSION: Comparing implementation factors across these cases highlights practical experience and recommendations that complement existing EIR guidance documents. The findings and recommendations from this study can inform other countries considering or in the process of implementing an EIR.

Changes in on-time vaccination following the introduction of an electronic immunization registry, Tanzania 2016-2018: interrupted time-series analysis.

BACKGROUND: Digital health interventions (DHI) have the potential to improve the management and utilization of health information to optimize health care worker performance and provision of care. Despite the proliferation of DHI projects in low-and middle-income countries, few have been evaluated in an effort to understand their impact on health systems and health-related outcomes. Although more evidence is needed on their impact and effectiveness, the use of DHIs among immunization programs has become more widespread and shows promise for improving vaccination uptake and adherence to immunization schedules. METHODS: Our aim was to assess the impact of an electronic immunization registry (EIR) using an interrupted time-series analysis to analyze the effect on proportion of on-time vaccinations following introduction of an EIR in Tanzania. We hypothesized that the introduction of the EIR would lead to statistically significant changes in vaccination timeliness at 3, 6, and > 6 months post-introduction. RESULTS: For our primary analysis, we observed a decrease in the proportion of on-time vaccinations following EIR introduction. In contrast, our sensitivity analysis estimated improvements in timeliness among those children with complete vaccination records. However, we must emphasize caution interpreting these findings as they are likely affected by implementation challenges. CONCLUSIONS: This study highlights the complexities of using digitized individual-level routine health information system data for evaluation and research purposes. EIRs have the potential to improve vaccination timeliness, but analyses using EIR data can be complicated by data quality issues and inconsistent data entry leading to difficulties interpreting findings.

Reduction in Rubella Virus Active Cases among Children and Adolescents after Rubella Vaccine Implementation in Tanzania: A Call for Sustained High Vaccination Coverage.

Rubella virus (RV) infection in susceptible women during the first trimester of pregnancy is associated with congenital Rubella syndrome (CRS). In countries where a vaccination program is implemented, active case surveillance is emphasized. This report documents the magnitude of active cases before and after vaccine implementation in Tanzania. A total of 8750 children and adolescents with signs and symptoms of RV infection were tested for Rubella IgM antibodies between 2013 and 2019 using enzyme immunoassay followed by descriptive analysis. The median age of participants was 3.8 (IQR: 2−6.4) years. About half (4867; 55.6%) of the participants were aged 1−5 years. The prevalence of RV active cases was 534 (32.6%, 95% CI: 30.2−34.9) and 219 (3.2%, 95% CI: 2.7−3.6) before and after vaccine implementation, respectively. Before vaccination, the highest prevalence was recorded in Pemba (78.6%) and the lowest was reported in Geita (15.6%), whereas, after vaccination, the prevalence ranged between 0.5% in Iringa and 6.5% in Pemba. Overall, >50% of the regions had a >90% reduction in active cases. The significant reduction in active cases after vaccine implementation in Tanzania underscores the need to sustain high vaccination coverage to prevent active infections and eventually eliminate CRS, which is the main goal of Rubella vaccine implementation.

Domestic funding opportunities for Tanzania as five new Middle-Income countries brace for reduced Gavi support for immunization.

Vaccines have produced remarkable impact in reducing the global burden of disease. Thanks to Gavi-the Vaccine Alliance, which supports eligible countries to increase access to the new and underused vaccines. Gavi support depends on economic growth, whereby low-income countries contribute 0.2 USD per dose of supported vaccines, while middle-income countries contribute by price fraction that increases gradually by 15% annually. A country must become fully self-financing within five years when its economy reaches 1,630 USD GNI per capita. Recently, Tanzania, Benin, Haiti, Nepal, and Tajikistan became middle-income countries triggering gradual reduction in Gavi support. This paper first compares the socio-demographic characteristics, immunization program performance, and health financing strategies of these countries and second, explores domestic financing strategies that Tanzania can use to close the funding gap. Although the five countries are similar economically, they vary in demography, health financing strategies, extent of donor dependency, and strength of immunization programs. Some health indicators are not any better than those in low-income countries. Tanzania receives the largest financial support from Gavi and is projected to be fully self-financing by 2043. The potential domestic funding opportunities include to increase Government budget, use of innovative financing strategies, and health insurance, complemented with enhanced program efficiency.

Added Value of Electronic Immunization Registries in Low- and Middle-Income Countries: Observational Case Study in Tanzania.

BACKGROUND: There is growing interest and investment in electronic immunization registries (EIRs) in low- and middle-income countries. EIRs provide ready access to patient- and aggregate-level service delivery data that can be used to improve patient care, identify spatiotemporal trends in vaccination coverage and dropout, inform resource allocation and program operations, and target quality improvement measures. The Government of Tanzania introduced the Tanzania Immunization Registry (TImR) in 2017, and the system has since been rolled out in 3736 facilities in 15 regions. OBJECTIVE: The aims of this study are to conceptualize the additional ways in which EIRs can add value to immunization programs (beyond measuring vaccine coverage) and assess the potential value-add using EIR data from Tanzania as a case study. METHODS: This study comprised 2 sequential phases. First, a comprehensive list of ways EIRs can potentially add value to immunization programs was developed through stakeholder interviews. Second, the added value was evaluated using descriptive and regression analyses of TImR data for a prioritized subset of program needs. RESULTS: The analysis areas prioritized through stakeholder interviews were population movement, missed opportunities for vaccination (MOVs), continuum of care, and continuous quality improvement. The included TImR data comprised 958,870 visits for 559,542 patients from 2359 health facilities. Our analyses revealed that few patients sought care outside their assigned facility (44,733/810,568, 5.52% of applicable visits); however, this varied by region; facility urbanicity, type, ownership, patient volume, and duration of TImR system use; density of facilities in the immediate area; and patient age. Analyses further showed that MOVs were highest among children aged <12 months (215,576/831,018, 25.94% of visits included an MOV and were applicable visits); however, there were few significant differences based on other individual or facility characteristics. Nearly half (133,337/294,464, 45.28%) of the children aged 12 to 35 months were fully vaccinated or had received all doses except measles-containing vaccine-1 of the 14-dose under-12-month schedule (ie, through measles-containing vaccine-1), and facility and patient characteristics associated with dropout varied by vaccine. The continuous quality improvement analysis showed that most quality issues (eg, MOVs) were concentrated in <10% of facilities, indicating the potential for EIRs to target quality improvement efforts. CONCLUSIONS: EIRs have the potential to add value to immunization stakeholders at all levels of the health system. Individual-level electronic data can enable new analyses to understand service delivery or care-seeking patterns, potential risk factors for underimmunization, and where challenges occur. However, to achieve this potential, country programs need to leverage and strengthen the capacity to collect, analyze, interpret, and act on the data. As EIRs are introduced and scaled in low- and middle-income countries, implementers and researchers should continue to share real-world examples and build an evidence base for how EIRs can add value to immunization programs, particularly for innovative uses.

Vaccine storage and distribution between expanded program on immunization and medical store department in Tanzania: a cost-minimization analysis.

BACKGROUND: In 2016, the Tanzanian government shifted the vaccine supply chain responsibilities from the Medical Store Department (MSD) to the Expanded Program on Immunization (EPI) to reduce costs. However, cost estimates that informed the decision were based on invoice value of vaccines and related supplies, rather than a proper economic evaluation study. Therefore, this study aims to compare the actual storage and distribution costs of vaccines and related supplies between MSD to EPI. METHOD: Micro-costing approach was used to estimate resource use at MSD and EPI for the year 2018. Data were collected through a review of documents, warehouse databases, and interviews with key staff at MSD and EPI. We included both capital and recurrent costs. Microsoft Excel® was used for analysis with input data from the UNICEF forecasting tool, WHOs vaccine volume and capacity estimation tool, diesel generator calculator, and supply chain service fee estimator version 1.02. RESULTS: The total vaccine storage and distribution costs were estimated to be USD 1,996,286 at MSD and USD 543,648 at EPI. Distribution and program management costs represented 41% (USD 819,288) and 38% (USD 762,968) of the total costs at MSD, while storage and distribution costs represented 43% (USD 234,423) and 34% (USD 184,620) of the total costs at EPI, respectively. The cost drivers at MSD were fuel and transport (21%), receiving and dispatch (19%) and, program management personnel cost (14%), while at EPI were storage space (20%), program management personnel cost (18%) and fuel and transport (15%). CONCLUSION: The storage and distribution of vaccines in Tanzania via the EPI reduced the vaccine supply chain cost to about 27% of the program costs at MSD.

Determinants of Facility-Level Use of Electronic Immunization Registries in Tanzania and Zambia: An Observational Analysis.

BACKGROUND: As more countries transition from paper-based to electronic immunization registries (EIRs) to collect and track individual immunization data, guidance is needed for successful adoption and use of these systems. Little research is available on the determinants of EIR use soon after introduction. This observational study assesses the determinants of facility health care workers' use of new EIRs in Tanzania and Zambia, implemented during 2016 to 2018. METHODS: We used EIR data entered between 2016 and 2018 from 3 regions in Tanzania and 1 province in Zambia to measure weekly EIR system use for a total of 50,639 facility-weeks. We joined secondary data on facility characteristics and applied the Performance of Routine Information System Management framework to categorize characteristics as organizational, technical, or behavioral. We used a generalized estimating equations logistic regression model to assess facility characteristics as potential determinants of system use. RESULTS: In both countries, the estimated odds of weekly EIR use declined weekly after EIR introduction. In Tanzania, health centers and hospitals had increased odds of system use compared to dispensaries. For each additional health care worker trained in a facility during the EIR introduction, the estimated odds of weekly EIR use increased. Tanzanian facilities that had transitioned entirely to paperless reporting had higher odds of sustained use compared to those maintaining parallel electronic and paper-based reporting systems. In Zambia, distance from the district health office was significantly associated with decreasing odds of system use. There were significant differences in EIR use by district in both countries. DISCUSSION: The results highlight the importance of organizational and behavioral factors in explaining sustained EIR use. As EIRs are introduced in new settings, we recommend indicators of engagement and use be built directly into the system so they can be routinely monitored, and course corrections can be implemented as needed.

Perceptions of factors influencing the introduction and adoption of electronic immunization registries in Tanzania and Zambia: a mixed methods study.

BACKGROUND: As technology has become cheaper and more accessible, health programs are adopting digital health interventions (DHI) to improve the provision of and demand for health services. These interventions are complex and require strong coordination and support across different health system levels and government departments, and they need significant capacities in technology and information to be properly implemented. Electronic immunization registries (EIRs) are types of DHI used to capture, store, access, and share individual-level, longitudinal health information in digitized records. The BID Initiative worked in partnership with the governments of Tanzania and Zambia to introduce an EIR at the sub-national level in both countries within 5 years as part of a multi-component complex intervention package focusing on data use capacity-building. METHODS: We aimed to gather and describe learnings from the BID experience by conducting a framework-based mixed methods study to describe perceptions of factors that influenced scale-up of the EIR. Data were collected through key informant interviews, a desk review, EIRs, and health management information systems. We described how implementation of the EIRs fulfilled domains described in our conceptual framework and used cases to illustrate the relationships and relative influence of domains for scale-up and adoption of the EIR. RESULTS: We found that there was no single factor that seemed to influence the introduction or sustained adoption of the EIR as many of the factors were interrelated. For EIR introduction, strong strategic engagement among partners was important, while EIR adoption was influenced by adequate staffing at facilities, training, use of data for supervision, internet and electricity connectivity, and community sensitization. CONCLUSIONS: Organizations deploying DHIs in the future should consider how best to adapt their intervention to the existing ecosystem, including human resources and organizational capacity, as well as the changing technological landscape during planning and implementation.

The impact of an integrated electronic immunization registry and logistics management information system (EIR-eLMIS) on vaccine availability in three regions in Tanzania: A pre-post and time-series analysis.

BACKGROUND: Since 2016, the Government of Tanzania has been implementing TImR, an integrated Electronic Immunization registry-logistics management information system (EIR-LMIS) that includes stock notifications. The objective of this study is to estimate the impact of this intervention on vaccine availability. METHODS: Monthly stock-out data were collected from paper registers at facilities, an Excel-based system at districts, and the new system (TImR) across all 924 health facilities in Arusha, Tanga and Kilimanjaro Regions. Six months of stockout rates pre- and post-introduction, by antigen, were compared via a two-way analysis of variance (ANOVA). A mixed-effects logistic regression model with the TImR data identified predictors of vaccine availability across antigens. FINDINGS: Post-introduction, ANOVA models estimated that overall stock-out rates declined from a monthly average of 7.1% to 2.1% (p < 0.01). Three specific vaccines had fewer stock-outs; OPV's monthly average dropped from 12.5% to 2.1% (p < 0.01), MR from 9.4% to 1.0% (p < 0.01) and DTP-HepB-HiB from 8.1% to 1.7% (p < 0.01). In the mixed-effects logistic regression model, controlling for antigen, odds of stock-out were 4.1% (95% CI: 3.3 - 4.9) lower for each week of tenure. Compared to DTP-HepB-HiB vaccine, odds of BCG vaccine being stocked out were 4.31 as high (95% CI: 3.1 - 5.0). The odds of being stocked-out were 29.7% lower for PCV (95% CI: 8.8 - 45.8) and 26.6% (95% CI: 3.4 - 44.1) lower for rotavirus vaccines compared to DTP-HepB-HiB. The odds of stock out were 37.7% lower for MR vaccine than DTP-HepB-HiB (95% CI: 18.1 - 52.6). CONCLUSIONS: Tanzania's integrated EIR-eLMIS may increase vaccine availability compared to its paper and Excel based system. Post-introduction of an eLMIS, the odds of a vaccine stock-out reduced over time. Further research could determine the impact of this intervention on vaccine wastage and replenishment response times.

Electronic Immunization Registries in Tanzania and Zambia: Shaping a Minimum Viable Product for Scaled Solutions.

As part of the work the Better Immunization Data (BID) Initiative undertook starting in 2013 to improve countries' collection, quality, and use of immunization data, PATH partnered with countries to identify the critical requirements for an electronic immunization registry (EIR). An EIR became the core intervention to address the data challenges that countries faced but also presented complexities during the development process to ensure that it met the core needs of the users. The work began with collecting common system requirements from 10 sub-Saharan African countries; these requirements represented the countries' vision of an ideal system to track individual child vaccination schedules and elements of supply chain. Through iterative development processes in both Tanzania and Zambia, the common requirements were modified and adapted to better fit the country contexts and users' needs, as well as to be developed with the technology available at the time. This process happened across four different software platforms. This paper outlines the process undertaken and analyzes similarities and differences across the iterations of the EIR in both countries, culminating in the development of a registry in Zambia that includes the most critical aspects required for initially deploying the registry and embodies what could be considered the minimum viable product for an EIR.