Implementation outcomes of the integrated district evidence to action (IDEAs) program to reduce neonatal mortality in central Mozambique: an application of the RE-AIM evaluation framework.

BACKGROUND: Scarce evidence exists on audit and feedback implementation processes in low-resource health systems. The Integrated District Evidence to Action (IDEAs) is a multi-component audit and feedback strategy designed to improve the implementation of maternal and child guidelines in Mozambique. We report IDEAs implementation outcomes. METHODS: IDEAs was implemented in 154 health facilities across 12 districts in Manica and Sofala provinces between 2016 and 2020 and evaluated using a quasi-experimental design guided by the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework. Reach is the proportion of pregnant women attending IDEAs facilities. Adoption is the proportion of facilities initiating audit and feedback meetings. Implementation is the fidelity to the strategy components, including readiness assessments, meetings (frequency, participation, action plan development), and targeted financial support and supervision. Maintenance is the sustainment at 12, 24, and 54 months. RESULTS: Across both provinces, 56% of facilities were exposed to IDEAs (target 57%). Sixty-nine and 73% of pregnant women attended those facilities' first and fourth antenatal consultations (target 70%). All facilities adopted the intervention. 99% of the expected meetings occurred with an average interval of 5.9 out of 6 months. Participation of maternal and child managers was high, with 3076 attending meetings, of which 64% were from the facility, 29% from the district, and 7% from the province level. 97% of expected action plans were created, and 41 specific problems were identified. "Weak diagnosis or management of obstetric complications" was identified as the main problem, and "actions to reinforce norms and protocols" was the dominant subcategory of micro-interventions selected. Fidelity to semiannual readiness assessments was low (52% of expected facilities), and in completing micro-interventions (17% were completed). Ninety-six and 95% of facilities sustained the intervention at 12 and 24 months, respectively, and 71% had completed nine cycles at 54 months. CONCLUSION: Maternal and child managers can lead audit and feedback processes in primary health care in Mozambique with high reach, adoption, and maintenance. The IDEAs strategy should be adapted to promote higher fidelity around implementing action plans and conducting readiness assessments. Adding effectiveness to these findings will help to inform strategy scale-up.

Association between service readiness and PMTCT cascade effectiveness: a 2018 cross-sectional analysis from Manica province, Mozambique.

BACKGROUND: Despite high coverage of maternal and child  health services in Mozambique, prevention of mother-to-child transmission of HIV (PMTCT) cascade outcomes remain sub-optimal. Delivery effectiveness is modified by health system preparedness. Identifying modifiable factors that impact quality of care and service uptake can inform strategies to improve the effectiveness of PMTCT programs. We estimated associations between facility-level modifiable health system readiness measures and three PMTCT outcomes: Early infant diagnosis (polymerase chain reaction (PCR) before 8 weeks of life), PCR ever (before or after 8 weeks), and positive PCR test result. METHODS: A 2018 cross-sectional, facility-level survey was conducted in a sample of 36 health facilities covering all 12 districts in Manica province, central Mozambique, as part of a baseline assessment for the SAIA-SCALE trial (NCT03425136). Data on HIV testing outcomes among 3,427 exposed infants were abstracted from at-risk child service registries. Nine health system readiness measures were included in the analysis. Logistic regressions were used to estimate associations between readiness measures and pediatric HIV testing outcomes. Odds ratios (OR) and 95% confidence intervals (95%CI) are reported. RESULTS: Forty-eight percent of HIV-exposed infants had a PCR test within 8 weeks of life, 69% had a PCR test ever, and 6% tested positive. Staffing levels, glove stockouts, and distance to the reference laboratory were positively associated with early PCR (OR = 1.02 [95%CI: 1.01-1.02], OR = 1.73 [95%CI: 1.24-2.40] and OR = 1.01 [95%CI: 1.00-1.01], respectively) and ever PCR (OR = 1.02 [95%CI: 1.01-1.02], OR = 1.80 [95%CI: 1.26-2.58] and OR = 1.01 [95%CI: 1.00-1.01], respectively). Catchment area size and multiple NGOs supporting PMTCT services were associated with early PCR testing OR = 1.02 [95%CI: 1.01-1.03] and OR = 0.54 [95%CI: 0.30-0.97], respectively). Facility type, stockout of prophylactic antiretrovirals, the presence of quality improvement programs and mothers' support groups in the health facility were not associated with PCR testing. No significant associations with positive HIV diagnosis were found. CONCLUSION: Salient modifiable factors associated with HIV testing for exposed infants include staffing levels, NGO support, stockout of essential commodities and accessibility of reference laboratories. Our study provides insights into modifiable factors that could be targeted to improve PMTCT performance, particularly at small and rural facilities.

Challenges and facilitators to evidence-based decision-making for maternal and child health in Mozambique: district, municipal and national case studies.

BACKGROUND: The need for evidence-based decision-making in the health sector is well understood in the global health community. Yet, gaps persist between the availability of evidence and the use of that evidence. Most research on evidence-based decision-making has been carried out in higher-income countries, and most studies look at policy-making rather than decision-making more broadly. We conducted this study to address these gaps and to identify challenges and facilitators to evidence-based decision-making in Maternal, Newborn and Child Health and Nutrition (MNCH&N) at the municipality, district, and national levels in Mozambique. METHODS: We used a case study design to capture the experiences of decision-makers and analysts (n = 24) who participated in evidence-based decision-making processes related to health policies and interventions to improve MNCH&N in diverse decision-making contexts (district, municipality, and national levels) in 2014-2017, in Mozambique. We examined six case studies, at the national level, in Maputo City and in two districts of Sofala Province and two of Zambézia Province, using individual in-depth interviews with key informants and a document review, for three weeks, in July 2018. RESULTS: Our analysis highlighted various challenges for evidence-based decision-making for MNCH&N, at national, district, and municipality levels in Mozambique, including limited demand for evidence, limited capacity to use evidence, and lack of trust in the available evidence. By contrast, access to evidence, and availability of evidence were viewed positively and seen as potential facilitators. Organizational capacity for the demand and use of evidence appears to be the greatest challenge; while individual capacity is also a barrier. CONCLUSION: Evidence-based decision-making requires that actors have access to evidence and are empowered to act on that evidence. This, in turn, requires alignment between those who collect data, those who analyze and interpret data, and those who make and implement decisions. Investments in individual, organizational, and systems capacity to use evidence are needed to foster practices of evidence-based decision-making for improved maternal and child health in Mozambique.

Cost-Effectiveness and Budget Impact Analysis of the Implementation of Differentiated Service Delivery Models for HIV Treatment in Mozambique: a Modelling Study.

INTRODUCTION: In 2018, the Mozambique Ministry of Health launched guidelines for implementing differentiated service delivery models (DSDMs) to optimize HIV service delivery, improve retention in care, and ultimately reduce HIV-associated mortality. The models were fast-track, 3-month antiretrovirals dispensing, community antiretroviral therapy groups, adherence clubs, family approach and three one-stop shop models: adolescent-friendly health services, maternal and child health, and tuberculosis. We conducted a cost-effectiveness analysis and budget impact analysis to compare these models to conventional services. METHODS: We constructed a decision tree model based on the percentage of enrolment in each model and the probability of the outcome (12-month retention in treatment) for each year of the study period-three for the cost-effectiveness analysis (2019-2021) and three for the budget impact analysis (2022-2024). Costs for these analyses were primarily estimated per client-year from the health system perspective. A secondary cost-effectiveness analysis was conducted from the societal perspective. Budget impact analysis costs included antiretrovirals, laboratory tests and service provision interactions. Cost-effectiveness analysis additionally included start-up, training and clients' opportunity costs. Effectiveness was estimated using an uncontrolled interrupted time series analysis comparing the outcome before and after the implementation of the differentiated models. A one-way sensitivity analysis was conducted to identify drivers of uncertainty. RESULTS: After implementation of the DSDMs, there was a mean increase of 14.9 percentage points (95% CI: 12.2, 17.8) in 12-month retention, from 47.6% (95% CI, 44.9-50.2) to 62.5% (95% CI, 60.9-64.1). The mean cost difference comparing DSDMs and conventional care was US$ -6 million (173,391,277 vs. 179,461,668) and -32.5 million (394,705,618 vs. 433,232,289) from the health system and the societal perspective, respectively. Therefore, DSDMs dominated conventional care. Results were most sensitive to conventional care interaction costs in the one-way sensitivity analysis. For a population of 1.5 million, the base-case 3-year financial costs associated with the DSDMs was US$550 million, compared with US$564 million for conventional care. CONCLUSIONS: DSDMs were less expensive and more effective in retaining clients 12 months after antiretroviral therapy initiation and were estimated to save approximately US$14 million for the health system from 2022 to 2024.

Managers' and providers' perspectives on barriers and facilitators for the implementation of differentiated service delivery models for HIV treatment in Mozambique: a qualitative study.

INTRODUCTION: In 2018, Mozambique's Ministry of Health launched a guideline for a nationwide implementation of eight differentiated service delivery models to optimize HIV service delivery and achieve universal coverage of HIV care and treatment. The models were (1) Fast-track, (2) Three-month Antiretrovirals Dispensing, (3) Community Antiretroviral Therapy Groups, (4) Adherence Clubs, (5) Family-approach, and three one-stop shop models for (6) Tuberculosis, (7) Maternal and Child Health, and (8) Adolescent-friendly Health Services. This study identified drivers of implementation success and failure across these differentiated service delivery models. METHODS: Twenty in-depth individual interviews were conducted with managers and providers from the Ministry of Health and implementing partners from all levels of the health system between July and September 2021. National-level participants were based in the capital city of Maputo, and participants at provincial, district and health facility levels were from Sofala province, a purposively selected setting. The Consolidated Framework for Implementation Research (CFIR) guided data collection and thematic analysis. Deductively selected constructs were assessed while allowing for additional themes to emerge inductively. RESULTS: The CFIR constructs of Relative Advantage, Complexity, Patient Needs and Resources, and Reflecting and Evaluating were identified as drivers of implementation, whereas Available Resources and Access to Knowledge and Information were identified as barriers. Fast-track and Three-month Antiretrovirals Dispensing models were deemed easier to implement and more effective in reducing workload. Adherence Clubs and Community Antiretroviral Therapy Groups were believed to be less preferred by clients in urban settings. COVID-19 (an inductive theme) improved acceptance and uptake of individual differentiated service delivery models that reduced client visits, but it temporarily interrupted the implementation of group models. CONCLUSIONS: This study described important determinants to be addressed or leveraged for the successful implementation of differentiated service delivery models in Mozambique. The models were considered advantageous overall for the health system and clients when compared with the standard of care. However, successful implementation requires resources and ongoing training for frontline providers. COVID-19 expedited individual models by loosening the inclusion criteria; this experience can be leveraged to optimize the design and implementation of differentiated service delivery models in Mozambique and other countries.

Assessing drivers of implementing "Scaling-up the Systems Analysis and Improvement Approach" for Prevention of Mother-to-Child HIV Transmission in Mozambique (SAIA-SCALE) over implementation waves.

BACKGROUND: The Systems Analysis and Improvement Approach (SAIA) is an evidence-based package of systems engineering tools originally designed to improve patient flow through the prevention of Mother-to-Child transmission of HIV (PMTCT) cascade. SAIA is a potentially scalable model for maximizing the benefits of universal antiretroviral therapy (ART) for mothers and their babies. SAIA-SCALE was a stepped wedge trial implemented in Manica Province, Mozambique, to evaluate SAIA's effectiveness when led by district health managers, rather than by study nurses. We present the results of a qualitative assessment of implementation determinants of the SAIA-SCALE strategy during two intensive and one maintenance phases. METHODS: We used an extended case study design that embedded the Consolidated Framework for Implementation Research (CFIR) to guide data collection, analysis, and interpretation. From March 2019 to April 2020, we conducted in-depth individual interviews (IDIs) and focus group discussions (FGDs) with district managers, health facility maternal and child health (MCH) managers, and frontline nurses at 21 health facilities and seven districts of Manica Province (Chimoio, Báruè, Gondola, Macate, Manica, Sussundenga, and Vanduzi). RESULTS: We included 85 participants: 50 through IDIs and 35 from three FGDs. Most study participants were women (98%), frontline nurses (49.4%), and MCH health facility managers (32.5%). An identified facilitator of successful intervention implementation (regardless of intervention phase) was related to SAIA's compatibility with organizational structures, processes, and priorities of Mozambique's health system at the district and health facility levels. Identified barriers to successful implementation included (a) inadequate health facility and road infrastructure preventing mothers from accessing MCH/PMTCT services at study health facilities and preventing nurses from dedicating time to improving service provision, and (b) challenges in managing intervention funds. CONCLUSIONS: The SAIA-SCALE qualitative evaluation suggests that the scalability of SAIA for PMTCT is enhanced by its fit within organizational structures, processes, and priorities at the primary level of healthcare delivery and health system management in Mozambique. Barriers to implementation that impact the scalability of SAIA include district-level financial management capabilities and lack of infrastructure at the health facility level. SAIA cannot be successfully scaled up to adequately address PMTCT needs without leveraging central-level resources and priorities. TRIAL REGISTRATION: ClinicalTrials.gov, NCT03425136 . Registered on 02/06/2018.

The Systems Analysis and Improvement Approach: specifying core components of an implementation strategy to optimize care cascades in public health.

BACKGROUND: Healthcare systems in low-resource settings need simple, low-cost interventions to improve services and address gaps in care. Though routine data provide opportunities to guide these efforts, frontline providers are rarely engaged in analyzing them for facility-level decision making. The Systems Analysis and Improvement Approach (SAIA) is an evidence-based, multi-component implementation strategy that engages providers in use of facility-level data to promote systems-level thinking and quality improvement (QI) efforts within multi-step care cascades. SAIA was originally developed to address HIV care in resource-limited settings but has since been adapted to a variety of clinical care systems including cervical cancer screening, mental health treatment, and hypertension management, among others; and across a variety of settings in sub-Saharan Africa and the USA. We aimed to extend the growing body of SAIA research by defining the core elements of SAIA using established specification approaches and thus improve reproducibility, guide future adaptations, and lay the groundwork to define its mechanisms of action. METHODS: Specification of the SAIA strategy was undertaken over 12 months by an expert panel of SAIA-researchers, implementing agents and stakeholders using a three-round, modified nominal group technique approach to match core SAIA components to the Expert Recommendations for Implementing Change (ERIC) list of distinct implementation strategies. Core implementation strategies were then specified according to Proctor's recommendations for specifying and reporting, followed by synthesis of data on related implementation outcomes linked to the SAIA strategy across projects. RESULTS: Based on this review and clarification of the operational definitions of the components of the SAIA, the four components of SAIA were mapped to 13 ERIC strategies. SAIA strategy meetings encompassed external facilitation, organization of provider implementation meetings, and provision of ongoing consultation. Cascade analysis mapped to three ERIC strategies: facilitating relay of clinical data to providers, use of audit and feedback of routine data with healthcare teams, and modeling and simulation of change. Process mapping matched to local needs assessment, local consensus discussions and assessment of readiness and identification of barriers and facilitators. Finally, continuous quality improvement encompassed tailoring strategies, developing a formal implementation blueprint, cyclical tests of change, and purposefully re-examining the implementation process. CONCLUSIONS: Specifying the components of SAIA provides improved conceptual clarity to enhance reproducibility for other researchers and practitioners interested in applying the SAIA across novel settings.

Use of implementation science to advance family planning programs in low- and middle-income countries: A systematic review.

Objective: As environmental and economic pressures converge with demands to achieve sustainability development goals, low- and middle-income countries (LMIC) increasingly require strategies to strengthen and scale-up evidence-based practices (EBP) related to family planning (FP). Implementation science (IS) can help these efforts. The purpose of this article is to elucidate patterns in the use of IS in FP research and identify ways to maximize the potential of IS to advance FP in LMIC. Design and methods: We conducted a systematic review that describes how IS concepts and principles have been operationalized in LMIC FP research published from 2007-2021. We searched six databases for implementation studies of LMIC FP interventions. Our review synthesizes the characteristics of implementation strategies and research efforts used to enhance the performance of FP-related EBP in these settings, identifying gaps, strengths and lessons learned. Results: Four-hundred and seventy-two studies were eligible for full-text review. Ninety-two percent of studies were carried out in one region only, whereas 8 percent were multi-country studies that took place across multiple regions. 37 percent of studies were conducted in East Africa, 21 percent in West and Central Africa, 19 percent in Southern Africa and South Asia, respectively, and fewer than 5 percent in other Asian countries, Latin America and Middle East and North Africa, respectively. Fifty-four percent were on strategies that promoted individuals' uptake of FP. Far fewer were on strategies to enhance the coverage, implementation, spread or sustainability of FP programs. Most studies used quantitative methods only and evaluated user-level outcomes over implementation outcomes. Thirty percent measured processes and outcomes of strategies, 15 percent measured changes in implementation outcomes, and 31 percent report on the effect of contextual factors. Eighteen percent reported that they were situated within decision-making processes to address locally identified implementation issues. Fourteen percent of studies described measures to involve stakeholders in the research process. Only 7 percent of studies reported that implementation was led by LMIC delivery systems or implementation partners. Conclusions: IS has potential to further advance LMIC FP programs, although its impact will be limited unless its concepts and principles are incorporated more systematically. To support this, stakeholders must focus on strategies that address a wider range of implementation outcomes; adapt research designs and blend methods to evaluate outcomes and processes; and establish collaborative research efforts across implementation, policy, and research domains. Doing so will expand opportunities for learning and applying new knowledge in pragmatic research paradigms where research is embedded in usual implementation conditions and addresses critical issues such as scale up and sustainability of evidence-informed FP interventions.Systematic Review Registration: https://www.crd.york.ac.uk/prospero/, identifier: CRD42020199353.

Managers' and providers' perspectives on barriers and facilitators for the implementation of differentiated service delivery models for HIV treatment in Mozambique: a qualitative study

In 2018, Mozambique's Ministry of Health launched a guideline for a nationwide implementation of eight differentiated service delivery models to optimize HIV service delivery and achieve universal coverage of HIV care and treatment. The models were (1) Fast­track, (2) Three­month Antiretrovirals Dispensing, (3) Community Antiretroviral Therapy Groups, (4) Adherence Clubs, (5) Family­approach, and three one­stop shop models for (6) Tuberculosis, (7) Maternal and Child Health, and (8) Adolescent­friendly Health Services. This study identified drivers of implementation success and failure across these differentiated service delivery models.

Challenges and facilitators to evidence-based decision-making for maternal and child health in Mozambique: district, municipal and national case studies / Challenges and facilitators to evidence-based decision-making for maternal and child health in Mozambique: district, municipal and national case studies

The need for evidence-based decision-making in the health sector is well understood in the global health community. Yet, gaps persist between the availability of evidence and the use of that evidence. Most research on evidence-based decision-making has been carried out in higher-income countries, and most studies look at policy-making rather than decision-making more broadly. We conducted this study to address these gaps and to identify challenges and facilitators to evidence-based decision-making in Maternal, Newborn and Child Health and Nutrition (MNCH&N) at the municipality, district, and national levels in Mozambique. We used a case study design to capture the experiences of decision-makers and analysts (n = 24) who participated in evidence-based decision-making processes related to health policies and interventions to improve MNCH&N in diverse decision-making contexts (district, municipality, and national levels) in 2014-2017, in Mozambique. We examined six case studies, at the national level, in Maputo City and in two districts of Sofala Province and two of Zambézia Province, using individual in-depth interviews with key informants and a document review, for three weeks, in July 2018. Our analysis highlighted various challenges for evidence-based decision-making for MNCH&N, at national, district, and municipality levels in Mozambique, including limited demand for evidence, limited capacity to use evidence, and lack of trust in the available evidence. By contrast, access to evidence, and availability of evidence were viewed positively and seen as potential facilitators. Organizational capacity for the demand and use of evidence appears to be the greatest challenge; while individual capacity is also a barrier. Evidence-based decision-making requires that actors have access to evidence and are empowered to act on that evidence. This, in turn, requires alignment between those who collect data, those who analyze and interpret data, and those who make and implement decisions. Investments in individual, organizational, and systems capacity to use evidence are needed to foster practices of evidence-based decision-making for improved maternal and child health in Mozambique