Implementation outcomes of the integrated district evidence to action (IDEAs) program to reduce neonatal mortality in central Mozambique: an application of the RE-AIM evaluation framework.

BACKGROUND: Scarce evidence exists on audit and feedback implementation processes in low-resource health systems. The Integrated District Evidence to Action (IDEAs) is a multi-component audit and feedback strategy designed to improve the implementation of maternal and child guidelines in Mozambique. We report IDEAs implementation outcomes. METHODS: IDEAs was implemented in 154 health facilities across 12 districts in Manica and Sofala provinces between 2016 and 2020 and evaluated using a quasi-experimental design guided by the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework. Reach is the proportion of pregnant women attending IDEAs facilities. Adoption is the proportion of facilities initiating audit and feedback meetings. Implementation is the fidelity to the strategy components, including readiness assessments, meetings (frequency, participation, action plan development), and targeted financial support and supervision. Maintenance is the sustainment at 12, 24, and 54 months. RESULTS: Across both provinces, 56% of facilities were exposed to IDEAs (target 57%). Sixty-nine and 73% of pregnant women attended those facilities' first and fourth antenatal consultations (target 70%). All facilities adopted the intervention. 99% of the expected meetings occurred with an average interval of 5.9 out of 6 months. Participation of maternal and child managers was high, with 3076 attending meetings, of which 64% were from the facility, 29% from the district, and 7% from the province level. 97% of expected action plans were created, and 41 specific problems were identified. "Weak diagnosis or management of obstetric complications" was identified as the main problem, and "actions to reinforce norms and protocols" was the dominant subcategory of micro-interventions selected. Fidelity to semiannual readiness assessments was low (52% of expected facilities), and in completing micro-interventions (17% were completed). Ninety-six and 95% of facilities sustained the intervention at 12 and 24 months, respectively, and 71% had completed nine cycles at 54 months. CONCLUSION: Maternal and child managers can lead audit and feedback processes in primary health care in Mozambique with high reach, adoption, and maintenance. The IDEAs strategy should be adapted to promote higher fidelity around implementing action plans and conducting readiness assessments. Adding effectiveness to these findings will help to inform strategy scale-up.

Challenges and facilitators to evidence-based decision-making for maternal and child health in Mozambique: district, municipal and national case studies.

BACKGROUND: The need for evidence-based decision-making in the health sector is well understood in the global health community. Yet, gaps persist between the availability of evidence and the use of that evidence. Most research on evidence-based decision-making has been carried out in higher-income countries, and most studies look at policy-making rather than decision-making more broadly. We conducted this study to address these gaps and to identify challenges and facilitators to evidence-based decision-making in Maternal, Newborn and Child Health and Nutrition (MNCH&N) at the municipality, district, and national levels in Mozambique. METHODS: We used a case study design to capture the experiences of decision-makers and analysts (n = 24) who participated in evidence-based decision-making processes related to health policies and interventions to improve MNCH&N in diverse decision-making contexts (district, municipality, and national levels) in 2014-2017, in Mozambique. We examined six case studies, at the national level, in Maputo City and in two districts of Sofala Province and two of Zambézia Province, using individual in-depth interviews with key informants and a document review, for three weeks, in July 2018. RESULTS: Our analysis highlighted various challenges for evidence-based decision-making for MNCH&N, at national, district, and municipality levels in Mozambique, including limited demand for evidence, limited capacity to use evidence, and lack of trust in the available evidence. By contrast, access to evidence, and availability of evidence were viewed positively and seen as potential facilitators. Organizational capacity for the demand and use of evidence appears to be the greatest challenge; while individual capacity is also a barrier. CONCLUSION: Evidence-based decision-making requires that actors have access to evidence and are empowered to act on that evidence. This, in turn, requires alignment between those who collect data, those who analyze and interpret data, and those who make and implement decisions. Investments in individual, organizational, and systems capacity to use evidence are needed to foster practices of evidence-based decision-making for improved maternal and child health in Mozambique.

The everyday practice of supporting health system development: learning from how an externally-led intervention was implemented in Mozambique.

Health system strengthening (HSS) has often been undertaken by global health actors working through vertical programmes. However, experience has shown the challenges of this approach, and the need to recognize health systems as open complex adaptive systems-which in turn has implications for the design and implementation approach of more 'horizontal' HSS interventions. From 2009 to 2016, the Doris Duke Charitable Foundation supported the African Health Initiative, establishing Population Health Implementation and Training partnerships in five African countries (Ghana, Mozambique, Rwanda, Tanzania and Zambia). Each partnership was designed as a large-scale, long-term, complex health system strengthening intervention, at a primary care or district level-and in each country the intervention was adapted to suit that specific health systems context. In Mozambique, the Population Health Implementation and Training partnership sought to strengthen integrated health systems management at district and provincial levels (through a variety of capacity-development intervention activities, including in-service training and mentoring); to improve the quality of routine data and develop appropriate tools to facilitate decision-making for provincial and district managers; and to build capacity to design and conduct innovative operations research in order to guide integration and system-strengthening efforts. The success of this intervention, as assessed by outcome measures, has been reported elsewhere. In this paper, the implementation practice of this horizontal HSS intervention is assessed, focusing on the key features of how implementation occurred and the implementation approach. A case study focusing on HSS implementation practice was conducted by external researchers from 2014 to 2017. The importance of an accompanying implementation research approach is emphasized-especially for HSS interventions where the 'complex adaptive system' (complex and constantly changing context) forces constant adaptations to the intervention design and approach.

Data-driven quality improvement in low-and middle-income country health systems: lessons from seven years of implementation experience across Mozambique, Rwanda, and Zambia.

BACKGROUND: Well-functioning health systems need to utilize data at all levels, from the provider, to local and national-level decision makers, in order to make evidence-based and needed adjustments to improve the quality of care provided. Over the last 7 years, the Doris Duke Charitable Foundation's African Health Initiative funded health systems strengthening projects at the facility, district, and/or provincial level to improve population health. Increasing data-driven decision making was a common strategy in Mozambique, Rwanda and Zambia. This paper describes the similar and divergent approaches to increase data-driven quality of care improvements (QI) and implementation challenge and opportunities encountered in these three countries. METHODS: Eight semi-structured in-depth interviews (IDIs) were administered to program staff working in each country. IDIs for this paper included principal investigators of each project, key program implementers (medically-trained support staff, data managers and statisticians, and country directors), as well as Ministry of Health counterparts. IDI data were collected through field notes; interviews were not audio recorded. Data were analyzed using thematic analysis but no systematic coding was conducted. IDIs were supplemented through donor report abstractions, a structured questionnaire, one-on-one phone calls, and email exchanges with country program leaders to clarify and expand on key themes emerging from IDIs. RESULTS: Project successes ranged from over 450 collaborative action-plans developed, implemented, and evaluated in Mozambique, to an increase from <10% to >80% of basic clinical protocols followed in intervention facilities in rural Zambia, and a shift from a lack of awareness of health data among health system staff to collaborative ownership of data and using data to drive change in Rwanda. CONCLUSION: Based on common successes across the country experiences, we recommend future data-driven QI interventions begin with data quality assessments to promote that rapid health system improvement is possible, ensure confidence in available data, serve as the first step in data-driven targeted improvements, and improve staff data analysis and visualization skills. Explicit Ministry of Health collaborative engagement can ensure performance review is collaborative and internally-driven rather than viewed as an external "audit."