Implementation matters: assessing the effectiveness and sustainment of an obstetric triage program at a high-volume facility in Ghana.

BACKGROUND: Maternal mortality remains stubbornly high in Ghana. Current national efforts are focused on improving the quality of care offered in health facilities. Obstetric triage is one intervention that has been proposed to improve the timeliness and appropriateness of care, two key elements of quality. In this study, we describe and evaluate a theory-based implementation approach to introduce obstetric triage into Tema General Hospital, a high-volume maternity hospital in Greater Accra, that blends concepts from implementation science and quality improvement. This implementation project was a first attempt to scale this intervention into a new facility, following initial development in the Greater Accra Regional Hospital (formerly Ridge Hospital) in Accra. METHODS: This was a retrospective mixed-methods evaluation of two stages of implementation: active implementation and sustainment. We triangulated monitoring data captured during active implementation with clinical outcome data (timeliness of first assessment, accuracy of diagnosis, and appropriateness of care plan) from direct observation or patient obstetric triage assessment forms at baseline, at the completion of the active implementation stage, and following a 12-month "washout" period with no contact between hospital staff and the purveyor organization. Finally, we assessed embeddedness of the new triage procedures using the NoMad, a quantitative assessment of constructs from normalization process theory (NPT). RESULTS: Patient waiting time decreased substantially during the study. At baseline, the median arrival-to-assessment waiting time was 70.5 min (IQR: 30.0-443.0 min). Waiting time decreased to 6.0 min (IQR: 3.0-15.0 min) following active implementation and to 5.0 min (IQR: 2.0-10.0 min) during the sustainment period. Accuracy of diagnosis was high at the end of active implementation (75.7% correct) and improved during the sustainment period (to 77.9%). The appropriateness of care plans also improved during the sustainment period (from 66.0 to 78.9%). Per NoMad data, hospital staff generally perceive obstetric triage to be well integrated into the facility. CONCLUSIONS: This theory-based implementation approach proved to be successful in introducing a novel obstetric triage concept to a busy high-volume hospital, despite resource constraints and a short implementation window. Results proved long-lasting, suggesting this approach has high potential for engendering sustainability in other facilities as well. Our approach will be useful to other initiatives that aim to utilize program data to create and test implementation theories.

Learning needs assessment for multi-stakeholder implementation science training in LMIC settings: findings and recommendations.

BACKGROUND: Despite significant progress in the field of implementation science (IS), current training programs are inadequate to meet the global need, especially in low-and middle-income countries (LMICs). Even when training opportunities exist, there is a "knowledge-practice gap," where implementation research findings are not useful to practitioners in a field designed to bridge that gap. This is a critical challenge in LMICs where complex public health issues must be addressed. This paper describes results from a formal assessment of learning needs, priority topics, and delivery methods for LMIC stakeholders. METHODS: We first reviewed a sample of articles published recently in Implementation Science to identify IS stakeholders and assigned labels and definitions for groups with similar roles. We then employed a multi-step sampling approach and a random sampling strategy to recruit participants (n = 39) for a semi-structured interview that lasted 30-60 min. Stakeholders with inputs critical to developing training curricula were prioritized and selected for interviews. We created memos from audio-recorded interviews and used a deductively created codebook to conduct thematic analysis. We calculated kappa coefficients for each memo and used validation techniques to establish rigor including incorporating feedback from reviewers and member checking. RESULTS: Participants included program managers, researchers, and physicians working in over 20 countries, primarily LMICs. The majority had over 10 years of implementation experience but fewer than 5 years of IS experience. Three main themes emerged from the data, pertaining to past experience with IS, future IS training needs, and contextual issues. Most respondents (even with formal training) described their IS knowledge as basic or minimal. Preferences for future training were heterogeneous, but findings suggest that curricula must encompass a broader set of competencies than just IS, include mentorship/apprenticeship, and center the LMIC context. CONCLUSION: While this work is the first systematic assessment of IS learning needs among LMIC stakeholders, findings reflect existing research in that current training opportunities may not meet the demand, trainings are too narrowly focused to meet the heterogeneous needs of stakeholders, and there is a need for a broader set of competencies that moves beyond only IS. Our research also demonstrates the timely and unique needs of developing appropriately scoped, accessible training and mentorship support within LMIC settings. Therefore, we propose the novel approach of intelligent swarming as a solution to help build IS capacity in LMICs through the lens of sustainability and equity.

The cost-effectiveness of a program to reduce intrapartum and neonatal mortality in a referral hospital in Ghana.

OBJECTIVE: To evaluate the cost-effectiveness of a program intended to reduce intrapartum and neonatal mortality in Accra, Ghana. DESIGN: Quasi-experimental, time-sequence intervention, retrospective cost-effectiveness analysis. METHODS: A program integrating leadership development, clinical skills and quality improvement training was piloted at the Greater Accra Regional Hospital from 2013 to 2016. The number of intrapartum and neonatal deaths prevented were estimated using the hospital's 2012 stillbirth and neonatal mortality rates as a steady-state assumption. The cost-effectiveness of the intervention was calculated as cost per disability-adjusted life year (DALY) averted. In order to test the assumptions included in this analysis, it was subjected to probabilistic and one-way sensitivity analyses. MAIN OUTCOME MEASURES: Incremental cost-effectiveness ratio (ICER), which measures the cost per disability-adjusted life-year averted by the intervention compared to status quo. RESULTS: From 2012 to 2016, there were 45,495 births at the Greater Accra Regional Hospital, of whom 5,734 were admitted to the newborn intensive care unit. The budget for the systems strengthening program was US $1,716,976. Based on program estimates, 307 (±82) neonatal deaths and 84 (±35) stillbirths were prevented, amounting to 12,342 DALYs averted. The systems strengthening intervention was found to be highly cost effective with an ICER of US $139 (±$44), an amount significantly lower than the established threshold of cost-effectiveness of the per capita gross domestic product, which averaged US $1,649 between 2012-2016. The results were found to be sensitive to the following parameters: DALYs averted, number of neonatal deaths, and number of stillbirths. CONCLUSION: An integrated approach to system strengthening in referral hospitals has the potential to reduce neonatal and intrapartum mortality in low resource settings and is likely to be cost-effective. Sustained change can be achieved by building organizational capacity through leadership and clinical training.

A protocol for evaluating a multi-level implementation theory to scale-up obstetric triage in referral hospitals in Ghana.

BACKGROUND: Ghana significantly reduced maternal and newborn mortality between 1990 and 2015, largely through efforts focused on improving access to care. Yet achieving further progress requires improving the quality and timeliness of care. Beginning in 2013, Ghana Health Service and Kybele, a US-based non-governmental organization, developed an innovative obstetric triage system to help midwives assess, diagnosis, and determine appropriate care plans more quickly and accurately. In 2019, efforts began to scale this successful intervention into six additional hospitals. This protocol describes the theory-based implementation approach guiding scale-up and presents the proposed mixed-methods evaluation plan. METHODS: An implementation theory was developed to describe how complementary implementation strategies would be bundled into a multi-level implementation approach. Drawing on the Interactive Systems Framework and Evidenced Based System for Implementation Support, the proposed implementation approach is designed to help individual facilities develop implementation capacity and also build a learning network across facilities to support the implementation of evidence-based interventions. A convergent design mixed methods approach will be used to evaluate implementation with relevant data drawn from tailored assessments, routinely collected process and quality monitoring data, textual analysis of relevant documents and WhatsApp group messages, and key informant interviews. Implementation outcomes of interest are acceptability, adoption, and sustainability. DISCUSSION: The past decade has seen a rapid growth in the development of frameworks, models, and theories of implementation, yet there remains little guidance on how to use these to operationalize implementation practice. This study proposes one method for using implementation theory, paired with other kinds of mid-level and program theory, to guide the replication and evaluation of a clinical intervention in a complex, real-world setting. The results of this study should help to provide evidence of how implementation theory can be used to help close the "know-do" gap. Every woman and every newborn deserves a safe and positive birth experience. Yet in many parts of the world, this goal is often more aspiration than reality. In 2006, Kybele, a US-based non-governmental organization, began working with the Ghanaian government to improve the quality of obstetric and newborn care in a large hospital in Greater Accra. One successful program was the development of a triage system that would help midwives rapidly assess pregnant women to determine who needed what kind of care and develop risk-based care plans. The program was then replicated in another large hospital in the Greater Accra region, where a systematic theory to inform triage implementation was developed. This paper describes the extension of this approach to scale-up the triage program implementation in six additional hospitals. The scale-up is guided by a multi-level theory that extends the facility level theory to include cross-facility learning networks and oversight by the health system. We explain the process of theory development to implement interventions and demonstrate how these require the combination of local contextual knowledge with evidence from the implementation science literature. We also describe our approach for evaluating the theory to assess its effectiveness in achieving key implementation outcomes. This paper provides an example of how to use implementation theories to guide the development and evaluation of complex programs in real-world settings.