Implementing surgical mentorship in a resource-constrained context: a mixed methods assessment of the experiences of mentees, mentors, and leaders, and lessons learned.

BACKGROUND: A well-qualified workforce is critical to effective functioning of health systems and populations; however, skill gaps present a challenge in low-resource settings. While an emerging body of evidence suggests that mentorship can improve quality, access, and systems in African health settings by building the capacity of health providers, less is known about its implementation in surgery. We studied a novel surgical mentorship intervention as part of a safe surgery intervention (Safe Surgery 2020) in five rural Ethiopian facilities to understand factors affecting implementation of surgical mentorship in resource-constrained settings. METHODS: We designed a convergent mixed-methods study to understand the experiences of mentees, mentors, hospital leaders, and external stakeholders with the mentorship intervention. Quantitative data was collected through a survey (n = 25) and qualitative data through in-depth interviews (n = 26) in 2018 to gather information on (1) intervention characteristics including areas of mentorship, mentee-mentor relationships, and mentor characteristics, (2) organizational context including facilitators and barriers to implementation, (3) perceived impact, and (4) respondent characteristics. We analyzed the quantitative and qualitative data using frequency analysis and the constant comparison method, respectively; we integrated findings to identify themes. RESULTS: All mentees (100%) experienced the intervention as positive. Participants perceived impact as: safer and more frequent surgical procedures, collegial bonds between mentees and mentors, empowerment among mentees, and a culture of continuous learning. Over 70% of all mentees reported their confidence and job satisfaction increased. Supportive intervention characteristics included a systems focus, psychologically safe mentee-mentor relationships, and mentor characteristics including generosity with time and knowledge, understanding of local context, and interpersonal skills. Supportive organizational context included a receptive implementation climate. Intervention challenges included insufficient clinical training, inadequate mentor support, and inadequate dose. Organizational context challenges included resource constraints and a lack of common understanding of the intervention. CONCLUSION: We offer lessons for intervention designers, policy makers, and practitioners about optimizing surgical mentorship interventions in resource-constrained settings. We attribute the intervention's success to its holistic approach, a receptive climate, and effective mentee-mentor relationships. These qualities, along with policy support and adapting the intervention through user feedback are important for successful implementation.

Maternal and neonatal services in Ethiopia: measuring and improving quality.

PROBLEM: Maternal and neonatal mortality remains high in low- and middle-income countries, with poor quality of intrapartum care as a barrier to further progress. APPROACH: We developed and tested a method of measuring the quality of maternal and neonatal care that could be embedded in a larger national performance management initiative. The tool used direct observations and medical record reviews to score quality in nine domains of intrapartum care. We piloted and evaluated the tool in visits to the 18 lead hospitals that have responsibility to promote and coordinate quality improvement efforts within a hospital cluster in Ethiopia. Between baseline and follow-up assessments, staff from a national quality collaborative alliance provided hospital-based training on labour and delivery services. LOCAL SETTING: Ethiopia has invested in hospital quality improvement for more than a decade and this tool was integrated into existing quality improvement mechanisms within lead hospitals, with the potential for scale-up to all government hospitals. RELEVANT CHANGES: Significant improvements in quality of intrapartum care were detected from baseline (June-July 2015) to follow-up (February-March 2016) in targeted hospitals. The overall mean quality score rose from 65.6 (standard deviation, SD: 10.5) to 91.2 (SD: 12.4) out of 110 items (P < 0.001). LESSONS LEARNT: The method was feasible, requiring a total of 3 days and two to three trained data collectors per hospital visit. It produced data that detected substantial changes made during 8 months of national hospital quality improvement efforts. With additional replication studies, this tool may be useful in other low- and middle-income countries.

Safe Surgery for All: Early Lessons from Implementing a National Government-Driven Surgical Plan in Ethiopia.

Recognizing the unmet need for surgical care in Ethiopia, the Federal Ministry of Health (FMOH) has pioneered innovative methodologies for surgical system development with Saving Lives through Safe Surgery (SaLTS). SaLTS is a national flagship initiative designed to improve access to safe, essential and emergency surgical and anaesthesia care across all levels of the healthcare system. Sustained commitment from the FMOH and their recruitment of implementing partners has led to notable accomplishments across the breadth of the surgical system, including but not limited to: (1) Leadership, management and governance-a nationally scaled surgical leadership and mentorship programme, (2) Infrastructure-operating room construction and oxygen delivery plan, (3) Supplies and logistics-a national essential surgical procedure and equipment list, (4) Human resource development-a Surgical Workforce Expansion Plan and Anaesthesia National Roadmap, (5) Advocacy and partnership-strong FMOH partnership with international organizations, including GE Foundation's SafeSurgery2020 initiative, (6) Innovation-facility-driven identification of problems and solutions, (7) Quality of surgical and anaesthesia care service delivery-a national peri-operative guideline and WHO Surgical Safety Checklist implementation, and (8) Monitoring and evaluation-a comprehensive plan for short-term and long-term assessment of surgical quality and capacity. As Ethiopia progresses with its commitment to prioritize surgery within its Health Sector Transformation Plan, disseminating the process and outcomes of the SaLTS initiative will inform other countries on successful national implementation strategies. The following article describes the process by which the Ethiopian FMOH established surgical system reform and the preliminary results of implementation across these eight pillars.

Quality and sustainability of Ethiopia's national surgical indicators.

In 2015, the Ethiopian Federal Ministry of Health (FMOH) developed the Saving Lives through Safe Surgery (SaLTS) initiative to improve national surgical care. Previous work led to development and implementation of 15 surgical key performance indicators (KPIs) to standardize surgical data practices. The objective of this project is to investigate current practices of KPI data collection and assess quality to improve data management and strengthen surgical systems. The first portion of the study documented the surgical data collection process including methods, instruments, and effectiveness at 10 hospitals across 2 regions in Ethiopia. Secondly, data for KPIs of focus [1. Surgical Volume, 2. Perioperative Mortality Rate (POMR), 3. Adverse Anesthetic Outcome (AAO), 4. Surgical Site Infection (SSI), and 5. Safe Surgery Checklist (SSC) Utilization] were compared between registries, KPI reporting forms, and the DHIS2 (district health information system) electronic database for a 6-month period (January-June 2022). Quality was assessed based on data completeness and consistency. The data collection process involved hospital staff recording data elements in registries, quality officers calculating KPIs, completing monthly KPI reporting forms, and submitting data into DHIS2 for the national and regional health bureaus. Data quality verifications revealed discrepancies in consistency at all hospitals, ranging from 1-3 indicators. For all hospitals, average monthly surgical volume was 57 cases, POMR was 0.38% (13/3399), inpatient SSI rate was 0.79% (27/3399), AAO rate was 0.15% (5/3399), and mean SSC utilization monthly was 93% (100% median). Half of the hospitals had incomplete data within the registries, ranging from 2-5 indicators. AAO, SSC, and SSI were commonly missing data in registries. Non-standardized KPI reporting forms contributed significantly to the findings. Facilitators to quality data collection included continued use of registries from previous interventions and use of a separate logbook to document specific KPIs. Delayed rollout of these indicators in each region contributed to issues in data quality. Barriers involved variable indicator recording from different personnel, data collection tools that generate false positives (i.e. completeness of SSC defined as paper form filled out prior to patient discharge) or missing data because of reporting time period (i.e. monthly SSI may miss infections outside of one month), inadequate data elements in registries, and lack of standardized monthly KPI reporting forms. As the FMOH introduces new indicators and changes, we recommend continuous and consistent quality checks and data capacity building, including the use of routinely generated health information for quality improvement projects at the department level.

Surgical data strengthening in Ethiopia: results of a Kirkpatrick framework evaluation of a data quality intervention.

Background: One key challenge in improving surgical care in resource-limited settings is the lack of high-quality and informative data. In Ethiopia, the Safe Surgery 2020 (SS2020) project developed surgical key performance indicators (KPIs) to evaluate surgical care within the country. New data collection methods were developed and piloted in 10 SS2020 intervention hospitals in the Amhara and Tigray regions of Ethiopia. Objective: To assess the feasibility of collecting and reporting new surgical indicators and measure the impact of a surgical Data Quality Intervention (DQI) in rural Ethiopian hospitals. Methods: An 8-week DQI was implemented to roll-out new data collection tools in SS2020 hospitals. The Kirkpatrick Method, a widely used mixed-method evaluation framework for training programs, was used to assess the impact of the DQI. Feedback surveys and focus groups at various timepoints evaluated the impact of the intervention on surgical data quality, the feasibility of a new data collection system, and the potential for national scale-up. Results: Results of the evaluation are largely positive and promising. DQI participants reported knowledge gain, behavior change, and improved surgical data quality, as well as greater teamwork, communication, leadership, and accountability among surgical staff. Barriers remained in collection of high-quality data, such as lack of adequate human resources and electronic data reporting infrastructure. Conclusions: Study results are largely positive and make evident that surgical data capture is feasible in low-resource settings and warrants more investment in global surgery efforts. This type of training and mentorship model can be successful in changing individual behavior and institutional culture regarding surgical data collection and reporting. Use of the Kirkpatrick Framework for evaluation of a surgical DQI is an innovative contribution to literature and can be easily adapted and expanded for use within global surgery.