Girl Champ in eSwatini: A Strategic Marketing Campaign to Promote Demand for Sexual and Reproductive Health Services Among Young Women.

Efforts to engage adolescent girls and young women (AGYW) in HIV services have struggled, in part, due to limited awareness of services and stigma. Strategic marketing is a promising approach, but the impact on youth behavior change is unclear. We report findings from a mixed methods evaluation of the Girl Champ campaign, designed to generate demand for sexual and reproductive services among AGYW, and piloted in three clinics in the Manzini region of eSwatini. We analyzed and integrated data from longitudinal, clinic-level databases on health service utilization among AGYW before and after the pilot, qualitative interviews with stakeholders responsible for the implementation of the pilot, and participant feedback surveys from attendees of Girl Champ events. Girl Champ was well received by most stakeholders based on event attendance and participant feedback, and associated with longitudinal improvements in demand for HIV services. Findings can inform future HIV demand creation interventions for youth.

Mitigating structural racism to reduce inequities in sepsis outcomes: a mixed methods, longitudinal intervention study.

BACKGROUND: Sepsis affects 1.7 million patients in the US annually, is one of the leading causes of mortality, and is a major driver of US healthcare costs. African American/Black and LatinX populations experience higher rates of sepsis complications, deviations from standard care, and readmissions compared with Non-Hispanic White populations. Despite clear evidence of structural racism in sepsis care and outcomes, there are no prospective interventions to mitigate structural racism in sepsis care, nor are we aware of studies that report reductions in racial inequities in sepsis care as an outcome. Therefore, we will deliver and evaluate a coalition-based intervention to equip health systems and their surrounding communities to mitigate structural racism, driving measurable reductions in inequities in sepsis outcomes. This paper presents the theoretical foundation for the study, summarizes key elements of the intervention, and describes the methodology to evaluate the intervention. METHODS: Our aims are to: (1) deliver a coalition-based leadership intervention in eight U.S. health systems and their surrounding communities; (2) evaluate the impact of the intervention on organizational culture using a longitudinal, convergent mixed methods approach, and (3) evaluate the impact of the intervention on reduction of racial inequities in three clinical outcomes: a) early identification (time to antibiotic), b) clinical management (in-hospital sepsis mortality) and c) standards-based follow up (same-hospital, all-cause sepsis readmissions) using interrupted time series analysis. DISCUSSION: This study is aligned with calls to action by the NIH and the Sepsis Alliance to address inequities in sepsis care and outcomes. It is the first to intervene to mitigate effects of structural racism by developing the domains of organizational culture that are required for anti-racist action, with implications for inequities in complex health outcomes beyond sepsis.

Title: Expansion of a national differentiated service delivery model to support people living with HIV and other chronic conditions in South Africa: a descriptive analysis.

BACKGROUND: South Africa is home to 7.7 million people living with HIV and supports the largest antiretroviral therapy (ART) program worldwide. Despite global investment in HIV service delivery and the parallel challenge of non-communicable diseases (NCDs), there are few examples of integrated programs addressing both HIV and NCDs through differentiated service delivery. In 2014, the National Department of Health (NDoH) of South Africa launched the Central Chronic Medicines Dispensing and Distribution (CCMDD) program to provide patients who have chronic diseases, including HIV, with alternative access to medications via community-based pick-up points. This study describes the expansion of CCMDD toward national scale. METHODS: Yale monitors CCMDD expansion as part of its mixed methods evaluation of Project Last Mile, a national technical support partner for CCMDD since 2016. From March 2016 through October 2019, cumulative weekly data on CCMDD uptake [patients enrolled, facilities registered, pick-up points contracted], type of medication provided [ART only; NCD only; and ART-NCD] and collection sites preferred by patients [external pick-up points; adherence/outreach clubs; or facility-based fast lanes], were extracted for descriptive, longitudinal analysis. RESULTS: As of October 2019, 3,436 health facilities were registered with CCMDD across 46 health districts (88 % of South Africa's districts), and 2,037 external pick-up points had been contracted by the NDoH. A total of 2,069,039 patients were actively serviced through CCMDD, a significant increase since 2018 (p < 0.001), including 76 % collecting ART [64 % ART only, 12 % ART plus NCD/comorbidities] and 479,120 [24 %] collecting medications for chronic diseases only. Further, 734,005 (35 %) of patients were collecting from contracted, external pick-up points, a 73 % increase in patient volume from 2018. DISCUSSION: This longitudinal description of CCMDD provides an example of growth of a national differentiated service delivery model that integrates management of HIV and noncommunicable diseases. This study demonstrates the success of the program in engaging patients irrespective of their chronic condition, which bodes well for the potential of the program to address the rising burden of both HIV and NCDs in South Africa. CONCLUSIONS: The CCMDD program expansion signals the potential for a differentiated service delivery strategy in resource-limited settings that can be agnostic of the patients chronic disease condition.

Experiences of managerial accountability in Ethiopia's primary healthcare system: a qualitative study.

BACKGROUND: Despite calls for improved accountability in global health systems, and a set of clear and consistent theoretical accountability frameworks, empirical descriptions of how accountability is experienced and enacted in low- and middle- income country (LMIC) settings is limited. Therefore, we sought to characterize how managers at all levels of Ethiopia's primary healthcare system experience accountability in their daily practice. METHODS: We conducted in-depth key informant interviews with 41 key stakeholders across 4 regions (Amhara, Oromia, Southern Nations Nationalities and Peoples, and Tigray) in the context of the Primary Healthcare Transformation Initiative (PTI). Consistent with the principles of grounded theory, our team used the constant comparative method to identify emergent themes related to concrete areas that could be targeted to allow an overall culture of accountability to flourish. RESULTS: Emergent themes were: development of a shared understanding of system-wide accountability, streamlining of managerial reporting lines, strengthening of medico-legal knowledge and systems, and development of mechanisms for bottom-up accountability. CONCLUSIONS: Findings may be valuable to policymakers seeking to create more effective national accountability frameworks; practitioners and development partners seeking to strengthen implementation of evidence-based accountability systems and practices; and researchers aiming to develop meaningful, practical measures of accountability in public health.

Maternal and neonatal services in Ethiopia: measuring and improving quality.

PROBLEM: Maternal and neonatal mortality remains high in low- and middle-income countries, with poor quality of intrapartum care as a barrier to further progress. APPROACH: We developed and tested a method of measuring the quality of maternal and neonatal care that could be embedded in a larger national performance management initiative. The tool used direct observations and medical record reviews to score quality in nine domains of intrapartum care. We piloted and evaluated the tool in visits to the 18 lead hospitals that have responsibility to promote and coordinate quality improvement efforts within a hospital cluster in Ethiopia. Between baseline and follow-up assessments, staff from a national quality collaborative alliance provided hospital-based training on labour and delivery services. LOCAL SETTING: Ethiopia has invested in hospital quality improvement for more than a decade and this tool was integrated into existing quality improvement mechanisms within lead hospitals, with the potential for scale-up to all government hospitals. RELEVANT CHANGES: Significant improvements in quality of intrapartum care were detected from baseline (June-July 2015) to follow-up (February-March 2016) in targeted hospitals. The overall mean quality score rose from 65.6 (standard deviation, SD: 10.5) to 91.2 (SD: 12.4) out of 110 items (P < 0.001). LESSONS LEARNT: The method was feasible, requiring a total of 3 days and two to three trained data collectors per hospital visit. It produced data that detected substantial changes made during 8 months of national hospital quality improvement efforts. With additional replication studies, this tool may be useful in other low- and middle-income countries.

A national system for monitoring the performance of hospitals in Ethiopia.

Many countries struggle to develop and implement strategies to monitor hospitals nationally. The challenge is particularly acute in low-income countries where resources for measurement and reporting are scarce. We examined the experience of developing and implementing a national system for monitoring the performance of 130 government hospitals in Ethiopia. Using participatory observation, we found that the monitoring system resulted in more consistent hospital reporting of performance data to regional health bureaus and the federal government, increased transparency about hospital performance and the development of multiple quality-improvement projects. The development and implementation of the system, which required technical and political investment and support, would not have been possible without strong hospital-level management capacity. Thorough assessment of the health sector's readiness to change and desire to prioritize hospital quality can be helpful in the early stages of design and implementation. This assessment may include interviews with key informants, collection of data about health facilities and human resources and discussion with academic partners. Aligning partners and donors with the government's vision for quality improvement can enhance acceptability and political support. Such alignment can enable resources to be focused strategically towards one national effort - rather than be diluted across dozens of potentially competing projects. Initial stages benefit from having modest goals and the flexibility for continuous modification and improvement, through active engagement with all stakeholders.

De nombreux pays s'efforcent d'élaborer et de mettre en œuvre des stratégies pour contrôler les hôpitaux à l'échelle nationale. C'est un défi de taille, en particulier pour les pays à faible revenu, qui disposent de peu de ressources pour effectuer des mesures et des comptes-rendus. Nous avons analysé l'expérience qui a consisté à élaborer et mettre en œuvre un système national de contrôle des performances de 130 hôpitaux publics en Éthiopie. Des observations participatives ont révélé que ce système de contrôle a entraîné une communication plus systématique des données sur les performances aux bureaux régionaux de la santé et au gouvernement fédéral de la part des hôpitaux, a amélioré la transparence concernant les performances de ces derniers et a permis d'élaborer plusieurs projets d'amélioration de la qualité. L'élaboration et la mise en œuvre de ce système, qui ont nécessité des investissements et des soutiens techniques et politiques, n'auraient pas été possibles sans d'importantes capacités de gestion dans les hôpitaux. Il peut être utile, aux premiers stades de la conception et de la mise en œuvre, d'évaluer de manière approfondie l'ouverture au changement du secteur de la santé ainsi que son souhait de placer au premier plan la qualité des services hospitaliers. Cette évaluation peut s'appuyer sur des entretiens avec des informateurs clés, sur la collecte de données au sujet des établissements de santé et des ressources humaines, ou encore sur une discussion avec des partenaires universitaires. Le fait d'associer des partenaires et des donateurs à l'objectif d'amélioration de la qualité visé par le gouvernement peut permettre de renforcer son acceptabilité ainsi que le soutien politique en la matière. Cela peut permettre de faire converger les ressources de façon stratégique vers un même effort national, plutôt que de les éparpiller dans des dizaines de projets potentiellement concurrents. Au cours des premières phases, il est bénéfique d'avoir des objectifs modestes et de faire preuve de souplesse afin de permettre des modifications et une amélioration continues, par le biais d'un engagement actif auprès de l'ensemble des parties prenantes.

Muchos países tienen dificultades para desarrollar e implementar estrategias a nivel nacional para monitorizar los hospitales. El reto es especialmente complicado en países de ingresos bajos donde los recursos para la medición y la notificación son escasos. Se examinó la experiencia a la hora de desarrollar e implementar un sistema nacional para monitorizar el rendimiento de 130 hospitales del gobierno en Etiopía. Haciendo uso de una observación participativa, se observó que el sistema de monitorización se tradujo en una notificación de datos de rendimiento de los hospitales más coherente a las oficinas de salud regionales y al gobierno federal, así como un incremento en la transparencia sobre el rendimiento de los hospitales y el desarrollo de diferentes proyectos para la mejora de la calidad. El desarrollo y la implementación de dicho sistema, que requería de inversiones y soporte tanto técnico como en materia de inversión, no hubieran sido posibles sin una fuerte habilidad de gestión a nivel hospitalario. Una meticulosa valoración de la disposición del sector sanitario a cambiar y del deseo de este a priorizar la calidad hospitalaria podría ser de gran ayuda en las primeras fases del diseño y la implementación. Esta evaluación podría incluir entrevistas con informadores clave, una recopilación de datos sobre instalaciones sanitarias, recursos humanos y debates con asociados del mundo académico. Poner en consonancia la visión del gobierno sobre la mejora de la calidad con los asociados y contribuyentes puede hacer aumentar la aceptación y el apoyo político. Dicho alineamiento puede permitir una focalización estratégica de los recursos respecto a un solo esfuerzo nacional, antes que esparcirlo en docenas de proyectos potencialmente conflictivos. Las fases iniciales son las principales beneficiadas de tener objetivos modestos y flexibilidad para modificar y mejorar de forma continua, a través de un compromiso activo con todos los accionistas.

Implementation of hospital governing boards: views from the field.

BACKGROUND: Decentralization through the establishment of hospital governing boards has been touted as an effective way to improve the quality and efficiency of hospitals in low-income countries. Although several studies have examined the process of decentralization, few have quantitatively assessed the implementation of hospital governing boards and their impact on hospital performance. Therefore, we sought to describe the functioning of governing boards and to determine the association between governing board functioning and hospital performance. METHODS: We conducted a cross-sectional study with governing board chairpersons to assess board (1) structure, (2) roles and responsibilities and (3) training and orientation practices. Using bivariate analysis and multivariable regression, we examined the association between governing board functioning and hospital performance. Hospital performance indicators: 1) percent of hospital management standards met, measured with the Ethiopian Hospital Reform Implementation Guidelines and 2) patient experience, measured with the Inpatient and Outpatient Assessment of Healthcare surveys. RESULTS: A total of 92 boards responded to the survey (96% response rate). The average percentage of EHRIG standards met was 58.1% (standard deviation (SD) 21.7 percentage points), and the mean overall patient experience score was 7.2 (SD 2.2). Hospitals with greater hospital management standards met had governing boards that paid members, reviewed performance in several domains quarterly or more frequently, developed new revenue sources, determined services to be outsourced, reviewed patient complaints, and had members with knowledge in business and financial management (all P-values < 0.05). Hospitals with more positive patient experience had governing boards that developed new revenue sources, determined services to be outsourced, and reviewed patient complaints (all P-values < 0.05). CONCLUSIONS: These cross-sectional data suggest that strengthening governing boards to perform essential responsibilities may result in improved hospital performance.

Assessing changes in adolescent girls' and young women's sexual and reproductive health service utilisation following a COVID-19 lockdown in eSwatini.

The effects of COVID-19-associated restrictions on youth sexual and reproductive health (SRH) care during the pandemic remain unclear, particularly in sub-Saharan Africa. This study uses interrupted time series analyses to assess changes in SRH care utilisation (including visits for HIV testing and treatment, family planning, and antenatal care) adolescent girls' and young women's (AGYW; aged 15-24 years old) in eSwatini following COVID-19 lockdown beginning in March 2020. SRH utilisation data from 32 clinics in the Manzini region that remained open throughout the 2020 COVID-19 period were extracted from eSwatini's electronic health record system. We tabulated and graphed monthly visits (both overall and by visit type) by AGYW during the two-year period between January 2019 and December 2020. Despite the March to September 2020 lockdown, we did not detect significant changes in monthly visit trends from 2019 to 2020. Our findings suggest little change to AGYW's SRH utilisation in eSwatini during the 2020 COVID-19 lockdown period.

Identifying characteristics associated with performing recommended practices in maternal and newborn care among health facilities in Rwanda: a cross-sectional study.

BACKGROUND: Although rates of maternal and neonatal mortality have decreased in many countries over the last two decades, they remain unacceptably high, particularly in sub-Saharan Africa. Nevertheless, we know little about the quality of facility-based maternal and newborn care in low-income countries and little about the association between quality of care and health worker training, supervision, and incentives in these settings. We therefore sought to examine the quality of facility-based maternal and newborn health care by describing the implementation of recommended practices for maternal and newborn care among health care facilities. We also aimed to determine whether increased training, supervision, and incentives for health workers were associated with implementing these recommended practices. We chose to study these aims in the Republic of Rwanda, where rates of maternal and newborn mortality are high and where substantial attention is currently focused on strengthening health workforce capacity and quality. METHODS: We used data from the 2007 Rwanda Service Provision Assessment. Using observations from 455 facilities and interviews from 1357 providers, we generated descriptive statistics to describe the use of recommended practices and frequencies of provider training, supervision, and incentives in the areas of antenatal, delivery, and newborn care. We then constructed multivariable regression models to examine the associations between using recommended practices and health provider training, supervision, and incentives. RESULTS: Use of recommended practices varied widely, and very few facilities performed all recommended practices. Furthermore, in most areas of care, less than 25% of providers reported having had any pre-service or in-service training in the last 3 years. Contrary to our hypotheses, we found no evidence that training, supervision, or incentives were consistently associated with using recommended practices. CONCLUSION: Our findings highlight the need to improve facility-based maternal and newborn care in Rwanda and suggest that current approaches to workforce training, supervision, and incentives may not be adequate for improving these critical practices.

Building hospital management capacity to improve patient flow for cardiac catheterization at a cardiovascular hospital in Egypt.

BACKGROUND: Quality improvement (QI) has been shown to be effective in improving hospital care in high-income countries, but evidence of its use in low- and middle-income countries has been limited to date. The impact of a QI intervention to reduce patient waiting time and overcrowding for cardiac catheterization-the subset of procedures associated with the most severe bottlenecks in patient flow at the National Heart Institute in Cairo-was investigated. METHODS: A pre-post intervention study was conducted to examine the impact of a new scheduling system on patient waiting time and overcrowdedness for cardiac catheterization. The sample consisted of 628 consecutive patients in the pre-intervention period (July-August 2009) and 1,607 in the postintervention period (September-November 2010). RESULTS: The intervention was associated with significant reductions in waiting time and patient crowdedness. On average, total patient waiting time from arrival to beginning the catheterization procedure decreased from 208 minutes to 180 minutes (13% decrease, p < .001). Time between arrival at registration and admission to inpatient ward unit decreased from 33 minutes to 24 minutes (27% decrease, p < .001). Patient waiting time immediately prior to the catheterization laboratory procedure decreased from 79 minutes to 58 minutes (27% decrease, p < .001). The percentage of patients arriving between 7:00 A.M. and 9:00 A.M. decreased from 88% to 44% (50% decrease, p < .001), reducing patient crowding. CONCLUSION: With little financial investment, the patient scheduling system significantly reduced waiting time and crowdedness in a resource-limited setting. The capacity-building effort enabled the hospital to sustain the scheduling system and data collection after the Egyptian revolution and departure of the mentoring team in January 2011.

Improving management of vaccine supply chains: A multi-methods evaluation of vSTEP in Zambia.

BACKGROUND: Equipping supply chain professionals at all levels of the health care systems with essential leadership and management skills is essential to achieving global immunization targets. Numerous and diverse professional development initiatives have been established to support vaccine supply chain managers in Gavi-eligible countries. However, COVID-19 catalyzed rapid innovation in approaches to support leadership development in times of rapid change, and systematic evaluation of these approaches can inform future workforce development strategies to ensure resilient health systems. Therefore, we sought to evaluate outcomes and short-term impact of the fully virtual Strategic Training Executive Program 2.0 (vSTEP 2.0) program in Zambia on participant engagement, skill development, and application of new skills to improve supply chain performance. METHODS: We used a multi-method design to describe the outcomes and short-term impact of vSTEP 2.0 at three levels: (1) delegate response to the training experience (including participation, completion, and satisfaction); (2) delegate change in leadership skill (including achievement of learning objectives and change in competencies); and (3) application of new skills to impact supply chain performance. RESULTS: The program achieved high levels of engagement and an 83% graduation rate despite the length and rigor of the program. High satisfaction was evidenced by positive feedback from delegates on the quality and relevance of the program, especially in the context of COVID response (100% would "definitely" recommend). Delegates demonstrated significant growth in all domains of leadership competencies and applied their learnings to address a complex challenge in supply chain performance in their home organization. DISCUSSION: These findings demonstrate a strong appetite for leadership development support among vaccine supply chain professionals, especially in times of rapid change such as during the COVID response. These results also demonstrate the feasibility and impact of a fully virtual model for leadership development, with implications well beyond the COVID-19 pandemic.

Measuring Organizational Culture in Ethiopia's Primary Care System: Validation of a Practical Survey Tool for Managers.

BACKGROUND: Organizational culture has been widely recognized as predictive of health system performance and improved outcomes across various healthcare settings. Research on organizational culture in healthcare has been largely conducted in high-income settings, and validated scales to measure this concept in primary healthcare systems in low- and middle-income country (LMIC) settings are lacking. Our study aimed to validate a tool to measure organizational culture in the context of the Ethiopian Primary Healthcare Transformation Initiative (PTI), a collaborative of the Federal Ministry of Health (FMoH) and the Yale Global Health Leadership Initiative to strengthen primary healthcare system performance in Ethiopia. METHODS: Following established survey development and adaptation guidelines, we adapted a 31-item US-based organizational culture scale using (1) cognitive interviewing, (2) testing with 1176 district and zonal health officials from four regions in Ethiopia, and (3) exploratory factor analysis (EFA). RESULTS: Based on the results of cognitive interviewing, an adapted 30-item survey was piloted. The factor analyses of 1034 complete surveys (88% complete responses) identified five constructs of the scale which demonstrated strong validity and internal consistency: learning and problem solving, psychological safety, resistance to change, time for improvement, and commitment to the organization. Of the 30 a priori items, 26 items loaded well on the five constructs (loading values 0.40-0.86), and 4 items failed to load. Cronbach alpha coefficients were 0.86 for the scale as a whole and ranged from 0.65 to 0.90 for the subscales. The five-factor solution accounted for 62% of total variance in culture scores across respondents. CONCLUSION: Through validation and factor analyses, we generated a 26-item scale for measuring organizational culture in public primary healthcare systems in LMIC settings. This validated tool can be useful for managers, implementers, policy-makers, and researchers to assess and improve organizational culture in support of improved primary healthcare system performance.

District-Level Health Management and Health System Performance: The Ethiopia Primary Healthcare Transformation Initiative.

BACKGROUND: Despite a wide range of interventions to improve district health management capacity in low-income settings, evidence of the impact of these investments on system-wide management capacity and primary healthcare systems performance is limited. To address this gap, we conducted a longitudinal study of the 36 rural districts (woredas), including 229 health centers, participating in the Primary Healthcare Transformation Initiative (PTI) in Ethiopia. METHODS: Between 2015 and 2017, we collected quantitative measures of management capacity at the district and health center levels and a primary healthcare key performance indicator (KPI) summary score based on antenatal care (ANC) coverage, contraception use, skilled birth attendance, infant immunization, and availability of essential medications. We conducted repeated measures analysis of variance (ANOVA) to assess (1) changes in management capacities at the district health office level and health center level, (2) changes in health systems performance, and (3) the differential effects of more vs less intensive intervention models. RESULTS: Adherence to management standards at both district and health center levels improved during the intervention, and the most prominent improvement was achieved during district managers' exposure to intensive mentorship and education. We did not observe similar patterns of change in KPI summary score. CONCLUSION: The district health office is a valuable entry point for primary healthcare reform, and district- and facility-level management capacity can be measured and improved in a relatively short period of time. A combination of intensive mentorship and structured team-based education can serve as both an accelerator for change and a mechanism to inform broader reform efforts.

The role of leadership in times of systems disruption: a qualitative study of health and social care integration.

OBJECTIVES: To understand whether and how effective integration of health and social care might occur in the context of major system disruption (the COVID-19 pandemic), with a focus on how the initiative may overcome past barriers to integration. DESIGN: Rapid, descriptive case study approach with deviant case sampling to gather and analyse key informant interviews and relevant archival documents. SETTING: The innovation ('COVID-19 Protect') took place in Norfolk and Waveney, UK, and aimed to foster integration across highly diverse organisations, capitalising on existing digital technology to proactively identify and support individuals most at risk of severe illness from COVID-19. PARTICIPANTS: Twenty-six key informants directly involved with project conceptualisation and early implementation. Participants included clinicians, executives, digital/information technology leads, and others. Final sample size was determined by theoretical saturation. RESULTS: Four primary recurrent themes characterised the experiences of diverse team members in the project: (1) ways of working that supported rapid collaboration, (2) leveraging diversity and clinician input for systems change, (3) allowing for both central control and local adaptation and (4) balancing risk taking and accountability. CONCLUSIONS: This rapid case study underscores the role of leadership in large systems change efforts, particularly in times of major disruption. Project leadership overcame barriers to integration highlighted by prior studies, including engaging with aversion to clinical/safety risk, fostering distributed leadership and developing shared organisational practices for data sharing and service delivery. These insights offer considerations for future efforts to support strategic integration of health and social care.

Creativity in problem solving to improve complex health outcomes: Insights from hospitals seeking to improve cardiovascular care.

Introduction: Improving performance often requires health care teams to employ creativity in problem solving, a key attribute of learning health systems. Despite increasing interest in the role of creativity in health care, empirical evidence documenting how this concept manifests in real-world contexts remains limited. Methods: We conducted a qualitative study to understand how creativity was fostered during problem solving in 10 hospitals that took part in a 2-year collaborative to improve cardiovascular care outcomes. We analyzed interviews with 197 hospital team members involved in the collaborative, focusing on work processes or outcomes that participants self-identified as creative or promoting creativity. We sought to identify recurrent patterns across instances of creativity in problem solving. Results: Participants reported examples of creativity at both stages typically identified in problem solving research and practice: uncovering non-obvious problems and finding novel solutions. Creativity generally involved the assembly of an "ecological view" of the care process, which reflected a more complete understanding of relationships between individual care providers, organizational sub-units, and their environment. Teams used three prominent behaviors to construct the ecological view: (a) collecting new and diverse information, (b) accepting (rather than dismissing) disruptive information, and (c) employing empathy to understand and share feelings of others. Conclusions: We anticipate that findings will be useful to researchers and practitioners who wish to understand how creativity can be fostered in problem solving to improve clinical outcomes and foster learning health systems.

Building leadership and management competencies of national immunization teams in 16 Gavi-eligible countries through the EPI leadership and management programme.

BACKGROUND: Strengthening leadership and management competencies among national Expanded Programme on Immunization (EPI) teams will be critical to achieving global immunization targets and other sustainable developmental goals. However, there is little empirical evidence of the effectiveness of investments in leadership and management capacity in the context of national EPI programs. Therefore, we sought to evaluate the EPI Leadership and Management Programme (EPI LAMP), a nine-month certificate program for EPI teams in national Ministries of Health from Gavi priority countries in Anglophone and Francophone Africa and Asia. METHODS: We used a mixed-methods longitudinal evaluation to describe EPI LAMP at four levels: (1) participant response to the training experience based on program administration records and satisfaction surveys; (2) change in management and leadership skill based on competency surveys and exit interviews; (3) change in behavior in the workplace based on exit interviews; and (4) impact of the training on EPI program performance based on the results of each delegate's leadership project. RESULTS: In the first three cohorts, the programme engaged 16 countries (63 participants) and achieved an 86% graduation rate (54 alumni). Participants demonstrated significant improvement in management and leadership competencies across eight domains with the largest improvement observed in the domain of governance and leadership. Women showed greater increases than men, especially in the domains of Operations Management and Political Advocacy and Dialogue. We observed no difference in the gains made by French-speaking delegates compared to English-speaking participants. Breakthrough projects developed by each team improved EPI program performance, as measured by metrics specific to each project. DISCUSSION: Our results show that team-based leadership programs can foster improvements in management practice, collaboration, and problem-solving, and that engagement the broader policy and organizational context is needed to foster the systems thinking capacity required to address complex challenges and improve system performance.

The Evolution of Trust Within a Global Health Partnership With the Private Sector: An Inductive Framework.

BACKGROUND: Public-private partnerships (PPPs) in global health are increasingly common to support sustainable development and strengthen health systems in low- and middle-income countries. Since the release of the Sustainable Development Goals (SDGs) in 2015 culminating in a discrete goal "to revitalize the global partnership for sustainable development," public health scholars have sought to understand what makes PPPs successful in different contexts. While trust has long been identified as a key component of successful strategic alliances in the private sector, less is known about how trust emerges between public- and private- sector partners, particularly in global health. Therefore, we investigated how trust between partners evolved in the context of Project Last Mile (PLM), a global health partnership that translates the business acumen of The Coca-Cola Company to strengthen public health systems across Africa. METHODS: This study draws upon secondary analysis of qualitative data generated as part of the longitudinal, mixed-methods evaluation of PLM across country settings. Seventy-seven interviews with a purposeful sample of key stakeholders were conducted in Mozambique, South Africa and eSwatini between August 2016 and July 2018. Trained qualitative interviewers followed a standard discussion guide, and audio-recorded interviews with participants' consent. In this secondary analysis, we analyzed qualitative data to understand how trust between partners was cultivated across settings. RESULTS: We drew upon stakeholder experiences to inform an inductive framework for how trust develops over time. Our analysis revealed five domains that were foundational to building trust: (1) reputational context, (2) team composition, (3) tangible outputs, (4) shared values, and (5) effective communication. CONCLUSION: The framework may be useful for private and public sector entities seeking to establish and sustain trust within their global health partnerships.

An Analysis of Zonal Health Management Capacity and Health System Performance: Ethiopia Primary Healthcare Transformation Initiative.

BACKGROUND: District management is emerging as a lynchpin for primary healthcare system performance. However, delivery of district-level interventions at scale is challenging, and overlooks the potential role of management at other subnational levels. From 2015-2019, Ethiopia's Primary Healthcare Transformation Initiative (PTI), aimed to build a culture of performance management and accountability at the zonal level. This paper aims to evaluate the longitudinal change in management practice and performance in the 19 zones participating in PTI, which included 315 districts and 1617 health centers. METHODS: Using data from PTI intervention (2018 to 2019), we employed quantitative measures of management capacity at health center, district, and zonal levels, and quantified primary healthcare service performance using a summary score based on antenatal care coverage, contraception use, skilled birth attendance, infant immunization, and availability of essential medications. We used multiple generalized linear regression models accounting for clustering of health centers within zones to quantify (1) change in management and performance during the two-year intervention, (2) associations between the changes in management capacity at the zonal, district, and health facility level. RESULTS: Adherence to management standards at the zonal, district, and health facility level improved significantly over two years (37%, P<.001; 18%, P<.001; 18%, P<.001; respectively), as did the performance summary score (14%, P<.001). Adherence at the zonal level in year one was associated with district level adherence in year one (P=.04), and, over the two-year period (P=.002), and district management mediated the relationship between management practice at zonal and health center levels (P<.001). CONCLUSION: Improvements in zonal-level management practice were associated with significant improvements in district-level management and performance in PTI sites. Investments in managerial practices at the zonal level may provide an immediate way to energize primary healthcare system performance at scale in low-income country settings.

Strengthening Public Health Scholarship in Sudan: The Role of Leadership and Mentorship Development.

A robust public health workforce in Sudan is essential for accelerating progress toward the Sustainable Development Goals, and strengthening public health education is a priority for the Ministries of Health and Higher Education. Faculty at public health training institutions are a critical resource. Globally, development programs for junior to midlevel public health faculty have been well documented. However, most involved direct partnership between a university from the Global North and only one or two universities from the Global South, only one included an explicit focus on creation of a leadership network, and none were launched as fully virtual collaborations. Therefore, we conducted a mixed-method evaluation of the fully virtual Yale-Sudan Program for Research Leadership in Public Health. We used program records, participant feedback, competency assessment, and network analysis to evaluate 1) participant engagement, 2) change in skill, and 3) change in collaboration. The program achieved a 93% graduation rate. All participants would "definitely" recommend the program and described the live virtual sessions as engaging, effective, and accessible. We observed progress toward learning objectives and significant increases in 13 of 14 leadership and mentorship competency domains. Collaboration across Sudanese institutions increased, including an almost doubling in the number of pairs reporting scholarly collaboration. Eight authorship teams are actively working toward peer-reviewed publications. The program engaged scholars and policymakers from across Sudan and the Sudanese diaspora achieved high levels of co-creation and continues despite significant political unrest in the country, serving as a promising model for strengthening of public health education in Sudan.