Measuring Organizational Culture in Ethiopia's Primary Care System: Validation of a Practical Survey Tool for Managers.

BACKGROUND: Organizational culture has been widely recognized as predictive of health system performance and improved outcomes across various healthcare settings. Research on organizational culture in healthcare has been largely conducted in high-income settings, and validated scales to measure this concept in primary healthcare systems in low- and middle-income country (LMIC) settings are lacking. Our study aimed to validate a tool to measure organizational culture in the context of the Ethiopian Primary Healthcare Transformation Initiative (PTI), a collaborative of the Federal Ministry of Health (FMoH) and the Yale Global Health Leadership Initiative to strengthen primary healthcare system performance in Ethiopia. METHODS: Following established survey development and adaptation guidelines, we adapted a 31-item US-based organizational culture scale using (1) cognitive interviewing, (2) testing with 1176 district and zonal health officials from four regions in Ethiopia, and (3) exploratory factor analysis (EFA). RESULTS: Based on the results of cognitive interviewing, an adapted 30-item survey was piloted. The factor analyses of 1034 complete surveys (88% complete responses) identified five constructs of the scale which demonstrated strong validity and internal consistency: learning and problem solving, psychological safety, resistance to change, time for improvement, and commitment to the organization. Of the 30 a priori items, 26 items loaded well on the five constructs (loading values 0.40-0.86), and 4 items failed to load. Cronbach alpha coefficients were 0.86 for the scale as a whole and ranged from 0.65 to 0.90 for the subscales. The five-factor solution accounted for 62% of total variance in culture scores across respondents. CONCLUSION: Through validation and factor analyses, we generated a 26-item scale for measuring organizational culture in public primary healthcare systems in LMIC settings. This validated tool can be useful for managers, implementers, policy-makers, and researchers to assess and improve organizational culture in support of improved primary healthcare system performance.

District-Level Health Management and Health System Performance: The Ethiopia Primary Healthcare Transformation Initiative.

BACKGROUND: Despite a wide range of interventions to improve district health management capacity in low-income settings, evidence of the impact of these investments on system-wide management capacity and primary healthcare systems performance is limited. To address this gap, we conducted a longitudinal study of the 36 rural districts (woredas), including 229 health centers, participating in the Primary Healthcare Transformation Initiative (PTI) in Ethiopia. METHODS: Between 2015 and 2017, we collected quantitative measures of management capacity at the district and health center levels and a primary healthcare key performance indicator (KPI) summary score based on antenatal care (ANC) coverage, contraception use, skilled birth attendance, infant immunization, and availability of essential medications. We conducted repeated measures analysis of variance (ANOVA) to assess (1) changes in management capacities at the district health office level and health center level, (2) changes in health systems performance, and (3) the differential effects of more vs less intensive intervention models. RESULTS: Adherence to management standards at both district and health center levels improved during the intervention, and the most prominent improvement was achieved during district managers' exposure to intensive mentorship and education. We did not observe similar patterns of change in KPI summary score. CONCLUSION: The district health office is a valuable entry point for primary healthcare reform, and district- and facility-level management capacity can be measured and improved in a relatively short period of time. A combination of intensive mentorship and structured team-based education can serve as both an accelerator for change and a mechanism to inform broader reform efforts.

An Analysis of Zonal Health Management Capacity and Health System Performance: Ethiopia Primary Healthcare Transformation Initiative.

BACKGROUND: District management is emerging as a lynchpin for primary healthcare system performance. However, delivery of district-level interventions at scale is challenging, and overlooks the potential role of management at other subnational levels. From 2015-2019, Ethiopia's Primary Healthcare Transformation Initiative (PTI), aimed to build a culture of performance management and accountability at the zonal level. This paper aims to evaluate the longitudinal change in management practice and performance in the 19 zones participating in PTI, which included 315 districts and 1617 health centers. METHODS: Using data from PTI intervention (2018 to 2019), we employed quantitative measures of management capacity at health center, district, and zonal levels, and quantified primary healthcare service performance using a summary score based on antenatal care coverage, contraception use, skilled birth attendance, infant immunization, and availability of essential medications. We used multiple generalized linear regression models accounting for clustering of health centers within zones to quantify (1) change in management and performance during the two-year intervention, (2) associations between the changes in management capacity at the zonal, district, and health facility level. RESULTS: Adherence to management standards at the zonal, district, and health facility level improved significantly over two years (37%, P<.001; 18%, P<.001; 18%, P<.001; respectively), as did the performance summary score (14%, P<.001). Adherence at the zonal level in year one was associated with district level adherence in year one (P=.04), and, over the two-year period (P=.002), and district management mediated the relationship between management practice at zonal and health center levels (P<.001). CONCLUSION: Improvements in zonal-level management practice were associated with significant improvements in district-level management and performance in PTI sites. Investments in managerial practices at the zonal level may provide an immediate way to energize primary healthcare system performance at scale in low-income country settings.

District-level health management and health system performance.

Strengthening district-level management may be an important lever for improving key public health outcomes in low-income settings; however, previous studies have not established the statistical associations between better management and primary healthcare system performance in such settings. To explore this gap, we conducted a cross-sectional study of 36 rural districts and 226 health centers in Ethiopia, a country which has made ambitious investment in expanding access to primary care over the last decade. We employed quantitative measure of management capacity at both the district health office and health center levels and used multiple regression models, accounting for clustering of health centers within districts, to estimate the statistical association between management capacity and a key performance indicator (KPI) summary score based on antenatal care coverage, contraception use, skilled birth attendance, infant immunization, and availability of essential medications. In districts with above median district management capacity, health center management capacity was strongly associated (p < 0.05) with KPI performance. In districts with below median management capacity, health center management capacity was not associated with KPI performance. Having more staff at the district health office was also associated with better KPI performance (p < 0.05) but only in districts with above median management capacity. The results suggest that district-level management may provide an opportunity for improving health system performance in low-income country settings.