Drivers and Barriers to Improved Data Quality and Data-Use Practices: An Interpretative Qualitative Study in Addis Ababa, Ethiopia.

INTRODUCTION: An objective of the Information Revolution Roadmap of Ethiopia's Health Sector Transformation Plan was to improve health management information system (HMIS) data quality and data use at the point of health service delivery. We aimed to assess drivers of and barriers to improving HMIS data quality and use, focusing on key Information Revolution strategies including Connected Woreda, capacity building, performance monitoring teams, and motivational incentives. METHODS: We conducted an interpretative qualitative study across all 11 health centers in 3 subcities of Addis Ababa, Ethiopia: Yeka, Akaki-Kaliti, and Ledeta. A total of 40 key informant interviews and 6 focus group discussions with a total of 43 discussants were conducted. We coded information gathered line-by-line and grouped responses under thematic codes as they emerged. Findings were triangulated and validated. RESULTS: Our findings indicate that the main drivers of data quality and use at the point of service delivery were the use of the Connected Woreda strategy and its tools, capacity-building activities including mentorship, performance monitoring-team activities that led to active leadership engagement, and motivational incentives for data producers and users. Barriers to optimal data-use practices were the use of duplicative data collection tools at health facilities, under-developed health information system infrastructure, inadequate health information technician staffing and capacity limitations at the health facility level, insufficient leadership commitment, and unfavorable health worker attitudes toward data. DISCUSSION: Improvements in quality and use of HMIS data at health facilities are expected to result in delivering better-quality health services to the community as data enable health workers to identify gaps in health care, fix them, and monitor improvements. Future investments should focus on strengthening the promising data-use practices, resolving bottlenecks caused by duplicative data collection tools, enhancing individual and institutional capacity, addressing suboptimal health worker attitudes toward data, and overcoming infrastructure and connectivity challenges.

Maternal Service Coverage and Its Relationship To Health Information System Performance: A Linked Facility and Population-Based Survey in Ethiopia.

BACKGROUND: Studies in Ethiopia show an increasing trend in maternal health service use, such as having at least 4 visits of antenatal care (ANC4+) and skilled birth attendance (SBA). Improving the health information system (HIS) is an intervention that can improve service uptake and quality. We conducted a baseline study to measure current maternal service coverage, HIS performance status, and their relationship. METHODS: We conducted a linked health facility-level and population-based survey from September 2020 to October 2020. The study covers all regions of Ethiopia. For the population-based survey, 3,016 mothers were included. Overall, 81 health posts, 71 health centers, and 15 hospitals were selected for the facility survey. A two-stage sampling procedure was applied to select target households. The study used modified Performance of Routine Information System Management tools for the facility survey and a structured questionnaire for the household survey. Multilevel logistic regression was employed to account for clustering and control for likely confounders. RESULTS: Maternal service indicators, ANC4+ visits (54.0%), SBA (75.8%), postnatal care (70.6%), and cesarean delivery (9%) showed good service uptake. All data quality and use indicators showed lower performance compared to the national target of 90%. Maternal education and higher levels of wealth index were significantly and positively associated with all selected maternal service indicators. Longer distance from health facilities was significantly and negatively associated with SBA and the maternal care composite indicator. Among HIS-related indicators, availability of electronic HIS tools was significantly associated with maternal care composite indicator and ANC4+. CONCLUSIONS: Maternal service indicators showed promising performance. However, current HIS performance is suboptimal. Both service user and HIS-related factors were associated with maternal service uptake. Conducting similar research outside of the project sites will be helpful to have a wider understanding and better coverage.

Lessons Learned From the Capacity-Building and Mentorship Program to Improve Health Information Systems in 11 Districts of Ethiopia.

INTRODUCTION: Health information systems (HIS) performance in Ethiopia is currently insufficient, and improvements are required to ensure that decision making is data driven. We share our experiences from the early-stage implementation of a package of HIS capacity-strengthening interventions as part of an innovative academic-government collaboration that addresses challenges in HIS performance. METHODS: We used routine program data to assess HIS performance using the Performance of Routine Information System Management (PRISM) assessment tools. The assessment employed a pre-post design and was conducted in a total of 24 selected health facilities (6 hospitals and 18 health centers) from 11 districts in Ethiopia at project baseline (2018) and midline (2020). RESULTS: Source document completeness rate reached less than 80% for the majority of the assessed data elements. Improvements were observed in quarterly report completeness (26% vs. 83%) and timeliness (17% vs. 48%). Though data inaccuracies are noted for all assessed data elements in 2020, the majority (83%) of skilled birth attendance and HIV reports (68%) fall within the acceptable range of reporting accuracy. The identification of performance-related problems, using performance monitoring team (PMT) meetings, improved between 2018 and 2020 (67% vs 89%). Similar improvements were also observed in developing action plans to solve identified problems via the PMT (52% in 2018 vs. 89% in 2020). Data use for planning and target setting (65% in 2018 vs. 90% in 2020), reviewing performance (58% in 2018 vs. 60% in 2020), and supervision (51% in 2018 vs. 53% in 2020) all improved among assessed health facilities. DISCUSSION: This study showed that a capacity-building and mentorship program that engages experts from multiple disciplines and sectors can improve the quality and use of health data. This partnership enabled engagement between government and academic stakeholders and allowed for a more robust exchange of resources and expertise toward HIS improvement.

Current and Future Needs for Human Resources for Ethiopia's National Health Information System: Survey and Forecasting Study.

BACKGROUND: Strengthening the national health information system is one of Ethiopia's priority transformation agendas. A well-trained and competent workforce is the essential ingredient to a strong health information system. However, this workforce has neither been quantified nor characterized well, and there is no roadmap of required human resources to enhance the national health information system. OBJECTIVE: We aimed to determine the current state of the health information system workforce and to forecast the human resources needed for the health information system by 2030. METHODS: We conducted a survey to estimate the current number of individuals employed in the health information system unit and the turnover rate. Document review and key-informant interviews were used to collect current human resources and available health information system position data from 110 institutions, including the Ministry of Health, federal agencies, regional health bureaus, zonal health departments, district health offices, and health facilities. The Delphi technique was used to forecast human resources required for the health information system in the next ten years: 3 rounds of workshops with experts from the Ministry of Health, universities, agencies, and regional health bureaus were held. In the first expert meeting, we set criteria, which was followed by expert suggestions and feedback. RESULTS: As of April 2020, there were 10,344 health information system professionals working in the governmental health system. Nearly 95% (20/21) of district health offices and 86.7% (26/30) of health centers reported that the current number of health information system positions was inadequate. In the period from June 2015 to June 2019, health information technicians had high turnover (48/244, 19.7%) at all levels of the health system. In the next ten years, we estimate that 50,656 health information system professionals will be needed to effectively implement the Ethiopia's national health information system. CONCLUSIONS: Current health information system-related staffing levels were found to be inadequate. To meet the estimated need of 50,656 multidisciplinary health information system professionals by 2030, the Ministry of Health and regional health bureaus, in collaboration with partners and academic institutions, need to work on retaining existing and training additional health information system professionals.

Contribution of health information system to child immunization services in Ethiopia: baseline study of 33 woredas.

BACKGROUND: Monitoring progress using appropriate data, with a functional health information system (HIS), believed to be very crucial for success of immunization program. Baseline study was conducted to assess, immunization service coverage, HIS performance status, and their relationships. METHODS: A linked facility and population-based survey was conducted concurrently from September 21 to October 15, 2020. A total of 3016 households were reached to interview mothers having children aged 12-23 months in the 33 woredas. Overall 81 health posts, 71 health centers, and 15 hospitals were selected for the facility survey. The study used modified Performance of Routine Information System Management (PRISM) tools for the facility survey and a structured questionnaire for the household survey. Using STATA 14.0 software, mixed effect modeling was employed to control the effect of clustering and potential confounders. RESULTS: The proportion of fully immunized children was 58%. Coverages of measles (at least one dose) and penta3 immunization (received all 3 doses of DPT-HepB-Hib vaccine) were 86%, and 85% respectively. About 27% of mothers had missed their child immunization card mainly due to misplacing or lost. Except 'source document completeness' (85%) and 'use of data for planning and target setting' (84%), other data quality and use indicators like 'data accuracy' (63%), 'data use for performance review and evidence-based decision making' (50%), and 'data use to produce analytical reports' (31%) show low performance. The odds of fully immunized children is 37% lower in Muslims compared with Orthodox Christians (AOR, 0.63; 95%CI: 0.46, 0.88), higher by 42% with father's secondary education compared with no education (AOR, 1.42; 95%CI: 1.05, 1.92), and highest wealth quintile compared with lowest quintile (AOR, 2.49; 95%CI: 1.54, 4.03). For each additional score of HIS infrastructure availability, the odds of fully immunized children increased by 22% (AOR:1.22; 95% CI: 1.03, 1.44). CONCLUSIONS: Child immunization coverages are promising However, the current HIS performance is suboptimal. Both service user and HIS related factors are important for immunization service uptake. Documenting required information and advising mothers to keep immunization cards by health workers, and working to have functional HIS are recommended.

Strengthening the national health information system through a capacity-building and mentorship partnership (CBMP) programme: a health system and university partnership initiative in Ethiopia.

BACKGROUND: A strong health information system (HIS) is one of the essential building blocks for a resilient health system. The Ministry of Health (MOH) of Ethiopia is working on different initiatives to strengthen the national HIS. Among these is the Capacity-Building and Mentorship Partnership (CBMP) Programme in collaboration with public universities in Ethiopia since November 2017. This study aims to evaluate the outcomes and share experiences of the country in working with universities to strengthen the national HIS. METHODS: The study employed a mixed-methods approach that included 247 health organizations (health offices and facilities) of CBMP-implementing woredas (districts) and 23 key informant interviews. The programme focused on capacity-building and mentoring facilities and woreda health offices. The status of HIS was measured using a connected woreda checklist before and after the intervention. The checklist consists of items related to HIS infrastructure, data quality and administrative use. The organizations were classified as emerging, candidate or model based on the score. The findings were triangulated with qualitative data collected through key informant interviews. RESULTS: The results showed that the overall score of the HIS implementation was 46.3 before and 74.2 after implementation of the programme. The proportion of model organizations increased from 1.2% before to 31.8% after the programme implementation. The health system-university partnership has provided an opportunity for higher education institutions to understand the health system and tune their curricula to address real-world challenges. The partnership brought opportunities to conduct and produce local- and national-level evidence to improve the HIS. Weak ownership, poor responsiveness and poor perceptions of the programme were mentioned as major challenges in programme implementation. CONCLUSION: The overall HIS has shown substantial progress in CBMP implementation woredas. A number of facilities became models in a short period of time after the implementation of the programme. The health system-university partnership was found to be a promising approach to improve the national HIS and to share the on-the-ground experiences with the university academicians. However, weak ownership and poor responsiveness to feedback were the major challenges identified as needing more attention in future programme implementation.