Drivers and Barriers to Improved Data Quality and Data-Use Practices: An Interpretative Qualitative Study in Addis Ababa, Ethiopia.

INTRODUCTION: An objective of the Information Revolution Roadmap of Ethiopia's Health Sector Transformation Plan was to improve health management information system (HMIS) data quality and data use at the point of health service delivery. We aimed to assess drivers of and barriers to improving HMIS data quality and use, focusing on key Information Revolution strategies including Connected Woreda, capacity building, performance monitoring teams, and motivational incentives. METHODS: We conducted an interpretative qualitative study across all 11 health centers in 3 subcities of Addis Ababa, Ethiopia: Yeka, Akaki-Kaliti, and Ledeta. A total of 40 key informant interviews and 6 focus group discussions with a total of 43 discussants were conducted. We coded information gathered line-by-line and grouped responses under thematic codes as they emerged. Findings were triangulated and validated. RESULTS: Our findings indicate that the main drivers of data quality and use at the point of service delivery were the use of the Connected Woreda strategy and its tools, capacity-building activities including mentorship, performance monitoring-team activities that led to active leadership engagement, and motivational incentives for data producers and users. Barriers to optimal data-use practices were the use of duplicative data collection tools at health facilities, under-developed health information system infrastructure, inadequate health information technician staffing and capacity limitations at the health facility level, insufficient leadership commitment, and unfavorable health worker attitudes toward data. DISCUSSION: Improvements in quality and use of HMIS data at health facilities are expected to result in delivering better-quality health services to the community as data enable health workers to identify gaps in health care, fix them, and monitor improvements. Future investments should focus on strengthening the promising data-use practices, resolving bottlenecks caused by duplicative data collection tools, enhancing individual and institutional capacity, addressing suboptimal health worker attitudes toward data, and overcoming infrastructure and connectivity challenges.

Maternal Service Coverage and Its Relationship To Health Information System Performance: A Linked Facility and Population-Based Survey in Ethiopia.

BACKGROUND: Studies in Ethiopia show an increasing trend in maternal health service use, such as having at least 4 visits of antenatal care (ANC4+) and skilled birth attendance (SBA). Improving the health information system (HIS) is an intervention that can improve service uptake and quality. We conducted a baseline study to measure current maternal service coverage, HIS performance status, and their relationship. METHODS: We conducted a linked health facility-level and population-based survey from September 2020 to October 2020. The study covers all regions of Ethiopia. For the population-based survey, 3,016 mothers were included. Overall, 81 health posts, 71 health centers, and 15 hospitals were selected for the facility survey. A two-stage sampling procedure was applied to select target households. The study used modified Performance of Routine Information System Management tools for the facility survey and a structured questionnaire for the household survey. Multilevel logistic regression was employed to account for clustering and control for likely confounders. RESULTS: Maternal service indicators, ANC4+ visits (54.0%), SBA (75.8%), postnatal care (70.6%), and cesarean delivery (9%) showed good service uptake. All data quality and use indicators showed lower performance compared to the national target of 90%. Maternal education and higher levels of wealth index were significantly and positively associated with all selected maternal service indicators. Longer distance from health facilities was significantly and negatively associated with SBA and the maternal care composite indicator. Among HIS-related indicators, availability of electronic HIS tools was significantly associated with maternal care composite indicator and ANC4+. CONCLUSIONS: Maternal service indicators showed promising performance. However, current HIS performance is suboptimal. Both service user and HIS-related factors were associated with maternal service uptake. Conducting similar research outside of the project sites will be helpful to have a wider understanding and better coverage.

Contribution of health information system to child immunization services in Ethiopia: baseline study of 33 woredas.

BACKGROUND: Monitoring progress using appropriate data, with a functional health information system (HIS), believed to be very crucial for success of immunization program. Baseline study was conducted to assess, immunization service coverage, HIS performance status, and their relationships. METHODS: A linked facility and population-based survey was conducted concurrently from September 21 to October 15, 2020. A total of 3016 households were reached to interview mothers having children aged 12-23 months in the 33 woredas. Overall 81 health posts, 71 health centers, and 15 hospitals were selected for the facility survey. The study used modified Performance of Routine Information System Management (PRISM) tools for the facility survey and a structured questionnaire for the household survey. Using STATA 14.0 software, mixed effect modeling was employed to control the effect of clustering and potential confounders. RESULTS: The proportion of fully immunized children was 58%. Coverages of measles (at least one dose) and penta3 immunization (received all 3 doses of DPT-HepB-Hib vaccine) were 86%, and 85% respectively. About 27% of mothers had missed their child immunization card mainly due to misplacing or lost. Except 'source document completeness' (85%) and 'use of data for planning and target setting' (84%), other data quality and use indicators like 'data accuracy' (63%), 'data use for performance review and evidence-based decision making' (50%), and 'data use to produce analytical reports' (31%) show low performance. The odds of fully immunized children is 37% lower in Muslims compared with Orthodox Christians (AOR, 0.63; 95%CI: 0.46, 0.88), higher by 42% with father's secondary education compared with no education (AOR, 1.42; 95%CI: 1.05, 1.92), and highest wealth quintile compared with lowest quintile (AOR, 2.49; 95%CI: 1.54, 4.03). For each additional score of HIS infrastructure availability, the odds of fully immunized children increased by 22% (AOR:1.22; 95% CI: 1.03, 1.44). CONCLUSIONS: Child immunization coverages are promising However, the current HIS performance is suboptimal. Both service user and HIS related factors are important for immunization service uptake. Documenting required information and advising mothers to keep immunization cards by health workers, and working to have functional HIS are recommended.

Exploring data quality and use of the routine health information system in Ethiopia: a mixed-methods study.

OBJECTIVE: A routine health information system (RHIS) enables decision making in the healthcare system. We aimed to analyse data quality at the district and regional level and explore factors and perceptions affecting the quality and use of routine data. DESIGN: This was a mixed-methods study. We used the WHO toolkit for analysing data quality and interviewed staff at the point of data generation and along with the flow of data. Data were analysed using the Performance of Routine Information System Management framework. SETTING: This study was performed in eight districts in four regions of Ethiopia. The study was nested within a 2-year programme of the Operational Research and Coaching for government Analysts. PARTICIPANTS: We visited 45 health posts, 1 district hospital, 16 health centres and 8 district offices for analysis of routine RHIS data and interviewed 117 staff members for the qualitative assessment. OUTCOME MEASURES: We assessed availability of source documents, completeness, timeliness and accuracy of reporting of routine data, and explored data quality and use perceptions. RESULTS: There was variable quality of both indicator and data element. Data on maternal health and immunisation were of higher quality than data on child nutrition. Issues ranged from simple organisational factors, such as availability of register books, to intricate technical issues, like complexity of indicators and choice of denominators based on population estimates. Respondents showed knowledge of the reporting procedures, but also demonstrated limited skills, lack of supportive supervision and reporting to please the next level. We saw limited examples of the use of data by the staff who were responsible for data reporting. CONCLUSION: We identified important organisational, technical, behavioural and process factors that need further attention to improve the quality and use of RHIS data in Ethiopia.

Routine health management information system data in Ethiopia: consistency, trends, and challenges.

Background: Ethiopia is investing in the routine Health Management Information System. Improved routine data are needed for decision-making in the health sector. Objective: To analyse the quality of the routine Health Management Information System data and triangulate with other sources, such as the Demographic and Health Surveys. Methods: We analysed national Health Management Information System data on 19 indicators of maternal health, neonatal survival, immunization, child nutrition, malaria, and tuberculosis over the 2012-2018 time period. The analyses were conducted by 38 analysts from the Ministry of Health, Ethiopia, and two government agencies who participated in the Operational Research and Coaching for Analysts (ORCA) project between June 2018 and June 2020. Using a World Health Organization Data Quality Review toolkit, we assessed indicator definitions, completeness, internal consistency over time and between related indicators, and external consistency compared with other data sources. Results: Several services reported coverage of above 100%. For many indicators, denominators were based on poor-quality population data estimates. Data on individual vaccinations had relatively good internal consistency. In contrast, there was low external consistency for data on fully vaccinated children, with the routine Health Management Information System showing 89% coverage but the Demographic and Health Survey estimate at 39%. Maternal health indicators displayed increasing coverage over time. Indicators on child nutrition, malaria, and tuberculosis were less consistent. Data on neonatal mortality were incomplete and operationalised as mortality on day 0-6. Our comparisons with survey and population projections indicated that one in eight early neonatal deaths were reported in the routine Health Management Information System. Data quality varied between regions. Conclusions: The quality of routine data gathered in the health system needs further attention. We suggest regular triangulation with data from other sources. We recommend addressing the denominator issues, reducing the complexity of indicators, and aligning indicators to international definitions.