Key Characteristics and Perception of Different Outbreak Surveillance Systems in Côte d'Ivoire: Cross-Sectional Survey Among Users.

Background: Accurate and timely infectious disease surveillance is pivotal for effective public health responses. An important component of this is the disease surveillance tools used. Understanding views and experiences of users is crucial for informing policy decisions and ensuring the seamless functioning of surveillance systems. Objective: In this study, we aimed to assess the user perceptions of 3 disease surveillance tools used in Côte d'Ivoire, namely, MAGPI, District Health Information Software 2 (DHIS2), and Surveillance Outbreak Response Management and Analysis System (SORMAS), the latter was implemented in 2021 within a pilot scheme. Methods: We conducted interviews and a web-based survey distributed to users of the 3 surveillance tools. The survey assessed users' views of the surveillance tools' usefulness, ease of use, feelings toward the tool, conditions that may influence the use, and other characteristics. The descriptive analysis compared responses from SORMAS, MAGPI, and DHIS2 users, providing a comprehensive evaluation of their experiences. Results: Among the 159 respondents who actively use one of the systems, MAGPI was the most widely used surveillance tool among respondents (n=127, 79.9%), followed by DHIS2 (n=108, 67.9%), and SORMAS (n=25, 15.7%). In terms of users' perceptions, SORMAS, despite its limited implementation, emerged as a tool that allows for data analysis and had the most comprehensive set of functionalities. DHIS2 was appreciated for its frequency of report provision, although users reported occasional IT system failures. MAGPI was recognized for its ease of use but was reported to lack certain functionalities offered by the other surveillance systems. Conclusions: This study offers valuable insights into the perceptions of disease surveillance tools users in Côte d'Ivoire. While all systems were positively regarded, each exhibited strengths and weaknesses addressing different needs and functionalities. Policy makers and health officials can use these findings to enhance existing tools or consider a unified approach for infectious disease surveillance systems. Understanding users' perspectives allows them to optimize the choice of surveillance tools, ultimately strengthening public health responses in Côte d'Ivoire and potentially serving as a model for other countries facing similar decisions in their health care systems.

The quality of routine data for measuring facility-based maternal mortality in public and private health facilities in Kampala City, Uganda.

BACKGROUND: Routine health facility data are an important source of health information in resource-limited settings. Regular quality assessments are necessary to improve the reliability of routine data for different purposes, including estimating facility-based maternal mortality. This study aimed to assess the quality of routine data on deliveries, livebirths and maternal deaths in Kampala City, Uganda. METHODS: We reviewed routine health facility data from the district health information system (DHIS2) for 2016 to 2021. This time period included an upgrade of DHIS2, resulting in two datasets (2016-2019 and 2020-2021) that were managed separately. We analysed data for all facilities that reported at least one delivery in any of the six years, and for a subset of facilities designated to provide emergency obstetric care (EmOC). We adapted the World Health Organization data quality review framework to assess completeness and internal consistency of the three data elements, using 2019 and 2021 as reference years. Primary data were collected to verify reporting accuracy in four purposively selected EmOC facilities. Data were disaggregated by facility level and ownership. RESULTS: We included 255 facilities from 2016 to 2019 and 247 from 2020 to 2021; of which 30% were EmOC facilities. The overall completeness of data for deliveries and livebirths ranged between 53% and 55%, while it was < 2% for maternal deaths (98% of monthly values were zero). Among EmOC facilities, completeness was higher for deliveries and livebirths at 80%; and was < 6% for maternal deaths. For the whole sample, the prevalence of outliers for all three data elements was < 2%. Inconsistencies over time were mostly observed for maternal deaths, with the highest difference of 96% occurring in 2021. CONCLUSIONS: Routine data from childbirth facilities in Kampala were generally suboptimal, but the quality was better in EmOC facilities. Given likely underreporting of maternal deaths, further efforts to verify and count all facility-related maternal deaths are essential to accurately estimate facility-based maternal mortality. Data reliability could be enhanced by improving reporting practices in EmOC facilities and streamlining reporting processes in private-for-profit facilities. Further qualitative studies should identify critical points where data are compromised, and data quality assessments should consider service delivery standards.

Electronic oral health surveillance system for Egyptian preschoolers using District Health Information System (DHIS2): design description and time motion study.

BACKGROUND: Early childhood caries (ECC) is a major global health issue affecting millions of children. Mitigating this problem requires up-to-date information from reliable surveillance systems. This enables evidence-based decision-making to devise oral health policies. The World Health Organization (WHO) advocates the adoption of mobile technologies in oral disease surveillance because of their efficiency and ease of application. The study describes developing an electronic, oral health surveillance system (EOHSS) for preschoolers in Egypt, using the District Health Information System (DHIS2) open-source platform along with its Android App, and assesses its feasibility in data acquisition. METHODS: The DHIS2 Server was configured for the DHIS2 Tracker Android Capture App to allow individual-level data entry. The EOHSS indicators were selected in line with the WHO Action Plan 2030. Two modalities for the EOHSS were developed based on clinical data capture: face-to-face and tele/asynchronous. Eight dentists in the pilot team collected 214 events using modality-specific electronic devices. The pilot's team's feedback was obtained regarding the EOHSS's feasibility in collecting data, and a time-motion study was conducted to assess workflow over two weeks. Independent t-test and Statistical Process Control techniques were used for data analysis. RESULTS: The pilot team reported positive feedback on the structure of the EOHSS. Workflow adaptations were made to prioritize surveillance tasks by collecting data from caregivers before acquiring clinical data from children to improve work efficiency. A shorter data capture time was required during face-to-face modality (4.2 ± 0.7 min) compared to telemodality (5.1 ± 0.9 min), p < 0.001). The acquisition of clinical data accounted for 16.9% and 21.1% of the time needed for both modalities, respectively. The time required by the face-to-face modality showed random variation, and the tele-modality tasks showed a reduced time trend to perform tasks. CONCLUSIONS: The DHIS2 provides a feasible solution for developing electronic, oral health surveillance systems. The one-minute difference in data capture time in telemodality compared to face-to-face indicates that despite being slightly more time-consuming, telemodality still shows promise for remote oral health assessments that is particularly valuable in areas with limited access to dental professionals, potentially expanding the reach of oral health screening programs.

Maturity Assessment of District Health Information System Version 2 Implementation in Ethiopia: Current Status and Improvement Pathways.

BACKGROUND: Although Ethiopia has made remarkable progress in the uptake of the District Health Information System version 2 (DHIS2) for national aggregate data reporting, there has been no comprehensive assessment of the maturity level of the system. OBJECTIVE: This study aims to assess the maturity level of DHIS2 implementation in Ethiopia and propose a road map that could guide the progress toward a higher level of maturity. We also aim to assess the current maturity status, implementation gaps, and future directions of DHIS2 implementation in Ethiopia. The assessment focused on digital health system governance, skilled human resources, information and communication technology (ICT) infrastructure, interoperability, and data quality and use. METHODS: A collaborative assessment was conducted with the engagement of key stakeholders through consultative workshops using the Stages of Continuous Improvement tool to measure maturity levels in 5 core domains, 13 components, and 39 subcomponents. A 5-point scale (1=emerging, 2=repeatable, 3=defined, 4=managed, and 5=optimized) was used to measure the DHIS2 implementation maturity level. RESULTS: The national DHIS2 implementation's maturity level is currently at the defined stage (score=2.81) and planned to move to the manageable stage (score=4.09) by 2025. The domain-wise maturity score indicated that except for ICT infrastructure, which is at the repeatable stage (score=2.14), the remaining 4 domains are at the defined stage (score=3). The development of a standardized and basic DHIS2 process at the national level, the development of a 10-year strategic plan to guide the implementation of digital health systems including DHIS2, and the presence of the required competencies at the facility level to accomplish specific DHIS2-related tasks are the major strength of the Ministry of Health of Ethiopia so far. The lack of workforce competency guidelines to support the implementation of DHIS2; the unavailability of core competencies (knowledge, skills, and abilities) required to accomplish DHIS2 tasks at all levels of the health system; and ICT infrastructures such as communication network and internet connectivity at the district, zonal, and regional levels are the major hindrances to effective DHIS2 implementation in the country. CONCLUSIONS: On the basis of the Stages of Continuous Improvement maturity model toolkit, the implementation status of DHIS2 in Ethiopia is at the defined stage, with the ICT infrastructure domain being at the lowest stage as compared to the other 4 domains. By 2025, the maturity status is planned to move from the defined stage to the managed stage by improving the identified gaps. Various action points are suggested to address the identified gaps and reach the stated maturity level. The responsible body, necessary resources, and methods of verification required to reach the specified maturity level are also listed.

Digitalizing disease surveillance: experience from Sierra Leone.

The Integrated Disease Surveillance and Response (IDSR) system was adopted by the Sierra Leone Ministry of Health (MOH) in 2008, which was based on paper-based tools for health data recording and reporting from health facilities to the national level. The Sierra Leone MoH introduced the implementation of electronic case-based disease surveillance reporting of immediately notifiable diseases. This study aimed to document and describe the experience of Sierra Leone in transforming her paper-based disease surveillance system into an electronic disease surveillance system. Retrospective mixed methods of qualitative and quantitative data were reviewed. Qualitative data was collected by reviewing surveillance technical reports, epidemiological bulletins, COVID-19, IDSR technical guidelines, Digital Health strategy, and DHIS2 documentation. Content and thematic data analysis were performed for the qualitative data, while Microsoft Excel and DHIS2 platform were used for the quantitative data analysis to document the experience of Sierra Leone in digitalizing its disease surveillance system. In early 2017, a web-based electronic Case-Based Disease Surveillance (eCBDS) for real-time reporting of immediately notifiable diseases and health threats was piloted using the District Health Information System 2 (DHIS2) software. The eCBDS, integrates case profile, laboratory, and final outcome data. All captured data and information are immediately accessible to users with the required credentials. The system can be accessed via a browser or an Android DHIS2 application. By 2021, there was a significant increase in the proportion of immediately notifiable cases reported through the facility-level electronic platform, and more than 80% of the cases reported through the weekly surveillance platform had case-based data in eCBDS. Case-based data from the platform is analyzed and disseminated to stakeholders for public health decision-making. Several outbreaks of Lassa fever, Measles, vaccine-derived Polio, and Anthrax have been tracked in real-time through the eCBDS.

Experiences, Lessons, and Challenges With Adapting REDCap for COVID-19 Laboratory Data Management in a Resource-Limited Country: Descriptive Study.

BACKGROUND: The COVID-19 pandemic brought challenges requiring timely health data sharing to inform accurate decision-making at national levels. In Botswana, we adapted and integrated the Research Electronic Data Capture (REDCap) and the District Health Information System version 2 (DHIS2) platforms to support timely collection and reporting of COVID-19 cases. We focused on establishing an effective COVID-19 data flow at the national public health laboratory, being guided by the needs of health care professionals at the National Health Laboratory (NHL). This integration contributed to automated centralized reporting of COVID-19 results at the Ministry of Health (MOH). OBJECTIVE: This paper reports the experiences, challenges, and lessons learned while designing, adapting, and implementing the REDCap and DHIS2 platforms to support COVID-19 data management at the NHL in Botswana. METHODS: A participatory design approach was adopted to guide the design, customization, and implementation of the REDCap platform in support of COVID-19 data management at the NHL. Study participants included 29 NHL and 4 MOH personnel, and the study was conducted from March 2, 2020, to June 30, 2020. Participants' requirements for an ideal COVID-19 data management system were established. NVivo 11 software supported thematic analysis of the challenges and resolutions identified during this study. These were categorized according to the 4 themes of infrastructure, capacity development, platform constraints, and interoperability. RESULTS: Overall, REDCap supported the majority of perceived technical and nontechnical requirements for an ideal COVID-19 data management system at the NHL. Although some implementation challenges were identified, each had mitigation strategies such as procurement of mobile Internet routers, engagement of senior management to resolve conflicting policies, continuous REDCap training, and the development of a third-party web application to enhance REDCap's capabilities. Lessons learned informed next steps and further refinement of the REDCap platform. CONCLUSIONS: Implementation of REDCap at the NHL to streamline COVID-19 data collection and integration with the DHIS2 platform was feasible despite the urgency of implementation during the pandemic. By implementing the REDCap platform at the NHL, we demonstrated the possibility of achieving a centralized reporting system of COVID-19 cases, hence enabling timely and informed decision-making at a national level. Challenges faced presented lessons learned to inform sustainable implementation of digital health innovations in Botswana and similar resource-limited countries.

Rapid assessment of data systems for COVID-19 vaccination in the WHO African Region.

Most countries in Africa deployed digital solutions to monitor progress in rolling out COVID-19 vaccines. A rapid assessment of existing data systems for COVID-19 vaccines in the African region was conducted between May and July 2022, in 23 countries. Data were collected through interviews with key informants, identified among senior staff within Ministries of Health, using a semi-structured electronic questionnaire. At vaccination sites, individual data were collected in paper-based registers in five countries (21.7%), in an electronic registry in two countries (8.7%), and in the remaining 16 countries (69.6%) using a combination of paper-based and electronic registries. Of the 18 countries using client-based digital registries, 11 (61%) deployed the District Health Information System 2 Tracker, and seven (39%), a locally developed platform. The mean percentage of individual data transcribed in the electronic registries was 61% ± 36% standard deviation. Unreliable Internet coverage (100% of countries), non-payment of data clerks' incentives (89%), and lack of electronic devices (89%) were the main reasons for the suboptimal functioning of digital systems quoted by key informants. It is critical for investments made and experience acquired in deploying electronic platforms for COVID-19 vaccines to be leveraged to strengthen routine immunization data management.

Evaluation of the malaria case surveillance system in KwaZulu-Natal Province, South Africa, 2022: a focus on DHIS2.

BACKGROUND: South Africa set a target to eliminate malaria by 2023, with KwaZulu-Natal (KZN) Province the malaria-endemic province closest to achieving this goal. Objective two of the National Malaria Elimination Strategic Plan (NMESP) focused on strengthening surveillance systems to support the country's elimination efforts. Regular evaluations of the malaria surveillance systems against the targets of the NMESP objective are crucial in improving their performance and impact. This study aimed to assess whether the malaria surveillance system in KwaZulu-Natal Province meets the NMESP surveillance objective and goals. METHODS: A mixed-methods cross-sectional study design was used to evaluate the malaria surveillance system, focusing on the District Health Information System 2 (DHIS2). The study assessed the data quality, timeliness, simplicity, and acceptability of the system. Key personnel from KZN's Provincial malaria control programme were interviewed using self-administered questionnaires to evaluate their perception of the system's simplicity and acceptability. Malaria case data from January 2016 to December 2020 were extracted from the DHIS2 and evaluated for data quality and timeliness. RESULTS: The survey respondents generally found the DHIS2-based surveillance system acceptable (79%, 11/14) and easy to use (71%, 10/14), stating that they could readily find, extract, and share data (64%, 9/14). Overall data quality was good (88.9%), although some variables needed for case classification had low completeness and data availability. However, case notifications were not timely, with only 61% (2 622/4 329) of cases notified within 24 h of diagnosis. During the 5-year study period, the DHIS2 captured 4 333 malaria cases. The majority of cases (81%, 3 489/4 330) were categorized as imported, and predominately in males (67%, 2 914/4 333). CONCLUSION: While the malaria surveillance system in KZN Province largely met the NMESP surveillance strategic goals, it failed to achieve the overarching surveillance objective of 100% notification of cases within 24 h of diagnosis. The majority of reported cases in KZN Province were classified as imported, emphasizing the importance of complete data for accurate case classification. Engaging with healthcare professionals responsible for case notification and disseminating aggregated data back to them is needed to encourage and improve notification timeliness.

Electronic aggregated data collection on cervical cancer screening in Bangladesh since 2014: what the data tells us?

INTRODUCTION: To reduce the high prevalence of cervical cancers among the Bangladeshi women, the Government of Bangladesh established a national cervical cancer screening programme in 2005 for women aged 30 to 60 years. The District Health Information System Version 2 (DHIS2) based electronic aggregated data collection system is used since the year 2013. This study summarises data from the year 2014 to 2022 to assess the effectiveness of the electronic data collection system in understanding the outcome of the screening programme. METHODS: This is a descriptive study based on secondary data extracted in MS Excel from the DHIS2-based electronic repository of the national cervical cancer screening programme of Bangladesh. The respondents were women aged 30-60 years, screened for cervical cancer using VIA (Visual Inspection of cervix with Acetic acid) method in 465 government health facilities. The data were collected on the participants' residential location, month and year of screening, name and type of health facilities performing VIA, and VIA screening results. RESULTS: The national screening programme reported a total 3.36 million VIA tests from 465 government hospitals in 8 years (2014 to 2022). The national average VIA-positivity rate was 3.6%, which varied from 1.4 to 9.5% among the districts. This national screening programme witnessed an exponential growth, year after year, with 83.3% increase in VIA test from 2014 to 2022. The primary and the secondary care hospitals were the highest collective contributors of VIA tests (86.2%) and positive cases (77.8%). The VIA-positivity rates in different hospital types varied widely, 7.0% in the medical university hospital, 5.7% in the medical college hospitals, 3.9% in the district/general hospitals, and 3.0% in the upazila health complexes. CONCLUSIONS: A national cervical cancer screening programme using VIA method and a DHIS2-based electronic data collection backbone, is effective, sustainable, and useful to understand the screening coverage, VIA positivity rate and geographic distribution of the participants and case load to initiate policy recommendations and actions. Decentralization of the screening programme and more efforts at the primary and secondary care level is required to increase screening performances.

District health information system (DHIS2) as integrated antimicrobial resistance surveillance platform: An exploratory qualitative investigation of the one health stakeholders' viewpoints in Ethiopia.

INTRODUCTION: There is an unmet need for One Health (OH) surveillance and reporting systems for antimicrobial resistance (AMR) in resource poor settings. District health information system, version 2 (DHIS2), is a globally recognized digital surveillance platform which has not been widely utilized for AMR data yet. Our study aimed to understand the local stakeholders' viewpoints on DHIS2 as OH-AMR surveillance platform in Jimma, Ethiopia which will aid its further context specific establishment. METHODS: We performed an exploratory qualitative study using semi-structured key informant interviews (KIIs) in Jimma Zone at Southwest Ethiopia. We interviewed 42 OH professionals between November 2020 and February 2021. Following verbatim transcription of the audio recordings of KIIs, we conducted thematic analysis. RESULTS: We identified five major themes which are important for understanding the trajectory of OH-AMR surveillance in DHIS2 platform. The themes were: (1) Stakeholders' current knowledge on digital surveillance platforms including DHIS2. (2) Stakeholders' perception on digital surveillance platform including DHIS2. (3) Features suggested by stakeholders to be included in the surveillance platform. (4) Comments from stakeholders on system implementation challenges. (5) Stakeholders' perceived role in the process of implementation. Despite several barriers and challenges, most of the participants perceived and suggested DHIS2 as a suitable OH-AMR surveillance platform and were willing to contribute at their current professional roles. CONCLUSIONS: Our study demonstrates the potential of the DHIS2 as a user friendly and acceptable interoperable platform for OH-AMR surveillance if the technology designers accommodate the stakeholders' concerns. Piloting at local level and using performance appraisal tool in all OH disciplines should be the next step before proceeding to workable format.

The transition of human resources for health information systems from the MDGs into the SDGs and the post-pandemic era: reviewing the evidence from 2000 to 2022.

BACKGROUND: This review paper offers a policy-tracing trend analysis of national experiences among low- and middle-income countries in strengthening human resources for health information systems (HRHIS). This paper draws on evidence from the last two decades and applies a modified Bardach's policy analysis framework. A timely review of the evidence on HRHIS and underlying data systems is needed now more than ever, given the halfway mark of the Global Strategy on Human Resources for Health: Workforce 2030 and the protracted COVID-19 pandemic and other global health emergencies, over and above the increasing need for health and care workers to provide essential health services. MAIN TEXT: Considering World Health Assembly resolutions and HRH-related global developments between 2000 and 2022, we targeted peer-reviewed and gray literature covering the inception, impact, bottlenecks, and gaps of HRHIS. We also considered results from a Bill and Melinda Gates Foundation-funded project that assessed HRH data systems in 21 countries and the use of HRH data and information for policy, planning, and management. Aligned with the National Health Workforce Accounts (NHWA), we identify priority themes related to digital priorities for HRHIS and governance/leadership and present case studies of five countries that pursued different pathways to successfully develop their HRHIS. Over the last two decades, considerable progress has been achieved through a scaled-up implementation of HRHIS combined with the skills needed to analyze and use data, sustain systems functionality, and make systematic improvements over time. Global health development aid investments and technical innovations have led to advancements in HRHIS, district health information software (DHIS2), and partner collaborations during the HIV/AIDS, Ebola, and COVID-19 crises. Although the progressive implementation of NHWA continues to steer country-level efforts through standardized indicators and regular reporting, traditional challenges remain, such as data systems fragmentation, lack of interoperability between systems, and underutilization of reported data. Encouragingly, some countries demonstrate strong governance and leadership capacities and others strong HRHIS digital capacities. Both HRH and health service data are needed to inform on-demand decisions during times of emergencies and pandemics as well as during routine essential health services delivery. Evidence-based examples from distinctive countries demonstrate that reliable HRHIS is achievable for better planning and management of the health and care workforce.

Development of novel composite data quality scores to evaluate facility-level data quality in electronic data in Kenya: a nationwide retrospective cohort study.

BACKGROUND: In this evaluation, we aim to strengthen Routine Health Information Systems (RHIS) through the digitization of data quality assessment (DQA) processes. We leverage electronic data from the Kenya Health Information System (KHIS) which is based on the District Health Information System version 2 (DHIS2) to perform DQAs at scale. We provide a systematic guide to developing composite data quality scores and use these scores to assess data quality in Kenya. METHODS: We evaluated 187 HIV care facilities with electronic medical records across Kenya. Using quarterly, longitudinal KHIS data from January 2011 to June 2018 (total N = 30 quarters), we extracted indicators encompassing general HIV services including services to prevent mother-to-child transmission (PMTCT). We assessed the accuracy (the extent to which data were correct and free of error) of these data using three data-driven composite scores: 1) completeness score; 2) consistency score; and 3) discrepancy score. Completeness refers to the presence of the appropriate amount of data. Consistency refers to uniformity of data across multiple indicators. Discrepancy (measured on a Z-scale) refers to the degree of alignment (or lack thereof) of data with rules that defined the possible valid values for the data. RESULTS: A total of 5,610 unique facility-quarters were extracted from KHIS. The mean completeness score was 61.1% [standard deviation (SD) = 27%]. The mean consistency score was 80% (SD = 16.4%). The mean discrepancy score was 0.07 (SD = 0.22). A strong and positive correlation was identified between the consistency score and discrepancy score (correlation coefficient = 0.77), whereas the correlation of either score with the completeness score was low with a correlation coefficient of -0.12 (with consistency score) and -0.36 (with discrepancy score). General HIV indicators were more complete, but less consistent, and less plausible than PMTCT indicators. CONCLUSION: We observed a lack of correlation between the completeness score and the other two scores. As such, for a holistic DQA, completeness assessment should be paired with the measurement of either consistency or discrepancy to reflect distinct dimensions of data quality. Given the complexity of the discrepancy score, we recommend the simpler consistency score, since they were highly correlated. Routine use of composite scores on KHIS data could enhance efficiencies in DQA at scale as digitization of health information expands and could be applied to other health sectors beyondHIV clinics.

Healthcare professionals' satisfaction toward the use of district health information system and its associated factors in southwest Ethiopia: using the information system success model.

Background: Ethiopia has the potential to use the district health information system, which is a building block of the health system. Thus, it needs to assess the performance level of the system by identifying the satisfaction of end users. There is little evidence about users' satisfaction with using this system. As a result, this study was conducted to fill this gap by evaluating user satisfaction and associated factors of district health information system among healthcare providers in Ethiopia, using the information system success model. Methods: An institutional-based cross-sectional study was conducted from November to December 2022 in the Oromia region of southwest Ethiopia. A total of 391 health professionals participated in the study. The study participants were selected using a census. Using a self-administered questionnaire, data were collected. Measurement and structural equation modeling analyses were used to evaluate reliability, the validity of model fit, and to test the relationship between the constructs, respectively, using analysis of moment structure (AMOS) V 26. Results: System quality had a positive direct effect on the respondent's system use (ß = 0.18, P-value < 0.001), and satisfaction (ß = 0.44, P-value < 0.001). Service quality had also a direct effect on the respondent's system use (ß = 0.37, P-value < 0.01), and satisfaction with using the district health information system (ß = 0.36, P-value < 0.01). Similarly, system use had also a direct effect on the respondent's satisfaction (ß = 0.53, P-value < 0.05). Moreover, computer literacy had a direct effect on the respondent's system use (ß = 0.63, P-value < 0.05), and satisfaction (ß = 0.51, P-value < 0.01). Concussions: The overall user satisfaction with using the district health information system in Ethiopia was low. System quality, service quality, and computer literacy had a direct positive effect on system use and user satisfaction. In addition, system use and information quality had a direct positive effect on healthcare professionals' satisfaction with using the district health information system. The most important factor for enhancing system use and user satisfaction was computer literacy. Accordingly, for the specific user training required for the success of the district health information system in Ethiopia, the manager should offer additional basic computer courses for better use of the system.

Area-specific covid-19 effects on health services utilization in the Democratic Republic of the Congo using routine health information system data.

BACKGROUND: Since March 2020, the COVID-19 pandemic has shocked health systems worldwide. This analysis investigated the effects of the pandemic on basic health services utilization in the Democratic Republic of the Congo (DRC) and examined the variability of COVID effects in the capital city Kinshasa, in other urban areas, and in rural areas. METHODS: We estimated time trends models using national health information system data to replicate pre-COVID-19 (i.e., January 2017-February 2020) trajectories of health service utilization, and then used those models to estimate what the levels would have been in the absence of COVID-19 during the pandemic period, starting in March 2020 through March 2021. We classified the difference between the observed and predicted levels as the effect of COVID-19 on health services. We estimated 95% confidence intervals and p-values to examine if the effect of the pandemic, nationally and within specific geographies, was statistically significant. RESULTS: Our results indicate that COVID-19 negatively impacted health services and subsequent recovery varied by service type and by geographical area. COVID-19 had a lasting impact on overall service utilization as well as on malaria and pneumonia-related visits among young children in the DRC. We also found that the effects of COVID-19 were even more immediate and stronger in the capital city of Kinshasa compared with the national effect. Both nationally and in Kinshasa, most affected services had slow and incomplete recovery to expected levels. Therefore, our analysis indicates that COVID-19 continued to affect health services in the DRC throughout the first year of the pandemic. CONCLUSIONS: The methodology used in this article allows for examining the variability in magnitude, timing, and duration of the COVID effects within geographical areas of the DRC and nationally. This analytical procedure based on national health information system data could be applied to surveil health service disruptions and better inform rapid responses from health service managers and policymakers.

Quality of routine health data at the onset of the COVID-19 pandemic in Ethiopia, Haiti, Laos, Nepal, and South Africa.

BACKGROUND: During the COVID-19 pandemic, governments and researchers have used routine health data to estimate potential declines in the delivery and uptake of essential health services. This research relies on the data being high quality and, crucially, on the data quality not changing because of the pandemic. In this paper, we investigated those assumptions and assessed data quality before and during COVID-19. METHODS: We obtained routine health data from the DHIS2 platforms in Ethiopia, Haiti, Lao People's Democratic Republic, Nepal, and South Africa (KwaZulu-Natal province) for a range of 40 indicators on essential health services and institutional deaths. We extracted data over 24 months (January 2019-December 2020) including pre-pandemic data and the first 9 months of the pandemic. We assessed four dimensions of data quality: reporting completeness, presence of outliers, internal consistency, and external consistency. RESULTS: We found high reporting completeness across countries and services and few declines in reporting at the onset of the pandemic. Positive outliers represented fewer than 1% of facility-month observations across services. Assessment of internal consistency across vaccine indicators found similar reporting of vaccines in all countries. Comparing cesarean section rates in the HMIS to those from population-representative surveys, we found high external consistency in all countries analyzed. CONCLUSIONS: While efforts remain to improve the quality of these data, our results show that several indicators in the HMIS can be reliably used to monitor service provision over time in these five countries.

A roadmap for using DHIS2 data to track progress in key health indicators in the Global South: experience from sub-saharan Africa.

High quality health data as collected by health management information systems (HMIS) is an important building block of national health systems. District Health Information System 2 (DHIS2) software is an innovation in data management and monitoring for strengthening HMIS that has been widely implemented in low and middle-income countries in the last decade. However, analysts and decision-makers still face significant challenges in fully utilizing the capabilities of DHIS2 data to pursue national and international health agendas. We aimed to (i) identify the most relevant health indicators captured by DHIS2 for tracking progress towards the Sustainable Development goals in sub-Saharan African countries and (ii) present a clear roadmap for improving DHIS2 data quality and consistency, with a special focus on immediately actionable solutions. We identified that key indicators in child and maternal health (e.g. vaccine coverage, maternal deaths) are currently being tracked in the DHIS2 of most countries, while other indicators (e.g. HIV/AIDS) would benefit from streamlining the number of indicators collected and standardizing case definitions. Common data issues included unreliable denominators for calculation of incidence, differences in reporting among health facilities, and programmatic differences in data quality. We proposed solutions for many common data pitfalls at the analysis level, including standardized data cleaning pipelines, k-means clustering to identify high performing health facilities in terms of data quality, and imputation methods. While we focus on immediately actionable solutions for DHIS2 analysts, improvements at the point of data collection are the most rigorous. By investing in improving data quality and monitoring, countries can leverage the current global attention on health data to strengthen HMIS and progress towards national and international health priorities.

Data collection systems for active safety surveillance of vaccines during pregnancy in low- and middle-income countries: developing and piloting an assessment tool (VPASS).

BACKGROUND: There is an urgent need for active safety surveillance to monitor vaccine exposure during pregnancy in low- and middle-income countries (LMICs). Existing maternal, newborn, and child health (MNCH) data collection systems could serve as platforms for post-marketing active surveillance of maternal immunization safety. To identify sites using existing systems, a thorough assessment should be conducted. Therefore, this study had the objectives to first develop an assessment tool and then to pilot this tool in sites using MNCH data collection systems through virtual informant interviews. METHODS: We conducted a rapid review of the literature to identify frameworks on population health or post-marketing drug surveillance. Four frameworks that met the eligibility criteria were identified and served to develop an assessment tool capable of evaluating sites that could support active monitoring of vaccine safety during pregnancy. We conducted semi-structured interviews in six geographical sites using MNCH data collection systems (DHIS2, INDEPTH, and GNMNHR) to pilot domains included in the assessment tool. RESULTS: We developed and piloted the "VPASS (Vaccines during Pregnancy - sites supporting Active Safety Surveillance) assessment tool" through interviews with nine stakeholders, including central-level systems key informants and site-level managers from DHIS2 and GNMNHR; DHIS2 in Kampala (Uganda) and Kigali (Rwanda); GNMNHR from Belagavi (India) and Lusaka (Zambia); and INDEPTH from Nanoro (Burkina Faso) and Manhica (Mozambique). The tool includes different domains such as the system's purpose, the scale of implementation, data capture and confidentiality, type of data collected, the capability of integration with other platforms, data management policies and data quality monitoring. Similarities among sites were found regarding some domains, such as data confidentiality, data management policies, and data quality monitoring. Four of the six sites met some domains to be eligible as potential sites for active surveillance of vaccinations during pregnancy, such as a routine collection of MNCH individual data and the capability of electronically integrating individual MNCH outcomes with information related to vaccine exposure during pregnancy. Those sites were: Rwanda (DHIS2), Manhica (IN-DEPTH), Lusaka (GNMNHR), and Belagavi (GNMNHR). CONCLUSION: This study's findings should inform the successful implementation of active safety surveillance of vaccines during pregnancy by identifying and using active individual MNCH data collection systems in LMICs.

A comparative analysis of two national tuberculosis reporting systems and their impact on tuberculosis case notification in Uganda

Background: Before 2018, the use of parallel tuberculosis (TB) reporting systems was resource intensive with duplication of efforts and hence the need to select one that contributed to better TB case notification at the National TB and Leprosy Program (NLTP) in Uganda. We sought to analyse the difference in reporting rates between the two systems in order to improve NTLP TB case notification rates, logistics management, and planning for better health service delivery initiatives. Methods: We conducted a comparative study to assess TB case notification between the web-based DHIS2 and the district TB supervisor-led health management information system between January 2016 to December 2017. We used Poisson regression analysis to assess the statistical differences in reporting rates between the two reporting systems. Results: The association between TB case notification and the type of reporting system was statistically significant (Prob > chi2 = 0.0000). The Incident Rate Ratio (IRR) for the web-enabled DHIS2 system versus the district TB supervisor-led health management information system was 1.106625. Conclusion: The web-based integrated DHIS2 system was more effective in reporting missing TB cases. It presents an opportunity for better planning and allocation of resources for improved service delivery in a low-income setting.

A comparative analysis of two national tuberculosis reporting systems and their impact on tuberculosis case notification in Uganda.

Background: Before 2018, the use of parallel tuberculosis (TB) reporting systems was resource intensive with duplication of efforts and hence the need to select one that contributed to better TB case notification at the National TB and Leprosy Program (NLTP) in Uganda. We sought to analyse the difference in reporting rates between the two systems in order to improve NTLP TB case notification rates, logistics management, and planning for better health service delivery initiatives. Methods: We conducted a comparative study to assess TB case notification between the web-based DHIS2 and the district TB supervisor-led health management information system between January 2016 to December 2017. We used Poisson regression analysis to assess the statistical differences in reporting rates between the two reporting systems. Results: The association between TB case notification and the type of reporting system was statistically significant (Prob > chi2 = 0.0000). The Incident Rate Ratio (IRR) for the web-enabled DHIS2 system versus the district TB supervisor-led health management information system was 1.106625. Conclusion: The web-based integrated DHIS2 system was more effective in reporting missing TB cases. It presents an opportunity for better planning and allocation of resources for improved service delivery in a low-income setting.

Extending and Strengthening Routine DHIS2 Surveillance Systems for COVID-19 Responses in Sierra Leone, Sri Lanka, and Uganda.

The COVID-19 pandemic challenged countries to protect their populations from this emerging disease. One aspect of that challenge was to rapidly modify national surveillance systems or create new systems that would effectively detect new cases of COVID-19. Fifty-five countries leveraged past investments in District Health Information Software version 2 (DHIS2) to quickly adapt their national public health surveillance systems for COVID-19 case reporting and response activities. We provide background on DHIS2 and describe case studies from Sierra Leone, Sri Lanka, and Uganda to illustrate how the DHIS2 platform, its community of practice, long-term capacity building, and local autonomy enabled countries to establish an effective COVID-19 response. With these case studies, we provide valuable insights and recommendations for strategies that can be used for national electronic disease surveillance platforms to detect new and emerging pathogens and respond to public health emergencies.