Innovative approach to monitor performance of integrated disease surveillance and response after the Ebola outbreak in Sierra Leone: lessons from the field.

BACKGROUND: Supervision of healthcare workers improves performance if done in a supportive and objective manner. Regular supervision is a support function of Integrated Disease Surveillance and Response (IDSR) strategy and allows systematic monitoring of IDSR implementation. Starting 2015, WHO and other development partners supported the Ministry of Health and Sanitation (MoHS) to revitalize IDSR in Sierra Leone and to monitor progress through supportive supervision assessments. We report on the findings of these assessments. METHODS: This was a cross-sectional study where six longitudinal assessments were conducted in randomly selected health facilities. Health facilities assessed were 71 in February 2016, 99 in July 2016, 101 in May 2017, 126 in August 2018, 139 in February 2019 and 156 in August 2021. An electronic checklist based on selected core functions of IDSR was developed and uploaded onto tablets using the Open Data Kit (ODK) platform. Supervision teams interviewed health care workers, reviewed documents and made observations in health facilities. Supervision books were used to record feedback and corrective actions. Data from the supervisory visits was downloaded from ODK platform, cleaned and analysed. Categorical data was summarized using frequencies and proportions while means and medians were used for continuous variables. Z test was used to test for differences in proportions. RESULTS: Completeness of IDSR reporting improved from 84.5% in 2016 to 96% in 2021 (11.5% points; 95% CI 3.6, 21.9; P-value 0.003). Timeliness of IDSR reports improved from 80.3 to 92% (11.7% points; 95% CI 2.4, 22.9; P-value 0.01). There was significant improvement in health worker knowledge of IDSR concepts and tools, in availability of IDSR standard case definition posters and reporting tools and in data analysis practices. Availability of vaccines and temperature monitoring tools in health facilities also improved significantly but some indicators dropped such as availability of IDSR technical guidelines and malaria testing kits and drugs. CONCLUSION: Supervision using electronic tool contributed to health systems strengthening through longitudinal tracking of core IDSR indicators and other program indicators such as essential malaria commodities and availability and status of routine vaccines. Supervision using electronic tools should be extended to other programs.

Institutionalized data quality assessments: a critical pathway to improving the accuracy of integrated disease surveillance data in Sierra Leone.

BACKGROUND: Public health agencies require valid, timely and complete health information for early detection of outbreaks. Towards the end of the Ebola Virus Disease (EVD) outbreak in 2015, the Ministry of Health and Sanitation (MoHS), Sierra Leone revitalized the Integrated Disease Surveillance and Response System (IDSR). Data quality assessments were conducted to monitor accuracy of IDSR data. METHODS: Starting 2016, data quality assessments (DQA) were conducted in randomly selected health facilities. Structured electronic checklist was used to interview district health management teams (DHMT) and health facility staff. We used malaria data, to assess data accuracy, as malaria was endemic in Sierra Leone. Verification factors (VF) calculated as the ratio of confirmed malaria cases recorded in health facility registers to the number of malaria cases in the national health information database, were used to assess data accuracy. Allowing a 5% margin of error, VF < 95% were considered over reporting while VF > 105 was underreporting. Differences in the proportion of accurate reports at baseline and subsequent assessments were compared using Z-test for two proportions. RESULTS: Between 2016 and 2018, four DQA were conducted in 444 health facilities where 1729 IDSR reports were reviewed. Registers and IDSR technical guidelines were available in health facilities and health care workers were conversant with reporting requirements. Overall data accuracy improved from over- reporting of 4.7% (VF 95.3%) in 2016 to under-reporting of 0.2% (VF 100.2%) in 2018. Compared to 2016, proportion of accurate IDSR reports increased by 14.8% (95% CI 7.2, 22.3%) in May 2017 and 19.5% (95% CI 12.5-26.5%) by 2018. Over reporting was more common in private clinics and not- for profit facilities while under-reporting was more common in lower level government health facilities. Leading reasons for data discrepancies included counting errors in 358 (80.6%) health facilities and missing source documents in 47 (10.6%) health facilities. CONCLUSION: This is the first attempt to institutionalize routine monitoring of IDSR data quality in Sierra Leone. Regular data quality assessments may have contributed to improved data accuracy over time. Data compilation errors accounted for most discrepancies and should be minimized to improve accuracy of IDSR data.

Implementing Nationwide Facility-based Electronic Disease Surveillance in Sierra Leone: Lessons Learned.

The Global Health Security Agenda aims to improve countries' ability to prevent, detect, and respond to infectious disease threats by building or strengthening core capacities required by the International Health Regulations (2005). One of those capacities is the development of surveillance systems to rapidly detect and respond to occurrences of diseases with epidemic potential. Since 2015, the US Centers for Disease Control and Prevention (CDC) has worked with partners in Sierra Leone to assist the Ministry of Health and Sanitation in developing an Integrated Disease Surveillance and Response (IDSR) system. Beginning in 2016, CDC, in collaboration with the World Health Organization and eHealth Africa, has supported the ministry in the development of Android device mobile data entry at the health facility for electronic IDSR (eIDSR), also known as health facility-based eIDSR. Health facility-based eIDSR was introduced via a pilot program in 1 district, and national rollout began in 2018. With more than 1,100 health facilities now reporting, the Sierra Leone eIDSR system is substantially larger than most mobile-device health (mHealth) projects found in the literature. Several technical innovations contributed to the success of health facility-based eIDSR in Sierra Leone. Among them were data compression and dual-mode (internet and text) message transmission to mitigate connectivity issues, user interface design tailored to local needs, and a continuous-feedback process to iteratively detect user or system issues and remediate challenges identified. The resultant system achieved high user acceptance and demonstrated the feasibility of an mHealth-based surveillance system implemented on a national scale.