User Evaluation Indicates High Quality of the Surveillance Outbreak Response Management and Analysis System (SORMAS) After Field Deployment in Nigeria in 2015 and 2018.

During the West African Ebola virus disease outbreak in 2014-15, health agencies had severe challenges with case notification and contact tracing. To overcome these, we developed the Surveillance, Outbreak Response Management and Analysis System (SORMAS). The objective of this study was to measure perceived quality of SORMAS and its change over time. We ran a 4-week-pilot and 8-week-implementation of SORMAS among hospital informants in Kano state, Nigeria in 2015 and 2018 respectively. We carried out surveys after the pilot and implementation asking about usefulness and acceptability. We calculated the proportions of users per answer together with their 95% confidence intervals (CI) and compared whether the 2015 response distributions differed from those from 2018. Total of 31 and 74 hospital informants participated in the survey in 2015 and 2018, respectively. In 2018, 94% (CI: 89-100%) of users indicated that the tool was useful, 92% (CI: 86-98%) would recommend SORMAS to colleagues and 18% (CI: 10-28%) had login difficulties. In 2015, the proportions were 74% (CI: 59-90%), 90% (CI: 80-100%), and 87% (CI: 75-99%) respectively. Results indicate high usefulness and acceptability of SORMAS. We recommend mHealth tools to be evaluated to allow repeated measurements and comparisons between different versions and users.

Evaluation of the Measles Surveillance System in Kaduna State, Nigeria (2010-2012).

OBJECTIVE: To evaluate the case-based measles surveillance system in Kaduna State of Nigeria and identify gaps in its operation. INTRODUCTION: In Africa, approximately 13 million cases, 650,000 deaths due to measles occur annually, with sub-Saharan Africa having the highest morbidity and mortality. Measles infection is endemic in Nigeria and has been documented to occur all year round, despite high measles routine and supplemental immunization coverage. The frequent outbreaks of measles in Kaduna State prompted the need for the evaluation of the measles case-based surveillance system. METHODS: We interviewed stakeholders and conducted a retrospective record review of the measles case-based surveillance data from 2010 - 2012 and adapted the 2001 CDC guidelines on surveillance evaluation and the Framework for Evaluating Public Health Surveillance Systems for Early Detection of Outbreaks, to assess the systems usefulness, representativeness, timeliness, stability, acceptability and data quality. We calculated the annualized detection rate of measles and non-measles febrile rash, proportion of available results, proportion of LGAs (Districts) that investigated at least one case with blood, proportion of cases that were IgM positive and the incidence of measles. We compared the results with WHO(2004) recommended performance indicators to determine the quality and effectiveness of measles surveillance system. RESULTS: According to the Stakeholders, the case-based surveillance system was useful and acceptable. Median interval between specimen collection and release of result was 7days (1 - 25 days) in 2010, 38 days (Range: 16 - 109 days) in 2011 and 11 days (Range: 1 - 105 days) in 2012. The annualized detection rate of measles rash in 2010 was 2.1 (target: 32), 1.0 (target: 32) in 2011 and 1.4 (target: 32) in 2012. The annualized detection rate of non-measles febrile rash in 2010 was 2.1 (target: 32), 0.6 (target: 32) in 2011 and 0.8 (target: 32) in 2012. Case definitions are simple and understood by all the operators. CONCLUSION: This evaluation showed that the surveillance system was still useful. Also, the efficiency and effectiveness of the laboratory component as captured by the "median interval between specimen collection and the release of results improved in 2010 and 2012 compared to 2011. However, there was a progressive decline in the timeliness and completeness of weekly reports in the years under review.