The role of supportive supervision using mobile technology in monitoring and guiding program performance: a case study in Nigeria, 2015-2016.

BACKGROUND: Supportive supervision is one of the interventions that fosters program improvement by way of imparting knowledge and skills to health workers. The basic challenge in supportive supervision is the availability of data in real time for timely and effective feedback. Thus, the main objective of this study was to determine the contribution of real-time data collection during supportive supervision for timely feedback and generation of evidence for health intervention planning. METHODS: We analyzed supportive supervision records collected through handheld devices employing the open data kit (ODK) platform from July 2015 to June 2016. Supervision was conducted across the country by 592 World Health Organization (WHO) officers. The availability of real-time data and the distance of health facilities to the community were analyzed. RESULTS: During the study period, 90,396 health facilities were supervised. The average time spent during supervision varied from 1.53 to 3.78 h across the six geopolitical zones of the country. The average interval between completion of the supervisory checklist and synchronization with the server varied from 3.9 h to 7.5 h. The average distance between the health facility and a ward varied from 5 to 24 km. CONCLUSION: The use of handheld devices for supportive supervision provided real-time data from health facilities to state and zonal levels for analysis and feedback. Program officers used the findings to rectify process indicators in time for a better outcome.

Profile of polio-compatible cases in Nigeria, 2006-2016.

BACKGROUND: The tremendous progress made by Nigeria towards polio eradication has recently suffered a setback with the isolation of circulating vaccine-derived poliovirus (cVDPV) type 2 from environmental samples and confirmation of four wild poliovirus (WPV) cases from acute flaccid paralysis (AFP) cases, with dates of onset of paralysis in July and August 2016. All these viruses were confirmed from the security-challenged northeastern state of Borno. Polio-compatible cases exist in Nigeria, and they indicate surveillance failure. Surveillance, therefore, has to be strengthened for the country to achieve certification. The objective of this paper is to highlight the epidemiological profile and magnitude of polio-compatible cases in Nigeria during the reporting period, as well as immunization and surveillance response activities conducted to close immunity and surveillance gaps. METHODS: We conducted a retrospective review of AFP surveillance performance and polio-compatible cases in Nigeria between 2006 and 2016 from the AFP database at the World Health Organization Country Office. We also reviewed and compared key epidemiological features of polio-compatible cases with those of wild poliovirus cases during the reporting period. RESULTS: The non-polio AFP rate improved from 6.5 in 2006 to 19.5 in 2016. The corresponding figures for stool adequacy rates were 88 and 98%. The total number of polio-compatible cases reported during the reporting period was 888, with the highest number (194) of cases reported in 2006 and the least (24) in 2016. Clusters of polio-compatible cases were reported every year during the reporting period except in 2015. The highest number (65) of polio-compatible cases in clusters was reported in 2006. The key epidemiological features of polio-compatible and wild poliovirus cases were similar. CONCLUSION: AFP surveillance performance has improved significantly during the reporting period. Surveillance gaps still existed as shown by the presence of orphan viruses and polio-compatible cases, and these gaps need to be identified and closed to achieve certification.

Tracking Vaccination Teams During Polio Campaigns in Northern Nigeria by Use of Geographic Information System Technology: 2013-2015.

INTRODUCTION: Nigeria is among the 3 countries in which polio remains endemic. The country made significant efforts to reduce polio transmission but remains challenged by poor-quality campaigns and poor team performance in some areas. This article demonstrates the application of geographic information system technology to track vaccination teams to monitor settlement coverage, reduce the number of missed settlements, and improve team performance. METHODS: In each local government area where tracking was conducted, global positioning system-enabled Android phones were given to each team on a daily basis and were used to record team tracks. These tracks were uploaded to a dashboard to show the level of coverage and identify areas missed by the teams. RESULTS: From 2012 to June 2015, tracking covered 119 immunization days. A total of 1149 tracking activities were conducted. Of these, 681 (59%) were implemented in Kano state. There was an improvement in the geographic coverage of settlements and an overall reduction in the number of missed settlements. CONCLUSIONS: The tracking of vaccination teams provided significant feedback during polio campaigns and enabled supervisors to evaluate performance of vaccination teams. The reports supported other polio program activities, such as review of microplans and the deployment of other interventions, for increasing population immunity in northern Nigeria.

Implementation of a Systematic Accountability Framework in 2014 to Improve the Performance of the Nigerian Polio Program.

BACKGROUND: An accountability framework is a central feature of managing human and financial resources. One of its primary goals is to improve program performance through close monitoring of selected priority activities. The principal objective of this study was to determine the contribution of a systematic accountability framework to improving the performance of the World Health Organization (WHO)-Nigeria polio program staff, as well as the program itself. METHODS: The effect of implementation of the accountability framework was evaluated using data on administrative actions and select process indicators associated with acute flaccid paralysis (AFP) surveillance, routine immunization, and polio supplemental immunization activities. Data were collected in 2014 during supportive supervision, using Magpi software (a company that provides service to collect data using mobile phones). A total of 2500 staff were studied. RESULTS: Data on administrative actions and process indicators from quarters 2-4 in 2014 were compared. With respect to administrative actions, 1631 personnel (74%) received positive feedback (written or verbal commendation) in quarter 4 through the accountability framework, compared with 1569 (73%) and 1152 (61%) during quarters 3 and 2, respectively. These findings accorded with data on process indicators associated with AFP surveillance and routine immunization, showing statistically significant improvements in staff performance at the end of quarter 4, compared with other quarters. CONCLUSIONS: Improvements in staff performance and process indicators were observed for the WHO-Nigeria polio program after implementation of a systematic accountability framework.

Strengthening Routine Immunization in Areas of Northern Nigeria at High Risk for Polio Transmission During 2012-2014.

BACKGROUND: Following the 2012 declaration by World Health Organization (WHO) Regional Director for Africa and the WHO Executive Board to ramp up routine immunization (RI) activities, began to intensify activities to strengthen RI. This study assessed how the intensification of RI helped strengthen service delivery in local government areas (LGAs) of northern Nigeria at high risk for polio transmission. METHODS: A retrospective study was performed by analyzing RI administrative data and findings from supportive supervisory visits in 107 high-risk LGAs. RESULTS: Our study revealed that administrative coverage with 3rd dose of diphtheria-pertussis-tetanus vaccine in the 107 high-risk LGAs improved from a maximum average coverage of 33% during the preintensification period of 2009-2011 to 74% during the postintensification period of 2012-2014. CONCLUSIONS: Routine immunization could be strengthened in areas where coverage is low, and RI has been identified to be weak when certain key routine activities are intensified.

Effectiveness of poliovirus vaccines against circulating vaccine-derived type 2 poliomyelitis in Nigeria between 2017 and 2022: a case-control study.

BACKGROUND: Between 2018 and 2022, Nigeria experienced continuous transmission of circulating vaccine-derived type 2 poliovirus (cVDPV2), with 526 cases of cVDPV2 poliomyelitis detected in total and approximately 180 million doses of monovalent type 2 oral poliovirus vaccine (mOPV2) and 450 million doses of novel type 2 oral poliovirus vaccine (nOPV2) delivered in outbreak response campaigns. Inactivated poliovirus vaccine (IPV) was introduced into routine immunisation in 2015, with a second dose added in 2021. We aimed to estimate the effectiveness of nOPV2 against cVDPV2 paralysis and compare nOPV2 effectiveness with that of mOPV2 and IPV. METHODS: In this retrospective case-control study, we used acute flaccid paralysis (AFP) surveillance data in Nigeria from Jan 1, 2017, to Dec 31, 2022, using age-matched, onset-matched, and location-matched cVDPV2-negative AFP cases as test-negative controls. We also did a parallel prospective study from March, 2021, using age-matched community controls from the same settlement as the cases. We included children born after May, 2016, younger than 60 months, for whom polio immunisation history (doses of OPV from campaigns and IPV) was reported. We estimated the per-dose effectiveness of nOPV2 against cVDPV2 paralysis using conditional logistic regression and compared nOPV2 effectiveness with that of mOPV2 and IPV. FINDINGS: In the retrospective case-control study, we identified 509 cVDPV2 poliomyelitis cases in Nigeria with case verification and paralysis onset between Jan 1, 2017, and Dec 31, 2022. Of these, 82 children were excluded for not meeting inclusion criteria, and 363 (85%) of 427 eligible cases were matched to 1303 test-negative controls. Cases reported fewer OPV and IPV doses than test-negative controls (mean number of OPV doses 5·9 [SD 4·2] in cases vs 6·7 [4·3] in controls; one or more IPV doses reported in 95 [26%] of 363 cases vs 513 [39%] of 1303 controls). We found low per-dose effectiveness of nOPV2 (12%, 95% CI -2 to 25) and mOPV2 (17%, 3 to 29), but no significant difference between the two vaccines (p=0·67). The estimated effectiveness of one IPV dose was 43% (23 to 58). In the prospective study, 181 (46%) of 392 eligible cases were matched to 1557 community controls. Using community controls, we found a high effectiveness of IPV (89%, 95% CI 83 to 93, for one dose), a low per-dose effectiveness of nOPV2 (-23%, -45 to -5) and mOPV2 (1%, -23 to 20), and no significant difference between the per-dose effectiveness of nOPV2 and mOPV2 (p=0·12). INTERPRETATION: We found no significant difference in estimated effectiveness of the two oral vaccines, supporting the recommendation that the more genetically stable nOPV2 should be preferred in cVDPV2 outbreak response. Our findings highlight the role of IPV and the necessity of strengthening routine immunisation, the primary route through which IPV is delivered. FUNDING: Bill & Melinda Gates Foundation and UK Medical Research Council.