Mapping the international health regulations monitoring and evaluation framework: an expert consultation, triangulation crosswalk and quantitative analysis.

The International Health Regulations Monitoring and Evaluation Framework (IHRMEF) includes four components regularly conducted by States Parties to measure the current status of International Health Regulations (IHR) 2005 core capacities and provide recommendations for strengthening these capacities. However, the four components are conducted independently of one another and have no systematic referral to each other before, during or after each process, despite being largely conducted by the same team, country and support organisations. This analysis sets out to identify ways in which IHRMEF components could work more synergistically to effectively measure the status of IHR core capacities, taking into account the country's priority risks. We developed a methodology to allow these independent components to communicate with each other, including expert consultation, a qualitative crosswalk analysis and a country-level quantitative analysis. The demonstrated results act as a proof of concept and illustrate a methodology to provide benefits across all four components before, during and after implementation.

Improving global health security through implementation of the National Action Plan for Health Security in Sierra Leone, 2018-2021: lessons from the field.

BACKGROUND: All countries are required to implement International Health Regulations (IHR) through development and implementation of multi-year National Action Plans for Health Security (NAPHS). IHR implementation requires annual operational planning which involves several tools such as NAPHS, State Party Annual Report (SPAR), Joint External Evaluation (JEE) and WHO IHR Benchmarks tool. Sierra Leone has successfully improved IHR capacities across the years through successful annual operational planning using the above tools. We conducted a study to document and share the country's unique approach to implementation of NAPHS. METHODS: This was an observational study where the process of implementing and monitoring NAPHS in Sierra Leone was observed at the national level from 2018 to 2021. Data was obtained through review and analysis of NAPHS annual operational plans, quarterly review reports and annual IHR assessment reports. Available data was supplemented by information from key informants. Qualitative data was captured as notes and analysed for various themes while quantitative data was analyzed mainly for means and proportions. RESULTS: The overall national IHR Joint External Evaluation self-assessment score for human health improved from 44% in 2018 to 51% in 2019 and 57% in 2020. The score for the animal sector improved from 32% in 2018 to 43% in 2019 and 52% in 2020. A new JEE tool with new indicators was used in 2021 and the score for both human and animal sectors declined slightly to 51%. Key enablers of success included strong political commitment, whole-of-government approach, annual assessments using JEE tool, annual operational planning using WHO IHR Benchmarks tool and real time online monitoring of progress. Key challenges included disruption created by COVID-19 response, poor health infrastructure, low funding and inadequate health workforce. CONCLUSION: IHR annual operational planning and implementation using evidence-based data and tools can facilitate strengthening of IHR capacity and should be encouraged.

Implementing Joint External Evaluations of the International Health Regulations (2005) capacities in all countries in the WHO African region: process challenges, lessons learnt and perspectives for the future.

Following the West Africa Ebola virus disease outbreak (2013-2016), the Joint External Evaluation (JEE) is one of the three voluntary components recommended by the WHO for evaluating the International Health Regulations (2005) capacities in countries. Here, we share experience implementing JEEs in all 47 countries in the WHO African region. In February 2016, the United Republic of Tanzania (Mainland) was the first country globally to conduct a JEE. By April 2022, JEEs had been conducted in all 47 countries plus in the island of Zanzibar. A total of 360 subject matter experts (SMEs) from 88 organisations were deployed 607 times. Despite availability of guidelines, the process had to be contextualised while avoiding jeopardising the quality and integrity of the findings. Key challenges were: inadequate understanding of the process by in-country counterparts; competing country priorities; limited time for validating subnational capacities; insufficient availability of SMEs for biosafety and biosecurity, antimicrobial resistance, points of entry, chemical events and radio-nuclear emergencies; and inadequate financing to fill gaps identified. Key points learnt were: importance of country leadership and ownership; conducting orientation workshops before the self-assessment; availability of an external JEE expert to support the self-assessment; the skills, attitudes and leadership competencies of the team lead; identifying national experts as SMEs for future JEEs to promote capacity building and experience sharing; the centrality of involving One Health stakeholders from the beginning to the end of the process; and the need for dedicated staff for planning, coordination, implementation and timely report writing. Moving forward, it is essential to draw from this learning to plan future JEEs. Finally, predictable financing is needed immediately to fill gaps identified.

How prepared is the world? Identifying weaknesses in existing assessment frameworks for global health security through a One Health approach.

The COVID-19 pandemic has exposed faults in the way we assess preparedness and response capacities for public health emergencies. Existing frameworks are limited in scope, and do not sufficiently consider complex social, economic, political, regulatory, and ecological factors. One Health, through its focus on the links among humans, animals, and ecosystems, is a valuable approach through which existing assessment frameworks can be analysed and new ways forward proposed. Although in the past few years advances have been made in assessment tools such as the International Health Regulations Joint External Evaluation, a rapid and radical increase in ambition is required. To sufficiently account for the range of complex systems in which health emergencies occur, assessments should consider how problems are defined across stakeholders and the wider sociopolitical environments in which structures and institutions operate. Current frameworks do little to consider anthropogenic factors in disease emergence or address the full array of health security hazards across the social-ecological system. A complex and interdependent set of challenges threaten human, animal, and ecosystem health, and we cannot afford to overlook important contextual factors, or the determinants of these shared threats. Health security assessment frameworks should therefore ensure that the process undertaken to prioritise and build capacity adheres to core One Health principles and that interventions and outcomes are assessed in terms of added value, trade-offs, and cobenefits across human, animal, and environmental health systems.

Investing in preparedness for rapid detection and control of epidemics: analysis of health system reforms and their effect on 2021 Ebola virus disease epidemic response in Guinea.

The 2014-2016 West Africa Ebola Virus Disease (EVD) Epidemic devastated Guinea's health system and constituted a public health emergency of international concern. Following the crisis, Guinea invested in the establishment of basic health system reforms and crucial legal instruments for strengthening national health security in line with the WHO's recommendations for ensuring better preparedness for (and, therefore, a response to) health emergencies. The investments included the scaling up of Integrated Disease Surveillance and Response; Joint External Evaluation of International Health Regulation capacities; National Action Plan for Health Security; Simulation Exercises; One Health platforms; creation of decentralised structures such as regional and prefectural Emergency Operation Centres; Risk assessment and hazard identification; Expanding human resources capacity; Early Warning Alert System and community preparedness. These investments were tested in the subsequent 2021 EVD outbreak and other epidemics. In this case, there was a timely declaration and response to the 2021 EVD epidemic, a lower-case burden and mortality rate, a shorter duration of the epidemic and a significant reduction in the cost of the response. Similarly, there was timely detection, response and containment of other epidemics including Lassa fever and Marburg virus disease. Findings suggest the utility of the preparedness activities for the early detection and efficient containment of outbreaks, which, therefore, underlines the need for all countries at risk of infectious disease epidemics to invest in similar reforms. Doing so promises to be not only cost-effective but also lifesaving.

Online capacity building for the health workforce: the case of the Integrated Disease Surveillance and Response for the African region.

The World Health Organisation (WHO) Regional Office for Africa (AFRO) has developed a comprehensive capacity devel-opment programme to support the successful implementation of the Integrated Disease Surveillance and Response 3rd edition Technical Guidelines (IDSR). As part of the learning program, a series of asyn-chronous online courses are offered on OpenWHO in English, French and Portuguese. This paper describes the use of five IDSR online courses and reports on feedback received from learners on Course 1 in the English series. An online learner survey was developed, and a descriptive analysis was conducted. This paper also reports on use related empirical metadata from the OpenWHO platform. Overall, learners (97%-n/N) of Course 1 IDSR English series indicated a positive perception toward their online learning experience because of the quality of course content, its organization, ease of use and relevance to their workplace needs. In addition, 88% (n/N) of learners reported that they had used their acquired knowledge at least sometimes and 54.4% (n/N) had shared their learning with others. Lastly, the quiz analyses showed an average of right answers of 78.97% for quiz 1 and 69.94% for quiz 2. Online learning is an essential component of a blended capacity development programme and provides cost effective, equitable and impactful learning. Learners who have a learning goal and find their needs met in courses tend to show more satisfaction and motivation to share their learning.

Sustainable strategies for Ebola virus disease outbreak preparedness in Africa: a case study on lessons learnt in countries neighbouring the Democratic Republic of the Congo.

BACKGROUND: From May 2018 to September 2022, the Democratic Republic of Congo (DRC) experienced seven Ebola virus disease (EVD) outbreaks within its borders. During the 10th EVD outbreak (2018-2020), the largest experienced in the DRC and the second largest and most prolonged EVD outbreak recorded globally, a WHO risk assessment identified nine countries bordering the DRC as moderate to high risk from cross border importation. These countries implemented varying levels of Ebola virus disease preparedness interventions. This case study highlights the gains and shortfalls with the Ebola virus disease preparedness interventions within the various contexts of these countries against the background of a renewed and growing commitment for global epidemic preparedness highlighted during recent World Health Assembly events. MAIN TEXT: Several positive impacts from preparedness support to countries bordering the affected provinces in the DRC were identified, including development of sustained capacities which were leveraged upon to respond to the subsequent coronavirus disease 2019 (COVID-19) pandemic. Shortfalls such as lost opportunities for operationalizing cross-border regional preparedness collaboration and better integration of multidisciplinary perspectives, vertical approaches to response pillars such as surveillance, over dependence on external support and duplication of efforts especially in areas of capacity building were also identified. A recurrent theme that emerged from this case study is the propensity towards implementing short-term interventions during active Ebola virus disease outbreaks for preparedness rather than sustainable investment into strengthening systems for improved health security in alignment with IHR obligations, the Sustainable Development Goals and advocating global policy for addressing the larger structural determinants underscoring these outbreaks. CONCLUSIONS: Despite several international frameworks established at the global level for emergency preparedness, a shortfall exists between global policy and practice in countries at high risk of cross border transmission from persistent Ebola virus disease outbreaks in the Democratic Republic of Congo. With renewed global health commitment for country emergency preparedness resulting from the COVID-19 pandemic and cumulating in a resolution for a pandemic preparedness treaty, the time to review and address these gaps and provide recommendations for more sustainable and integrative approaches to emergency preparedness towards achieving global health security is now.

Innovative approach to monitor performance of integrated disease surveillance and response after the Ebola outbreak in Sierra Leone: lessons from the field.

BACKGROUND: Supervision of healthcare workers improves performance if done in a supportive and objective manner. Regular supervision is a support function of Integrated Disease Surveillance and Response (IDSR) strategy and allows systematic monitoring of IDSR implementation. Starting 2015, WHO and other development partners supported the Ministry of Health and Sanitation (MoHS) to revitalize IDSR in Sierra Leone and to monitor progress through supportive supervision assessments. We report on the findings of these assessments. METHODS: This was a cross-sectional study where six longitudinal assessments were conducted in randomly selected health facilities. Health facilities assessed were 71 in February 2016, 99 in July 2016, 101 in May 2017, 126 in August 2018, 139 in February 2019 and 156 in August 2021. An electronic checklist based on selected core functions of IDSR was developed and uploaded onto tablets using the Open Data Kit (ODK) platform. Supervision teams interviewed health care workers, reviewed documents and made observations in health facilities. Supervision books were used to record feedback and corrective actions. Data from the supervisory visits was downloaded from ODK platform, cleaned and analysed. Categorical data was summarized using frequencies and proportions while means and medians were used for continuous variables. Z test was used to test for differences in proportions. RESULTS: Completeness of IDSR reporting improved from 84.5% in 2016 to 96% in 2021 (11.5% points; 95% CI 3.6, 21.9; P-value 0.003). Timeliness of IDSR reports improved from 80.3 to 92% (11.7% points; 95% CI 2.4, 22.9; P-value 0.01). There was significant improvement in health worker knowledge of IDSR concepts and tools, in availability of IDSR standard case definition posters and reporting tools and in data analysis practices. Availability of vaccines and temperature monitoring tools in health facilities also improved significantly but some indicators dropped such as availability of IDSR technical guidelines and malaria testing kits and drugs. CONCLUSION: Supervision using electronic tool contributed to health systems strengthening through longitudinal tracking of core IDSR indicators and other program indicators such as essential malaria commodities and availability and status of routine vaccines. Supervision using electronic tools should be extended to other programs.

After action review of the response to an outbreak of Lassa fever in Sierra Leone, 2019: Best practices and lessons learnt.

BACKGROUND: In November 2019, an outbreak of Lassa Fever occurred among health workers in a non-endemic district in Sierra Leone. The outbreak resulted in five cases, including two that were exported to the Netherlands. The outbreak tested multiple technical capacities in the International Health Regulations (2005) in a real-life setting. As such, an after action review (AAR) was undertaken as recommended by World Health Organization. We report on the findings of the AAR including best practices and lessons learnt. METHODS: A two stage review process was employed. The first stage involved national pillar level reviews for each technical pillar and one review of the district level response. The second stage brought together all pillars, including participants from the national and sub-national level as well as health sector partners. National guidelines were used as references during the deliberations. A standardized template was used to report on the key findings on what happened, what was supposed to happen, what went well and lessons learnt. RESULTS: This was a hospital associated outbreak that likely occurred due to a breach in infection prevention and control (IPC) practices resulting in three health workers being infected during a surgical operation. There was a delay in detecting the outbreak on time due to low index of suspicion among clinicians. Once detected, the outbreak response contained the outbreak within one incubation period. Areas that worked well included coordination, contact tracing, active case search and ring IPC. Notable gaps included delays in accessing local emergency funding and late distribution of IPC and laboratory supplies. CONCLUSIONS: The incident management system worked optimally to contain this outbreak. The core technical gaps identified in surveillance, IPC and delay in deployment of resources should be addressed through systemic changes that can mitigate future outbreaks.

Evaluation of integrated disease surveillance and response (IDSR) and early warning and response network (EWARN) in South Sudan 2021.

Introduction: South Sudan has been implementing the Integrated Disease Surveillance and Response (IDSR) strategy since 2006, along with Early Warning and Alert Response and Network (EWARN). The IDSR/EWARN stakeholders commissioned an independent evaluation to establish performance at national, state, county, health facility, and community levels in the first half of 2021. Methods: the evaluation was conducted between June and September 2021 (during the COVID-19 pandemic) and was based on the World Health Organization (WHO) protocols for monitoring and evaluating communicable disease surveillance and response systems and the guidelines for evaluating EWARN. Results: integrated disease surveillance and response/early warning and alert response and network indicator data showed improving timeliness and completeness from the beginning of 2021 to week 16 and then a slight depression of timeliness by week 32, while completeness remained high. Event-based surveillance was active at the beginning of 2021 and in week 32. However, there was inadequate sample collection to investigate acute watery diarrhea, bloody diarrhea, and acute jaundice syndrome alerts. Respondents in all cadres had substantial experience working in IDSR/EWARN. All respondents performed the various IDSR/EWARN tasks and duties as expected, but needed more resources and training. Conclusion: while IDSR/EWARN is performing relatively well, confirmation of priority diseases by the laboratories needs to be strengthened. Health facilities need more regular supervision from the higher levels. Community health workers need more training on IDSR/EWARN. The whole IDSR/EWARN system needs more resources, particularly for communication and transport and to confirm priority diseases. Staff at all levels requested more training in IDSR/EWARN.

SARS-CoV-2 infection in Africa: a systematic review and meta-analysis of standardised seroprevalence studies, from January 2020 to December 2021.

INTRODUCTION: Estimating COVID-19 cumulative incidence in Africa remains problematic due to challenges in contact tracing, routine surveillance systems and laboratory testing capacities and strategies. We undertook a meta-analysis of population-based seroprevalence studies to estimate SARS-CoV-2 seroprevalence in Africa to inform evidence-based decision making on public health and social measures (PHSM) and vaccine strategy. METHODS: We searched for seroprevalence studies conducted in Africa published 1 January 2020-30 December 2021 in Medline, Embase, Web of Science and Europe PMC (preprints), grey literature, media releases and early results from WHO Unity studies. All studies were screened, extracted, assessed for risk of bias and evaluated for alignment with the WHO Unity seroprevalence protocol. We conducted descriptive analyses of seroprevalence and meta-analysed seroprevalence differences by demographic groups, place and time. We estimated the extent of undetected infections by comparing seroprevalence and cumulative incidence of confirmed cases reported to WHO. PROSPERO: CRD42020183634. RESULTS: We identified 56 full texts or early results, reporting 153 distinct seroprevalence studies in Africa. Of these, 97 (63%) were low/moderate risk of bias studies. SARS-CoV-2 seroprevalence rose from 3.0% (95% CI 1.0% to 9.2%) in April-June 2020 to 65.1% (95% CI 56.3% to 73.0%) in July-September 2021. The ratios of seroprevalence from infection to cumulative incidence of confirmed cases was large (overall: 100:1, ranging from 18:1 to 954:1) and steady over time. Seroprevalence was highly heterogeneous both within countries-urban versus rural (lower seroprevalence for rural geographic areas), children versus adults (children aged 0-9 years had the lowest seroprevalence)-and between countries and African subregions. CONCLUSION: We report high seroprevalence in Africa suggesting greater population exposure to SARS-CoV-2 and potential protection against COVID-19 severe disease than indicated by surveillance data. As seroprevalence was heterogeneous, targeted PHSM and vaccination strategies need to be tailored to local epidemiological situations.

Intention to vaccinate against COVID-19 and adherence to non-pharmaceutical interventions against COVID-19 prior to the second wave of the pandemic in Uganda: a cross-sectional study.

OBJECTIVES: The resurgence in cases and deaths due to COVID-19 in many countries suggests complacency in adhering to COVID-19 preventive guidelines. Vaccination, therefore, remains a key intervention in mitigating the impact of the COVID-19 pandemic. This study investigated the level of adherence to COVID-19 preventive measures and intention to receive the COVID-19 vaccine among Ugandans. DESIGN, SETTING AND PARTICIPANTS: A nationwide cross-sectional survey of 1053 Ugandan adults was conducted in March 2021 using telephone interviews. MAIN OUTCOME MEASURES: Participants reported on adherence to COVID-19 preventive measures and intention to be vaccinated with COVID-19 vaccines. RESULTS: Overall, 10.2% of the respondents adhered to the COVID-19 preventive guidelines and 57.8% stated definite intention to receive a SARS-CoV-2 vaccine. Compared with women, men were less likely to adhere to COVID-19 guidelines (Odds Ratio (OR)=0.64, 95% CI 0.41 to 0.99). Participants from the northern (4.0%, OR=0.28, 95% CI 0.12 to 0.92), western (5.1%, OR=0.30, 95% CI 0.14 to 0.65) and eastern regions (6.5%, OR=0.47, 95% CI 0.24 to 0.92), respectively, had lower odds of adhering to the COVID-19 guidelines than those from the central region (14.7%). A higher monthly income of ≥US$137 (OR=2.31, 95% CI 1.14 to 4.58) and a history of chronic disease (OR=1.81, 95% CI 1.14 to 2.86) were predictors of adherence. Concerns about the chances of getting COVID-19 in the future (Prevalence Ratio (PR)=1.26, 95% CI 1.06 to 1.48) and fear of severe COVID-19 infection (PR=1.20, 95% CI 1.04 to 1.38) were the strongest predictors for a definite intention, while concerns for side effects were negatively associated with vaccination intent (PR=0.75, 95% CI 0.68 to 0.83). CONCLUSION: Behaviour change programmes need to be strengthened to promote adherence to COVID-19 preventive guidelines as vaccination is rolled out as another preventive measure. Dissemination of accurate, safe and efficacious information about the vaccines is necessary to enhance vaccine uptake.

Assessment of COVID-19 pandemic responses in African countries: thematic synthesis of WHO intra-action review reports.

OBJECTIVES: We conducted a review of intra-action review (IAR) reports of the national response to the COVID-19 pandemic in Africa. We highlight best practices and challenges and offer perspectives for the future. DESIGN: A thematic analysis across 10 preparedness and response domains, namely, governance, leadership, and coordination; planning and monitoring; risk communication and community engagement; surveillance, rapid response, and case investigation; infection prevention and control; case management; screening and monitoring at points of entry; national laboratory system; logistics and supply chain management; and maintaining essential health services during the COVID-19 pandemic. SETTING: All countries in the WHO African Region were eligible for inclusion in the study. National IAR reports submitted by March 2021 were analysed. RESULTS: We retrieved IAR reports from 18 African countries. The COVID-19 pandemic response in African countries has relied on many existing response systems such as laboratory systems, surveillance systems for previous outbreaks of highly infectious diseases and a logistics management information system. These best practices were backed by strong political will. The key challenges included low public confidence in governments, inadequate adherence to infection prevention and control measures, shortages of personal protective equipment, inadequate laboratory capacity, inadequate contact tracing, poor supply chain and logistics management systems, and lack of training of key personnel at national and subnational levels. CONCLUSION: These findings suggest that African countries' response to the COVID-19 pandemic was prompt and may have contributed to the lower cases and deaths in the region compared with countries in other regions. The IARs demonstrate that many technical areas still require immediate improvement to guide decisions in subsequent waves or future outbreaks.

The COVID-19 pandemic in the African continent.

In December 2019, a new coronavirus, severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2) and associated disease, coronavirus disease 2019 (COVID-19), was identified in China. This virus spread quickly and in March, 2020, it was declared a pandemic. Scientists predicted the worst scenario to occur in Africa since it was the least developed of the continents in terms of human development index, lagged behind others in achievement of the United Nations sustainable development goals (SDGs), has inadequate resources for provision of social services, and has many fragile states. In addition, there were relatively few research reporting findings on COVID-19 in Africa. On the contrary, the more developed countries reported higher disease incidences and mortality rates. However, for Africa, the earlier predictions and modelling into COVID-19 incidence and mortality did not fit into the reality. Therefore, the main objective of this forum is to bring together infectious diseases and public health experts to give an overview of COVID-19 in Africa and share their thoughts and opinions on why Africa behaved the way it did. Furthermore, the experts highlight what needs to be done to support Africa to consolidate the status quo and overcome the negative effects of COVID-19 so as to accelerate attainment of the SDGs.

On the resilience of health systems: A methodological exploration across countries in the WHO African Region.

The need for resilient health systems is recognized as important for the attainment of health outcomes, given the current shocks to health services. Resilience has been defined as the capacity to "prepare and effectively respond to crises; maintain core functions; and, informed by lessons learnt, reorganize if conditions require it". There is however a recognized dichotomy between its conceptualization in literature, and its application in practice. We propose two mutually reinforcing categories of resilience, representing resilience targeted at potentially known shocks, and the inherent health system resilience, needed to respond to unpredictable shock events. We determined capacities for each of these categories, and explored this methodological proposition by computing country-specific scores against each capacity, for the 47 Member States of the WHO African Region. We assessed face validity of the computed index, to ensure derived values were representative of the different elements of resilience, and were predictive of health outcomes, and computed bias-corrected non-parametric confidence intervals of the emergency preparedness and response (EPR) and inherent system resilience (ISR) sub-indices, as well as the overall resilience index, using 1000 bootstrap replicates. We also explored the internal consistency and scale reliability of the index, by calculating Cronbach alphas for the various proposed capacities and their corresponding attributes. We computed overall resilience to be 48.4 out of a possible 100 in the 47 assessed countries, with generally lower levels of ISR. For ISR, the capacities were weakest for transformation capacity, followed by mobilization of resources, awareness of own capacities, self-regulation and finally diversity of services respectively. This paper aims to contribute to the growing body of empirical evidence on health systems and service resilience, which is of great importance to the functionality and performance of health systems, particularly in the context of COVID-19. It provides a methodological reflection for monitoring health system resilience, revealing areas of improvement in the provision of essential health services during shock events, and builds a case for the need for mechanisms, at country level, that address both specific and non-specific shocks to the health system, ultimately for the attainment of improved health outcomes.