Multiple models for outbreak decision support in the face of uncertainty.

Policymakers must make management decisions despite incomplete knowledge and conflicting model projections. Little guidance exists for the rapid, representative, and unbiased collection of policy-relevant scientific input from independent modeling teams. Integrating approaches from decision analysis, expert judgment, and model aggregation, we convened multiple modeling teams to evaluate COVID-19 reopening strategies for a mid-sized United States county early in the pandemic. Projections from seventeen distinct models were inconsistent in magnitude but highly consistent in ranking interventions. The 6-mo-ahead aggregate projections were well in line with observed outbreaks in mid-sized US counties. The aggregate results showed that up to half the population could be infected with full workplace reopening, while workplace restrictions reduced median cumulative infections by 82%. Rankings of interventions were consistent across public health objectives, but there was a strong trade-off between public health outcomes and duration of workplace closures, and no win-win intermediate reopening strategies were identified. Between-model variation was high; the aggregate results thus provide valuable risk quantification for decision making. This approach can be applied to the evaluation of management interventions in any setting where models are used to inform decision making. This case study demonstrated the utility of our approach and was one of several multimodel efforts that laid the groundwork for the COVID-19 Scenario Modeling Hub, which has provided multiple rounds of real-time scenario projections for situational awareness and decision making to the Centers for Disease Control and Prevention since December 2020.

Strategic testing approaches for targeted disease monitoring can be used to inform pandemic decision-making.

More than 1.6 million Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) tests were administered daily in the United States at the peak of the epidemic, with a significant focus on individual treatment. Here, we show that objective-driven, strategic sampling designs and analyses can maximize information gain at the population level, which is necessary to increase situational awareness and predict, prepare for, and respond to a pandemic, while also continuing to inform individual treatment. By focusing on specific objectives such as individual treatment or disease prediction and control (e.g., via the collection of population-level statistics to inform lockdown measures or vaccine rollout) and drawing from the literature on capture-recapture methods to deal with nonrandom sampling and testing errors, we illustrate how public health objectives can be achieved even with limited test availability when testing programs are designed a priori to meet those objectives.

Participatory Mathematical Modeling Approach for Policymaking during the First Year of the COVID-19 Crisis, Jordan.

We engaged in a participatory modeling approach with health sector stakeholders in Jordan to support government decision-making regarding implementing public health measures to mitigate COVID-19 disease burden. We considered the effect of 4 physical distancing strategies on reducing COVID-19 transmission and mortality in Jordan during March 2020-January 2021: no physical distancing; intermittent physical distancing where all but essential services are closed once a week; intermittent physical distancing where all but essential services are closed twice a week; and a permanent physical distancing intervention. Modeling showed that the fourth strategy would be most effective in reducing cases and deaths; however, this approach was only marginally beneficial to reducing COVID-19 disease compared with an intermittently enforced physical distancing intervention. Scenario-based model influenced policy-making and the evolution of the pandemic in Jordan confirmed the forecasting provided by the modeling exercise and helped confirm the effectiveness of the policy adopted by the government of Jordan.

Fleaborne Typhus-Associated Deaths - Los Angeles County, California, 2022.

Fleaborne typhus (also known as murine typhus), a widely distributed vectorborne zoonosis caused by Rickettsia typhi, is a moderately severe, but infrequently fatal illness; among patients who receive doxycycline, the case-fatality rate is <1%. Fleaborne typhus is a mandated reportable condition in California. Reported fleaborne typhus cases in Los Angeles County have been increasing since 2010, with the highest number (171) reported during 2022. During June-October 2022, Los Angeles County Department of Public Health learned of three fleaborne typhus-associated deaths. This report describes the clinical presentation, illness course, and methods used to diagnose fleaborne typhus in these three cases. Severe fleaborne typhus manifestations among these cases included hemophagocytic lymphohistiocytosis, a rare immune hyperactivation syndrome that can occur in the infection setting; myocarditis; and septic shock with disseminated intravascular coagulation. Increased health care provider and public health awareness of the prevalence and severity of fleaborne typhus and of the importance of early doxycycline therapy is essential for prevention and treatment efforts.

PopART-IBM, a highly efficient stochastic individual-based simulation model of generalised HIV epidemics developed in the context of the HPTN 071 (PopART) trial.

Mathematical models are powerful tools in HIV epidemiology, producing quantitative projections of key indicators such as HIV incidence and prevalence. In order to improve the accuracy of predictions, such models need to incorporate a number of behavioural and biological heterogeneities, especially those related to the sexual network within which HIV transmission occurs. An individual-based model, which explicitly models sexual partnerships, is thus often the most natural type of model to choose. In this paper we present PopART-IBM, a computationally efficient individual-based model capable of simulating 50 years of an HIV epidemic in a large, high-prevalence community in under a minute. We show how the model calibrates within a Bayesian inference framework to detailed age- and sex-stratified data from multiple sources on HIV prevalence, awareness of HIV status, ART status, and viral suppression for an HPTN 071 (PopART) study community in Zambia, and present future projections of HIV prevalence and incidence for this community in the absence of trial intervention.

Synergistic interventions to control COVID-19: Mass testing and isolation mitigates reliance on distancing.

Stay-at-home orders and shutdowns of non-essential businesses are powerful, but socially costly, tools to control the pandemic spread of SARS-CoV-2. Mass testing strategies, which rely on widely administered frequent and rapid diagnostics to identify and isolate infected individuals, could be a potentially less disruptive management strategy, particularly where vaccine access is limited. In this paper, we assess the extent to which mass testing and isolation strategies can reduce reliance on socially costly non-pharmaceutical interventions, such as distancing and shutdowns. We develop a multi-compartmental model of SARS-CoV-2 transmission incorporating both preventative non-pharmaceutical interventions (NPIs) and testing and isolation to evaluate their combined effect on public health outcomes. Our model is designed to be a policy-guiding tool that captures important realities of the testing system, including constraints on test administration and non-random testing allocation. We show how strategic changes in the characteristics of the testing system, including test administration, test delays, and test sensitivity, can reduce reliance on preventative NPIs without compromising public health outcomes in the future. The lowest NPI levels are possible only when many tests are administered and test delays are short, given limited immunity in the population. Reducing reliance on NPIs is highly dependent on the ability of a testing program to identify and isolate unreported, asymptomatic infections. Changes in NPIs, including the intensity of lockdowns and stay at home orders, should be coordinated with increases in testing to ensure epidemic control; otherwise small additional lifting of these NPIs can lead to dramatic increases in infections, hospitalizations and deaths. Importantly, our results can be used to guide ramp-up of testing capacity in outbreak settings, allow for the flexible design of combined interventions based on social context, and inform future cost-benefit analyses to identify efficient pandemic management strategies.

OpenABM-Covid19-An agent-based model for non-pharmaceutical interventions against COVID-19 including contact tracing.

SARS-CoV-2 has spread across the world, causing high mortality and unprecedented restrictions on social and economic activity. Policymakers are assessing how best to navigate through the ongoing epidemic, with computational models being used to predict the spread of infection and assess the impact of public health measures. Here, we present OpenABM-Covid19: an agent-based simulation of the epidemic including detailed age-stratification and realistic social networks. By default the model is parameterised to UK demographics and calibrated to the UK epidemic, however, it can easily be re-parameterised for other countries. OpenABM-Covid19 can evaluate non-pharmaceutical interventions, including both manual and digital contact tracing, and vaccination programmes. It can simulate a population of 1 million people in seconds per day, allowing parameter sweeps and formal statistical model-based inference. The code is open-source and has been developed by teams both inside and outside academia, with an emphasis on formal testing, documentation, modularity and transparency. A key feature of OpenABM-Covid19 are its Python and R interfaces, which has allowed scientists and policymakers to simulate dynamic packages of interventions and help compare options to suppress the COVID-19 epidemic.

Vote-processing rules for combining control recommendations from multiple models.

Mathematical modelling is used during disease outbreaks to compare control interventions. Using multiple models, the best method to combine model recommendations is unclear. Existing methods weight model projections, then rank control interventions using the combined projections, presuming model outputs are directly comparable. However, the way each model represents the epidemiological system will vary. We apply electoral vote-processing rules to combine model-generated rankings of interventions. Combining rankings of interventions, instead of combining model projections, avoids assuming that projections are comparable as all comparisons of projections are made within each model. We investigate four rules: First-past-the-post, Alternative Vote (AV), Coombs Method and Borda Count. We investigate rule sensitivity by including models that favour only one action or including those that rank interventions randomly. We investigate two case studies: the 2014 Ebola outbreak in West Africa (37 compartmental models) and a hypothetical foot-and-mouth disease outbreak in UK (four individual-based models). The Coombs Method was least susceptible to adding models that favoured a single action, Borda Count and AV were most susceptible to adding models that ranked interventions randomly. Each rule chose the same intervention as when ranking interventions by mean projections, suggesting that combining rankings provides similar recommendations with fewer assumptions about model comparability. This article is part of the theme issue 'Technical challenges of modelling real-life epidemics and examples of overcoming these'.

Estimating SARS-CoV-2 variant fitness and the impact of interventions in England using statistical and geo-spatial agent-based models.

The SARS-CoV-2 epidemic has been extended by the evolution of more transmissible viral variants. In autumn 2020, the B.1.177 lineage became the dominant variant in England, before being replaced by the B.1.1.7 (Alpha) lineage in late 2020, with the sweep occurring at different times in each region. This period coincided with a large number of non-pharmaceutical interventions (e.g. lockdowns) to control the epidemic, making it difficult to estimate the relative transmissibility of variants. In this paper, we model the spatial spread of these variants in England using a meta-population agent-based model which correctly characterizes the regional variation in cases and distribution of variants. As a test of robustness, we additionally estimated the relative transmissibility of multiple variants using a statistical model based on the renewal equation, which simultaneously estimates the effective reproduction number R. Relative to earlier variants, the transmissibility of B.1.177 is estimated to have increased by 1.14 (1.12-1.16) and that of Alpha by 1.71 (1.65-1.77). The vaccination programme starting in December 2020 is also modelled. Counterfactual simulations demonstrate that the vaccination programme was essential for reopening in March 2021, and that if the January lockdown had started one month earlier, up to 30 k (24 k-38 k) deaths could have been prevented. This article is part of the theme issue 'Technical challenges of modelling real-life epidemics and examples of overcoming these'.

Molecular Epidemiology of Measles in California, United States-2019.

In 2019, the United States (US) experienced the highest number of measles importations and cases in the postelimination era. More than a quarter of imported cases entered the US through California. Measles surveillance efforts in California resulted in the identification of 26 importations, 6 outbreaks, and 72 cases in 2019. Only genotype B3 and D8 measles strains were detected. Genotype-specific differences were noted in the incidence of vaccine failures, hospitalizations, and severe complications among cases. A targeted whole genome sequencing approach provided higher-resolution discrimination between epidemiologically linked and sporadically introduced strains than conventional N450 sequencing. Our report underscores the importance of ensuring appropriate measles vaccination status, especially prior to international travel to measles-endemic regions, and highlights the value of a strong measles surveillance system in minimizing outbreaks and preserving measles elimination status in the US.

Anticipating future learning affects current control decisions: A comparison between passive and active adaptive management in an epidemiological setting.

Infectious disease epidemics present a difficult task for policymakers, requiring the implementation of control strategies under significant time constraints and uncertainty. Mathematical models can be used to predict the outcome of control interventions, providing useful information to policymakers in the event of such an epidemic. However, these models suffer in the early stages of an outbreak from a lack of accurate, relevant information regarding the dynamics and spread of the disease and the efficacy of control. As such, recommendations provided by these models are often incorporated in an ad hoc fashion, as and when more reliable information becomes available. In this work, we show that such trial-and-error-type approaches to management, which do not formally take into account the resolution of uncertainty and how control actions affect this, can lead to sub-optimal management outcomes. We compare three approaches to managing a theoretical epidemic: a non-adaptive management (AM) approach that does not use real-time outbreak information to adapt control, a passive AM approach that incorporates real-time information if and when it becomes available, and an active AM approach that explicitly incorporates the future resolution of uncertainty through gathering real-time information into its initial recommendations. The structured framework of active AM encourages the specification of quantifiable objectives, models of system behaviour and possible control and monitoring actions, followed by an iterative learning and control phase that is able to employ complex control optimisations and resolve system uncertainty. The result is a management framework that is able to provide dynamic, long-term projections to help policymakers meet the objectives of management. We investigate in detail the effect of different methods of incorporating up-to-date outbreak information. We find that, even in a highly simplified system, the method of incorporating new data can lead to different results that may influence initial policy decisions, with an active AM approach to management providing better information that can lead to more desirable outcomes from an epidemic.

Essential information: Uncertainty and optimal control of Ebola outbreaks.

Early resolution of uncertainty during an epidemic outbreak can lead to rapid and efficient decision making, provided that the uncertainty affects prioritization of actions. The wide range in caseload projections for the 2014 Ebola outbreak caused great concern and debate about the utility of models. By coding and running 37 published Ebola models with five candidate interventions, we found that, despite this large variation in caseload projection, the ranking of management options was relatively consistent. Reducing funeral transmission and reducing community transmission were generally ranked as the two best options. Value of information (VoI) analyses show that caseloads could be reduced by 11% by resolving all model-specific uncertainties, with information about model structure accounting for 82% of this reduction and uncertainty about caseload only accounting for 12%. Our study shows that the uncertainty that is of most interest epidemiologically may not be the same as the uncertainty that is most relevant for management. If the goal is to improve management outcomes, then the focus of study should be to identify and resolve those uncertainties that most hinder the choice of an optimal intervention. Our study further shows that simplifying multiple alternative models into a smaller number of relevant groups (here, with shared structure) could streamline the decision-making process and may allow for a better integration of epidemiological modeling and decision making for policy.

Molecular Genotyping of Hepatitis A Virus, California, USA, 2017-2018.

We implemented subgenomic and whole-genome sequencing to support the investigation of a large hepatitis A virus outbreak among persons experiencing homelessness, users of illicit drugs, or both in California, USA, during 2017-2018. Genotyping data helped confirm case-patients, track chains of transmission, and monitor the effectiveness of public health control measures.

New Subgenotyping and Consensus Real-Time Reverse Transcription-PCR Assays for Hepatitis A Outbreak Surveillance.

Laboratory surveillance plays an important role in the detection and control of hepatitis A outbreaks and requires the application of rapid and accurate molecular diagnostic tools for hepatitis A virus (HAV) RNA detection, subgenotype identification, and sequence-based genotyping. We describe the development and validation of a triplex real-time, reverse transcription-PCR (triplex rRT-PCR) assay for the identification and discrimination of HAV subgenotypes IA, IB, and IIIA and a singleplex rRT-PCR assay designed to detect all HAV genotypes infecting humans. Overall, the accuracy, sensitivity, and specificity of the new assays were >97% for serum and plasma specimens collected during unrelated outbreaks of HAV in California and Michigan compared to a nested RT-PCR genotyping assay and the ISO 15216-1 rRT-PCR method for HAV detection. The new assays will permit the rapid detection of HAV RNA and discrimination among subgenotypes IA, IB, and IIIA in serum and plasma specimens, which will strengthen public health surveillance efforts for HAV outbreak detection and response.

Real-time decision-making during emergency disease outbreaks.

In the event of a new infectious disease outbreak, mathematical and simulation models are commonly used to inform policy by evaluating which control strategies will minimize the impact of the epidemic. In the early stages of such outbreaks, substantial parameter uncertainty may limit the ability of models to provide accurate predictions, and policymakers do not have the luxury of waiting for data to alleviate this state of uncertainty. For policymakers, however, it is the selection of the optimal control intervention in the face of uncertainty, rather than accuracy of model predictions, that is the measure of success that counts. We simulate the process of real-time decision-making by fitting an epidemic model to observed, spatially-explicit, infection data at weekly intervals throughout two historical outbreaks of foot-and-mouth disease, UK in 2001 and Miyazaki, Japan in 2010, and compare forward simulations of the impact of switching to an alternative control intervention at the time point in question. These are compared to policy recommendations generated in hindsight using data from the entire outbreak, thereby comparing the best we could have done at the time with the best we could have done in retrospect. Our results show that the control policy that would have been chosen using all the data is also identified from an early stage in an outbreak using only the available data, despite high variability in projections of epidemic size. Critically, we find that it is an improved understanding of the locations of infected farms, rather than improved estimates of transmission parameters, that drives improved prediction of the relative performance of control interventions. However, the ability to estimate undetected infectious premises is a function of uncertainty in the transmission parameters. Here, we demonstrate the need for both real-time model fitting and generating projections to evaluate alternative control interventions throughout an outbreak. Our results highlight the use of using models at outbreak onset to inform policy and the importance of state-dependent interventions that adapt in response to additional information throughout an outbreak.

Quantifying the Value of Perfect Information in Emergency Vaccination Campaigns.

Foot-and-mouth disease outbreaks in non-endemic countries can lead to large economic costs and livestock losses but the use of vaccination has been contentious, partly due to uncertainty about emergency FMD vaccination. Value of information methods can be applied to disease outbreak problems such as FMD in order to investigate the performance improvement from resolving uncertainties. Here we calculate the expected value of resolving uncertainty about vaccine efficacy, time delay to immunity after vaccination and daily vaccination capacity for a hypothetical FMD outbreak in the UK. If it were possible to resolve all uncertainty prior to the introduction of control, we could expect savings of £55 million in outbreak cost, 221,900 livestock culled and 4.3 days of outbreak duration. All vaccination strategies were found to be preferable to a culling only strategy. However, the optimal vaccination radius was found to be highly dependent upon vaccination capacity for all management objectives. We calculate that by resolving the uncertainty surrounding vaccination capacity we would expect to return over 85% of the above savings, regardless of management objective. It may be possible to resolve uncertainty about daily vaccination capacity before an outbreak, and this would enable decision makers to select the optimal control action via careful contingency planning.

Contaminated Stream Water as Source for Escherichia coli O157 Illness in Children.

In May 2016, an outbreak of Shiga toxin-producing Escherichia coli O157 infections occurred among children who had played in a stream flowing through a park. Analysis of E. coli isolates from the patients, stream water, and deer and coyote scat showed that feces from deer were the most likely source of contamination.

Effect of risk aversion on prioritizing conservation projects.

Conservation outcomes are uncertain. Agencies making decisions about what threat mitigation actions to take to save which species frequently face the dilemma of whether to invest in actions with high probability of success and guaranteed benefits or to choose projects with a greater risk of failure that might provide higher benefits if they succeed. The answer to this dilemma lies in the decision maker's aversion to risk--their unwillingness to accept uncertain outcomes. Little guidance exists on how risk preferences affect conservation investment priorities. Using a prioritization approach based on cost effectiveness, we compared 2 approaches: a conservative probability threshold approach that excludes investment in projects with a risk of management failure greater than a fixed level, and a variance-discounting heuristic used in economics that explicitly accounts for risk tolerance and the probabilities of management success and failure. We applied both approaches to prioritizing projects for 700 of New Zealand's threatened species across 8303 management actions. Both decision makers' risk tolerance and our choice of approach to dealing with risk preferences drove the prioritization solution (i.e., the species selected for management). Use of a probability threshold minimized uncertainty, but more expensive projects were selected than with variance discounting, which maximized expected benefits by selecting the management of species with higher extinction risk and higher conservation value. Explicitly incorporating risk preferences within the decision making process reduced the number of species expected to be safe from extinction because lower risk tolerance resulted in more species being excluded from management, but the approach allowed decision makers to choose a level of acceptable risk that fit with their ability to accommodate failure. We argue for transparency in risk tolerance and recommend that decision makers accept risk in an adaptive management framework to maximize benefits and avoid potential extinctions due to inefficient allocation of limited resources.

Isolation and identification of an Enterobacter cloacae strain producing a novel subtype of Shiga toxin type 1.

We describe here the isolation and identification of a Shiga toxin 1 (Stx1)-producing Enterobacter cloacae strain, M12X01451, from a human clinical specimen. The bacterial isolate was identified as E. cloacae using a polyphasic approach that included phenotypic, genetic, and proteomic analyses. The M12X01451 stx1 was sequenced, and the holotoxin was found to share only 87% amino acid sequence identity with the nearest Stx1 subtype reference sequence. Sequence analysis of the regions immediately flanking stx1 displayed similarities with bacteriophage-related sequences, suggesting a prophage origin. The stx1 gene was a stable element within the M12X01451 genome, as demonstrated by real-time PCR detection following successive subculturing of the bacterial isolate. Culture supernatant from M12X01451 was cytotoxic to Vero cells but was not neutralized by an anti-Stx1 monoclonal antibody. In addition, Stx1 from M12X01451 demonstrated limited antigenicity with two commercially available lateral flow immunoassays. The M12X01451 Stx represents a new Stx1 subtype based on the degree of sequence dissimilarity with Stx1 subtype reference sequences and its limited reactivity with anti-Stx1 antibodies.

Fatal meningococcal disease in a laboratory worker--California, 2012.

Occupationally acquired meningococcal disease is rare. Adherence to recommendations for safe handling of Neisseria meningitidis in the laboratory greatly reduces the risk for transmission to laboratory workers. A California microbiologist developed fatal serogroup B meningococcal disease after working with N. meningitidis patient isolates in a research laboratory (laboratory A). The California Department of Public Health (CDPH), the local health department, the California Division of Occupational Safety and Health (CalOSHA), and the federal Occupational Safety and Health Administration (OSHA) collaborated on an investigation of laboratory A, which revealed several breaches in recommended laboratory practice for safe handling of N. meningitidis, including manipulating cultures on the bench top. Additionally, laboratory workers had not been offered meningococcal vaccine in accordance with Advisory Committee on Immunization Practices (ACIP) recommendations and CalOSHA Aerosol Transmissible Diseases Standard requirements. In accordance with OSHA and CalOSHA regulations, laboratory staff members must receive laboratory biosafety training and use appropriate personal protective equipment, and those who routinely work with N. meningitidis isolates should receive meningococcal vaccine.