Multiple models for outbreak decision support in the face of uncertainty.

Policymakers must make management decisions despite incomplete knowledge and conflicting model projections. Little guidance exists for the rapid, representative, and unbiased collection of policy-relevant scientific input from independent modeling teams. Integrating approaches from decision analysis, expert judgment, and model aggregation, we convened multiple modeling teams to evaluate COVID-19 reopening strategies for a mid-sized United States county early in the pandemic. Projections from seventeen distinct models were inconsistent in magnitude but highly consistent in ranking interventions. The 6-mo-ahead aggregate projections were well in line with observed outbreaks in mid-sized US counties. The aggregate results showed that up to half the population could be infected with full workplace reopening, while workplace restrictions reduced median cumulative infections by 82%. Rankings of interventions were consistent across public health objectives, but there was a strong trade-off between public health outcomes and duration of workplace closures, and no win-win intermediate reopening strategies were identified. Between-model variation was high; the aggregate results thus provide valuable risk quantification for decision making. This approach can be applied to the evaluation of management interventions in any setting where models are used to inform decision making. This case study demonstrated the utility of our approach and was one of several multimodel efforts that laid the groundwork for the COVID-19 Scenario Modeling Hub, which has provided multiple rounds of real-time scenario projections for situational awareness and decision making to the Centers for Disease Control and Prevention since December 2020.

Evaluating targeted COVID-19 vaccination strategies with agent-based modeling.

We evaluate approaches to vaccine distribution using an agent-based model of human activity and COVID-19 transmission calibrated to detailed trends in cases, hospitalizations, deaths, seroprevalence, and vaccine breakthrough infections in Florida, USA. We compare the incremental effectiveness for four different distribution strategies at four different levels of vaccine supply, starting in late 2020 through early 2022. Our analysis indicates that the best strategy to reduce severe outcomes would be to actively target high disease-risk individuals. This was true in every scenario, although the advantage was greatest for the intermediate vaccine availability assumptions and relatively modest compared to a simple mass vaccination approach under high vaccine availability. Ring vaccination, while generally the most effective strategy for reducing infections, ultimately proved least effective at preventing deaths. We also consider using age group as a practical surrogate measure for actual disease-risk targeting; this approach also outperforms both simple mass distribution and ring vaccination. We find that quantitative effectiveness of a strategy depends on whether effectiveness is assessed after the alpha, delta, or omicron wave. However, these differences in absolute benefit for the strategies do not change the ranking of their performance at preventing severe outcomes across vaccine availability assumptions.

Agent-based modeling of the COVID-19 pandemic in Florida.

The onset of the COVID-19 pandemic drove a widespread, often uncoordinated effort by research groups to develop mathematical models of SARS-CoV-2 to study its spread and inform control efforts. The urgent demand for insight at the outset of the pandemic meant early models were typically either simple or repurposed from existing research agendas. Our group predominantly uses agent-based models (ABMs) to study fine-scale intervention scenarios. These high-resolution models are large, complex, require extensive empirical data, and are often more detailed than strictly necessary for answering qualitative questions like "Should we lockdown?" During the early stages of an extraordinary infectious disease crisis, particularly before clear empirical evidence is available, simpler models are more appropriate. As more detailed empirical evidence becomes available, however, and policy decisions become more nuanced and complex, fine-scale approaches like ours become more useful. In this manuscript, we discuss how our group navigated this transition as we modeled the pandemic. The role of modelers often included nearly real-time analysis, and the massive undertaking of adapting our tools quickly. We were often playing catch up with a firehose of evidence, while simultaneously struggling to do both academic research and real-time decision support, under conditions conducive to neither. By reflecting on our experiences of responding to the pandemic and what we learned from these challenges, we can better prepare for future demands.

Evaluating targeted COVID-19 vaccination strategies with agent-based modeling.

We evaluate approaches to vaccine distribution using an agent-based model of human activity and COVID-19 transmission calibrated to detailed trends in cases, hospitalizations, deaths, seroprevalence, and vaccine breakthrough infections in Florida, USA. We compare the incremental effectiveness for four different distribution strategies at four different levels of vaccine availability, reflecting different income settings' historical COVID-19 vaccine distribution. Our analysis indicates that the best strategy to reduce severe outcomes is to actively target high disease-risk individuals. This was true in every scenario, although the advantage was greatest for the middle-income-country availability assumptions, and relatively modest compared to a simple mass vaccination approach for rapid, high levels of vaccine availability. Ring vaccination, while generally the most effective strategy for reducing infections, ultimately proved least effective at preventing deaths. We also consider using age group as a practical, surrogate measure for actual disease-risk targeting; this approach still outperforms both simple mass distribution and ring vaccination. We also find that the magnitude of strategy effectiveness depends on when assessment occurs (e.g., after delta vs. after omicron variants). However, these differences in absolute benefit for the strategies do not change the ranking of their performance at preventing severe outcomes across vaccine availability assumptions.

Updated projections for COVID-19 omicron wave in Florida.

In this report, we use a detailed simulation model to assess and project the COVID-19 epidemic in Florida. The model is a data-driven, stochastic, discrete-time, agent based model with an explicit representation of people and places. Using the model, we find that the omicron variant wave in Florida is likely to cause many more infections than occurred during the delta variant wave. Due to testing limitations and often mild symptoms, however, we anticipate that omicron infections will be underreported compared to delta. We project that reported cases of COVID-19 will continue to grow significantly and peak in early January 2022, and that the number of reported COVID-19 deaths due to omicron may be 1/3 of the total caused by the delta wave.

Ecology and public health burden of Keystone virus in Florida.

Keystone virus (KEYV) is an under-studied orthobunyavirus that is transmitted via both horizontal and vertical cycles involving various mosquito species and vertebrate hosts. Historical evidence indicates that KEYV causes sub-clinical infections in humans, and some case studies draw links between this virus and encephalitis. Given KEYV's potential to cause human infections, it is plausible that it causes an under-appreciated proportion of both generic viral infections and unidentified viral encephalitis cases. This review summarizes current knowledge of KEYV and its disease dynamics in order to better understand the virus' medical and economic burden on human populations.

COVID-19 reopening strategies at the county level in the face of uncertainty: Multiple Models for Outbreak Decision Support.

Policymakers make decisions about COVID-19 management in the face of considerable uncertainty. We convened multiple modeling teams to evaluate reopening strategies for a mid-sized county in the United States, in a novel process designed to fully express scientific uncertainty while reducing linguistic uncertainty and cognitive biases. For the scenarios considered, the consensus from 17 distinct models was that a second outbreak will occur within 6 months of reopening, unless schools and non-essential workplaces remain closed. Up to half the population could be infected with full workplace reopening; non-essential business closures reduced median cumulative infections by 82%. Intermediate reopening interventions identified no win-win situations; there was a trade-off between public health outcomes and duration of workplace closures. Aggregate results captured twice the uncertainty of individual models, providing a more complete expression of risk for decision-making purposes.