Potential impact of annual vaccination with reformulated COVID-19 vaccines: Lessons from the US COVID-19 scenario modeling hub.

BACKGROUND: Coronavirus Disease 2019 (COVID-19) continues to cause significant hospitalizations and deaths in the United States. Its continued burden and the impact of annually reformulated vaccines remain unclear. Here, we present projections of COVID-19 hospitalizations and deaths in the United States for the next 2 years under 2 plausible assumptions about immune escape (20% per year and 50% per year) and 3 possible CDC recommendations for the use of annually reformulated vaccines (no recommendation, vaccination for those aged 65 years and over, vaccination for all eligible age groups based on FDA approval). METHODS AND FINDINGS: The COVID-19 Scenario Modeling Hub solicited projections of COVID-19 hospitalization and deaths between April 15, 2023 and April 15, 2025 under 6 scenarios representing the intersection of considered levels of immune escape and vaccination. Annually reformulated vaccines are assumed to be 65% effective against symptomatic infection with strains circulating on June 15 of each year and to become available on September 1. Age- and state-specific coverage in recommended groups was assumed to match that seen for the first (fall 2021) COVID-19 booster. State and national projections from 8 modeling teams were ensembled to produce projections for each scenario and expected reductions in disease outcomes due to vaccination over the projection period. From April 15, 2023 to April 15, 2025, COVID-19 is projected to cause annual epidemics peaking November to January. In the most pessimistic scenario (high immune escape, no vaccination recommendation), we project 2.1 million (90% projection interval (PI) [1,438,000, 4,270,000]) hospitalizations and 209,000 (90% PI [139,000, 461,000]) deaths, exceeding pre-pandemic mortality of influenza and pneumonia. In high immune escape scenarios, vaccination of those aged 65+ results in 230,000 (95% confidence interval (CI) [104,000, 355,000]) fewer hospitalizations and 33,000 (95% CI [12,000, 54,000]) fewer deaths, while vaccination of all eligible individuals results in 431,000 (95% CI: 264,000-598,000) fewer hospitalizations and 49,000 (95% CI [29,000, 69,000]) fewer deaths. CONCLUSIONS: COVID-19 is projected to be a significant public health threat over the coming 2 years. Broad vaccination has the potential to substantially reduce the burden of this disease, saving tens of thousands of lives each year.

COVSIM: A stochastic agent-based COVID-19 SIMulation model for North Carolina.

We document the evolution and use of the stochastic agent-based COVID-19 simulation model (COVSIM) to study the impact of population behaviors and public health policy on disease spread within age, race/ethnicity, and urbanicity subpopulations in North Carolina. We detail the methodologies used to model the complexities of COVID-19, including multiple agent attributes (i.e., age, race/ethnicity, high-risk medical status), census tract-level interaction network, disease state network, agent behavior (i.e., masking, pharmaceutical intervention (PI) uptake, quarantine, mobility), and variants. We describe its uses outside of the COVID-19 Scenario Modeling Hub (CSMH), which has focused on the interplay of nonpharmaceutical and pharmaceutical interventions, equitability of vaccine distribution, and supporting local county decision-makers in North Carolina. This work has led to multiple publications and meetings with a variety of local stakeholders. When COVSIM joined the CSMH in January 2022, we found it was a sustainable way to support new COVID-19 challenges and allowed the group to focus on broader scientific questions. The CSMH has informed adaptions to our modeling approach, including redesigning our high-performance computing implementation.

Potential impact of annual vaccination with reformulated COVID-19 vaccines: lessons from the U.S. COVID-19 Scenario Modeling Hub.

Importance: COVID-19 continues to cause significant hospitalizations and deaths in the United States. Its continued burden and the impact of annually reformulated vaccines remain unclear. Objective: To project COVID-19 hospitalizations and deaths from April 2023-April 2025 under two plausible assumptions about immune escape (20% per year and 50% per year) and three possible CDC recommendations for the use of annually reformulated vaccines (no vaccine recommendation, vaccination for those aged 65+, vaccination for all eligible groups). Design: The COVID-19 Scenario Modeling Hub solicited projections of COVID-19 hospitalization and deaths between April 15, 2023-April 15, 2025 under six scenarios representing the intersection of considered levels of immune escape and vaccination. State and national projections from eight modeling teams were ensembled to produce projections for each scenario. Setting: The entire United States. Participants: None. Exposure: Annually reformulated vaccines assumed to be 65% effective against strains circulating on June 15 of each year and to become available on September 1. Age and state specific coverage in recommended groups was assumed to match that seen for the first (fall 2021) COVID-19 booster. Main outcomes and measures: Ensemble estimates of weekly and cumulative COVID-19 hospitalizations and deaths. Expected relative and absolute reductions in hospitalizations and deaths due to vaccination over the projection period. Results: From April 15, 2023-April 15, 2025, COVID-19 is projected to cause annual epidemics peaking November-January. In the most pessimistic scenario (high immune escape, no vaccination recommendation), we project 2.1 million (90% PI: 1,438,000-4,270,000) hospitalizations and 209,000 (90% PI: 139,000-461,000) deaths, exceeding pre-pandemic mortality of influenza and pneumonia. In high immune escape scenarios, vaccination of those aged 65+ results in 230,000 (95% CI: 104,000-355,000) fewer hospitalizations and 33,000 (95% CI: 12,000-54,000) fewer deaths, while vaccination of all eligible individuals results in 431,000 (95% CI: 264,000-598,000) fewer hospitalizations and 49,000 (95% CI: 29,000-69,000) fewer deaths. Conclusion and Relevance: COVID-19 is projected to be a significant public health threat over the coming two years. Broad vaccination has the potential to substantially reduce the burden of this disease.

Evaluation of the US COVID-19 Scenario Modeling Hub for informing pandemic response under uncertainty.

Our ability to forecast epidemics far into the future is constrained by the many complexities of disease systems. Realistic longer-term projections may, however, be possible under well-defined scenarios that specify the future state of critical epidemic drivers. Since December 2020, the U.S. COVID-19 Scenario Modeling Hub (SMH) has convened multiple modeling teams to make months ahead projections of SARS-CoV-2 burden, totaling nearly 1.8 million national and state-level projections. Here, we find SMH performance varied widely as a function of both scenario validity and model calibration. We show scenarios remained close to reality for 22 weeks on average before the arrival of unanticipated SARS-CoV-2 variants invalidated key assumptions. An ensemble of participating models that preserved variation between models (using the linear opinion pool method) was consistently more reliable than any single model in periods of valid scenario assumptions, while projection interval coverage was near target levels. SMH projections were used to guide pandemic response, illustrating the value of collaborative hubs for longer-term scenario projections.

Quantifying association and disparities between diabetes complications and COVID-19 outcomes: A retrospective study using electronic health records.

BACKGROUND: Despite established relationships between diabetic status and an increased risk for COVID-19 severe outcomes, there is a limited number of studies examining the relationships between diabetes complications and COVID-19-related risks. We use the Adapted Diabetes Complications Severity Index to define seven diabetes complications. We aim to understand the risk for COVID-19 infection, hospitalization, mortality, and longer length of stay of diabetes patients with complications. METHODS: We perform a retrospective case-control study using Electronic Health Records (EHRs) to measure differences in the risks for COVID-19 severe outcomes amongst those with diabetes complications. Using multiple logistic regression, we calculate adjusted odds ratios (OR) for COVID-19 infection, hospitalization, and in-hospital mortality of the case group (patients with diabetes complications) compared to a control group (patients without diabetes). We also calculate adjusted mean difference in length of stay between the case and control groups using multiple linear regression. RESULTS: Adjusting demographics and comorbidities, diabetes patients with renal complications have the highest odds for COVID-19 infection (OR = 1.85, 95% CI = [1.71, 1.99]) while those with metabolic complications have the highest odds for COVID-19 hospitalization (OR = 5.58, 95% CI = [3.54, 8.77]) and in-hospital mortality (OR = 2.41, 95% CI = [1.35, 4.31]). The adjusted mean difference (MD) of hospital length-of-stay for diabetes patients, especially those with cardiovascular (MD = 0.94, 95% CI = [0.17, 1.71]) or peripheral vascular (MD = 1.72, 95% CI = [0.84, 2.60]) complications, is significantly higher than non-diabetes patients. African American patients have higher odds for COVID-19 infection (OR = 1.79, 95% CI = [1.66, 1.92]) and hospitalization (OR = 1.62, 95% CI = [1.39, 1.90]) than White patients in the general diabetes population. However, White diabetes patients have higher odds for COVID-19 in-hospital mortality. Hispanic patients have higher odds for COVID-19 infection (OR = 2.86, 95% CI = [2.42, 3.38]) and shorter mean length of hospital stay than non-Hispanic patients in the general diabetes population. Although there is no significant difference in the odds for COVID-19 hospitalization and in-hospital mortality between Hispanic and non-Hispanic patients in the general diabetes population, Hispanic patients have higher odds for COVID-19 hospitalization (OR = 1.83, 95% CI = [1.16, 2.89]) and in-hospital mortality (OR = 3.69, 95% CI = [1.18, 11.50]) in the diabetes population with no complications. CONCLUSIONS: The presence of diabetes complications increases the risks of COVID-19 infection, hospitalization, and worse health outcomes with respect to in-hospital mortality and longer hospital length of stay. We show the presence of health disparities in COVID-19 outcomes across demographic groups in our diabetes population. One such disparity is that African American and Hispanic diabetes patients have higher odds of COVID-19 infection than White and Non-Hispanic diabetes patients, respectively. Furthermore, Hispanic patients might have less access to the hospital care compared to non-Hispanic patients when longer hospitalizations are needed due to their diabetes complications. Finally, diabetes complications, which are generally associated with worse COVID-19 outcomes, might be predominantly determining the COVID-19 severity in those infected patients resulting in less demographic differences in COVID-19 hospitalization and in-hospital mortality.

Informing pandemic response in the face of uncertainty. An evaluation of the U.S. COVID-19 Scenario Modeling Hub.

Our ability to forecast epidemics more than a few weeks into the future is constrained by the complexity of disease systems, our limited ability to measure the current state of an epidemic, and uncertainties in how human action will affect transmission. Realistic longer-term projections (spanning more than a few weeks) may, however, be possible under defined scenarios that specify the future state of critical epidemic drivers, with the additional benefit that such scenarios can be used to anticipate the comparative effect of control measures. Since December 2020, the U.S. COVID-19 Scenario Modeling Hub (SMH) has convened multiple modeling teams to make 6-month ahead projections of the number of SARS-CoV-2 cases, hospitalizations and deaths. The SMH released nearly 1.8 million national and state-level projections between February 2021 and November 2022. SMH performance varied widely as a function of both scenario validity and model calibration. Scenario assumptions were periodically invalidated by the arrival of unanticipated SARS-CoV-2 variants, but SMH still provided projections on average 22 weeks before changes in assumptions (such as virus transmissibility) invalidated scenarios and their corresponding projections. During these periods, before emergence of a novel variant, a linear opinion pool ensemble of contributed models was consistently more reliable than any single model, and projection interval coverage was near target levels for the most plausible scenarios (e.g., 79% coverage for 95% projection interval). SMH projections were used operationally to guide planning and policy at different stages of the pandemic, illustrating the value of the hub approach for long-term scenario projections.

Modeling the Impact of Nonpharmaceutical Interventions on COVID-19 Transmission in K-12 Schools.

Background. The novel coronavirus SARS-CoV-2 spread across the world causing many waves of COVID-19. Children were at high risk of being exposed to the disease because they were not eligible for vaccination during the first 20 mo of the pandemic in the United States. While children 5 y and older are now eligible to receive a COVID-19 vaccine in the United States, vaccination rates remain low despite most schools returning to in-person instruction. Nonpharmaceutical interventions (NPIs) are important for controlling the spread of COVID-19 in K-12 schools. US school districts used varied and layered mitigation strategies during the pandemic. The goal of this article is to analyze the impact of different NPIs on COVID-19 transmission within K-12 schools. Methods. We developed a deterministic stratified SEIR model that captures the role of social contacts between cohorts in disease transmission to estimate COVID-19 incidence under different NPIs including masks, random screening, contact reduction, school closures, and test-to-stay. We designed contact matrices to simulate the contact patterns between students and teachers within schools. We estimated the proportion of susceptible infected associated with each intervention over 1 semester under the Omicron variant. Results. We find that masks and reducing contacts can greatly reduce new infections among students. Weekly screening tests also have a positive impact on disease mitigation. While self-quarantining symptomatic infections and school closures are effective measures for decreasing semester-end infections, they increase absenteeism. Conclusion. The model provides a useful tool for evaluating the impact of a variety of NPIs on disease transmission in K-12 schools. While the model is tested under Omicron variant parameters in US K-12 schools, it can be adapted to study other populations under different disease settings. Highlights: A stratified SEIR model was developed that captures the role of social contacts in K-12 schools to estimate COVID-19 transmission under different nonpharmaceutical interventions.While masks, random screening, contact reduction, school closures, and test-to-stay are all beneficial interventions, masks and contact reduction resulted in the greatest reduction in new infections among students from the tested scenarios.Layered interventions provide more benefits than implementing interventions independently.

Use of Modeling to Inform Decision Making in North Carolina during the COVID-19 Pandemic: A Qualitative Study.

Background. The COVID-19 pandemic has popularized computer-based decision-support models, which are commonly used to inform decision making amidst complexity. Understanding what organizational decision makers prefer from these models is needed to inform model development during this and future crises. Methods. We recruited and interviewed decision makers from North Carolina across 9 sectors to understand organizational decision-making processes during the first year of the COVID-19 pandemic (N = 44). For this study, we identified and analyzed a subset of responses from interviewees (n = 19) who reported using modeling to inform decision making. We used conventional content analysis to analyze themes from this convenience sample with respect to the source of models and their applications, the value of modeling and recommended applications, and hesitancies toward the use of models. Results. Models were used to compare trends in disease spread across localities, estimate the effects of social distancing policies, and allocate scarce resources, with some interviewees depending on multiple models. Decision makers desired more granular models, capable of projecting disease spread within subpopulations and estimating where local outbreaks could occur, and incorporating a broad set of outcomes, such as social well-being. Hesitancies to the use of modeling included doubts that models could reflect nuances of human behavior, concerns about the quality of data used in models, and the limited amount of modeling specific to the local context. Conclusions. Decision makers perceived modeling as valuable for informing organizational decisions yet described varied ability and willingness to use models for this purpose. These data present an opportunity to educate organizational decision makers on the merits of decision-support modeling and to inform modeling teams on how to build more responsive models that address the needs of organizational decision makers. Highlights: Organizations from a diversity of sectors across North Carolina (including public health, education, business, government, religion, and public safety) have used decision-support modeling to inform decision making during COVID-19.Decision makers wish for models to project the spread of disease, especially at the local level (e.g., individual cities and counties), and to help estimate the outcomes of policies.Some organizational decision makers are hesitant to use modeling to inform their decisions, stemming from doubts that models could reflect nuances of human behavior, concerns about the accuracy and precision of data used in models, and the limited amount of modeling available at the local level.

Vaccinating children against COVID-19 is crucial to protect schools and communities.

To evaluate the joint impact of childhood vaccination rates and school masking policies on community transmission and severe outcomes due to COVID-19, we utilized a stochastic, agent-based simulation of North Carolina to test 24 health policy scenarios. In these scenarios, we varied the childhood (ages 5 to 19) vaccination rate relative to the adult's (ages 20 to 64) vaccination rate and the masking relaxation policies in schools. We measured the overall incidence of disease, COVID-19-related hospitalization, and mortality from 2021 July 1 to 2023 July 1. Our simulation estimates that removing all masks in schools in January 2022 could lead to a 31% to 45%, 23% to 35%, and 13% to 19% increase in cumulative infections for ages 5 to 9, 10 to 19, and the total population, respectively, depending on the childhood vaccination rate. Additionally, achieving a childhood vaccine uptake rate of 50% of adults could lead to a 31% to 39% reduction in peak hospitalizations overall masking scenarios compared with not vaccinating this group. Finally, our simulation estimates that increasing vaccination uptake for the entire eligible population can reduce peak hospitalizations in 2022 by an average of 83% and 87% across all masking scenarios compared to the scenarios where no children are vaccinated. Our simulation suggests that high vaccination uptake among both children and adults is necessary to mitigate the increase in infections from mask removal in schools and workplaces.

Checklists in Healthcare: Operational Improvement of Standards using Safety Engineering - Project CHOISSE - A framework for evaluating the effects of checklists on surgical team culture.

The CHOISSE multi-stage framework for evaluating the effects of electronic checklist applications (e-checklists) on surgical team members' perception of their roles, performance, communication, and understanding of checklists is introduced via a pilot study. A prospective interventional cohort study design was piloted to assess the effectiveness of the framework and the sociotechnical effects of the e-checklist. A Delphi process was used to design the stages of the framework based on literature and expert consensus. The CHOISSE framework was applied to guide the implementation and evaluation of e-checklists on team culture for ten pilot teams across the US over a 24-week period. The pilot results revealed more engagement by surgeons than non-surgeons, and significant increases in surgeons' perception of communication and engagement during surgery with a small sample. Mixed methods analysis of the data and lessons learned were used to identify iterative improvements to the CHOISSE framework and to inform future studies.