Multiple models for outbreak decision support in the face of uncertainty.

Policymakers must make management decisions despite incomplete knowledge and conflicting model projections. Little guidance exists for the rapid, representative, and unbiased collection of policy-relevant scientific input from independent modeling teams. Integrating approaches from decision analysis, expert judgment, and model aggregation, we convened multiple modeling teams to evaluate COVID-19 reopening strategies for a mid-sized United States county early in the pandemic. Projections from seventeen distinct models were inconsistent in magnitude but highly consistent in ranking interventions. The 6-mo-ahead aggregate projections were well in line with observed outbreaks in mid-sized US counties. The aggregate results showed that up to half the population could be infected with full workplace reopening, while workplace restrictions reduced median cumulative infections by 82%. Rankings of interventions were consistent across public health objectives, but there was a strong trade-off between public health outcomes and duration of workplace closures, and no win-win intermediate reopening strategies were identified. Between-model variation was high; the aggregate results thus provide valuable risk quantification for decision making. This approach can be applied to the evaluation of management interventions in any setting where models are used to inform decision making. This case study demonstrated the utility of our approach and was one of several multimodel efforts that laid the groundwork for the COVID-19 Scenario Modeling Hub, which has provided multiple rounds of real-time scenario projections for situational awareness and decision making to the Centers for Disease Control and Prevention since December 2020.

The changing health impact of vaccines in the COVID-19 pandemic: A modeling study.

Much of the world's population had already been infected with COVID-19 by the time the Omicron variant emerged at the end of 2021, but the scale of the Omicron wave was larger than any that had come before or has happened since, and it left a global imprinting of immunity that changed the COVID-19 landscape. In this study, we simulate a South African population and demonstrate how population-level vaccine effectiveness and efficiency changed over the course of the first 2 years of the pandemic. We then introduce three hypothetical variants and evaluate the impact of vaccines with different properties. We find that variant-chasing vaccines have a narrow window of dominating pre-existing vaccines but that a variant-chasing vaccine strategy may have global utility, depending on the rate of spread from setting to setting. Next-generation vaccines might be able to overcome uncertainty in pace and degree of viral evolution.

Frequent and unpredictable changes in COVID-19 policies and restrictions reduce the accuracy of model forecasts.

Between June and August 2020, an agent-based model was used to project rates of COVID-19 infection incidence and cases diagnosed as positive from 15 September to 31 October 2020 for 72 geographic settings. Five scenarios were modelled: a baseline scenario where no future changes were made to existing restrictions, and four scenarios representing small or moderate changes in restrictions at two intervals. Post hoc, upper and lower bounds for number of diagnosed Covid-19 cases were compared with actual data collected during the prediction window. A regression analysis with 17 covariates was performed to determine correlates of accurate projections. It was found that the actual data fell within the lower and upper bounds in 27 settings and out of bounds in 45 settings. The only statistically significant predictor of actual data within the predicted bounds was correct assumptions about future policy changes (OR 15.04; 95% CI 2.20-208.70; p = 0.016). Frequent changes in restrictions implemented by governments, which the modelling team was not always able to predict, in part explains why the majority of model projections were inaccurate compared with actual outcomes and supports revision of projections when policies are changed as well as the importance of modelling teams collaborating with policy experts.

How to do (or not to do) health resource allocations using constrained mathematical optimization.

Despite the push towards evidence-based health policy, decisions about how to allocate health resources are all too often made on the basis of political forces or a continuation of the status quo. This results in wastage in health systems and loss of potential population health. However, if health systems are to serve people best, then they must operate efficiently and equitably, and appropriate valuation methods are needed to determine how to do this. With the advances in computing power over the past few decades, advanced mathematical optimization algorithms can now be run on personal computers and can be used to provide comprehensive, evidence-based recommendations for policymakers on how to prioritize health spending considering policy objectives, interactions of interventions, real-world system constraints and budget envelopes. Such methods provide an invaluable complement to traditional or extended cost-effectiveness analyses or league tables. In this paper, we describe how such methods work, how policymakers and programme managers can access them and implement their recommendations and how they have changed health spending in the world to date.

Modelling herd immunity requirements in Queensland: impact of vaccination effectiveness, hesitancy and variants of SARS-CoV-2.

Long-term control of SARS-CoV-2 outbreaks depends on the widespread coverage of effective vaccines. In Australia, two-dose vaccination coverage of above 90% of the adult population was achieved. However, between August 2020 and August 2021, hesitancy fluctuated dramatically. This raised the question of whether settings with low naturally derived immunity, such as Queensland where less than [Formula: see text] of the population is known to have been infected in 2020, could have achieved herd immunity against 2021's variants of concern. To address this question, we used the agent-based model Covasim. We simulated outbreak scenarios (with the Alpha, Delta and Omicron variants) and assumed ongoing interventions (testing, tracing, isolation and quarantine). We modelled vaccination using two approaches with different levels of realism. Hesitancy was modelled using Australian survey data. We found that with a vaccine effectiveness against infection of 80%, it was possible to control outbreaks of Alpha, but not Delta or Omicron. With 90% effectiveness, Delta outbreaks may have been preventable, but not Omicron outbreaks. We also estimated that a decrease in hesitancy from 20% to 14% reduced the number of infections, hospitalizations and deaths by over 30%. Overall, we demonstrate that while herd immunity may not be attainable, modest reductions in hesitancy and increases in vaccine uptake may greatly improve health outcomes. This article is part of the theme issue 'Technical challenges of modelling real-life epidemics and examples of overcoming these'.

Impact of SARS-CoV-2 Gamma lineage introduction and COVID-19 vaccination on the epidemiological landscape of a Brazilian city.

Background: The emergence of the Brazilian variant of concern, Gamma lineage (P.1), impacted the epidemiological profile of COVID-19 cases due to its higher transmissibility rate and immune evasion ability. Methods: We sequenced 305 SARS-CoV-2 whole-genomes and performed phylogenetic analyses to identify introduction events and the circulating lineages. Additionally, we use epidemiological data of COVID-19 cases, severe cases, and deaths to measure the impact of vaccination coverage and mortality risk. Results: Here we show that Gamma introduction in São José do Rio Preto, São Paulo, Brazil, was followed by the displacement of seven circulating SARS-CoV-2 variants and a rapid increase in prevalence two months after its first detection in January 2021. Moreover, Gamma variant is associated with increased mortality risk and severity of COVID-19 cases in younger age groups, which corresponds to the unvaccinated population at the time. Conclusions: Our findings highlight the beneficial effects of vaccination indicated by a pronounced reduction of severe cases and deaths in immunized individuals, reinforcing the need for rapid and massive vaccination.

Training a spiking neuronal network model of visual-motor cortex to play a virtual racket-ball game using reinforcement learning.

Recent models of spiking neuronal networks have been trained to perform behaviors in static environments using a variety of learning rules, with varying degrees of biological realism. Most of these models have not been tested in dynamic visual environments where models must make predictions on future states and adjust their behavior accordingly. The models using these learning rules are often treated as black boxes, with little analysis on circuit architectures and learning mechanisms supporting optimal performance. Here we developed visual/motor spiking neuronal network models and trained them to play a virtual racket-ball game using several reinforcement learning algorithms inspired by the dopaminergic reward system. We systematically investigated how different architectures and circuit-motifs (feed-forward, recurrent, feedback) contributed to learning and performance. We also developed a new biologically-inspired learning rule that significantly enhanced performance, while reducing training time. Our models included visual areas encoding game inputs and relaying the information to motor areas, which used this information to learn to move the racket to hit the ball. Neurons in the early visual area relayed information encoding object location and motion direction across the network. Neuronal association areas encoded spatial relationships between objects in the visual scene. Motor populations received inputs from visual and association areas representing the dorsal pathway. Two populations of motor neurons generated commands to move the racket up or down. Model-generated actions updated the environment and triggered reward or punishment signals that adjusted synaptic weights so that the models could learn which actions led to reward. Here we demonstrate that our biologically-plausible learning rules were effective in training spiking neuronal network models to solve problems in dynamic environments. We used our models to dissect the circuit architectures and learning rules most effective for learning. Our model shows that learning mechanisms involving different neural circuits produce similar performance in sensory-motor tasks. In biological networks, all learning mechanisms may complement one another, accelerating the learning capabilities of animals. Furthermore, this also highlights the resilience and redundancy in biological systems.

Risk of sustained SARS-CoV-2 transmission in Queensland, Australia.

We used an agent-based model Covasim to assess the risk of sustained community transmission of SARSCoV-2/COVID-19 in Queensland (Australia) in the presence of high-transmission variants of the virus. The model was calibrated using the demographics, policies, and interventions implemented in the state. Then, using the calibrated model, we simulated possible epidemic trajectories that could eventuate due to leakage of infected cases with high-transmission variants, during a period without recorded cases of locally acquired infections, known in Australian settings as "zero community transmission". We also examined how the threat of new variants reduces given a range of vaccination levels. Specifically, the model calibration covered the first-wave period from early March 2020 to May 2020. Predicted epidemic trajectories were simulated from early February 2021 to late March 2021. Our simulations showed that one infected agent with the ancestral (A.2.2) variant has a 14% chance of crossing a threshold of sustained community transmission (SCT) (i.e., > 5 infections per day, more than 3 days in a row), assuming no change in the prevailing preventative and counteracting policies. However, one agent carrying the alpha (B.1.1.7) variant has a 43% chance of crossing the same threshold; a threefold increase with respect to the ancestral strain; while, one agent carrying the delta (B.1.617.2) variant has a 60% chance of the same threshold, a fourfold increase with respect to the ancestral strain. The delta variant is 50% more likely to trigger SCT than the alpha variant. Doubling the average number of daily tests from ∼ 6,000 to 12,000 results in a decrease of this SCT probability from 43 to 33% for the alpha variant. However, if the delta variant is circulating we would need an average of 100,000 daily tests to achieve a similar decrease in SCT risk. Further, achieving a full-vaccination coverage of 70% of the adult population, with a vaccine with 70% effectiveness against infection, would decrease the probability of SCT from a single seed of alpha from 43 to 20%, on par with the ancestral strain in a naive population. In contrast, for the same vaccine coverage and same effectiveness, the probability of SCT from a single seed of delta would decrease from 62 to 48%, a risk slightly above the alpha variant in a naive population. Our results demonstrate that the introduction of even a small number of people infected with high-transmission variants dramatically increases the probability of sustained community transmission in Queensland. Until very high vaccine coverage is achieved, a swift implementation of policies and interventions, together with high quarantine adherence rates, will be required to minimise the probability of sustained community transmission.

Preventing a cluster from becoming a new wave in settings with zero community COVID-19 cases.

BACKGROUND: In settings with zero community transmission, any new SARS-CoV-2 outbreaks are likely to be the result of random incursions. The level of restrictions in place at the time of the incursion is likely to considerably affect possible outbreak trajectories, but the probability that a large outbreak eventuates is not known. METHODS: We used an agent-based model to investigate the relationship between ongoing restrictions and behavioural factors, and the probability of an incursion causing an outbreak and the resulting growth rate. We applied our model to the state of Victoria, Australia, which has reached zero community transmission as of November 2020. RESULTS: We found that a future incursion has a 45% probability of causing an outbreak (defined as a 7-day average of > 5 new cases per day within 60 days) if no restrictions were in place, decreasing to 23% with a mandatory masks policy, density restrictions on venues such as restaurants, and if employees worked from home where possible. A drop in community symptomatic testing rates was associated with up to a 10-percentage point increase in outbreak probability, highlighting the importance of maintaining high testing rates as part of a suppression strategy. CONCLUSIONS: Because the chance of an incursion occurring is closely related to border controls, outbreak risk management strategies require an integrated approaching spanning border controls, ongoing restrictions, and plans for response. Each individual restriction or control strategy reduces the risk of an outbreak. They can be traded off against each other, but if too many are removed there is a danger of accumulating an unsafe level of risk. The outbreak probabilities estimated in this study are of particular relevance in assessing the downstream risks associated with increased international travel.

Optima TB: A tool to help optimally allocate tuberculosis spending.

Approximately 85% of tuberculosis (TB) related deaths occur in low- and middle-income countries where health resources are scarce. Effective priority setting is required to maximise the impact of limited budgets. The Optima TB tool has been developed to support analytical capacity and inform evidence-based priority setting processes for TB health benefits package design. This paper outlines the Optima TB framework and how it was applied in Belarus, an upper-middle income country in Eastern Europe with a relatively high burden of TB. Optima TB is a population-based disease transmission model, with programmatic cost functions and an optimisation algorithm. Modelled populations include age-differentiated general populations and higher-risk populations such as people living with HIV. Populations and prospective interventions are defined in consultation with local stakeholders. In partnership with the latter, demographic, epidemiological, programmatic, as well as cost and spending data for these populations and interventions are then collated. An optimisation analysis of TB spending was conducted in Belarus, using program objectives and constraints defined in collaboration with local stakeholders, which included experts, decision makers, funders and organisations involved in service delivery, support and technical assistance. These analyses show that it is possible to improve health impact by redistributing current TB spending in Belarus. Specifically, shifting funding from inpatient- to outpatient-focused care models, and from mass screening to active case finding strategies, could reduce TB prevalence and mortality by up to 45% and 50%, respectively, by 2035. In addition, an optimised allocation of TB spending could lead to a reduction in drug-resistant TB infections by 40% over this period. This would support progress towards national TB targets without additional financial resources. The case study in Belarus demonstrates how reallocations of spending across existing and new interventions could have a substantial impact on TB outcomes. This highlights the potential for Optima TB and similar modelling tools to support evidence-based priority setting.

Covasim: An agent-based model of COVID-19 dynamics and interventions.

The COVID-19 pandemic has created an urgent need for models that can project epidemic trends, explore intervention scenarios, and estimate resource needs. Here we describe the methodology of Covasim (COVID-19 Agent-based Simulator), an open-source model developed to help address these questions. Covasim includes country-specific demographic information on age structure and population size; realistic transmission networks in different social layers, including households, schools, workplaces, long-term care facilities, and communities; age-specific disease outcomes; and intrahost viral dynamics, including viral-load-based transmissibility. Covasim also supports an extensive set of interventions, including non-pharmaceutical interventions, such as physical distancing and protective equipment; pharmaceutical interventions, including vaccination; and testing interventions, such as symptomatic and asymptomatic testing, isolation, contact tracing, and quarantine. These interventions can incorporate the effects of delays, loss-to-follow-up, micro-targeting, and other factors. Implemented in pure Python, Covasim has been designed with equal emphasis on performance, ease of use, and flexibility: realistic and highly customized scenarios can be run on a standard laptop in under a minute. In collaboration with local health agencies and policymakers, Covasim has already been applied to examine epidemic dynamics and inform policy decisions in more than a dozen countries in Africa, Asia-Pacific, Europe, and North America.

Controlling COVID-19 via test-trace-quarantine.

Initial COVID-19 containment in the United States focused on limiting mobility, including school and workplace closures. However, these interventions have had enormous societal and economic costs. Here, we demonstrate the feasibility of an alternative control strategy, test-trace-quarantine: routine testing of primarily symptomatic individuals, tracing and testing their known contacts, and placing their contacts in quarantine. We perform this analysis using Covasim, an open-source agent-based model, which has been calibrated to detailed demographic, mobility, and epidemiological data for the Seattle region from January through June 2020. With current levels of mask use and schools remaining closed, we find that high but achievable levels of testing and tracing are sufficient to maintain epidemic control even under a return to full workplace and community mobility and with low vaccine coverage. The easing of mobility restrictions in June 2020 and subsequent scale-up of testing and tracing programs through September provided real-world validation of our predictions. Although we show that test-trace-quarantine can control the epidemic in both theory and practice, its success is contingent on high testing and tracing rates, high quarantine compliance, relatively short testing and tracing delays, and moderate to high mask use. Thus, in order for test-trace-quarantine to control transmission with a return to high mobility, strong performance in all aspects of the program is required.

Role of masks, testing and contact tracing in preventing COVID-19 resurgences: a case study from New South Wales, Australia.

OBJECTIVES: The early stages of the COVID-19 pandemic illustrated that SARS-CoV-2, the virus that causes the disease, has the potential to spread exponentially. Therefore, as long as a substantial proportion of the population remains susceptible to infection, the potential for new epidemic waves persists even in settings with low numbers of active COVID-19 infections, unless sufficient countermeasures are in place. We aim to quantify vulnerability to resurgences in COVID-19 transmission under variations in the levels of testing, tracing and mask usage. SETTING: The Australian state of New South Wales (NSW), a setting with prolonged low transmission, high mobility, non-universal mask usage and a well-functioning test-and-trace system. PARTICIPANTS: None (simulation study). RESULTS: We find that the relative impact of masks is greatest when testing and tracing rates are lower and vice versa. Scenarios with very high testing rates (90% of people with symptoms, plus 90% of people with a known history of contact with a confirmed case) were estimated to lead to a robustly controlled epidemic. However, across comparable levels of mask uptake and contact tracing, the number of infections over this period was projected to be 2-3 times higher if the testing rate was 80% instead of 90%, 8-12 times higher if the testing rate was 65% or 30-50 times higher with a 50% testing rate. In reality, NSW diagnosed 254 locally acquired cases over this period, an outcome that had a moderate probability in the model (10%-18%) assuming low mask uptake (0%-25%), even in the presence of extremely high testing (90%) and near-perfect community contact tracing (75%-100%), and a considerably higher probability if testing or tracing were at lower levels. CONCLUSIONS: Our work suggests that testing, tracing and masks can all be effective means of controlling transmission. A multifaceted strategy that combines all three, alongside continued hygiene and distancing protocols, is likely to be the most robust means of controlling transmission of SARS-CoV-2.

Estimating and mitigating the risk of COVID-19 epidemic rebound associated with reopening of international borders in Vietnam: a modelling study.

BACKGROUND: Vietnam has emerged as one of the world's leading success stories in responding to COVID-19. After a prolonged period of little to no transmission, there was an outbreak of unknown source in July, 2020, in the Da Nang region, but the outbreak was quickly suppressed. We aimed to use epidemiological, behavioural, demographic, and policy data from the COVID-19 outbreak in Da Nang to calibrate an agent-based model of COVID-19 transmission for Vietnam, and to estimate the risk of future outbreaks associated with reopening of international borders in the country. METHODS: For this modelling study, we used comprehensive data from June 15 to Oct 15, 2020, on testing, COVID-19 cases, and quarantine breaches within an agent-based model of SARS-CoV-2 transmission to model a COVID-19 outbreak in Da Nang in July, 2020. We applied this model to quantify the risk of future outbreaks in Vietnam in the 3 months after the reopening of international borders, under different behavioural scenarios, policy responses (ie, closure of workplaces and schools), and ongoing testing. FINDINGS: We estimated that the outbreak in Da Nang between July and August, 2020, resulted in substantial community transmission, and that higher levels of symptomatic testing could have mitigated this transmission. We estimated that the outbreak peaked on Aug 2, 2020, with an estimated 1060 active infections (95% projection interval 890-1280). If the population of Vietnam remains highly compliant with mask-wearing policies, our projections indicate that the epidemic would remain under control even if a small but steady flow of imported infections escaped quarantine into the community. However, if complacency increases and testing rates are relatively low (10% of symptomatic individuals are tested), the epidemic could rebound again, resulting in an estimated 2100 infections (95% projected interval 1050-3610) in 3 months. These outcomes could be mitigated if the behaviour of the general population responds dynamically to increases in locally acquired cases that exceed specific thresholds, but only if testing of symptomatic individuals is also increased. INTERPRETATION: The successful response to COVID-19 in Vietnam could be improved even further with higher levels of symptomatic testing. If the previous approaches are used in response to new COVID-19 outbreaks, epidemic control is possible even in the presence of low levels of imported cases. FUNDING: Ministry of Science and Technology (Vietnam). TRANSLATION: For the Vietnamese translation of the abstract see Supplementary Materials section.

Modelling the impact of relaxing COVID-19 control measures during a period of low viral transmission.

OBJECTIVES: To assess the risks associated with relaxing coronavirus disease 2019 (COVID-19)-related physical distancing restrictions and lockdown policies during a period of low viral transmission. DESIGN: Network-based viral transmission risks in households, schools, workplaces, and a variety of community spaces and activities were simulated in an agent-based model, Covasim. SETTING: The model was calibrated for a baseline scenario reflecting the epidemiological and policy environment in Victoria during March-May 2020, a period of low community viral transmission. INTERVENTION: Policy changes for easing COVID-19-related restrictions from May 2020 were simulated in the context of interventions that included testing, contact tracing (including with a smartphone app), and quarantine. MAIN OUTCOME MEASURE: Increase in detected COVID-19 cases following relaxation of restrictions. RESULTS: Policy changes that facilitate contact of individuals with large numbers of unknown people (eg, opening bars, increased public transport use) were associated with the greatest risk of COVID-19 case numbers increasing; changes leading to smaller, structured gatherings with known contacts (eg, small social gatherings, opening schools) were associated with lower risks. In our model, the rise in case numbers following some policy changes was notable only two months after their implementation. CONCLUSIONS: Removing several COVID-19-related restrictions within a short period of time should be undertaken with care, as the consequences may not be apparent for more than two months. Our findings support continuation of work from home policies (to reduce public transport use) and strategies that mitigate the risk associated with re-opening of social venues.

COVID-19 reopening strategies at the county level in the face of uncertainty: Multiple Models for Outbreak Decision Support.

Policymakers make decisions about COVID-19 management in the face of considerable uncertainty. We convened multiple modeling teams to evaluate reopening strategies for a mid-sized county in the United States, in a novel process designed to fully express scientific uncertainty while reducing linguistic uncertainty and cognitive biases. For the scenarios considered, the consensus from 17 distinct models was that a second outbreak will occur within 6 months of reopening, unless schools and non-essential workplaces remain closed. Up to half the population could be infected with full workplace reopening; non-essential business closures reduced median cumulative infections by 82%. Intermediate reopening interventions identified no win-win situations; there was a trade-off between public health outcomes and duration of workplace closures. Aggregate results captured twice the uncertainty of individual models, providing a more complete expression of risk for decision-making purposes.

Determining the optimal strategy for reopening schools, the impact of test and trace interventions, and the risk of occurrence of a second COVID-19 epidemic wave in the UK: a modelling study.

BACKGROUND: As lockdown measures to slow the spread of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection begin to ease in the UK, it is important to assess the impact of any changes in policy, including school reopening and broader relaxation of physical distancing measures. We aimed to use an individual-based model to predict the impact of two possible strategies for reopening schools to all students in the UK from September, 2020, in combination with different assumptions about relaxation of physical distancing measures and the scale-up of testing. METHODS: In this modelling study, we used Covasim, a stochastic individual-based model for transmission of SARS-CoV-2, calibrated to the UK epidemic. The model describes individuals' contact networks stratified into household, school, workplace, and community layers, and uses demographic and epidemiological data from the UK. We simulated six different scenarios, representing the combination of two school reopening strategies (full time and a part-time rota system with 50% of students attending school on alternate weeks) and three testing scenarios (68% contact tracing with no scale-up in testing, 68% contact tracing with sufficient testing to avoid a second COVID-19 wave, and 40% contact tracing with sufficient testing to avoid a second COVID-19 wave). We estimated the number of new infections, cases, and deaths, as well as the effective reproduction number (R) under different strategies. In a sensitivity analysis to account for uncertainties within the stochastic simulation, we also simulated infectiousness of children and young adults aged younger than 20 years at 50% relative to older ages (20 years and older). FINDINGS: With increased levels of testing (between 59% and 87% of symptomatic people tested at some point during an active SARS-CoV-2 infection, depending on the scenario), and effective contact tracing and isolation, an epidemic rebound might be prevented. Assuming 68% of contacts could be traced, we estimate that 75% of individuals with symptomatic infection would need to be tested and positive cases isolated if schools return full-time in September, or 65% if a part-time rota system were used. If only 40% of contacts could be traced, these figures would increase to 87% and 75%, respectively. However, without these levels of testing and contact tracing, reopening of schools together with gradual relaxing of the lockdown measures are likely to induce a second wave that would peak in December, 2020, if schools open full-time in September, and in February, 2021, if a part-time rota system were adopted. In either case, the second wave would result in R rising above 1 and a resulting second wave of infections 2·0-2·3 times the size of the original COVID-19 wave. When infectiousness of children and young adults was varied from 100% to 50% of that of older ages, we still found that a comprehensive and effective test-trace-isolate strategy would be required to avoid a second COVID-19 wave. INTERPRETATION: To prevent a second COVID-19 wave, relaxation of physical distancing, including reopening of schools, in the UK must be accompanied by large-scale, population-wide testing of symptomatic individuals and effective tracing of their contacts, followed by isolation of diagnosed individuals. FUNDING: None.

Optimal allocation of HIV resources among geographical regions.

BACKGROUND: Health resources are limited, which means spending should be focused on the people, places and programs that matter most. Choosing the mix of programs to maximize a health outcome is termed allocative efficiency. Here, we extend the methodology of allocative efficiency to answer the question of how resources should be distributed among different geographic regions. METHODS: We describe a novel geographical optimization algorithm, which has been implemented as an extension to the Optima HIV model. This algorithm identifies an optimal funding of services and programs across regions, such as multiple countries or multiple districts within a country. The algorithm consists of three steps: (1) calibrating the model to each region, (2) determining the optimal allocation for each region across a range of different budget levels, and (3) finding the budget level in each region that minimizes the outcome (such as reducing new HIV infections and/or HIV-related deaths), subject to the constraint of fixed total budget across all regions. As a case study, we applied this method to determine an illustrative allocation of HIV program funding across three representative oblasts (regions) in Ukraine (Mykolayiv, Poltava, and Zhytomyr) to minimize the number of new HIV infections. RESULTS: Geographical optimization was found to identify solutions with better outcomes than would be possible by considering region-specific allocations alone. In the case of Ukraine, prior to optimization (i.e. with status quo spending), a total of 244,000 HIV-related disability-adjusted life years (DALYs) were estimated to occur from 2016 to 2030 across the three oblasts. With optimization within (but not between) oblasts, this was estimated to be reduced to 181,000. With geographical optimization (i.e., allowing reallocation of funds between oblasts), this was estimated to be further reduced to 173,000. CONCLUSIONS: With the increasing availability of region- and even facility-level data, geographical optimization is likely to play an increasingly important role in health economic decision making. Although the largest gains are typically due to reallocating resources to the most effective interventions, especially treatment, further gains can be achieved by optimally reallocating resources between regions. Finally, the methods described here are not restricted to geographical optimization, and can be applied to other problems where competing resources need to be allocated with constraints, such as between diseases.

NetPyNE, a tool for data-driven multiscale modeling of brain circuits.

Biophysical modeling of neuronal networks helps to integrate and interpret rapidly growing and disparate experimental datasets at multiple scales. The NetPyNE tool (www.netpyne.org) provides both programmatic and graphical interfaces to develop data-driven multiscale network models in NEURON. NetPyNE clearly separates model parameters from implementation code. Users provide specifications at a high level via a standardized declarative language, for example connectivity rules, to create millions of cell-to-cell connections. NetPyNE then enables users to generate the NEURON network, run efficiently parallelized simulations, optimize and explore network parameters through automated batch runs, and use built-in functions for visualization and analysis - connectivity matrices, voltage traces, spike raster plots, local field potentials, and information theoretic measures. NetPyNE also facilitates model sharing by exporting and importing standardized formats (NeuroML and SONATA). NetPyNE is already being used to teach computational neuroscience students and by modelers to investigate brain regions and phenomena.