ABSTRACT
A wide range of research has promised new tools for forecasting infectious disease dynamics, but little of that research is currently being applied in practice, because tools do not address key public health needs, do not produce probabilistic forecasts, have not been evaluated on external data, or do not provide sufficient forecast skill to be useful. We developed an open collaborative forecasting challenge to assess probabilistic forecasts for seasonal epidemics of dengue, a major global public health problem. Sixteen teams used a variety of methods and data to generate forecasts for 3 epidemiological targets (peak incidence, the week of the peak, and total incidence) over 8 dengue seasons in Iquitos, Peru and San Juan, Puerto Rico. Forecast skill was highly variable across teams and targets. While numerous forecasts showed high skill for midseason situational awareness, early season skill was low, and skill was generally lowest for high incidence seasons, those for which forecasts would be most valuable. A comparison of modeling approaches revealed that average forecast skill was lower for models including biologically meaningful data and mechanisms and that both multimodel and multiteam ensemble forecasts consistently outperformed individual model forecasts. Leveraging these insights, data, and the forecasting framework will be critical to improve forecast skill and the application of forecasts in real time for epidemic preparedness and response. Moreover, key components of this project-integration with public health needs, a common forecasting framework, shared and standardized data, and open participation-can help advance infectious disease forecasting beyond dengue.
Subject(s)
Dengue/epidemiology , Epidemiologic Methods , Disease Outbreaks , Epidemics/prevention & control , Humans , Incidence , Models, Statistical , Peru/epidemiology , Puerto Rico/epidemiologyABSTRACT
BACKGROUND: This year, Brazil will host about 600,000 foreign visitors during the 2014 FIFA World Cup. The concern of possible dengue transmission during this event has been raised given the high transmission rates reported in the past by this country. METHODOLOGY/PRINCIPAL FINDINGS: We used dengue incidence rates reported by each host city during previous years (2001-2013) to estimate the risk of dengue during the World Cup for tourists and teams. Two statistical models were used: a percentile rank (PR) and an Empirical Bayes (EB) model. Expected IR's during the games were generally low (<10/100,000) but predictions varied across locations and between models. Based on current ticket allocations, the mean number of expected symptomatic dengue cases ranged from 26 (PR, 10th-100th percentile: 5-334 cases) to 59 (EB, 95% credible interval: 30-77 cases) among foreign tourists but none are expected among teams. These numbers will highly depend on actual travel schedules and dengue immunity among visitors. Sensitivity analysis for both models indicated that the expected number of cases could be as low as 4 or 5 with 100,000 visitors and as high as 38 or 70 with 800,000 visitors (PR and EB, respectively). CONCLUSION/SIGNIFICANCE: The risk of dengue among tourists during the World Cup is expected to be small due to immunity among the Brazil host population provided by last year's epidemic with the same DENV serotypes. Quantitative risk estimates by different groups and methodologies should be made routinely for mass gathering events.