A new twenty-first century science for effective epidemic response.

With rapidly changing ecology, urbanization, climate change, increased travel and fragile public health systems, epidemics will become more frequent, more complex and harder to prevent and contain. Here we argue that our concept of epidemics must evolve from crisis response during discrete outbreaks to an integrated cycle of preparation, response and recovery. This is an opportunity to combine knowledge and skills from all over the world-especially at-risk and affected communities. Many disciplines need to be integrated, including not only epidemiology but also social sciences, research and development, diplomacy, logistics and crisis management. This requires a new approach to training tomorrow's leaders in epidemic prevention and response.

Invited Commentary: Combining Information to Answer Epidemiologic Questions About a Target Population.

Epidemiologists are attempting to address research questions of increasing complexity by developing novel methods for combining information from diverse sources. Cole et al. (Am J Epidemiol. 2023;192(3)467-474) provide 2 examples of the process of combining information to draw inferences about a population proportion. In this commentary, we consider combining information to learn about a target population as an epidemiologic activity and distinguish it from more conventional meta-analyses. We examine possible rationales for combining information and discuss broad methodological considerations, with an emphasis on study design, assumptions, and sources of uncertainty.

Harnessing causal forests for epidemiologic research: key considerations.

Assessing heterogeneous treatment effects (HTEs) is an essential task in epidemiology. The recent integration of machine learning into causal inference has provided a new, flexible tool for evaluating complex HTEs: causal forest. In a recent paper, Jawadekar et al (Am J Epidemiol. 2023;192(7):1155-1165) introduced this innovative approach and offered practical guidelines for applied users. Building on their work, this commentary provides additional insights and guidance to promote the understanding and application of causal forest in epidemiologic research. We start with conceptual clarifications, differentiating between honesty and cross-fitting, and exploring the interpretation of estimated conditional average treatment effects. We then delve into practical considerations not addressed by Jawadekar et al, including motivations for estimating HTEs, calibration approaches, and ways to leverage causal forest output with examples from simulated data. We conclude by outlining challenges to consider for future advancements and applications of causal forest in epidemiologic research.

Invited commentary: where do the causal DAGS come from?

How do we construct our causal directed acyclic graphs (DAGs)-for example, for life-course modeling and analysis? In this commentary, I review how the data-driven construction of causal DAGs (causal discovery) has evolved, what promises it holds, and what limitations or caveats must be considered. I find that expert- or theory-driven model-building might benefit from some more checking against the data and that causal discovery could bring new ideas to old theories.

Defining Spatial Epidemiology: A Systematic Review and Re-orientation.

BACKGROUND: Spatial epidemiology has emerged as an important subfield of epidemiology over the past quarter century. We trace the origins of spatial epidemiology and note that its emergence coincided with technological developments in spatial statistics and geography. We hypothesize that spatial epidemiology makes important contributions to descriptive epidemiology and analytic risk-factor studies but is not yet aligned with epidemiology's current focus on causal inference and intervention. METHODS: We conducted a systematic review of studies indexed in PubMed that used the term "spatial epidemiolog*" in the title, abstract, or keywords. Excluded articles were not written in English, examined disease in animals, or reported biologic pathogen distribution only. We coded the included papers into five categories (review, demonstration of method, descriptive, analytic, and intervention) and recorded the unit of analysis (i.e., individual vs. ecological). We additionally examined articles coded as analytic ecologic studies using scales for lexical content. RESULTS: A total of 482 articles met the inclusion criteria, including 76 reviews, 117 demonstrations of methods, 122 descriptive studies, 167 analytic studies, and 0 intervention studies. Demonstration studies were most common from 2006 to 2014, and analytic studies were most common after 2015. Among the analytic ecologic studies, those published in later years used more terms relevant to spatial statistics (incidence rate ratio =1.3; 95% confidence interval [CI] = 1.1, 1.5) and causal inference (incidence rate ratio =1.1; 95% CI = 1.1, 1.2). CONCLUSIONS: Spatial epidemiology is an important and growing subfield of epidemiology. We suggest a re-orientation to help align its practice with the goals of contemporary epidemiology.

Leveraging vibration of effects analysis for robust discovery in observational biomedical data science.

Hypothesis generation in observational, biomedical data science often starts with computing an association or identifying the statistical relationship between a dependent and an independent variable. However, the outcome of this process depends fundamentally on modeling strategy, with differing strategies generating what can be called "vibration of effects" (VoE). VoE is defined by variation in associations that often lead to contradictory results. Here, we present a computational tool capable of modeling VoE in biomedical data by fitting millions of different models and comparing their output. We execute a VoE analysis on a series of widely reported associations (e.g., carrot intake associated with eyesight) with an extended additional focus on lifestyle exposures (e.g., physical activity) and components of the Framingham Risk Score for cardiovascular health (e.g., blood pressure). We leveraged our tool for potential confounder identification, investigating what adjusting variables are responsible for conflicting models. We propose modeling VoE as a critical step in navigating discovery in observational data, discerning robust associations, and cataloging adjusting variables that impact model output.

Epidemiology and reporting characteristics of preclinical systematic reviews.

In an effort to better utilize published evidence obtained from animal experiments, systematic reviews of preclinical studies are increasingly more common-along with the methods and tools to appraise them (e.g., SYstematic Review Center for Laboratory animal Experimentation [SYRCLE's] risk of bias tool). We performed a cross-sectional study of a sample of recent preclinical systematic reviews (2015-2018) and examined a range of epidemiological characteristics and used a 46-item checklist to assess reporting details. We identified 442 reviews published across 43 countries in 23 different disease domains that used 26 animal species. Reporting of key details to ensure transparency and reproducibility was inconsistent across reviews and within article sections. Items were most completely reported in the title, introduction, and results sections of the reviews, while least reported in the methods and discussion sections. Less than half of reviews reported that a risk of bias assessment for internal and external validity was undertaken, and none reported methods for evaluating construct validity. Our results demonstrate that a considerable number of preclinical systematic reviews investigating diverse topics have been conducted; however, their quality of reporting is inconsistent. Our study provides the justification and evidence to inform the development of guidelines for conducting and reporting preclinical systematic reviews.

Can auxiliary indicators improve COVID-19 forecasting and hotspot prediction?

Short-term forecasts of traditional streams from public health reporting (such as cases, hospitalizations, and deaths) are a key input to public health decision-making during a pandemic. Since early 2020, our research group has worked with data partners to collect, curate, and make publicly available numerous real-time COVID-19 indicators, providing multiple views of pandemic activity in the United States. This paper studies the utility of five such indicators-derived from deidentified medical insurance claims, self-reported symptoms from online surveys, and COVID-related Google search activity-from a forecasting perspective. For each indicator, we ask whether its inclusion in an autoregressive (AR) model leads to improved predictive accuracy relative to the same model excluding it. Such an AR model, without external features, is already competitive with many top COVID-19 forecasting models in use today. Our analysis reveals that 1) inclusion of each of these five indicators improves on the overall predictive accuracy of the AR model; 2) predictive gains are in general most pronounced during times in which COVID cases are trending in "flat" or "down" directions; and 3) one indicator, based on Google searches, seems to be particularly helpful during "up" trends.

An open repository of real-time COVID-19 indicators.

The COVID-19 pandemic presented enormous data challenges in the United States. Policy makers, epidemiological modelers, and health researchers all require up-to-date data on the pandemic and relevant public behavior, ideally at fine spatial and temporal resolution. The COVIDcast API is our attempt to fill this need: Operational since April 2020, it provides open access to both traditional public health surveillance signals (cases, deaths, and hospitalizations) and many auxiliary indicators of COVID-19 activity, such as signals extracted from deidentified medical claims data, massive online surveys, cell phone mobility data, and internet search trends. These are available at a fine geographic resolution (mostly at the county level) and are updated daily. The COVIDcast API also tracks all revisions to historical data, allowing modelers to account for the frequent revisions and backfill that are common for many public health data sources. All of the data are available in a common format through the API and accompanying R and Python software packages. This paper describes the data sources and signals, and provides examples demonstrating that the auxiliary signals in the COVIDcast API present information relevant to tracking COVID activity, augmenting traditional public health reporting and empowering research and decision-making.

Global monitoring of the impact of the COVID-19 pandemic through online surveys sampled from the Facebook user base.

Simultaneously tracking the global impact of COVID-19 is challenging because of regional variation in resources and reporting. Leveraging self-reported survey outcomes via an existing international social media network has the potential to provide standardized data streams to support monitoring and decision-making worldwide, in real time, and with limited local resources. The University of Maryland Global COVID-19 Trends and Impact Survey (UMD-CTIS), in partnership with Facebook, has invited daily cross-sectional samples from the social media platform's active users to participate in the survey since its launch on April 23, 2020. We analyzed UMD-CTIS survey data through December 20, 2020, from 31,142,582 responses representing 114 countries/territories weighted for nonresponse and adjusted to basic demographics. We show consistent respondent demographics over time for many countries/territories. Machine Learning models trained on national and pooled global data verified known symptom indicators. COVID-like illness (CLI) signals were correlated with government benchmark data. Importantly, the best benchmarked UMD-CTIS signal uses a single survey item whereby respondents report on CLI in their local community. In regions with strained health infrastructure but active social media users, we show it is possible to define COVID-19 impact trajectories using a remote platform independent of local government resources. This syndromic surveillance public health tool is the largest global health survey to date and, with brief participant engagement, can provide meaningful, timely insights into the global COVID-19 pandemic at a local scale.

The US COVID-19 Trends and Impact Survey: Continuous real-time measurement of COVID-19 symptoms, risks, protective behaviors, testing, and vaccination.

The US COVID-19 Trends and Impact Survey (CTIS) is a large, cross-sectional, internet-based survey that has operated continuously since April 6, 2020. By inviting a random sample of Facebook active users each day, CTIS collects information about COVID-19 symptoms, risks, mitigating behaviors, mental health, testing, vaccination, and other key priorities. The large scale of the survey-over 20 million responses in its first year of operation-allows tracking of trends over short timescales and allows comparisons at fine demographic and geographic detail. The survey has been repeatedly revised to respond to emerging public health priorities. In this paper, we describe the survey methods and content and give examples of CTIS results that illuminate key patterns and trends and help answer high-priority policy questions relevant to the COVID-19 epidemic and response. These results demonstrate how large online surveys can provide continuous, real-time indicators of important outcomes that are not subject to public health reporting delays and backlogs. The CTIS offers high value as a supplement to official reporting data by supplying essential information about behaviors, attitudes toward policy and preventive measures, economic impacts, and other topics not reported in public health surveillance systems.

Crossing Birth-Weight-Specific Mortality Curves: How a Puzzling Clinical Observation Led to an Important Advance in Epidemiologic Methods.

Throughout the second half of the 20th century, clinicians noted that although African-American neonates were more likely than White neonates to weigh less than 2,500 g at birth (low birth weight), among low-birth-weight infants African Americans were more likely than Whites to survive. However, when born at normal weight, African-American infants were substantially less likely to survive. The observation generated much physiological speculation, and several clever mathematical manipulations were devised to "uncross the mortality curves." With the development and dissemination of directed acyclic graphs in the early 2000s, methodologists focusing on perinatal epidemiology showed graphically, in an early use of directed acyclic graphs, that birth weight was a "collider" and that controlling for birth weight, whether by regression, stratification, or restriction, introduced confounding of the race-mortality association by all unmeasured common causes of birth weight and mortality. These investigations showed that the crossing curves could be explained as an artifact of a conceptually flawed analysis. These results have applicability beyond perinatal epidemiology, including applicability to the "obesity paradox."

Invited Commentary: Some Social Epidemiologic Lessons From the COVID-19 Pandemic.

In their recent article, Dimitris et al. (Am J Epidemiol. 2022;191(6):980-986) presented a series of challenges modern epidemiology has faced during the coronavirus disease 2019 (COVID-19) pandemic, including challenges around the scientific progress, epidemiologic methods, interventions, equity, team science, and training needed to address these issues. Here, 2 social epidemiologists who have been working on COVID-19 inequities reflect on further lessons with an added year of perspective. We focus on 2 key challenges: 1) dominant biomedical individualistic narratives around the production of population health, and 2) the role of profit in policy-making. We articulate a need to consider social epidemiologic approaches, including acknowledging the importance of considering how societal systems lead to health inequities. To address these challenges, future (and current) epidemiologists should be trained in theories of population health distribution and political structures of governance. Last, we close with the need for better investment in public health infrastructure as a crucial step toward achieving population health equity.

Invited Commentary: Use of Epidemiologic Methods to Guide Comprehensive and Equitable Approaches to Policy.

Despite a dramatic reduction in the prevalence of commercial cigarette smoking in the United States, children are still commonly exposed to secondhand smoke (SHS), which is a cause of various pediatric health problems. Further, SHS exposure is patterned by race and class, exacting an inequitable toll on children from families with lesser social and economic advantage. In this issue of the Journal, Titus et al. (Am J Epidemiol. 2023;192(1):25-33) use natural experiment evaluation methods (difference-in-differences) to test whether the recently implemented US Department of Housing and Urban Development policy that forbade smoking in and around New York City Housing Authority buildings affected child respiratory health. The results from their work remind us that policies do not always impact outcomes as we might expect. Given that policy is one of the most potent tools for population health promotion, this work underlines the need for epidemiologists to engage in policy evaluation at all stages of the policy life cycle, in order to discover comprehensive approaches to policy development and implementation that prioritize equity and address structural racism.

Complexity in Epidemiology and Public Health. Addressing Complex Health Problems Through a Mix of Epidemiologic Methods and Data.

Public health and the underlying disease processes are complex, often involving the interaction of biologic, social, psychologic, economic, and other processes that may be nonlinear and adaptive and have other features of complex systems. There is therefore a need to push the boundaries of public health beyond single-factor data analysis and expand the capacity of research methodology to tackle real-world complexities. This article sets out a way to operationalize complex systems thinking in public health, with a particular focus on how epidemiologic methods and data can contribute towards this end. Our proposed framework comprises three core dimensions-patterns, mechanisms, and dynamics-along which complex systems may be conceptualized. These dimensions cover seven key features of complex systems-emergence, interactions, nonlinearity, interference, feedback loops, adaptation, and evolution. We relate this framework to examples of methods and data traditionally used in epidemiology. We conclude that systematic production of knowledge on complex health issues may benefit from: formulation of research questions and programs in terms of the core dimensions we identify, as a comprehensive way to capture crucial features of complex systems; integration of traditional epidemiologic methods with systems methodology such as computational simulation modeling; interdisciplinary work; and continued investment in a wide range of data types. We believe that the proposed framework can support the systematic production of knowledge on complex health problems, with the use of epidemiology and other disciplines. This will help us understand emergent health phenomena, identify vulnerable population groups, and detect leverage points for promoting public health.

Dynamical footprints enable detection of disease emergence.

Developing methods for anticipating the emergence or reemergence of infectious diseases is both important and timely; however, traditional model-based approaches are stymied by uncertainty surrounding the underlying drivers. Here, we demonstrate an operational, mechanism-agnostic detection algorithm for disease (re-)emergence based on early warning signals (EWSs) derived from the theory of critical slowing down. Specifically, we used computer simulations to train a supervised learning algorithm to detect the dynamical footprints of (re-)emergence present in epidemiological data. Our algorithm was then challenged to forecast the slowly manifesting, spatially replicated reemergence of mumps in England in the mid-2000s and pertussis post-1980 in the United States. Our method successfully anticipated mumps reemergence 4 years in advance, during which time mitigation efforts could have been implemented. From 1980 onwards, our model identified resurgent states with increasing accuracy, leading to reliable classification starting in 1992. Additionally, we successfully applied the detection algorithm to 2 vector-transmitted case studies, namely, outbreaks of dengue serotypes in Puerto Rico and a rapidly unfolding outbreak of plague in 2017 in Madagascar. Taken together, these findings illustrate the power of theoretically informed machine learning techniques to develop early warning systems for the (re-)emergence of infectious diseases.

Response to Tsuda et al. "demonstrating the undermining of science and health policy after the Fukushima nuclear accident by applying the toolkit for detecting misused epidemiological methods".

BACKGROUND: The SHAMISEN (Nuclear Emergency Situations - Improvement of Medical And Health Surveillance) European project was conducted in 2015-2017 to review the lessons learned from the experience of past nuclear accidents and develop recommendations for preparedness and health surveillance of populations affected by a nuclear accident. Using a toolkit approach, Tsuda et al. recently published a critical review of the article by Cléro et al. derived from the SHAMISEN project on thyroid cancer screening after nuclear accident. MAIN BODY: We address the main points of criticism of our publication on the SHAMISEN European project. CONCLUSION: We disagree with some of the arguments and criticisms mentioned by Tsuda et al. We continue to support the conclusions and recommendations of the SHAMISEN consortium, including the recommendation not to launch a mass thyroid cancer screening after a nuclear accident, but rather to make it available (with appropriate information counselling) to those who request it.

Incubation periods impact the spatial predictability of cholera and Ebola outbreaks in Sierra Leone.

Forecasting the spatiotemporal spread of infectious diseases during an outbreak is an important component of epidemic response. However, it remains challenging both methodologically and with respect to data requirements, as disease spread is influenced by numerous factors, including the pathogen's underlying transmission parameters and epidemiological dynamics, social networks and population connectivity, and environmental conditions. Here, using data from Sierra Leone, we analyze the spatiotemporal dynamics of recent cholera and Ebola outbreaks and compare and contrast the spread of these two pathogens in the same population. We develop a simulation model of the spatial spread of an epidemic in order to examine the impact of a pathogen's incubation period on the dynamics of spread and the predictability of outbreaks. We find that differences in the incubation period alone can determine the limits of predictability for diseases with different natural history, both empirically and in our simulations. Our results show that diseases with longer incubation periods, such as Ebola, where infected individuals can travel farther before becoming infectious, result in more long-distance sparking events and less predictable disease trajectories, as compared to the more predictable wave-like spread of diseases with shorter incubation periods, such as cholera.

Online Health Communities: an alternative feasible data registry tool for developing countries.

Given the many challenges facing healthcare access in many developing countries and the added limitations observed in emergencies like COVID-19 pandemic, the authors here discuss an alternative and feasible approach to overcome all these limitations.

Performance Evaluation of Parametric and Nonparametric Methods When Assessing Effect Measure Modification.

Effect measure modification is often evaluated using parametric models. These models, although efficient when correctly specified, make strong parametric assumptions. While nonparametric models avoid important functional form assumptions, they often require larger samples to achieve a given accuracy. We conducted a simulation study to evaluate performance tradeoffs between correctly specified parametric and nonparametric models to detect effect modification of a binary exposure by both binary and continuous modifiers. We evaluated generalized linear models and doubly robust (DR) estimators, with and without sample splitting. Continuous modifiers were modeled with cubic splines, fractional polynomials, and nonparametric DR-learner. For binary modifiers, generalized linear models showed the greatest power to detect effect modification, ranging from 0.42 to 1.00 in the worst and best scenario, respectively. Augmented inverse probability weighting had the lowest power, with an increase of 23% when using sample splitting. For continuous modifiers, the DR-learner was comparable to flexible parametric models in capturing quadratic and nonlinear monotonic functions. However, for nonlinear, nonmonotonic functions, the DR-learner had lower integrated bias than splines and fractional polynomials, with values of 141.3, 251.7, and 209.0, respectively. Our findings suggest comparable performance between nonparametric and correctly specified parametric models in evaluating effect modification.