Risk Assessment of Combined Exposure to Multiple Chemicals at the European Food Safety Authority: Principles, Guidance Documents, Applications and Future Challenges.

Human health and animal health risk assessment of combined exposure to multiple chemicals use the same steps as single-substance risk assessment, namely problem formulation, exposure assessment, hazard assessment and risk characterisation. The main unique feature of combined RA is the assessment of combined exposure, toxicity and risk. Recently, the Scientific Committee of the European Food Safety Authority (EFSA) published two relevant guidance documents. The first one "Harmonised methodologies for the human health, animal health and ecological risk assessment of combined exposure to multiple chemicals" provides principles and explores methodologies for all steps of risk assessment together with a reporting table. This guidance supports also the default assumption that dose addition is applied for combined toxicity of the chemicals unless evidence for response addition or interactions (antagonism or synergism) is available. The second guidance document provides an account of the scientific criteria to group chemicals in assessment groups using hazard-driven criteria and prioritisation methods, i.e., exposure-driven and risk-based approaches. This manuscript describes such principles, provides a brief description of EFSA's guidance documents, examples of applications in the human health and animal health area and concludes with a discussion on future challenges in this field.

A value of information framework for assessing the trade-offs associated with uncertainty, duration, and cost of chemical toxicity testing.

A number of investigators have explored the use of value of information (VOI) analysis to evaluate alternative information collection procedures in diverse decision-making contexts. This paper presents an analytic framework for determining the value of toxicity information used in risk-based decision making. The framework is specifically designed to explore the trade-offs between cost, timeliness, and uncertainty reduction associated with different toxicity-testing methodologies. The use of the proposed framework is demonstrated by two illustrative applications which, although based on simplified assumptions, show the insights that can be obtained through the use of VOI analysis. Specifically, these results suggest that timeliness of information collection has a significant impact on estimates of the VOI of chemical toxicity tests, even in the presence of smaller reductions in uncertainty. The framework introduces the concept of the expected value of delayed sample information, as an extension to the usual expected value of sample information, to accommodate the reductions in value resulting from delayed decision making. Our analysis also suggests that lower cost and higher throughput testing also may be beneficial in terms of public health benefits by increasing the number of substances that can be evaluated within a given budget. When the relative value is expressed in terms of return-on-investment per testing strategy, the differences can be substantial.

A Framework that Considers the Impacts of Time, Cost, and Uncertainty in the Determination of the Cost Effectiveness of Toxicity-Testing Methodologies.

Regulatory agencies are required to evaluate the impacts of thousands of chemicals. Toxicological tests currently used in such evaluations are time-consuming and resource intensive; however, advances in toxicology and related fields are providing new testing methodologies that reduce the cost and time required for testing. The selection of a preferred methodology is challenging because the new methodologies vary in duration and cost, and the data they generate vary in the level of uncertainty. This article presents a framework for performing cost-effectiveness analyses (CEAs) of toxicity tests that account for cost, duration, and uncertainty. This is achieved by using an output metric-the cost per correct regulatory decision-that reflects the three elements. The framework is demonstrated in two example CEAs, one for a simple decision of risk acceptability and a second, more complex decision, involving the selection of regulatory actions. Each example CEA evaluates five hypothetical toxicity-testing methodologies which differ with respect to cost, time, and uncertainty. The results of the examples indicate that either a fivefold reduction in cost or duration can be a larger driver of the selection of an optimal toxicity-testing methodology than a fivefold reduction in uncertainty. Uncertainty becomes of similar importance to cost and duration when decisionmakers are required to make more complex decisions that require the determination of small differences in risk predictions. The framework presented in this article may provide a useful basis for the identification of cost-effective methods for toxicity testing of large numbers of chemicals.

The Residential Population Generator (RPGen): Parameterization of Residential, Demographic, and Physiological Data to Model Intraindividual Exposure, Dose, and Risk.

Exposure to chemicals is influenced by associations between the individual's location and activities as well as demographic and physiological characteristics. Currently, many exposure models simulate individuals by drawing distributions from population-level data or use exposure factors for single individuals. The Residential Population Generator (RPGen) binds US surveys of individuals and households and combines the population with physiological characteristics to create a synthetic population. In general, the model must be supported by internal consistency; i.e., values that could have come from a single individual. In addition, intraindividual variation must be representative of the variation present in the modeled population. This is performed by linking individuals and similar households across income, location, family type, and house type. Physiological data are generated by linking census data to National Health and Nutrition Examination Survey data with a model of interindividual variation of parameters used in toxicokinetic modeling. The final modeled population data parameters include characteristics of the individual's community (region, state, urban or rural), residence (size of property, size of home, number of rooms), demographics (age, ethnicity, income, gender), and physiology (body weight, skin surface area, breathing rate, cardiac output, blood volume, and volumes for body compartments and organs). RPGen output is used to support user-developed chemical exposure models that estimate intraindividual exposure in a desired population. By creating profiles and characteristics that determine exposure, synthetic populations produced by RPGen increases the ability of modelers to identify subgroups potentially vulnerable to chemical exposures. To demonstrate application, RPGen is used to estimate exposure to Toluene in an exposure modeling case example.

Data Mining Approaches for Assessing Chemical Coexposures Using Consumer Product Purchase Data.

The use of consumer products presents a potential for chemical exposures to humans. Toxicity testing and exposure models are routinely employed to estimate risks from their use; however, a key challenge is the sparseness of information concerning who uses products and which products are used contemporaneously. Our goal was to demonstrate a method to infer use patterns by way of purchase data. We examined purchase patterns for three types of personal care products (cosmetics, hair care, and skin care) and two household care products (household cleaners and laundry supplies) using data from 60,000 households collected over a one-year period in 2012. The market basket analysis methodology frequent itemset mining (FIM) was used to identify co-occurring sets of product purchases for all households and demographic groups based on income, education, race/ethnicity, and family composition. Our methodology captured robust co-occurrence patterns for personal and household products, globally and for different demographic groups. FIM identified cosmetic co-occurrence patterns captured in prior surveys of cosmetic use, as well as a trend of increased diversity of cosmetic purchases as children mature to teenage years. We propose that consumer product purchase data can be mined to inform person-oriented use patterns for high-throughput chemical screening applications, for aggregate and combined chemical risk evaluations.

Organizing mechanism-related information on chemical interactions using a framework based on the aggregate exposure and adverse outcome pathways.

This paper presents a framework for organizing and accessing mechanistic data on chemical interactions. The framework is designed to support the assessment of risks from combined chemical exposures. The framework covers interactions between chemicals that occur over the entire source-to-outcome continuum including interactions that are studied in the fields of chemical transport, environmental fate, exposure assessment, dosimetry, and individual and population-based adverse outcomes. The framework proposes to organize data using a semantic triple of a chemical (subject), has impact (predicate), and a causal event on the source-to-outcome continuum of a second chemical (object). The location of the causal event on the source-to-outcome continuum and the nature of the impact are used as the basis for a taxonomy of interactions. The approach also builds on concepts from the Aggregate Exposure Pathway (AEP) and Adverse Outcome Pathway (AOP). The framework proposes the linking of AEPs of multiple chemicals and the AOP networks relevant to those chemicals to form AEP-AOP networks that describe chemical interactions that cannot be characterized using AOP networks alone. Such AEP-AOP networks will aid the construction of workflows for both experimental design and the systematic review or evaluation performed in risk assessments. Finally, the framework is used to link the constructs of existing component-based approaches for mixture toxicology to specific categories in the interaction taxonomy.

Calibrating an agent-based model of longitudinal human activity patterns using the Consolidated Human Activity Database.

Patterns of human behavior over extended periods of time are important for characterizing human exposure to hazardous chemicals. Because longitudinal behavior patterns for an individual are difficult to obtain, exposure-assessors have characterized such patterns by linking daily records from multiple individuals. In an earlier publication, we developed an alternative strategy that was based on agent-based simulation modeling. Specifically, we created a software program, Agent-Based Model of Human Activity Patterns (ABMHAP), that generates year-long longitudinal behavior patterns. In this paper, we both calibrate and evaluate ABMHAP using human behavior data from the U.S. Environmental Protection Agency's Consolidated Human Activity Database (CHAD). We use the longitudinal data (data on individuals' activities over multiple days) in CHAD to parameterize ABMHAP, and we use single-day behavior data from CHAD to evaluate ABMHAP predictions. We evaluate ABMHAP's ability to simulate sleeping, eating, commuting, and working (or attending school) for four populations: working adults, nonworking adults, school-age children, and preschool children. The results demonstrate that ABMHAP, when parameterized with empirical data, can capture both interindividual and intraindividual variation in behaviors in different types of individuals. We propose that simulating annual activity patterns via ABMHAP may allow exposure-assessors to characterize exposure-related behavior in ways not possible with traditional survey methods.

Simulating exposure-related behaviors using agent-based models embedded with needs-based artificial intelligence.

Exposure to a chemical is a critical consideration in the assessment of risk, as it adds real-world context to toxicological information. Descriptions of where and how individuals spend their time are important for characterizing exposures to chemicals in consumer products and in indoor environments. Herein we create an agent-based model (ABM) that simulates longitudinal patterns in human behavior. By basing the ABM upon an artificial intelligence (AI) system, we create agents that mimic human decisions on performing behaviors relevant for determining exposures to chemicals and other stressors. We implement the ABM in a computer program called the Agent-Based Model of Human Activity Patterns (ABMHAP) that predicts the longitudinal patterns for sleeping, eating, commuting, and working. We then show that ABMHAP is capable of simulating behavior over extended periods of time. We propose that this framework, and models based on it, can generate longitudinal human behavior data for use in exposure assessments.

Establishing a system of consumer product use categories to support rapid modeling of human exposure.

Consumer product categorizations for use in predicting human chemical exposure provide a bridge between product composition data and consumer product use pattern information. Furthermore, the categories reflect other factors relevant to developing consumer product exposure scenarios, such as microenvironment of use (e.g., indoors or outdoors), method of application/form of release (e.g., spray versus liquid), release to various media, removal processes (e.g., rinse-off or wipe-off), and route-specific exposure factors (dermal surface areas of application, fraction of release in respirable form). While challenging, developing harmonized product categories can generalize the factors described above allowing for rapid parameterization of route-specific exposure scenario algorithms for new chemical/product applications and efficient utilization of new data on product use or composition. This can be accomplished via mapping product categories to likewise categorized release and use patterns or exposure factors. Here, hierarchical product use categories (PUCs) for consumer products that provide such mappings are presented and crosswalked with other internationally harmonized product categories for consumer exposure assessment. The PUCs were defined by applying use and exposure scenario information to the products in EPA's Chemical and Products Database (CPDat). This paper demonstrates how these PUCs are being used to rapidly parameterize algorithms for scenario-specific use, fate, and exposure in a probabilistic aggregate model of human exposure to chemicals used in consumer products. The PUCs provide a generic representation of consumer products for use in exposure assessment and provide an efficient framework for flexible and rapid data reporting and consumer exposure model parameterization.

Consensus Modeling of Median Chemical Intake for the U.S. Population Based on Predictions of Exposure Pathways.

Prioritizing the potential risk posed to human health by chemicals requires tools that can estimate exposure from limited information. In this study, chemical structure and physicochemical properties were used to predict the probability that a chemical might be associated with any of four exposure pathways leading from sources-consumer (near-field), dietary, far-field industrial, and far-field pesticide-to the general population. The balanced accuracies of these source-based exposure pathway models range from 73 to 81%, with the error rate for identifying positive chemicals ranging from 17 to 36%. We then used exposure pathways to organize predictions from 13 different exposure models as well as other predictors of human intake rates. We created a consensus, meta-model using the Systematic Empirical Evaluation of Models framework in which the predictors of exposure were combined by pathway and weighted according to predictive ability for chemical intake rates inferred from human biomonitoring data for 114 chemicals. The consensus model yields an R2 of ∼0.8. We extrapolate to predict relevant pathway(s), median intake rate, and credible interval for 479 926 chemicals, mostly with minimal exposure information. This approach identifies 1880 chemicals for which the median population intake rates may exceed 0.1 mg/kg bodyweight/day, while there is 95% confidence that the median intake rate is below 1 µg/kg BW/day for 474572 compounds.

Temporal Trends in Exposures to Six Phthalates from Biomonitoring Data: Implications for Cumulative Risk.

Phthalates are used in a wide range of consumer goods, resulting in exposures to specific phthalates that vary over time in accordance with changes in product use and how phthalates are utilized. We investigated trends in estimates of daily intake dose and several cumulative risk metrics, including the Hazard Quotient (HQ), Hazard Index (HI), and Maximum Cumulative Ratio (MCR) for six phthalates from 2005 to 2014 using metabolite biomonitoring data collected from spot urine samples under the National Health and Nutrition Examination Survey (NHANES). Over this period, there was a 2.2-fold decrease in the mean HI (0.34 to 0.15) and a 7.2-fold decrease in the percentage of participants with an HI > 1 (5.7% to 0.8%), indicating an overall decrease in combined exposure to these phthalates. Children (aged 6-11 years) had higher mean HI values than either adolescents (aged 12-19 years) or adults (aged 20+ years) during this period. MCR values were generally low and inversely correlated with HI. This indicated that a single phthalate usually drove the hazards for highly exposed individuals. However, the average value of MCR increased 1.2-fold (1.7-2.1) over this period indicating an increasing need to consider exposures to multiple phthalates in this group.

The Chemical and Products Database, a resource for exposure-relevant data on chemicals in consumer products.

Quantitative data on product chemical composition is a necessary parameter for characterizing near-field exposure. This data set comprises reported and predicted information on more than 75,000 chemicals and more than 15,000 consumer products. The data's primary intended use is for exposure, risk, and safety assessments. The data set includes specific products with quantitative or qualitative ingredient information, which has been publicly disclosed through material safety data sheets (MSDS) and ingredient lists. A single product category from a refined and harmonized set of categories has been assigned to each product. The data set also contains information on the functional role of chemicals in products, which can inform predictions of the concentrations in which they occur. These data will be useful to exposure and risk assessors evaluating chemical and product safety.

An analysis of cumulative risks based on biomonitoring data for six phthalates using the Maximum Cumulative Ratio.

The Maximum Cumulative Ratio (MCR) quantifies the degree to which a single chemical drives the cumulative risk of an individual exposed to multiple chemicals. Phthalates are a class of chemicals with ubiquitous exposures in the general population that have the potential to cause adverse health effects in humans. This work used the MCR to evaluate coexposures to six phthalates as measured in biomonitoring data from the most recent cycle (2013-2014) of the National Health and Nutrition Examination Survey (NHANES). The values of MCR, Hazard Index (HI), and phthalate-specific Hazard Quotients (HQs) were determined for 2663 NHANES participants aged six years and older by using reverse dosimetry techniques to calculate steady-state doses consistent with concentrations of metabolites of six phthalates in urine and using Tolerable Daily Intake values. There were 21 participants (0.8% of the NHANES sample) with HI>1. Of those, 43% (9/21) would have been missed by chemical-by-chemical assessments (i.e. all HQs were less than one). The mean MCR value in the 21 participants was 2.1. HI and MCR values were negatively correlated (p<0.001) indicating that most participants, especially those with elevated HI values, had their cumulative risks driven by relatively large doses of a single phthalate rather than doses of multiple phthalates. The dominate phthalate varied across participants. Children (aged 6-17years) had a higher HI values (p<0.01) than adults (18+ years). However, the probability of having HI>1 was not driven by age, gender, or ethnicity. The cumulative exposures of concern largely originated from a subset of three of the fifteen possible pairs of the six phthalates. These findings suggest that cumulative exposures were a potential concern for a small portion of the surveyed participants involving a subset of the phthalates explored. The largest risks tended to occur in individuals whose exposures were dominated by a single phthalate.

In vitro to in vivo extrapolation for high throughput prioritization and decision making.

In vitro chemical safety testing methods offer the potential for efficient and economical tools to provide relevant assessments of human health risk. To realize this potential, methods are needed to relate in vitro effects to in vivo responses, i.e., in vitro to in vivo extrapolation (IVIVE). Currently available IVIVE approaches need to be refined before they can be utilized for regulatory decision-making. To explore the capabilities and limitations of IVIVE within this context, the U.S. Environmental Protection Agency Office of Research and Development and the National Toxicology Program Interagency Center for the Evaluation of Alternative Toxicological Methods co-organized a workshop and webinar series. Here, we integrate content from the webinars and workshop to discuss activities and resources that would promote inclusion of IVIVE in regulatory decision-making. We discuss properties of models that successfully generate predictions of in vivo doses from effective in vitro concentration, including the experimental systems that provide input parameters for these models, areas of success, and areas for improvement to reduce model uncertainty. Finally, we provide case studies on the uses of IVIVE in safety assessments, which highlight the respective differences, information requirements, and outcomes across various approaches when applied for decision-making.

Consumer product chemical weight fractions from ingredient lists.

Assessing human exposures to chemicals in consumer products requires composition information. However, comprehensive composition data for products in commerce are not generally available. Many consumer products have reported ingredient lists that are constructed using specific guidelines. A probabilistic model was developed to estimate quantitative weight fraction (WF) values that are consistent with the rank of an ingredient in the list, the number of reported ingredients, and labeling rules. The model provides the mean, median, and 95% upper and lower confidence limit WFs for ingredients of any rank in lists of any length. WFs predicted by the model compared favorably with those reported on Material Safety Data Sheets. Predictions for chemicals known to provide specific functions in products were also found to reasonably agree with reported WFs. The model was applied to a selection of publicly available ingredient lists, thereby estimating WFs for 1293 unique ingredients in 1123 products in 81 product categories. Predicted WFs, although less precise than reported values, can be estimated for large numbers of product-chemical combinations and thus provide a useful source of data for high-throughput or screening-level exposure assessments.

Use of a probabilistic PBPK/PD model to calculate Data Derived Extrapolation Factors for chlorpyrifos.

A physiologically based pharmacokinetic and pharmacodynamic (PBPK/PD) model combined with Monte Carlo analysis of inter-individual variation was used to assess the effects of the insecticide, chlorpyrifos and its active metabolite, chlorpyrifos oxon in humans. The PBPK/PD model has previously been validated and used to describe physiological changes in typical individuals as they grow from birth to adulthood. This model was updated to include physiological and metabolic changes that occur with pregnancy. The model was then used to assess the impact of inter-individual variability in physiology and biochemistry on predictions of internal dose metrics and quantitatively assess the impact of major sources of parameter uncertainty and biological diversity on the pharmacodynamics of red blood cell acetylcholinesterase inhibition. These metrics were determined in potentially sensitive populations of infants, adult women, pregnant women, and a combined population of adult men and women. The parameters primarily responsible for inter-individual variation in RBC acetylcholinesterase inhibition were related to metabolic clearance of CPF and CPF-oxon. Data Derived Extrapolation Factors that address intra-species physiology and biochemistry to replace uncertainty factors with quantitative differences in metrics were developed in these same populations. The DDEFs were less than 4 for all populations. These data and modeling approach will be useful in ongoing and future human health risk assessments for CPF and could be used for other chemicals with potential human exposure.

Conceptual Framework To Extend Life Cycle Assessment Using Near-Field Human Exposure Modeling and High-Throughput Tools for Chemicals.

Life Cycle Assessment (LCA) is a decision-making tool that accounts for multiple impacts across the life cycle of a product or service. This paper presents a conceptual framework to integrate human health impact assessment with risk screening approaches to extend LCA to include near-field chemical sources (e.g., those originating from consumer products and building materials) that have traditionally been excluded from LCA. A new generation of rapid human exposure modeling and high-throughput toxicity testing is transforming chemical risk prioritization and provides an opportunity for integration of screening-level risk assessment (RA) with LCA. The combined LCA and RA approach considers environmental impacts of products alongside risks to human health, which is consistent with regulatory frameworks addressing RA within a sustainability mindset. A case study is presented to juxtapose LCA and risk screening approaches for a chemical used in a consumer product. The case study demonstrates how these new risk screening tools can be used to inform toxicity impact estimates in LCA and highlights needs for future research. The framework provides a basis for developing tools and methods to support decision making on the use of chemicals in products.

Evaluation of potential human health effects associated with the agricultural uses of 1,3-D: Spatial and temporal stochastic risk analysis.

Dow AgroSciences (DAS) markets and sells 1,3-Dichloropropene (1,3-D), the active ingredient in Telone®, which is used as a pre-plant soil fumigant nematicide in economically important crops in California. 1,3-D has been regulated as a "probable human carcinogen" and the California Department of Pesticide Regulation limits use of 1,3-D based on human health risk assessments for bystanders. This paper presents a risk characterization for bystanders based on advances in the assessment of both exposure and hazard. The revised bystander risk assessment incorporates significant advances: 1) new data on residency duration and mobility in communities where 1,3-D is in high demand; 2) new information on spatial and temporal concentrations of 1,3-D in air based on multi-year modeling using a validated model; and 3) a new stochastic spatial and temporal model of long-term exposures. Predicted distributions of long-term, chronic exposures indicate that current, and anticipated uses of 1,3-D would result in lifetime average daily doses lower than 0.002mg/kg/d, a dose associated with theoretical lifetime excess cancer risk of <10(-5) to >95% of the local population based on a non-threshold risk assessment approach. Additionally, examination of 1,3-D toxicity studies including new chronic toxicity data and mechanism of action supports the use of a non-linear, threshold based risk assessment approach. The estimated maximum annual average daily dose of <0.0016mg/kg/d derived from the updated exposure assessment was then compared with a threshold point of departure. The calculated margin of exposure is >1000-fold, a clear indication of acceptable risk for human health. In summary, the best available science supports 1,3-D's threshold nature of hazard and the revised exposure assessment supports that current agricultural uses of 1,3-D are associated with reasonable certainty of no harm, i.e., estimated long-term exposures pose insignificant health risks to bystanders even when the non-threshold approach is assumed.

Evaluation of OASIS QSAR Models Using ToxCast™ in Vitro Estrogen and Androgen Receptor Binding Data and Application in an Integrated Endocrine Screening Approach.

BACKGROUND: Integrative testing strategies (ITSs) for potential endocrine activity can use tiered in silico and in vitro models. Each component of an ITS should be thoroughly assessed. OBJECTIVES: We used the data from three in vitro ToxCast™ binding assays to assess OASIS, a quantitative structure-activity relationship (QSAR) platform covering both estrogen receptor (ER) and androgen receptor (AR) binding. For stronger binders (described here as AC50 < 1 µM), we also examined the relationship of QSAR predictions of ER or AR binding to the results from 18 ER and 10 AR transactivation assays, 72 ER-binding reference compounds, and the in vivo uterotrophic assay. METHODS: NovaScreen binding assay data for ER (human, bovine, and mouse) and AR (human, chimpanzee, and rat) were used to assess the sensitivity, specificity, concordance, and applicability domain of two OASIS QSAR models. The binding strength relative to the QSAR-predicted binding strength was examined for the ER data. The relationship of QSAR predictions of binding to transactivation- and pathway-based assays, as well as to in vivo uterotrophic responses, was examined. RESULTS: The QSAR models had both high sensitivity (> 75%) and specificity (> 86%) for ER as well as both high sensitivity (92-100%) and specificity (70-81%) for AR. For compounds within the domains of the ER and AR QSAR models that bound with AC50 < 1 µM, the QSAR models accurately predicted the binding for the parent compounds. The parent compounds were active in all transactivation assays where metabolism was incorporated and, except for those compounds known to require metabolism to manifest activity, all assay platforms where metabolism was not incorporated. Compounds in-domain and predicted to bind by the ER QSAR model that were positive in ToxCast™ ER binding at AC50 < 1 µM were active in the uterotrophic assay. CONCLUSIONS: We used the extensive ToxCast™ HTS binding data set to show that OASIS ER and AR QSAR models had high sensitivity and specificity when compounds were in-domain of the models. Based on this research, we recommend a tiered screening approach wherein a) QSAR is used to identify compounds in-domain of the ER or AR binding models and predicted to bind; b) those compounds are screened in vitro to assess binding potency; and c) the stronger binders (AC50 < 1 µM) are screened in vivo. This scheme prioritizes compounds for integrative testing and risk assessment. Importantly, compounds that are not in-domain, that are predicted either not to bind or to bind weakly, that are not active in in vitro, that require metabolism to manifest activity, or for which in vivo AR testing is in order, need to be assessed differently. CITATION: Bhhatarai B, Wilson DM, Price PS, Marty S, Parks AK, Carney E. 2016. Evaluation of OASIS QSAR models using ToxCast™ in vitro estrogen and androgen receptor binding data and application in an integrated endocrine screening approach. Environ Health Perspect 124:1453-1461; http://dx.doi.org/10.1289/EHP184.

Use of the Maximum Cumulative Ratio As an Approach for Prioritizing Aquatic Coexposure to Plant Protection Products: A Case Study of a Large Surface Water Monitoring Database.

This paper uses the maximum cumulative ratio (MCR) as part of a tiered approach to evaluate and prioritize the risk of acute ecological effects from combined exposures to the plant protection products (PPPs) measured in 3 099 surface water samples taken from across the United States. Assessments of the reported mixtures performed on a substance-by-substance approach and using a Tier One cumulative assessment based on the lowest acute ecotoxicity benchmark gave the same findings for 92.3% of the mixtures. These mixtures either did not indicate a potential risk for acute effects or included one or more individual PPPs that had concentrations in excess of their benchmarks. A Tier Two assessment using a trophic level approach was applied to evaluate the remaining 7.7% of the mixtures. This assessment reduced the number of mixtures of concern by eliminating the combination of endpoint from multiple trophic levels, identified invertebrates and nonvascular plants as the most susceptible nontarget organisms, and indicated that a only a very limited number of PPPs drove the potential concerns. The combination of the measures of cumulative risk and the MCR enabled the identification of a small subset of mixtures where a potential risk would be missed in substance-by-substance assessments.