Applying a modified systematic review and integrated assessment framework (SYRINA) - a case study on triphenyl phosphate.

This work presents a case study in applying a systematic review framework (SYRINA) to the identification of chemicals as endocrine disruptors. The suitability and performance of the framework is tested with regard to the widely accepted World Health Organization definition of an endocrine disruptor (ED). The endocrine disrupting potential of triphenyl phosphate (TPP), a well-studied flame retardant reported to exhibit various endocrine related effects was assessed. We followed the 7 steps of the SYRINA framework, articulating the research objective via Populations, Exposures, Comparators, Outcomes (PECO) statements, performed literature search and screening, conducted study evaluation, performed data extraction and summarized and integrated the evidence. Overall, 66 studies, consisting of in vivo, in vitro and epidemiological data, were included. We concluded that triphenyl phosphate could be identified as an ED based on metabolic disruption and reproductive function. We found that the tools used in this case study and the optimizations performed on the framework were suitable to assess properties of EDs. A number of challenges and areas for methodological development in systematic appraisal of evidence relating to endocrine disrupting potential were identified; significant time and effort were needed for the analysis of in vitro mechanistic data in this case study, thus increasing the workload and time needed to perform the systematic review process. Further research and development of this framework with regards to grey literature (non-peer-reviewed literature) search, harmonization of study evaluation methods, more consistent evidence integration approaches and a pre-defined method to assess links between adverse effect and endocrine activity are recommended. It would also be advantageous to conduct more case studies for a chemical with less data than TPP.

Health Effects of Naphthalene Exposure: A Systematic Evidence Map and Analysis of Potential Considerations for Dose-Response Evaluation.

BACKGROUND: Naphthalene is a polycyclic aromatic hydrocarbon that has been associated with health effects, including cancer. As the state of the science on naphthalene toxicity continues to evolve, updated toxicity reference value(s) may be required to support human health risk assessment. OBJECTIVES: We present a systematic evidence map of studies that could be used to derive toxicity reference value(s) for naphthalene. METHODS: Human and animal health effect studies and physiologically based pharmacokinetic (PBPK) models were identified from a literature search based on populations, exposures, comparators, and outcomes (PECO) criteria. Human and animal studies meeting PECO criteria were refined to a smaller subset considered most informative for deriving chronic reference value(s), which are preferred for assessing risk to the general public. This subset was evaluated for risk of bias and sensitivity, and the suitability of each study for dose-response analysis was qualitatively assessed. Lowest observed adverse effect levels (LOAELs) were extracted and summarized. Other potentially relevant studies (e.g., mechanistic and toxicokinetic studies) were tracked as supplemental information but not evaluated further. Existing reference values for naphthalene are also summarized. RESULTS: We identified 26 epidemiology studies and 16 animal studies that were considered most informative for further analysis. Eleven PBPK models were identified. The available epidemiology studies generally had significant risk of bias and/or sensitivity concerns and were mostly found to have low suitability for dose-response analysis due to the nature of the exposure measurements. The animal studies had fewer risk of bias and sensitivity concerns and were mostly found to be suitable for dose-response analysis. CONCLUSION: Although both epidemiological and animal studies of naphthalene provide weight of evidence for hazard identification, the available animal studies appear more suitable for reference value derivation. PBPK models and mechanistic and toxicokinetic data can be applied to extrapolate these animal data to humans, considering mode of action and interspecies metabolic differences. https://doi.org/10.1289/EHP7381.

Application of systematic evidence mapping to assess the impact of new research when updating health reference values: A case example using acrolein.

BACKGROUND: The environmental health community needs transparent, methodologically rigorous, and rapid approaches for updating human health risk assessments. These assessments often contain reference values for cancer and/or noncancer effects. Increasingly, the use of systematic review methods are preferred when developing these assessments. Systematic evidence maps are a type of analysis that has the potential to be very helpful in the update process, especially when combined with machine-learning software advances designed to expedite the process of conducting a review. OBJECTIVES: To evaluate the applicability of evidence mapping to determine whether new evidence is likely to result in a change to an existing health reference value, using inhalation exposure to the air pollutant acrolein as a case example. METHODS: New literature published since the 2008 California Environmental Protection Agency's Office of Environmental Health Hazard Assessment (OEHHA) Reference Exposure Level (REL) for acrolein was assessed. Systematic review methods were used to search the literature and screening included the use of machine-learning software. The Populations, Exposures, Comparators and Outcomes (PECO) criteria were kept broad to identify studies that characterized acute and chronic exposure and could be informative for hazard characterization. Studies that met the PECO criteria after full-text review were briefly summarized before their suitability for chronic point of departure (POD) derivation and calculation of a reference value was considered. Studies considered potentially suitable underwent a targeted evaluation to determine their suitability for use in dose-response analysis. RESULTS: Over 15,000 studies were identified from scientific databases. Both machine-learning and manual screening processes were used to identify 60 studies considered PECO-relevant after full-text review. Most of these PECO-relevant studies were short-term exposure animal studies (acute or less than 1 month of exposure) and considered less suitable for deriving a chronic reference value when compared to the subchronic study in rats used in the 2008 OEHHA assessment. Thirteen epidemiological studies were identified but had limitations in the exposure assessment that made them less suitable for dose-response compared to the subchronic rat study. Among the 13 studies, there were four controlled trial studies that have the potential to be informative for future acute reference value derivation. Thus, the 2008 subchronic rat study used by OEHHA appears to still be the most appropriate study for chronic reference value derivation. In addition, advances in dosimetric modeling for gases, including new evidence pertinent to acrolein, could be considered when updating existing acrolein toxicity values. CONCLUSIONS: Evidence mapping is a very useful tool to assess the need for updating an assessment based on understanding the potential impact of new studies on revising an existing health reference value. In this case example, the focus was to identify studies suitable for chronic exposure dose-response analysis, while also identifying studies that may be important to consider for acute exposure scenarios, hazard identification, or for future research. This allows the evidence map to be a useful resource for a range of decision-making contexts. Specialized systematic review software increased the efficiency of the process in terms of human resources and time to conduct the analysis.

Development of outcome-specific criteria for study evaluation in systematic reviews of epidemiology studies.

INTRODUCTION AND OBJECTIVE: Systematic review tools that provide guidance on evaluating epidemiology studies are receiving increasing attention and support because their application facilitates improved quality of the review, consistency across reviewers, and transparency for readers. The U.S. Environmental Protection Agency's Integrated Risk Information System (IRIS) Program has developed an approach for systematic review of evidence of health effects from chemical exposures that includes structured approaches for literature search and screening, study evaluation, data extraction, and evidence synthesis and integration. This approach recognizes the need for developing outcome-specific criteria for study evaluation. Because studies are assessed at the outcome level, a study could be considered high quality for one investigated outcome, and low quality for another, due to differences in the outcome measures, analytic strategies, how relevant a certain bias is to the outcome, and how the exposure measure relates to the outcome. The objective of this paper is to illustrate the need for outcome-specific criteria in study evaluation or risk of bias evaluation, describe the process we used to develop the criteria, and summarize the resulting criteria. METHODS: We used a process of expert consultation to develop several sets of outcome-specific criteria to guide study reviewers, improve consistency, and ensure consideration of critical issues specific to the outcomes. The criteria were developed using the following domains: outcome assessment, exposure measurement (specifically timing of exposure in relation to outcome; other exposure measurement issues would be addressed in exposure-specific criteria), participant selection, confounding, analysis, and sensitivity (the study's ability to detect a true effect or hazard). RESULTS: We discuss the application of this process to pregnancy-related outcomes (preterm birth, spontaneous abortion), other reproductive-related outcomes (male reproductive hormones, sperm parameters, time to pregnancy, pubertal development), chronic disease (diabetes, insulin resistance), and acute or episodic conditions (asthma, allergies), and provide examples of the criteria developed. For each outcome the most influential methodological considerations are highlighted including biological sample collection and quality control, sensitivity and specificity of ascertainment tools, optimal timing for recruitment into the study (e.g., preconception, specific trimesters), the etiologically relevant window for exposure assessments, and important potential confounders. CONCLUSIONS: Outcome-specific criteria are an important part of a systematic review and will facilitate study evaluations by epidemiologists with experience in evaluating studies using systematic review methods who may not have extensive discipline-specific experience in the outcomes being reviewed.

Phthalate exposure and metabolic effects: a systematic review of the human epidemiological evidence.

OBJECTIVE: We performed a systematic review of the epidemiology literature to identify the metabolic effects associated with phthalate exposure. DATA SOURCES AND STUDY ELIGIBILITY CRITERIA: Six phthalates were included in the review: di(2­ethylhexyl) phthalate (DEHP), diisononyl phthalate (DINP), dibutyl phthalate (DBP), diisobutyl phthalate (DIBP), butyl benzyl phthalate (BBP), and diethyl phthalate (DEP). The initial literature search (of PubMed, Web of Science, and Toxline) included all studies of metabolic effects in humans, and outcomes were selected for full systematic review based on data availability. STUDY EVALUATION AND SYNTHESIS METHODS: Studies of diabetes and insulin resistance were evaluated using criteria defined a priori for risk of bias and sensitivity by two reviewers using a domain-based approach; studies identified with a pre-defined critical deficiency were excluded. Evidence was synthesized by outcome and phthalate and strength of evidence was summarized using a structured framework. Studies of obesity and renal effects received "screening level" reviews to determine whether full systematic review was warranted. RESULTS: The primary outcomes reviewed here are (number of included/excluded studies in parentheses): type 2 diabetes (1/3), insulin resistance (13/3), and impaired glucose tolerance and blood glucose in pregnancy (4/2). For DEHP exposure, there was consistency among studies of insulin resistance and coherence with the single included study of diabetes, as well as an observed exposure-response gradient observed in a study of insulin resistance. This evidence is considered moderate. Similarly, for DBP and DIBP exposure, the evidence is considered moderate due to strong positive associations in the diabetes study and coherent results for insulin resistance. For DINP, BBP, and DEP, the evidence is considered slight. No association was reported in the single study of diabetes with BBP and DEP exposure (DINP was not investigated). The available evidence does indicate an association between exposure to these phthalates and insulin resistance, but the small number of studies and the lack of coherence with diabetes decreases confidence. The screening level reviews for obesity and renal effects determined that the currently available evidence is inadequate to assess the associations between these outcomes and phthalate exposure. CONCLUSIONS AND IMPLICATIONS OF KEY FINDINGS: Overall, these results support that phthalate exposure at levels seen in human populations may have metabolic effects. Given the mechanistic support, the large effect sizes for incident diabetes in the single available study, and the coherence with insulin resistance, the association between phthalate exposure and diabetes risk should be considered when assessing the risks and costs of exposure to specific phthalates in humans. The views expressed are those of the authors and do not necessarily represent the views or policies of the U.S. EPA.

The evaluation of inhalation studies for exposure quality: A case study with formaldehyde.

The inherent complexity of generating and monitoring a test article in an inhalation chamber can make inhalation toxicity testing challenging. Poor study design, human error, and electrical and mechanical problems can adversely affect an inhalation exposure and undermine a study's results. We have developed a process for evaluating seven key elements of exposure quality in inhalation chamber studies: 1) test article characterization, 2) generation method, 3) chamber sampling and analytical method, 4) chamber concentrations, 5) particle size characteristics, 6) chamber type, and 7) controls. For each study evaluated, exposure deficiencies are documented, and a study is given an overall rating (Robust, Adequate, or Poor) for the quality of its exposure characterization and documentation. In combination with the systematic consideration of experimental features other than exposure, these ratings can inform the utility of a study for use in hazard identification and/or exposure-response analysis. Exposure quality evaluations of 204 formaldehyde inhalation studies are presented as a case study. Of these, 34% were rated Robust because they had comprehensive exposure documentation and no serious deficiencies in the key elements of exposure quality. Another 19% of studies with minor uncertainties or limitations were rated Adequate. Conversely, 47% of the studies were rated Poor due to multiple serious exposure deficiencies. This formaldehyde case study illustrates the need to carefully consider the exposure quality of inhalation toxicity studies when their results are used to support hazard and risk assessments.

Exposure assessment issues in epidemiology studies of phthalates.

PURPOSE: The purpose of this paper is to review exposure assessment issues that need to be addressed in designing and interpreting epidemiology studies of phthalates, a class of chemicals commonly used in consumer and personal care products. Specific issues include population trends in exposure, temporal reliability of a urinary metabolite measurement, and how well a single urine sample may represent longer-term exposure. The focus of this review is on seven specific phthalates: diethyl phthalate (DEP); di-n-butyl phthalate (DBP); diisobutyl phthalate (DiBP); butyl benzyl phthalate (BBzP); di(2-ethylhexyl) phthalate (DEHP); diisononyl phthalate (DiNP); and diisodecyl phthalate (DiDP). METHODS: Comprehensive literature search using multiple search strategies. RESULTS: Since 2001, declines in population exposure to DEP, BBzP, DBP, and DEHP have been reported in the United States and Germany, but DEHP exposure has increased in China. Although the half-lives of various phthalate metabolites are relatively short (3 to 18h), the intraclass correlation coefficients (ICCs) for phthalate metabolites, based on spot and first morning urine samples collected over a week to several months, range from weak to moderate, with a tendency toward higher ICCs (greater temporal stability) for metabolites of the shorter-chained (DEP, DBP, DiBP and BBzP, ICCs generally 0.3 to 0.6) compared with those of the longer-chained (DEHP, DiNP, DiDP, ICCs generally 0.1 to 0.3) phthalates. Additional research on optimal approaches to addressing the issue of urine dilution in studies of associations between biomarkers and different type of health effects is needed. CONCLUSIONS: In conclusion, the measurement of urinary metabolite concentrations in urine could serve as a valuable approach to estimating exposure to phthalates in environmental epidemiology studies. Careful consideration of the strengths and limitations of this approach when interpreting study results is required.