Exploring a mechanism-based approach for the identification of endocrine disruptors using Adverse Outcome Pathways (AOPs) and New Approach Methodologies (NAMs) : A perfluorooctane sulfonic acid case study.

Endocrine disruptors (EDs) pose a serious threat to human health and the environment and require a comprehensive evaluation to be identified. The identification of EDs require a substantial amount of data, both in vitro and in vivo, due to the current scientific criteria in the EU. At the same time, the EU strives to reduce animal testing due to concerns regarding animal welfare and sensitivity of animal studies to adequately detect adverse effects relevant for human health. Perfluorooctane sulfonic acid (PFOS) is a persistent organic pollutant that is suspected to be an ED based on academic research, however it is not identified as such from a regulatory perspective. It has previously been shown that PFOS has the potential to cause neurotoxicity as well as affect the thyroid system, and it is known that specific thyroid hormone levels are critical in the development of the brain during. In this work, the aim was to evaluate a mechanism-based approach to identify ED properties of PFOS based on the Adverse Outcome Pathway (AOP) framework and using New Approach Methods (NAMs), by comparing this approach to an ED assessment based on the currently available guidance document. An AOP network (AOPN) was generated for the thyroid modality, and AOPs leading to developmental neurotoxicity (DNT) were identified. A literature search and screening process based on the AOPN, and systematic review methodology, was performed, followed by a rigorous Weight-of-Evidence (WoE) assessment. Evidence was mapped back onto the AOPN used for the literature search, to identify possible endocrine Modes-of-Action (MoAs) for PFOS and data gaps in the two assessments. It could be concluded that PFOS fulfils the criteria for ED classification in the standard ED assessment, but not in the mechanism-based assessment. The need for quantitative information, such as quantitative AOPs, for the mechanism-based approach is discussed. The possibility of a directly neurotoxic alternative MoA was also highlighted based on available in vitro data. Opportunities and challenges with implementing AOPs and NAMs into the regulatory assessment of EDs, and assessing hazard in the Next Generation Risk Assessment, is discussed. This case study exploring the mechanism-based approach to ED identification represents an important step toward more accurate and predictive assessment of EDs based on AOPs and NAMs, and to the Next Generation Risk Assessment (NGRA) concept.

Building an adverse outcome pathway network for estrogen-, androgen- and steroidogenesis-mediated reproductive toxicity.

Introduction: Adverse Outcome Pathways (AOPs) can support both testing and assessment of endocrine disruptors (EDs). There is, however, a need for further development of the AOP framework to improve its applicability in a regulatory context. Here we have inventoried the AOP-wiki to identify all existing AOPs related to mammalian reproductive toxicity arising from disruption to the estrogen, androgen, and steroidogenesis modalities. Core key events (KEs) shared between relevant AOPs were also identified to aid in further AOP network (AOPN) development. Methods: A systematic approach using two different methods was applied to screen and search the entire AOP-wiki library. An AOPN was visualized using Cytoscape. Manual refinement was performed to remove AOPS devoid of any KEs and/or KERs. Results: Fifty-eight AOPs relevant for mammalian reproductive toxicity were originally identified, with 42 AOPs included in the final AOPN. Several of the KEs and KE relationships (KERs) described similar events and were thus merged to optimize AOPN construction. Sixteen sub-networks related to effects on hormone levels or hormone activity, cancer outcomes, male and female reproductive systems, and overall effects on fertility and reproduction were identified within the AOPN. Twenty-six KEs and 11 KERs were identified as core blocks of knowledge in the AOPN, of which 19 core KEs are already included as parameters in current OECD and US EPA test guidelines. Discussion: The AOPN highlights knowledge gaps that can be targeted for further development of a more complete AOPN that can support the identification and assessment of EDs.

Applying a modified systematic review and integrated assessment framework (SYRINA) - a case study on triphenyl phosphate.

This work presents a case study in applying a systematic review framework (SYRINA) to the identification of chemicals as endocrine disruptors. The suitability and performance of the framework is tested with regard to the widely accepted World Health Organization definition of an endocrine disruptor (ED). The endocrine disrupting potential of triphenyl phosphate (TPP), a well-studied flame retardant reported to exhibit various endocrine related effects was assessed. We followed the 7 steps of the SYRINA framework, articulating the research objective via Populations, Exposures, Comparators, Outcomes (PECO) statements, performed literature search and screening, conducted study evaluation, performed data extraction and summarized and integrated the evidence. Overall, 66 studies, consisting of in vivo, in vitro and epidemiological data, were included. We concluded that triphenyl phosphate could be identified as an ED based on metabolic disruption and reproductive function. We found that the tools used in this case study and the optimizations performed on the framework were suitable to assess properties of EDs. A number of challenges and areas for methodological development in systematic appraisal of evidence relating to endocrine disrupting potential were identified; significant time and effort were needed for the analysis of in vitro mechanistic data in this case study, thus increasing the workload and time needed to perform the systematic review process. Further research and development of this framework with regards to grey literature (non-peer-reviewed literature) search, harmonization of study evaluation methods, more consistent evidence integration approaches and a pre-defined method to assess links between adverse effect and endocrine activity are recommended. It would also be advantageous to conduct more case studies for a chemical with less data than TPP.

Beyond chemicals: Opportunities and challenges of integrating non-chemical stressors in adverse outcome pathways.

The adverse outcome pathways (AOPs) were developed to accelerate evidence-based chemical risk assessment by leveraging data from new approach methodologies. Thanks to their stressor-agnostic approach, AOPs were seen as instrumental in other fields. Here, we present AOPs that report non-chemical stressors along with the challenges encountered for their development. Challenges regarding AOPs linked to nanomaterials include non-specific molecular initiating events, limited understanding of nanomaterial biodistribution, and needs for adaptations of the in silico modeling and testing systems. Development of AOPs for radiation face challenges in how to incorporate ionizing events type, dose rate, energy deposition, and how to account for targeting multiple macromolecules. AOPs for COVID-19 required the inclusion of SARS-CoV-2-specific replicative steps to capture the essential events driving the disease. Developing AOPs to evaluate efficacy and toxicity of cell therapies necessitates addressing the cellular nature and the therapeutic function of the stressor. Finally, addressing toxicity of emerging biological stressors like microbial pesticides can learn from COVID-19 AOPs. We further discuss that the adaptations needed to expand AOP applicability beyond chemicals are mainly at the molecular and cellular levels while downstream key events at tissue or organ level, such as inflammation, are shared by many AOPs initiated by various stressors. In conclusion, although it is challenging to integrate non-chemical stressors within AOPs, this expands opportunities to account for real-world scenarios, to identify vulnerable individuals, and to bridge knowledge on mechanisms of adversity.

The adverse outcome pathway (AOP) framework was developed to help predict whether chemicals have toxic effects on humans. Structuring available information in an accessible database can reduce animal testing. AOPs usually capture the path from the interaction of a stressor, usually a chemical, with the human body to an adverse outcome, e.g., a disease symptom. The concept of AOPs has now been expanded to include non-chemical stressors such as nanomaterials, radiation, viruses, cells used to treat patients, and microorganisms employed as pesticides. We use discuss how these stressors need to be accommodated within the framework and point out that pathways initiated by these stressors share downstream events like inflammation with chemical stressors. By integrating non-chemical stressors into the framework, real-world scenarios where people may be exposed to different stressor types can be considered, vulnerable individuals can be identified, and knowledge on toxic effects can be compounded.

SciRAPnano: a pragmatic and harmonized approach for quality evaluation of in vitro toxicity data to support risk assessment of nanomaterials.

Large amounts of nanotoxicity data from alternative non-animal (in vitro) test methods have been generated, but there is a lack of harmonized quality evaluation approaches for these types of data. Tools for scientifically sound and structured evaluation of the reliability and relevance of in vitro toxicity data to effectively inform regulatory hazard assessment of nanomaterials (NMs), are needed. Here, we present the development of a pragmatic approach to facilitate such evaluation. The tool was developed based on the Science in Risk Assessment and Policy (SciRAP) tool currently applicable to quality evaluation of chemical toxicity studies. The approach taken to develop the tool, referred to as SciRAPnano, included refinement of the original SciRAP in vitro tool through implementation of identified NM-relevant criteria, and further refined based on a set of case studies involving evaluation of 11 studies investigating in vitro toxicity of nano-sized titanium dioxide. Parameters considered cover key physicochemical properties as well as assay-specific aspects that impact NM toxicity, including NM interference with test methods and NM transformation. The final SciRAPnano tool contains 38 criteria for reporting quality, 19 criteria for methodological quality, and 4 guidance items to evaluate relevance. The approach covers essential parameters for pragmatic and harmonized evaluation of NM in vitro toxicity studies and allows for structured use of in vitro data in regulatory hazard assessment of NMs, including transparency on data quality.

Development of a data-driven approach to Adverse Outcome Pathway network generation: a case study on the EATS-modalities.

Adverse Outcome Pathways (AOPs) summarize mechanistic understanding of toxicological effects and have, for example, been highlighted as a promising tool to integrate data from novel in vitro and in silico methods into chemical risk assessments. Networks based on AOPs are considered the functional implementation of AOPs, as they are more representative of complex biology. At the same time, there are currently no harmonized approaches to generate AOP networks (AOPNs). Systematic strategies to identify relevant AOPs, and methods to extract and visualize data from the AOP-Wiki, are needed. The aim of this work was to develop a structured search strategy to identify relevant AOPs in the AOP-Wiki, and an automated data-driven workflow to generate AOPNs. The approach was applied on a case study to generate an AOPN focused on the Estrogen, Androgen, Thyroid, and Steroidogenesis (EATS) modalities. A search strategy was developed a priori with search terms based on effect parameters in the ECHA/EFSA Guidance Document on Identification of Endocrine Disruptors. Furthermore, manual curation of the data was performed by screening the contents of each pathway in the AOP-Wiki, excluding irrelevant AOPs. Data were downloaded from the Wiki, and a computational workflow was utilized to automatically process, filter, and format the data for visualization. This study presents an approach to structured searches of AOPs in the AOP-Wiki coupled to an automated data-driven workflow for generating AOPNs. In addition, the case study presented here provides a map of the contents of the AOP-Wiki related to the EATS-modalities, and a basis for further research, for example, on integrating mechanistic data from novel methods and exploring mechanism-based approaches to identify endocrine disruptors (EDs). The computational approach is freely available as an R-script, and currently allows for the (re)-generation and filtering of new AOP networks based on data from the AOP-Wiki and a list of relevant AOPs used for filtering.

Application of AOPs to assist regulatory assessment of chemical risks - Case studies, needs and recommendations.

While human regulatory risk assessment (RA) still largely relies on animal studies, new approach methodologies (NAMs) based on in vitro, in silico or non-mammalian alternative models are increasingly used to evaluate chemical hazards. Moreover, human epidemiological studies with biomarkers of effect (BoE) also play an invaluable role in identifying health effects associated with chemical exposures. To move towards the next generation risk assessment (NGRA), it is therefore crucial to establish bridges between NAMs and standard approaches, and to establish processes for increasing mechanistically-based biological plausibility in human studies. The Adverse Outcome Pathway (AOP) framework constitutes an important tool to address these needs but, despite a significant increase in knowledge and awareness, the use of AOPs in chemical RA remains limited. The objective of this paper is to address issues related to using AOPs in a regulatory context from various perspectives as it was discussed in a workshop organized within the European Union partnerships HBM4EU and PARC in spring 2022. The paper presents examples where the AOP framework has been proven useful for the human RA process, particularly in hazard prioritization and characterization, in integrated approaches to testing and assessment (IATA), and in the identification and validation of BoE in epidemiological studies. Nevertheless, several limitations were identified that hinder the optimal usability and acceptance of AOPs by the regulatory community including the lack of quantitative information on response-response relationships and of efficient ways to map chemical data (exposure and toxicity) onto AOPs. The paper summarizes suggestions, ongoing initiatives and third-party tools that may help to overcome these obstacles and thus assure better implementation of AOPs in the NGRA.

Protocol for designing INVITES-IN, a tool for assessing the internal validity of in vitro studies.

This protocol describes the design and development of a tool for evaluation of the internal validity of in vitro studies, which is needed to include the data as evidence in systematic reviews and chemical risk assessments. The tool will be designed specifically to be applied to cell culture studies, including, but not restricted to, studies meeting the new approach methodology (NAM) definition. The tool is called INVITES-IN (IN VITro Experimental Studies INternal validity). In this protocol, three of the four studies that will be performed to create the release version of INVITES-IN are described. In the first study, evaluation of existing assessment tools will be combined with focus group discussions to identify how characteristics of the design or conduct of an in vitro study can affect its internal validity. Bias domains and items considered to be of relevance for in vitro studies will be identified. In the second study, group agreement on internal validity domains and items of importance for in vitro studies will be identified via a modified Delphi methodology. In the third study, the draft version of the tool will be created, based on the data on relevance and importance of bias domains and items collected in Studies 1 and 2. A separate protocol will be prepared for the fourth study, which includes the user testing and validation of the tool, and collection of users' experience.

Factors Modulating COVID-19: A Mechanistic Understanding Based on the Adverse Outcome Pathway Framework.

Addressing factors modulating COVID-19 is crucial since abundant clinical evidence shows that outcomes are markedly heterogeneous between patients. This requires identifying the factors and understanding how they mechanistically influence COVID-19. Here, we describe how eleven selected factors (age, sex, genetic factors, lipid disorders, heart failure, gut dysbiosis, diet, vitamin D deficiency, air pollution and exposure to chemicals) influence COVID-19 by applying the Adverse Outcome Pathway (AOP), which is well-established in regulatory toxicology. This framework aims to model the sequence of events leading to an adverse health outcome. Several linear AOPs depicting pathways from the binding of the virus to ACE2 up to clinical outcomes observed in COVID-19 have been developed and integrated into a network offering a unique overview of the mechanisms underlying the disease. As SARS-CoV-2 infectibility and ACE2 activity are the major starting points and inflammatory response is central in the development of COVID-19, we evaluated how those eleven intrinsic and extrinsic factors modulate those processes impacting clinical outcomes. Applying this AOP-aligned approach enables the identification of current knowledge gaps orientating for further research and allows to propose biomarkers to identify of high-risk patients. This approach also facilitates expertise synergy from different disciplines to address public health issues.

Systematic evaluation of the evidence for identification of endocrine disrupting properties of Bisphenol F.

Identification of endocrine disruptors (EDs) is a highly prioritized issue in the EU. However, scientific criteria to identify EDs have so far only been implemented for biocidal and plant protection products. The European Commission is working on developing a horizontal approach to the identification of EDs across legislations, based on these scientific criteria. With this study, our aim was to evaluate evidence on endocrine disrupting properties of Bisphenol F (BPF) by applying the process set out for biocidal and plant protection products in Europe. BPF is not registered under REACH and therefore assumed not to be produced in the EU > 1 ton/year, yet the substance has been detected in urine, serum, and breast milk in populations from different countries in Europe. BPF is raising concern since it is an analogue of the known ED and reproductive toxicant Bisphenol A. Relevant evidence on endocrine disrupting properties of BPF from the open literature was collected using systematic review methodology. Pre-defined inclusion criteria were developed to select relevant studies, and data was extracted. The reliability of included studies was evaluated by the Science in Risk Assessment and Policy tool, and results were converted into Klimisch categories to allow for categorization of study reliability. A weight-of-evidence approach was used to analyze the evidence and draw conclusions on endocrine-related activity and/or endocrine adversity. We found that there is sufficient evidence to conclude on an endocrine mechanism, and while evidence for adversity was not considered sufficient, we still conclude that BPF could also cause endocrine-mediated adversity. Two modes of action were postulated based on the collected data for BPF. Challenges of performing the ED assessment for data-poor chemicals and the importance of adequate reporting of studies in the open literature, especially for new approach methods, are discussed.

Assessment of endocrine disruptive properties of PFOS: EFSA/ECHA guidance case study utilising AOP networks and alternative methods.

Endocrine disruptors (EDs) are chemical substances that interfere with the endocrine system, adversely affecting human health and environment. Legislation with aim to eliminate and ban EDs have been introduced in EU, but the identification of EDs remains challenging and crucial step towards regulation and risk management. A guidance for ED assessment has been recently established for pesticides and biocides in the EU, which heavily relies on traditional toxicological testing in vivo. Most notably lacking mechanistic methods for some ED modalities and not covering many other modalities that might be affected by EDs. In this project, we focus on the ED assessment according to the valid legislation and explore the possibility to employ alternative methods to bolster the mechanistic understanding of the ED effects and eventually decrease the need for in vivo testing. We selected a well-studied industrial chemical perfluorooctanesulfonic acid (PFOS) to be a model compound in a case study for ED assessment where the EU criteria were applied in the frame of human health risk assessment with focus on thyroid disruption and developmental neurotoxicity. A systematic literature review has been conducted for these effects (Scopus, Pubmed, Embase), and relevant studies were selected by title/abstract screening (RAYYAN) and full-text examination. Selected studies were assessed for reliability (SciRAP), and all relevant data were extracted into a database and assessed by Weight of Evidence (WoE) approach. The initial analysis showed potential endocrine adverse effects and endocrine activity, meeting the ED criteria. The use of mechanistic and alternative methods enhanced the outcomes of WoE assessment. Also, the study provides a great hands-on experience with the most up-to-date development in the area of risk assessment and EDs.

Development of an adverse outcome pathway for intrahepatic cholestasis of pregnancy.

Adverse Outcome Pathways (AOPs) are a research synthesis tool, used primarily by toxicologists for numerous applications including: hypothesis generation, data integration, biomarker determination, and identification of gaps in current knowledge. The AOP model provides a means for evaluating critical interactions between stressors and biological systems which result in adversity, meaning there is significant potential value in using this model in clinical research. However, AOPs have so far not been applied in this context, which may be attributable to the fact that the method is not yet streamlined with established practices in evidence-based medicine, such as systematic review. Here, we present one approach to developing a clinically focused AOP for intrahepatic cholestasis of pregnancy; aiming to enhance understanding of the mechanistic link between this common, gestational liver disease and its association with preterm birth. Mechanistic aspects of the disease pathogenesis, and use of AOPs to broaden inclusion and improve integration of in vitro and in vivo data in clinical research are discussed. We also demonstrate for the first time how central components of systematic review can be integrated into the development of an AOP.

COVID-19 through Adverse Outcome Pathways: Building networks to better understand the disease - 3rd CIAO AOP Design Workshop.

On April 28-29, 2021, 50 scientists from different fields of expertise met for the 3rd online CIAO workshop. The CIAO project "Modelling the Pathogenesis of COVID-19 using the Adverse Outcome Pathway (AOP) framework" aims at building a holistic assembly of the available scientific knowledge on COVID-19 using the AOP framework. An individual AOP depicts the disease progression from the initial contact with the SARS-CoV-2 virus through biological key events (KE) toward an adverse outcome such as respiratory distress, anosmia or multiorgan failure. Assembling the individual AOPs into a network highlights shared KEs as central biological nodes involved in multiple outcomes observed in COVID-19 patients. During the workshop, the KEs and AOPs established so far by the CIAO members were presented and posi­tioned on a timeline of the disease course. Modulating factors influencing the progression and severity of the disease were also addressed as well as factors beyond purely biological phenomena. CIAO relies on an interdisciplinary crowd­sourcing effort, therefore, approaches to expand the CIAO network by widening the crowd and reaching stakeholders were also discussed. To conclude the workshop, it was decided that the AOPs/KEs will be further consolidated, inte­grating virus variants and long COVID when relevant, while an outreach campaign will be launched to broaden the CIAO scientific crowd.

An adverse outcome pathway on the disruption of retinoic acid metabolism leading to developmental craniofacial defects.

Adverse outcome pathway (AOP) is a conceptual framework that links a molecular initiating event (MIE) via intermediate key events (KEs) with adverse effects (adverse outcomes, AO) relevant for risk assessment, through defined KE relationships (KERs). The aim of the present work is to describe a linear AOP, supported by experimental data, for skeletal craniofacial defects as the AO. This AO was selected in view of its relative high incidence in humans and the suspected relation to chemical exposure. We focused on inhibition of CYP26, a retinoic acid (RA) metabolizing enzyme, as MIE, based on robust previously published data. Conazoles were selected as representative stressors. Intermediate KEs are RA disbalance, aberrant HOX gene expression, disrupted specification, migration, and differentiation of neural crest cells, and branchial arch dysmorphology. We described the biological basis of the postulated events and conducted weight of evidence (WoE) assessments. The biological plausibility and the overall empirical evidence were assessed as high and moderate, respectively, the latter taking into consideration the moderate evidence for concordance of dose-response and temporal relationships. Finally, the essentiality assessment of the KEs, considered as high, supported the robustness of the presented AOP. This AOP, which appears of relevance to humans, thus contributes to mechanistic underpinning of selected test methods, thereby supporting their application in integrated new approach test methodologies and strategies and application in a regulatory context.

Assessment of the endocrine disrupting properties of bisphenol AF: a case study applying the European regulatory criteria and guidance.

BACKGROUND: Scientific criteria to identify endocrine disruptors (ED) was recently implemented for plant protection products (PPP) and biocidal products (BP). A guidance document has been published by ECHA and EFSA in the context of ED criteria for PPPs and BPs. METHODS: In the present work, a case study was performed on Bisphenol AF (BPAF) to explore the application of the EU criteria and EFSA/ECHA guidance document for the ED assessment of a non-pesticide chemical regulated under REACH. A data dossier was built by a systematic literature search (Web of Science, Pubmed, Embase; n = 511), title/abstract screening (n = 124) and full text examination (n = 88). All the information was extracted and systematically reported for 309 parameters (100 for adversity; 209 for endocrine activity). The reliability of studies was assessed (SciRAP tool). RESULTS: Data were synthesized into 96 lines of evidence for adversity (n = 57), and endocrine activity (n = 39); and assessed by weight of evidence methodology. The initial analysis of the evidence indicated EATS-mediated adversity in mammals, therefore a mode of action (MoA) was postulated for both male and female adult exposure. Female MoA included estrogen receptor activation and altered steroidogenesis leading to ovarian dysfunction, altered estrous cycling and impaired female fertility. Male MoA was initiated by androgen receptor inhibition and altered steroidogenesis leading to dysfunction of male reproductive organs and impaired male fertility. CONCLUSIONS: The overall conclusion of the ED assessment indicated that BPAF meets the ED criteria for human health. The steps described in the ED guidance document were successfully completed, resulting in a thorough, structured and transparent identification of BPAF as an ED. Advantages and limitations of applying the ED criteria and guidance for a REACH chemical are discussed.

Development of the SciRAP Approach for Evaluating the Reliability and Relevance of in vitro Toxicity Data.

Efficient and successful integration of data generated from non-animal test methods must rely on reliable and relevant data. It is important therefore to develop tools and criteria that facilitate scientifically sound, structured, and transparent evaluation of reliability and relevance of in vitro toxicity data to efficiently inform regulatory hazard and risk assessment. The Science in Risk Assessment and Policy (SciRAP) initiative aims to promote such overarching goals. We present the work to develop and refine the SciRAP tool for evaluation of reliability and relevance of in vitro studies for incorporation on the SciRAP web-based platform (www.scirap.org). In the SciRAP approach, reliability evaluation is based on criteria for reporting quality and methodological quality, and is explicitly separated from relevance evaluation. The SciRAP in vitro tool (version 1.0) was tested and evaluated during an expert test round (April 2019-September 2020) on three in vitro studies by thirty-one experts from regulatory authorities, industry and academia from different geographical areas and with various degree of experience in in vitro research and/or human health risk assessment. In addition, the experts answered an online survey to collect their feedback about the general features and desired characteristics of the tool for further refinement. The SciRAP in vitro tool (version 2.0) was revised based on the outcome of the expert test round (study evaluation and online survey) and consists of 24 criteria for evaluating "reporting quality" (reliability), 16 criteria for "methodological quality" (reliability), and 4 items for evaluating relevance of in vitro studies. Participants were generally positive about the adequacy, flexibility, and user-friendliness of the tool. The expert test round outlined the need to (i) revise the formulation of certain criteria; (ii) provide new or revised accompanying guidance for reporting quality and methodological quality criteria in the "test compounds and controls," "test system," and "data collection and analysis" domains; and (iii) provide revised guidance for relevance items, as general measures to reduce inter-expert variability. The SciRAP in vitro tool allows for a structured and transparent evaluation of in vitro studies for use in regulatory hazard and risk assessment of chemicals.

Evaluating reliability and risk of bias of in vivo animal data for risk assessment of chemicals - Exploring the use of the SciRAP tool in a systematic review context.

Within the field of health risk assessment, it is essential that evaluations of reliability or validity of toxicity data are conducted with structure and transparency. To this end, different tools for evaluating toxicity studies have been developed by different groups and organizations, for different specific purposes. The Science in Risk Assessment and Policy (SciRAP) tool was developed for use in the regulatory health risk assessment of chemicals and to promote structured and transparent evaluation of study reliability within European regulatory frameworks. As such, the SciRAP tool is not specifically tailored for use in a systematic review context. However, in light of the current movement towards applying systematic review in the field of environmental health and chemical assessments and European chemicals regulation, we were interested in exploring how SciRAP could be applied in such a context. To achieve this, the scope of the SciRAP tool was first compared to two tools developed based on systematic review principles at the US Environmental Protection Agency's IRIS program and the National Toxicology Program's Office of Health Assessment and Translation (OHAT). Next, the SciRAP and IRIS tools were both applied in a case study to evaluate the same nine in vivo animal studies and the resulting evaluations were compared. The SciRAP tool was found to address the majority of the elements included for study evaluation in the OHAT and IRIS tools. In the case study, no major differences were found in the conclusions drawn when using SciRAP or IRIS tools. However, future developments to bring the SciRAP tool more in line with systematic review principles were identified and are discussed. Overall, this work illustrates the advantages of applying structured and pre-defined methods for study evaluation and provides a unique case study comparing the impact of using different tools for evaluating animal toxicity studies.

Recommendations for the conduct of systematic reviews in toxicology and environmental health research (COSTER).

BACKGROUND: There are several standards that offer explicit guidance on good practice in systematic reviews (SRs) for the medical sciences; however, no similarly comprehensive set of recommendations has been published for SRs that focus on human health risks posed by exposure to environmental challenges, chemical or otherwise. OBJECTIVES: To develop an expert, cross-sector consensus view on a key set of recommended practices for the planning and conduct of SRs in the environmental health sciences. METHODS: A draft set of recommendations was derived from two existing standards for SRs in biomedicine and developed in a consensus process, which engaged international participation from government, industry, non-government organisations, and academia. The consensus process consisted of a workshop, follow-up webinars, email discussion and bilateral phone calls. RESULTS: The Conduct of Systematic Reviews in Toxicology and Environmental Health Research (COSTER) recommendations cover 70 SR practices across eight performance domains. Detailed explanations for specific recommendations are made for those identified by the authors as either being novel to SR in general, specific to the environmental health SR context, or potentially controversial to environmental health SR stakeholders. DISCUSSION: COSTER provides a set of recommendations that should facilitate the production of credible, high-value SRs of environmental health evidence, and advance discussion of a number of controversial aspects of conduct of EH SRs. Key recommendations include the management of conflicts of interest, handling of grey literature, and protocol registration and publication. A process for advancing from COSTER's recommendations to developing a formal standard for EH SRs is also indicated.

Methodology for health risk assessment of combined exposures to multiple chemicals.

Focus on risks to human health and the environment from combined exposure to multiple chemicals ("mixture risk assessment") has increased in the last couple of decades. There has been a rise in awareness and concern in the community, especially concerning unintentional environmental exposure to unknown chemical mixtures. The Horizon 2020 project EuroMix has developed methodologies and tools for mixture risk assessment with a focus on component-based approach where substances are grouped based on toxicological considerations. Dose addition is used as the model for calculating the combined toxicity of mixture components. The methodology is anchored in the Adverse Outcome Pathway (AOP) concept, which provides a structured basis for e.g. grouping substances into assessment groups and identifying and collecting relevant toxicity data. The aim of this paper is to describes development of the methodology for mixture risk assessment and to provide detailed methodology for problem formulation, use of AOP networks for development of tiered testing strategies and grouping of substances, as well as considerations for use of dose addition methodology.