Standardizing Extracted Data Using Automated Application of Controlled Vocabularies.

BACKGROUND: Extraction of toxicological end points from primary sources is a central component of systematic reviews and human health risk assessments. To ensure optimal use of these data, consistent language should be used for end point descriptions. However, primary source language describing treatment-related end points can vary greatly, resulting in large labor efforts to manually standardize extractions before data are fit for use. OBJECTIVES: To minimize these labor efforts, we applied an augmented intelligence approach and developed automated tools to support standardization of extracted information via application of preexisting controlled vocabularies. METHODS: We created and applied a harmonized controlled vocabulary crosswalk, consisting of Unified Medical Language System (UMLS) codes, German Federal Institute for Risk Assessment (BfR) DevTox harmonized terms, and The Organization for Economic Co-operation and Development (OECD) end point vocabularies, to roughly 34,000 extractions from prenatal developmental toxicology studies conducted by the National Toxicology Program (NTP) and 6,400 extractions from European Chemicals Agency (ECHA) prenatal developmental toxicology studies, all recorded based on the original study report language. RESULTS: We automatically applied standardized controlled vocabulary terms to 75% of the NTP extracted end points and 57% of the ECHA extracted end points. Of all the standardized extracted end points, about half (51%) required manual review for potential extraneous matches or inaccuracies. Extracted end points that were not mapped to standardized terms tended to be too general or required human logic to find a good match. We estimate that this augmented intelligence approach saved >350 hours of manual effort and yielded valuable resources including a controlled vocabulary crosswalk, organized related terms lists, code for implementing an automated mapping workflow, and a computationally accessible dataset. DISCUSSION: Augmenting manual efforts with automation tools increased the efficiency of producing a findable, accessible, interoperable, and reusable (FAIR) dataset of regulatory guideline studies. This open-source approach can be readily applied to other legacy developmental toxicology datasets, and the code design is customizable for other study types. https://doi.org/10.1289/EHP13215.

Interlaboratory Study on Zebrafish in Toxicology: Systematic Evaluation of the Application of Zebrafish in Toxicology's (SEAZIT's) Evaluation of Developmental Toxicity.

Embryonic zebrafish represent a useful test system to screen substances for their ability to perturb development. The exposure scenarios, endpoints captured, and data analysis vary among the laboratories who conduct screening. A lack of harmonization impedes the comparison of the substance potency and toxicity outcomes across laboratories and may hinder the broader adoption of this model for regulatory use. The Systematic Evaluation of the Application of Zebrafish in Toxicology (SEAZIT) initiative was developed to investigate the sources of variability in toxicity testing. This initiative involved an interlaboratory study to determine whether experimental parameters altered the developmental toxicity of a set of 42 substances (3 tested in duplicate) in three diverse laboratories. An initial dose-range-finding study using in-house protocols was followed by a definitive study using four experimental conditions: chorion-on and chorion-off using both static and static renewal exposures. We observed reasonable agreement across the three laboratories as 33 of 42 test substances (78.6%) had the same activity call. However, the differences in potency seen using variable in-house protocols emphasizes the importance of harmonization of the exposure variables under evaluation in the second phase of this study. The outcome of the Def will facilitate future practical discussions on harmonization within the zebrafish research community.

Systematic Evaluation of the Application of Zebrafish in Toxicology (SEAZIT): Developing a Data Analysis Pipeline for the Assessment of Developmental Toxicity with an Interlaboratory Study.

The embryonic zebrafish is a useful vertebrate model for assessing the effects of substances on growth and development. However, cross-laboratory developmental toxicity outcomes can vary and reported developmental defects in zebrafish may not be directly comparable between laboratories. To address these limitations for gaining broader adoption of the zebrafish model for toxicological screening, we established the Systematic Evaluation of the Application of Zebrafish in Toxicology (SEAZIT) program to investigate how experimental protocol differences can influence chemical-mediated effects on developmental toxicity (i.e., mortality and the incidence of altered phenotypes). As part of SEAZIT, three laboratories were provided a common and blinded dataset (42 substances) to evaluate substance-mediated effects on developmental toxicity in the embryonic zebrafish model. To facilitate cross-laboratory comparisons, all the raw experimental data were collected, stored in a relational database, and analyzed with a uniform data analysis pipeline. Due to variances in laboratory-specific terminology for altered phenotypes, we utilized ontology terms available from the Ontology Lookup Service (OLS) for Zebrafish Phenotype to enable additional cross-laboratory comparisons. In this manuscript, we utilized data from the first phase of screening (dose range finding, DRF) to highlight the methodology associated with the development of the database and data analysis pipeline, as well as zebrafish phenotype ontology mapping.

Evaluation of the fish acute toxicity test for pesticide registration.

The U.S. Environmental Protection Agency (USEPA) uses the in vivo fish acute toxicity test to assess potential risk of substances to non-target aquatic vertebrates. The test is typically conducted on a cold and a warm freshwater species and a saltwater species for a conventional pesticide registration, potentially requiring upwards of 200 or more fish. A retrospective data evaluation was conducted to explore the potential for using fewer fish species to support conventional pesticide risk assessments. Lethal concentration 50% (LC50) values and experimental details were extracted and curated from 718 studies on fish acute toxicity submitted to USEPA. The LC50 data were analysed to determine, when possible, the relative sensitivity of the tested species to each pesticide. One of the tested freshwater species was most sensitive in 85% of those cases. The tested cold freshwater species was the most sensitive overall among cases with established relative sensitivity and was within 3X of the LC50 value of the most sensitive species tested in 98% of those cases. The results support potentially using fewer than three fish species to conduct ecological risk assessments for the registration of conventional pesticides.

Confirmation of high-throughput screening data and novel mechanistic insights into FXR-xenobiotic interactions by orthogonal assays.

Toxicology in the 21st Century (Tox21) is a federal collaboration employing a high-throughput robotic screening system to test 10,000 environmental chemicals. One of the primary goals of the program is prioritizing toxicity evaluations through in vitro high-throughput screening (HTS) assays for large numbers of chemicals already in commercial use for which little or no toxicity data is available. Within the Tox21 screening program, disruption in nuclear receptor (NR) signaling represents a particular area of interest. Given the role of NR's in modulating a wide range of biological processes, alterations of their activity can have profound biological impacts. Farnesoid X receptor (FXR) is a member of the nuclear receptor superfamily that has demonstrated importance in bile acid homeostasis, glucose metabolism, lipid homeostasis and hepatic regeneration. In this study, we re-evaluated 24 FXR agonists and antagonists identified through Tox21 using select orthogonal assays. In transient transactivation assays, 7/8 putative agonists and 4/4 putative inactive compounds were confirmed. Likewise, we confirmed 9/12 antagonists tested. Using a mammalian two hybrid approach we demonstrate that both FXR agonists and antagonists facilitate FXRα-coregulator interactions suggesting that differential coregulator recruitment may mediate activation/repression of FXRα mediated transcription. Additionally, we tested the ability of select FXR agonists and antagonists to facilitate hepatic transcription of FXR gene targets Shp and Bsep in a teleost (Medaka) model. Through application of in vitro cell-based assays, in silico modeling and in vivo gene expressions, we demonstrated the molecular complexity of FXR:ligand interactions and confirmed the ability of diverse ligands to modulate FXRα, facilitate differential coregulator recruitment and activate/repress receptor-mediated transcription. Overall, we suggest a multiplicative approach to assessment of nuclear receptor function may facilitate a greater understanding of the biological and mechanistic complexities of nuclear receptor activities and further our ability to interpret broad HTS outcomes.

Implementation of Zebrafish Ontologies for Toxicology Screening.

Toxicological evaluation of chemicals using early-life stage zebrafish (Danio rerio) involves the observation and recording of altered phenotypes. Substantial variability has been observed among researchers in phenotypes reported from similar studies, as well as a lack of consistent data annotation, indicating a need for both terminological and data harmonization. When examined from a data science perspective, many of these apparent differences can be parsed into the same or similar endpoints whose measurements differ only in time, methodology, or nomenclature. Ontological knowledge structures can be leveraged to integrate diverse data sets across terminologies, scales, and modalities. Building on this premise, the National Toxicology Program's Systematic Evaluation of the Application of Zebrafish in Toxicology undertook a collaborative exercise to evaluate how the application of standardized phenotype terminology improved data consistency. To accomplish this, zebrafish researchers were asked to assess images of zebrafish larvae for morphological malformations in two surveys. In the first survey, researchers were asked to annotate observed malformations using their own terminology. In the second survey, researchers were asked to annotate the images from a list of terms and definitions from the Zebrafish Phenotype Ontology. Analysis of the results suggested that the use of ontology terms increased consistency and decreased ambiguity, but a larger study is needed to confirm. We conclude that utilizing a common data standard will not only reduce the heterogeneity of reported terms but increases agreement and repeatability between different laboratories. Thus, we advocate for the development of a zebrafish phenotype atlas to help laboratories create interoperable, computable data.

Performance of the GHS Mixtures Equation for Predicting Acute Oral Toxicity.

Acute oral toxicity classifications are based on the estimated chemical dose causing lethality in 50 % of laboratory animals tested (LD50). Given the large number of pesticide registration applications that require acute toxicity data, an alternative to the in vivo test could greatly reduce animal testing. The United Nations Globally Harmonized System of Classification and Labelling of Chemicals (GHS) Mixtures Equation estimates the acute toxicity of mixtures using the toxicities of mixture components. The goal of this study was to evaluate the concordance of LD50s predicted using the GHS Mixtures Equation and LD50s from the in vivo test results. Using the EPA classification system, concordance was 55 % for the full dataset (N = 671), 52 % for agrochemical formulations (N = 620), and 84 % for antimicrobial cleaning products (N = 51). Most discordant results were from substances LD50 > 2000 mg/kg (limit test) or 2000 < LD50 < 5000 mg/kg that were predicted as LD50 > 5000 mg/kg. A supplementary analysis combining all formulations with an LD50 > 500 mg/kg produced a concordance of 82 %. The lack of more toxic formulations in this dataset prevented a thorough evaluation of the GHS equation for such substances. Accordingly, our results suggest the GHS equation is helpful to predict the toxicity of mixtures, particularly those with lower toxicity.

Characterizing sources of variability in zebrafish embryo screening protocols.

There is a need for fast, efficient, and cost-effective hazard identification and characterization of chemical hazards. This need is generating increased interest in the use of zebrafish embryos as both a screening tool and an alternative to mammalian test methods. A Collaborative Workshop on Aquatic Models and 21st Century Toxicology identified the lack of appropriate and consistent testing protocols as a challenge to the broader application of the zebrafish embryo model. The National Toxicology Program established the Systematic Evaluation of the Application of Zebrafish in Toxicology (SEAZIT) initiative to address the lack of consistent testing guidelines and identify sources of variability for zebrafish-based assays. This report summarizes initial SEAZIT information-gathering efforts. Investigators in academic, government, and industry laboratories that routinely use zebrafish embryos for chemical toxicity testing were asked about their husbandry practices and standard protocols. Information was collected about protocol components including zebrafish strains, feed, system water, disease surveillance, embryo exposure conditions, and endpoints. Literature was reviewed to assess issues raised by the investigators. Interviews revealed substantial variability across design parameters, data collected, and analysis procedures. The presence of the chorion and renewal of exposure media (static versus static-renewal) were identified as design parameters that could potentially influence study outcomes and should be investigated further with studies to determine chemical uptake from treatment solution into embryos. The information gathered in this effort provides a basis for future SEAZIT activities to promote more consistent practices among researchers using zebrafish embryos for toxicity evaluation.

Alternative approaches for identifying acute systemic toxicity: Moving from research to regulatory testing.

Acute systemic toxicity testing provides the basis for hazard labeling and risk management of chemicals. A number of international efforts have been directed at identifying non-animal alternatives for in vivo acute systemic toxicity tests. A September 2015 workshop, Alternative Approaches for Identifying Acute Systemic Toxicity: Moving from Research to Regulatory Testing, reviewed the state-of-the-science of non-animal alternatives for this testing and explored ways to facilitate implementation of alternatives. Workshop attendees included representatives from international regulatory agencies, academia, nongovernmental organizations, and industry. Resources identified as necessary for meaningful progress in implementing alternatives included compiling and making available high-quality reference data, training on use and interpretation of in vitro and in silico approaches, and global harmonization of testing requirements. Attendees particularly noted the need to characterize variability in reference data to evaluate new approaches. They also noted the importance of understanding the mechanisms of acute toxicity, which could be facilitated by the development of adverse outcome pathways. Workshop breakout groups explored different approaches to reducing or replacing animal use for acute toxicity testing, with each group crafting a roadmap and strategy to accomplish near-term progress. The workshop steering committee has organized efforts to implement the recommendations of the workshop participants.

Differential modulation of FXR activity by chlorophacinone and ivermectin analogs.

Chemicals that alter normal function of farnesoid X receptor (FXR) have been shown to affect the homeostasis of bile acids, glucose, and lipids. Several structural classes of environmental chemicals and drugs that modulated FXR transactivation were previously identified by quantitative high-throughput screening (qHTS) of the Tox21 10K chemical collection. In the present study, we validated the FXR antagonist activity of selected structural classes, including avermectin anthelmintics, dihydropyridine calcium channel blockers, 1,3-indandione rodenticides, and pyrethroid pesticides, using in vitro assay and quantitative structural-activity relationship (QSAR) analysis approaches. (Z)-Guggulsterone, chlorophacinone, ivermectin, and their analogs were profiled for their ability to alter CDCA-mediated FXR binding using a panel of 154 coregulator motifs and to induce or inhibit transactivation and coactivator recruitment activities of constitutive androstane receptor (CAR), liver X receptor alpha (LXRα), or pregnane X receptor (PXR). Our results showed that chlorophacinone and ivermectin had distinct modes of action (MOA) in modulating FXR-coregulator interactions and compound selectivity against the four aforementioned functionally-relevant nuclear receptors. These findings collectively provide mechanistic insights regarding compound activities against FXR and possible explanations for in vivo toxicological observations of chlorophacinone, ivermectin, and their analogs.

Advancing toxicology research using in vivo high throughput toxicology with small fish models.

Small freshwater fish models, especially zebrafish, offer advantages over traditional rodent models, including low maintenance and husbandry costs, high fecundity, genetic diversity, physiology similar to that of traditional biomedical models, and reduced animal welfare concerns. The Collaborative Workshop on Aquatic Models and 21st Century Toxicology was held at North Carolina State University on May 5-6, 2014, in Raleigh, North Carolina, USA. Participants discussed the ways in which small fish are being used as models to screen toxicants and understand mechanisms of toxicity. Workshop participants agreed that the lack of standardized protocols is an impediment to broader acceptance of these models, whereas development of standardized protocols, validation, and subsequent regulatory acceptance would facilitate greater usage. Given the advantages and increasing application of small fish models, there was widespread interest in follow-up workshops to review and discuss developments in their use. In this article, we summarize the recommendations formulated by workshop participants to enhance the utility of small fish species in toxicology studies, as well as many of the advances in the field of toxicology that resulted from using small fish species, including advances in developmental toxicology, cardiovascular toxicology, neurotoxicology, and immunotoxicology. We alsoreview many emerging issues that will benefit from using small fish species, especially zebrafish, and new technologies that will enable using these organisms to yield results unprecedented in their information content to better understand how toxicants affect development and health.

Quantitative high-throughput profiling of environmental chemicals and drugs that modulate farnesoid X receptor.

The farnesoid X receptor (FXR) regulates the homeostasis of bile acids, lipids, and glucose. Because endogenous chemicals bind and activate FXR, it is important to examine which xenobiotic compounds would disrupt normal receptor function. We used a cell-based human FXR ß-lactamase (Bla) reporter gene assay to profile the Tox21 10K compound collection of environmental chemicals and drugs. Structure-activity relationships of FXR-active compounds revealed by this screening were then compared against the androgen receptor, estrogen receptor α, peroxisome proliferator-activated receptors δ and γ, and the vitamin D receptor. We identified several FXR-active structural classes including anthracyclines, benzimidazoles, dihydropyridines, pyrethroids, retinoic acids, and vinca alkaloids. Microtubule inhibitors potently decreased FXR reporter gene activity. Pyrethroids specifically antagonized FXR transactivation. Anthracyclines affected reporter activity in all tested assays, suggesting non-specific activity. These results provide important information to prioritize chemicals for further investigation, and suggest possible modes of action of compounds in FXR signaling.