Mixtures-Inclusive In Silico Models of Ocular Toxicity Based on United States and International Hazard Categories.

Computational modeling grounded in reliable experimental data can help design effective non-animal approaches to predict the eye irritation and corrosion potential of chemicals. The National Toxicology Program (NTP) Interagency Center for the Evaluation of Alternative Toxicological Methods (NICEATM) has compiled and curated a database of in vivo eye irritation studies from the scientific literature and from stakeholder-provided data. The database contains 810 annotated records of 593 unique substances, including mixtures, categorized according to UN GHS and US EPA hazard classifications. This study reports a set of in silico models to predict EPA and GHS hazard classifications for chemicals and mixtures, accounting for purity by setting thresholds of 100% and 10% concentration. We used two approaches to predict classification of mixtures: conventional and mixture-based. Conventional models evaluated substances based on the chemical structure of its major component. These models achieved balanced accuracy in the range of 68-80% and 87-96% for the 100% and 10% test concentration thresholds, respectively. Mixture-based models, which accounted for all known components in the substance by weighted feature averaging, showed similar or slightly higher accuracy of 72-79% and 89-94% for the respective thresholds. We also noted a strong trend between the pH feature metric calculated for each substance and its activity. Across all the models, the calculated pH of inactive substances was within one log10 unit of neutral pH, on average, while for active substances, pH varied from neutral by at least 2 log10 units. This pH dependency is especially important for complex mixtures. Additional evaluation on an external test set of 673 substances obtained from ECHA dossiers achieved balanced accuracies of 64-71%, which suggests that these models can be useful in screening compounds for ocular irritation potential. Negative predictive value was particularly high and indicates the potential application of these models in a bottom-up approach to identify nonirritant substances.

Development and Validation of a Computational Model for Androgen Receptor Activity.

Testing thousands of chemicals to identify potential androgen receptor (AR) agonists or antagonists would cost millions of dollars and take decades to complete using current validated methods. High-throughput in vitro screening (HTS) and computational toxicology approaches can more rapidly and inexpensively identify potential androgen-active chemicals. We integrated 11 HTS ToxCast/Tox21 in vitro assays into a computational network model to distinguish true AR pathway activity from technology-specific assay interference. The in vitro HTS assays probed perturbations of the AR pathway at multiple points (receptor binding, coregulator recruitment, gene transcription, and protein production) and multiple cell types. Confirmatory in vitro antagonist assay data and cytotoxicity information were used as additional flags for potential nonspecific activity. Validating such alternative testing strategies requires high-quality reference data. We compiled 158 putative androgen-active and -inactive chemicals from a combination of international test method validation efforts and semiautomated systematic literature reviews. Detailed in vitro assay information and results were compiled into a single database using a standardized ontology. Reference chemical concentrations that activated or inhibited AR pathway activity were identified to establish a range of potencies with reproducible reference chemical results. Comparison with existing Tier 1 AR binding data from the U.S. EPA Endocrine Disruptor Screening Program revealed that the model identified binders at relevant test concentrations (<100 µM) and was more sensitive to antagonist activity. The AR pathway model based on the ToxCast/Tox21 assays had balanced accuracies of 95.2% for agonist (n = 29) and 97.5% for antagonist (n = 28) reference chemicals. Out of 1855 chemicals screened in the AR pathway model, 220 chemicals demonstrated AR agonist or antagonist activity and an additional 174 chemicals were predicted to have potential weak AR pathway activity.

In Silico Prediction of Physicochemical Properties of Environmental Chemicals Using Molecular Fingerprints and Machine Learning.

There are little available toxicity data on the vast majority of chemicals in commerce. High-throughput screening (HTS) studies, such as those being carried out by the U.S. Environmental Protection Agency (EPA) ToxCast program in partnership with the federal Tox21 research program, can generate biological data to inform models for predicting potential toxicity. However, physicochemical properties are also needed to model environmental fate and transport, as well as exposure potential. The purpose of the present study was to generate an open-source quantitative structure-property relationship (QSPR) workflow to predict a variety of physicochemical properties that would have cross-platform compatibility to integrate into existing cheminformatics workflows. In this effort, decades-old experimental property data sets available within the EPA EPI Suite were reanalyzed using modern cheminformatics workflows to develop updated QSPR models capable of supplying computationally efficient, open, and transparent HTS property predictions in support of environmental modeling efforts. Models were built using updated EPI Suite data sets for the prediction of six physicochemical properties: octanol-water partition coefficient (logP), water solubility (logS), boiling point (BP), melting point (MP), vapor pressure (logVP), and bioconcentration factor (logBCF). The coefficient of determination (R2) between the estimated values and experimental data for the six predicted properties ranged from 0.826 (MP) to 0.965 (BP), with model performance for five of the six properties exceeding those from the original EPI Suite models. The newly derived models can be employed for rapid estimation of physicochemical properties within an open-source HTS workflow to inform fate and toxicity prediction models of environmental chemicals.

Screening Chemicals for Estrogen Receptor Bioactivity Using a Computational Model.

The U.S. Environmental Protection Agency (EPA) is considering high-throughput and computational methods to evaluate the endocrine bioactivity of environmental chemicals. Here we describe a multistep, performance-based validation of new methods and demonstrate that these new tools are sufficiently robust to be used in the Endocrine Disruptor Screening Program (EDSP). Results from 18 estrogen receptor (ER) ToxCast high-throughput screening assays were integrated into a computational model that can discriminate bioactivity from assay-specific interference and cytotoxicity. Model scores range from 0 (no activity) to 1 (bioactivity of 17ß-estradiol). ToxCast ER model performance was evaluated for reference chemicals, as well as results of EDSP Tier 1 screening assays in current practice. The ToxCast ER model accuracy was 86% to 93% when compared to reference chemicals and predicted results of EDSP Tier 1 guideline and other uterotrophic studies with 84% to 100% accuracy. The performance of high-throughput assays and ToxCast ER model predictions demonstrates that these methods correctly identify active and inactive reference chemicals, provide a measure of relative ER bioactivity, and rapidly identify chemicals with potential endocrine bioactivities for additional screening and testing. EPA is accepting ToxCast ER model data for 1812 chemicals as alternatives for EDSP Tier 1 ER binding, ER transactivation, and uterotrophic assays.

Open-source QSAR models for pKa prediction using multiple machine learning approaches.

BACKGROUND: The logarithmic acid dissociation constant pKa reflects the ionization of a chemical, which affects lipophilicity, solubility, protein binding, and ability to pass through the plasma membrane. Thus, pKa affects chemical absorption, distribution, metabolism, excretion, and toxicity properties. Multiple proprietary software packages exist for the prediction of pKa, but to the best of our knowledge no free and open-source programs exist for this purpose. Using a freely available data set and three machine learning approaches, we developed open-source models for pKa prediction. METHODS: The experimental strongest acidic and strongest basic pKa values in water for 7912 chemicals were obtained from DataWarrior, a freely available software package. Chemical structures were curated and standardized for quantitative structure-activity relationship (QSAR) modeling using KNIME, and a subset comprising 79% of the initial set was used for modeling. To evaluate different approaches to modeling, several datasets were constructed based on different processing of chemical structures with acidic and/or basic pKas. Continuous molecular descriptors, binary fingerprints, and fragment counts were generated using PaDEL, and pKa prediction models were created using three machine learning methods, (1) support vector machines (SVM) combined with k-nearest neighbors (kNN), (2) extreme gradient boosting (XGB) and (3) deep neural networks (DNN). RESULTS: The three methods delivered comparable performances on the training and test sets with a root-mean-squared error (RMSE) around 1.5 and a coefficient of determination (R2) around 0.80. Two commercial pKa predictors from ACD/Labs and ChemAxon were used to benchmark the three best models developed in this work, and performance of our models compared favorably to the commercial products. CONCLUSIONS: This work provides multiple QSAR models to predict the strongest acidic and strongest basic pKas of chemicals, built using publicly available data, and provided as free and open-source software on GitHub.

The US Federal Tox21 Program: A strategic and operational plan for continued leadership.

The traditional approaches to toxicity testing have posed multiple challenges for evaluating the safety of commercial chemicals, pesticides, food additives/contaminants, and medical products.The challenges include number of chemicals that need to be tested, time and resource intensive nature of traditional toxicity tests, and unexpected adverse effects that occur in pharmaceutical clinical trials despite the extensive toxicological testing.Over a decade ago, the U.S. Environmental Protection Agency (EPA), National Toxicology Program (NTP), National Center for Advancing Translational Sciences (NCATS), and the Food and Drug Administration (FDA) formed a federal consortium for "Toxicology in the 21st Century" (Tox21) with a focus on developing and evaluating in vitro high-throughput screening (HTS) methods for hazard identification and providing mechanistic insights.The Tox21 consortium generated data on thousands of pharmaceuticals and datapoor chemicals, developed better understanding of the limits and applications of in vitro methods, and enabled incorporation of HTS data into regulatory decisions. To more broadly address the challenges in toxicology, Tox21 has developed a new strategic and operational plan that expands the focus of its research activities. The new focus areas include developing an expanded portfolio of alternative test systems, addressing technical limitations of in vitrotest systems, curating legacy in vivo toxicity testing data, establishing scientific confidence in the in vitrotest systems, and refining alternative methods for characterizing pharmacokinetics and in vitro assay disposition.The new Tox21 strategic and operational plan addresses key challenges to advance toxicology testing and will benefit both the organizations involved and the toxicology community.

Evaluation and Optimization of Pharmacokinetic Models for in Vitro to in Vivo Extrapolation of Estrogenic Activity for Environmental Chemicals.

BACKGROUND: To effectively incorporate in vitro data into regulatory use, confidence must be established in the quantitative extrapolation of in vitro activity to relevant end points in animals or humans. OBJECTIVE: Our goal was to evaluate and optimize in vitro to in vivo extrapolation (IVIVE) approaches using in vitro estrogen receptor (ER) activity to predict estrogenic effects measured in rodent uterotrophic studies. METHODS: We evaluated three pharmacokinetic (PK) models with varying complexities to extrapolate in vitro to in vivo dosimetry for a group of 29 ER agonists, using data from validated in vitro [U.S. Environmental Protection Agency (U.S. EPA) ToxCast™ ER model] and in vivo (uterotrophic) methods. In vitro activity values were adjusted using mass-balance equations to estimate intracellular exposure via an enrichment factor (EF), and steady-state model calculations were adjusted using fraction of unbound chemical in the plasma ([Formula: see text]) to approximate bioavailability. Accuracy of each model-adjustment combination was assessed by comparing model predictions with lowest effect levels (LELs) from guideline uterotrophic studies. RESULTS: We found little difference in model predictive performance based on complexity or route-specific modifications. Simple adjustments, applied to account for in vitro intracellular exposure (EF) or chemical bioavailability ([Formula: see text]), resulted in significant improvements in the predictive performance of all models. CONCLUSION: Computational IVIVE approaches accurately estimate chemical exposure levels that elicit positive responses in the rodent uterotrophic bioassay. The simplest model had the best overall performance for predicting both oral (PPK_EF) and injection (PPK_[Formula: see text]) LELs from guideline uterotrophic studies, is freely available, and can be parameterized entirely using freely available in silico tools. https://doi.org/10.1289/EHP1655.

In vitro to in vivo extrapolation for high throughput prioritization and decision making.

In vitro chemical safety testing methods offer the potential for efficient and economical tools to provide relevant assessments of human health risk. To realize this potential, methods are needed to relate in vitro effects to in vivo responses, i.e., in vitro to in vivo extrapolation (IVIVE). Currently available IVIVE approaches need to be refined before they can be utilized for regulatory decision-making. To explore the capabilities and limitations of IVIVE within this context, the U.S. Environmental Protection Agency Office of Research and Development and the National Toxicology Program Interagency Center for the Evaluation of Alternative Toxicological Methods co-organized a workshop and webinar series. Here, we integrate content from the webinars and workshop to discuss activities and resources that would promote inclusion of IVIVE in regulatory decision-making. We discuss properties of models that successfully generate predictions of in vivo doses from effective in vitro concentration, including the experimental systems that provide input parameters for these models, areas of success, and areas for improvement to reduce model uncertainty. Finally, we provide case studies on the uses of IVIVE in safety assessments, which highlight the respective differences, information requirements, and outcomes across various approaches when applied for decision-making.

Application of Adverse Outcome Pathways to U.S. EPA's Endocrine Disruptor Screening Program.

BACKGROUND: The U.S. EPA's Endocrine Disruptor Screening Program (EDSP) screens and tests environmental chemicals for potential effects in estrogen, androgen, and thyroid hormone pathways, and it is one of the only regulatory programs designed around chemical mode of action. OBJECTIVES: This review describes the EDSP's use of adverse outcome pathway (AOP) and toxicity pathway frameworks to organize and integrate diverse biological data for evaluating the endocrine activity of chemicals. Using these frameworks helps to establish biologically plausible links between endocrine mechanisms and apical responses when those end points are not measured in the same assay. RESULTS: Pathway frameworks can facilitate a weight of evidence determination of a chemical's potential endocrine activity, identify data gaps, aid study design, direct assay development, and guide testing strategies. Pathway frameworks also can be used to evaluate the performance of computational approaches as alternatives for low-throughput and animal-based assays and predict downstream key events. In cases where computational methods can be validated based on performance, they may be considered as alternatives to specific assays or end points. CONCLUSIONS: A variety of biological systems affect apical end points used in regulatory risk assessments, and without mechanistic data, an endocrine mode of action cannot be determined. Because the EDSP was designed to consider mode of action, toxicity pathway and AOP concepts are a natural fit. Pathway frameworks have diverse applications to endocrine screening and testing. An estrogen pathway example is presented, and similar approaches are being used to evaluate alternative methods and develop predictive models for androgen and thyroid pathways. https://doi.org/10.1289/EHP1304.

An Integrated Chemical Environment to Support 21st-Century Toxicology.

SUMMARY: Access to high-quality reference data is essential for the development, validation, and implementation of in vitro and in silico approaches that reduce and replace the use of animals in toxicity testing. Currently, these data must often be pooled from a variety of disparate sources to efficiently link a set of assay responses and model predictions to an outcome or hazard classification. To provide a central access point for these purposes, the National Toxicology Program Interagency Center for the Evaluation of Alternative Toxicological Methods developed the Integrated Chemical Environment (ICE) web resource. The ICE data integrator allows users to retrieve and combine data sets and to develop hypotheses through data exploration. Open-source computational workflows and models will be available for download and application to local data. ICE currently includes curated in vivo test data, reference chemical information, in vitro assay data (including Tox21TM/ToxCast™ high-throughput screening data), and in silico model predictions. Users can query these data collections focusing on end points of interest such as acute systemic toxicity, endocrine disruption, skin sensitization, and many others. ICE is publicly accessible at https://ice.ntp.niehs.nih.gov. https://doi.org/10.1289/EHP1759.

Advances in the Development and Validation of Test Methods in the United States.

The National Toxicology Program Interagency Center for the Evaluation of Alternative Toxicological Methods (NICEATM) provides validation support for US Federal agencies and the US Tox21 interagency consortium, an interagency collaboration that is using high throughput screening (HTS) and other advanced approaches to better understand and predict chemical hazards to humans and the environment. The use of HTS data from assays relevant to the estrogen receptor signaling data pathway is used as an example of how HTS data can be combined with computational modeling to meet the needs of US agencies. As brief summary of US efforts in the areas of biologics testing, acute toxicity, and skin sensitization will also be provided.

A Curated Database of Rodent Uterotrophic Bioactivity.

BACKGROUND: Novel in vitro methods are being developed to identify chemicals that may interfere with estrogen receptor (ER) signaling, but the results are difficult to put into biological context because of reliance on reference chemicals established using results from other in vitro assays and because of the lack of high-quality in vivo reference data. The Organisation for Economic Co-operation and Development (OECD)-validated rodent uterotrophic bioassay is considered the "gold standard" for identifying potential ER agonists. OBJECTIVES: We performed a comprehensive literature review to identify and evaluate data from uterotrophic studies and to analyze study variability. METHODS: We reviewed 670 articles with results from 2,615 uterotrophic bioassays using 235 unique chemicals. Study descriptors, such as species/strain, route of administration, dosing regimen, lowest effect level, and test outcome, were captured in a database of uterotrophic results. Studies were assessed for adherence to six criteria that were based on uterotrophic regulatory test guidelines. Studies meeting all six criteria (458 bioassays on 118 unique chemicals) were considered guideline-like (GL) and were subsequently analyzed. RESULTS: The immature rat model was used for 76% of the GL studies. Active outcomes were more prevalent across rat models (74% active) than across mouse models (36% active). Of the 70 chemicals with at least two GL studies, 18 (26%) had discordant outcomes and were classified as both active and inactive. Many discordant results were attributable to differences in study design (e.g., injection vs. oral dosing). CONCLUSIONS: This uterotrophic database provides a valuable resource for understanding in vivo outcome variability and for evaluating the performance of in vitro assays that measure estrogenic activity. CITATION: Kleinstreuer NC, Ceger PC, Allen DG, Strickland J, Chang X, Hamm JT, Casey WM. 2016. A curated database of rodent uterotrophic bioactivity. Environ Health Perspect 124:556-562; http://dx.doi.org/10.1289/ehp.1510183.

Selective PPARdelta agonist treatment increases skeletal muscle lipid metabolism without altering mitochondrial energy coupling: an in vivo magnetic resonance spectroscopy study.

Peroxisome proliferator-activated receptor-delta (PPARdelta) activation results in upregulation of genes associated with skeletal muscle fatty acid oxidation and mitochondrial uncoupling. However, direct, noninvasive assessment of lipid metabolism and mitochondrial energy coupling in skeletal muscle following PPARdelta stimulation has not been examined. Therefore, in this study we examined the response of a selective PPARdelta agonist (GW610742X at 5 or 100 mg.kg(-1).day(-1) for 8 days) on skeletal-muscle lipid metabolism and mitochondrial coupling efficiency in rats by using in vivo magnetic resonance spectroscopy (MRS). There was a decrease in the intramyocellular lipid-to-total creatine ratio as assessed by in vivo (1)H-MRS in soleus and tibialis anterior muscles by day 7 (reduced by 49 and 46%, respectively; P < 0.01) at the high dose. Following the (1)H-MRS experiment (day 8), [1-(13)C]glucose was administered to conscious rats to assess metabolism in the soleus muscle. The relative fat-vs.-carbohydrate oxidation rate increased in a dose-dependent manner (increased by 52 and 93% in the 5 and 100 mg.kg(-1).day(-1) groups, respectively; P < 0.05). In separate experiments where mitochondrial coupling was assessed in vivo (day 7), (31)P-MRS was used to measure hindlimb ATP synthesis and (13)C-MRS was used to measure the hindlimb tricarboxylic acid cycle flux (V(tca)). There was no alteration, at either dose, in mitochondrial coupling efficiency measured as the ratio of unidirectional ATP synthesis flux to V(tca). Soleus muscle GLUT4 expression was decreased by twofold, whereas pyruvate dehydrogenase kinase 4, carnitine palmitoyl transferase 1a, and uncoupling protein 2 and 3 expression was increased by two- to threefold at the high dose (P < 0.05). In summary, these are the first noninvasive measurements illustrating a selective PPARdelta-mediated decrease in muscle lipid content that was consistent with a shift in metabolic substrate utilization from carbohydrate to lipid. However, the mitochondrial-energy coupling efficiency was not altered in the presence of increased uncoupling protein expression.

Toxicogenomics, drug discovery, and the pathologist.

The field of toxicogenomics, which currently focuses on the application of large-scale differential gene expression (DGE) data to toxicology, is starting to influence drug discovery and development in the pharmaceutical industry. Toxicological pathologists, who play key roles in the development of therapeutic agents, have much to contribute to DGE studies, especially in the experimental design and interpretation phases. The intelligent application of DGE to drug discovery can reveal the potential for both desired (therapeutic) and undesired (toxic) responses. The pathologist's understanding of anatomic, physiologic, biochemical, immune, and other underlying factors that drive mechanisms of tissue responses to noxious agents turns a bewildering array of gene expression data into focused research programs. The latter process is critical for the successful application of DGE to toxicology. Pattern recognition is a useful first step, but mechanistically based DGE interpretation is where the long-term future of these new technologies lies. Pathologists trained to carry out such interpretations will become important members of the research teams needed to successfully apply these technologies to drug discovery and safety assessment. As a pathologist using DGE, you will need to learn to read DGE data in the same way you learned to read glass slides, patiently and with a desire to learn and, later, to teach. In return, you will gain a greater depth of understanding of cell and tissue function, both in health and disease.